2025-10-15T10:53:12.081030Z :BasicWriteSession INFO: Random seed for debugging is 1760525592080962
2025-10-15T10:53:12.792085Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561399842804304319:2079];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:12.792139Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:12.979084Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T10:53:13.079338Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:13.105326Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7561399847477853033:2074];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:13.119573Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/001079/r3tmp/tmpMiBQnz/pdisk_1.dat
2025-10-15T10:53:13.200090Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:13.591429Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:13.592185Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:13.839879Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:13.839945Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:13.862942Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:13.864074Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:13.916791Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:13.916909Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:13.920421Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:13.920469Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:13.937165Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:13.939597Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T10:53:13.939890Z node 1 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [1:7561399842804304268:2082] 1760525592788487 != 1760525592788490
2025-10-15T10:53:13.964755Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:13.965148Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 15910, node 1
2025-10-15T10:53:14.171511Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:14.306297Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/001079/r3tmp/yandexNFkW2E.tmp
2025-10-15T10:53:14.306313Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/001079/r3tmp/yandexNFkW2E.tmp
2025-10-15T10:53:14.306419Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/001079/r3tmp/yandexNFkW2E.tmp
2025-10-15T10:53:14.306523Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:14.386506Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:14.442745Z INFO: TTestServer started on Port 8542 GrpcPort 15910
2025-10-15T10:53:14.500113Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:8542
PQClient connected to localhost:15910
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:15.281459Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:17.792339Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561399842804304319:2079];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:17.792409Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:18.106526Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7561399847477853033:2074];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:18.106609Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:20.807830Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:20.821129Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7561399872869076418:2325], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:20.823278Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=ZTk3YzA5MWUtZjgyNzU2YzYtYjQwZDkwNjMtNTM4YzAxYzE=, ActorId: [1:7561399872869076414:2322], ActorState: ExecuteState, TraceId: 01k7kr1gwz6y8yf12zfbb3m512, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:20.833485Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:20.835959Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7561399877542624410:2298], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:20.837647Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=YTFlYTQ1OGYtYTFlMGI0NTMtYTRkZTkzZTEtMWEyZmNhM2I=, ActorId: [2:7561399877542624408:2297], ActorState: ExecuteState, TraceId: 01k7kr1hev82swqmjqyqz8vacd, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:20.837966Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:21.180043Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:21.442313Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:15910", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:21.983982Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k7kr1jvddpsfdxqqec00f6sk, Database: , SessionId: ydb://session/3?node_id=1&id=MTcxNzQzMC05ZjYwNTViOS00MTAyNjk1Zi0xNTA4NjZmZQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561399885753978723:2922] 
=== CheckClustersList. Ok
2025-10-15T10:53:27.780526Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710673:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:15910
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:27.983664Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:15910
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:28.081781Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561399911523782954:3185] connected; active server actors: 1
2025-10-15T10:53:28.083220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:28.093998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:28.095152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:28.125821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:28.132131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:28.132357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:28.132409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:28.132442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:28.133438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399911523782953:3184], now have 1 active actors on pipe
2025-10-15T10:53:28.133460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399911523782983:2436], now have 1 active actors on pipe
2025-10-15T10:53:28.134068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:28.136637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T10:53:28.148070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:28.155912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399911523783016:3232], now have 1 active actors on pipe
2025-10-15T10:53:28.156574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:28.176031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:28.177156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:28.177231Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:28.177576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:28.177844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561399911902363316:2386]
2025-10-15T10:53:28.184668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:28.184701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:28.184739Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561399911902363316:2386]
2025-10-15T10:53:28.184776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:28.186071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:28.186117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:28.186219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.186228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:28.186247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:28.186257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.186266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.186274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:28.186325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:28.186628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:28.186729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:28.204058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:28.204193Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525608198, TxId 281474976710676
2025-10-15T10:53:28.204212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.204223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.204337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:28.204534Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:28.211848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:28.212129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:28.212158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:28.212168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.212177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:28.212199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:28.212523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:28.212610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:28.212907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:28.225085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:28.225195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:28.231842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:28.239618Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k7kr1s4x0bkdg3a6wqdm7n7j, Database: , SessionId: ydb://session/3?node_id=1&id=NjY5MzkwMTMtMzEzM2U5Yi00MzBlNzhiZi00ZjA0MzJiYg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525608198
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525608198
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:15910
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:28.283902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:28.283944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.283966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:28.289797Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:28.387464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:28.387502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.387522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:28.488508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:28.488529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.488536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:28.591578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:28.591605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.591614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:28.696531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:28.696556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.696564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:15910
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:28.798638Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-10-15T10:53:28.797277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:28.797304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.797313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:28.859861Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:28.859896Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:28.900058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:28.900088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:28.900103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.003444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.003473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.003481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.103520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.103543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.103552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.203805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.203827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.203836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.305058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.305083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.305094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:15910
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:29.333981Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:29.363855Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:29.364254Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:29.364290Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:15910
2025-10-15T10:53:29.380975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:29.381006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:29.404380Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:29.405204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:29.405367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:58896
2025-10-15T10:53:29.405445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58896 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:29.405464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:29.407481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:29.407583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.407606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.407614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.407615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:29.407635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:29.407643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:29.407657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399915818750471:2469] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:29.409751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399915818750471:2469] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:29.515606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.515633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.515642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.617242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.617268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.617277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.720539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.720565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.720573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.823829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.823857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.823864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.912389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399915818750471:2469] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:29.915533Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399915818750525:2469] connected; active server actors: 1
2025-10-15T10:53:29.915771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399915818750471:2469] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:29.915792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399915818750471:2469] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:29.924098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.924124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.924147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.927638Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399915818750525:2469] disconnected; active server actors: 1
2025-10-15T10:53:29.927669Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399915818750525:2469] disconnected no session
2025-10-15T10:53:30.027430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.027458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.027467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.112951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399915818750471:2469] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:30.112985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399915818750471:2469] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:30.113010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399915818750471:2469] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:30.113036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:30.118055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:30.115996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399920113717857:2469], now have 1 active actors on pipe
2025-10-15T10:53:30.118433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:30.118465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:30.118968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:30.119113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.119138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.119149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:30.119186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.119222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:30.119293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:30.121813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0
2025-10-15T10:53:30.122617Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525610122 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:30.122735Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:30.122922Z :INFO: [] MessageGroupId [src] SessionId [src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:30.122957Z :INFO: [] MessageGroupId [src] SessionId [src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0] Write session will now close
2025-10-15T10:53:30.123000Z :DEBUG: [] MessageGroupId [src] SessionId [src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0] Write session: aborting
2025-10-15T10:53:30.123376Z :INFO: [] MessageGroupId [src] SessionId [src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:30.123422Z :DEBUG: [] MessageGroupId [src] SessionId [src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0] Write session: destroy
2025-10-15T10:53:30.121405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:30.121434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:30.121519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:30.127319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.127340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.127361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.141479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399920113717857:2469] destroyed
2025-10-15T10:53:30.141511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:30.135717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0 grpc read done: success: 0 data: 
2025-10-15T10:53:30.135739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0 grpc read failed
2025-10-15T10:53:30.147415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.135766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0 grpc closed
2025-10-15T10:53:30.135784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d85e4bb9-86ef8e2b-5221561f-fb4edf94_0 is DEAD
2025-10-15T10:53:30.140754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:30.147468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.147480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
Got new write session event: ReadyToAcceptEvent
Got new write session event: ReadyToAcceptEvent
2025-10-15T10:53:30.228828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.228852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.228860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:53:30.238088Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:15910" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:15910" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:15910" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-15T10:53:30.251156Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:30.251566Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-15T10:53:30.257367Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-15T10:53:30.264300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:30.264331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-15T10:53:30.313967Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:53:30.314408Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-15T10:53:30.315029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:53:30.315182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:58914
2025-10-15T10:53:30.315199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:58914 proto=topic  topic=test-topic durationSec=0
2025-10-15T10:53:30.315210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:30.316633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-15T10:53:30.316730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:30.316739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:30.316748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:30.316762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399920113717871:2488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:30.318691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399920113717871:2488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:30.328196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399920113717871:2488] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:30.329659Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399920113717890:2488] connected; active server actors: 1
2025-10-15T10:53:30.329791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399920113717871:2488] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-15T10:53:30.329807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399920113717871:2488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:30.330874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.330898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.330908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.330632Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399920113717890:2488] disconnected; active server actors: 1
2025-10-15T10:53:30.330649Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399920113717890:2488] disconnected no session
2025-10-15T10:53:30.342305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399920113717871:2488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:30.342335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399920113717871:2488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:30.342348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399920113717871:2488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:30.342372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:30.344140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399920113717901:2488], now have 1 active actors on pipe
2025-10-15T10:53:30.344335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:30.344661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:30.344688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:30.344745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:53:30.344780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.344793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.344801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:30.344872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.344922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:30.344966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:30.345711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:30.345731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:30.345777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:30.346094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0
2025-10-15T10:53:30.347208Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:30.347324Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525610347 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:30.347493Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-15T10:53:30.347759Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-15T10:53:30.354012Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:30.354088Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-15T10:53:30.355888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:53:30.356157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:53:30.356725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:30.356758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:30.356828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:53:30.357312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:30.357736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:30.357763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:30.358056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 96 offset: -1
2025-10-15T10:53:30.358102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:53:30.358157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.358184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.358202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:30.358316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T10:53:30.359484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 170 count 1 nextOffset 1 batches 1
2025-10-15T10:53:30.359519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.360043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 158 WTime 1760525610359
2025-10-15T10:53:30.360187Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:30.360307Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 158
2025-10-15T10:53:30.368459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 158 actorID [2:7561399911902363296:2386]
2025-10-15T10:53:30.368512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:30.368560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 103 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:30.368598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:30.368639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-15T10:53:30.368846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:30.368867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:53:30.368882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.368891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.368898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.368946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:30.368982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-15T10:53:30.369087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T10:53:30.369295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 158 count 1 last offset 0, current partition end offset: 1
2025-10-15T10:53:30.369310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:53:30.369355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 158 accessed 0 times before, last time 2025-10-15T10:53:30.000000Z
2025-10-15T10:53:30.369399Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-15T10:53:30.369450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:53:30.369584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 138 from pos 0 cbcount 1
2025-10-15T10:53:30.369643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525610357 queuesize 0 startOffset 0
2025-10-15T10:53:30.370653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:30.371609Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:30.372311Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 9000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-15T10:53:30.372361Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-15T10:53:30.372395Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write session: acknoledged message 1
Got new write session event: AcksEvent: { seqNo : 1, State : EES_WRITTEN, offset : 0, partitionId : 0 } write stat: Write time 0.009000s minimal time in partition queue 0.001000s maximal time in partition queue 0.001000s partition quoted time 0.000000s topic quoted time 0.000000s
2025-10-15T10:53:30.372902Z :INFO: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-15T10:53:30.372955Z :INFO: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write session will now close
2025-10-15T10:53:30.373004Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write session: aborting
2025-10-15T10:53:30.373349Z :INFO: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:30.373381Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0]  MessageGroupId [src_id] Write session: destroy
2025-10-15T10:53:30.374696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0 grpc read done: success: 0 data: 
2025-10-15T10:53:30.374717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0 grpc read failed
2025-10-15T10:53:30.374749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0 grpc closed
2025-10-15T10:53:30.374764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|f5ef17ef-3961c0f2-edd83442-8a052015_0 is DEAD
2025-10-15T10:53:30.375465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:30.370344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 158
2025-10-15T10:53:30.370408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-15T10:53:30.388342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399920113717901:2488] destroyed
2025-10-15T10:53:30.388391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:30.388421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.388430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.388439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.434347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.434371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.434400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.534940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.534964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.534973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.972536Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399920113717940:2499]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-15T10:53:31.012062Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399920113717940:2499]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:31.135921Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399920113717940:2499]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:31.351642Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399920113717940:2499]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:31.564408Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399920113717940:2499]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:31.772265Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399920113717940:2499]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:32.189059Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399920113717940:2499]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:32.399548Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710688. Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:32.399668Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:248: ActorId: [1:7561399924408685268:2493] TxId: 281474976710688. Ctx: { TraceId: 01k7kr1vw19q4q8rx6p4gq1cxm, Database: /Root, SessionId: ydb://session/3?node_id=1&id=N2ZlYjY2M2QtNzAzMjZlOTctMjIzOTEzNDgtODE3ZWIyMjQ=, PoolId: }. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:32.399875Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2830: SessionId: ydb://session/3?node_id=1&id=N2ZlYjY2M2QtNzAzMjZlOTctMjIzOTEzNDgtODE3ZWIyMjQ=, ActorId: [1:7561399920113717916:2493], ActorState: ExecuteState, TraceId: 01k7kr1vw19q4q8rx6p4gq1cxm, Create QueryResponse for error on request, msg: 
2025-10-15T10:53:32.401280Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k7kr1wdf9t8ynjd8x6wgcyfv" } } YdbStatus: UNAVAILABLE ConsumedRu: 367 }
2025-10-15T10:53:32.911431Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399920113717940:2499]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:35.186177Z :CloseWriteSessionImmediately INFO: Random seed for debugging is 1760525615186163
2025-10-15T10:53:35.904503Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7561399941594799017:2072];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:35.851878Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7561399944228106020:2174];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:35.851926Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:35.947273Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:35.947991Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/001079/r3tmp/tmpKgT6W0/pdisk_1.dat
2025-10-15T10:53:36.043167Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:36.043405Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:36.074855Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:36.218360Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:36.407829Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:36.467208Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:36.527614Z node 4 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [4:7561399941594798981:2073] 1760525615879206 != 1760525615879203
2025-10-15T10:53:36.537587Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:36.664158Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:36.664297Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:36.665347Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:36.665404Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:36.693074Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:36.693702Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-15T10:53:36.743624Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:36.741762Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 62638, node 3
2025-10-15T10:53:36.851517Z node 4 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.017660s
2025-10-15T10:53:36.920104Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:36.920195Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:36.999496Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:37.034544Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/001079/r3tmp/yandex21AmTI.tmp
2025-10-15T10:53:37.034571Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/001079/r3tmp/yandex21AmTI.tmp
2025-10-15T10:53:37.034721Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/001079/r3tmp/yandex21AmTI.tmp
2025-10-15T10:53:37.034855Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:37.068781Z INFO: TTestServer started on Port 27950 GrpcPort 62638
TClient is connected to server localhost:27950
PQClient connected to localhost:62638
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:37.319524Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:40.851806Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7561399944228106020:2174];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:40.851881Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:40.891551Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7561399941594799017:2072];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:40.891623Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:41.985895Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7561399967364603112:2295], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:41.989713Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=YzgwMGMwYWMtZDk1Zjc2YjQtZmRlM2UwYTgtZjg1MjU1YWM=, ActorId: [4:7561399967364603110:2294], ActorState: ExecuteState, TraceId: 01k7kr26nx02jcckzh5jd11tt3, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:41.990165Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:42.149982Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7561399974292877992:2325], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:42.165422Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=YWFhNmE1NjQtM2M0MTIzZWItZjQyNzdkNDMtZmYzYzIyN2E=, ActorId: [3:7561399974292877989:2323], ActorState: ExecuteState, TraceId: 01k7kr26tcbnfgq142tezr10az, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:42.165841Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:42.201419Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:42.407987Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:42.571269Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:62638", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:43.304057Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k7kr27hebtcfkvs0v9jgdbz5, Database: , SessionId: ydb://session/3?node_id=3&id=ZDc4OGRkZTItNzFhZmE1YmQtNTdjYjM0ZGMtNDBkNGE4OWQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7561399978587845693:2923] 
=== CheckClustersList. Ok
2025-10-15T10:53:49.019497Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:62638
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:49.195700Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:62638
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:49.275964Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7561400004357649954:3212] connected; active server actors: 1
2025-10-15T10:53:49.276335Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:49.281375Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:49.281502Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:49.289815Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:49.295245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:49.295548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:49.295588Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:49.295623Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:49.299824Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400004357649953:3211], now have 1 active actors on pipe
2025-10-15T10:53:49.299862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400004357649980:2440], now have 1 active actors on pipe
2025-10-15T10:53:49.300973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:49.304324Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-15T10:53:49.308917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:49.319972Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400004357650012:3252], now have 1 active actors on pipe
2025-10-15T10:53:49.322262Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:49.326693Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:49.327907Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:49.327948Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:49.328226Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:49.328439Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7561400001724342042:2385]
2025-10-15T10:53:49.331318Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:49.345619Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:49.345681Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7561400001724342042:2385]
2025-10-15T10:53:49.345709Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:49.347213Z node 4 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:49.347242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.347316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.347326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:49.347342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:49.347374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.347385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.347396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:49.347426Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:49.347939Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:49.348106Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:49.354483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:49.354600Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525629359, TxId 281474976715676
2025-10-15T10:53:49.354619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.354628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.354722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.354907Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:49.357748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:49.357955Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:49.357976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.357986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.357995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.358022Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:49.358332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:49.358420Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:49.358660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:49.369357Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:49.369462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:49.372540Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:49.445622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.445657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.445670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.546031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.546065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.546077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.592240Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715679. Ctx: { TraceId: 01k7kr2dva308y0y2w2rw65hg4, Database: , SessionId: ydb://session/3?node_id=3&id=NzkxNzJlMWItMWYzNzllYzktNTY4NzhjYTItNTQ5MjU4Y2Q=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-15T10:53:49.646895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.646922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.646933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525629359
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525629359
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:62638
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:49.678855Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-15T10:53:49.751326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.751380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.751395Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.850662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.850685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.850695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.964404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.964429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.964439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.067177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.067204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.067213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.175563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.175593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.175605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:62638
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:50.185640Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:50.273874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.273902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.273914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.375643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.375682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.375693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.476198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.476223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.476233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.576200Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.576230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.576242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.676639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.676673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.676688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:62638
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:50.691421Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:50.718054Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:50.718472Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:50.718510Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:62638
2025-10-15T10:53:50.759947Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:50.760843Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:50.760868Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:50.761178Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:50.761259Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:47834
2025-10-15T10:53:50.761267Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:47834 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:50.761273Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:50.762349Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:50.762431Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:50.762438Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:50.762443Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:50.762453Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561400008652617517:2483] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:50.764544Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561400008652617517:2483] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:50.782434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.782459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.782469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.882414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.882447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.882459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.982749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.982797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.982816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.083556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.083582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.083594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.091068Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7561400008652617517:2483] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:51.092342Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400012947584861:2483] connected; active server actors: 1
2025-10-15T10:53:51.092614Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7561400008652617517:2483] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:51.092630Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400008652617517:2483] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:51.096036Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400012947584861:2483] disconnected; active server actors: 1
2025-10-15T10:53:51.096063Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400012947584861:2483] disconnected no session
2025-10-15T10:53:51.187717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.187745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.187756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.291754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.291777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.291788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.324836Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400008652617517:2483] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:51.324870Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561400008652617517:2483] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:51.324885Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400008652617517:2483] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:51.324911Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:51.326828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400012947584883:2483], now have 1 active actors on pipe
2025-10-15T10:53:51.330187Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:53:51.331239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:51.331273Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:51.331342Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|4ba67c74-b7829f7e-4da72361-f9a80913_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:51.331388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.331407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.331416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:51.331449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.331483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:51.331526Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:51.332389Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:51.332416Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:51.332484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:51.332901Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|4ba67c74-b7829f7e-4da72361-f9a80913_0
2025-10-15T10:53:51.333915Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525631333 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:51.334055Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|4ba67c74-b7829f7e-4da72361-f9a80913_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:51.335469Z :INFO: [] MessageGroupId [src] SessionId [src|4ba67c74-b7829f7e-4da72361-f9a80913_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:51.335518Z :INFO: [] MessageGroupId [src] SessionId [src|4ba67c74-b7829f7e-4da72361-f9a80913_0] Write session will now close
2025-10-15T10:53:51.335555Z :DEBUG: [] MessageGroupId [src] SessionId [src|4ba67c74-b7829f7e-4da72361-f9a80913_0] Write session: aborting
2025-10-15T10:53:51.335931Z :INFO: [] MessageGroupId [src] SessionId [src|4ba67c74-b7829f7e-4da72361-f9a80913_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:51.335967Z :DEBUG: [] MessageGroupId [src] SessionId [src|4ba67c74-b7829f7e-4da72361-f9a80913_0] Write session: destroy
2025-10-15T10:53:51.338607Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|4ba67c74-b7829f7e-4da72361-f9a80913_0 grpc read done: success: 0 data: 
2025-10-15T10:53:51.338631Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|4ba67c74-b7829f7e-4da72361-f9a80913_0 grpc read failed
2025-10-15T10:53:51.338653Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|4ba67c74-b7829f7e-4da72361-f9a80913_0 grpc closed
2025-10-15T10:53:51.338665Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|4ba67c74-b7829f7e-4da72361-f9a80913_0 is DEAD
2025-10-15T10:53:51.339209Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:51.340170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561400012947584883:2483] destroyed
2025-10-15T10:53:51.340209Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:51.340231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.340241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.340252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-15T10:53:51.404106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.404130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.404141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.505845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.505876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.505890Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.507673Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:51.507698Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:51.611231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.611276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.611289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.402426Z node 3 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [3:7561400017242552232:2496] TxId: 281474976715687. Ctx: { TraceId: 01k7kr2g0a1p4mahqk6p8yyeyc, Database: /Root, SessionId: ydb://session/3?node_id=3&id=NThhYTM2MzQtY2E3YjU0MGEtYTM5OTAwOTctMjVlM2MxN2E=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 4
2025-10-15T10:53:52.403033Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [3:7561400017242552241:2505], TxId: 281474976715687, task: 2. Ctx: { TraceId : 01k7kr2g0a1p4mahqk6p8yyeyc.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=3&id=NThhYTM2MzQtY2E3YjU0MGEtYTM5OTAwOTctMjVlM2MxN2E=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [3:7561400017242552232:2496], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-15T10:53:52.403393Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [3:7561400017242552242:2506], TxId: 281474976715687, task: 4. Ctx: { TraceId : 01k7kr2g0a1p4mahqk6p8yyeyc.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=3&id=NThhYTM2MzQtY2E3YjU0MGEtYTM5OTAwOTctMjVlM2MxN2E=.  CurrentExecutionId : .  DatabaseId : /Root.  Database : /Root. }. Handle abort execution event from: [3:7561400017242552232:2496], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-15T10:53:02.500204Z :FallbackToSingleDb INFO: Random seed for debugging is 1760525582500145
2025-10-15T10:53:03.401400Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561399805216172458:2078];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:03.418259Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:03.550723Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T10:53:03.551039Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/0010b2/r3tmp/tmpvAYPH8/pdisk_1.dat
2025-10-15T10:53:03.584505Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:04.198292Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:04.198395Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:04.302906Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:04.392365Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:04.452735Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:04.452820Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:04.458609Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:04.458671Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:04.472623Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:04.485931Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:04.498310Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:04.500154Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:04.508613Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:04.511518Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T10:53:04.518044Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:04.555093Z node 1 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639257 Duration# 0.006328s
2025-10-15T10:53:04.565732Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TServer::EnableGrpc on GrpcPort 23846, node 1
2025-10-15T10:53:04.833180Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/0010b2/r3tmp/yandexZ44Q6k.tmp
2025-10-15T10:53:04.833205Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/0010b2/r3tmp/yandexZ44Q6k.tmp
2025-10-15T10:53:04.833339Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/0010b2/r3tmp/yandexZ44Q6k.tmp
2025-10-15T10:53:04.833435Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:04.906921Z INFO: TTestServer started on Port 14736 GrpcPort 23846
2025-10-15T10:53:04.962794Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:05.022229Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:14736
PQClient connected to localhost:23846
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:05.683786Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:08.402411Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561399805216172458:2078];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:08.402495Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:11.481805Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7561399835280944570:2327], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:11.484311Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=YWMwNDkyNDYtMThjZDc2ODMtNTNlMjkxNWEtMzhiN2Y5OGQ=, ActorId: [1:7561399835280944567:2325], ActorState: ExecuteState, TraceId: 01k7kr18c56s91qkqw766scakk, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:11.486725Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:11.489861Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7561399833929158283:2295], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:11.492118Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=OGIyOWFiZDMtMjQ0MTczM2UtMmY3MzUxM2ItMTFmYWU5MzY=, ActorId: [2:7561399833929158281:2294], ActorState: ExecuteState, TraceId: 01k7kr185636576essgcwtzrzh, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:11.521556Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:11.521885Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:11.816423Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:12.074454Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:23846", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:12.675569Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k7kr19nd9wp0qyqr68rdykgs, Database: , SessionId: ydb://session/3?node_id=1&id=YjljODM3MjAtNjY5MDc5ZmEtMzY3MTBhODItYjVlNmRhNg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561399843870879580:2952] 
=== CheckClustersList. Ok
2025-10-15T10:53:18.142412Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:23846
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:18.384218Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:23846
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:18.459791Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561399869640683845:3246] connected; active server actors: 1
2025-10-15T10:53:18.460051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:18.467957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:18.468135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:18.521902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:18.529619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:18.529949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:18.530064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:18.530110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:18.536537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399869640683870:2448], now have 1 active actors on pipe
2025-10-15T10:53:18.536568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399869640683844:3245], now have 1 active actors on pipe
2025-10-15T10:53:18.542855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T10:53:18.545092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:18.551228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:18.616301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399869640683933:3301], now have 1 active actors on pipe
2025-10-15T10:53:18.617198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:18.663464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:18.664705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:18.664827Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:18.665152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:18.665498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561399868288897169:2377]
2025-10-15T10:53:18.684506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:18.684545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:18.684596Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561399868288897169:2377]
2025-10-15T10:53:18.684644Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:18.686108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:18.686166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.686295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.686307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:18.686326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:18.686340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.686350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.686359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:18.686427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:18.692112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:18.692299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:18.712850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:18.713013Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525598615, TxId 281474976715676
2025-10-15T10:53:18.713037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.713049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.713190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.713470Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:18.720799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:18.721108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:18.721142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.721151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.721162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.721187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:18.721521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:18.721625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:18.721916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:18.740076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:18.740205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:18.746249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:18.748826Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715679. Ctx: { TraceId: 01k7kr1fqmd7tqptdzpx14wkf7, Database: , SessionId: ydb://session/3?node_id=1&id=MzEwNzg2MWUtYjdhZDIyZDUtMTNkY2FlOGYtZjI3ZDk3YTc=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-15T10:53:18.787084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.787118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.787132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525598615
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525598615
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:23846
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:18.816925Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:18.888487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.888514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.888524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.991458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.991488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.991499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.083820Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:19.083865Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:19.088991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.089022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.089031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.195463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.195488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.195498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.295709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.295735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.295745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:23846
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:19.336616Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:19.399539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.399573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.399581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.503466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.503500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.503510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.607447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.607475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.607486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.707490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.707518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.707528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.809804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.809843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.809853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:23846
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:19.848580Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:19.877633Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:19.891526Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:19.891590Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:23846
2025-10-15T10:53:19.909768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.909794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.909812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.924390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:19.924425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:19.960217Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:19.961184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:19.961351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:48864
2025-10-15T10:53:19.961379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48864 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:19.961390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:19.963090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:19.963228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:19.963241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:19.963253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:19.963269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399873935651426:2492] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:19.965462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399873935651426:2492] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:20.011458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.011489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.011498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.115519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.115558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.115567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.219451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.219478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.219487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.288640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399873935651426:2492] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:20.289462Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399878230618761:2492] connected; active server actors: 1
2025-10-15T10:53:20.289649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399873935651426:2492] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:20.289673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399873935651426:2492] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:20.296038Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399878230618761:2492] disconnected; active server actors: 1
2025-10-15T10:53:20.296074Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399878230618761:2492] disconnected no session
2025-10-15T10:53:20.325383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.325409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.325420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.430624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.430650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.430660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.532645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.532671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.532680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.540309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399873935651426:2492] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:20.540357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399873935651426:2492] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:20.540377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399873935651426:2492] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:20.540429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:20.542424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399878230618785:2492], now have 1 active actors on pipe
2025-10-15T10:53:20.542718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:20.543014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.543046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:20.543130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|9c898edc-979c62d4-6f81ab5c-af8f9352_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:20.543169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.543189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.543200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:20.543242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.543283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:20.543371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:20.545033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.545070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:20.545162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:20.545659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|9c898edc-979c62d4-6f81ab5c-af8f9352_0
2025-10-15T10:53:20.546780Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525600546 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.546910Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|9c898edc-979c62d4-6f81ab5c-af8f9352_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:20.547758Z :INFO: [] MessageGroupId [src] SessionId [src|9c898edc-979c62d4-6f81ab5c-af8f9352_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:20.547798Z :INFO: [] MessageGroupId [src] SessionId [src|9c898edc-979c62d4-6f81ab5c-af8f9352_0] Write session will now close
2025-10-15T10:53:20.547840Z :DEBUG: [] MessageGroupId [src] SessionId [src|9c898edc-979c62d4-6f81ab5c-af8f9352_0] Write session: aborting
2025-10-15T10:53:20.548221Z :INFO: [] MessageGroupId [src] SessionId [src|9c898edc-979c62d4-6f81ab5c-af8f9352_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:20.548258Z :DEBUG: [] MessageGroupId [src] SessionId [src|9c898edc-979c62d4-6f81ab5c-af8f9352_0] Write session: destroy
2025-10-15T10:53:20.623653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|9c898edc-979c62d4-6f81ab5c-af8f9352_0 grpc read done: success: 0 data: 
2025-10-15T10:53:20.623723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|9c898edc-979c62d4-6f81ab5c-af8f9352_0 grpc read failed
2025-10-15T10:53:20.629277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|9c898edc-979c62d4-6f81ab5c-af8f9352_0
2025-10-15T10:53:20.629331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|9c898edc-979c62d4-6f81ab5c-af8f9352_0 is DEAD
2025-10-15T10:53:20.629666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:20.664637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.664664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.664674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.664754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399878230618785:2492] destroyed
2025-10-15T10:53:20.664795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:20.664827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.664839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.664850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-15T10:53:20.720300Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-15T10:53:20.720434Z :INFO: [/Root] [] [97ed4440-9fae2bc3-a6badd2b-80d71309] Open read subsessions to databases: { name: , endpoint: localhost:23846, path: /Root }
2025-10-15T10:53:20.720685Z :INFO: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] Starting read session
2025-10-15T10:53:20.720719Z :DEBUG: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] Starting single session
2025-10-15T10:53:20.722015Z :DEBUG: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:20.722071Z :DEBUG: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:20.722116Z :DEBUG: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:53:20.729149Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:53:20.729177Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-15T10:53:20.729859Z :DEBUG: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] [] Successfully connected. Initializing session
2025-10-15T10:53:20.767606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.767637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.767648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.785064Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:53:20.785453Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 read init: from# ipv6:[::1]:48886, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:53:20.785937Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 auth for : user
2025-10-15T10:53:20.789752Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 Handle describe topics response
2025-10-15T10:53:20.864736Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 auth is DEAD
2025-10-15T10:53:20.864880Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:53:20.866070Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:53:20.867594Z :INFO: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] [] Got InitResponse. ReadSessionId: shared/user_1_1_7301848668462920731_v1
2025-10-15T10:53:20.867673Z :DEBUG: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:20.867787Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399878230618819:2508] connected; active server actors: 1
2025-10-15T10:53:20.867983Z :DEBUG: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:53:20.867961Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561399878230618819:2508] session shared/user_1_1_7301848668462920731_v1
2025-10-15T10:53:20.868029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:53:20.868091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:53:20.868140Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_7301848668462920731_v1" (Sender=[1:7561399878230618810:2508], Pipe=[1:7561399878230618819:2508], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:53:20.868189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:53:20.868254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:53:20.868311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_7301848668462920731_v1" (Sender=[1:7561399878230618810:2508], Pipe=[1:7561399878230618819:2508], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:53:20.868378Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_7301848668462920731_v1" sender [1:7561399878230618810:2508] lock partition 0 for ReadingSession "shared/user_1_1_7301848668462920731_v1" (Sender=[1:7561399878230618810:2508], Pipe=[1:7561399878230618819:2508], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-15T10:53:20.868432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:53:20.868458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000183s
2025-10-15T10:53:20.868550Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:53:20.869564Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_7301848668462920731_v1" ClientId: "user" PipeClient { RawX1: 7561399878230618819 RawX2: 4503603922340300 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:53:20.869667Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 got read request: guid# 92511eae-ea1b16c9-607147d4-aeeb39f2
2025-10-15T10:53:20.869792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:53:20.871463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.871487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.871498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.882733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7561399878230618822:2511]
2025-10-15T10:53:20.887742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399878230618822:2511], now have 1 active actors on pipe
2025-10-15T10:53:20.887849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.887871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:20.887930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_7301848668462920731_v1 on pipe: [1:7561399878230618822:2511]
2025-10-15T10:53:20.888000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.888020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.888033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:20.888103Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_7301848668462920731_v1
2025-10-15T10:53:20.888116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.888260Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:20.889031Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_7301848668462920731_v1:1 with generation 1
2025-10-15T10:53:20.904000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:20.904078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:20.904105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.904116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.904125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.904155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:20.904194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:53:20.907835Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760525600867 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:53:20.907893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T10:53:20.907978Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name:  Database path: /Root Database id:  CommittedOffset: 0 EndOffset: 0 }
2025-10-15T10:53:20.911595Z :INFO: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-15T10:53:20.911845Z :INFO: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] Closing read session. Close timeout: 0.010000s
2025-10-15T10:53:20.911901Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-15T10:53:20.911957Z :INFO: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] Counters: { Errors: 0 CurrentSessionLifetimeMs: 191 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.912470Z :INFO: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] Closing read session. Close timeout: 0.000000s
2025-10-15T10:53:20.912520Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-15T10:53:20.912556Z :INFO: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] Counters: { Errors: 0 CurrentSessionLifetimeMs: 191 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.912599Z :INFO: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] Closing read session. Close timeout: 0.000000s
2025-10-15T10:53:20.912631Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-15T10:53:20.912662Z :INFO: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] Counters: { Errors: 0 CurrentSessionLifetimeMs: 192 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.912748Z :NOTICE: [/Root] [/Root] [ec062a4f-f6da846e-a0d9ff86-27c2a723] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:53:20.915814Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-15T10:53:20.915902Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 grpc closed
2025-10-15T10:53:20.915943Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_7301848668462920731_v1 is DEAD
2025-10-15T10:53:20.920057Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399878230618819:2508] disconnected; active server actors: 1
2025-10-15T10:53:20.920108Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399878230618819:2508] client user disconnected session shared/user_1_1_7301848668462920731_v1
2025-10-15T10:53:20.927824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_7301848668462920731_v1
2025-10-15T10:53:20.927869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399878230618822:2511] destroyed
2025-10-15T10:53:20.927937Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_7301848668462920731_v1
2025-10-15T10:53:20.975847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.975879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.975890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:21.076319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:21.076348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:21.076358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:21.179557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:21.179584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:21.698231Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715687, task: 1, CA Id [1:7561399882525586156:2520]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-15T10:53:21.736293Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715687, task: 1, CA Id [1:7561399882525586156:2520]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:21.848088Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715687, task: 1, CA Id [1:7561399882525586156:2520]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:22.056979Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715687, task: 1, CA Id [1:7561399882525586156:2520]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:22.264074Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715687, task: 1, CA Id [1:7561399882525586156:2520]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:23.619312Z :FallbackToSingleDbAfterBadRequest INFO: Random seed for debugging is 1760525603619272
2025-10-15T10:53:24.533444Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7561399895537355931:2174];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:24.548186Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/0010b2/r3tmp/tmpyybr7T/pdisk_1.dat
2025-10-15T10:53:24.633757Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:24.664757Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:24.681388Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:24.681615Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:24.719499Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:24.923628Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:24.987080Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:25.005304Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:25.068976Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:25.069056Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:25.080455Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:25.080557Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:25.104355Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:25.104497Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-15T10:53:25.105869Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 5331, node 3
2025-10-15T10:53:25.147704Z node 4 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.006372s
2025-10-15T10:53:25.299987Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:25.326019Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:25.347205Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/0010b2/r3tmp/yandexd17c6p.tmp
2025-10-15T10:53:25.347233Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/0010b2/r3tmp/yandexd17c6p.tmp
2025-10-15T10:53:25.347374Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/0010b2/r3tmp/yandexd17c6p.tmp
2025-10-15T10:53:25.347530Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:25.425662Z INFO: TTestServer started on Port 12870 GrpcPort 5331
2025-10-15T10:53:25.533306Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:25.603676Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:12870
PQClient connected to localhost:5331
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:25.800581Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:29.533325Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7561399895537355931:2174];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:29.561768Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:30.689859Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7561399921307159930:2296], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:30.690069Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=OTZhMmY1ZGUtMjQzYzI4MjYtODk5MDg3MGItNDA5NjNlZTY=, ActorId: [4:7561399921307159928:2295], ActorState: ExecuteState, TraceId: 01k7kr1vmx05ek2jtxqb6tb271, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:30.690403Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:30.933037Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:30.954644Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7561399921612225679:2324], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:30.956957Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=OWZjYjI5Y2MtY2U2NmYwMi0zMjdlMTI4Mi1mNDMxNmY0OA==, ActorId: [3:7561399921612225676:2322], ActorState: ExecuteState, TraceId: 01k7kr1vtv064c9ag0hy70dv12, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:30.957290Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:31.083516Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:31.299223Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:5331", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:31.857028Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k7kr1wg5demkfkx45an6dvwf, Database: , SessionId: ydb://session/3?node_id=3&id=YmI2ZTYwNGQtODg4ZTQ3NzktZjAxYzNhOTgtYzNmOTgwODk=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7561399925907193367:2915] 
=== CheckClustersList. Ok
2025-10-15T10:53:38.110524Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:5331
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:38.236110Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:5331
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:38.343402Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7561399955971964941:3214] connected; active server actors: 1
2025-10-15T10:53:38.343620Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:38.362067Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:38.396806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:38.397118Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:38.397151Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:38.397193Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:38.397586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399955971964940:3213], now have 1 active actors on pipe
2025-10-15T10:53:38.400947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.405435Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:38.405571Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:38.424193Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-15T10:53:38.416775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399955971964984:2437], now have 1 active actors on pipe
2025-10-15T10:53:38.419650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.592506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399955971965014:3264], now have 1 active actors on pipe
2025-10-15T10:53:38.593354Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.645182Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.645996Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:38.646044Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:38.646349Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:38.646650Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7561399955666898846:2380]
2025-10-15T10:53:38.649777Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:38.649800Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:38.649822Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7561399955666898846:2380]
2025-10-15T10:53:38.649849Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:38.651157Z node 4 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:38.651198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.651282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.651291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:38.651320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:38.651331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.651340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.656975Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:38.657077Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:38.657476Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.657910Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:38.671927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.672072Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525618516, TxId 281474976710676
2025-10-15T10:53:38.672094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.672105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.672231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.672435Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:38.677089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:38.677388Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:38.677413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.677425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.677437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.677467Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:38.677848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:38.677946Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:38.678203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.693784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.693902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.707961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.760015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.760045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.760058Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.859739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.859765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.859777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.964634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.964663Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.964673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.966258Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710679. Ctx: { TraceId: 01k7kr234e8ark0vh4vyzx4ch9, Database: , SessionId: ydb://session/3?node_id=3&id=ODYyMzQ4N2EtZWE5MDY0NmEtZDI4Yjc1MGUtM2RjOTYzODM=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525618516
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525618516
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:5331
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:39.055846Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:39.071623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.071659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.071670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.171826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.171853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.171863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.275745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.275783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.275794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.379786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.379816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.379827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.483690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.483716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.483727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:5331
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:39.564845Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:39.584030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.584061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.584072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.691934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.691974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.691989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.795051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.795086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.795100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.896062Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.896098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.896110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.963942Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:39.963977Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:40.003457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.003493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.003505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:5331
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:40.084121Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:40.100757Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:40.104135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.104163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.104174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.143730Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:40.143789Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:5331
2025-10-15T10:53:40.170795Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:40.172304Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:40.172348Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:40.172787Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:40.172885Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:60276
2025-10-15T10:53:40.172899Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60276 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:40.172908Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:40.175205Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:40.175301Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:40.175310Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:40.175318Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:40.175334Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561399964561899813:2477] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:40.177819Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561399964561899813:2477] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:40.203965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.204001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.204013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.307644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.307675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.307684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.405427Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7561399964561899813:2477] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:40.407609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.407640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.407650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.407949Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399964561899855:2477] connected; active server actors: 1
2025-10-15T10:53:40.409236Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7561399964561899813:2477] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:40.409254Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561399964561899813:2477] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:40.415192Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399964561899855:2477] disconnected; active server actors: 1
2025-10-15T10:53:40.415213Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399964561899855:2477] disconnected no session
2025-10-15T10:53:40.506497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.506533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.506545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.607094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.607122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.607132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.711462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.711496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.711508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.810185Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.810223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.810235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.825712Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561399964561899813:2477] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:40.825756Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561399964561899813:2477] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:40.825775Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561399964561899813:2477] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:40.825807Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:40.832112Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:53:40.835464Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399964561899902:2477], now have 1 active actors on pipe
2025-10-15T10:53:40.835561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:40.835589Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:40.835681Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|208abd08-caac01f3-ac7a9595-e6c78141_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:40.835721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.835743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.835754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:40.835796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.835841Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:40.835905Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:40.840667Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:40.840704Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:40.840779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:40.841311Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|208abd08-caac01f3-ac7a9595-e6c78141_0
2025-10-15T10:53:40.844003Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525620843 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:40.844122Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|208abd08-caac01f3-ac7a9595-e6c78141_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:40.844582Z :INFO: [] MessageGroupId [src] SessionId [src|208abd08-caac01f3-ac7a9595-e6c78141_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:40.844613Z :INFO: [] MessageGroupId [src] SessionId [src|208abd08-caac01f3-ac7a9595-e6c78141_0] Write session will now close
2025-10-15T10:53:40.844658Z :DEBUG: [] MessageGroupId [src] SessionId [src|208abd08-caac01f3-ac7a9595-e6c78141_0] Write session: aborting
2025-10-15T10:53:40.844999Z :INFO: [] MessageGroupId [src] SessionId [src|208abd08-caac01f3-ac7a9595-e6c78141_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:40.845040Z :DEBUG: [] MessageGroupId [src] SessionId [src|208abd08-caac01f3-ac7a9595-e6c78141_0] Write session: destroy
PORTS 5331 16629
2025-10-15T10:53:40.866776Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|208abd08-caac01f3-ac7a9595-e6c78141_0 grpc read done: success: 0 data: 
2025-10-15T10:53:40.866802Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|208abd08-caac01f3-ac7a9595-e6c78141_0 grpc read failed
2025-10-15T10:53:40.866832Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|208abd08-caac01f3-ac7a9595-e6c78141_0 grpc closed
2025-10-15T10:53:40.866848Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|208abd08-caac01f3-ac7a9595-e6c78141_0 is DEAD
2025-10-15T10:53:40.880418Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:40.881295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561399964561899902:2477] destroyed
2025-10-15T10:53:40.881338Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:40.881365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.881383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.881397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-15T10:53:40.912658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.912686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.912697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.017969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.018001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.018011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.115474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.115507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.115527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.218520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.218549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.218559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.323505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.323535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.323549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.422551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.422583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.422594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.523776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.523812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.523825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.624841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.624880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.624895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.731492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.731532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.731545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.839755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.839789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.839802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:53:41.898117Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-15T10:53:41.898216Z :INFO: [/Root] [] [ff45be4-bba2fa85-9c674a3b-3b88ba8e] Open read subsessions to databases: { name: , endpoint: localhost:16629, path: /Root }
2025-10-15T10:53:41.898408Z :INFO: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Starting read session
2025-10-15T10:53:41.898444Z :DEBUG: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Starting single session
2025-10-15T10:53:41.899067Z :DEBUG: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:41.903581Z :DEBUG: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:41.903628Z :DEBUG: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:53:41.907809Z :ERROR: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] [] Got error. Status: CLIENT_CALL_UNIMPLEMENTED. Description: <main>: Error: GRpc error: (12):  <main>: Error: Grpc error response on endpoint localhost:16629 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:16629. 
2025-10-15T10:53:41.912038Z :DEBUG: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:41.912084Z :DEBUG: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:41.912265Z :INFO: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] [] Closing session to cluster: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:16629" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:16629     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:16629. " }
2025-10-15T10:53:41.913691Z :NOTICE: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:53:41.913736Z :DEBUG: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] [] Abort session to cluster
Got new read session event: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:16629" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:16629     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:16629. " }
2025-10-15T10:53:41.913851Z :INFO: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Closing read session. Close timeout: 0.010000s
2025-10-15T10:53:41.913891Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:53:41.913931Z :INFO: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Counters: { Errors: 1 CurrentSessionLifetimeMs: 15 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:41.913967Z :INFO: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Closing read session. Close timeout: 0.000000s
2025-10-15T10:53:41.914002Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:53:41.914037Z :INFO: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Counters: { Errors: 1 CurrentSessionLifetimeMs: 15 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:41.914074Z :INFO: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Closing read session. Close timeout: 0.000000s
2025-10-15T10:53:41.914104Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:53:41.914154Z :INFO: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Counters: { Errors: 1 CurrentSessionLifetimeMs: 15 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:41.914227Z :NOTICE: [/Root] [/Root] [e5b01bf0-eec7e502-a88d0022-d03e02fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:53:41.939137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.939168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.939180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.039448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.039485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.039496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.139774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.139802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.139812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.241789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.241820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.241831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.727035Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710689, task: 1, CA Id [3:7561399973151834595:2509]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-15T10:53:42.763941Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710689, task: 1, CA Id [3:7561399973151834595:2509]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:42.891809Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710689, task: 1, CA Id [3:7561399973151834595:2509]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:43.100228Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710689, task: 1, CA Id [3:7561399973151834595:2509]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:43.315562Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710689, task: 1, CA Id [3:7561399973151834595:2509]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:02.454005Z :GetAllStartPartitionSessions INFO: Random seed for debugging is 1760525582453933
2025-10-15T10:53:03.270678Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561399802915224006:2087];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:03.270748Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:03.419303Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:03.454854Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7561399805557297099:2258];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:03.454901Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:03.497742Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T10:53:03.512646Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/00107f/r3tmp/tmpffXMGD/pdisk_1.dat
2025-10-15T10:53:04.106013Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:04.154610Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:04.252890Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:04.252980Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:04.278097Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:04.283768Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:04.303720Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:04.314453Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:04.314545Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:04.323769Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:04.336498Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:04.350812Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:04.395518Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T10:53:04.409486Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:04.456036Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TServer::EnableGrpc on GrpcPort 26387, node 1
2025-10-15T10:53:04.700416Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:04.709883Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:04.716626Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/00107f/r3tmp/yandexZKynBo.tmp
2025-10-15T10:53:04.716646Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/00107f/r3tmp/yandexZKynBo.tmp
2025-10-15T10:53:04.716792Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/00107f/r3tmp/yandexZKynBo.tmp
2025-10-15T10:53:04.716893Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:04.808532Z INFO: TTestServer started on Port 27137 GrpcPort 26387
TClient is connected to server localhost:27137
PQClient connected to localhost:26387
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:05.587540Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:08.275570Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561399802915224006:2087];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:08.275636Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:08.451707Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7561399805557297099:2258];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:08.451773Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:10.493839Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7561399832979996099:2325], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:10.494051Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7561399831327100994:2296], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:10.495714Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=NTJmYTIzMWItMmFlZmUwMjEtZDFhYzdiZDctYTc4N2IyMjA=, ActorId: [2:7561399831327100992:2295], ActorState: ExecuteState, TraceId: 01k7kr174h6qp1vd135cswqtxn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:10.495891Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=MzUyZjk0ZDYtNGIzZTM3ZjEtYjdhZGY0OGUtYzFhMTM4MDc=, ActorId: [1:7561399832979996096:2323], ActorState: ExecuteState, TraceId: 01k7kr17pr6etzrhnyj7nqs73g, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:10.497987Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:10.502486Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:10.606138Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:10.960331Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:11.117974Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:26387", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:11.696815Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k7kr18qne0vx5zyw69xb5a6h, Database: , SessionId: ydb://session/3?node_id=1&id=MTllMjY0ZjEtYTM1ZDkzN2MtNzQxNjdmNmEtNWFmMjc1YzY=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561399837274963806:2941] 
=== CheckClustersList. Ok
2025-10-15T10:53:16.967506Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 5 partitions
CallPersQueueGRPC request to localhost:26387
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:17.193551Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:26387
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 5
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:17.333398Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561399863044768060:3230] connected; active server actors: 1
2025-10-15T10:53:17.333637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [1, 2, 3, 4, 0]
2025-10-15T10:53:17.339720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:17.339882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) (1, 72075186224037892) (2, 72075186224037892) (3, 72075186224037892) (4, 72075186224037892) 
2025-10-15T10:53:17.405659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:17.435485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:17.486885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:17.486963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:17.487008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:17.490575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T10:53:17.490973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399863044768077:2435], now have 1 active actors on pipe
2025-10-15T10:53:17.491011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399863044768059:3229], now have 1 active actors on pipe
2025-10-15T10:53:17.492067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.506497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.526188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399863044768121:3279], now have 1 active actors on pipe
2025-10-15T10:53:17.527066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.530926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.534246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:17.534290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:17.534306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:17.534320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:17.534332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:17.534375Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:17.534396Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][2][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:17.534406Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][3][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:17.534415Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:17.534425Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][4][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:17.534976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:17.535271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [2:7561399865686839901:2384]
2025-10-15T10:53:17.540753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:17.540791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:1:Initializer] Initializing completed.
2025-10-15T10:53:17.540844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 1 generation 1 [2:7561399865686839901:2384]
2025-10-15T10:53:17.540879Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:17.542135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-10-15T10:53:17.542189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.551288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.551310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-15T10:53:17.551327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-15T10:53:17.551340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.551369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.551381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-15T10:53:17.552489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:17.552690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:17.552843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][2][StateInit] bootstrapping 2 [2:7561399865686839902:2384]
2025-10-15T10:53:17.554521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:17.554535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:2:Initializer] Initializing completed.
2025-10-15T10:53:17.554549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][2][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 2 generation 1 [2:7561399865686839902:2384]
2025-10-15T10:53:17.554566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][2][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 2 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:17.555474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][2][StateIdle] Process pending events. Count 1
2025-10-15T10:53:17.555497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.555554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.555561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-15T10:53:17.555574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-15T10:53:17.555582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.555588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.555594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-15T10:53:17.555618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:17.555735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:17.555858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][3][StateInit] bootstrapping 3 [2:7561399865686839903:2384]
2025-10-15T10:53:17.575721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:17.575753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:3:Initializer] Initializing completed.
2025-10-15T10:53:17.575771Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][3][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 3 generation 1 [2:7561399865686839903:2384]
2025-10-15T10:53:17.575821Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][3][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 3 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:17.576885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][3][StateIdle] Process pending events. Count 1
2025-10-15T10:53:17.576916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.576982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.576989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-15T10:53:17.577002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-15T10:53:17.577010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.577017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.577024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-15T10:53:17.577047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:17.577222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:17.577404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][4][StateInit] bootstrapping 4 [2:7561399865686839904:2384]
2025-10-15T10:53:17.595511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:17.595572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:4:Initializer] Initializing completed.
2025-10-15T10:53:17.595592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][4][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 4 generation 1 [2:7561399865686839904:2384]
2025-10-15T10:53:17.595614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][4][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 4 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:17.596646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][4][StateIdle] Process pending events. Count 1
2025-10-15T10:53:17.596670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.596749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.596758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-15T10:53:17.596772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-15T10:53:17.596780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.596787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.596793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-15T10:53:17.596819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:17.597005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:17.597151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561399865686839905:2384]
2025-10-15T10:53:17.599020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:17.599035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:17.599049Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561399865686839905:2384]
2025-10-15T10:53:17.599065Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:17.600044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:17.600070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.600123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.600131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:17.600147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:17.600153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.600160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.600166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:17.600205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:17.600640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.600800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.600904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.601042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.601249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.601358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.614793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.614955Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525597558, TxId 281474976710676
2025-10-15T10:53:17.614975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.615375Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525597558, TxId 281474976710676
2025-10-15T10:53:17.615388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:17.615552Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][2][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525597558, TxId 281474976710676
2025-10-15T10:53:17.615562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:17.615697Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][3][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525597558, TxId 281474976710676
2025-10-15T10:53:17.615706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:17.615834Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][4][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525597558, TxId 281474976710676
2025-10-15T10:53:17.615843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.615903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:17.616026Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:17.616070Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:17.616084Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:17.616097Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:17.616177Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:17.625364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:17.625644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:17.625671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.625678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.625686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.625715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.625732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:17.625859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:17.625868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.625873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.625878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:17.625888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.625901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:17.625994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:17.626001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.626006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.626010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:17.626018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.626028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:17.626114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:17.626121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.626127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.626131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:17.626141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.626151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:17.626245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:17.626254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.626259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.626263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:17.626271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.626847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 5 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 2 PartitionIds: 3 PartitionIds: 4 PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:17.626955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:17.627229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.648594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.648709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.652427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.654051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.654068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.654083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:17.656589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.656605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.656612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:17.679701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.679722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.679732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:17.699851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.699873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.699881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:17.699918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.699923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.699930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.749155Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k7kr1en15a5a5txmybayv7ck, Database: , SessionId: ydb://session/3?node_id=1&id=OTdkMWYzNDctOTk4YTRhNDEtYTNhM2I3MzktN2Q4OGQ4NDk=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-15T10:53:17.759527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.759549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.759559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:17.759602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.759609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.759613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:17.783657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.783679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.783687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525597558
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525597558
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 2
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 3
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 4
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 5
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 5
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:26387
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:17.798160Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:17.799979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.799999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.800009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:17.800046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.800052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.800057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.859501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.859534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.859542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:17.860322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.860335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.860343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:17.883763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.883785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.883793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:17.903580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.903602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.903610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:17.903646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.903653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.903658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.963594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.963616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.963623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:17.963660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.963666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.963670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:17.984136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.984184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.984195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.003342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.003369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.003380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.003425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.003432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.003438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.065875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.065900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.065909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.065955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.065962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.065967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:18.091019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.091046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.091056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.105825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.105855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.105865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.105917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.105928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.105935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.165065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.165096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.165110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.165163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.165170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.165176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:18.193521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.193546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.193557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.218918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.218959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.218970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.219036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.219044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.219050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.268347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.268385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.268396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.268449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.268456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.268463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
CallPersQueueGRPC request to localhost:26387
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:18.307474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.307513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.307520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.318426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.318455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.318463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.318504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.318510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.318516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.321961Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 5
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:18.352449Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:18.352878Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:18.352911Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:26387
2025-10-15T10:53:18.377306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:18.377337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:18.442632Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:18.445973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:18.446132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:36414
2025-10-15T10:53:18.446156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:36414 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:18.446165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:18.451521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:18.451660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:18.451673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:18.451682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:18.451698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399867339735567:2468] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:18.454201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399867339735567:2468] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:18.472095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.472121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.472130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.472179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.472187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.472192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:18.472213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.472220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.472228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.472244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.472250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.472255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.472272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.472278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.472282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.575673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.575715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.575728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.575808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.575821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.575830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:18.575870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.575879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.575892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.575918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.575924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.575930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.575951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.575959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.575965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.679613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.679643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.679654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.679708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.679716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.679722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:18.679745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.679753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.679759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.679781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.679788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.679794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.679827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.679834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.679840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.694764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399867339735567:2468] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:18.695540Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399867339735612:2468] connected; active server actors: 1
2025-10-15T10:53:18.695751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399867339735567:2468] (SourceId=src, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=src
2025-10-15T10:53:18.695770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399867339735567:2468] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:18.713120Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399867339735612:2468] disconnected; active server actors: 1
2025-10-15T10:53:18.713153Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399867339735612:2468] disconnected no session
2025-10-15T10:53:18.784029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.784055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.784063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.784099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.784107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.784112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:18.784131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.784138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.784143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.784160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.784166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.784171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.784188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.784195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.784200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.833146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399867339735567:2468] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:18.833197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399867339735567:2468] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-15T10:53:18.833215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399867339735567:2468] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:18.833242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-15T10:53:18.837332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399867339735642:2468], now have 1 active actors on pipe
2025-10-15T10:53:18.838004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:18.838032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-15T10:53:18.838096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|6ff1d06-1e306d37-66187afb-bb5690da_0 generated for partition 1 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:18.838131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.838147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.838156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-15T10:53:18.838190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.838239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-15T10:53:18.838303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:18.837123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:18.843084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:18.843113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-15T10:53:18.843191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:18.843847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 1 MaxSeqNo: 0 sessionId: src|6ff1d06-1e306d37-66187afb-bb5690da_0
2025-10-15T10:53:18.844935Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525598844 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:18.845044Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|6ff1d06-1e306d37-66187afb-bb5690da_0" topic: "test-topic" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:18.850541Z :INFO: [] MessageGroupId [src] SessionId [src|6ff1d06-1e306d37-66187afb-bb5690da_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:18.850633Z :INFO: [] MessageGroupId [src] SessionId [src|6ff1d06-1e306d37-66187afb-bb5690da_0] Write session will now close
2025-10-15T10:53:18.850671Z :DEBUG: [] MessageGroupId [src] SessionId [src|6ff1d06-1e306d37-66187afb-bb5690da_0] Write session: aborting
2025-10-15T10:53:18.851091Z :INFO: [] MessageGroupId [src] SessionId [src|6ff1d06-1e306d37-66187afb-bb5690da_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:18.851123Z :DEBUG: [] MessageGroupId [src] SessionId [src|6ff1d06-1e306d37-66187afb-bb5690da_0] Write session: destroy
2025-10-15T10:53:18.853040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|6ff1d06-1e306d37-66187afb-bb5690da_0 grpc read done: success: 0 data: 
2025-10-15T10:53:18.853060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|6ff1d06-1e306d37-66187afb-bb5690da_0 grpc read failed
2025-10-15T10:53:18.853084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|6ff1d06-1e306d37-66187afb-bb5690da_0 grpc closed
2025-10-15T10:53:18.853107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|6ff1d06-1e306d37-66187afb-bb5690da_0 is DEAD
2025-10-15T10:53:18.863906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:18.879251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399867339735642:2468] destroyed
2025-10-15T10:53:18.879340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:18.885199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.885247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.885261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.885324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.885346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.885353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.885376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.885382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.885387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:18.885405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.885412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.885417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.885437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.885443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.885448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.885465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.885471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.885476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-15T10:53:18.985886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.985912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.985920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:18.985962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.985968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.985973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:18.985992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.985998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.986003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:18.986021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.986026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.986031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:18.986055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.986062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.986069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.076255Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:19.076285Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:19.087674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.087700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.087709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:19.087757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.087763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.087777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:19.087794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.087800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.087804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:19.087820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.087845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.087850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:19.087868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.087875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.087879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.191986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.192034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.192044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:19.192105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.192112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.192118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:19.192170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.192185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.192192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:19.192220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.192227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.192232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:19.192251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.192260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.192267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.291966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.291986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.292020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:19.292068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.292074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.292079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:19.292097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.292102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.292107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:19.292122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.292128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.292133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:19.292159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.292164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.292170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.393129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.393158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.393169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:19.393223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.393232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.393249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:19.393271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.393278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.393285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:19.393311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.393318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.393326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:19.393378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.393387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.393391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.499556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.499587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.499596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:19.499647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.499655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.499660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:19.499683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.499691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.499696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:19.499717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.499725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.499731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:19.499750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.499771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.499777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.599920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.599951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.599961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:19.600014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.600021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.600027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:19.600049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.600055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.600061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:19.600080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.600096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.600101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:19.600121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.600128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.600134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.703648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.703688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.703698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:19.703749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.703756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.703763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:19.703783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.703790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.703795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:19.703815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.703821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.703827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:19.703847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.703853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.703860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.804259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.804291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.804302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:19.804351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.804359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.804366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:19.804406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.804417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.804424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:19.804449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.804464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.804472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:19.804494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.804500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.804512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:53:19.904924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.904950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.904960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:19.905008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.905015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.905021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:19.905041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.905049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.905056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:19.905078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.905085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.905093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:19.905112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.905119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.905124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.907849Z :INFO: [/Root] [] [7bc197bc-d2ca7f3c-12bc0eb9-85425057] Open read subsessions to databases: { name: dc1, endpoint: localhost:26387, path: /Root }, { name: dc2, endpoint: localhost:26387, path: /Root }
2025-10-15T10:53:19.958188Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] Starting read session
2025-10-15T10:53:19.958231Z :DEBUG: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] Starting single session
2025-10-15T10:53:19.958665Z :DEBUG: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:19.958706Z :DEBUG: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:19.958737Z :DEBUG: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:53:19.981658Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] Starting read session
2025-10-15T10:53:19.981699Z :DEBUG: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] Starting single session
2025-10-15T10:53:19.981819Z :DEBUG: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:19.981842Z :DEBUG: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:19.981873Z :DEBUG: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:53:20.006734Z :DEBUG: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] [] Successfully connected. Initializing session
2025-10-15T10:53:20.007192Z :DEBUG: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] Successfully connected. Initializing session
2025-10-15T10:53:20.007943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.007980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.007991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:20.008047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.008057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.008070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:20.008100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.008107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.008114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:20.008141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.008159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.008167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:20.008188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.008200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.008211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.008930Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:53:20.008952Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-15T10:53:20.009072Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:53:20.009077Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-15T10:53:20.070911Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:53:20.076347Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:53:20.076592Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 read init: from# ipv6:[::1]:36418, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:53:20.077155Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 read init: from# ipv6:[::1]:36418, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:53:20.077359Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 auth for : user
2025-10-15T10:53:20.077378Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 auth for : user
2025-10-15T10:53:20.078252Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 Handle describe topics response
2025-10-15T10:53:20.078371Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 auth is DEAD
2025-10-15T10:53:20.078425Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:53:20.079510Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:53:20.079799Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399875929670317:2496] connected; active server actors: 1
2025-10-15T10:53:20.079835Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561399875929670317:2496] session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.079881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:53:20.079929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:53:20.079941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 1
2025-10-15T10:53:20.079981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-10-15T10:53:20.080000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 2
2025-10-15T10:53:20.080024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=3 (Status=Free, Partitions=[2])
2025-10-15T10:53:20.080033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 3
2025-10-15T10:53:20.080049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=4 (Status=Free, Partitions=[3])
2025-10-15T10:53:20.080078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 4
2025-10-15T10:53:20.080098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=5 (Status=Free, Partitions=[4])
2025-10-15T10:53:20.080140Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:53:20.080164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:53:20.080216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=5, UnradableFamilies=5 [5 (4), 4 (3), 3 (2), 2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-15T10:53:20.080266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=5 (Status=Free, Partitions=[4]) for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:53:20.080320Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 5 status Active partitions [4] session "shared/user_1_2_6855417180946557331_v1" sender [1:7561399875929670313:2496] lock partition 4 for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-15T10:53:20.080378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=4 (Status=Free, Partitions=[3]) for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=1)
2025-10-15T10:53:20.080413Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 4 status Active partitions [3] session "shared/user_1_2_6855417180946557331_v1" sender [1:7561399875929670313:2496] lock partition 3 for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=2) generation 1 step 2
2025-10-15T10:53:20.080463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=3 (Status=Free, Partitions=[2]) for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=2)
2025-10-15T10:53:20.080493Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_2_6855417180946557331_v1" sender [1:7561399875929670313:2496] lock partition 2 for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=3) generation 1 step 3
2025-10-15T10:53:20.080521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=3)
2025-10-15T10:53:20.080548Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_2_6855417180946557331_v1" sender [1:7561399875929670313:2496] lock partition 1 for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=4) generation 1 step 4
2025-10-15T10:53:20.080581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=4)
2025-10-15T10:53:20.080605Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_6855417180946557331_v1" sender [1:7561399875929670313:2496] lock partition 0 for ReadingSession "shared/user_1_2_6855417180946557331_v1" (Sender=[1:7561399875929670313:2496], Pipe=[1:7561399875929670317:2496], Partitions=[], ActiveFamilyCount=5) generation 1 step 5
2025-10-15T10:53:20.080635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=1, desiredFamilyCount=5, allowPlusOne=0
2025-10-15T10:53:20.080664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000427s
2025-10-15T10:53:20.080685Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 Handle describe topics response
2025-10-15T10:53:20.080757Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 auth is DEAD
2025-10-15T10:53:20.081586Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 assign: record# { Partition: 4 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_2_6855417180946557331_v1" ClientId: "user" PipeClient { RawX1: 7561399875929670317 RawX2: 4503603922340288 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:53:20.081709Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 assign: record# { Partition: 3 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_6855417180946557331_v1" ClientId: "user" PipeClient { RawX1: 7561399875929670317 RawX2: 4503603922340288 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:53:20.081779Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 assign: record# { Partition: 2 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_2_6855417180946557331_v1" ClientId: "user" PipeClient { RawX1: 7561399875929670317 RawX2: 4503603922340288 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:53:20.081844Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_2_6855417180946557331_v1" ClientId: "user" PipeClient { RawX1: 7561399875929670317 RawX2: 4503603922340288 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:53:20.081936Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_2_6855417180946557331_v1" ClientId: "user" PipeClient { RawX1: 7561399875929670317 RawX2: 4503603922340288 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:53:20.082006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1)
2025-10-15T10:53:20.082082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2)
2025-10-15T10:53:20.082109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-15T10:53:20.082139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-15T10:53:20.082169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-15T10:53:20.082190Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:53:20.084467Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] Got InitResponse. ReadSessionId: shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.084526Z :DEBUG: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:20.084745Z :DEBUG: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:53:20.084881Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] [] Got InitResponse. ReadSessionId: shared/user_1_1_11737664680101381890_v1
2025-10-15T10:53:20.084902Z :DEBUG: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:53:20.085070Z :DEBUG: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:53:20.082924Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:53:20.085501Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399875929670330:2495] connected; active server actors: 1
2025-10-15T10:53:20.086335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399875929670325:2501], now have 1 active actors on pipe
2025-10-15T10:53:20.086367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399875929670326:2502], now have 1 active actors on pipe
2025-10-15T10:53:20.086381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399875929670327:2503], now have 1 active actors on pipe
2025-10-15T10:53:20.086395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399875929670328:2504], now have 1 active actors on pipe
2025-10-15T10:53:20.086412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399875929670329:2505], now have 1 active actors on pipe
2025-10-15T10:53:20.085688Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561399875929670330:2495] session shared/user_1_1_11737664680101381890_v1
2025-10-15T10:53:20.085727Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_11737664680101381890_v1" (Sender=[1:7561399875929670312:2495], Pipe=[1:7561399875929670330:2495], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:53:20.085745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:53:20.085773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-15T10:53:20.085797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-15T10:53:20.085847Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_6855417180946557331_v1" sender [1:7561399875929670313:2496]  release partitions [0]. Target status Free
2025-10-15T10:53:20.085900Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_2_6855417180946557331_v1" sender [1:7561399875929670313:2496]  release partitions [1]. Target status Free
2025-10-15T10:53:20.085925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000137s
2025-10-15T10:53:20.085953Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 gone release: partition# 0
2025-10-15T10:53:20.085989Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-15T10:53:20.086014Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-15T10:53:20.086067Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-15T10:53:20.086117Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 gone release: partition# 1
2025-10-15T10:53:20.086129Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-15T10:53:20.086156Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-15T10:53:20.086169Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-15T10:53:20.086304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7561399875929670325:2501]
2025-10-15T10:53:20.086349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7561399875929670326:2502]
2025-10-15T10:53:20.086392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7561399875929670327:2503]
2025-10-15T10:53:20.087186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.087220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-15T10:53:20.087271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_6855417180946557331_v1 on pipe: [1:7561399875929670325:2501]
2025-10-15T10:53:20.087325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.087335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 3
2025-10-15T10:53:20.087365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_6855417180946557331_v1 on pipe: [1:7561399875929670326:2502]
2025-10-15T10:53:20.087391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.087401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-10-15T10:53:20.087414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_6855417180946557331_v1 on pipe: [1:7561399875929670327:2503]
2025-10-15T10:53:20.087439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.087447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:20.087461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_6855417180946557331_v1 on pipe: [1:7561399875929670329:2505]
2025-10-15T10:53:20.087491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.087512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399875929670329:2505] destroyed
2025-10-15T10:53:20.087548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.087557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-15T10:53:20.087570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_6855417180946557331_v1 on pipe: [1:7561399875929670328:2504]
2025-10-15T10:53:20.087588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.087599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399875929670328:2504] destroyed
2025-10-15T10:53:20.087638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.087662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.087672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-15T10:53:20.087721Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user session is set to 0 (startOffset 0) session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.087733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:20.087859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.087869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.087875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-15T10:53:20.087898Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user session is set to 0 (startOffset 0) session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.087904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:20.087954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.087962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.087968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-15T10:53:20.087986Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user session is set to 0 (startOffset 0) session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.087992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:20.088060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.088073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.088092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:20.088123Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.088130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.088184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.088191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.088196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-15T10:53:20.088215Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user session is set to 0 (startOffset 0) session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.088220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:20.088265Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:20.088293Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:20.088324Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:20.088343Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:20.088358Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:20.089507Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_6855417180946557331_v1:1 with generation 1
2025-10-15T10:53:20.089540Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_6855417180946557331_v1:2 with generation 1
2025-10-15T10:53:20.089553Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_6855417180946557331_v1:3 with generation 1
2025-10-15T10:53:20.089563Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_6855417180946557331_v1:5 with generation 1
2025-10-15T10:53:20.089584Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.089592Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_6855417180946557331_v1:4 with generation 1
2025-10-15T10:53:20.089604Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.091780Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7561399875929670317:2496] session shared/user_1_2_6855417180946557331_v1 partition 0
2025-10-15T10:53:20.091836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:53:20.091864Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7561399875929670317:2496] session shared/user_1_2_6855417180946557331_v1 partition 1
2025-10-15T10:53:20.091897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=2 [2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-15T10:53:20.091948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_1_11737664680101381890_v1" (Sender=[1:7561399875929670312:2495], Pipe=[1:7561399875929670330:2495], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:53:20.091989Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_11737664680101381890_v1" sender [1:7561399875929670312:2495] lock partition 1 for ReadingSession "shared/user_1_1_11737664680101381890_v1" (Sender=[1:7561399875929670312:2495], Pipe=[1:7561399875929670330:2495], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-15T10:53:20.092027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_11737664680101381890_v1" (Sender=[1:7561399875929670312:2495], Pipe=[1:7561399875929670330:2495], Partitions=[], ActiveFamilyCount=1)
2025-10-15T10:53:20.092067Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_11737664680101381890_v1" sender [1:7561399875929670312:2495] lock partition 0 for ReadingSession "shared/user_1_1_11737664680101381890_v1" (Sender=[1:7561399875929670312:2495], Pipe=[1:7561399875929670330:2495], Partitions=[], ActiveFamilyCount=2) generation 1 step 7
2025-10-15T10:53:20.092091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-15T10:53:20.092109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000199s
2025-10-15T10:53:20.092189Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:53:20.092274Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 got read request: guid# fdc48bfe-1773fdaa-3443eeee-6a281cba
2025-10-15T10:53:20.092314Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:53:20.092939Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_1_11737664680101381890_v1" ClientId: "user" PipeClient { RawX1: 7561399875929670330 RawX2: 4503603922340287 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:53:20.093075Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_1_11737664680101381890_v1" ClientId: "user" PipeClient { RawX1: 7561399875929670330 RawX2: 4503603922340287 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:53:20.093122Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 got read request: guid# ceb2ac9b-4d7641cb-5898e5cd-c61857bc
2025-10-15T10:53:20.093202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:1)
2025-10-15T10:53:20.093291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2)
2025-10-15T10:53:20.093866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399875929670335:2506], now have 1 active actors on pipe
2025-10-15T10:53:20.093886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399875929670336:2507], now have 1 active actors on pipe
2025-10-15T10:53:20.094146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7561399875929670335:2506]
2025-10-15T10:53:20.094228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7561399875929670336:2507]
2025-10-15T10:53:20.094539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.094591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-15T10:53:20.094620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_11737664680101381890_v1 on pipe: [1:7561399875929670335:2506]
2025-10-15T10:53:20.094656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:20.094665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:20.094676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_11737664680101381890_v1 on pipe: [1:7561399875929670336:2507]
2025-10-15T10:53:20.094704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][1][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:53:20.094715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:53:20.094732Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_11737664680101381890_v1:1 with generation 1
2025-10-15T10:53:20.094750Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_11737664680101381890_v1:2 with generation 1
2025-10-15T10:53:20.119318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][1][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:53:20.119343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][2][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:53:20.119381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][3][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:53:20.119393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][4][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:53:20.119436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:53:20.119483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:20.119543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:20.119564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.119580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.119587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:20.119614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-15T10:53:20.119627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:20.119658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:20.119667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.119673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.119678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:20.119693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-15T10:53:20.119704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:20.119736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:20.119744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.119748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.119752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:20.119761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-15T10:53:20.119770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:20.119798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:20.119805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.119818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.119828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:20.119891Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_11737664680101381890_v1
2025-10-15T10:53:20.119899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.120037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:20.120055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:20.120091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:20.120101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.120111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.120116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-15T10:53:20.120139Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user session is set to 0 (startOffset 0) session shared/user_1_1_11737664680101381890_v1
2025-10-15T10:53:20.120145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:20.120189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-15T10:53:20.120219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:53:20.120269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 3 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:53:20.120291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:53:20.120309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:53:20.120328Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:20.120360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:53:20.120374Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:20.129424Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760525600007 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:53:20.129487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T10:53:20.129578Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760525600007 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:53:20.129593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T10:53:20.129640Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760525600007 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:53:20.129653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T10:53:20.129707Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 sending to client partition status
2025-10-15T10:53:20.129969Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 sending to client partition status
2025-10-15T10:53:20.129999Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 sending to client partition status
2025-10-15T10:53:20.131220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:20.131280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:20.131300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.131308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.131316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.131339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:20.131367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:20.131393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:20.131408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.131414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.131419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:20.131429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-15T10:53:20.131455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:53:20.131487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 4 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-15T10:53:20.132252Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 4. Read offset: (NULL)
2025-10-15T10:53:20.133044Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-15T10:53:20.133132Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-15T10:53:20.133283Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760525600087 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:53:20.133309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T10:53:20.133406Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760525600087 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:53:20.133422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T10:53:20.133464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-15T10:53:20.133504Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) wait data in partition inited, cookie 1 from offset 0
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-15T10:53:20.134563Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 3 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-15T10:53:20.134755Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 3. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 3 Topic: "test-topic" Partition: 2 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-15T10:53:20.134879Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] [] Confirm partition stream create. Partition stream id: 3. Cluster: "-". Topic: "test-topic". Partition: 2. Read offset: (NULL)
2025-10-15T10:53:20.133621Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 sending to client partition status
2025-10-15T10:53:20.133771Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 1 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-15T10:53:20.135951Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 1. Read offset: (NULL)
2025-10-15T10:53:20.136193Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] Closing read session. Close timeout: 0.010000s
2025-10-15T10:53:20.136244Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:2:3:0:0 -:test-topic:3:2:0:0 -:test-topic:4:1:0:0
2025-10-15T10:53:20.136275Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 178 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.136683Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] Closing read session. Close timeout: 0.010000s
2025-10-15T10:53:20.136717Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:1:2:0:0 -:test-topic:0:1:0:0
2025-10-15T10:53:20.136738Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] Counters: { Errors: 0 CurrentSessionLifetimeMs: 155 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.137007Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] Closing read session. Close timeout: 0.000000s
2025-10-15T10:53:20.137048Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:2:3:0:0 -:test-topic:3:2:0:0 -:test-topic:4:1:0:0
2025-10-15T10:53:20.138638Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-10-15T10:53:20.138725Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 grpc closed
2025-10-15T10:53:20.137073Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 178 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.138809Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] Closing read session. Close timeout: 0.000000s
2025-10-15T10:53:20.138840Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:1:2:0:0 -:test-topic:0:1:0:0
2025-10-15T10:53:20.138860Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] Counters: { Errors: 0 CurrentSessionLifetimeMs: 157 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.138880Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] Closing read session. Close timeout: 0.000000s
2025-10-15T10:53:20.138909Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:1:2:0:0 -:test-topic:0:1:0:0
2025-10-15T10:53:20.138938Z :INFO: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] Counters: { Errors: 0 CurrentSessionLifetimeMs: 157 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.139003Z :NOTICE: [/Root] [/Root] [d2581cff-1edb1262-be8cf128-c6c832b6] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:53:20.139633Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] Closing read session. Close timeout: 0.000000s
2025-10-15T10:53:20.139677Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:2:3:0:0 -:test-topic:3:2:0:0 -:test-topic:4:1:0:0
2025-10-15T10:53:20.139701Z :INFO: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 181 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:20.139743Z :NOTICE: [/Root] [/Root] [ede63f8e-bec632ae-97efbaa5-563d642c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:53:20.140622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_11737664680101381890_v1
2025-10-15T10:53:20.140650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399875929670336:2507] destroyed
2025-10-15T10:53:20.140668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_11737664680101381890_v1
2025-10-15T10:53:20.140680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399875929670335:2506] destroyed
2025-10-15T10:53:20.140690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.140706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399875929670327:2503] destroyed
2025-10-15T10:53:20.140725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.140739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399875929670326:2502] destroyed
2025-10-15T10:53:20.140752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.140774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399875929670325:2501] destroyed
2025-10-15T10:53:20.140806Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_11737664680101381890_v1
2025-10-15T10:53:20.140817Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_11737664680101381890_v1
2025-10-15T10:53:20.140826Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.140835Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.140845Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.138779Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_11737664680101381890_v1 is DEAD
2025-10-15T10:53:20.139464Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-10-15T10:53:20.139511Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 grpc closed
2025-10-15T10:53:20.139536Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_6855417180946557331_v1 is DEAD
2025-10-15T10:53:20.140188Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399875929670330:2495] disconnected; active server actors: 1
2025-10-15T10:53:20.140205Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399875929670330:2495] client user disconnected session shared/user_1_1_11737664680101381890_v1
2025-10-15T10:53:20.140283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:53:20.140347Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399875929670317:2496] disconnected; active server actors: 1
2025-10-15T10:53:20.140363Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399875929670317:2496] client user disconnected session shared/user_1_2_6855417180946557331_v1
2025-10-15T10:53:20.216650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.216681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.216698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:20.216752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.216757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.216763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:20.216799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.216805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.216811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:20.216830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.216835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.216840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:20.222302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.222329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.222340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.323452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.323481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.323490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:20.323533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.323539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.323543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:20.323562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.323568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.323573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:20.323592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.323597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.323603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:20.323621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.323626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.323631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.428525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.428549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.428557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:20.428598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.428605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.428610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:20.428648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.428657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.428662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:20.428683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.428689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.428694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:20.428711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.428716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.428721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.535261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.535283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.535293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:20.535332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.535338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.535343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:20.539464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.539486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.539493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:20.539513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.539520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.539525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:20.539542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.539548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.539553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.639444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.639470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.639479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-15T10:53:20.639520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.639526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.639531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-15T10:53:20.639548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.639554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.639558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-15T10:53:20.639576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.639590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.639595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-15T10:53:20.639613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.639618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.639623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.767418Z node 1 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [1:7561399875929670348:2485] TxId: 281474976710686. Ctx: { TraceId: 01k7kr1h370962v40r52ecz851, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NmNiZDFmOTgtODMxNzI5Y2QtNTFiNWM3MzUtNGI0OTQxZWY=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 2
2025-10-15T10:53:20.768156Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7561399875929670358:2510], TxId: 281474976710686, task: 2. Ctx: { TraceId : 01k7kr1h370962v40r52ecz851.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=1&id=NmNiZDFmOTgtODMxNzI5Y2QtNTFiNWM3MzUtNGI0OTQxZWY=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7561399875929670348:2485], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-15T10:53:20.768440Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7561399875929670359:2511], TxId: 281474976710686, task: 4. Ctx: { TraceId : 01k7kr1h370962v40r52ecz851.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=1&id=NmNiZDFmOTgtODMxNzI5Y2QtNTFiNWM3MzUtNGI0OTQxZWY=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7561399875929670348:2485], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-15T10:53:21.772318Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710687. Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:21.772443Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:248: ActorId: [1:7561399880224637665:2512] TxId: 281474976710687. Ctx: { TraceId: 01k7kr1j7m3ssjs7cdp7k1y608, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MmRlZDZkMmMtODAxYWU4YTEtODA5MWZkODItM2VjNGNkNzA=, PoolId: }. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:21.772646Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2830: SessionId: ydb://session/3?node_id=1&id=MmRlZDZkMmMtODAxYWU4YTEtODA5MWZkODItM2VjNGNkNzA=, ActorId: [1:7561399880224637662:2512], ActorState: ExecuteState, TraceId: 01k7kr1j7m3ssjs7cdp7k1y608, Create QueryResponse for error on request, msg: 
2025-10-15T10:53:21.772814Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2830: SessionId: ydb://session/3?node_id=1&id=NmNiZDFmOTgtODMxNzI5Y2QtNTFiNWM3MzUtNGI0OTQxZWY=, ActorId: [1:7561399871634702981:2485], ActorState: ExecuteState, TraceId: 01k7kr1h370962v40r52ecz851, Create QueryResponse for error on request, msg: 
2025-10-15T10:53:21.773713Z node 1 :PQ_METACACHE ERROR: msgbus_server_pq_metacache.cpp:260: Got error trying to perform request: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k7kr1j7vfptbc90ydvb1fqqa" } } YdbStatus: UNAVAILABLE ConsumedRu: 1 }
2025-10-15T10:53:21.775248Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Kikimr cluster or one of its subsystems was unavailable." issue_code: 2005 severity: 1 issues { message: "Failed to send EvStartKqpTasksRequest because node is unavailable: 2" severity: 1 } } TxMeta { id: "01k7kr1hzm4w9egt7qsj71qtk6" } } YdbStatus: UNAVAILABLE ConsumedRu: 600 }
2025-10-15T10:53:23.105722Z :PreferredDatabaseNoFallback INFO: Random seed for debugging is 1760525603105707
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/00107f/r3tmp/tmpPEPKZR/pdisk_1.dat
2025-10-15T10:53:23.842513Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7561399891104769516:2218];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:23.874826Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T10:53:23.875016Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:23.911899Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:24.004941Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:24.007702Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:24.007741Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:24.008247Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:24.283815Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:24.335502Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:24.419868Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:24.448802Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:24.453954Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:24.464199Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:24.464276Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:24.467893Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:24.473067Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-15T10:53:24.479993Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 6625, node 3
2025-10-15T10:53:24.812281Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:24.814550Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:24.847601Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:24.912119Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:24.963220Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/00107f/r3tmp/yandex43fLPm.tmp
2025-10-15T10:53:24.963244Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/00107f/r3tmp/yandex43fLPm.tmp
2025-10-15T10:53:24.963421Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/00107f/r3tmp/yandex43fLPm.tmp
2025-10-15T10:53:24.963607Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:25.079214Z INFO: TTestServer started on Port 26043 GrpcPort 6625
TClient is connected to server localhost:26043
PQClient connected to localhost:6625
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:25.428964Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:28.846610Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7561399891104769516:2218];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:28.846712Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:31.066699Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7561399921169540765:2298], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:31.067541Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=YTFhN2NjZmMtMjhjZDU1Mi1lMzMyMDQxOC1lY2QzYTU0Yw==, ActorId: [4:7561399921169540763:2297], ActorState: ExecuteState, TraceId: 01k7kr1vz94dw3pjhh08w6debv, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:31.067906Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:31.193979Z node 3 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k7kr1psfekng4j68w7j3bkq7", Request deadline has expired for 0.525597s seconds
2025-10-15T10:53:31.269975Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7561399926428785252:2328], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:31.272446Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=YTQwNWI1YmYtOTJlMGZhOTItYzY1ZGNiOWYtM2YyOTVmYzA=, ActorId: [3:7561399926428785249:2326], ActorState: ExecuteState, TraceId: 01k7kr1w6107cdke88nbt3enza, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:31.272827Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:31.303585Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:31.494853Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:31.722559Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:6625", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:32.426904Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k7kr1wvwck2e0qrkq14xnb8b, Database: , SessionId: ydb://session/3?node_id=3&id=NWIyZGQxZDctZTdkMTMyOGUtYjUxMzlkY2MtMjE0MzUwNjg=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7561399930723752953:2937] 
=== CheckClustersList. Ok
2025-10-15T10:53:37.882553Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:6625
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:38.032877Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6625
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:38.113560Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7561399956493557196:3209] connected; active server actors: 1
2025-10-15T10:53:38.114290Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:38.118896Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:38.117066Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:38.121846Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:38.126458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:38.126677Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:38.126704Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:38.126736Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:38.127223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399956493557195:3208], now have 1 active actors on pipe
2025-10-15T10:53:38.127246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399956493557221:2438], now have 1 active actors on pipe
2025-10-15T10:53:38.128026Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-15T10:53:38.128505Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.136926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.156652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399956493557253:3254], now have 1 active actors on pipe
2025-10-15T10:53:38.157694Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.167027Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.168009Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:38.168048Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:38.168281Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:38.168475Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7561399955529279650:2381]
2025-10-15T10:53:38.171312Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:38.171333Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:38.171366Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7561399955529279650:2381]
2025-10-15T10:53:38.171389Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:38.172618Z node 4 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:38.172655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.172725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.172737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:38.172752Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:38.172764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.172774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.172783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:38.172812Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:38.173077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.173230Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:38.184191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.184320Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525618187, TxId 281474976710676
2025-10-15T10:53:38.184341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.184350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.184445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.184611Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:38.191645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:38.191974Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:38.191999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.192023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.192033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.192066Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:38.192375Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:38.192446Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:38.192645Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.223157Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.223249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:38.246282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:38.276984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.277028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.277040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.375648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.375675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.375688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.479710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.479753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.479769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.519033Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k7kr22xh8kcem1br1wkkehgq, Database: , SessionId: ydb://session/3?node_id=3&id=OTg0NGZkYzktM2RhMWRmZDQtM2EzOGUzNzEtZWQwMTc2YmQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525618187
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525618187
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:6625
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:38.578753Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:38.588037Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.588076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.588090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.687335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.687390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.687405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.792241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.792270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.792282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.898578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.898605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.898616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.000997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.001020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.001044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:6625
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:39.091386Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:39.107451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.107478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.107489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.119860Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:39.120905Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:39.132901Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:6625
2025-10-15T10:53:39.172590Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:39.181231Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:39.181270Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:39.188122Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:39.188324Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:41260
2025-10-15T10:53:39.188345Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41260 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:39.188356Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:39.193194Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:39.193352Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:39.193364Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:39.193374Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:39.193401Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561399960788524700:2468] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:39.197656Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561399960788524700:2468] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:39.211587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.211624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.211636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.311535Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:39.311563Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:39.314695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.314719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.314731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.419679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.419706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.419718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.523825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.523864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.523879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.632385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.632417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.632432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.714189Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7561399960788524700:2468] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:39.727865Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399960788524740:2468] connected; active server actors: 1
2025-10-15T10:53:39.728036Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7561399960788524700:2468] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:39.728054Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561399960788524700:2468] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:39.736040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.736070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.736094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.800041Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399960788524740:2468] disconnected; active server actors: 1
2025-10-15T10:53:39.800072Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399960788524740:2468] disconnected no session
2025-10-15T10:53:39.839805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.839833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.839849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.947558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.947595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.947610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.051273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.051302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.051313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.151535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.151558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.151569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.207817Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561399960788524700:2468] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:40.207852Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561399960788524700:2468] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:40.207868Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561399960788524700:2468] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:40.207893Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:40.221713Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399965083492082:2468], now have 1 active actors on pipe
2025-10-15T10:53:40.221985Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:53:40.222279Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:40.222306Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:40.222375Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|df4b677d-9ac0a17f-fb05ce71-45af852d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:40.222431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.222448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.222458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:40.222492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.222525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:40.222566Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:40.223368Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:40.223396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:40.223460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:40.223819Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|df4b677d-9ac0a17f-fb05ce71-45af852d_0
2025-10-15T10:53:40.224546Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525620224 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:40.224638Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|df4b677d-9ac0a17f-fb05ce71-45af852d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:40.224856Z :INFO: [] MessageGroupId [src] SessionId [src|df4b677d-9ac0a17f-fb05ce71-45af852d_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:40.224888Z :INFO: [] MessageGroupId [src] SessionId [src|df4b677d-9ac0a17f-fb05ce71-45af852d_0] Write session will now close
2025-10-15T10:53:40.224921Z :DEBUG: [] MessageGroupId [src] SessionId [src|df4b677d-9ac0a17f-fb05ce71-45af852d_0] Write session: aborting
2025-10-15T10:53:40.225239Z :INFO: [] MessageGroupId [src] SessionId [src|df4b677d-9ac0a17f-fb05ce71-45af852d_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:40.225268Z :DEBUG: [] MessageGroupId [src] SessionId [src|df4b677d-9ac0a17f-fb05ce71-45af852d_0] Write session: destroy
2025-10-15T10:53:40.232930Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|df4b677d-9ac0a17f-fb05ce71-45af852d_0 grpc read done: success: 0 data: 
2025-10-15T10:53:40.232952Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|df4b677d-9ac0a17f-fb05ce71-45af852d_0 grpc read failed
2025-10-15T10:53:40.232976Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|df4b677d-9ac0a17f-fb05ce71-45af852d_0 grpc closed
2025-10-15T10:53:40.232990Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|df4b677d-9ac0a17f-fb05ce71-45af852d_0 is DEAD
2025-10-15T10:53:40.233519Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:40.234083Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561399965083492082:2468] destroyed
2025-10-15T10:53:40.234121Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:40.234145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.234155Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.234164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.252063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.252087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.252099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
====TYdbPqTestRetryPolicy()
====ExpectBreakDown
=== Session was created, waiting for retries
>>> Ready to answer: ok
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-10-15T10:53:40.354789Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:53:40.355604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.355627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.355639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.490655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.490682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.490693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.595447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.595479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.595490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.693700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.693728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.693738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.796150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.796188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.796221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.900276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.900310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.900325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.001424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.001456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.001470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.103257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.103292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.103303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.203643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.203696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.203713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.307613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.307644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.307659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.412323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.412355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.412371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.512172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.512201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.512213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.612107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.612132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.612154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.712448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.712481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.712505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.815559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.815588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.815600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.915829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.915864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.915883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.016296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.016330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.016345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.120020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.120048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.120060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.222624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.222657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.222670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.322070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.322105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.322119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:53:42.359649Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:53:42.423574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.423605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.423617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.526826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.526869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.526881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.627664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.627695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.627707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.728212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.728238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.728249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.831697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.831732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.831744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.935553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.935580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.935592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.037577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.037602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.037614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.139570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.139598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.139611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.176144Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:43.240499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.240527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.240538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.343469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.343496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.343506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.446833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.446862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.446875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.551447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.551474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.551484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.653542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.653565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.653575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.753888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.753913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.753925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.855394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.855422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.855431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.956136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.956172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.956188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.059812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.059840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.059855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.167490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.167525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.167539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.265839Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.265868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.265882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:53:44.363591Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
=== In the next federation discovery response dc2 will be available
2025-10-15T10:53:44.368668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.368699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.368711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.471750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.471784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.471798Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.572509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.572544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.572559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.675559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.675596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.675611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.779478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.779511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.779523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.883473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.883507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.883521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.983843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.983874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.983887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.084876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.084911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.084925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.187462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.187498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.187512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.289755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.289789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.289803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.395587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.395632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.395646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.494124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.494159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.494184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.595990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.596026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.596040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.699541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.699577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.699593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.803497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.803536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.803552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.900595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.900629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.900648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.007480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.007520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.007537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.105894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.105933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.105949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.208285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.208316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.208329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.315505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.315543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.315560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:53:46.367596Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:53:46.412168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.412211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.412226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.515584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.515620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.515636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.616557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.616593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.616609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.718040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.718075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.718089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.823477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.823512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.823526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.923087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.923124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.923138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.027715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.027746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.027759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.131759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.131786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.131799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.232249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.232276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.232289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.334392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.334423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.334436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.435543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.435573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.435585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.538167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.538195Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.538208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.639550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.639582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.639597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.743604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.743641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.743657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.843169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.843212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.843242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.944325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.944359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.944374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.043882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.043917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.043930Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.147476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.147514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.147527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.179644Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:48.251827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.251866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.251882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.358971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.359025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.359040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:53:48.371575Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:53:48.458888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.458929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.458944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.563654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.563684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.563697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.667475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.667516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.667530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.767377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.767406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.767419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.869566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.869601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.869611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.979424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.979452Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.979464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.076504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.076528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.076539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.179482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.179508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.179521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.280241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.280272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.280286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.385635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.385658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.385668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.485677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.485705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.485718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.590788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.590821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.590834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.695888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.695920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.695931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.799210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.799240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.799253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.896235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.896267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.896282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.999762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.999797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.999812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.104160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.104191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.104207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.207620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.207656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.207670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.307455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.307489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.307501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:53:50.375705Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:53:50.411599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.411631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.411643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.511627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.511660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.511673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.615677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.615707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.615719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.719450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.719478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.719491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.819445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.819473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.819483Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.923509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.923548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.923563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.024159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.024191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.024202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.133616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.133660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.133672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.235616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.235647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.235659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.335638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.335670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.335685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.443497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.443535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.443551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.547659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.547694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.547723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.647618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.647652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.647665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.751915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.751949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.751964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.855212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.855292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.855315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.955723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.955753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.955766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.055979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.056012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.056024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.160556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.160588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.160602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.263633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.263673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.263690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.367227Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.367263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.367276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:53:52.379428Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:53:52.470327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.470359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.470372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.568736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.568764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.568776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.671571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.671617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.671633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.770861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.770892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.770907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.871801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.871847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.871860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.974283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.974326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.974342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.075583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.075613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.075628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.175635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.175664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.175680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.181587Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:53.279473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.279510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.279525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.379985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.380030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.380059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.480373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.480404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.480430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.580686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.580717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.580733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.684953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.684983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.684998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.786656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.786694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.786708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.887782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.887815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.887834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.988351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.988383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.988398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.088503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.088530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.088543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.196960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.196991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.197004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.297314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.297348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.297363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:53:54.383634Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:53:54.402879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.402913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.402927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.503710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.503743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.503760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.604286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.604315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.604328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.707300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.707336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.707361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.808135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.808175Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.808188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.908406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.908433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.908446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.011457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.011489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.011501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.111511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.111540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.111552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.212646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.212671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.212683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.319465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.319492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.319501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.418221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.418244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.418255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.518879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.518907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.518919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.619154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.619178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.619188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.723459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.723488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.723499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.831361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.831395Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.831409Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.931971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.932001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.932013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.037025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.037056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.037068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.139897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.139927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.139939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.245905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.245936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.245949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.351842Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.351873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.351885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:53:56.390391Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:53:56.451666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.451706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.451722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.557116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.557158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.557172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.657188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.657221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.657236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.759467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.759493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.759503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.863011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.863039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.863050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.963605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.963637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.963649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.066925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.066952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.066962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.175172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.175197Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.175208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.279458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.279492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.279505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.379780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.379814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.379828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.483071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.483101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.483112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.587479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.587512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.587528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.695573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.695612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.695628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.792831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.792860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.792873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.898787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.898827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.898841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.995863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.995895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.995910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.102725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.102764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.102779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.183688Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:58.203581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.203612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.203628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.307789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.307815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.307829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:53:58.393119Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:53:58.407297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.407328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.407341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.511666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.511697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.511711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.622531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.622561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.622575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.723767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.723802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.723816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.828128Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.828168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.828187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.930686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.930716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.930745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.030892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.030929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.030943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.131618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.131653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.131666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.235770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.235799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.235812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.336331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.336368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.336383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.439944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.439984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.440000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.543486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.543525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.543540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.647569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.647608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.647624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.747699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.747732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.747745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.857788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.857817Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.857831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.961771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.961801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.961819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.062825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.062852Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.062864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.163605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.163637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.163648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.263785Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.263815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.263828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.367823Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.367858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.367872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:54:00.393631Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:54:00.471612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.471645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.471658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.575512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.575547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.575563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.676851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.676878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.676891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.779792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.779824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.779837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.879933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.879964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.879977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.980247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.980274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.980287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.087587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.087621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.087635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.187833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.187865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.187878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.288041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.288064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.288075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.391500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.391527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.391538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.492087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.492125Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.492150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.595469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.595504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.595519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.694315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.694340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.694351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.798290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.798329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.798343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.903512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.903554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.903569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.003655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.003686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.003698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.107161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.107192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.107204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.207337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.207383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.207396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.309818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.309845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.309855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:54:02.398183Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:54:02.409408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.409440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.409451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.511888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.511920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.511932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.619253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.619285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.619298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.721273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.721302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.721314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.823466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.823496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.823510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.922010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.922036Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.922049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.023952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.023984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.024001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.126269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.126302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.126317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.182879Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:03.231799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.231837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.231852Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.335049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.335084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.335098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.435157Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.435191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.435206Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.539673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.539706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.539722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.639750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.639779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.639792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.743595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.743626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.743642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.845331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.845367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.845396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.950659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.950692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.950706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.051391Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.051423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.051438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.155473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.155503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.155516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.257173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.257211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.257227Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.359565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.359604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.359620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:54:04.403656Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:54:04.459502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.459538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.459553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.559459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.559489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.559503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.661557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.661597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.661614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.766530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.766575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.766592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.875789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.875828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.875843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.979487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.979522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.979539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.082377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.082414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.082430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.181158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.181191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.181208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.283597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.283631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.283646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.383958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.383993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.384008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.491460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.491493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.491506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.591573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.591605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.591618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.694203Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.694236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.694249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.795540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.795577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.795600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.899815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.899849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.899862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.999696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.999727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.999741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.103515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.103552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.103567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.207691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.207722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.207737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.311664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.311700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.311715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:54:06.407479Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:54:06.413147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.413179Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.413204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.513240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.513278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.513296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.613803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.613842Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.613858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.719841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.719871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.719884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.823612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.823642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.823655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.927654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.927682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.927695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.035000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.035038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.035052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.135698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.135734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.135747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.239722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.239756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.239769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.340635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.340664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.340677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.444759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.444788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.444802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.551442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.551470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.551485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.659521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.659550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.659562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.763545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.763577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.763590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.867462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.867493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.867508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.968032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.968057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.968070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.073964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.073996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.074010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.123583Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:54:08.123674Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-15T10:54:08.127277Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:54:08.128316Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-15T10:54:08.128856Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:54:08.130191Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-15T10:54:08.176469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.176496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.176509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.183842Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:08.279618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.279648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.279660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.385075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.385114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.385128Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-15T10:54:08.411743Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-15T10:54:08.487634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.487671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.487686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.591471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.591514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.591527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.689732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.689762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.689777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.795488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.795524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.795537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.892783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.892808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.892828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.993402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.993432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.993461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.095705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.095731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.095741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.196099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.196126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.196138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.299684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.299715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.299729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.406816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.406849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.406864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.511514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.511548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.511563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.611878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.611925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.611940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.717181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.717218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.717234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.814302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.814333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.814348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.914489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.914522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.914537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.018135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.018171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.018187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.119941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.119989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.120015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.224097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.224133Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.224147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.324044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.324075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.324090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
=== Waiting for repair
>>> Ready to answer: ok
2025-10-15T10:54:10.419873Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:6625" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:6625" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:6625" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
=== Closing the session
2025-10-15T10:54:10.428006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.428036Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.428048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.439657Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:54:10.440208Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-15T10:54:10.472037Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-15T10:54:10.472075Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session will now close
2025-10-15T10:54:10.472132Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: aborting
2025-10-15T10:54:10.472275Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-15T10:54:10.472322Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: destroy
2025-10-15T10:54:10.531526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.531560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.531576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.633701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.633739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.633756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.107691Z node 3 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [3:7561400098227479609:2698] TxId: 281474976710732. Ctx: { TraceId: 01k7kr3278ener89nvvx7vvcyt, Database: /Root, SessionId: ydb://session/3?node_id=3&id=MTRmYTM5YjctYjJlOWJlYzItM2Q4MTBjZTAtMWExYzk2NzY=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 4
2025-10-15T10:54:11.107873Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [3:7561400098227479618:2710], TxId: 281474976710732, task: 2. Ctx: { TraceId : 01k7kr3278ener89nvvx7vvcyt.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=3&id=MTRmYTM5YjctYjJlOWJlYzItM2Q4MTBjZTAtMWExYzk2NzY=.  CurrentExecutionId : .  DatabaseId : /Root.  Database : /Root. }. Handle abort execution event from: [3:7561400098227479609:2698], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-15T10:54:11.108160Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [3:7561400098227479619:2711], TxId: 281474976710732, task: 4. Ctx: { TraceId : 01k7kr3278ener89nvvx7vvcyt.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=3&id=MTRmYTM5YjctYjJlOWJlYzItM2Q4MTBjZTAtMWExYzk2NzY=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [3:7561400098227479609:2698], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-15T10:53:50.628970Z :PropagateSessionClosed INFO: Random seed for debugging is 1760525630628910
2025-10-15T10:53:51.369067Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561400009315858673:2217];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:51.369118Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:51.551445Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:51.573854Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7561400012115566018:2190];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:51.577351Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T10:53:51.593727Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:51.593880Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/00106d/r3tmp/tmpDvZdC2/pdisk_1.dat
2025-10-15T10:53:52.062272Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:52.091514Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:52.337367Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:52.362524Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:52.362609Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:52.363291Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:52.363333Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:52.364422Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:52.370669Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T10:53:52.370832Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:52.372196Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:52.372405Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:52.374451Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
TServer::EnableGrpc on GrpcPort 13695, node 1
2025-10-15T10:53:52.652159Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:52.665032Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:52.678151Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/00106d/r3tmp/yandexLaPw54.tmp
2025-10-15T10:53:52.678184Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/00106d/r3tmp/yandexLaPw54.tmp
2025-10-15T10:53:52.678381Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/00106d/r3tmp/yandexLaPw54.tmp
2025-10-15T10:53:52.678541Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:52.756153Z INFO: TTestServer started on Port 6884 GrpcPort 13695
2025-10-15T10:53:52.803297Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:6884
PQClient connected to localhost:13695
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:53.438958Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:56.371467Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561400009315858673:2217];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:56.371535Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:56.575477Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7561400012115566018:2190];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:56.575554Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:58.337750Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:58.349742Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7561400035085663318:2325], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:58.351662Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=NzZiNzBmODktYTJmMjM1Yy1hNWM3OTBiNC01NWU2ODhkMA==, ActorId: [1:7561400035085663315:2323], ActorState: ExecuteState, TraceId: 01k7kr2p8macedawz7d5eec387, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:58.353920Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:58.359505Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7561400037885369958:2295], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:58.361408Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=N2YwODY0ODgtNjJjYWIzLTg5OGYwNWZkLTkxOGVlNDY5, ActorId: [2:7561400037885369956:2294], ActorState: ExecuteState, TraceId: 01k7kr2p1p20frasm52hje2ns6, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:58.361735Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:58.562207Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:58.885320Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:13695", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:59.549006Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k7kr2qc39w1fad1471a0ypst, Database: , SessionId: ydb://session/3?node_id=1&id=M2I4Njc5NDQtNjBmOWNmM2QtM2E1YTc1MWItOTA0MmJiZmI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561400043675598339:2954] 
=== CheckClustersList. Ok
2025-10-15T10:54:06.370187Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:13695
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:54:06.586246Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:13695
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715681
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:54:06.648911Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561400073740369990:3270] connected; active server actors: 1
2025-10-15T10:54:06.649151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:54:06.650755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:54:06.652247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:54:06.705970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:06.720120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:06.720449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:54:06.720561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:06.720605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:54:06.725515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400073740369989:3269], now have 1 active actors on pipe
2025-10-15T10:54:06.725547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400073740370010:2467], now have 1 active actors on pipe
2025-10-15T10:54:06.723509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T10:54:06.730225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:06.748674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:06.755139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400073740370054:3317], now have 1 active actors on pipe
2025-10-15T10:54:06.757095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:06.761606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:06.762829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:06.762939Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:54:06.763303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:06.763692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400076540076259:2404]
2025-10-15T10:54:06.774638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:06.777053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:06.777121Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561400076540076259:2404]
2025-10-15T10:54:06.777174Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:54:06.778915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:54:06.778993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.779134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.779145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:06.779171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:54:06.779186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.779197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.779207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:54:06.779281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:06.780634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:06.780829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:06.799792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:06.799960Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525646796, TxId 281474976715681
2025-10-15T10:54:06.799985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.799998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.800141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.800421Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:06.804548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:06.804878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:06.804917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.804932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.804942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.804976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:06.805392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:54:06.805518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:06.805817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:06.824590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:06.824749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:06.830613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:06.861932Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715682. Ctx: { TraceId: 01k7kr2yt382n83gg6qgh2wr3d, Database: , SessionId: ydb://session/3?node_id=1&id=YTFkNTA1MjAtZWE1NDRhMWYtZjM0YTZlMTYtYTE3OTIwNw==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-15T10:54:06.872429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.872457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.872470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715681
    CreateStep: 1760525646796
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715681
    CreateStep: 1760525646796
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:13695
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:54:06.962997Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:54:06.979500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.979538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.979548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.079451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.079480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.079490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.176044Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:54:07.176092Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:54:07.179735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.179770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.179780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.282180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.282200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.282210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.382377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.382399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.382418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13695
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:54:07.475128Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:54:07.527278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.527307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.527318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.627490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.627521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.627530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.727632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.727659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.727679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.833732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.833758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.833768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.933898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.933922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.933933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13695
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:54:07.985564Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:54:08.000160Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:54:08.002022Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:54:08.002077Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:08.024209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:08.024241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:54:08.034381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.034404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.034413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.036709Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:54:08.037817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:54:08.037986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:53638
2025-10-15T10:54:08.038012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53638 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:08.038023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:08.040303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:54:08.040443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:08.040455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:08.040464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:08.040485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400082330304807:2500] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:08.042808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400082330304807:2500] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:08.136293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.136317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.136327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.239946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.239973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.239982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.326612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561400082330304807:2500] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:54:08.327468Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400082330304855:2500] connected; active server actors: 1
2025-10-15T10:54:08.327571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561400082330304807:2500] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:54:08.327593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400082330304807:2500] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:08.332438Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400082330304855:2500] disconnected; active server actors: 1
2025-10-15T10:54:08.332486Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400082330304855:2500] disconnected no session
2025-10-15T10:54:08.340963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.340992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.341001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.444313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.444338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.444348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.545606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.545633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.545643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.559273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400082330304807:2500] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:08.559315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400082330304807:2500] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:54:08.559337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400082330304807:2500] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:08.559388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:08.561061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:54:08.561233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400082330304882:2500], now have 1 active actors on pipe
2025-10-15T10:54:08.561321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:08.561351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:08.561435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|40a26ed6-90a06f0e-e03f826f-5e066388_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:54:08.561494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.561525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.561537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:08.561589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.561633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:08.561724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:08.569555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:08.569595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:08.569706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:08.574060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|40a26ed6-90a06f0e-e03f826f-5e066388_0
2025-10-15T10:54:08.580935Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525648580 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:08.581091Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|40a26ed6-90a06f0e-e03f826f-5e066388_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:08.581355Z :INFO: [] MessageGroupId [src] SessionId [src|40a26ed6-90a06f0e-e03f826f-5e066388_0] Write session: close. Timeout = 0 ms
2025-10-15T10:54:08.581392Z :INFO: [] MessageGroupId [src] SessionId [src|40a26ed6-90a06f0e-e03f826f-5e066388_0] Write session will now close
2025-10-15T10:54:08.581430Z :DEBUG: [] MessageGroupId [src] SessionId [src|40a26ed6-90a06f0e-e03f826f-5e066388_0] Write session: aborting
2025-10-15T10:54:08.581845Z :INFO: [] MessageGroupId [src] SessionId [src|40a26ed6-90a06f0e-e03f826f-5e066388_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:54:08.581881Z :DEBUG: [] MessageGroupId [src] SessionId [src|40a26ed6-90a06f0e-e03f826f-5e066388_0] Write session: destroy
2025-10-15T10:54:08.590669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|40a26ed6-90a06f0e-e03f826f-5e066388_0 grpc read done: success: 0 data: 
2025-10-15T10:54:08.590700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|40a26ed6-90a06f0e-e03f826f-5e066388_0 grpc read failed
2025-10-15T10:54:08.590736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|40a26ed6-90a06f0e-e03f826f-5e066388_0 grpc closed
2025-10-15T10:54:08.590750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|40a26ed6-90a06f0e-e03f826f-5e066388_0 is DEAD
2025-10-15T10:54:08.592075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:54:08.592706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561400082330304882:2500] destroyed
2025-10-15T10:54:08.592749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:54:08.592779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.592796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.592807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-15T10:54:08.645241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.645265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.645276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:54:08.688694Z :INFO: [/Root] [] [c38267ff-c9659b18-bae79ef9-faca37a3] Open read subsessions to databases: { name: dc1, endpoint: localhost:13695, path: /Root }, { name: dc2, endpoint: localhost:13695, path: /Invalid }
2025-10-15T10:54:08.707910Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Starting read session
2025-10-15T10:54:08.707977Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Starting single session
2025-10-15T10:54:08.708666Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:08.708706Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:08.708743Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:54:08.715107Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T10:54:08.716548Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:54:08.716572Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-15T10:54:08.746655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.746685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.746696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.747936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-15T10:54:08.748439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-15T10:54:08.748539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:08.763830Z :INFO: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Starting read session
2025-10-15T10:54:08.783481Z :DEBUG: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Starting single session
2025-10-15T10:54:08.790819Z :DEBUG: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:08.790849Z :DEBUG: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:08.790887Z :DEBUG: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:54:08.791102Z :ERROR: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. 
2025-10-15T10:54:08.791172Z :DEBUG: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:08.791226Z :DEBUG: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:08.791370Z :INFO: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:08.795188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:08.795724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:08.795759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-15T10:54:08.799139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:08.799279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:08.799295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:08.799308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:08.805115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-15T10:54:08.805227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:08.805239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:08.805247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:08.805265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:08.812230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:08.818175Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:54:08.818510Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:54:08.819007Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 auth for : user
2025-10-15T10:54:08.819621Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 Handle describe topics response
2025-10-15T10:54:08.819759Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 auth is DEAD
2025-10-15T10:54:08.819833Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:54:08.821059Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:54:08.822812Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_1_7647013187117849532_v1
2025-10-15T10:54:08.822890Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:08.823372Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:08.826275Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:54:08.826427Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 got read request: guid# d3a28b74-947126e9-e0d6a519-2203af67
2025-10-15T10:54:08.826538Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400082330304931:2522] connected; active server actors: 1
2025-10-15T10:54:08.828067Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561400082330304931:2522] session shared/user_1_1_7647013187117849532_v1
2025-10-15T10:54:08.828145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:54:08.828210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:54:08.828281Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_7647013187117849532_v1" (Sender=[1:7561400082330304911:2522], Pipe=[1:7561400082330304931:2522], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:54:08.828329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:54:08.828395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:54:08.828451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_7647013187117849532_v1" (Sender=[1:7561400082330304911:2522], Pipe=[1:7561400082330304931:2522], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:54:08.828520Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_7647013187117849532_v1" sender [1:7561400082330304911:2522] lock partition 0 for ReadingSession "shared/user_1_1_7647013187117849532_v1" (Sender=[1:7561400082330304911:2522], Pipe=[1:7561400082330304931:2522], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-15T10:54:08.828584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:54:08.828621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000197s
2025-10-15T10:54:08.829678Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_7647013187117849532_v1" ClientId: "user" PipeClient { RawX1: 7561400082330304931 RawX2: 4503603922340314 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:54:08.829780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:54:08.835393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:54:08.836145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400082330304938:2534], now have 1 active actors on pipe
2025-10-15T10:54:08.839590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7561400082330304938:2534]
2025-10-15T10:54:08.839759Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400082330304948:2528] connected; active server actors: 1
2025-10-15T10:54:08.839794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-15T10:54:08.839817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:08.840298Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400082330304948:2528] disconnected; active server actors: 1
2025-10-15T10:54:08.840320Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400082330304948:2528] disconnected no session
2025-10-15T10:54:08.840140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:08.840175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:08.840221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_7647013187117849532_v1 on pipe: [1:7561400082330304938:2534]
2025-10-15T10:54:08.840297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.840318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.840334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:08.840399Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_7647013187117849532_v1
2025-10-15T10:54:08.840414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.840562Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:08.840988Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_7647013187117849532_v1:1 with generation 1
2025-10-15T10:54:08.850628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:08.850699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:08.850760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:08.850781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.850792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.850800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.850824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:08.850857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:54:08.857346Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760525648745 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:54:08.857405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T10:54:08.857509Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 sending to client partition status
2025-10-15T10:54:08.861632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:08.861669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:54:08.861684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:08.861715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:08.865006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:54:08.866126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400082330304960:2528], now have 1 active actors on pipe
2025-10-15T10:54:08.866209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:08.866230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:08.866296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:08.866328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.866343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.866351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:08.866386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.866422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:08.866472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:08.867916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0
2025-10-15T10:54:08.868776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525648868 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:08.868878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:08.867371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:08.867393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:08.867446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:08.873753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 1 to 1
2025-10-15T10:54:08.880294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:08.880363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 1
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-15T10:54:08.906312Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-15T10:54:08.913095Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-15T10:54:08.913334Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-15T10:54:08.913391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:08.913522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-15T10:54:08.913597Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-15T10:54:08.915699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:08.921385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:08.921418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:08.921529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:54:08.921995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:08.942371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 2 to 2
2025-10-15T10:54:08.944328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:08.944375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-15T10:54:08.959035Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:54:08.959081Z :DEBUG: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:08.955846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.959482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.959519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.012823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 3 to 3
2025-10-15T10:54:09.014651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.014692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-15T10:54:09.025671Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:09.036242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 4 to 4
2025-10-15T10:54:09.038121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.038159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-15T10:54:09.046342Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:09.064345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 5 to 5
2025-10-15T10:54:09.066187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.066229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-15T10:54:09.077007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.077049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.082918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-15T10:54:09.083437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:09.100231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:09.103631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-15T10:54:09.104149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-15T10:54:09.104654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-15T10:54:09.104900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-15T10:54:09.104928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-15T10:54:09.105882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.105915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.105924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.105995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.106011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.106035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:09.106097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.106127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.106136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T10:54:09.106245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T10:54:09.106286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-15T10:54:09.106299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-15T10:54:09.106313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-15T10:54:09.106328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-15T10:54:09.161914Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:09.201148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-15T10:54:09.201245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.204794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 6 to 6
2025-10-15T10:54:09.207225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.207285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-15T10:54:09.208284Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:09.223147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:09.210687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1760525649207
2025-10-15T10:54:09.222535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.222552Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:09.222676Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-15T10:54:09.222713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-15T10:54:09.239448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:09.253270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:09.254580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.257652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.274587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 7 to 7
2025-10-15T10:54:09.262495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-15T10:54:09.278865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.278905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-15T10:54:09.279660Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:09.270258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-15T10:54:09.273293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-15T10:54:09.276542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-15T10:54:09.297189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-15T10:54:09.297224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-15T10:54:09.298608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:09.298189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.298218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.298245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:09.298310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.298345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-15T10:54:09.307397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:09.307446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:09.307488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:09.307518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.307555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-15T10:54:09.307568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.307583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-15T10:54:09.307590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.307606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-15T10:54:09.307613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.307625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T10:54:09.307628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-15T10:54:09.307647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.307663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-15T10:54:09.326183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:09.346884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:09.350039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 8 to 8
2025-10-15T10:54:09.358023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.358069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-15T10:54:09.359229Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:09.363316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:09.363369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:09.363386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.363422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.363437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T10:54:09.363541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T10:54:09.363573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-15T10:54:09.363590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-15T10:54:09.363605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-15T10:54:09.363619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-15T10:54:09.364775Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-15T10:54:09.364807Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-15T10:54:09.364875Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-15T10:54:09.364892Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:09.364942Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 performing read request: guid# 6f2f298a-eac582ee-ecdb45fc-93496c81, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:09.365143Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 6f2f298a-eac582ee-ecdb45fc-93496c81
2025-10-15T10:54:09.382448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 9 to 9
2025-10-15T10:54:09.385863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.385916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-15T10:54:09.386882Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:09.421470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 10 to 10
2025-10-15T10:54:09.433156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.433213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-15T10:54:09.433250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528010[B] reached maximum (20971520[B])
2025-10-15T10:54:09.434313Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:09.482814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-15T10:54:09.482926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.495633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1760525649493
2025-10-15T10:54:09.497679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:09.497801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-15T10:54:09.499515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:09.503596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 197 }
2025-10-15T10:54:09.503674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 1
2025-10-15T10:54:09.511446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275209[B]
2025-10-15T10:54:09.508626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.508668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.513992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-15T10:54:09.514706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-15T10:54:09.520440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-15T10:54:09.521405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-15T10:54:09.521791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-15T10:54:09.521808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-15T10:54:09.522707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.522759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.522776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.522880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.522898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.522934Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:09.523027Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-10-15T10:54:09.523056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:09.523099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.523246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-15T10:54:09.523293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T10:54:09.526128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 11 to 11
2025-10-15T10:54:09.523977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:09.533635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-15T10:54:09.533663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:09.545627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.545666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.546204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-10-15T10:54:09.546732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-15T10:54:09.550520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-15T10:54:09.562097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-15T10:54:09.562601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-15T10:54:09.562627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-15T10:54:09.563479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T10:54:09.000000Z
2025-10-15T10:54:09.567123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:09.563516Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-15T10:54:09.563578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T10:54:09.563725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-15T10:54:09.563737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:09.563759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:09.563815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.563853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:09.564429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-15T10:54:09.583972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:09.585324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:09.572394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:09.590255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.590297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-15T10:54:09.590331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528011[B] reached maximum (20971520[B])
2025-10-15T10:54:09.591226Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:09.620291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:09.622955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:09.640280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T10:54:09.640522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-15T10:54:09.000000Z
2025-10-15T10:54:09.640557Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-15T10:54:09.640639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.640661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.640697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.640722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:54:09.640820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:09.643257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:09.643387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-15T10:54:09.645884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:09.647836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:09.649989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:09.650764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T10:54:09.657785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:09.657868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-15T10:54:09.659331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:09.700632Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525649106 CreateTimestampMS: 1760525648871 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-15T10:54:09.706327Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-15T10:54:09.706389Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 6f2f298a-eac582ee-ecdb45fc-93496c81 has messages 1
2025-10-15T10:54:09.706834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:09.710030Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-15T10:54:09.710090Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1002 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:09.709886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:09.710072Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 read done: guid# 6f2f298a-eac582ee-ecdb45fc-93496c81, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252975
2025-10-15T10:54:09.710111Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 response to read: guid# 6f2f298a-eac582ee-ecdb45fc-93496c81
2025-10-15T10:54:09.715032Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 Process answer. Aval parts: 0
2025-10-15T10:54:09.732189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.744592Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got ReadResponse, serverBytesSize = 2252975, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728687
2025-10-15T10:54:09.745370Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-15T10:54:09.745448Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 2252975 to budget
2025-10-15T10:54:09.732237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.738757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-15T10:54:09.739268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-15T10:54:09.745604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-15T10:54:09.746252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-15T10:54:09.746474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-15T10:54:09.746495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-15T10:54:09.747421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.747441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.747501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.747515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:09.747566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.747607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:09.747679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:09.747720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:09.747733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.747754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-15T10:54:09.747764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.747779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-15T10:54:09.747785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.747798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-15T10:54:09.747806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.747821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-15T10:54:09.747837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.747852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-15T10:54:09.748709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.748766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.748775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:09.748860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-15T10:54:09.748888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-15T10:54:09.748904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-15T10:54:09.748919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-15T10:54:09.748934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-15T10:54:09.750610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T10:54:09.750938Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-15T10:54:09.750973Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-15T10:54:09.751016Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1760525649106, sizeLag# 2253219
2025-10-15T10:54:09.751029Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:09.795384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-10-15T10:54:09.795523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-15T10:54:09.795559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-15T10:54:09.795576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-15T10:54:09.795596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-15T10:54:09.795611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-15T10:54:09.822451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 4506426 count 2 nextOffset 4 batches 9
2025-10-15T10:54:09.822578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-15T10:54:09.822611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-15T10:54:09.822627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-15T10:54:09.822643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-15T10:54:09.822661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-15T10:54:09.857439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 6759623 count 3 nextOffset 5 batches 13
2025-10-15T10:54:09.857557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.858377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,3 HeadOffset 2 endOffset 2 curOffset 5 d0000000000_00000000000000000002_00000_0000000003_00012? size 6759613 WTime 1760525649857
2025-10-15T10:54:09.869488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:09.869557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:09.864793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:09.869604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:09.864879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-15T10:54:09.864957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-15T10:54:09.865010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.865025Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:09.865123Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 3 size 6759613
2025-10-15T10:54:09.886431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 385 queued_in_partition_duration_ms: 67 }
2025-10-15T10:54:09.891878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.891938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.895240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:09.897900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-15T10:54:09.900029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-15T10:54:09.900176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 2
2025-10-15T10:54:09.900228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275210[B]
2025-10-15T10:54:09.912321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-15T10:54:09.919008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-15T10:54:09.920693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-15T10:54:09.920726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-10-15T10:54:09.921492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:09.921564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.922130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:09.925327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.925361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.925421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-15T10:54:09.925758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:09.944238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.944285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.944863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-15T10:54:09.945482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-10-15T10:54:09.946033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-15T10:54:09.951636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 12 to 12
2025-10-15T10:54:09.956803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:09.956854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-15T10:54:09.946755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-15T10:54:09.947046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-15T10:54:09.947067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-15T10:54:09.948079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:09.948140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.976626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:09.986316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:09.988677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:09.989715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:09.989749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:09.989805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-15T10:54:09.994969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 3 size 6759613 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:09.995023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:09.995075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758730 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:09.995094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-15T10:54:09.995131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-15T10:54:09.995153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-15T10:54:09.995177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-15T10:54:09.995214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-15T10:54:09.995246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-15T10:54:09.995269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-15T10:54:09.995302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-15T10:54:09.995327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-15T10:54:09.995367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-15T10:54:09.995392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-15T10:54:09.995421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-15T10:54:09.995443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-15T10:54:09.995463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-15T10:54:09.995487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:09.995501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-15T10:54:09.997074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.997132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.997140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:09.997235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-15T10:54:09.997266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-15T10:54:09.997284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-15T10:54:09.997298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-15T10:54:09.997311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-15T10:54:10.000304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-15T10:54:10.000515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:10.004491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528012[B] reached maximum (20971520[B])
2025-10-15T10:54:10.007045Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-15T10:54:10.007133Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:10.007177Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252975, ReadSizeServerDelta = -1728687
2025-10-15T10:54:10.007460Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:10.007513Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:10.012714Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252975 } }
2025-10-15T10:54:10.012862Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 got read request: guid# ff1813be-3cb0d389-b96ad701-8bb909ff
2025-10-15T10:54:10.012929Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 performing read request: guid# 3320fe65-2b361647-f966c62f-1e0ae62, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:10.013069Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 3320fe65-2b361647-f966c62f-1e0ae62
2025-10-15T10:54:10.025280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-15T10:54:08.871000Z WriteTime: 2025-10-15T10:54:09.106000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:53654", "server": "ipv6:[::1]:53654", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:10.043602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:10.141426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-10-15T10:54:10.141574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-15T10:54:10.141606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-15T10:54:10.141625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-15T10:54:10.141639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-15T10:54:10.141656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-15T10:54:10.215203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 4506426 count 2 nextOffset 7 batches 9
2025-10-15T10:54:10.215300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.216125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 5,2 HeadOffset 5 endOffset 5 curOffset 7 d0000000000_00000000000000000005_00000_0000000002_00008? size 4506416 WTime 1760525650212
2025-10-15T10:54:10.221163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:10.221225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:10.221249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:10.223906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 249 queued_in_partition_duration_ms: 222 }
2025-10-15T10:54:10.223948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 3
2025-10-15T10:54:10.223973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275211[B]
2025-10-15T10:54:10.224858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 200 queued_in_partition_duration_ms: 232 }
2025-10-15T10:54:10.224889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 4
2025-10-15T10:54:10.225967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 174 queued_in_partition_duration_ms: 74 }
2025-10-15T10:54:10.226001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 5
2025-10-15T10:54:10.220430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-15T10:54:10.220457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-15T10:54:10.220469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000003_00012?
2025-10-15T10:54:10.220480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 11266051 bytes
2025-10-15T10:54:10.220586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-15T10:54:10.220651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-15T10:54:10.220720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-15T10:54:10.257555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:10.257598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:10.258163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-15T10:54:10.258701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-15T10:54:10.259212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-15T10:54:10.259785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-15T10:54:10.260055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-15T10:54:10.260077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-15T10:54:10.273817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 13 to 13
2025-10-15T10:54:10.276276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:10.276327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-15T10:54:10.277207Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:10.286839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:10.286873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:10.286925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:10.286935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:10.286969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:10.286984Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:10.287078Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 2 size 4506416
2025-10-15T10:54:10.287113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:10.287141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-15T10:54:10.290418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-15T10:54:10.290637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000003_00012?
2025-10-15T10:54:10.290812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:10.290843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:10.290907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:10.291135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-15T10:54:09.000000Z
2025-10-15T10:54:10.291153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T10:54:09.000000Z
2025-10-15T10:54:10.291177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 3 parts_count 12 source 1 size 6759613 accessed 0 times before, last time 2025-10-15T10:54:09.000000Z
2025-10-15T10:54:10.291225Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-15T10:54:10.291325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-15T10:54:10.291671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-15T10:54:10.291695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-15T10:54:10.291716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 3 parts 12 suffix '63'
2025-10-15T10:54:10.292847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:10.296684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:10.296713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:10.298476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T10:54:10.299553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-15T10:54:10.300601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-15T10:54:10.330878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-15T10:54:10.331494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-15T10:54:10.370236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 14 to 14
2025-10-15T10:54:10.371490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:10.388279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:10.388323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-15T10:54:10.426492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:10.427757Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:10.418277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-15T10:54:10.429502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:10.430575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T10:54:10.431821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-15T10:54:10.448270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-15T10:54:10.449579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-15T10:54:10.450298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-15T10:54:10.472011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 15 to 15
2025-10-15T10:54:10.485524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:10.485583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-15T10:54:10.485621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528015[B] reached maximum (20971520[B])
2025-10-15T10:54:10.486608Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:10.635768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-15T10:54:10.635864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:10.636850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-15T10:54:10.638003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-15T10:54:10.639194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-15T10:54:10.640794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-15T10:54:10.642650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-15T10:54:10.670782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-15T10:54:10.670873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-15T10:54:10.672094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-15T10:54:10.673243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-15T10:54:10.677989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-15T10:54:10.772802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-15T10:54:10.772825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400082330304922:2528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:10.830420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-15T10:54:10.832007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-15T10:54:10.832072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1760525650831
2025-10-15T10:54:10.929004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-15T10:54:10.929076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-15T10:54:10.930575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-15T10:54:10.931715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-15T10:54:10.942878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-15T10:54:10.943579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-15T10:54:11.009356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 3 PackedSize 2970341 count 2 nextOffset 5 batches 6
2025-10-15T10:54:11.012871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:557: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,2 HeadOffset 0 endOffset 0 curOffset 5 d0000000000_00000000000000000003_00003_0000000002_00005| size 2970331 WTime 1760525651012
2025-10-15T10:54:11.020918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 5 max time lag 0ms effective offset 1
2025-10-15T10:54:11.021069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 5
2025-10-15T10:54:11.021083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-15T10:54:11.039323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.039409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.043243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-15T10:54:11.047007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-15T10:54:11.047654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-15T10:54:11.048280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-15T10:54:11.048606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-15T10:54:11.048634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-15T10:54:11.049965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:11.050055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.050081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.050182Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:11.050303Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-15T10:54:11.050393Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 2 size 2970331
2025-10-15T10:54:11.050455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-15T10:54:10.000000Z
2025-10-15T10:54:11.050492Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-15T10:54:11.050543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:11.050611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:11.050748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-15T10:54:11.052490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:11.054477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:11.056700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:11.057898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:11.059893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:11.060630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T10:54:11.060808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-15T10:54:11.060950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:54:11.064250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:11.078684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:11.095138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:11.120823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.120872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.123892Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525649360 CreateTimestampMS: 1760525648935 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 1 }
2025-10-15T10:54:11.132604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-15T10:54:11.133959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-15T10:54:11.136007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-15T10:54:11.140399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-15T10:54:11.144184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-15T10:54:11.144219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-15T10:54:11.146276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.146311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.146383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 2 size 4506416 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:11.146463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:11.146533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:11.146566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:11.146631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:11.146662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.146708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-15T10:54:11.146735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.146775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-15T10:54:11.147035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T10:54:11.147424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.147459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-15T10:54:11.147472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.147490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-15T10:54:11.147509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.147525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-15T10:54:11.147534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.147548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-15T10:54:11.147556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.147572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-15T10:54:11.147581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.147599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-15T10:54:11.147606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.147623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-15T10:54:11.147633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.147653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-15T10:54:11.148721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.148779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.148796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:11.148887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-15T10:54:11.148921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-15T10:54:11.148937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-15T10:54:11.148954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-15T10:54:11.148975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-15T10:54:11.144858Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 5
2025-10-15T10:54:11.144931Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 2 ReadGuid 3320fe65-2b361647-f966c62f-1e0ae62 has messages 1
2025-10-15T10:54:11.147059Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 5, WTime# 1760525649360, sizeLag# 2253329
2025-10-15T10:54:11.147076Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:11.147113Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 read done: guid# 3320fe65-2b361647-f966c62f-1e0ae62, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-15T10:54:11.147137Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 response to read: guid# 3320fe65-2b361647-f966c62f-1e0ae62
2025-10-15T10:54:11.191403Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 Process answer. Aval parts: 1
2025-10-15T10:54:11.238011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 2253229 count 1 nextOffset 8 batches 5
2025-10-15T10:54:11.238127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-15T10:54:11.238159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-15T10:54:11.238177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-15T10:54:11.238192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-15T10:54:11.238208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-15T10:54:11.357293Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-15T10:54:11.357758Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-15T10:54:11.357835Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 2252978 to budget
2025-10-15T10:54:11.419143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 4506426 count 2 nextOffset 9 batches 9
2025-10-15T10:54:11.419549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-15T10:54:11.422321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-15T10:54:11.422352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-15T10:54:11.422370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-15T10:54:11.422385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-15T10:54:11.490600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 6759623 count 3 nextOffset 10 batches 13
2025-10-15T10:54:11.490711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.491458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,3 HeadOffset 7 endOffset 7 curOffset 10 d0000000000_00000000000000000007_00000_0000000003_00012? size 6759613 WTime 1760525651491
2025-10-15T10:54:11.507447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:11.507561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-15T10:54:11.507673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-15T10:54:11.507725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-15T10:54:11.507770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:11.507839Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:11.507939Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 3 size 6759613
2025-10-15T10:54:11.508439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:11.508525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:11.508560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:11.551067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.551112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.552849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-15T10:54:11.554468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-15T10:54:11.558050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-15T10:54:11.562735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-15T10:54:11.571673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-15T10:54:11.571714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-15T10:54:11.575824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 1146 queued_in_partition_duration_ms: 76 }
2025-10-15T10:54:11.575873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 6
2025-10-15T10:54:11.575905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275214[B]
2025-10-15T10:54:11.641661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 16 to 16
2025-10-15T10:54:11.667865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:11.667916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-15T10:54:11.680201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:11.684332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:11.702263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:11.702351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:11.702373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:11.702458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.702484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.702532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:11.702556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 2 size 2970331 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:11.702909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:11.702938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 2 parts 5 suffix '124' size 2970331
2025-10-15T10:54:11.704063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:11.727705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:11.727747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:11.728167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-15T10:54:11.737735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528016[B] reached maximum (20971520[B])
2025-10-15T10:54:11.736608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:11.741062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 6759613 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:11.741124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:11.741168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758730 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:11.741187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-15T10:54:11.741228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-15T10:54:11.741254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-15T10:54:11.741279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-15T10:54:11.741328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-15T10:54:11.741360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-15T10:54:11.741385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-15T10:54:11.741412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-15T10:54:11.741434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-15T10:54:11.741464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-15T10:54:11.741502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-15T10:54:11.741530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-15T10:54:11.741575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-15T10:54:11.741634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-15T10:54:11.741662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:11.741680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-15T10:54:11.742993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T10:54:11.743041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-15T10:54:11.744303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.744339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.744349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T10:54:11.744457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-15T10:54:11.744508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-15T10:54:11.744524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-15T10:54:11.744540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-15T10:54:11.744557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-15T10:54:11.763527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 1005 queued_in_partition_duration_ms: 189 }
2025-10-15T10:54:11.766772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 7
2025-10-15T10:54:11.766811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275215[B]
2025-10-15T10:54:11.776168Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-15T10:54:11.776238Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:11.776265Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-15T10:54:11.776508Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:11.776546Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:11.853833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 2253230 count 1 nextOffset 11 batches 5
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-15T10:54:08.935000Z WriteTime: 2025-10-15T10:54:09.360000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:53654", "logtype": "unknown", "server": "ipv6:[::1]:53654", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:11.872731Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-15T10:54:11.872911Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 got read request: guid# 1885947c-8c4a817c-d4cce972-8c2c9c4
2025-10-15T10:54:11.887974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.888833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00004? size 2253220 WTime 1760525651888
2025-10-15T10:54:11.890946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-15T10:54:11.890963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000003_00012?
2025-10-15T10:54:11.890973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266029 bytes
2025-10-15T10:54:11.891082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 33798046 CachedBlobs 7
2025-10-15T10:54:11.891141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-15T10:54:11.891221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-15T10:54:11.891269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-15T10:54:11.891311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 2253219 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:11.891337Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:11.892599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:11.892636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:11.872953Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 performing read request: guid# 63bbffbe-ba080068-3b84c7b0-6c9e2afb, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:11.873081Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 63bbffbe-ba080068-3b84c7b0-6c9e2afb
2025-10-15T10:54:11.891578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:11.891661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:11.891711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:11.913310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 17 to 17
2025-10-15T10:54:11.919588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:11.919642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-15T10:54:11.928787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.928833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.929355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-15T10:54:11.929877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-15T10:54:11.930364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-15T10:54:11.930845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-15T10:54:11.931183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-15T10:54:11.931201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-15T10:54:11.931776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528017[B] reached maximum (20971520[B])
2025-10-15T10:54:11.932595Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:11.959097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 592 queued_in_partition_duration_ms: 858 }
2025-10-15T10:54:11.959164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 8
2025-10-15T10:54:11.959202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275216[B]
2025-10-15T10:54:11.960365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 503 queued_in_partition_duration_ms: 189 }
2025-10-15T10:54:11.960422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 9
2025-10-15T10:54:11.961450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 321 queued_in_partition_duration_ms: 275 }
2025-10-15T10:54:11.961540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 10
2025-10-15T10:54:11.933596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:11.973456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.973506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.973546Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:11.973661Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 2253220
2025-10-15T10:54:11.973692Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-15T10:54:11.973700Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-10-15T10:54:11.973709Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000003_00012?(+) to d0000000000_00000000000000000002_00000_0000000003_00012?(+)
2025-10-15T10:54:11.973741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T10:54:11.973757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-15T10:54:11.973864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000003_00012?
2025-10-15T10:54:11.973985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T10:54:11.974178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:11.974234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:11.974424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-15T10:54:11.000000Z
2025-10-15T10:54:11.974446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 3 parts_count 12 source 1 size 6759613 accessed 0 times before, last time 2025-10-15T10:54:11.000000Z
2025-10-15T10:54:11.974481Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T10:54:11.974638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:11.974656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:11.975526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63'
2025-10-15T10:54:11.975554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 12 suffix '63'
2025-10-15T10:54:11.975708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-15T10:54:11.976919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-15T10:54:11.986264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 18 to 18
2025-10-15T10:54:11.989272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-15T10:54:11.991328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-15T10:54:11.992930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-15T10:54:11.996523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:11.996569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-15T10:54:11.997135Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:12.005812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:12.034603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 19 to 19
2025-10-15T10:54:12.036620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:12.036666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-15T10:54:12.037166Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:12.060941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 20 to 20
2025-10-15T10:54:12.062787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:12.062832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-15T10:54:12.062867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:12.067614Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:12.074462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-10-15T10:54:12.074560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-15T10:54:12.084739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-15T10:54:12.085901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-15T10:54:12.087029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-15T10:54:12.089841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-15T10:54:12.097856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 4506426 count 2 nextOffset 7 batches 9
2025-10-15T10:54:12.097950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:12.099636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-15T10:54:12.100651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-15T10:54:12.147755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-15T10:54:12.148858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-15T10:54:12.149994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-15T10:54:12.151981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-15T10:54:12.152050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1760525652151
2025-10-15T10:54:12.173373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-15T10:54:12.173466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-15T10:54:12.174592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-15T10:54:12.175768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-15T10:54:12.177106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-15T10:54:12.178680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-15T10:54:12.196221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 3994395 count 2 nextOffset 9 batches 8
2025-10-15T10:54:12.196317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-15T10:54:12.197506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-15T10:54:12.198579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-15T10:54:12.199885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-15T10:54:12.200366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-15T10:54:12.208497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 6247592 count 3 nextOffset 10 batches 12
2025-10-15T10:54:12.209403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:557: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,3 HeadOffset 3 endOffset 5 curOffset 10 d0000000000_00000000000000000007_00001_0000000003_00011| size 6247582 WTime 1760525652209
2025-10-15T10:54:12.214966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 3 size 524288 endOffset 10 max time lag 0ms effective offset 2
2025-10-15T10:54:12.215205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 0 count 1 last offset 0, current partition end offset: 10
2025-10-15T10:54:12.218202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-15T10:54:12.218276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.218341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.218362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.218450Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:12.218552Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-15T10:54:12.218627Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 6247582
2025-10-15T10:54:12.218670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 3 parts_count 15 source 1 size 8295635 accessed 0 times before, last time 2025-10-15T10:54:11.000000Z
2025-10-15T10:54:12.218708Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-15T10:54:12.219610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0'
2025-10-15T10:54:12.220329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:12.234088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 3 count 1 size 717094 from pos 1 cbcount 2
2025-10-15T10:54:12.235233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:12.236796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:12.237907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:12.238431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T10:54:12.242146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 3 count 0 size 1536000 from pos 0 cbcount 3
2025-10-15T10:54:12.243253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-10-15T10:54:12.243578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-15T10:54:12.243714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:12.243759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 3 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:12.243820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 2253220 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:12.244616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.249060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T10:54:12.269063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-15T10:54:12.272001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T10:54:12.278043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:12.280307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:12.287086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:12.287155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:12.287176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.287212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-15T10:54:12.287226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.287245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-15T10:54:12.287255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.287272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-15T10:54:12.287280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.287296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-15T10:54:12.287317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.287335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-15T10:54:12.287929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.287968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.287978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T10:54:12.288065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-15T10:54:12.288098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-15T10:54:12.288114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-15T10:54:12.288132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-15T10:54:12.288147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-15T10:54:12.305377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 2253230 count 1 nextOffset 12 batches 5
2025-10-15T10:54:12.305468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.306301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00004? size 2253220 WTime 1760525652304
2025-10-15T10:54:12.312584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:12.316814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.316852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.317394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-15T10:54:12.317946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-15T10:54:12.318460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-15T10:54:12.318970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-15T10:54:12.319212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-15T10:54:12.319235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-15T10:54:12.320129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.320159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.320191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-15T10:54:12.320206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.320290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-15T10:54:12.320668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.322246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 543 queued_in_partition_duration_ms: 43 }
2025-10-15T10:54:12.322290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 11
2025-10-15T10:54:12.322315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:12.324492Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:12.324625Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 2253220
2025-10-15T10:54:12.324717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.324734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:12.324789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.324958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-15T10:54:12.325083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 26214400 endOffset 11 max time lag 0ms effective offset 3
2025-10-15T10:54:12.325107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 0 blobs, size 0 count 0 last offset 3, current partition end offset: 11
2025-10-15T10:54:12.326275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.338948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:12.342395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1088: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. All data is from uncompacted head.
2025-10-15T10:54:12.342439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 0 blobs
2025-10-15T10:54:12.346394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.346432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.346945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-15T10:54:12.347402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-15T10:54:12.347832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-15T10:54:12.357122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:12.371555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 21 to 21
2025-10-15T10:54:12.378281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:12.378328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-15T10:54:12.388742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-15T10:54:12.388989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-15T10:54:12.389021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-15T10:54:12.389489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 2
2025-10-15T10:54:12.389610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.389634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.389659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:12.389714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.393150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:12.395493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-15T10:54:12.399897Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:12.417475Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 11 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525649745 CreateTimestampMS: 1760525648990 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525649794 CreateTimestampMS: 1760525649033 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 15055355 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 11 StartOffset: 0 } Cookie: 2 }
2025-10-15T10:54:12.425084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.426146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.447255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:12.444502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.444547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.445110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-10-15T10:54:12.445645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-15T10:54:12.446199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-15T10:54:12.447162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-15T10:54:12.449713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-15T10:54:12.449737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-15T10:54:12.450324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:12.450378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.450424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:12.450447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 6247582 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:12.450506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:12.452213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:12.452255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 2 parts 5 suffix '124' size 2970331
2025-10-15T10:54:12.452280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T10:54:12.452302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-15T10:54:12.474627Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 11
2025-10-15T10:54:12.474687Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 11 ReadOffset 4 ReadGuid 63bbffbe-ba080068-3b84c7b0-6c9e2afb has messages 1
2025-10-15T10:54:12.477245Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 11, WTime# 1760525649794, sizeLag# 15055355
2025-10-15T10:54:12.477259Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:12.477299Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 read done: guid# 63bbffbe-ba080068-3b84c7b0-6c9e2afb, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505939
2025-10-15T10:54:12.477325Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 response to read: guid# 63bbffbe-ba080068-3b84c7b0-6c9e2afb
2025-10-15T10:54:12.486670Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 Process answer. Aval parts: 1
2025-10-15T10:54:12.499991Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got ReadResponse, serverBytesSize = 4505939, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981651
2025-10-15T10:54:12.500285Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-15T10:54:12.500322Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 4505939 to budget
2025-10-15T10:54:12.500744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.500777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:12.500838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 5 size 4506416 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:12.500854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 2970331 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:12.500868Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:12.504123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:12.506952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.506983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.507042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-15T10:54:12.508436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.521189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.521229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.522020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-15T10:54:12.522585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-15T10:54:12.527400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-15T10:54:12.527934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-15T10:54:12.528187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-15T10:54:12.528210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-15T10:54:12.528952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.528968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:12.529022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.529070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 2253220 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:12.529108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:12.529149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:12.529165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.529192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-15T10:54:12.529202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.529230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-15T10:54:12.529243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.529261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-15T10:54:12.529270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.529286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-15T10:54:12.529304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.529319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-15T10:54:12.529956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.530022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.530031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-15T10:54:12.530113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-15T10:54:12.530144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-15T10:54:12.530160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-15T10:54:12.530185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-15T10:54:12.530210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-15T10:54:12.534953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:12.535628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-15T10:54:12.535669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T10:54:12.537059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:12.559835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 2253230 count 1 nextOffset 13 batches 5
2025-10-15T10:54:12.559956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-15T10:54:12.559992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-15T10:54:12.560008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-15T10:54:12.560024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-15T10:54:12.560040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-15T10:54:12.574548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 4506428 count 2 nextOffset 14 batches 9
2025-10-15T10:54:12.574677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-15T10:54:12.574710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-15T10:54:12.574729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-15T10:54:12.574744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-15T10:54:12.574758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-15T10:54:12.582544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 6759626 count 3 nextOffset 15 batches 13
2025-10-15T10:54:12.582653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-15T10:54:12.582693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-15T10:54:12.582711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-15T10:54:12.582729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-15T10:54:12.640750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 16 partNo 3 result is x0000000000_00000000000000000012_00000_0000000003_00015? size 8295638
2025-10-15T10:54:12.640835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-15T10:54:12.640901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000012_00000_0000000003_00015? new key d0000000000_00000000000000000012_00000_0000000003_00015? size 8295638 WTime 1760525652640
2025-10-15T10:54:12.656357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 1 NewHead: Offset 15 PartNo 3 PackedSize 717145 count 1 nextOffset 16 batches 2
2025-10-15T10:54:12.656431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.657287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 15,1 HeadOffset 12 endOffset 12 curOffset 16 d0000000000_00000000000000000015_00003_0000000001_00001? size 717135 WTime 1760525652656
2025-10-15T10:54:12.658115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:12.658238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-15T10:54:12.658306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 6759613 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:12.658324Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:12.658879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.660197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 239 queued_in_partition_duration_ms: 313 }
2025-10-15T10:54:12.660279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 12
2025-10-15T10:54:12.660313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:12.666226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 22 to 22
2025-10-15T10:54:12.672571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:12.672619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-15T10:54:12.672651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:12.675192Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-15T10:54:12.675259Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:12.679573Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-15T10:54:12.684935Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:12.686185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.686230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.686277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.686296Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:12.686407Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 3 size 8295638
2025-10-15T10:54:12.686487Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 3 count 1 size 717135
2025-10-15T10:54:12.686511Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000002_00008?(+) to d0000000000_00000000000000000005_00000_0000000002_00008?(+)
2025-10-15T10:54:12.686522Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000003_00012?(+) to d0000000000_00000000000000000007_00000_0000000003_00012?(+)
2025-10-15T10:54:12.686531Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000002_00005|(+) to d0000000000_00000000000000000003_00003_0000000002_00005|(+)
2025-10-15T10:54:12.686718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-15T10:54:08.990000Z WriteTime: 2025-10-15T10:54:09.745000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:53654", "server": "ipv6:[::1]:53654", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:12.691120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.721683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:12.729823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.729867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.724676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:12.736147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-15T10:54:12.744027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-15T10:54:12.746280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-15T10:54:12.746960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-15T10:54:12.747396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-15T10:54:12.747422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-15T10:54:12.748276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.748299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.748328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:12.748388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.748425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-15T10:54:12.748978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.762605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:12.765658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:12.782323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.782358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.782999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-15T10:54:12.784108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-15T10:54:12.784685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-15T10:54:12.785230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-15T10:54:12.787778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-15T10:54:12.787815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-15T10:54:12.788617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.788649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.788716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.788731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:12.788783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.788818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-15T10:54:12.789251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.792918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 3 size 8295638 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:12.792950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 717135 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:12.793003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:12.793050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:12.793070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-15T10:54:12.793113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-15T10:54:12.793163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-15T10:54:12.793220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-15T10:54:12.793260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-15T10:54:12.793286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-15T10:54:12.793314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-15T10:54:12.793340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-15T10:54:12.793411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-15T10:54:12.793491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-15T10:54:12.793536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-15T10:54:12.793588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-15T10:54:12.793659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-15T10:54:12.793713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-15T10:54:12.793740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-15T10:54:12.793769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-15T10:54:12.793843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-15T10:54:12.793916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.793959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-15T10:54:12.793986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.794037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-15T10:54:12.794052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:12.794070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-15T10:54:12.794465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.794511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.794520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:12.794608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-15T10:54:12.794641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-15T10:54:12.794657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-15T10:54:12.794679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-15T10:54:12.794697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-15T10:54:12.795045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:12.795076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T10:54:12.795102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T10:54:12.809494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:12.813445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:12.816601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2253230 count 1 nextOffset 17 batches 5
2025-10-15T10:54:12.816694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-15T10:54:12.816720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-15T10:54:12.816731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-15T10:54:12.816742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-15T10:54:12.816753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-15T10:54:12.825258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 4506428 count 2 nextOffset 18 batches 9
2025-10-15T10:54:12.825563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.826440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 16,2 HeadOffset 16 endOffset 16 curOffset 18 d0000000000_00000000000000000016_00000_0000000002_00008? size 4506418 WTime 1760525652825
2025-10-15T10:54:12.831319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000001_00004?
2025-10-15T10:54:12.831357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000001_00004?
2025-10-15T10:54:12.831370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000012_00000_0000000003_00015?
2025-10-15T10:54:12.831382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000015_00003_0000000001_00001?
2025-10-15T10:54:12.831392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 13519213 bytes
2025-10-15T10:54:12.831522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-15T10:54:12.831601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-15T10:54:12.831636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-15T10:54:12.831672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-15T10:54:12.831703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:12.831714Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:12.835797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.835868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.835893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.835915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.837352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.837387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.838205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-15T10:54:12.839476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-15T10:54:12.838230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 262 queued_in_partition_duration_ms: 206 }
2025-10-15T10:54:12.840802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 13
2025-10-15T10:54:12.840837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:12.842032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 232 queued_in_partition_duration_ms: 169 }
2025-10-15T10:54:12.842071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 14
2025-10-15T10:54:12.843221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 220 queued_in_partition_duration_ms: 127 }
2025-10-15T10:54:12.843255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 15
2025-10-15T10:54:12.844529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 210 queued_in_partition_duration_ms: 55 }
2025-10-15T10:54:12.844607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 16
2025-10-15T10:54:12.848406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-15T10:54:12.850967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 23 to 23
2025-10-15T10:54:12.853191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:12.853235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-15T10:54:12.853691Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:12.849868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-15T10:54:12.855836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-15T10:54:12.855875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-15T10:54:12.861871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:12.861897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:12.861917Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:12.862002Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 2 size 4506418
2025-10-15T10:54:12.862032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-15T10:54:12.862041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00000_0000000001_00004?
2025-10-15T10:54:12.862106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000011_00000_0000000001_00004?
2025-10-15T10:54:12.862211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000012_00000_0000000003_00015?
2025-10-15T10:54:12.862326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000015_00003_0000000001_00001?
2025-10-15T10:54:12.862406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-15T10:54:12.862418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:12.862465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:12.862584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-15T10:54:12.000000Z
2025-10-15T10:54:12.862598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-15T10:54:12.000000Z
2025-10-15T10:54:12.862611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-15T10:54:12.000000Z
2025-10-15T10:54:12.862624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-15T10:54:12.000000Z
2025-10-15T10:54:12.862641Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-10-15T10:54:12.862698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-15T10:54:12.862738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:12.862751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:12.863594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-15T10:54:12.864513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-15T10:54:12.865297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-15T10:54:12.865696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63'
2025-10-15T10:54:12.865714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 4 suffix '63'
2025-10-15T10:54:12.865727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 3 parts 15 suffix '63'
2025-10-15T10:54:12.865740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 3 count 1 parts 1 suffix '63'
2025-10-15T10:54:12.866918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:12.876095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:12.889489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:12.901926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-15T10:54:12.903446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-15T10:54:12.919726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 24 to 24
2025-10-15T10:54:12.921900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:12.921933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-15T10:54:12.927222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295579
2025-10-15T10:54:12.927272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295579 WTime 1760525652926
2025-10-15T10:54:12.930595Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (3-3)
2025-10-15T10:54:12.930642Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:12.930662Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505939, ReadSizeServerDelta = -3981651
2025-10-15T10:54:12.930842Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:12.930865Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:12.935799Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505939 } }
2025-10-15T10:54:12.935932Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 got read request: guid# cc0b8cc9-6594ce22-b25c969-cf2ae423
2025-10-15T10:54:12.935986Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 performing read request: guid# e9649a8d-7edf035b-99f198b-a2fa3a7b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:12.936044Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 11 ClientCommitOffset 0 committedOffset 0 Guid e9649a8d-7edf035b-99f198b-a2fa3a7b
2025-10-15T10:54:12.939921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-10-15T10:54:12.939982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:12.941129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-15T10:54:12.942267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-15T10:54:12.943794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-15T10:54:12.944934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-15T10:54:12.946063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-15T10:54:09.033000Z WriteTime: 2025-10-15T10:54:09.794000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:53654", "logtype": "unknown", "server": "ipv6:[::1]:53654" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:12.980963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-10-15T10:54:12.981063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:12.982135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-15T10:54:12.988133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-15T10:54:12.989360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-15T10:54:12.990765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-15T10:54:12.992445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 25 to 25
2025-10-15T10:54:12.994392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:12.994434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-15T10:54:12.995293Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:54:12.996484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:13.041895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 26 to 26
2025-10-15T10:54:13.050288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:13.050340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-15T10:54:13.050372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:13.050932Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:13.072677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 4711514 count 3 nextOffset 13 batches 9
2025-10-15T10:54:13.072788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-15T10:54:13.073930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-15T10:54:13.074956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-15T10:54:13.086103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-15T10:54:13.087265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-15T10:54:13.111533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 6964712 count 4 nextOffset 14 batches 13
2025-10-15T10:54:13.111633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-15T10:54:13.112886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-15T10:54:13.114063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-15T10:54:13.199102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988738
2025-10-15T10:54:13.201829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-15T10:54:13.202440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-15T10:54:13.202504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988738 WTime 1760525653199
2025-10-15T10:54:13.222513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-10-15T10:54:13.231844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-15T10:54:13.231884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-15T10:54:13.231899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-15T10:54:13.232942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:13.234467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-15T10:54:13.235595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-15T10:54:13.273681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-10-15T10:54:13.275278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:557: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,2 HeadOffset 7 endOffset 10 curOffset 16 d0000000000_00000000000000000014_00002_0000000002_00006| size 3482360 WTime 1760525653272
2025-10-15T10:54:13.286412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.286455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.287562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-15T10:54:13.288141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-15T10:54:13.288834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-15T10:54:13.289345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-15T10:54:13.290901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-15T10:54:13.290947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-15T10:54:13.292935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.293005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.293025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.293148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.293160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.293230Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:13.293348Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295579
2025-10-15T10:54:13.293428Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988738
2025-10-15T10:54:13.293501Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 2 size 3482360
2025-10-15T10:54:13.293553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:13.293607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.294061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-15T10:54:13.294159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 8 size 524288 endOffset 16 max time lag 0ms effective offset 4
2025-10-15T10:54:13.294327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 0 count 3 last offset 3, current partition end offset: 16
2025-10-15T10:54:13.304970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-15T10:54:13.305120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 3 count 4 parts_count 14 source 1 size 7988778 accessed 0 times before, last time 2025-10-15T10:54:12.000000Z
2025-10-15T10:54:13.305154Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-15T10:54:13.305235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:13.307461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0'
2025-10-15T10:54:13.299437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:13.323957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 4 count 1 size 717094 from pos 1 cbcount 2
2025-10-15T10:54:13.324198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:13.327223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:13.332633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:13.344145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:13.345371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:13.346036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T10:54:13.358498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:13.359795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:13.361021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:13.376730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:13.378445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:54:13.384686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:13.385911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:13.401062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:13.401656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T10:54:13.402632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:13.419533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.419580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.420129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-15T10:54:13.420675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-15T10:54:13.421329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-15T10:54:13.422021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-15T10:54:13.422293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-15T10:54:13.422314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-15T10:54:13.423229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.423251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.424131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.424254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-15T10:54:13.424319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:13.424367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.424429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 2 size 4506418 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:13.425471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:13.489478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-15T10:54:13.489553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:13.489605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:13.489624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-15T10:54:13.489671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-15T10:54:13.489699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-15T10:54:13.489729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-15T10:54:13.489767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-15T10:54:13.489792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-15T10:54:13.489819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-10-15T10:54:13.489846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-10-15T10:54:13.489873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-10-15T10:54:13.489900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.489917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-10-15T10:54:13.496264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.496340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.496351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:13.496463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-15T10:54:13.496500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-15T10:54:13.496517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-15T10:54:13.496536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-15T10:54:13.496555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-15T10:54:13.519174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-15T10:54:13.519297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-15T10:54:13.519333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-15T10:54:13.519364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-15T10:54:13.519383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-15T10:54:13.519399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-15T10:54:13.560494Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525649819 CreateTimestampMS: 1760525649062 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525649996 CreateTimestampMS: 1760525649191 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525650137 CreateTimestampMS: 1760525649257 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 7783962 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 4 }
2025-10-15T10:54:13.575637Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 16
2025-10-15T10:54:13.575693Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 7 ReadGuid e9649a8d-7edf035b-99f198b-a2fa3a7b has messages 1
2025-10-15T10:54:13.577680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:13.607956Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 16, WTime# 1760525650137, sizeLag# 7783962
2025-10-15T10:54:13.607987Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:13.608037Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 read done: guid# e9649a8d-7edf035b-99f198b-a2fa3a7b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6758898
2025-10-15T10:54:13.608063Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 response to read: guid# e9649a8d-7edf035b-99f198b-a2fa3a7b
2025-10-15T10:54:13.623280Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 Process answer. Aval parts: 1
2025-10-15T10:54:13.648834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:13.651083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:13.652997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-15T10:54:13.653113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-15T10:54:13.653148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-15T10:54:13.653166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-15T10:54:13.653183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-15T10:54:13.653199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-15T10:54:13.677071Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got ReadResponse, serverBytesSize = 6758898, now ReadSizeBudget = 0, ReadSizeServerDelta = -6234610
2025-10-15T10:54:13.683424Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-15T10:54:13.683481Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 6758898 to budget
2025-10-15T10:54:13.681015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-10-15T10:54:13.681104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.681974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 18,3 HeadOffset 18 endOffset 18 curOffset 21 d0000000000_00000000000000000018_00000_0000000003_00012? size 6759616 WTime 1760525653680
2025-10-15T10:54:13.691593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:13.691830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-15T10:54:13.691902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-15T10:54:13.691938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.695186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:13.695266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:13.701939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 695 queued_in_partition_duration_ms: 44 }
2025-10-15T10:54:13.701992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 17
2025-10-15T10:54:13.702026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:13.702943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 671 queued_in_partition_duration_ms: 29 }
2025-10-15T10:54:13.702983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 18
2025-10-15T10:54:13.705854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 27 to 27
2025-10-15T10:54:13.712197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.712242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.712814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-15T10:54:13.713334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-15T10:54:13.713889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-15T10:54:13.714434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-15T10:54:13.714680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-15T10:54:13.714701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-15T10:54:13.720766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:13.720812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-15T10:54:13.725428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.725469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.725503Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:13.725629Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 6759616
2025-10-15T10:54:13.726020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:13.726076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.726208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-15T10:54:13.731038Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-10-15T10:54:13.731104Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:13.739552Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-15T10:54:13.739611Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:13.728664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:13.741408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:13.741443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:13.741466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 2 size 3482360 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:13.741507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:13.748075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-15T10:54:13.748117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T10:54:13.748145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-15T10:54:13.748173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T10:54:13.748195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T10:54:13.748214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:13.748237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 2 parts 6 suffix '124' size 3482360
2025-10-15T10:54:13.821134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:13.823480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-15T10:54:09.062000Z WriteTime: 2025-10-15T10:54:09.819000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:53654", "_ip": "ipv6:[::1]:53654", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:13.826357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.826385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:13.826454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 12 size 8295638 cause it's been evicted from L2. Actual L1 size: 9
2025-10-15T10:54:13.826472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 6247582 cause it's been evicted from L2. Actual L1 size: 8
2025-10-15T10:54:13.826486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 11 size 2253220 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T10:54:13.826501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 2253220 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:13.826514Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:13.874601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 28 to 28
2025-10-15T10:54:13.876714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:13.876758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-15T10:54:13.876789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:13.877419Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:13.886551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.886600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.888925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-10-15T10:54:13.892244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-10-15T10:54:13.892788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-10-15T10:54:13.893347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-10-15T10:54:13.893612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-10-15T10:54:13.893633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
2025-10-15T10:54:13.895292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:13.894390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.894459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.894481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.894506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:13.894562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.894599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-15T10:54:13.919107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.919159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.906992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:13.909629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:13.934645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-10-15T10:54:13.935208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-10-15T10:54:13.936001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-10-15T10:54:13.936530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-10-15T10:54:13.936774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-10-15T10:54:13.936798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-10-15T10:54:13.937290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.937312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.937340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:13.937399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.937433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-15T10:54:13.938083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:13.948443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:13.948491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:13.949060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-10-15T10:54:13.949620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-10-15T10:54:13.950175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-10-15T10:54:13.950727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-10-15T10:54:13.950983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-10-15T10:54:13.951007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
2025-10-15T10:54:13.959678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:13.959763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:13.967640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 6759616 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:13.967684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:13.967726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:13.967747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.967781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-15T10:54:13.967794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.967815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-10-15T10:54:13.967823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.967839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-10-15T10:54:13.967845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.967862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-10-15T10:54:13.967882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.967900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-10-15T10:54:13.967909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.967925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-15T10:54:13.967934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.967954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-10-15T10:54:13.967962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.967980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-10-15T10:54:13.967989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.968007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-10-15T10:54:13.968017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.968033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-10-15T10:54:13.968043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.968058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-15T10:54:13.968068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.968084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-10-15T10:54:13.968091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.968109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-10-15T10:54:13.968116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.968134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-10-15T10:54:13.968146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:13.968166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-10-15T10:54:13.968367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 15 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T10:54:13.968396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:13.968427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:13.973698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.973769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.973779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-15T10:54:13.973876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-15T10:54:13.973917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-15T10:54:13.973934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-15T10:54:13.973951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-15T10:54:13.973967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-15T10:54:13.975953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:13.979009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:14.009847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2253230 count 1 nextOffset 22 batches 5
2025-10-15T10:54:14.009966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-15T10:54:14.009998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-15T10:54:14.010017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-15T10:54:14.010032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-15T10:54:14.010049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-15T10:54:14.037020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 4506428 count 2 nextOffset 23 batches 9
2025-10-15T10:54:14.037127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-15T10:54:14.037160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-15T10:54:14.037175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-15T10:54:14.037192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-15T10:54:14.037208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-15T10:54:14.085273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 6759626 count 3 nextOffset 24 batches 13
2025-10-15T10:54:14.085393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-15T10:54:14.085423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-15T10:54:14.085441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-15T10:54:14.085458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-15T10:54:14.273116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 25 partNo 3 result is x0000000000_00000000000000000021_00000_0000000003_00015? size 8295638
2025-10-15T10:54:14.273186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-15T10:54:14.273240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00000_0000000003_00015? new key d0000000000_00000000000000000021_00000_0000000003_00015? size 8295638 WTime 1760525654272
2025-10-15T10:54:14.285511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 1 NewHead: Offset 24 PartNo 3 PackedSize 717145 count 1 nextOffset 25 batches 2
2025-10-15T10:54:14.285599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.286440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,1 HeadOffset 21 endOffset 21 curOffset 25 d0000000000_00000000000000000024_00003_0000000001_00001? size 717135 WTime 1760525654282
2025-10-15T10:54:14.287240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00000_0000000002_00008?
2025-10-15T10:54:14.287255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000018_00000_0000000003_00012?
2025-10-15T10:54:14.287266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes
2025-10-15T10:54:14.287437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-15T10:54:14.287514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-15T10:54:14.287564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-15T10:54:14.287597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 15 size 717135 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:14.287615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:14.287628Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:14.289579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:14.289617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:14.289658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:14.289673Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:14.289778Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 0 count 3 size 8295638
2025-10-15T10:54:14.289844Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 3 count 1 size 717135
2025-10-15T10:54:14.289864Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00000_0000000001_00004?(+) to d0000000000_00000000000000000010_00000_0000000001_00004?(+)
2025-10-15T10:54:14.289873Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000011_00000_0000000001_00004?(+) to d0000000000_00000000000000000011_00000_0000000001_00004?(+)
2025-10-15T10:54:14.289881Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000012_00000_0000000003_00015?(+) to d0000000000_00000000000000000012_00000_0000000003_00015?(+)
2025-10-15T10:54:14.289891Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000015_00003_0000000001_00001?(+) to d0000000000_00000000000000000015_00003_0000000001_00001?(+)
2025-10-15T10:54:14.289900Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00001_0000000003_00011|(+) to d0000000000_00000000000000000007_00001_0000000003_00011|(+)
2025-10-15T10:54:14.289927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T10:54:14.289942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00000_0000000002_00008?
2025-10-15T10:54:14.290038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000018_00000_0000000003_00012?
2025-10-15T10:54:14.290154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T10:54:14.290352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T10:54:13.000000Z
2025-10-15T10:54:14.290373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 18 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-15T10:54:13.000000Z
2025-10-15T10:54:14.290407Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T10:54:14.290477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-15T10:54:14.290541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:14.290559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:14.290631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 2 parts 8 suffix '63'
2025-10-15T10:54:14.290663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 12 suffix '63'
2025-10-15T10:54:14.291587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.291666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.291736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.291762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.300091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 476 queued_in_partition_duration_ms: 628 }
2025-10-15T10:54:14.300260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 19
2025-10-15T10:54:14.300323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:14.303711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-15T10:54:14.304831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-15T10:54:14.305975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-15T10:54:14.307129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-15T10:54:14.324982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:14.327340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:14.328845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 29 to 29
2025-10-15T10:54:14.330867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:14.330906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-15T10:54:14.332236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-15T10:54:14.337909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:14.340503Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (5-5)
2025-10-15T10:54:14.340559Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:14.340646Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-15T10:54:14.340677Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:14.343857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 449 queued_in_partition_duration_ms: 225 }
2025-10-15T10:54:14.343908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 20
2025-10-15T10:54:14.343939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:14.344776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 314 queued_in_partition_duration_ms: 231 }
2025-10-15T10:54:14.344819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 21
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-15T10:54:09.191000Z WriteTime: 2025-10-15T10:54:09.996000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:53654", "logtype": "unknown", "server": "ipv6:[::1]:53654" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:14.376917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2253230 count 1 nextOffset 17 batches 5
2025-10-15T10:54:14.377017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-15T10:54:14.398497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-15T10:54:14.399735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-15T10:54:14.400889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-15T10:54:14.401403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-15T10:54:14.417093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 30 to 30
2025-10-15T10:54:14.419061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:14.419103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-15T10:54:14.419905Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:14.434325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 31 to 31
2025-10-15T10:54:14.436381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:14.436424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-15T10:54:14.436457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:14.438814Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (6-6)
2025-10-15T10:54:14.438875Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:14.438906Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 6758898, ReadSizeServerDelta = -6234610
2025-10-15T10:54:14.443594Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:14.443657Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:14.439931Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 grpc read done: success# 1, data# { read_request { bytes_size: 6758898 } }
2025-10-15T10:54:14.440078Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 got read request: guid# 83df4535-c4703ca1-9c2cd16d-8da82c43
2025-10-15T10:54:14.440125Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 performing read request: guid# f7d3836-61415716-2e284a14-638850b1, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:14.440189Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid f7d3836-61415716-2e284a14-638850b1
2025-10-15T10:54:14.455913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 4506428 count 2 nextOffset 18 batches 9
2025-10-15T10:54:14.456023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:14.457036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-15T10:54:09.257000Z WriteTime: 2025-10-15T10:54:10.137000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:53654", "_ip": "ipv6:[::1]:53654" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:14.516267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988778
2025-10-15T10:54:14.517430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-15T10:54:14.518584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-15T10:54:14.537582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-15T10:54:14.539125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-15T10:54:14.539195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988778 WTime 1760525654538
2025-10-15T10:54:14.561845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-15T10:54:14.561958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-15T10:54:14.567161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-15T10:54:14.568304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-15T10:54:14.569415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-15T10:54:14.570993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-15T10:54:14.579222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-15T10:54:14.579311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-15T10:54:14.580616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-15T10:54:14.581696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-15T10:54:14.582707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-15T10:54:14.583195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-15T10:54:14.592335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-10-15T10:54:14.593274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:557: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 18,3 HeadOffset 14 endOffset 16 curOffset 21 d0000000000_00000000000000000018_00000_0000000003_00012| size 6759616 WTime 1760525654589
2025-10-15T10:54:14.602835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:14.603207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:14.603775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-10-15T10:54:14.604389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-10-15T10:54:14.604880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-10-15T10:54:14.605407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-10-15T10:54:14.605657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-10-15T10:54:14.605680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-10-15T10:54:14.606172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:14.606192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:14.606229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:14.606348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:14.606362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:14.606401Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:14.606517Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988778
2025-10-15T10:54:14.606598Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 6759616
2025-10-15T10:54:14.606630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:14.606686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:14.608520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-15T10:54:14.608631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 7 count 10 size 524288 endOffset 21 max time lag 0ms effective offset 7
2025-10-15T10:54:14.609015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 2 blobs, size 8295579 count 3 last offset 7, current partition end offset: 21
2025-10-15T10:54:14.609032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-15T10:54:14.609072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 3 partno 3 count 4 parts_count 14 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:14.609095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 1 count 3 parts_count 15 source 1 size 8295579 accessed 0 times before, last time 2025-10-15T10:54:13.000000Z
2025-10-15T10:54:14.609119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 9. Have to read 1 of 2 from KV
2025-10-15T10:54:14.609718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0'
2025-10-15T10:54:14.609750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 3 partno 3 count 4 parts_count 14
2025-10-15T10:54:14.612156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.636536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:14.636586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:14.634040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:14.645763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-10-15T10:54:14.651974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-10-15T10:54:14.653299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:14.654095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-10-15T10:54:14.655440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-10-15T10:54:14.661869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-10-15T10:54:14.661906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-10-15T10:54:14.662689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:14.662719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:14.662749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:14.662804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:14.662979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 3 size 8295638 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:14.663001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 24 count 1 size 717135 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:14.663060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:14.663102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:14.663119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-15T10:54:14.663158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-10-15T10:54:14.663186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-10-15T10:54:14.663217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-10-15T10:54:14.663259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-10-15T10:54:14.663291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-15T10:54:14.663319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-10-15T10:54:14.663366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-10-15T10:54:14.663396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-10-15T10:54:14.663427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-10-15T10:54:14.663453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-15T10:54:14.663480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-10-15T10:54:14.663509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-10-15T10:54:14.663535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-10-15T10:54:14.663562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.663577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-10-15T10:54:14.663586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.664130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:14.664166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T10:54:14.664196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 24 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T10:54:14.664206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-15T10:54:14.664228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.664257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-10-15T10:54:14.664267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.664304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-10-15T10:54:14.664312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.664333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-10-15T10:54:14.664349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:14.664367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-10-15T10:54:14.664681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.664730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.664739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:14.664828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-15T10:54:14.664862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-15T10:54:14.664879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-15T10:54:14.664896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-15T10:54:14.664910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-15T10:54:14.702760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 2253230 count 1 nextOffset 26 batches 5
2025-10-15T10:54:14.702871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-15T10:54:14.702903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-15T10:54:14.702922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-15T10:54:14.702939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-15T10:54:14.702956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-15T10:54:14.714679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 4506428 count 2 nextOffset 27 batches 9
2025-10-15T10:54:14.718969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.733838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 25 endOffset 25 curOffset 27 d0000000000_00000000000000000025_00000_0000000002_00008? size 4506418 WTime 1760525654733
2025-10-15T10:54:14.745343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:14.745456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-10-15T10:54:14.745556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-15T10:54:14.745606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-15T10:54:14.745652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-15T10:54:14.745699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988738 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:14.745712Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:14.747437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.747506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.747539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.747573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.761208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-15T10:54:14.761844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:14.761955Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:14.762074Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 2 size 4506418
2025-10-15T10:54:14.771846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:14.771891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:14.772487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-10-15T10:54:14.772946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-10-15T10:54:14.773334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-10-15T10:54:14.773800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-10-15T10:54:14.773981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-10-15T10:54:14.773996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-10-15T10:54:14.763390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.776665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:14.780760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 688 queued_in_partition_duration_ms: 247 }
2025-10-15T10:54:14.780808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 22
2025-10-15T10:54:14.780836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:14.784529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:14.792289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 652 queued_in_partition_duration_ms: 118 }
2025-10-15T10:54:14.792344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 23
2025-10-15T10:54:14.793100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 625 queued_in_partition_duration_ms: 99 }
2025-10-15T10:54:14.793139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 24
2025-10-15T10:54:14.796028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 32 to 32
2025-10-15T10:54:14.798190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:14.798228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-15T10:54:14.798726Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:14.800096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 579 queued_in_partition_duration_ms: 124 }
2025-10-15T10:54:14.800142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 25
2025-10-15T10:54:14.808890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:14.808967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:14.819808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:14.819851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:14.819892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-15T10:54:14.819908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:14.819948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:14.820435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-10-15T10:54:14.824232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 2 parts 6 suffix '124' size 3482360
2025-10-15T10:54:14.824270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:14.824300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:14.834008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 33 to 33
2025-10-15T10:54:14.836034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:14.836075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-15T10:54:14.836894Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:14.880337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:14.882832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:14.883993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:14.886332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:14.888779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:54:14.890130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:14.894575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 34 to 34
2025-10-15T10:54:14.896941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:14.896987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-15T10:54:14.897853Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:14.901737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:14.902951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:14.904635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:54:14.923639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 35 to 35
2025-10-15T10:54:14.925694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:14.925738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-15T10:54:14.925769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:14.926426Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:14.931582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:14.932716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:14.933837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:14.934482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T10:54:14.943303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-15T10:54:14.947572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-15T10:54:14.947650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 3482360 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:14.947664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 16 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:14.947692Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:14.952402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:14.954193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:14.954389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-10-15T10:54:14.954486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:14.954507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 6759616 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:14.955913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:14.955948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:14.955976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-15T10:54:14.955998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 12 suffix '124' size 6759616
2025-10-15T10:54:14.978990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:14.985364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:15.001060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:15.030610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.030666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000021_00000_0000000003_00015?
2025-10-15T10:54:15.030680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000024_00003_0000000001_00001?
2025-10-15T10:54:15.030691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012773 bytes
2025-10-15T10:54:15.030774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295579 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:15.030788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 6759616 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:15.030802Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:15.042114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.045777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.046413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-10-15T10:54:15.047098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
2025-10-15T10:54:15.048038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-10-15T10:54:15.048597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-10-15T10:54:15.048866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-10-15T10:54:15.048893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-10-15T10:54:15.064498Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 25 Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525651148 CreateTimestampMS: 1760525649313 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525651237 CreateTimestampMS: 1760525649379 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760525651419 CreateTimestampMS: 1760525649400 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 1 BlobsFromCache: 1 SizeLag: 15260739 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 25 StartOffset: 0 } Cookie: 7 }
2025-10-15T10:54:15.064055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.064089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.064129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T10:54:15.064154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000021_00000_0000000003_00015?
2025-10-15T10:54:15.064263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000024_00003_0000000001_00001?
2025-10-15T10:54:15.064371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T10:54:15.064388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:15.064441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.064463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.064508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 4506418 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:15.064609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 21 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-15T10:54:14.000000Z
2025-10-15T10:54:15.064631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 24 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-15T10:54:14.000000Z
2025-10-15T10:54:15.064653Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T10:54:15.064713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:15.064755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:15.064773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.064803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-15T10:54:15.064819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.064838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-10-15T10:54:15.064863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.064884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-10-15T10:54:15.064894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.064912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-10-15T10:54:15.064930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.064951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-10-15T10:54:15.064961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.064981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-15T10:54:15.064990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.065008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-10-15T10:54:15.065015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.065035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-10-15T10:54:15.065043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.065062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-10-15T10:54:15.065072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.065090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-10-15T10:54:15.065422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T10:54:15.065479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:15.065622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:203: PQ Cache (L2). Miss in touch. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 3 parts 15 suffix '63'
2025-10-15T10:54:15.065661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 24 partno 3 count 1 parts 1 suffix '63'
2025-10-15T10:54:15.067181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.067231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.067240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:15.067338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-15T10:54:15.067388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-15T10:54:15.067406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-15T10:54:15.067423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-15T10:54:15.067439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-15T10:54:15.074715Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 25
2025-10-15T10:54:15.075117Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 25 ReadOffset 10 ReadGuid f7d3836-61415716-2e284a14-638850b1 has messages 1
2025-10-15T10:54:15.082526Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 25, WTime# 1760525651419, sizeLag# 15260739
2025-10-15T10:54:15.082560Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:15.082618Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 read done: guid# f7d3836-61415716-2e284a14-638850b1, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6758900
2025-10-15T10:54:15.082645Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 response to read: guid# f7d3836-61415716-2e284a14-638850b1
2025-10-15T10:54:15.090449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-15T10:54:15.090566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-15T10:54:15.096152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-15T10:54:15.096225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-15T10:54:15.096241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-15T10:54:15.096260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-15T10:54:15.102464Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 Process answer. Aval parts: 1
2025-10-15T10:54:15.130330Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got ReadResponse, serverBytesSize = 6758900, now ReadSizeBudget = 0, ReadSizeServerDelta = -6234612
2025-10-15T10:54:15.131762Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-15T10:54:15.131809Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 6758900 to budget
2025-10-15T10:54:15.135206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 4506428 count 2 nextOffset 29 batches 9
2025-10-15T10:54:15.135631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.136494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 27,2 HeadOffset 27 endOffset 27 curOffset 29 d0000000000_00000000000000000027_00000_0000000002_00008? size 4506418 WTime 1760525655136
2025-10-15T10:54:15.140471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:15.141308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-15T10:54:15.141357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:15.141375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:15.142467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-15T10:54:15.146501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.147321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-15T10:54:15.148574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-15T10:54:15.149783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-15T10:54:15.167544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:15.170220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:15.198378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295638
2025-10-15T10:54:15.204277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-15T10:54:15.204357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295638 WTime 1760525655201
2025-10-15T10:54:15.206606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-15T10:54:15.206652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-15T10:54:15.216089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-15T10:54:15.217265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-15T10:54:15.243911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-15T10:54:15.245473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-15T10:54:15.296375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 2970343 count 2 nextOffset 23 batches 6
2025-10-15T10:54:15.296474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-15T10:54:15.297823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-15T10:54:15.298943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-15T10:54:15.300139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-15T10:54:15.300923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-15T10:54:15.319195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 5223541 count 3 nextOffset 24 batches 10
2025-10-15T10:54:15.322515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-15T10:54:15.322558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-15T10:54:15.322571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-15T10:54:15.323139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:15.324367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-15T10:54:15.324870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-15T10:54:15.346532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 7476739 count 4 nextOffset 25 batches 14
2025-10-15T10:54:15.347847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:557: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,4 HeadOffset 18 endOffset 21 curOffset 25 d0000000000_00000000000000000021_00003_0000000004_00013| size 7476729 WTime 1760525655347
2025-10-15T10:54:15.355176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-15T10:54:15.355274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-15T10:54:15.355308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:15.355324Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:15.358819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.358888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.360723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 399 queued_in_partition_duration_ms: 57 }
2025-10-15T10:54:15.360770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 26
2025-10-15T10:54:15.360803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:15.361829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 361 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:15.361874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 27
2025-10-15T10:54:15.365393Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:15.365511Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 2 size 4506418
2025-10-15T10:54:15.365549Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00000_0000000002_00008?(+) to d0000000000_00000000000000000016_00000_0000000002_00008?(+)
2025-10-15T10:54:15.365559Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000003_00012?(+) to d0000000000_00000000000000000018_00000_0000000003_00012?(+)
2025-10-15T10:54:15.365568Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00002_0000000002_00006|(+) to d0000000000_00000000000000000014_00002_0000000002_00006|(+)
2025-10-15T10:54:15.369581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 36 to 36
2025-10-15T10:54:15.371606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:15.371648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-15T10:54:15.374253Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (7-7)
2025-10-15T10:54:15.374310Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:15.375452Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-15T10:54:15.375510Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:15.381402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.381451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.382014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-10-15T10:54:15.382577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-10-15T10:54:15.383098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-10-15T10:54:15.389522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-15T10:54:09.313000Z WriteTime: 2025-10-15T10:54:11.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:53654", "_ip": "ipv6:[::1]:53654", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:15.395650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-10-15T10:54:15.395687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-10-15T10:54:15.396569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.396639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.396661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.396687Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:15.396799Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295638
2025-10-15T10:54:15.396880Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7476729
2025-10-15T10:54:15.399253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.397338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:15.397400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.397508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-15T10:54:15.412339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.412389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.415395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:15.417626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:15.424000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-10-15T10:54:15.428368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-10-15T10:54:15.436054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 37 to 37
2025-10-15T10:54:15.438194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:15.438234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-15T10:54:15.438363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-10-15T10:54:15.438940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-10-15T10:54:15.439220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-10-15T10:54:15.439243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-10-15T10:54:15.439856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.439874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.439900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:15.439954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.439990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-15T10:54:15.444038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.464579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:15.467081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:15.473564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.473612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.474204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-10-15T10:54:15.474885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-10-15T10:54:15.484998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-10-15T10:54:15.485927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-10-15T10:54:15.486244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-10-15T10:54:15.486265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-10-15T10:54:15.487438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.487461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.487490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:15.487999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.488056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-10-15T10:54:15.489202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.496631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.523781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:15.524670Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:54:15.533023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.533088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.534066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-10-15T10:54:15.537044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-10-15T10:54:15.542398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:15.547570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-10-15T10:54:15.551659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-10-15T10:54:15.551687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-10-15T10:54:15.552693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:15.552764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.552929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 2 size 4506418 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:15.552976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:15.553016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:15.553032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-15T10:54:15.553071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-10-15T10:54:15.553097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-10-15T10:54:15.553121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-10-15T10:54:15.553156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-10-15T10:54:15.553179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-15T10:54:15.553223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-10-15T10:54:15.553254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-10-15T10:54:15.553278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-10-15T10:54:15.553308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:15.553323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-10-15T10:54:15.554659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.554730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.554739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-15T10:54:15.554826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-15T10:54:15.554860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-15T10:54:15.555309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:15.557818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:15.560759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:15.563948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-15T10:54:15.563995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-15T10:54:15.564012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-15T10:54:15.596880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 29 PartNo 0 PackedSize 2253230 count 1 nextOffset 30 batches 5
2025-10-15T10:54:15.596993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-15T10:54:15.597027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-15T10:54:15.597043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-15T10:54:15.597060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-15T10:54:15.597077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-15T10:54:15.637633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 29 PartNo 0 PackedSize 4506428 count 2 nextOffset 31 batches 9
2025-10-15T10:54:15.637748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-15T10:54:15.637788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-15T10:54:15.637810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-15T10:54:15.637829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-15T10:54:15.637845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-15T10:54:15.666383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 29 PartNo 0 PackedSize 6759626 count 3 nextOffset 32 batches 13
2025-10-15T10:54:15.666494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-15T10:54:15.666523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-15T10:54:15.666542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-15T10:54:15.666559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-15T10:54:15.782299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 33 partNo 3 result is x0000000000_00000000000000000029_00000_0000000003_00015? size 8295638
2025-10-15T10:54:15.782369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-15T10:54:15.782419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000029_00000_0000000003_00015? new key d0000000000_00000000000000000029_00000_0000000003_00015? size 8295638 WTime 1760525655781
2025-10-15T10:54:15.793799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 1 NewHead: Offset 32 PartNo 3 PackedSize 717145 count 1 nextOffset 33 batches 2
2025-10-15T10:54:15.793875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.794539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 32,1 HeadOffset 29 endOffset 29 curOffset 33 d0000000000_00000000000000000032_00003_0000000001_00001? size 717135 WTime 1760525655790
2025-10-15T10:54:15.795108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:15.795665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-15T10:54:15.795755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-15T10:54:15.795845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.795866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.796169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.796224Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:15.796327Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 29 partNo 0 count 3 size 8295638
2025-10-15T10:54:15.796416Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 3 count 1 size 717135
2025-10-15T10:54:15.796794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-10-15T10:54:15.802793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.802868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.802897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.814880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.816639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.817473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-10-15T10:54:15.825448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 485 queued_in_partition_duration_ms: 263 }
2025-10-15T10:54:15.825503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 28
2025-10-15T10:54:15.825530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:15.835192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-10-15T10:54:15.835766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-10-15T10:54:15.836472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-10-15T10:54:15.836771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-10-15T10:54:15.836792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-10-15T10:54:15.837862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:15.837939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.837991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:15.838013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7476729 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:15.838052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:15.839723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:15.839763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-15T10:54:15.839796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:15.839830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 13 suffix '124' size 7476729
2025-10-15T10:54:15.842656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 38 to 38
2025-10-15T10:54:15.848187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:15.851207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:15.875953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:15.876016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-15T10:54:15.876052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:15.879899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 464 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:15.879948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 29
2025-10-15T10:54:15.879983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:15.887332Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (8-8)
2025-10-15T10:54:15.887421Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:15.887552Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-15T10:54:15.888126Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:15.894446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.894494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-15T10:54:15.894511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000002_00008?
2025-10-15T10:54:15.894521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012836 bytes
2025-10-15T10:54:15.894605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T10:54:15.894623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:15.894637Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:15.899199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:15.899238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:15.899309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T10:54:15.899329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-15T10:54:15.899479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000002_00008?
2025-10-15T10:54:15.899619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T10:54:15.899647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:15.906902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T10:54:15.000000Z
2025-10-15T10:54:15.906941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 27 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T10:54:15.000000Z
2025-10-15T10:54:15.907686Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T10:54:15.907809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-10-15T10:54:15.907865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:15.907885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:15.908847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-15T10:54:15.910018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-15T10:54:15.911444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63'
2025-10-15T10:54:15.911493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 2 parts 8 suffix '63'
2025-10-15T10:54:15.912409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:15.925782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988760
2025-10-15T10:54:15.931879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-15T10:54:15.933029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-15T10:54:15.934587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-15T10:54:15.934654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988760 WTime 1760525655931
2025-10-15T10:54:15.938147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:15.941254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:15.947214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-10-15T10:54:15.947308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-15T10:54:15.949079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-15T10:54:15.950727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-15T10:54:09.379000Z WriteTime: 2025-10-15T10:54:11.237000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:53654", "server": "ipv6:[::1]:53654", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:15.963242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-15T10:54:15.963968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-15T10:54:15.979126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 39 to 39
2025-10-15T10:54:15.984645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-10-15T10:54:15.984734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:15.985805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-15T10:54:15.986930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-15T10:54:15.989456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:15.989502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-15T10:54:15.989533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:15.990727Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:16.003494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-15T10:54:16.008423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-15T10:54:16.009987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-15T10:54:16.018120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 6247595 count 3 nextOffset 28 batches 12
2025-10-15T10:54:16.018211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-15T10:54:16.019298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-15T10:54:16.020762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-15T10:54:16.021874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-15T10:54:16.022382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-15T10:54:16.080716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 29 partNo 4 result is x0000000000_00000000000000000025_00001_0000000003_00015 size 8295582
2025-10-15T10:54:16.080788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00001_0000000003_00015 new key d0000000000_00000000000000000025_00001_0000000003_00015 size 8295582 WTime 1760525656080
2025-10-15T10:54:16.088093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 4 PackedSize 205118 count 1 nextOffset 29 batches 1
2025-10-15T10:54:16.088989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:557: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 28,1 HeadOffset 21 endOffset 25 curOffset 29 d0000000000_00000000000000000028_00004_0000000001_00000| size 205108 WTime 1760525656088
2025-10-15T10:54:16.093503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.093555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.094088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-10-15T10:54:16.094567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-10-15T10:54:16.095044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
2025-10-15T10:54:16.096466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-10-15T10:54:16.096722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-10-15T10:54:16.096750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-10-15T10:54:16.097367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.097397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.097442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.097460Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:16.097586Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988760
2025-10-15T10:54:16.097659Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 8295582
2025-10-15T10:54:16.097735Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 1 size 205108
2025-10-15T10:54:16.097793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 29 count 3 size 8295638 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.097817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 1 size 717135 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.097866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:16.097920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.097945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-10-15T10:54:16.098048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:16.098092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:16.098110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-15T10:54:16.098150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-10-15T10:54:16.098179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-10-15T10:54:16.098196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 12 suffix '124' size 6759616
2025-10-15T10:54:16.098207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-10-15T10:54:16.098230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 24 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T10:54:16.098245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T10:54:16.098263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-10-15T10:54:16.098273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-15T10:54:16.098290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-15T10:54:16.098299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T10:54:16.098320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-10-15T10:54:16.098329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-10-15T10:54:16.098358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-10-15T10:54:16.098389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-10-15T10:54:16.098417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-15T10:54:16.098447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-10-15T10:54:16.098475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-10-15T10:54:16.098506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-10-15T10:54:16.098536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-10-15T10:54:16.098566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-15T10:54:16.098592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-10-15T10:54:16.098619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-10-15T10:54:16.098648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-10-15T10:54:16.098681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.098699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-10-15T10:54:16.099023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.099071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.099081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:16.099169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-15T10:54:16.099201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-15T10:54:16.099218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-15T10:54:16.099235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-15T10:54:16.099252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-15T10:54:16.116100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 2253230 count 1 nextOffset 34 batches 5
2025-10-15T10:54:16.116210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-15T10:54:16.116243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-15T10:54:16.116262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-15T10:54:16.116278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-15T10:54:16.116295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-15T10:54:16.125312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 4506428 count 2 nextOffset 35 batches 9
2025-10-15T10:54:16.125399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.126335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 33,2 HeadOffset 33 endOffset 33 curOffset 35 d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418 WTime 1760525656123
2025-10-15T10:54:16.130827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:16.131026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-15T10:54:16.131107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 6759616 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T10:54:16.131124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295638 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:16.131139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 24 size 717135 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:16.131153Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:16.132911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.134289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 542 queued_in_partition_duration_ms: 157 }
2025-10-15T10:54:16.134334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 30
2025-10-15T10:54:16.134365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:16.138827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-15T10:54:16.141653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 40 to 40
2025-10-15T10:54:16.144539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.144604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.144634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.144659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.139488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-15T10:54:16.139576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-10-15T10:54:16.139610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-15T10:54:16.139633Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:16.139748Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 33 partNo 0 count 2 size 4506418
2025-10-15T10:54:16.139772Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00000_0000000003_00015?(+) to d0000000000_00000000000000000021_00000_0000000003_00015?(+)
2025-10-15T10:54:16.139783Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000024_00003_0000000001_00001?(+) to d0000000000_00000000000000000024_00003_0000000001_00001?(+)
2025-10-15T10:54:16.139795Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000003_00012|(+) to d0000000000_00000000000000000018_00000_0000000003_00012|(+)
2025-10-15T10:54:16.158214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:16.158263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-15T10:54:16.158295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:16.163783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.163830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.170600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-10-15T10:54:16.171638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 500 queued_in_partition_duration_ms: 157 }
2025-10-15T10:54:16.171692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 31
2025-10-15T10:54:16.171728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:16.178501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-10-15T10:54:16.179053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-10-15T10:54:16.179613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-10-15T10:54:16.179893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-10-15T10:54:16.179916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-10-15T10:54:16.180356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:16.180414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.182910Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (9-9)
2025-10-15T10:54:16.182976Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T10:54:16.183007Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 6758900, ReadSizeServerDelta = -6234612
2025-10-15T10:54:16.183121Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:16.183176Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:16.191732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 459 queued_in_partition_duration_ms: 149 }
2025-10-15T10:54:16.191796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 32
2025-10-15T10:54:16.192678Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 grpc read done: success# 1, data# { read_request { bytes_size: 6758900 } }
2025-10-15T10:54:16.192761Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 got read request: guid# 246539a6-14bb768-fd0a737f-d7ca8ce1
2025-10-15T10:54:16.192822Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 performing read request: guid# f2c1740e-63ec74c6-28d7fd1-f6686c44, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:16.192875Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 25 ClientCommitOffset 0 committedOffset 0 Guid f2c1740e-63ec74c6-28d7fd1-f6686c44
2025-10-15T10:54:16.197212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.197251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.197350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 18 size 524288 endOffset 33 max time lag 0ms effective offset 10
2025-10-15T10:54:16.197705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 2 blobs, size 7988738 count 4 last offset 10, current partition end offset: 33
2025-10-15T10:54:16.197732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-15T10:54:16.197767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 1 count 3 parts_count 15 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.197780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.197813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 10. Have to read 2 of 2 from KV
2025-10-15T10:54:16.198381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.198891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 1 count 3 parts_count 15
2025-10-15T10:54:16.198914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:16.199660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 435 queued_in_partition_duration_ms: 109 }
2025-10-15T10:54:16.199710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 33
2025-10-15T10:54:16.206943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:16.209367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:16.211460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.211503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.211572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-15T10:54:16.211924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.230642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-15T10:54:09.400000Z WriteTime: 2025-10-15T10:54:11.419000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:53654", "_ip": "ipv6:[::1]:53654", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:16.242078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.242120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.246299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:16.250362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-10-15T10:54:16.250794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-10-15T10:54:16.251458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-10-15T10:54:16.251896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-10-15T10:54:16.252124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-10-15T10:54:16.252139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-10-15T10:54:16.252556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.252571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.252591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:16.252632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.252657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-10-15T10:54:16.255756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.269788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:16.276417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 41 to 41
2025-10-15T10:54:16.274979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:16.280655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:16.280703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-15T10:54:16.290609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.290647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.291109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-10-15T10:54:16.291561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-10-15T10:54:16.291961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-10-15T10:54:16.292399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-10-15T10:54:16.292591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-10-15T10:54:16.292605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-10-15T10:54:16.292974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.292988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.293008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:16.293050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.293080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-10-15T10:54:16.295698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.302577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.304901Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:16.327864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.327909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.329946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 42 to 42
2025-10-15T10:54:16.332604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:16.332650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-15T10:54:16.327503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:16.340556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-10-15T10:54:16.344211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-10-15T10:54:16.347971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-10-15T10:54:16.352593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
2025-10-15T10:54:16.357943Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:16.373626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:16.374735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-10-15T10:54:16.374773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-10-15T10:54:16.375453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.375484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.375519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:16.375581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.375624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-15T10:54:16.379293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.399051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.399099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.399580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:16.400173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-10-15T10:54:16.400710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
2025-10-15T10:54:16.401261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-10-15T10:54:16.401808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-10-15T10:54:16.402058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-10-15T10:54:16.402080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-10-15T10:54:16.408093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:16.417882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 43 to 43
2025-10-15T10:54:16.424902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988760 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.424945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295582 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.424968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 1 size 205108 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.425056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:16.425119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.425118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-15T10:54:16.425143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.425167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 13 suffix '124' size 7476729
2025-10-15T10:54:16.425195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:16.425197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.425220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.425221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295582
2025-10-15T10:54:16.425243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:16.425249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 1 parts 0 suffix '124' size 205108
2025-10-15T10:54:16.428323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:16.428365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-15T10:54:16.434167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.434205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000029_00000_0000000003_00015?
2025-10-15T10:54:16.434218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00003_0000000001_00001?
2025-10-15T10:54:16.434228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012773 bytes
2025-10-15T10:54:16.434310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 4506418 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T10:54:16.434325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7476729 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:16.434338Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:16.436816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T10:54:16.436844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000029_00000_0000000003_00015?
2025-10-15T10:54:16.436984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00003_0000000001_00001?
2025-10-15T10:54:16.437124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T10:54:16.437158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-15T10:54:16.439485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.440884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:16.441763Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:16.457635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:16.463284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:16.468560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 29 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-15T10:54:16.000000Z
2025-10-15T10:54:16.468587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 32 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-15T10:54:16.000000Z
2025-10-15T10:54:16.468616Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T10:54:16.469419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 3 parts 15 suffix '63'
2025-10-15T10:54:16.469451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 32 partno 3 count 1 parts 1 suffix '63'
2025-10-15T10:54:16.473003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.473035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.473453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-10-15T10:54:16.473877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-10-15T10:54:16.474325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-10-15T10:54:16.474775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-10-15T10:54:16.474966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-10-15T10:54:16.474983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-10-15T10:54:16.478175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:16.478207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:16.478244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:16.478258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:16.478270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:16.478302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.478329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.478430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:16.478449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:16.479226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-15T10:54:16.479458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:16.479496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-15T10:54:16.479527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-15T10:54:16.479558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295582
2025-10-15T10:54:16.479581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:16.480790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-15T10:54:16.481954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-15T10:54:16.483215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-15T10:54:16.484789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-15T10:54:16.495248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 29 PartNo 0 PackedSize 2253230 count 1 nextOffset 30 batches 5
2025-10-15T10:54:16.495343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-15T10:54:16.496623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-15T10:54:16.497655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-15T10:54:16.498642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-15T10:54:16.500418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-15T10:54:16.514392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 29 PartNo 0 PackedSize 4506428 count 2 nextOffset 31 batches 9
2025-10-15T10:54:16.514486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-15T10:54:16.515884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-15T10:54:16.517012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-15T10:54:16.518169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-15T10:54:16.518739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-15T10:54:16.542051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 29 PartNo 0 PackedSize 6759626 count 3 nextOffset 32 batches 13
2025-10-15T10:54:16.551037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-15T10:54:16.551084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-15T10:54:16.551098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-15T10:54:16.611639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 33 partNo 2 result is x0000000000_00000000000000000028_00004_0000000004_00014 size 7988760
2025-10-15T10:54:16.612241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:16.613203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-15T10:54:16.613754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-15T10:54:16.613814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000028_00004_0000000004_00014 new key d0000000000_00000000000000000028_00004_0000000004_00014 size 7988760 WTime 1760525656611
2025-10-15T10:54:16.620285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 33 partNo 4 FormedBlobsCount 1 NewHead: Offset 32 PartNo 2 PackedSize 1229172 count 1 nextOffset 33 batches 3
2025-10-15T10:54:16.621144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:557: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 32,1 HeadOffset 28 endOffset 29 curOffset 33 d0000000000_00000000000000000032_00002_0000000001_00002| size 1229162 WTime 1760525656620
2025-10-15T10:54:16.622331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:16.622395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.622549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:16.622639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-10-15T10:54:16.623783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:16.644228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-15T10:54:16.648021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-15T10:54:16.649348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:16.650499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:16.651791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:16.653288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-15T10:54:16.654556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:16.656107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:16.657163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:16.658622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-15T10:54:16.660040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:16.661151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:16.662216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:16.662753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-15T10:54:16.664794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-15T10:54:16.665456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7988760 cause it's been evicted from L2. Actual L1 size: 8
2025-10-15T10:54:16.665474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 8295582 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T10:54:16.665488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 27 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:16.665502Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:16.676888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.676915Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:16.677023Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 7988760
2025-10-15T10:54:16.677096Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 2 count 1 size 1229162
2025-10-15T10:54:16.677127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:16.677177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:16.677195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-15T10:54:16.677240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-10-15T10:54:16.677270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-10-15T10:54:16.677301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-10-15T10:54:16.677340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-10-15T10:54:16.677368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-15T10:54:16.677395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-10-15T10:54:16.677423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-10-15T10:54:16.677451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-10-15T10:54:16.677485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:16.677505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-10-15T10:54:16.680449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.680551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.680561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (30)
2025-10-15T10:54:16.680666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-15T10:54:16.680703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-15T10:54:16.680721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-15T10:54:16.680739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-15T10:54:16.680754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-15T10:54:16.689889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 2253230 count 1 nextOffset 36 batches 5
2025-10-15T10:54:16.690007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-15T10:54:16.690038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-15T10:54:16.690058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-15T10:54:16.690075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-15T10:54:16.690092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-15T10:54:16.717436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 4506428 count 2 nextOffset 37 batches 9
2025-10-15T10:54:16.717569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-15T10:54:16.717604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-15T10:54:16.717621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-15T10:54:16.717637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-15T10:54:16.717654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-15T10:54:16.733906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 6759626 count 3 nextOffset 38 batches 13
2025-10-15T10:54:16.734041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-15T10:54:16.734077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-15T10:54:16.734093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-15T10:54:16.734109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-15T10:54:16.842931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 39 partNo 3 result is x0000000000_00000000000000000035_00000_0000000003_00015? size 8295638
2025-10-15T10:54:16.843003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-15T10:54:16.843054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000035_00000_0000000003_00015? new key d0000000000_00000000000000000035_00000_0000000003_00015? size 8295638 WTime 1760525656840
2025-10-15T10:54:16.879909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 1 NewHead: Offset 38 PartNo 3 PackedSize 717145 count 1 nextOffset 39 batches 2
2025-10-15T10:54:16.880004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-15T10:54:16.880040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-15T10:54:16.880057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-15T10:54:16.880075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-15T10:54:16.880091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-15T10:54:16.899380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 3 PackedSize 2970343 count 2 nextOffset 40 batches 6
2025-10-15T10:54:16.899508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-15T10:54:16.899545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-15T10:54:16.899565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-15T10:54:16.899581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-15T10:54:16.899600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-15T10:54:16.923705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 3 PackedSize 5223541 count 3 nextOffset 41 batches 10
2025-10-15T10:54:16.923799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.924646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 38,3 HeadOffset 35 endOffset 35 curOffset 41 d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531 WTime 1760525656923
2025-10-15T10:54:16.933327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:16.933832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-15T10:54:16.934004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-15T10:54:16.934441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-15T10:54:16.934495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-15T10:54:16.934590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:16.934749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:16.934766Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:16.934867Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 0 count 3 size 8295638
2025-10-15T10:54:16.934940Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 3 count 3 size 5223531
2025-10-15T10:54:16.934960Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000002_00008?(+) to d0000000000_00000000000000000025_00000_0000000002_00008?(+)
2025-10-15T10:54:16.934971Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000002_00008?(+) to d0000000000_00000000000000000027_00000_0000000002_00008?(+)
2025-10-15T10:54:16.934980Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000004_00013|(+) to d0000000000_00000000000000000021_00003_0000000004_00013|(+)
2025-10-15T10:54:16.936068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.936134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.936189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:16.953435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 576 queued_in_partition_duration_ms: 263 }
2025-10-15T10:54:16.953510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 34
2025-10-15T10:54:16.953544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:16.954439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 560 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:16.954490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 35
2025-10-15T10:54:16.983165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 44 to 44
2025-10-15T10:54:16.985423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:16.985471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-15T10:54:17.005214Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:17.030788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 45 to 45
2025-10-15T10:54:17.048950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:17.049003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-15T10:54:17.071914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:17.072409Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:17.091393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:17.099817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:17.132304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:17.132344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:17.132918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-10-15T10:54:17.133423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-10-15T10:54:17.133948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-10-15T10:54:17.134903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-10-15T10:54:17.135704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-10-15T10:54:17.135731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-10-15T10:54:17.136758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.136813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:17.136830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:17.136898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:17.136946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.136980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-10-15T10:54:17.173067Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 33 Result { Offset: 10 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 11 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760525651743 CreateTimestampMS: 1760525649515 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 12 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760525652287 CreateTimestampMS: 1760525649949 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 13 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760525652529 CreateTimestampMS: 1760525650224 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 14 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760525652559 CreateTimestampMS: 1760525650353 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 6554822 RealReadOffset: 13 WaitQuotaTimeMs: 0 EndOffset: 33 StartOffset: 0 } Cookie: 10 }
2025-10-15T10:54:17.185772Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 14 endOffset 33
2025-10-15T10:54:17.185824Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 33 ReadOffset 14 ReadGuid f2c1740e-63ec74c6-28d7fd1-f6686c44 has messages 1
2025-10-15T10:54:17.187879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:17.211894Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 14, endOffset# 33, WTime# 1760525652559, sizeLag# 6554822
2025-10-15T10:54:17.211926Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:17.211982Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 read done: guid# f2c1740e-63ec74c6-28d7fd1-f6686c44, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011867
2025-10-15T10:54:17.212009Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 response to read: guid# f2c1740e-63ec74c6-28d7fd1-f6686c44
2025-10-15T10:54:17.231699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:17.231750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:17.232400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-10-15T10:54:17.232970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-10-15T10:54:17.233528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-10-15T10:54:17.234077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-10-15T10:54:17.236754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-10-15T10:54:17.236777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-10-15T10:54:17.237261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.237280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:17.237332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.272741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 7988760 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:17.272777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 1 size 1229162 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:17.272826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:17.275484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 1 parts 0 suffix '124' size 205108
2025-10-15T10:54:17.275530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T10:54:17.275562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T10:54:17.275592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 1 parts 2 suffix '124' size 1229162
2025-10-15T10:54:17.279279Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 Process answer. Aval parts: 1
2025-10-15T10:54:17.310020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:17.326124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:17.337080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.337120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:17.337198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 39226538 CachedBlobs 8
2025-10-15T10:54:17.337234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 29 size 8295638 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T10:54:17.337251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 205108 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:17.337266Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:17.340297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:17.340333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:17.340373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.340430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-10-15T10:54:17.344150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:17.403124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:17.406320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:17.416455Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got ReadResponse, serverBytesSize = 9011867, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487579
2025-10-15T10:54:17.419638Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-10)
2025-10-15T10:54:17.419705Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 9011867 to budget
2025-10-15T10:54:17.430004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:17.430058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:17.430616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 87 size: 511959
2025-10-15T10:54:17.434981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 87 size: 511959
2025-10-15T10:54:17.440106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 87 size: 511959
2025-10-15T10:54:17.440704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 87 size: 511959
2025-10-15T10:54:17.441006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size: 205040
2025-10-15T10:54:17.441029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size 205040 offset: -1
2025-10-15T10:54:17.441513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:17.441533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:17.441631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.441647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:17.441702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.442260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 45
2025-10-15T10:54:17.446811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:17.460858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 35 count 3 size 8295638 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:17.460893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:17.460938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:17.460981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 13517466 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:17.460999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-15T10:54:17.461043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-10-15T10:54:17.461075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-10-15T10:54:17.461104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-10-15T10:54:17.461143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-10-15T10:54:17.461171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-15T10:54:17.461196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 1, Offset: 36 is stored on disk
2025-10-15T10:54:17.461223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 2, Offset: 36 is stored on disk
2025-10-15T10:54:17.461245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 3, Offset: 36 is stored on disk
2025-10-15T10:54:17.461273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 4, Offset: 36 is stored on disk
2025-10-15T10:54:17.461316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-15T10:54:17.461343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 1, Offset: 37 is stored on disk
2025-10-15T10:54:17.461371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 2, Offset: 37 is stored on disk
2025-10-15T10:54:17.461397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 3, Offset: 37 is stored on disk
2025-10-15T10:54:17.461425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 4, Offset: 37 is stored on disk
2025-10-15T10:54:17.461452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-15T10:54:17.461478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 1, Offset: 38 is stored on disk
2025-10-15T10:54:17.461522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 2, Offset: 38 is stored on disk
2025-10-15T10:54:17.461560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 3, Offset: 38 is stored on disk
2025-10-15T10:54:17.461609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 4, Offset: 38 is stored on disk
2025-10-15T10:54:17.461635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-15T10:54:17.461662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 1, Offset: 39 is stored on disk
2025-10-15T10:54:17.461689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 2, Offset: 39 is stored on disk
2025-10-15T10:54:17.461717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 3, Offset: 39 is stored on disk
2025-10-15T10:54:17.461743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 4, Offset: 39 is stored on disk
2025-10-15T10:54:17.461769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-15T10:54:17.461795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 1, Offset: 40 is stored on disk
2025-10-15T10:54:17.461823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 2, Offset: 40 is stored on disk
2025-10-15T10:54:17.461843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T10:54:17.461848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 3, Offset: 40 is stored on disk
2025-10-15T10:54:17.461874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-15T10:54:17.461874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:17.461890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 4, Offset: 40 is stored on disk
2025-10-15T10:54:17.461902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T10:54:17.461936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:17.461963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:17.473904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.473981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.473990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:17.474089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-15T10:54:17.474127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-15T10:54:17.474144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-15T10:54:17.474162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-15T10:54:17.474177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-15T10:54:17.494134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 2253230 count 1 nextOffset 42 batches 5
2025-10-15T10:54:17.494257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-15T10:54:17.494291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-15T10:54:17.494310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-15T10:54:17.494326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-15T10:54:17.494345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-15T10:54:17.511992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 4506428 count 2 nextOffset 43 batches 9
2025-10-15T10:54:17.519538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-15T10:54:17.519605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-15T10:54:17.519621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-15T10:54:17.519639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-15T10:54:17.519656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-15T10:54:17.569743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 6759626 count 3 nextOffset 44 batches 13
2025-10-15T10:54:17.569834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.575329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 41,3 HeadOffset 41 endOffset 41 curOffset 44 d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616 WTime 1760525657571
2025-10-15T10:54:17.583407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-15T10:54:17.583433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00015?
2025-10-15T10:54:17.583444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 12802056 bytes
2025-10-15T10:54:17.583573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-15T10:54:17.583646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 37
2025-10-15T10:54:17.583691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 38
2025-10-15T10:54:17.584959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:17.585024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:17.585050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:17.588669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 780 queued_in_partition_duration_ms: 504 }
2025-10-15T10:54:17.588709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 36
2025-10-15T10:54:17.588744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:17.597754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:17.597801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:17.598330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size: 511959
2025-10-15T10:54:17.598834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 89 size: 511959
2025-10-15T10:54:17.599337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 89 size: 511959
2025-10-15T10:54:17.600171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 89 size: 511959
2025-10-15T10:54:17.603606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size: 205040
2025-10-15T10:54:17.603629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size 205040 offset: -1
2025-10-15T10:54:17.604440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 39
2025-10-15T10:54:17.604528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 40
2025-10-15T10:54:17.604588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-15T10:54:17.604622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 717135 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T10:54:17.604638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295579 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:17.604650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988738 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:17.604662Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:17.607633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:17.612069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.612347Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:17.612451Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 41 partNo 0 count 3 size 6759616
2025-10-15T10:54:17.612472Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000029_00000_0000000003_00015?(+) to d0000000000_00000000000000000029_00000_0000000003_00015?(+)
2025-10-15T10:54:17.612482Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00003_0000000001_00001?(+) to d0000000000_00000000000000000032_00003_0000000001_00001?(+)
2025-10-15T10:54:17.612491Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00004_0000000001_00000|(+) to d0000000000_00000000000000000028_00004_0000000001_00000|(+)
2025-10-15T10:54:17.612522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T10:54:17.612537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-15T10:54:17.612638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00015?
2025-10-15T10:54:17.612748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T10:54:17.612763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:17.612815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:17.612977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 33 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T10:54:16.000000Z
2025-10-15T10:54:17.612998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 35 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-15T10:54:17.000000Z
2025-10-15T10:54:17.613022Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T10:54:17.613121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:17.613138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:17.614256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-15T10:54:17.607700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:17.607728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:17.615198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63'
2025-10-15T10:54:17.615225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 15 suffix '63'
2025-10-15T10:54:17.620328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-15T10:54:17.621456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-15T10:54:17.638212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 773 queued_in_partition_duration_ms: 437 }
2025-10-15T10:54:17.638257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 37
2025-10-15T10:54:17.646033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 46 to 46
2025-10-15T10:54:17.648933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-15T10:54:17.650628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-15T10:54:17.652829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:17.652876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-15T10:54:17.665801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:17.673352Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-10-15T10:54:17.673404Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-15T10:54:17.673508Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-11)
2025-10-15T10:54:17.674847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 744 queued_in_partition_duration_ms: 422 }
2025-10-15T10:54:17.676407Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:17.684394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 38
2025-10-15T10:54:17.685894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:17.687481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 726 queued_in_partition_duration_ms: 358 }
2025-10-15T10:54:17.687522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 39
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-15T10:54:09.515000Z WriteTime: 2025-10-15T10:54:11.743000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:53654", "_ip": "ipv6:[::1]:53654", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:17.692738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 583 queued_in_partition_duration_ms: 453 }
2025-10-15T10:54:17.692780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 40
2025-10-15T10:54:17.713682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 561 queued_in_partition_duration_ms: 277 }
2025-10-15T10:54:17.713732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 41
2025-10-15T10:54:17.722599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 47 to 47
2025-10-15T10:54:17.723257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 2253230 count 1 nextOffset 34 batches 5
2025-10-15T10:54:17.723378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-15T10:54:17.726055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:17.726100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:17.737270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-15T10:54:17.738597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-15T10:54:17.739805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-15T10:54:17.741829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-15T10:54:17.748746Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:17.769555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 48 to 48
2025-10-15T10:54:17.766932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 4506428 count 2 nextOffset 35 batches 9
2025-10-15T10:54:17.767037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:17.772157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-15T10:54:17.775619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:17.775688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-15T10:54:17.773249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-15T10:54:17.774163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-15T10:54:17.775270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-15T10:54:17.777380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-15T10:54:17.787716Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (11-11)
2025-10-15T10:54:17.787798Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-15T10:54:17.787918Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (12-12)
2025-10-15T10:54:17.787982Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:17.802942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 6759626 count 3 nextOffset 36 batches 13
2025-10-15T10:54:17.803068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-15T10:54:09.949000Z WriteTime: 2025-10-15T10:54:12.287000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:53654", "logtype": "unknown", "_ip": "ipv6:[::1]:53654" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:17.824680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 49 to 49
2025-10-15T10:54:17.826558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:17.826612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-15T10:54:17.838537Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:17.858685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 50 to 50
2025-10-15T10:54:17.868281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:17.868369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-15T10:54:17.890364Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (12-12)
2025-10-15T10:54:17.890452Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-15T10:54:17.890634Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (13-13)
2025-10-15T10:54:17.890696Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-15T10:54:10.224000Z WriteTime: 2025-10-15T10:54:12.529000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:53654", "server": "ipv6:[::1]:53654", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:17.922232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 37 partNo 0 result is x0000000000_00000000000000000032_00002_0000000004_00014 size 7988778
2025-10-15T10:54:17.928819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-15T10:54:17.930116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-15T10:54:17.933990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 51 to 51
2025-10-15T10:54:17.935928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:17.935982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-15T10:54:17.936020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:17.936542Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:17.963551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-15T10:54:17.965134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-15T10:54:17.965213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000032_00002_0000000004_00014 new key d0000000000_00000000000000000032_00002_0000000004_00014 size 7988778 WTime 1760525657962
2025-10-15T10:54:17.980893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 37 partNo 4 FormedBlobsCount 1 NewHead: Offset 36 PartNo 0 PackedSize 2253230 count 1 nextOffset 37 batches 5
2025-10-15T10:54:17.981177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-15T10:54:17.982504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-15T10:54:17.983603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-15T10:54:17.984656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-15T10:54:17.985129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-15T10:54:18.011109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4506428 count 2 nextOffset 38 batches 9
2025-10-15T10:54:18.022781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-15T10:54:18.022829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-15T10:54:18.022846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-15T10:54:18.024765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:557: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,2 HeadOffset 32 endOffset 33 curOffset 38 d0000000000_00000000000000000036_00000_0000000002_00008| size 4506418 WTime 1760525658024
2025-10-15T10:54:18.038215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.035728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.035758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.035793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:18.035823Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:18.035901Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 2 count 4 size 7988778
2025-10-15T10:54:18.035954Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 2 size 4506418
2025-10-15T10:54:18.036447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-10-15T10:54:18.053127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.053186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.053790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size: 511959
2025-10-15T10:54:18.055060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 91 size: 511959
2025-10-15T10:54:18.055614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 91 size: 511959
2025-10-15T10:54:18.056141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 91 size: 511959
2025-10-15T10:54:18.056445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size: 205040
2025-10-15T10:54:18.056473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size 205040 offset: -1
2025-10-15T10:54:18.058891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:18.058950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:18.059091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:18.059177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:18.059230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:18.059250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T10:54:18.059284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-15T10:54:18.059298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:18.059298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 1, Offset: 41 is stored on disk
2025-10-15T10:54:18.059331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 2, Offset: 41 is stored on disk
2025-10-15T10:54:18.059377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 3, Offset: 41 is stored on disk
2025-10-15T10:54:18.059420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 4, Offset: 41 is stored on disk
2025-10-15T10:54:18.059451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-15T10:54:18.059480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 1, Offset: 42 is stored on disk
2025-10-15T10:54:18.059510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 2, Offset: 42 is stored on disk
2025-10-15T10:54:18.059540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 3, Offset: 42 is stored on disk
2025-10-15T10:54:18.059573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 4, Offset: 42 is stored on disk
2025-10-15T10:54:18.059601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-15T10:54:18.059632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 1, Offset: 43 is stored on disk
2025-10-15T10:54:18.059664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 2, Offset: 43 is stored on disk
2025-10-15T10:54:18.059694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 3, Offset: 43 is stored on disk
2025-10-15T10:54:18.059757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.059779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 4, Offset: 43 is stored on disk
2025-10-15T10:54:18.061912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.061966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.061977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:18.062076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-15T10:54:18.062113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-15T10:54:18.062131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-15T10:54:18.062150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-15T10:54:18.062167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-15T10:54:18.074333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:18.076691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:18.087488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 44 PartNo 0 PackedSize 2253230 count 1 nextOffset 45 batches 5
2025-10-15T10:54:18.087642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-15T10:54:18.087682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-15T10:54:18.087705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-15T10:54:18.087721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-15T10:54:18.087742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-15T10:54:18.098538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 44 PartNo 0 PackedSize 4506428 count 2 nextOffset 46 batches 9
2025-10-15T10:54:18.098647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.099846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 44,2 HeadOffset 44 endOffset 44 curOffset 46 d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418 WTime 1760525658099
2025-10-15T10:54:18.104882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:18.105049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 7988760 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:18.105068Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:18.115218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 42
2025-10-15T10:54:18.115338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 43
2025-10-15T10:54:18.115417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 44
2025-10-15T10:54:18.115840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.115868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.115942Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:18.116077Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 44 partNo 0 count 2 size 4506418
2025-10-15T10:54:18.116510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-15T10:54:18.115686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.115758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.115789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.119261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 586 queued_in_partition_duration_ms: 338 }
2025-10-15T10:54:18.119330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 42
2025-10-15T10:54:18.119381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:18.120676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 565 queued_in_partition_duration_ms: 257 }
2025-10-15T10:54:18.120720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 43
2025-10-15T10:54:18.124140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 52 to 52
2025-10-15T10:54:18.125800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.130907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:18.130948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-15T10:54:18.143085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.143139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.143510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 539 queued_in_partition_duration_ms: 77 }
2025-10-15T10:54:18.145348Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (13-13)
2025-10-15T10:54:18.145415Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-15T10:54:18.145462Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 9011867, ReadSizeServerDelta = -8487579
2025-10-15T10:54:18.145731Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:18.145772Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:18.148344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 44
2025-10-15T10:54:18.148343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size: 511959
2025-10-15T10:54:18.148373Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 grpc read done: success# 1, data# { read_request { bytes_size: 9011867 } }
2025-10-15T10:54:18.153681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 93 size: 511959
2025-10-15T10:54:18.148560Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 got read request: guid# c805e8b9-b91323a0-d54d0a93-6c34cec2
2025-10-15T10:54:18.148640Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 performing read request: guid# fd0bb73-7d61755b-e80f1d3d-83a798c2, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 22, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:18.148751Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 22 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 14 EndOffset 33 ClientCommitOffset 0 committedOffset 0 Guid fd0bb73-7d61755b-e80f1d3d-83a798c2
2025-10-15T10:54:18.156033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 93 size: 511959
2025-10-15T10:54:18.161434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 93 size: 511959
2025-10-15T10:54:18.162224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size: 205040
2025-10-15T10:54:18.162260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size 205040 offset: -1
2025-10-15T10:54:18.162968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:18.163078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.163100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.163139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:18.163190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:18.163235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 4 size 7988778 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:18.163260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:18.163324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:18.163846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 1 parts 2 suffix '124' size 1229162
2025-10-15T10:54:18.163886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:18.163918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-15T10:54:10.353000Z WriteTime: 2025-10-15T10:54:12.559000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:53654", "server": "ipv6:[::1]:53654" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:18.163943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-15T10:54:18.179540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:18.182501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:18.186474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:18.187914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:18.197763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:18.197790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11983147 bytes
2025-10-15T10:54:18.197919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 38 size 5223531 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T10:54:18.197945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 1229162 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:18.197961Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:18.209566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.209622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.209704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T10:54:18.209723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:18.209845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:18.209978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T10:54:18.210009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 44 max time lag 0ms effective offset 14
2025-10-15T10:54:18.210332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 44
2025-10-15T10:54:18.210347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-15T10:54:18.210726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:18.210754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 41 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-15T10:54:18.000000Z
2025-10-15T10:54:18.210786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 2 from KV
2025-10-15T10:54:18.210825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:18.210837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:18.210854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 11. Have to read 2 of 2 from KV
2025-10-15T10:54:18.210894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-10-15T10:54:18.213822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 53 to 53
2025-10-15T10:54:18.215948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63'
2025-10-15T10:54:18.215987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:18.216014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:18.216024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:18.220384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:18.220431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-15T10:54:18.216363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.221049Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:18.229699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.229746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.233048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:18.243292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 95 size: 511959
2025-10-15T10:54:18.247567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 95 size: 511959
2025-10-15T10:54:18.248133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 95 size: 511959
2025-10-15T10:54:18.248694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 95 size: 511959
2025-10-15T10:54:18.248923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size: 205040
2025-10-15T10:54:18.248944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size 205040 offset: -1
2025-10-15T10:54:18.249507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.249527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.249548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:18.249608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:18.249644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:18.249684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:18.249714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:18.249725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.249744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-15T10:54:18.249764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.249782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 1, Offset: 44 is stored on disk
2025-10-15T10:54:18.249793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.249813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 2, Offset: 44 is stored on disk
2025-10-15T10:54:18.249828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.249847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 3, Offset: 44 is stored on disk
2025-10-15T10:54:18.249868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.249891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 4, Offset: 44 is stored on disk
2025-10-15T10:54:18.249901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.249923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-15T10:54:18.249931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.249950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 1, Offset: 45 is stored on disk
2025-10-15T10:54:18.249960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.249982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 2, Offset: 45 is stored on disk
2025-10-15T10:54:18.249992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.250009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 3, Offset: 45 is stored on disk
2025-10-15T10:54:18.250023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:18.250043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 4, Offset: 45 is stored on disk
2025-10-15T10:54:18.250256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:18.250298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:18.251544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.251609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.251620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:18.251719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-15T10:54:18.251760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-15T10:54:18.251778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-15T10:54:18.251798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-15T10:54:18.251816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-15T10:54:18.245620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:18.266000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 54 to 54
2025-10-15T10:54:18.279098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:18.279151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 54
2025-10-15T10:54:18.279182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:18.281672Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:18.308281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 2253230 count 1 nextOffset 47 batches 5
2025-10-15T10:54:18.308408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-15T10:54:18.308442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-15T10:54:18.308458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-15T10:54:18.308479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-15T10:54:18.308495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-15T10:54:18.356742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 4506428 count 2 nextOffset 48 batches 9
2025-10-15T10:54:18.356837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.357814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 46,2 HeadOffset 46 endOffset 46 curOffset 48 d0000000000_00000000000000000046_00000_0000000002_00008? size 4506418 WTime 1760525658357
2025-10-15T10:54:18.362696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:18.362788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 49
2025-10-15T10:54:18.362872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 45
2025-10-15T10:54:18.362923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 46
2025-10-15T10:54:18.362958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 33 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:18.362972Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:18.363952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.364011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.364046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.381247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:18.381345Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:18.381459Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 46 partNo 0 count 2 size 4506418
2025-10-15T10:54:18.381483Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000033_00000_0000000002_00008?(+) to d0000000000_00000000000000000033_00000_0000000002_00008?(+)
2025-10-15T10:54:18.381494Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000035_00000_0000000003_00015?(+) to d0000000000_00000000000000000035_00000_0000000003_00015?(+)
2025-10-15T10:54:18.389510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:18.381505Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00002_0000000001_00002|(+) to d0000000000_00000000000000000032_00002_0000000001_00002|(+)
2025-10-15T10:54:18.384865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.384898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.385508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 97 size: 511959
2025-10-15T10:54:18.386276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 97 size: 511959
2025-10-15T10:54:18.386801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 97 size: 511959
2025-10-15T10:54:18.387308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 97 size: 511959
2025-10-15T10:54:18.399006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 187 queued_in_partition_duration_ms: 449 }
2025-10-15T10:54:18.399067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 45
2025-10-15T10:54:18.399100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T10:54:18.400030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 162 queued_in_partition_duration_ms: 28 }
2025-10-15T10:54:18.400071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: acknoledged message 46
2025-10-15T10:54:18.402978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 55 to 55
2025-10-15T10:54:18.404933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:18.404977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 55
2025-10-15T10:54:18.406341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size: 205040
2025-10-15T10:54:18.406387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size 205040 offset: -1
2025-10-15T10:54:18.409603Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:18.415614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:18.423689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:18.423777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:18.423841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:18.423871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:18.423911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-15T10:54:18.423922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:18.423962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400076540076242:2404]
2025-10-15T10:54:18.424133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:18.424153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:18.424524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T10:54:18.424567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:18.435003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-15T10:54:18.445487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-15T10:54:18.457954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write 1 messages with Id from 56 to 56
2025-10-15T10:54:18.465629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: try to update token
2025-10-15T10:54:18.465681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Send 1 message(s) (0 left), first sequence number is 56
2025-10-15T10:54:18.465716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T10:54:18.466206Z :NOTICE: [/Invalid] [/Invalid] [7f652692-39947863-c99379c1-5de8411b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:13695" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:13695. " }
2025-10-15T10:54:18.484355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 3 PackedSize 2253230 count 1 nextOffset 39 batches 5
2025-10-15T10:54:18.484476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:18.755165Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::ExecRequestForCompaction(NKikimr::NPQ::TWriteMsg&, NKikimr::NPQ::TPartition::TProcessParametersBase&, NKikimr::TEvKeyValue::TEvRequest*, TInstant)+4718 (0x3DD3A9EE)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+2371 (0x3DD484B3)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:18.768251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 50
2025-10-15T10:54:18.768354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 35 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T10:54:18.768367Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T10:54:18.777570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:18.804341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:18.804375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:18.804775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: error at write: Disconnected sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0
2025-10-15T10:54:18.820087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0 is DEAD
2025-10-15T10:54:18.823122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_7647013187117849532_v1
2025-10-15T10:54:18.823214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:18.823258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:18.823280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:18.823302Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:18.850794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400082330304938:2534]
2025-10-15T10:54:18.850893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:18.866122Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_7647013187117849532_v1
2025-10-15T10:54:18.867056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:18.867098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session will restart in 0.008582s
2025-10-15T10:54:18.867228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: Do CDS request
2025-10-15T10:54:18.867263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:18.897336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:18.897374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-15T10:54:18.908616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:18.911875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:18.912030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:18.912051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:18.912065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:18.910805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:18.911369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:18.912307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:18.912337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:18.912382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:18.912645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:18.912991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400128079684594:2537]
2025-10-15T10:54:18.917267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:18.916459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-15T10:54:18.916564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:18.916574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:18.916582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:18.916597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400125279978510:2620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:18.919028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400125279978510:2620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:18.919498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:18.919752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:18.921231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:18.921623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:18.921630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:18.921636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:18.921642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:18.921648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:18.921654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:18.921660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:18.921664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:18.921669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:18.921674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-15T10:54:18.921680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:18.921685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:18.921690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-15T10:54:18.921695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000035_00000_0000000003_00015?
2025-10-15T10:54:18.921700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[14]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:18.921705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[15]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:18.921711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[16]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:18.921770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:18.921893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:18.921934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:18.921971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:18.922008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:18.922044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:18.922081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:18.922117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:18.922154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:18.922197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-15T10:54:18.922239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:574: replace key d0000000000_00000000000000000032_00002_0000000001_00002| to d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:18.922284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:18.922355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:603: ignore key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-15T10:54:18.922402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:603: ignore key d0000000000_00000000000000000035_00000_0000000003_00015?
2025-10-15T10:54:18.922439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:18.922477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:18.922516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:18.922562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:18.922658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:18.922724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:18.924460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:18.924529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:18.924579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:18.924643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:18.924698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:18.924742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:18.924807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:18.924855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:18.924902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:18.924944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:18.924988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:18.925028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:18.925076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:18.925117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:18.925163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:18.925202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000001_00002|
2025-10-15T10:54:18.925253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000032_00002_0000000001_00002| will be deleted
2025-10-15T10:54:18.925278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:18.925324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:18.925379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-15T10:54:18.925420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000033_00000_0000000002_00008? will be deleted
2025-10-15T10:54:18.925434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00015?
2025-10-15T10:54:18.925472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000035_00000_0000000003_00015? will be deleted
2025-10-15T10:54:18.925483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:18.925526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:18.925563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:18.925622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:18.925661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:18.925705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:18.925740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:18.925784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:18.926334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:18.935454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400125279978510:2620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:18.955839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400125279978541:2534]
2025-10-15T10:54:18.956068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:18.962870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400125279978510:2620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:18.962907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400125279978510:2620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:18.962923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400125279978510:2620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:18.962953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:18.965202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:18.993247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:18.993306Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:18.993328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:18.993353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:18.993383Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7561400128079684594:2537]
2025-10-15T10:54:18.993447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:18.993514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:18.993532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.993550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.993564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.993730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:18.993755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:18.993779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:18.995308Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:18.995341Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000035_00000_0000000003_00015?(+) to d0000000000_00000000000000000035_00000_0000000003_00015?(+)
2025-10-15T10:54:18.999419Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000033_00000_0000000002_00008?(+) to d0000000000_00000000000000000033_00000_0000000002_00008?(+)
2025-10-15T10:54:18.999459Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00002_0000000001_00002|(+) to d0000000000_00000000000000000032_00002_0000000001_00002|(+)
2025-10-15T10:54:18.999670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:18.999694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:18.999708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:18.999720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:19.000137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:19.000165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:19.000300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:19.000479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:19.000703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:19.000800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400128079684588:2537]
2025-10-15T10:54:19.000820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400128079684588:2537]
2025-10-15T10:54:19.000833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400128079684588:2537]
2025-10-15T10:54:19.000870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:19.000940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:19.001105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:19.001128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:19.001616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400128079684588:2537]
2025-10-15T10:54:19.001647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:19.002157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:19.002176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:19.002187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:19.002207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:19.005004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7561400125279978541:2534]
2025-10-15T10:54:19.005076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-10-15T10:54:19.005151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-10-15T10:54:19.008074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400125279978541:2534], now have 1 active actors on pipe
2025-10-15T10:54:19.008112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400125279978544:2620], now have 1 active actors on pipe
2025-10-15T10:54:19.008135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400125279978487:2467], now have 1 active actors on pipe
2025-10-15T10:54:19.008760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:19.008789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:19.008843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:19.008855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:19.008947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1fdd989-29cd6014-22854515-308818a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:19.008982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:19.009032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:19.009366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:19.009382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:19.009417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400128079684588:2537]
2025-10-15T10:54:19.009429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400128079684588:2537]
2025-10-15T10:54:19.009468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:19.012341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:19.012363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:19.016761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:19.016808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:19.016833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.016853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.016863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:19.016901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.016963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:19.016993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:54:19.017034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:19.022798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:19.022831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:19.022900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:19.023747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 46 sessionId: src_id|e1fdd989-29cd6014-22854515-308818a5_0
2025-10-15T10:54:19.027570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b532f2-8dcf92b8-423e78e7-1d32ff9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e1fdd989-29cd6014-22854515-308818a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:19.095178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.095215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.095226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.109505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1fdd989-29cd6014-22854515-308818a5_0] Write session: try to update token
2025-10-15T10:54:19.109577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1fdd989-29cd6014-22854515-308818a5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:19.292395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.292430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.292440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.292498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:19.292510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:19.292520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:19.292528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:19.292559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400128079684588:2537]
2025-10-15T10:54:19.292582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400128079684588:2537]
2025-10-15T10:54:19.292602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400128079684588:2537]
2025-10-15T10:54:19.292708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:19.292717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:19.292734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:19.292739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:19.292767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:19.322158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:19.516898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|e1fdd989-29cd6014-22854515-308818a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:19.513522Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:19.559720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:19.662388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:19.662422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:19.666326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:19.668952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:19.669795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:19.669812Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:19.669854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:19.670088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:19.670249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400132374651994:2547]
2025-10-15T10:54:19.672474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:19.674592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:19.674783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:19.676135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:19.676433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:19.676439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:19.676445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:19.676451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:19.676455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:19.676461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:19.676466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:19.676470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:19.676475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:19.676479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:19.676485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:19.676490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:19.676496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:19.676505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:19.676540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:19.676629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:19.676666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:19.676736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:19.676768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:19.676804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:19.676837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:19.676872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:19.676906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:19.676942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:19.676977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:19.677012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:19.677046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:19.677079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:19.677114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:19.677165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:19.677210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:19.677255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:19.677292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:19.677333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:19.677366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:19.677406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:19.677439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:19.677476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:19.677509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:19.677547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:19.677581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:19.677638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:19.677670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:19.677707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:19.677741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:19.677782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:19.677816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:19.677856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:19.677888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:19.677928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:19.677958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:19.677994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:19.678025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:19.678062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:19.678092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:19.678129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:19.679816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:19.704386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|e1fdd989-29cd6014-22854515-308818a5_0
2025-10-15T10:54:19.704710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|e1fdd989-29cd6014-22854515-308818a5_0 is DEAD
2025-10-15T10:54:19.710825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:19.718552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400125279978541:2534]
2025-10-15T10:54:19.718632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:19.723574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1fdd989-29cd6014-22854515-308818a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:54:19.723623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1fdd989-29cd6014-22854515-308818a5_0] Write session will restart in 0.005142s
2025-10-15T10:54:19.723768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1fdd989-29cd6014-22854515-308818a5_0] Write session: Do CDS request
2025-10-15T10:54:19.723799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1fdd989-29cd6014-22854515-308818a5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:19.736397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1fdd989-29cd6014-22854515-308818a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:19.740175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:19.740206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-15T10:54:19.740455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:19.740492Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:19.740506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:19.740522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:19.740542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3 [2:7561400132374651994:2547]
2025-10-15T10:54:19.740583Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:19.740627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:19.740640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.740650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.740659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.740700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:19.740718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:19.740734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:19.742920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:19.743043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:19.743058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:19.743066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:19.748084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-15T10:54:19.748196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:19.748207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:19.748216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:19.748231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400129574945905:2626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:19.750664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400129574945905:2626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:19.751628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:19.751652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:19.751663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:19.751672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:19.751933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:19.751948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:19.752066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:19.752208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:19.752383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:19.752487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400129574945899:2467], now have 1 active actors on pipe
2025-10-15T10:54:19.752510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:19.752521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:19.752533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:19.752566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:19.752631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:19.752782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:19.752796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:19.752896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:19.752911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:19.753333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3
2025-10-15T10:54:19.753548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:19.753566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:19.753575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:19.753612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:19.776596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400129574945905:2626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:19.819479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400129574945935:2534]
2025-10-15T10:54:19.819631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:19.820415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3, pipe: [1:7561400129574945935:2534]
2025-10-15T10:54:19.823083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400129574945935:2534], now have 1 active actors on pipe
2025-10-15T10:54:19.823211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:19.823236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:19.823329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:19.823700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:19.823719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:19.823752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:19.823769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:19.823838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:19.823853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:19.823869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:19.839013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400129574945905:2626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:19.839053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400129574945905:2626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:19.839067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400129574945905:2626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:19.839094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:19.841405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3
2025-10-15T10:54:19.843464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400129574945938:2626], now have 1 active actors on pipe
2025-10-15T10:54:19.843543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:19.843562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:19.843614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.843623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.843633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.843716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:19.843741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.843755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.843762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:19.843793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.843838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:19.843877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:19.848514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 46 sessionId: src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0
2025-10-15T10:54:19.848175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:19.848206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:19.848267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:19.851968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1fdd989-29cd6014-22854515-308818a5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:19.926136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0] Write session: try to update token
2025-10-15T10:54:19.926198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:19.955267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:19.955295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:19.955307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:19.955317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:19.955363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:19.955386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:19.955407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:19.955572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.955584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.955607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.955701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:19.955720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:19.956779Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:19.958682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:19.958719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:19.958744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:20.156938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:20.201021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:20.206501Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:20.218470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:20.218512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:20.218565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:20.218576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:20.218626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400132374651988:2547]
2025-10-15T10:54:20.219921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:20.220003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:20.223618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:20.223642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:20.229025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:20.229153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400129574945935:2534]
2025-10-15T10:54:20.261771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:20.261803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:20.277297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:20.277366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0] Write session will restart in 0.005793s
2025-10-15T10:54:20.277566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0] Write session: Do CDS request
2025-10-15T10:54:20.277638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:20.276447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: error at write: Disconnected sessionId: src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0
2025-10-15T10:54:20.276731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0 is DEAD
2025-10-15T10:54:20.304083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:20.304116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-15T10:54:20.315539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:20.320843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:20.320975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:20.320990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:20.320999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:20.323823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-15T10:54:20.323945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:20.323956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:20.323965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:20.323993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400133869913274:2633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:20.326079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400133869913274:2633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:20.328312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400133869913280:2534]
2025-10-15T10:54:20.328458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:20.328544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400133869913280:2534]
2025-10-15T10:54:20.328623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: ERROR TabletId: 72075186224037892 Generation: 0, pipe: [0:0:0]
2025-10-15T10:54:20.349401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:20.350783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400133869913274:2633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:20.356468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:20.357243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:20.357259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:20.357297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:20.357528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:20.357712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400136669619363:2551]
2025-10-15T10:54:20.360500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:20.367923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:20.368142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:20.369316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:20.369705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400133869913274:2633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:20.369746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400133869913274:2633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:20.369760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400133869913274:2633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:20.369787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:20.370714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:20.370730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:20.370736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:20.370742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:20.370748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:20.370753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:20.370758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:20.370763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:20.370770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:20.370777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:20.370783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:20.370789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:20.370798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:20.370803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:20.370845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:20.370936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:20.370984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:20.371027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:20.371067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:20.371107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:20.371145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:20.371184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:20.371221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:20.371264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:20.371306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:20.371362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:20.371402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:20.371445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:20.371485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:20.371545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:20.371598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:20.371649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:20.371691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:20.371741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:20.371784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:20.371833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:20.371879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:20.371932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:20.371973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:20.372021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:20.372064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:20.372113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:20.372154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:20.372199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:20.372243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:20.372291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:20.372331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:20.372376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:20.372414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:20.372461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:20.372502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:20.372549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:20.372591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:20.372634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:20.372674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:20.372720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:20.373154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:20.428121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400133869913314:2534]
2025-10-15T10:54:20.428307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:20.454736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:20.486472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:20.486516Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:20.486532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:20.486548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:20.486567Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 4 [2:7561400136669619363:2551]
2025-10-15T10:54:20.486621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:20.486673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:20.486687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.486697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.486706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.486745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:20.486765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:20.486784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:20.487759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:20.487774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:20.487787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:20.487797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:20.488038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:20.488055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:20.488179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:20.488342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:20.488547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:20.488610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:20.488623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:20.488633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:20.488659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:20.488718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:20.488724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:20.488736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:20.488748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:20.488871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:20.488886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:20.489010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400133869913314:2534], now have 1 active actors on pipe
2025-10-15T10:54:20.489030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400133869913255:2467], now have 1 active actors on pipe
2025-10-15T10:54:20.489049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400133869913309:2633], now have 1 active actors on pipe
2025-10-15T10:54:20.489065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:20.489094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:20.489102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:20.491112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:20.491142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:20.491194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:20.491206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:20.491270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:20.491296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.491309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.491318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:20.491366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.491404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:20.491459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:20.491507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:20.491809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:20.491824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:20.491854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:20.491865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:20.491886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:20.492178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:20.492189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:20.490332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 4, pipe: [1:7561400133869913314:2534]
2025-10-15T10:54:20.490421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 4
2025-10-15T10:54:20.490478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 4
2025-10-15T10:54:20.498152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 46 sessionId: src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0
2025-10-15T10:54:20.498900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc7b667-8abe12c1-7abcf953-576dbaed_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:20.497536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:20.497572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:20.497657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:20.539075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0] Write session: try to update token
2025-10-15T10:54:20.539127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:20.591487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.591517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.591528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.831505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:20.888928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.888953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.888963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.889013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:20.889026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:20.889039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:20.889049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:20.889080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:20.889104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:20.889126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:20.889250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:20.889279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:20.889301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:20.889359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:20.889380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:20.890442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:20.926132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:21.222884Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:21.264244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:21.264285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:21.264343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:21.264355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:21.264390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:21.264477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:21.264487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:21.264497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:21.264521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:21.264541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400136669619355:2551]
2025-10-15T10:54:21.265299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:21.265342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-15T10:54:21.265371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:21.265398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:21.265422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:21.265443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:21.266505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400133869913314:2534]
2025-10-15T10:54:21.268846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:21.266597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:21.266689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:21.268912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:21.266697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:21.318556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: error at write: Disconnected sessionId: src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0
2025-10-15T10:54:21.328346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0 is DEAD
2025-10-15T10:54:21.331628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:21.331721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0] Write session will restart in 0.006692s
2025-10-15T10:54:21.331931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0] Write session: Do CDS request
2025-10-15T10:54:21.332013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:21.360165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:21.391794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:21.397270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400138164880682:2534]
2025-10-15T10:54:21.397423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:21.397524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:21.397536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-15T10:54:21.399758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:21.400558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:21.400574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:21.400611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:21.400850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:21.401017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400140964586768:2566]
2025-10-15T10:54:21.403084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:21.404278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:21.404499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:21.405717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:21.405994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:21.406002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:21.406009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:21.406015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:21.406021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:21.406027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:21.406032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:21.406037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:21.406042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:21.406048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:21.406054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:21.406058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:21.406065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:21.406071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:21.406111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:21.406200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:21.406239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:21.406276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:21.406310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:21.406347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:21.406386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:21.406427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:21.406465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:21.406506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:21.406544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:21.406582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:21.406624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:21.406664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:21.406703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:21.406766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:21.406815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:21.406861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:21.406902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:21.406950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:21.406989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:21.407043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:21.407086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:21.407125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:21.407160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:21.407205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:21.407248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:21.407293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:21.407333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:21.407432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:21.407472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:21.407522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:21.407560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:21.407611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:21.407654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:21.407700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:21.407742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:21.407811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:21.407855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:21.407903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:21.407945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:21.408009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:21.408451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:21.412366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:21.412501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:21.412515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:21.412524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:21.416724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-15T10:54:21.416835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:21.416845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:21.416853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:21.416870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400138164880691:2645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:21.419294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400138164880691:2645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:21.435333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400138164880691:2645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:21.445869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:21.464363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400138164880691:2645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:21.464404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400138164880691:2645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:21.464417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400138164880691:2645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:21.464446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:21.516954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:21.516986Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:21.517000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:21.517017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:21.517037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 5 [2:7561400140964586768:2566]
2025-10-15T10:54:21.517081Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:21.517128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:21.517142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.517151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.517161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.517201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:21.517219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:21.517237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:21.534867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 5
2025-10-15T10:54:21.531561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:21.531586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:21.531597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:21.531607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:21.531857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:21.531873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:21.532001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:21.532158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:21.534958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 5
2025-10-15T10:54:21.535043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 5, pipe: [1:7561400138164880682:2534]
2025-10-15T10:54:21.532346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:21.532406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:21.532419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:21.532431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:21.532469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:21.532534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:21.532676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:21.532691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:21.532802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:21.532819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:21.533229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:21.533240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:21.533250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:21.533270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:21.538560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400138164880664:2467], now have 1 active actors on pipe
2025-10-15T10:54:21.538593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400138164880722:2645], now have 1 active actors on pipe
2025-10-15T10:54:21.538613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400138164880682:2534], now have 1 active actors on pipe
2025-10-15T10:54:21.538681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:21.538701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:21.538777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:21.538792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:21.538866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a788a454-64b0367d-c7a662d4-185e270a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:21.538894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.538909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.538919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:21.538954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.538993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:21.539045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:21.539105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:21.548399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:21.548429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:21.548501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:21.548521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:21.548572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:21.548584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:21.548612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:21.548776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:21.548967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:21.548981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:21.549371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 46 sessionId: src_id|a788a454-64b0367d-c7a662d4-185e270a_0
2025-10-15T10:54:21.553914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54d8c417-a005c45c-3968d0f0-a389bcb7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a788a454-64b0367d-c7a662d4-185e270a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:21.607599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a788a454-64b0367d-c7a662d4-185e270a_0] Write session: try to update token
2025-10-15T10:54:21.607661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a788a454-64b0367d-c7a662d4-185e270a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:21.616485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.616509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.616519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.716191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:21.716215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:21.716226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:21.716235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:21.716277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:21.716302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:21.716322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:21.716526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.716539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.716550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.716590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:21.716608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:21.717638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:21.719722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:21.719760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:21.719787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:21.719812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:21.719832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:21.904893Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:21.930174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: src_id|a788a454-64b0367d-c7a662d4-185e270a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:21.975138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:22.015179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:22.015513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:22.015538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:22.011543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:22.011570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:22.011609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400140964586762:2566]
2025-10-15T10:54:22.012095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:22.012213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:22.019619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400138164880682:2534]
2025-10-15T10:54:22.023768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 6 reason: error at write: Disconnected sessionId: src_id|a788a454-64b0367d-c7a662d4-185e270a_0
2025-10-15T10:54:22.024055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: src_id|a788a454-64b0367d-c7a662d4-185e270a_0 is DEAD
2025-10-15T10:54:22.032162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a788a454-64b0367d-c7a662d4-185e270a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:22.032212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a788a454-64b0367d-c7a662d4-185e270a_0] Write session will restart in 0.009147s
2025-10-15T10:54:22.032329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a788a454-64b0367d-c7a662d4-185e270a_0] Write session: Do CDS request
2025-10-15T10:54:22.032362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a788a454-64b0367d-c7a662d4-185e270a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:22.040061Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:22.060304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a788a454-64b0367d-c7a662d4-185e270a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:22.063948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:22.063985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-15T10:54:22.064637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:22.064772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:22.064790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:22.064799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:22.066482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-15T10:54:22.066615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:22.066626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:22.066637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:22.066654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400142459848084:2654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:22.070329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400142459848084:2654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:22.090318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400142459848084:2654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:22.112786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400142459848084:2654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:22.112846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400142459848084:2654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:22.112864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400142459848084:2654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:22.112899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:22.114675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:22.116615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:22.117514Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:22.117545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:22.117596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:22.117887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:22.118068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400145259554138:2571]
2025-10-15T10:54:22.123208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400142459848126:2534]
2025-10-15T10:54:22.123437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:22.126388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:22.133607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:22.133891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:22.145007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:22.145560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:22.145568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:22.145573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:22.145578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:22.145584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:22.145590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:22.145596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:22.145603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:22.145610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:22.145616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:22.145622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:22.145644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.145652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.145659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.145708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:22.145813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:22.145859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:22.145900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:22.145939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:22.145981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:22.146024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:22.146068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:22.146111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:22.146157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:22.146204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:22.146247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.146288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.146327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.146371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:22.146438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:22.146499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:22.146549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:22.146589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:22.146638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:22.146681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:22.146733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:22.146775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:22.146825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:22.146868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:22.146912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:22.146955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:22.147008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:22.147053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:22.147099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:22.147141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:22.147195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:22.147232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:22.147279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:22.147319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:22.156076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:22.156177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.156256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.156312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.156377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.156431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.156491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.157033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:22.201084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:22.225317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:22.225364Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:22.225382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:22.225405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:22.225430Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 6 [2:7561400145259554138:2571]
2025-10-15T10:54:22.225499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:22.225563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:22.225579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.225592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.225604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.225671Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:22.225695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:22.225719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:22.263460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.263484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.263496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.263507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:22.263765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:22.263782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.263911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.264054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.264259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:22.264331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.264344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.264354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.264397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:22.264478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:22.264659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:22.264675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:22.264797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.264813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:22.267570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 6, pipe: [1:7561400142459848126:2534]
2025-10-15T10:54:22.267663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 6
2025-10-15T10:54:22.267732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 6
2025-10-15T10:54:22.265537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:22.265552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:22.265563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:22.265585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:22.272521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400142459848122:2654], now have 1 active actors on pipe
2025-10-15T10:54:22.272568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400142459848072:2467], now have 1 active actors on pipe
2025-10-15T10:54:22.272587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400142459848126:2534], now have 1 active actors on pipe
2025-10-15T10:54:22.272691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:22.272719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:22.272778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:22.272793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:22.272903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67257b95-51818ee1-e8dec6da-af296f5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:22.272938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.272957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.272968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:22.273009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.273056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:22.273128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:22.273190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:22.273593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:22.273612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:22.273668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.273679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.273715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:22.274998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:22.275016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:22.276159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:22.276187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:22.276265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:22.276685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 46 sessionId: src_id|67257b95-51818ee1-e8dec6da-af296f5d_0
2025-10-15T10:54:22.279591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a788a454-64b0367d-c7a662d4-185e270a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|67257b95-51818ee1-e8dec6da-af296f5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:22.322470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.322498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.322510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.381506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67257b95-51818ee1-e8dec6da-af296f5d_0] Write session: try to update token
2025-10-15T10:54:22.381571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67257b95-51818ee1-e8dec6da-af296f5d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:22.526716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.526745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.526757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.526814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:22.526829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:22.526841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:22.526852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:22.526885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.526908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.526932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.527135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:22.527161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:22.528331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:22.531891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:22.531937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:22.531976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:22.738291Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:22.780037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:22.780067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:22.780111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400145259554131:2571]
2025-10-15T10:54:22.785391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:22.789157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:22.789295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400142459848126:2534]
2025-10-15T10:54:22.790078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: src_id|67257b95-51818ee1-e8dec6da-af296f5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:22.832266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:22.851378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:22.851409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:22.894910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400142459848185:2534]
2025-10-15T10:54:22.895093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:22.902032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:22.907701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:22.908615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:22.908636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:22.908685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:22.908972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:22.909274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400145259554233:2581]
2025-10-15T10:54:22.912606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 7 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|67257b95-51818ee1-e8dec6da-af296f5d_0
2025-10-15T10:54:22.913749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: src_id|67257b95-51818ee1-e8dec6da-af296f5d_0 is DEAD
2025-10-15T10:54:22.917561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:22.919828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67257b95-51818ee1-e8dec6da-af296f5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:54:22.919870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67257b95-51818ee1-e8dec6da-af296f5d_0] Write session will restart in 0.006191s
2025-10-15T10:54:22.919988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67257b95-51818ee1-e8dec6da-af296f5d_0] Write session: Do CDS request
2025-10-15T10:54:22.920018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67257b95-51818ee1-e8dec6da-af296f5d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:22.919326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:22.919644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:22.921163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:22.921538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:22.921547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:22.921553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:22.921560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:22.921568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:22.921574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:22.921581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:22.921588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:22.921594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:22.921600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:22.921606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:22.921612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.921617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.921624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.921689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:22.921797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:22.921856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:22.922251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:22.922301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:22.922345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:22.922391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:22.923062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:22.923119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:22.923173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:22.923238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:22.923292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.923361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.923407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.923457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:22.923550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:22.923611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:22.923670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:22.923718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:22.924020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:22.924075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:22.924133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:22.924179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:22.924253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:22.924304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:22.924374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:22.924423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:22.924495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:22.924540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:22.924590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:22.924632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:22.924691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:22.924734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:22.924783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:22.924827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:22.924897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:22.924949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.925005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:22.925049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.925101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:22.925144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.925210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:22.925717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:22.961961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:22.961997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-15T10:54:22.968116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67257b95-51818ee1-e8dec6da-af296f5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:22.978619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:22.978798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:22.978824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:22.978835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:22.985428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-15T10:54:22.985558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:22.985571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:22.985582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:22.985599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400142459848202:2662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:22.993242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400142459848202:2662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:22.993842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:23.003223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400142459848202:2662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:23.033306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:23.033345Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:23.033364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:23.033386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:23.033413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 7 [2:7561400145259554233:2581]
2025-10-15T10:54:23.033460Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:23.033521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:23.033536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.033548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.033557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.033607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:23.033629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:23.033670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:23.037740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400142459848202:2662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:23.037780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400142459848202:2662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:23.037800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400142459848202:2662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:23.037838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:23.051839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:23.051876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:23.051888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:23.051899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:23.052257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:23.052274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:23.052406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:23.052563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:23.052768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:23.052844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.052857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.052867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.052915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:23.052994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:23.053172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:23.053188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:23.053313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.053330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:23.067563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 7, pipe: [1:7561400142459848185:2534]
2025-10-15T10:54:23.067668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 7
2025-10-15T10:54:23.067750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 7
2025-10-15T10:54:23.079782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 46 sessionId: src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0
2025-10-15T10:54:23.063733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:23.063755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:23.063766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:23.063791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:23.066900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400142459848185:2534], now have 1 active actors on pipe
2025-10-15T10:54:23.083633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67257b95-51818ee1-e8dec6da-af296f5d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:23.066931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400142459848168:2467], now have 1 active actors on pipe
2025-10-15T10:54:23.066951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400146754815523:2662], now have 1 active actors on pipe
2025-10-15T10:54:23.071684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:23.071722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:23.071821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:23.071836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:23.071939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:23.071973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.071991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.072001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:23.072042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.072085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:23.072154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:23.072219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:23.072610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:23.072629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:23.072669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.072681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.072717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:23.073020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:23.073033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:23.076062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:23.076090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:23.076185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:23.127089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0] Write session: try to update token
2025-10-15T10:54:23.127146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:23.132460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.132485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.132498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.219634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:23.219671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:23.219684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:23.219693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:23.219727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.219751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.219775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.219987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:23.220038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:23.221057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:23.223592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:23.223628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:23.223658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:23.434809Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:23.434997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:23.476422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:23.476451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:23.476494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400145259554223:2581]
2025-10-15T10:54:23.478131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:23.492985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:23.493014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:23.515999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400142459848185:2534]
2025-10-15T10:54:23.516082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 8 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0
2025-10-15T10:54:23.516430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0 is DEAD
2025-10-15T10:54:23.532225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:54:23.532270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0] Write session will restart in 0.006017s
2025-10-15T10:54:23.532383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0] Write session: Do CDS request
2025-10-15T10:54:23.532413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:23.557187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:23.562725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:23.605544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:23.605767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:23.605780Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-15T10:54:23.614628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:23.614749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:23.614763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:23.614772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:23.616937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-15T10:54:23.617040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:23.617048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:23.617057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:23.617073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400146754815575:2671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:23.621539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400146754815579:2534]
2025-10-15T10:54:23.621722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:23.621787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400146754815575:2671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:23.640973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400146754815579:2534]
2025-10-15T10:54:23.641073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: ERROR TabletId: 72075186224037892 Generation: 0, pipe: [0:0:0]
2025-10-15T10:54:23.640660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:23.652563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400146754815575:2671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:23.653063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:23.653896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:23.653914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:23.653953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:23.654181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:23.654344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400149554521632:2590]
2025-10-15T10:54:23.656484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:23.657634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:23.659028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:23.660593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:23.660980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:23.660988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:23.660995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:23.661001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:23.661007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:23.661015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:23.661021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:23.661027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:23.661034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:23.661043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:23.661049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:23.661056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:23.661063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:23.661069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:23.661120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:23.661243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:23.661293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:23.661340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:23.661387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:23.661433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:23.661479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:23.661522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:23.661566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:23.661610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:23.661675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:23.661724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:23.661768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:23.661817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:23.661864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:23.661933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:23.661992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:23.663728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:23.669253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400146754815575:2671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:23.669297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400146754815575:2671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:23.669315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400146754815575:2671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:23.669348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:23.671800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:23.671892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:23.671943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:23.672002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:23.672054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:23.672121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:23.672169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:23.672226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:23.672271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:23.672323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:23.672366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:23.672420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:23.672465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:23.672516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:23.672561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:23.672614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:23.672660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:23.672712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:23.672756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:23.672810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:23.672861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:23.672914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:23.672963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:23.673016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:23.673523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:23.704791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:23.721718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:23.721760Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:23.721777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:23.721794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:23.721816Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 8 [2:7561400149554521632:2590]
2025-10-15T10:54:23.721863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:23.721922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:23.721936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.721947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.721956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.721999Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:23.722018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:23.722039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:23.723789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:23.723824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:23.723835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:23.723845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:23.724135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:23.724160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:23.724292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:23.724463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:23.724712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:23.724789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400146754815616:2671], now have 1 active actors on pipe
2025-10-15T10:54:23.724814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400146754815579:2534], now have 1 active actors on pipe
2025-10-15T10:54:23.724836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400146754815562:2467], now have 1 active actors on pipe
2025-10-15T10:54:23.724860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:23.724876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:23.724888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:23.724926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:23.724993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:23.725046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:23.725061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:23.725072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:23.725159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:23.725174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:23.725316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:23.725335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:23.725369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561400146754815579:2534] destroyed
2025-10-15T10:54:23.725402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:23.725428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:23.725546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c466c063-1da51867-26b6b6a0-81668dc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:23.725574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.725589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.725599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:23.725630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.725686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:23.725786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:23.726146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:23.728193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:23.728225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:23.728308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:23.724633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 8
2025-10-15T10:54:23.724744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 8
2025-10-15T10:54:23.728917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 46 sessionId: src_id|c466c063-1da51867-26b6b6a0-81668dc6_0
2025-10-15T10:54:23.734787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3221a3b-9c658aac-5335424f-db6ced6a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c466c063-1da51867-26b6b6a0-81668dc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:23.741253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400146754815627:2534], now have 1 active actors on pipe
2025-10-15T10:54:23.741713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:23.741735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:23.741810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:23.742154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:23.742169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:23.742207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:23.742220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:23.742249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:23.742568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:23.742585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:23.740438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400146754815627:2534]
2025-10-15T10:54:23.740620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:23.741482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 8, pipe: [1:7561400146754815627:2534]
2025-10-15T10:54:23.823510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.823541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.823555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.829307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c466c063-1da51867-26b6b6a0-81668dc6_0] Write session: try to update token
2025-10-15T10:54:23.829360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c466c063-1da51867-26b6b6a0-81668dc6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:24.084247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:24.084278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:24.084291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:24.084302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:24.084339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:24.084366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:24.084392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:24.084511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:24.084543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:24.084559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.084572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:24.084572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.084583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.084696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:24.084716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:24.085717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:24.133038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: src_id|c466c063-1da51867-26b6b6a0-81668dc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:24.169084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:24.315925Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:24.351941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:24.351983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:24.352047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:24.352062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:24.352103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400149554521618:2590]
2025-10-15T10:54:24.356828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:24.356906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:24.356929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:24.359920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400146754815627:2534]
2025-10-15T10:54:24.360003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:24.360107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:24.368838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 9 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c466c063-1da51867-26b6b6a0-81668dc6_0
2025-10-15T10:54:24.375654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c466c063-1da51867-26b6b6a0-81668dc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:54:24.375734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c466c063-1da51867-26b6b6a0-81668dc6_0] Write session will restart in 0.008031s
2025-10-15T10:54:24.375927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c466c063-1da51867-26b6b6a0-81668dc6_0] Write session: Do CDS request
2025-10-15T10:54:24.375979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c466c063-1da51867-26b6b6a0-81668dc6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:24.374934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: src_id|c466c063-1da51867-26b6b6a0-81668dc6_0 is DEAD
2025-10-15T10:54:24.395571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c466c063-1da51867-26b6b6a0-81668dc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:24.397838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:24.397867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-15T10:54:24.399783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:24.399878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:24.399901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:24.399908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:24.400933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-15T10:54:24.401002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:24.401008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:24.401013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:24.401023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400151049782962:2681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:24.402681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400151049782962:2681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:24.426422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400151049782962:2681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:24.436642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:24.440745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400151049782962:2681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:24.440784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400151049782962:2681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:24.440797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400151049782962:2681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:24.440828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:24.443586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:24.444876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:24.444897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:24.444938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:24.445174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:24.445358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400153849489023:2601]
2025-10-15T10:54:24.447492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:24.448687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:24.448870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:24.449945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:24.450232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:24.450240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:24.450246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:24.450252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:24.450257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:24.450262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:24.450269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:24.450274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:24.450280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:24.450286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:24.450292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:24.450298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:24.450304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:24.450309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:24.450346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:24.450434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:24.450475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:24.450517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:24.450554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:24.450591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:24.450627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:24.450663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:24.450699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:24.450734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:24.450768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:24.450802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:24.450839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:24.450873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:24.450907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:24.450959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:24.451004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:24.451046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:24.451086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:24.451126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:24.451162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:24.451204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:24.451239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:24.451279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:24.451313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:24.451372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:24.451411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:24.451454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:24.451487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:24.452369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:24.452421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:24.452467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:24.452503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:24.452557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:24.452596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:24.452640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:24.452672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:24.452713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:24.452747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:24.452783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:24.452818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:24.452858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:24.453233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:24.464365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400151049783011:2534]
2025-10-15T10:54:24.464535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:24.486507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:24.512672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:24.512708Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:24.512723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:24.512739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:24.512760Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 9 [2:7561400153849489023:2601]
2025-10-15T10:54:24.512804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:24.512849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:24.512863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.512873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.512883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.512924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:24.512944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:24.512962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:24.514347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:24.514359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:24.514368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:24.514378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:24.515813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 9, pipe: [1:7561400151049783011:2534]
2025-10-15T10:54:24.515887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 9
2025-10-15T10:54:24.516855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 9
2025-10-15T10:54:24.514611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:24.514631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:24.514747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:24.514900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:24.515087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:24.515149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:24.515160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:24.515170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:24.515657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:24.515673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:24.515685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:24.517255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:24.517336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:24.517502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:24.517517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:24.517559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400151049783011:2534], now have 1 active actors on pipe
2025-10-15T10:54:24.517578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400151049783005:2681], now have 1 active actors on pipe
2025-10-15T10:54:24.517609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400151049782949:2467], now have 1 active actors on pipe
2025-10-15T10:54:24.517699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:24.517718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:24.517764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:24.517775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:24.517884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:24.517913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:24.517980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6afecd0f-37888075-e28dade2-90e51e93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:24.518006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.518020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.518029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:24.518059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.518094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:24.518217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:24.518268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:24.518566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:24.518578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:24.518602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:24.518614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:24.518636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:24.522868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 46 sessionId: src_id|6afecd0f-37888075-e28dade2-90e51e93_0
2025-10-15T10:54:24.519326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:24.519367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:24.519377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:24.522023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:24.522058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:24.522160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:24.527523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c466c063-1da51867-26b6b6a0-81668dc6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6afecd0f-37888075-e28dade2-90e51e93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:24.597835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6afecd0f-37888075-e28dade2-90e51e93_0] Write session: try to update token
2025-10-15T10:54:24.597886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6afecd0f-37888075-e28dade2-90e51e93_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:24.611770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.611800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.611814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.888425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:24.888461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:24.888470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:24.888478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:24.888504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:24.888522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:24.888538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:24.888677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.888689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.888697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.888808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:24.888824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:24.889855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:24.891464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:24.891504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:24.891532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:24.918588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: src_id|6afecd0f-37888075-e28dade2-90e51e93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:24.958086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.076146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:25.125561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.125594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.125645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:25.125654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:25.125697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:25.125762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:25.125768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:25.125775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:25.125789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:25.125802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400153849489017:2601]
2025-10-15T10:54:25.127746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:25.127798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:25.127824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:25.127851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:25.127875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:25.127893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:25.128031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:25.128045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:25.131054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:25.131177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400151049783011:2534]
2025-10-15T10:54:25.131238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.142898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 10 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6afecd0f-37888075-e28dade2-90e51e93_0
2025-10-15T10:54:25.143176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: src_id|6afecd0f-37888075-e28dade2-90e51e93_0 is DEAD
2025-10-15T10:54:25.147836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afecd0f-37888075-e28dade2-90e51e93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:54:25.147874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afecd0f-37888075-e28dade2-90e51e93_0] Write session will restart in 0.005001s
2025-10-15T10:54:25.147968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afecd0f-37888075-e28dade2-90e51e93_0] Write session: Do CDS request
2025-10-15T10:54:25.147992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afecd0f-37888075-e28dade2-90e51e93_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:25.181724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6afecd0f-37888075-e28dade2-90e51e93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:25.201902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:25.201935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 11
2025-10-15T10:54:25.207904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:25.208053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 11 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:25.208069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=11 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:25.208077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:25.209755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 11 sessionId:  describe result for acl check
2025-10-15T10:54:25.209869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:25.209878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:25.209887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:25.209902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400155344750383:2693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:25.212408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400155344750383:2693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:25.221434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400155344750383:2693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:25.225830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:25.229458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:25.230640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400155344750383:2693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:25.230678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400155344750383:2693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:25.230695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400155344750383:2693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:25.230725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 11 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:25.231179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400155344750414:2534]
2025-10-15T10:54:25.231374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:25.230411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:25.230431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:25.230470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:25.230680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:25.230837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400158144456404:2609]
2025-10-15T10:54:25.232960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:25.234032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:25.234229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:25.235481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:25.235770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:25.235777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:25.235783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:25.235788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:25.235794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:25.235801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:25.235806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:25.235812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:25.235817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:25.235825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:25.235832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:25.235838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.235844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.235850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.235888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:25.236202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:25.236258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:25.236300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:25.236339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:25.236395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:25.236432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:25.236468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:25.236510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:25.236549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:25.236585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:25.236623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.236658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.236696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.236794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:25.236844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:25.236891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:25.236937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:25.236978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:25.237026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:25.237065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:25.237109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:25.237154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:25.237266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:25.237308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:25.237352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:25.237392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:25.237436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:25.237472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:25.237514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:25.237557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:25.237600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:25.237634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:25.237692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:25.237736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:25.237780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:25.237971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.238024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.238069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.238115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.238153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.238200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.238617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:25.263739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:25.297122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:25.297160Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:25.297173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:25.297191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:25.297212Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 10 [2:7561400158144456404:2609]
2025-10-15T10:54:25.297257Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:25.297309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:25.297322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.297333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.297342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.297381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:25.297401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:25.297420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:25.298532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.298547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.298558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.298568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:25.298802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:25.298816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.298935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.299092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.299298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:25.301392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.301415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.301426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.301462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:25.301540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:25.301714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:25.301731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:25.301777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400155344750358:2467], now have 1 active actors on pipe
2025-10-15T10:54:25.301800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400155344750414:2534], now have 1 active actors on pipe
2025-10-15T10:54:25.301819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400155344750413:2693], now have 1 active actors on pipe
2025-10-15T10:54:25.301927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.301945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:25.302353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:25.302370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:25.302379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:25.302413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:25.303654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 10
2025-10-15T10:54:25.303793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 10, pipe: [1:7561400155344750414:2534]
2025-10-15T10:54:25.303852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 10
2025-10-15T10:54:25.309008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.309046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.309106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.309119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.309195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:25.309225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.309244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.309254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:25.309290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.309330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:25.309393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:25.309446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:25.309805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:25.309821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:25.309854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.309867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.309899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:25.310504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:25.310519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:25.319213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.319253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.319332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:25.321285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 11 partition: 0 MaxSeqNo: 46 sessionId: src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0
2025-10-15T10:54:25.323882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afecd0f-37888075-e28dade2-90e51e93_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:25.372353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0] Write session: try to update token
2025-10-15T10:54:25.372409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:25.486842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.486885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.486909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.487074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:25.487107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:25.487135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:25.487150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:25.487205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.487250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.487291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.488005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:25.488051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:25.488098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:25.488127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:25.508238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:25.508274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:25.509205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:25.670484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId: src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.694237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.768268Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:25.769692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:25.769708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:25.769747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400158144456398:2609]
2025-10-15T10:54:25.769867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:25.769901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:25.769931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.770852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:25.769933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:25.769952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.771171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:25.771210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:25.771221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400155344750414:2534]
2025-10-15T10:54:25.782519Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:25.782570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:25.825381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 11 reason: error at write: Disconnected sessionId: src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0
2025-10-15T10:54:25.825667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 11 sessionId: src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0 is DEAD
2025-10-15T10:54:25.832323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:25.832353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0] Write session will restart in 0.005566s
2025-10-15T10:54:25.831613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:25.832445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0] Write session: Do CDS request
2025-10-15T10:54:25.832469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:25.834375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:25.835183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:25.835200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:25.835244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:25.835534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:25.835697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400158144456493:2615]
2025-10-15T10:54:25.838111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:25.839288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:25.839511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:25.840712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:25.841000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:25.841007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:25.841012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:25.841018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:25.841023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:25.841028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:25.841034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:25.841040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:25.841046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:25.841051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:25.841057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:25.841063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.841069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.841074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.841112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:25.841197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:25.841233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:25.841266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:25.841300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:25.841335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:25.841369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:25.841402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:25.841435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:25.841469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:25.841502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:25.841534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.841568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.842191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.842236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:25.842294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:25.842345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:25.842390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:25.842426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:25.842468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:25.842501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:25.842541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:25.842575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:25.842613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:25.842646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:25.842684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:25.842716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:25.842753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:25.842785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:25.842824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:25.842857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:25.842895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:25.842927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:25.842981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:25.843030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:25.843070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:25.843117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.843156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.843190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.843238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.843268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.843305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.843722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:25.852466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:25.853468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:25.853501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 12
2025-10-15T10:54:25.859737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:25.859875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 12 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:25.859895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=12 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:25.859905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:25.861012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 12 sessionId:  describe result for acl check
2025-10-15T10:54:25.861111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:25.861127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:25.861135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:25.861150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400155344750495:2702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:25.863545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400155344750495:2702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:25.871600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400155344750506:2534]
2025-10-15T10:54:25.871756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:25.876159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:25.879585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400155344750495:2702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:25.893464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400155344750495:2702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:25.893514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400155344750495:2702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:25.893534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400155344750495:2702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:25.893566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 12 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:25.893730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:25.893767Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:25.893782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:25.893798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:25.893818Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 11 [2:7561400158144456493:2615]
2025-10-15T10:54:25.893863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:25.893911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:25.893924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.893934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.893944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.893983Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:25.894002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:25.894019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:25.896221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.896240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.896252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.896261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:25.896506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:25.896521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:25.896643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:25.896812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:25.897019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:25.897079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:25.897091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:25.897102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:25.897141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:25.897209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:25.897392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:25.897409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:25.897513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:25.897532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:25.898685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:25.898701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:25.898712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:25.898734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:25.899799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400155344750506:2534], now have 1 active actors on pipe
2025-10-15T10:54:25.899829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400155344750525:2702], now have 1 active actors on pipe
2025-10-15T10:54:25.899848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400155344750452:2467], now have 1 active actors on pipe
2025-10-15T10:54:25.899990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 11, pipe: [1:7561400155344750506:2534]
2025-10-15T10:54:25.900090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 11
2025-10-15T10:54:25.900165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 11
2025-10-15T10:54:25.901952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.901998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.902059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.902072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.902175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:25.902209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.902227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.902237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:25.902277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.902323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:25.902394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:25.902450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:25.902823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:25.902843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:25.902874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:25.902888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:25.902935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:25.903362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:25.903376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:25.905769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.905814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.905907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:25.906428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 12 partition: 0 MaxSeqNo: 46 sessionId: src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0
2025-10-15T10:54:25.907934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b054bfc-a9101e9d-e89c66a6-647ea404_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:25.957020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0] Write session: try to update token
2025-10-15T10:54:25.957074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:25.995563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.995596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.995609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.119716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:26.119741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:26.119753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:26.119762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:26.119792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:26.119813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:26.119834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:26.119991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.120003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.120014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.120108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:26.120127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:26.121614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:26.123526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:26.123576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:26.123605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:26.155146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId: src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.265945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.265927Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:26.289287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:26.289308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:26.289351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400158144456487:2615]
2025-10-15T10:54:26.290787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:26.292422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400155344750506:2534]
2025-10-15T10:54:26.292508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:26.292519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:26.300573Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:26.362493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 12 reason: error at write: Disconnected sessionId: src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0
2025-10-15T10:54:26.362783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 12 sessionId: src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0 is DEAD
2025-10-15T10:54:26.364157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:26.364239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0] Write session will restart in 0.008431s
2025-10-15T10:54:26.364500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0] Write session: Do CDS request
2025-10-15T10:54:26.364551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:26.365875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:26.378497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:26.394259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400159639717855:2534]
2025-10-15T10:54:26.394420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:26.395893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:26.395917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 13
2025-10-15T10:54:26.405244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:26.405388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 13 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:26.405403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=13 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:26.405412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:26.408931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 13 sessionId:  describe result for acl check
2025-10-15T10:54:26.409050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:26.409062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:26.409072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:26.409089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400159639717858:2712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:26.412433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400159639717858:2712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:26.420407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400159639717855:2534]
2025-10-15T10:54:26.420496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: ERROR TabletId: 72075186224037892 Generation: 0, pipe: [0:0:0]
2025-10-15T10:54:26.429876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400159639717858:2712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:26.462566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400159639717858:2712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:26.462626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400159639717858:2712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:26.462645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400159639717858:2712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:26.462677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 13 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:26.465773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:26.475933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:26.476764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:26.476780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:26.476823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:26.477067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:26.477219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400162439423888:2623]
2025-10-15T10:54:26.480055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:26.481158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:26.481377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:26.482528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:26.482850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:26.482858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:26.482864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:26.482869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:26.482874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:26.482879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:26.482884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:26.482890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:26.482895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:26.482902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:26.482909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:26.482915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:26.482921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:26.482928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:26.482969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:26.483054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:26.483090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:26.483129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:26.483167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:26.483201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:26.483239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:26.483273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:26.483309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:26.483365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:26.483404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:26.483441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:26.483477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:26.483514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:26.483545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:26.483601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:26.483649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:26.483696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:26.483735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:26.483778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:26.483816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:26.483859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:26.483896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:26.483937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:26.483975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:26.484019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:26.484057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:26.484101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:26.484138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:26.484182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:26.484221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:26.484263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:26.484302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:26.484346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:26.484384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:26.484430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:26.484464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:26.484508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:26.484583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:26.484627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:26.484661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:26.484704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:26.485108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:26.504921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:26.523191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400159639717908:2534]
2025-10-15T10:54:26.523419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:26.539257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:26.539301Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:26.539318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:26.539336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:26.539371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 12 [2:7561400162439423888:2623]
2025-10-15T10:54:26.547500Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:26.547567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:26.547581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.547593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.547602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.547651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:26.547672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:26.547690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:26.556898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 12
2025-10-15T10:54:26.557035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 12, pipe: [1:7561400159639717908:2534]
2025-10-15T10:54:26.557094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 12
2025-10-15T10:54:26.555742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:26.555767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:26.555780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:26.555790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:26.556047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:26.556062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:26.556197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:26.556362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:26.556609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:26.556685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400159639717848:2467], now have 1 active actors on pipe
2025-10-15T10:54:26.556704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400159639717908:2534], now have 1 active actors on pipe
2025-10-15T10:54:26.556725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400159639717855:2534], now have 1 active actors on pipe
2025-10-15T10:54:26.556744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400159639717901:2712], now have 1 active actors on pipe
2025-10-15T10:54:26.556766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:26.556779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:26.556790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:26.556831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:26.556892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:26.557063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:26.557078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:26.557108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:26.557120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:26.557130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:26.557184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:26.557212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:26.557217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:26.559021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.559050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.559094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561400159639717855:2534] destroyed
2025-10-15T10:54:26.559125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.559137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.559214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:26.559243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.559257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.559268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:26.559300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.559334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:26.559415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:26.559468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:26.559782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:26.559795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:26.559820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:26.559831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:26.559858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:26.559924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:26.559934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:26.562282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 13 partition: 0 MaxSeqNo: 46 sessionId: src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0
2025-10-15T10:54:26.561831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.561856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.561929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:26.567551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55ffcaa6-178b03de-edd33d8-dcf88701_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:26.647900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.647925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.647935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.739695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0] Write session: try to update token
2025-10-15T10:54:26.739749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:26.864226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.864250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.864261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.864312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:26.864323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:26.864335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:26.864345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:26.864373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:26.864395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:26.864416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:26.864589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:26.864606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:26.865675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:26.867829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:26.867861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:26.867889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:27.013928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId: src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.064809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.221889Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:27.235165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.235203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.235266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:27.235278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:27.235313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400162439423874:2623]
2025-10-15T10:54:27.235636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:27.240483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:27.240610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400159639717908:2534]
2025-10-15T10:54:27.240677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:27.240688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:27.247139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 13 reason: error at write: Disconnected sessionId: src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0
2025-10-15T10:54:27.248250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:27.248283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0] Write session will restart in 0.006119s
2025-10-15T10:54:27.248361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0] Write session: Do CDS request
2025-10-15T10:54:27.248390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:27.248942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 13 sessionId: src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0 is DEAD
2025-10-15T10:54:27.265148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:27.270792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:27.270821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:27.295702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:27.295732Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 14
2025-10-15T10:54:27.310048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:27.310203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 14 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:27.310217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=14 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:27.310226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:27.334360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 14 sessionId:  describe result for acl check
2025-10-15T10:54:27.334470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:27.334479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:27.334489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:27.334503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400163934685281:2718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:27.338063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400163934685281:2718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:27.344293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400163934685289:2534]
2025-10-15T10:54:27.344494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:27.346854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:27.354101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:27.354784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:27.354799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:27.354832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:27.355043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:27.355190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400166734391280:2632]
2025-10-15T10:54:27.357173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:27.359475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:27.359660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:27.360719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:27.360991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:27.360997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:27.361003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:27.361008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:27.361013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:27.361017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:27.361023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:27.361028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:27.361033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:27.361038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:27.361044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:27.361050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:27.361055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:27.361060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:27.361095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:27.361180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:27.361218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:27.361255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:27.361293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:27.361332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:27.361364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:27.361395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:27.361423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:27.361454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:27.361486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:27.361516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:27.361548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:27.361578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:27.361608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:27.361658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:27.361699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:27.361756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:27.361789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:27.361827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:27.361857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:27.361894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:27.361925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:27.361963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:27.361994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:27.362031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:27.362064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:27.362100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:27.362128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:27.362164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:27.362195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:27.362230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:27.362260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:27.362296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:27.362326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:27.362362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:27.362391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:27.362429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:27.362461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:27.362496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:27.362525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:27.362559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:27.362898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:27.380253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400163934685281:2718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:27.398154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400163934685281:2718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:27.398205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400163934685281:2718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:27.398222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400163934685281:2718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:27.398260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 14 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:27.396452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:27.408691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:27.408733Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:27.408749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:27.408766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:27.408790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 13 [2:7561400166734391280:2632]
2025-10-15T10:54:27.408833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:27.408889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:27.408902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.408913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.408924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.408966Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:27.408987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:27.409007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:27.410183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:27.410197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:27.410212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:27.410222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:27.410466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:27.410483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:27.410617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:27.410789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:27.410990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:27.411052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:27.411064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:27.411078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:27.411115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:27.411180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:27.411337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:27.411486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:27.411498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:27.411509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:27.412840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 13
2025-10-15T10:54:27.412948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 13, pipe: [1:7561400163934685289:2534]
2025-10-15T10:54:27.413010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 13
2025-10-15T10:54:27.414202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:27.414383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400163934685318:2718], now have 1 active actors on pipe
2025-10-15T10:54:27.414404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400163934685289:2534], now have 1 active actors on pipe
2025-10-15T10:54:27.414424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400163934685244:2467], now have 1 active actors on pipe
2025-10-15T10:54:27.414464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.414483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.414557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.414570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.414627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:27.414657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:27.414762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:27.414809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.414827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.414836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:27.414865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.414903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:27.415017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:27.415095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:27.415462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:27.415478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:27.415507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:27.415519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:27.415539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:27.415737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:27.415757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:27.415767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:27.418461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.418496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.418621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:27.419458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 14 partition: 0 MaxSeqNo: 46 sessionId: src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0
2025-10-15T10:54:27.423119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62fcb43-f283e064-c9208fc5-140d24c6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:27.486301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0] Write session: try to update token
2025-10-15T10:54:27.486352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:27.644161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.644187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.644198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.644301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:27.644315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:27.644325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:27.644335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:27.644364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:27.644387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:27.644408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:27.646941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:27.646977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:27.647003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:27.691888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:27.691922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:27.692948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:27.784141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId: src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.827776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.998035Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:28.041791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:28.041822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:28.041858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:28.041991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.042015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.042059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:28.042070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:28.042079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:28.042106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:28.042128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400166734391273:2632]
2025-10-15T10:54:28.046227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:28.046265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:28.043124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:28.043220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:28.043268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:28.043328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:28.043379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:28.043405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:28.051329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400163934685289:2534]
2025-10-15T10:54:28.051424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:28.058924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 14 reason: error at write: Disconnected sessionId: src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0
2025-10-15T10:54:28.063274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:28.063373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0] Write session will restart in 0.007763s
2025-10-15T10:54:28.063502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0] Write session: Do CDS request
2025-10-15T10:54:28.063539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:28.060070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:28.060110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:28.071911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 14 sessionId: src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0 is DEAD
2025-10-15T10:54:28.090289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:28.087869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:28.087900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 15
2025-10-15T10:54:28.092137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:28.092260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 15 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:28.092276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=15 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:28.092286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:28.094186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 15 sessionId:  describe result for acl check
2025-10-15T10:54:28.094280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:28.094290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:28.094299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:28.094316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400168229652664:2727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:28.096715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400168229652664:2727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:28.109146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400168229652664:2727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:28.138457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:28.140864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:28.141734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:28.141768Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:28.141816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:28.142075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:28.142299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400171029358674:2644]
2025-10-15T10:54:28.144538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:28.146089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:28.146301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:28.147715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:28.148060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:28.148069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:28.148075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:28.148081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:28.148089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:28.148095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:28.148101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:28.148108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:28.148115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:28.148123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:28.148129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:28.148136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.148143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.148150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.148200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:28.148316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:28.148367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:28.148419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:28.148464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:28.148512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:28.148557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:28.148605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:28.148649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:28.148695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:28.148741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:28.148789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.148831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.148877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.148923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:28.148991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:28.149054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:28.149110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:28.149161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:28.149212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:28.149255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:28.149306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:28.149353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:28.149408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:28.149452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:28.149506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:28.149555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:28.149610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:28.149655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:28.149705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:28.149766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:28.149816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:28.149859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:28.149914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:28.149959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:28.150010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:28.150053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.150102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.150141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.150192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.150236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.150290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.150795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:28.156129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400168229652709:2534]
2025-10-15T10:54:28.156287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:28.167462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400168229652664:2727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:28.167502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400168229652664:2727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:28.167520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400168229652664:2727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:28.167550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 15 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:28.184649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:28.204226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:28.204275Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:28.204294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:28.204314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:28.204340Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 14 [2:7561400171029358674:2644]
2025-10-15T10:54:28.204396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:28.204459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:28.204475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.204490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.204517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.204567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:28.204591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:28.204613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:28.230664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.230690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.230702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.230713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:28.230974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:28.230990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.231122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.231281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.232978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:28.233069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400168229652714:2727], now have 1 active actors on pipe
2025-10-15T10:54:28.233091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400168229652652:2467], now have 1 active actors on pipe
2025-10-15T10:54:28.233109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400168229652709:2534], now have 1 active actors on pipe
2025-10-15T10:54:28.233132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.233145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.233158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.233192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:28.233264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:28.233442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:28.233457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:28.233585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.233604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:28.235745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 14
2025-10-15T10:54:28.235852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 14
2025-10-15T10:54:28.235946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 14, pipe: [1:7561400168229652709:2534]
2025-10-15T10:54:28.234079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:28.234096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:28.234107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:28.234130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:28.237624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.237653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.237769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.237783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.237856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27400d0b-7bb80288-f2db6345-87d57571_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:28.237970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.237987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.237997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:28.238032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.238072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:28.238135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:28.238208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:28.238590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:28.238608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:28.238640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.238654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.238690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:28.238943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:28.238957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:28.239488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.239508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.239565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:28.240163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 15 partition: 0 MaxSeqNo: 46 sessionId: src_id|27400d0b-7bb80288-f2db6345-87d57571_0
2025-10-15T10:54:28.241323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796d57b9-bba88ab6-38cfc1a9-a35761d2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|27400d0b-7bb80288-f2db6345-87d57571_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:28.312066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27400d0b-7bb80288-f2db6345-87d57571_0] Write session: try to update token
2025-10-15T10:54:28.312130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27400d0b-7bb80288-f2db6345-87d57571_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:28.311464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.311497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.311507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.467746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:28.467791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:28.467814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:28.467829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:28.467877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.467910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.467943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.468147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.468167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.468184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.468313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:28.468338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:28.468471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:28.468522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:28.468561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:28.468595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:28.496267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:28.615472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId: src_id|27400d0b-7bb80288-f2db6345-87d57571_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.661031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.675109Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:28.688477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.688519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.688599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:28.688615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:28.688656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400171029358668:2644]
2025-10-15T10:54:28.691860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:28.691935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:28.691982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:28.695613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:28.695656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:28.715984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:28.716019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:28.734529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27400d0b-7bb80288-f2db6345-87d57571_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:28.734577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27400d0b-7bb80288-f2db6345-87d57571_0] Write session will restart in 0.006287s
2025-10-15T10:54:28.734674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27400d0b-7bb80288-f2db6345-87d57571_0] Write session: Do CDS request
2025-10-15T10:54:28.734708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27400d0b-7bb80288-f2db6345-87d57571_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:28.730942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:28.731082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 15 reason: error at write: Disconnected sessionId: src_id|27400d0b-7bb80288-f2db6345-87d57571_0
2025-10-15T10:54:28.731437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 15 sessionId: src_id|27400d0b-7bb80288-f2db6345-87d57571_0 is DEAD
2025-10-15T10:54:28.752089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27400d0b-7bb80288-f2db6345-87d57571_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:28.777131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400168229652709:2534]
2025-10-15T10:54:28.778051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:28.778066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 16
2025-10-15T10:54:28.784425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:28.784560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 16 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:28.784581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=16 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:28.784591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:28.785921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 16 sessionId:  describe result for acl check
2025-10-15T10:54:28.786028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:28.786038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:28.786047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:28.786061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400168229652786:2740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:28.788707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400168229652786:2740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:28.791238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:28.793967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:28.794775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:28.794791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:28.794835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:28.795115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:28.795281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400171029358780:2653]
2025-10-15T10:54:28.797350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:28.797323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400168229652786:2740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:28.803731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:28.804051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:28.805555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:28.805920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:28.805927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:28.805934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:28.805940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:28.805946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:28.805952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:28.805958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:28.805966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:28.805972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:28.805978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:28.805985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:28.805990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.805996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.806004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.806051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:28.806159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:28.806203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:28.806247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:28.806286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:28.806331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:28.806379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:28.806423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:28.806501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:28.806550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:28.806597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:28.806642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.806686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.806726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.806769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:28.806834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:28.806893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:28.806946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:28.806991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:28.807044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:28.807091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:28.807145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:28.807191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:28.807246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:28.807291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:28.807343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:28.815743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:28.815833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:28.815893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:28.815952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:28.816002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:28.816051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:28.816093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:28.816144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:28.816191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:28.816237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:28.816280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.816328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.816370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.816435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.816473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.816524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.817021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:28.818152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400168229652786:2740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:28.818195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400168229652786:2740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:28.818213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400168229652786:2740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:28.818245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 16 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:28.848242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:28.869394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:28.869459Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:28.869476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:28.869498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:28.869523Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 15 [2:7561400171029358780:2653]
2025-10-15T10:54:28.869576Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:28.869642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:28.869659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.869671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.869683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.869749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:28.869774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:28.869797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:28.879600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400168229652821:2534]
2025-10-15T10:54:28.879801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:28.905927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.905953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.905964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.905974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:28.906240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:28.906256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:28.906379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:28.906538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:28.906768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:28.906842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:28.906855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:28.906866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:28.906998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:28.907011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:28.907022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:28.908023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:28.908118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:28.908304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:28.908322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:28.908371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400168229652817:2740], now have 1 active actors on pipe
2025-10-15T10:54:28.908407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400168229652821:2534], now have 1 active actors on pipe
2025-10-15T10:54:28.908429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400168229652753:2467], now have 1 active actors on pipe
2025-10-15T10:54:28.908539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:28.908565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:28.908490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 15
2025-10-15T10:54:28.908604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 15, pipe: [1:7561400168229652821:2534]
2025-10-15T10:54:28.908674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 15
2025-10-15T10:54:28.908928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:28.909915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.909956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.910048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.910065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.910160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:28.910196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.910215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.910226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:28.910263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.910311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:28.910380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:28.910457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:28.910858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:28.910878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:28.910908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:28.910922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:28.910954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:28.912092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:28.912112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:28.922621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.922662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.922771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:28.923308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 16 partition: 0 MaxSeqNo: 46 sessionId: src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0
2025-10-15T10:54:28.927918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27400d0b-7bb80288-f2db6345-87d57571_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:28.969955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.969979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.969990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.006582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0] Write session: try to update token
2025-10-15T10:54:29.006645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:29.054079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:29.054505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:29.054523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:29.054535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:29.054570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:29.054594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:29.054615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:29.054712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:29.054755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:29.054781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:29.215257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:29.215292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:29.216318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:29.279450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId: src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:29.302146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:29.406084Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:29.407627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:29.407645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:29.407685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400171029358774:2653]
2025-10-15T10:54:29.407868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:29.407880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:29.407903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:29.412757Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:29.412786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:29.414344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:29.414397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:29.417140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400168229652821:2534]
2025-10-15T10:54:29.417225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:29.465588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:29.468364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:29.469072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:29.469090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:29.469125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:29.469366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:29.469536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400175324326158:2657]
2025-10-15T10:54:29.475407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 16 reason: error at write: Disconnected sessionId: src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0
2025-10-15T10:54:29.475685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 16 sessionId: src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0 is DEAD
2025-10-15T10:54:29.483620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:29.483673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0] Write session will restart in 0.006997s
2025-10-15T10:54:29.483788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0] Write session: Do CDS request
2025-10-15T10:54:29.483825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:29.484004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:29.485290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:29.485519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:29.486708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:29.486984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:29.486991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:29.486997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:29.487002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:29.487007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:29.487013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:29.487018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:29.487023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:29.487039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:29.487043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:29.487049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:29.487055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:29.487060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:29.487066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:29.487109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:29.487201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:29.487241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:29.487279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:29.487316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:29.487376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:29.487415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:29.487450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:29.487486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:29.487522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:29.487559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:29.487597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:29.487635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:29.487672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:29.487712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:29.487771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:29.487822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:29.487868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:29.487908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:29.487951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:29.487992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:29.488038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:29.488080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:29.488130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:29.488168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:29.488213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:29.488257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:29.488301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:29.488339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:29.488383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:29.488420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:29.488464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:29.488498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:29.488541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:29.488576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:29.488622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:29.488661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:29.488707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:29.488745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:29.488788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:29.488823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:29.488866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:29.489405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:29.500358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:29.500387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 17
2025-10-15T10:54:29.500550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:29.501008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:29.501144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 17 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:29.501169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=17 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:29.501179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:29.502454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 17 sessionId:  describe result for acl check
2025-10-15T10:54:29.502524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:29.502530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:29.502535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:29.502547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400172524620193:2748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:29.504769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400172524620193:2748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:29.512141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:29.517825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400172524620193:2748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:29.518431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400172524620213:2534]
2025-10-15T10:54:29.518617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:29.526285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400172524620193:2748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:29.526329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400172524620193:2748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:29.526350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400172524620193:2748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:29.526401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 17 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:29.525631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:29.525664Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:29.525678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:29.525694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:29.525714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 16 [2:7561400175324326158:2657]
2025-10-15T10:54:29.525773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:29.525822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:29.525834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.525844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.525853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.525893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:29.525913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:29.525931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:29.528259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:29.528279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:29.528291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:29.528301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:29.528526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:29.528540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:29.528661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:29.528827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:29.529035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:29.529095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400175324326153:2657]
2025-10-15T10:54:29.529107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400175324326153:2657]
2025-10-15T10:54:29.529119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400175324326153:2657]
2025-10-15T10:54:29.529152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:29.529214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:29.529368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:29.529381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:29.529820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:29.529835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:29.529845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:29.530298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 16, pipe: [1:7561400172524620213:2534]
2025-10-15T10:54:29.530396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 16
2025-10-15T10:54:29.530260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400175324326153:2657]
2025-10-15T10:54:29.530457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 16
2025-10-15T10:54:29.530287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:29.530337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400172524620213:2534], now have 1 active actors on pipe
2025-10-15T10:54:29.530357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400172524620158:2467], now have 1 active actors on pipe
2025-10-15T10:54:29.530374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400172524620222:2748], now have 1 active actors on pipe
2025-10-15T10:54:29.530595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:29.531411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:29.531447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:29.531521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:29.531533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:29.531605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:29.531632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.531648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.531657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:29.531690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.531728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:29.531783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:29.531831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:29.532194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:29.532211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:29.532240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400175324326153:2657]
2025-10-15T10:54:29.532251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400175324326153:2657]
2025-10-15T10:54:29.532272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:29.532784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:29.532801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:29.533562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:29.533585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:29.533645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:29.533992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 17 partition: 0 MaxSeqNo: 46 sessionId: src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0
2025-10-15T10:54:29.534836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb533e78-5b86c2a9-832fc53a-3e99e3f5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:29.606922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0] Write session: try to update token
2025-10-15T10:54:29.606968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:29.627529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.627568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.627581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.773475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:29.773507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:29.773521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:29.773529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:29.773560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400175324326153:2657]
2025-10-15T10:54:29.773584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400175324326153:2657]
2025-10-15T10:54:29.773605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400175324326153:2657]
2025-10-15T10:54:29.773766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.773778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.773789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.773829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:29.773846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:29.775216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:29.780108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:29.780145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:29.780170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:29.857531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId: src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:29.881050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:29.937264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:29.939312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:29.940214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:29.944734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:29.944761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:29.945589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400172524620213:2534]
2025-10-15T10:54:29.945649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:29.967775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:29.967810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:29.974995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 17 reason: error at write: Disconnected sessionId: src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0
2025-10-15T10:54:29.975233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 17 sessionId: src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0 is DEAD
2025-10-15T10:54:29.979825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:29.979859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0] Write session will restart in 0.006410s
2025-10-15T10:54:29.979943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0] Write session: Do CDS request
2025-10-15T10:54:29.983484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:30.000094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:30.000120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 18
2025-10-15T10:54:30.004766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:30.005637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:30.005765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 18 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:30.005777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=18 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:30.005785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:30.007138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 18 sessionId:  describe result for acl check
2025-10-15T10:54:30.007235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:30.007244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:30.007255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:30.007270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400176819587557:2753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:30.009499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400176819587557:2753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:30.025866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400176819587557:2753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:30.031003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:30.033281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:30.034089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:30.034108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:30.034150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:30.034389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:30.034550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400179619293555:2667]
2025-10-15T10:54:30.036594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:30.037478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:30.037665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:30.038798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:30.039108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:30.039116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:30.039122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:30.039129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:30.039135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:30.039142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:30.039148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:30.039155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:30.039161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:30.047482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400176819587600:2534]
2025-10-15T10:54:30.047650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:30.039167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:30.039175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:30.039181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.039188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.039194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.039237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:30.039331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:30.039407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:30.039450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:30.039490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:30.039531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:30.039570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:30.039610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:30.039648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:30.039686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:30.039722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:30.039763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.039805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.039842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.039919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:30.039979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:30.040030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:30.040075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:30.040118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:30.040175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:30.040215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:30.040266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:30.040307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:30.040355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:30.040396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:30.040441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:30.040481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:30.040525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:30.040566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:30.040615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:30.040658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:30.040707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:30.040749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:30.040797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:30.040835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:30.040881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:30.040917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.048660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.048732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.048796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.048841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.048899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.049415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:30.051048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400176819587557:2753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:30.051086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400176819587557:2753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:30.051102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400176819587557:2753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:30.051131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 18 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:30.090823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:30.110504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:30.110544Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:30.110560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:30.110579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:30.110602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 17 [2:7561400179619293555:2667]
2025-10-15T10:54:30.110664Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:30.110734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:30.110750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.110764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.110774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.110825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:30.110847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:30.110870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:30.113839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.115512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.115534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.115544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:30.115867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:30.115883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.116010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.116177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.116391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:30.116452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.116464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.116477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.116526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:30.116593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:30.116751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:30.116767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:30.116870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.116889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:30.120079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 17
2025-10-15T10:54:30.120181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 17, pipe: [1:7561400176819587600:2534]
2025-10-15T10:54:30.120244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 17
2025-10-15T10:54:30.117692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:30.117710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:30.117722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:30.117771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:30.118491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400176819587603:2753], now have 1 active actors on pipe
2025-10-15T10:54:30.118518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400176819587600:2534], now have 1 active actors on pipe
2025-10-15T10:54:30.118536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400172524620243:2467], now have 1 active actors on pipe
2025-10-15T10:54:30.120727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:30.120752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:30.120866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:30.120885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:30.120972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:30.120998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.121011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.121018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:30.121054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.121103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:30.121174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:30.121260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:30.121688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:30.121721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:30.121789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:30.121807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:30.121848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.121863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.121908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:30.121934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:30.121948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:30.122116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:30.123217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 18 partition: 0 MaxSeqNo: 46 sessionId: src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0
2025-10-15T10:54:30.128364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f88cfd2c-99407926-62fccddb-ea9d969a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:30.192766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0] Write session: try to update token
2025-10-15T10:54:30.192843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:30.343065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.343093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.343103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.343209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:30.343220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:30.343231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:30.343240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:30.343268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.343290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.343311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.346328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:30.346366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:30.346395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:30.458271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:30.458308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:30.468157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:30.549442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId: src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:30.575651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:30.692968Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:30.695278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:30.695308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:30.695363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400179619293550:2667]
2025-10-15T10:54:30.695563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:30.695594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:30.696498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:30.700049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:30.700088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:30.701281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:30.701349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:30.707372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400176819587600:2534]
2025-10-15T10:54:30.707524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:30.767956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 18 reason: error at write: Disconnected sessionId: src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0
2025-10-15T10:54:30.768217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:30.771715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:30.771753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0] Write session will restart in 0.007519s
2025-10-15T10:54:30.771840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0] Write session: Do CDS request
2025-10-15T10:54:30.771870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:30.768240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 18 sessionId: src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0 is DEAD
2025-10-15T10:54:30.772955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:30.774544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:30.774601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:30.774673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:30.775375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:30.775720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400179619293670:2678]
2025-10-15T10:54:30.779290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:30.782535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:30.782795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:30.785128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:30.784488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:30.784849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:30.784856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:30.784862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:30.784867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:30.784873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:30.784880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:30.784886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:30.784892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:30.784897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:30.784902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:30.784908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:30.784914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.784920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.784926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.784964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:30.785051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:30.785088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:30.785655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:30.785687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:30.785719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:30.785748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:30.785791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:30.785818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:30.785846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:30.785873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:30.785898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.785926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.785952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.785979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:30.786017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:30.786053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:30.786087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:30.786116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:30.786150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:30.786177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:30.786208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:30.786236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:30.786266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:30.786292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:30.786324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:30.786351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:30.786381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:30.786407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:30.786439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:30.786468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:30.786498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:30.786523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:30.786555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:30.786583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:30.786615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:30.786640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.787121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.787159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.787195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.787224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.787256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.787619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:30.787647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:30.787674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 19
2025-10-15T10:54:30.791614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:30.791759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 19 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:30.791775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=19 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:30.791785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:30.793264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 19 sessionId:  describe result for acl check
2025-10-15T10:54:30.793370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:30.793388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:30.793396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:30.793411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400176819587708:2768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:30.795838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400176819587708:2768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:30.805207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400176819587708:2768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:30.805577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400176819587727:2534]
2025-10-15T10:54:30.805728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:30.821431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400176819587708:2768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:30.821504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400176819587708:2768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:30.821521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400176819587708:2768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:30.821552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 19 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:30.854088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:30.864481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:30.864526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:30.864542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:30.864559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:30.864582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 18 [2:7561400179619293670:2678]
2025-10-15T10:54:30.864632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:30.864689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:30.864703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.864714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.864724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.864769Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:30.864789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:30.864808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:30.865810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.865825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.865838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.865848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:30.866097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:30.866113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:30.866249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:30.866430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:30.868260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 18, pipe: [1:7561400176819587727:2534]
2025-10-15T10:54:30.868338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 18
2025-10-15T10:54:30.868401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 18
2025-10-15T10:54:30.867938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:30.868045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400176819587727:2534], now have 1 active actors on pipe
2025-10-15T10:54:30.868068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400176819587737:2768], now have 1 active actors on pipe
2025-10-15T10:54:30.868088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400176819587669:2467], now have 1 active actors on pipe
2025-10-15T10:54:30.868110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400179619293664:2678]
2025-10-15T10:54:30.868124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400179619293664:2678]
2025-10-15T10:54:30.868137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400179619293664:2678]
2025-10-15T10:54:30.868172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:30.868240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:30.868411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:30.868425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:30.868530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400179619293664:2678]
2025-10-15T10:54:30.868547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:30.868608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:30.868621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:30.868632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:30.868655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:30.869459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:30.869488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:30.869558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:30.869571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:30.869657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:30.869686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.869703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.869711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:30.869769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.869809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:30.869884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:30.869938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:30.870289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:30.870304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:30.870329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400179619293664:2678]
2025-10-15T10:54:30.870340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400179619293664:2678]
2025-10-15T10:54:30.870371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:30.870927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:30.870942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:30.873998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:30.874034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:30.874129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:30.878615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 19 partition: 0 MaxSeqNo: 46 sessionId: src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0
2025-10-15T10:54:30.879506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692db50d-bb3a4aab-ae85df0a-79a6e069_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:30.942088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0] Write session: try to update token
2025-10-15T10:54:30.942142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:30.966302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.966324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.966335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.024965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:31.024991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:31.025005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:31.025015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:31.025046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400179619293664:2678]
2025-10-15T10:54:31.025069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400179619293664:2678]
2025-10-15T10:54:31.025090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400179619293664:2678]
2025-10-15T10:54:31.025218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:31.025238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:31.026348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:31.033823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:31.033858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:31.033888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:31.138558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId: src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:31.212773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:31.311930Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:31.314010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:31.314034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:31.315990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400176819587727:2534]
2025-10-15T10:54:31.316070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:31.316080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:31.319500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:31.334587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:31.334620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0] Write session will restart in 0.007570s
2025-10-15T10:54:31.334702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0] Write session: Do CDS request
2025-10-15T10:54:31.334728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:31.333706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 19 reason: error at write: Disconnected sessionId: src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0
2025-10-15T10:54:31.333985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 19 sessionId: src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0 is DEAD
2025-10-15T10:54:31.374774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:31.383487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:31.383515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 20
2025-10-15T10:54:31.396092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:31.396268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 20 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:31.396287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=20 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:31.396300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:31.398071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 20 sessionId:  describe result for acl check
2025-10-15T10:54:31.398201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:31.398213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:31.398223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:31.398241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400181114555075:2773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:31.401333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400181114555075:2773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:31.409039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400181114555075:2773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:31.417588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400181114555096:2534]
2025-10-15T10:54:31.417798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:31.419798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:31.419836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:31.427575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400181114555096:2534]
2025-10-15T10:54:31.427676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: ERROR TabletId: 72075186224037892 Generation: 0, pipe: [0:0:0]
2025-10-15T10:54:31.435950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400181114555075:2773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:31.435993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400181114555075:2773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:31.436012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400181114555075:2773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:31.436044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 20 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:31.461467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:31.463678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:31.464498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:31.464516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:31.464560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:31.464820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:31.465003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400183914261059:2686]
2025-10-15T10:54:31.467270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:31.468670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:31.468896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:31.470228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:31.470554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:31.470563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:31.470570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:31.470579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:31.470585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:31.470593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:31.470601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:31.470610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:31.470616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:31.470623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:31.470629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:31.470638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:31.470645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:31.470652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:31.470699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:31.470814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:31.470861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:31.470908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:31.470952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:31.471000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:31.471046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:31.471089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:31.471135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:31.471186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:31.471231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:31.471278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:31.471322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:31.471388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:31.471435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:31.472298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:31.472375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:31.472440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:31.472490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:31.472542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:31.472587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:31.472640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:31.472688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:31.472742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:31.472784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:31.472835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:31.472881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:31.472930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:31.472973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:31.473025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:31.473075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:31.473131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:31.473178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:31.473232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:31.473275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:31.473330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:31.473377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:31.473432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:31.473479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:31.473533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:31.473578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:31.473632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:31.474154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:31.496370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:31.518006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:31.518054Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:31.518074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:31.518094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:31.518119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 19 [2:7561400183914261059:2686]
2025-10-15T10:54:31.518177Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:31.518239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:31.518256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.518270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.518282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.518335Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:31.518361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:31.518387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:31.520689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:31.520714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:31.520728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:31.520740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:31.521024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:31.521043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:31.521194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:31.521394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:31.521633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:31.521708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.521725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.521737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.521795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:31.521882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:31.522074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:31.522092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:31.522232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.522252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:31.522929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:31.522948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:31.522960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:31.522986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:31.524833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400181114555096:2534], now have 1 active actors on pipe
2025-10-15T10:54:31.524867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400181114555107:2773], now have 1 active actors on pipe
2025-10-15T10:54:31.524890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400181114555063:2467], now have 1 active actors on pipe
2025-10-15T10:54:31.524989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 19
2025-10-15T10:54:31.525070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 19
2025-10-15T10:54:31.527756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400181114555137:2534]
2025-10-15T10:54:31.527930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:31.529371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 19, pipe: [1:7561400181114555137:2534]
2025-10-15T10:54:31.529444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561400181114555096:2534] destroyed
2025-10-15T10:54:31.529524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:31.529551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:31.529622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400181114555137:2534], now have 1 active actors on pipe
2025-10-15T10:54:31.529707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:31.529724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:31.529830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85503e86-62f780bc-a98a76f3-72628abf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:31.529870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.529889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.529900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:31.529943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.529994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:31.530084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:31.530172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:31.530584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:31.530605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:31.530657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:31.530673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:31.530712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.530726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.530770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:31.530799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:31.530814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:31.530960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:31.532913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 20 partition: 0 MaxSeqNo: 46 sessionId: src_id|85503e86-62f780bc-a98a76f3-72628abf_0
2025-10-15T10:54:31.535013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9875e120-ce43f7ab-7fb64dcc-bb849821_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|85503e86-62f780bc-a98a76f3-72628abf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:31.601788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85503e86-62f780bc-a98a76f3-72628abf_0] Write session: try to update token
2025-10-15T10:54:31.601849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85503e86-62f780bc-a98a76f3-72628abf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:31.616297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:31.616327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:31.616365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.616505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:31.618269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:31.619743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:31.628721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:31.648952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:31.650201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:31.661220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:54:31.676807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.676831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.676841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.676892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:54:31.776117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.776149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.776162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.882451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:31.882479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:31.882491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:31.882501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:31.882535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.882560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.882582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400183914261053:2686]
2025-10-15T10:54:31.882724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.882737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.882747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.882784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:31.882802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:31.883153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:31.883183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:31.883207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:31.888473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId: src_id|85503e86-62f780bc-a98a76f3-72628abf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:31.894175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:31.960708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:32.184107Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:32.231119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:32.231157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:32.236602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400181114555137:2534]
2025-10-15T10:54:32.236688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:32.236698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:32.240072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:32.240104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:32.291906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85503e86-62f780bc-a98a76f3-72628abf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:32.291943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85503e86-62f780bc-a98a76f3-72628abf_0] Write session will restart in 0.005621s
2025-10-15T10:54:32.292036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85503e86-62f780bc-a98a76f3-72628abf_0] Write session: Do CDS request
2025-10-15T10:54:32.292066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85503e86-62f780bc-a98a76f3-72628abf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:32.288518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:32.288685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 20 reason: error at write: Disconnected sessionId: src_id|85503e86-62f780bc-a98a76f3-72628abf_0
2025-10-15T10:54:32.288958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 20 sessionId: src_id|85503e86-62f780bc-a98a76f3-72628abf_0 is DEAD
2025-10-15T10:54:32.309618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85503e86-62f780bc-a98a76f3-72628abf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:32.325481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:32.328479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:32.329258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:32.329276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:32.329313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:32.329546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:32.329702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400188209228464:2695]
2025-10-15T10:54:32.332354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:32.338774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:32.339012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:32.340398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:32.347285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:32.347307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:32.347313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:32.347320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:32.347326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:32.347332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:32.347337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:32.347342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:32.347365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:32.347371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:32.347378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:32.347384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:32.347390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:32.347396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:32.347443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:32.347536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:32.347574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:32.347613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:32.348204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:32.348263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:32.348305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:32.348350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:32.348407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:32.348451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:32.348494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:32.348736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:32.348780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:32.348821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:32.348880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:32.349005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:32.349087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:32.349141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:32.349188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:32.349236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:32.349277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:32.349325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:32.349369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:32.349417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:32.349456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:32.349506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:32.349544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:32.349585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:32.349623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:32.349668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:32.349706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:32.349749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:32.349799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:32.349844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:32.349886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:32.349929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:32.349968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:32.350012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:32.350051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:32.350094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:32.350125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:32.350166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:32.350554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:32.352577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400185409522520:2534]
2025-10-15T10:54:32.352720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:32.352909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:32.352921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 21
2025-10-15T10:54:32.360931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:32.361082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 21 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:32.361099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=21 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:32.361109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:32.362758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 21 sessionId:  describe result for acl check
2025-10-15T10:54:32.362863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:32.362886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:32.362896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:32.362912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400185409522526:2785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:32.366707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400185409522526:2785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:32.381567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400185409522526:2785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:32.386696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:32.397408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:32.397447Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:32.397462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:32.397479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:32.397500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 20 [2:7561400188209228464:2695]
2025-10-15T10:54:32.397546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:32.397594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:32.397606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.397617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.397626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.397668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:32.397690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:32.397708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:32.403374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400185409522526:2785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:32.403417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400185409522526:2785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:32.403435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400185409522526:2785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:32.403468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 21 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:32.424313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:32.424339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:32.424351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:32.424361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:32.424604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:32.424619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:32.424740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:32.424892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:32.425102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:32.425168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400188209228458:2695]
2025-10-15T10:54:32.425180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400188209228458:2695]
2025-10-15T10:54:32.425191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400188209228458:2695]
2025-10-15T10:54:32.425228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:32.425295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:32.425454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:32.425471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:32.425585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400188209228458:2695]
2025-10-15T10:54:32.425602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:32.426372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:32.426390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:32.426412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:32.426433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:32.427261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400185409522520:2534], now have 1 active actors on pipe
2025-10-15T10:54:32.427287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400185409522554:2785], now have 1 active actors on pipe
2025-10-15T10:54:32.427304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400185409522502:2467], now have 1 active actors on pipe
2025-10-15T10:54:32.428677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 20, pipe: [1:7561400185409522520:2534]
2025-10-15T10:54:32.428757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 20
2025-10-15T10:54:32.428821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 20
2025-10-15T10:54:32.431998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:32.432032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:32.432091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:32.432103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:32.432194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:32.432221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.432235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.432244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:32.432275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.432313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:32.432373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:32.432425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:32.432758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:32.432773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:32.432800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400188209228458:2695]
2025-10-15T10:54:32.432811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400188209228458:2695]
2025-10-15T10:54:32.432844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:32.434885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 21 partition: 0 MaxSeqNo: 46 sessionId: src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0
2025-10-15T10:54:32.436382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85503e86-62f780bc-a98a76f3-72628abf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:32.433827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:32.433843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:32.434516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:32.434539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:32.434603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:32.497426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0] Write session: try to update token
2025-10-15T10:54:32.497477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:32.499500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.499528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.499539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.590350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:32.590378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:32.590390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:32.590399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:32.590433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400188209228458:2695]
2025-10-15T10:54:32.590456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400188209228458:2695]
2025-10-15T10:54:32.590477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400188209228458:2695]
2025-10-15T10:54:32.590618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:32.590639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:32.592919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:32.592983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:32.593015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:32.647776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:32.795683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId: src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:32.842730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:32.879975Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:32.882440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:32.882478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:32.885355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400185409522520:2534]
2025-10-15T10:54:32.885505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:32.885529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:32.903859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:32.903915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0] Write session will restart in 0.005268s
2025-10-15T10:54:32.904052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0] Write session: Do CDS request
2025-10-15T10:54:32.904091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:32.903017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:32.903131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 21 reason: error at write: Disconnected sessionId: src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0
2025-10-15T10:54:32.903449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 21 sessionId: src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0 is DEAD
2025-10-15T10:54:32.916778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:32.925099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:32.925133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 22
2025-10-15T10:54:32.925650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:32.925754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 22 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:32.925767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=22 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:32.925777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:32.928057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 22 sessionId:  describe result for acl check
2025-10-15T10:54:32.928156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:32.928166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:32.928175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:32.928191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400185409522592:2790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:32.936369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400185409522592:2790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:32.949437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400185409522592:2790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:32.951104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:32.951145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:32.980015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400185409522592:2790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:32.980069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400185409522592:2790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:32.980086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400185409522592:2790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:32.980121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 22 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:32.987935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:32.990745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:32.991895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400185409522654:2534]
2025-10-15T10:54:32.992297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:32.991557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:32.991580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:32.991620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:32.991858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:32.992090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400188209228579:2705]
2025-10-15T10:54:32.994149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:33.000979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:33.001234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:33.002543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:33.002864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:33.002872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:33.002879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:33.002886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:33.002892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:33.002898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:33.002905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:33.002911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:33.002917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:33.002925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:33.002932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:33.002939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.002945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.002952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.002999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:33.003103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:33.003146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:33.003192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:33.003235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:33.003280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:33.003320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:33.003384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:33.003431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:33.003474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:33.003518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:33.003562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.003603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.003643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.003685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:33.003747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:33.003801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:33.003851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:33.003896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:33.003945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:33.003988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:33.004040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:33.004086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:33.004134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:33.004177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:33.004225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:33.004270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:33.004321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:33.004363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:33.004412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:33.004455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:33.004500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:33.004541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:33.004590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:33.004634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:33.006145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:33.006216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.006275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.006318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.006367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.006409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.006457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.006968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:33.045343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:33.055305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:33.055593Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:33.055614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:33.055632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:33.055653Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 21 [2:7561400188209228579:2705]
2025-10-15T10:54:33.055699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:33.055748Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:33.055761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.055773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.055783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.055826Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:33.055845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:33.055864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:33.057530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.057544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.057557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.057568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:33.057825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:33.057842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.057973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.058166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.059972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 21, pipe: [1:7561400185409522654:2534]
2025-10-15T10:54:33.060056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 21
2025-10-15T10:54:33.060118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 21
2025-10-15T10:54:33.059566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:33.059661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400185409522654:2534], now have 1 active actors on pipe
2025-10-15T10:54:33.059685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400185409522649:2790], now have 1 active actors on pipe
2025-10-15T10:54:33.059705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400185409522580:2467], now have 1 active actors on pipe
2025-10-15T10:54:33.059730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400188209228573:2705]
2025-10-15T10:54:33.059743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400188209228573:2705]
2025-10-15T10:54:33.059756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400188209228573:2705]
2025-10-15T10:54:33.059790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:33.059860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:33.060026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:33.060042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:33.060152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400188209228573:2705]
2025-10-15T10:54:33.060169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:33.060640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:33.060656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:33.060666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:33.060689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:33.062804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:33.062836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:33.062890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:33.062904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:33.062993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:33.063019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.063035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.063046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:33.063080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.063117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:33.063178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:33.063226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:33.063603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:33.063621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:33.063657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400188209228573:2705]
2025-10-15T10:54:33.063670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400188209228573:2705]
2025-10-15T10:54:33.063701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:33.064299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:33.064315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:33.065211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:33.065234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:33.065296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:33.065625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 22 partition: 0 MaxSeqNo: 46 sessionId: src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0
2025-10-15T10:54:33.066804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5686939c-8bfd9675-2b3b9ab-98450ade_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:33.117463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0] Write session: try to update token
2025-10-15T10:54:33.126307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:33.152901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.152933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.152946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.224669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:33.224703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:33.224717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:33.224727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:33.224757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400188209228573:2705]
2025-10-15T10:54:33.224780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400188209228573:2705]
2025-10-15T10:54:33.224801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400188209228573:2705]
2025-10-15T10:54:33.224927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:33.224948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:33.225101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:33.225133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:33.225155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:33.253677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:33.382243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId: src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:33.411866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:33.454493Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:33.456662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:33.456695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:33.460266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400185409522654:2534]
2025-10-15T10:54:33.460369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:33.460381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:33.461782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:33.466354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:33.466384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:33.515443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:33.515495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0] Write session will restart in 0.009409s
2025-10-15T10:54:33.512395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 22 reason: error at write: Disconnected sessionId: src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0
2025-10-15T10:54:33.512702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 22 sessionId: src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0 is DEAD
2025-10-15T10:54:33.515614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0] Write session: Do CDS request
2025-10-15T10:54:33.515652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:33.535403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:33.540387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:33.541168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:33.541186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:33.541242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:33.541479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:33.541635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400192504195971:2714]
2025-10-15T10:54:33.543930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:33.544333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:33.544620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:33.544653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 23
2025-10-15T10:54:33.548800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:33.548932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 23 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:33.548948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=23 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:33.548957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:33.550710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:33.550936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:33.552289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:33.552580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:33.552589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:33.552596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:33.552602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:33.552608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:33.552615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:33.552620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:33.552625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:33.552631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:33.552636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:33.556906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 23 sessionId:  describe result for acl check
2025-10-15T10:54:33.552642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:33.552648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.557019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:33.552655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.557029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:33.552660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.552701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:33.557038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:33.552794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:33.557054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400189704490020:2798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:33.552836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:33.559700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400189704490020:2798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:33.552879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:33.552922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:33.552963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:33.553005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:33.553050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:33.553092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:33.553139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:33.553181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:33.553225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.553271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.553314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.553355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:33.553415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:33.553470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:33.553524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:33.553569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:33.553619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:33.553661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:33.553710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:33.553777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:33.553841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:33.553887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:33.553938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:33.553984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:33.554031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:33.554073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:33.554116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:33.554156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:33.554202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:33.554245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:33.554300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:33.554347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:33.554397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:33.554441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.554491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.554534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.554583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.554626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.554678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.555167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:33.563422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400189704490028:2534]
2025-10-15T10:54:33.563593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:33.571369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400189704490020:2798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:33.596649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400189704490020:2798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:33.596690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400189704490020:2798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:33.596707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400189704490020:2798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:33.596736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 23 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:33.605750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:33.674054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:33.674097Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:33.674112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:33.674129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:33.674150Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 22 [2:7561400192504195971:2714]
2025-10-15T10:54:33.674194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:33.674246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:33.674258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.674269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.674279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.674317Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:33.674338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:33.674358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:33.675317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.675337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.675367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.675379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:33.675647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:33.675664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:33.675806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:33.675989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:33.676221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:33.676285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:33.676299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:33.676311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:33.676353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:33.676421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:33.676590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:33.676607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:33.676736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:33.676756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:33.677758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:33.677774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:33.677785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:33.677824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:33.679715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400189704490051:2798], now have 1 active actors on pipe
2025-10-15T10:54:33.679748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400189704489981:2467], now have 1 active actors on pipe
2025-10-15T10:54:33.679772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400189704490028:2534], now have 1 active actors on pipe
2025-10-15T10:54:33.680676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 22
2025-10-15T10:54:33.680768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 22
2025-10-15T10:54:33.680917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 22, pipe: [1:7561400189704490028:2534]
2025-10-15T10:54:33.684895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:33.684930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:33.685032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:33.685047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:33.685122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b125ac16-f600a832-30305ef6-d988a821_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:33.685152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.685169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.685178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:33.685212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.685251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:33.685313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:33.685384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:33.685762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:33.685781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:33.685831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:33.685842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:33.685879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:33.686280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:33.686291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:33.689336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:33.689364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:33.689445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:33.692293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 23 partition: 0 MaxSeqNo: 46 sessionId: src_id|b125ac16-f600a832-30305ef6-d988a821_0
2025-10-15T10:54:33.695860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fa5cacc-66eb9796-6e7344ac-e718f2ce_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b125ac16-f600a832-30305ef6-d988a821_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:33.737388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:33.737415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:33.737452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:33.737570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:33.739468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:33.752662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b125ac16-f600a832-30305ef6-d988a821_0] Write session: try to update token
2025-10-15T10:54:33.752717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b125ac16-f600a832-30305ef6-d988a821_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:33.755318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:33.757032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:33.786835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:33.803366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:33.820221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:54:33.820613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.820626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.820638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.820693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:54:34.006371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId: src_id|b125ac16-f600a832-30305ef6-d988a821_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:34.017082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.017104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.017114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.017160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:34.017171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:34.017180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:34.017187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:34.017218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:34.017237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:34.017254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:34.017392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:34.017424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:34.017429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:34.017440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:34.017467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:34.018401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:34.052312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:34.191878Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:34.212690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:34.212731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:34.212798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:34.212813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:34.212824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:34.212860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:34.212883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400192504195965:2714]
2025-10-15T10:54:34.213100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:34.213144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:34.213184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:34.213214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:34.213240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:34.213413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:34.213434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:34.220530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:34.285735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b125ac16-f600a832-30305ef6-d988a821_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:54:34.285773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b125ac16-f600a832-30305ef6-d988a821_0] Write session will restart in 0.006190s
2025-10-15T10:54:34.285874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b125ac16-f600a832-30305ef6-d988a821_0] Write session: Do CDS request
2025-10-15T10:54:34.284691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 23 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b125ac16-f600a832-30305ef6-d988a821_0
2025-10-15T10:54:34.285080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 23 sessionId: src_id|b125ac16-f600a832-30305ef6-d988a821_0 is DEAD
2025-10-15T10:54:34.299837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b125ac16-f600a832-30305ef6-d988a821_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:34.313945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:34.314087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400189704490028:2534]
2025-10-15T10:54:34.333949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:34.333979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 24
2025-10-15T10:54:34.334760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b125ac16-f600a832-30305ef6-d988a821_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:34.335304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:34.335437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 24 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:34.335455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=24 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:34.335465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:34.339861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 24 sessionId:  describe result for acl check
2025-10-15T10:54:34.339965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:34.339975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:34.339985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:34.340000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400193999457435:2812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:34.347939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:34.350963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:34.351803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:34.351832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:34.351874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:34.352126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:34.352289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400196799163362:2718]
2025-10-15T10:54:34.354433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:34.355595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:34.355831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:34.356967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:34.357269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:34.357277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:34.357282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:34.357289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:34.357295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:34.357301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:34.357308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:34.357315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:34.357321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:34.357326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:34.357332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:34.357337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:34.357342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:34.357347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:34.357383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:34.357465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:34.357503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:34.357542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:34.357579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:34.357615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:34.357654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:34.357689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:34.357726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:34.357763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:34.357797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:34.357849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:34.357887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:34.357930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:34.357975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:34.358028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:34.358075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:34.358120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:34.358158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:34.358207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:34.358246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:34.358292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:34.358332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:34.358378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:34.358417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:34.358461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:34.358501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:34.358599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:34.358685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:34.358782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:34.359796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400193999457435:2812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:34.358847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:34.358896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:34.358937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:34.358995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:34.359039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:34.359086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:34.359125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:34.359171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:34.359213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:34.359257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:34.359292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:34.359336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:34.361843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:34.370400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400193999457435:2812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:34.382174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400193999457435:2812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:34.382215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400193999457435:2812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:34.382231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400193999457435:2812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:34.382259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 24 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:34.395629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:34.406883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:34.406920Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:34.406935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:34.406952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:34.406974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 23 [2:7561400196799163362:2718]
2025-10-15T10:54:34.407022Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:34.407071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:34.407085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.407096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.407107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.407151Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:34.407171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:34.407189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:34.409122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:34.409143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:34.409156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:34.409166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:34.409408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:34.409423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:34.409552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:34.409725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:34.409970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:34.410035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.410049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.410061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.410101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:34.410165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:34.410329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:34.410347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:34.410456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.410473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:34.410805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:34.410820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:34.410829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:34.410851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:34.411815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 23
2025-10-15T10:54:34.411906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 23
2025-10-15T10:54:34.412901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400193999457469:2812], now have 1 active actors on pipe
2025-10-15T10:54:34.412933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400193999457411:2467], now have 1 active actors on pipe
2025-10-15T10:54:34.412974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:34.412994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:34.413061Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:34.413091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.413108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.413117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:34.413146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.413182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:34.413224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:34.415608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:34.415638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:34.415712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:34.415988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400193999457474:2534]
2025-10-15T10:54:34.416155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:34.424342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b125ac16-f600a832-30305ef6-d988a821_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:34.425651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400193999457474:2534], now have 1 active actors on pipe
2025-10-15T10:54:34.423379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 24 partition: 0 MaxSeqNo: 46 sessionId: src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0
2025-10-15T10:54:34.425939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 23, pipe: [1:7561400193999457474:2534]
2025-10-15T10:54:34.426214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:34.426241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:34.426344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:34.426717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:34.426734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:34.426769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.426782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.426820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:34.427029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:34.427039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:34.484071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0] Write session: try to update token
2025-10-15T10:54:34.484122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:34.507764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.507786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.507795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.661297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:34.661323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:34.661335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:34.661344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:34.661375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.661400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.661421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.661593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.661604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.661613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.661650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:34.661668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:34.662467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:34.662508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:34.662541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:34.662570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:34.662691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:34.775443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId: src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:34.817219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:34.905182Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:34.929780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:34.929829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:34.929875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:34.929886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:34.929916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400196799163355:2718]
2025-10-15T10:54:34.931592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:34.931627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:34.931654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:34.932228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:34.932252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:34.935461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:34.935583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400193999457474:2534]
2025-10-15T10:54:34.938679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:34.938721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:34.947835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 24 reason: error at write: Disconnected sessionId: src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0
2025-10-15T10:54:34.948108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 24 sessionId: src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0 is DEAD
2025-10-15T10:54:34.953216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:34.953245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0] Write session will restart in 0.005405s
2025-10-15T10:54:34.953332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0] Write session: Do CDS request
2025-10-15T10:54:34.955315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:34.970295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:34.970328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 25
2025-10-15T10:54:34.976860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:34.980711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:34.980879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 25 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:34.980894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=25 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:34.980906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:34.982731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 25 sessionId:  describe result for acl check
2025-10-15T10:54:34.982842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:34.982852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:34.982862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:34.982877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400193999457522:2820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:34.985255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400193999457522:2820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:34.993658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400193999457522:2820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:35.026554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400193999457522:2820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:35.026615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400193999457522:2820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:35.026643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400193999457522:2820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:35.026669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 25 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:35.037159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:35.039624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400198294424872:2534]
2025-10-15T10:54:35.039843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:35.040522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:35.041444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:35.041468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:35.041508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:35.041752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:35.041925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400201094130776:2729]
2025-10-15T10:54:35.048533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:35.055482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:35.055782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:35.057016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:35.057389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:35.057396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:35.057402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:35.057408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:35.057413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:35.057418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:35.057424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:35.057429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:35.057435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:35.057440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:35.057448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:35.057455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.057460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.057467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.057511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:35.057608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:35.057647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:35.057689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:35.057740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:35.057782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:35.057854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:35.057914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:35.057957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:35.057995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:35.058035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:35.058075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.058115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.058152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.058191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:35.058254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:35.060287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:35.060389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:35.060447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:35.060508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:35.060553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:35.060606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:35.060697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:35.060749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:35.060794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:35.060844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:35.060886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:35.060934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:35.060978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:35.061027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:35.061072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:35.061121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:35.061164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:35.061216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:35.061259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:35.061308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:35.061350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.061397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.061440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.061488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.061533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.061582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.062096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:35.094334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:35.117324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:35.117377Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:35.117398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:35.117416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:35.117439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 24 [2:7561400201094130776:2729]
2025-10-15T10:54:35.117489Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:35.117542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:35.117556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.117569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.117579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.117619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:35.117638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:35.117660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:35.124854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.124878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.124892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.124903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:35.125202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:35.125220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.125379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.125557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.125778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:35.125866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400193999457506:2467], now have 1 active actors on pipe
2025-10-15T10:54:35.125888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400198294424868:2820], now have 1 active actors on pipe
2025-10-15T10:54:35.125907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400198294424872:2534], now have 1 active actors on pipe
2025-10-15T10:54:35.125931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400201094130769:2729]
2025-10-15T10:54:35.125942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400201094130769:2729]
2025-10-15T10:54:35.125951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400201094130769:2729]
2025-10-15T10:54:35.125984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:35.126045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:35.126206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:35.126223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:35.126333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400201094130769:2729]
2025-10-15T10:54:35.126350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:35.126139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 24
2025-10-15T10:54:35.126226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 24
2025-10-15T10:54:35.126306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 24, pipe: [1:7561400198294424872:2534]
2025-10-15T10:54:35.126900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:35.126919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:35.126928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:35.126950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:35.132809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:35.132850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:35.132951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:35.132971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:35.133069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:35.133103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.133130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.133141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:35.133180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.133225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:35.133288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:35.133375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:35.133847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:35.133869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:35.133912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400201094130769:2729]
2025-10-15T10:54:35.133925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400201094130769:2729]
2025-10-15T10:54:35.133966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:35.134106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:35.134130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:35.134877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:35.134905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:35.134985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:35.140651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 25 partition: 0 MaxSeqNo: 46 sessionId: src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0
2025-10-15T10:54:35.141604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53649ae5-3fa08877-ef5b6b6e-1bdfbc57_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:35.189962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0] Write session: try to update token
2025-10-15T10:54:35.190016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:35.262988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.263015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.263026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.263076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:35.263100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:35.263117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:35.263126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:35.263158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400201094130769:2729]
2025-10-15T10:54:35.263180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400201094130769:2729]
2025-10-15T10:54:35.263200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400201094130769:2729]
2025-10-15T10:54:35.263327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:35.265107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:35.267832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:35.267883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:35.267915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:35.276810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:35.457724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId: src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:35.480983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:35.502039Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:35.503977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:35.504009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:35.515653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400198294424872:2534]
2025-10-15T10:54:35.515739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:35.515844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:35.515856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:35.530105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 25 reason: error at write: Disconnected sessionId: src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0
2025-10-15T10:54:35.530409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 25 sessionId: src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0 is DEAD
2025-10-15T10:54:35.531789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:35.531820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0] Write session will restart in 0.007696s
2025-10-15T10:54:35.531905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0] Write session: Do CDS request
2025-10-15T10:54:35.531935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:35.582317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:35.584030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:35.584059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 26
2025-10-15T10:54:35.596534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:35.596669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 26 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:35.596686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=26 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:35.596696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:35.598417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 26 sessionId:  describe result for acl check
2025-10-15T10:54:35.598534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:35.598544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:35.598553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:35.598568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400198294424926:2825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:35.607647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400198294424926:2825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:35.616304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400198294424947:2534]
2025-10-15T10:54:35.616460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:35.630243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400198294424926:2825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:35.642062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:35.642094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:35.650998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:35.657843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400198294424947:2534]
2025-10-15T10:54:35.657932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: ERROR TabletId: 72075186224037892 Generation: 0, pipe: [0:0:0]
2025-10-15T10:54:35.660488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400198294424926:2825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:35.660515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400198294424926:2825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:35.660532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400198294424926:2825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:35.660563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 26 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:35.662398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:35.663419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:35.663437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:35.663482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:35.663734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:35.663890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400201094130874:2737]
2025-10-15T10:54:35.666445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:35.671871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:35.672127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:35.673368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:35.673682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:35.673690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:35.673698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:35.673704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:35.673711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:35.673717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:35.673723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:35.673729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:35.673736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:35.673742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:35.673749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:35.673755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.673761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.673767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.673815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:35.673930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:35.673982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:35.674029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:35.674074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:35.674120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:35.674163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:35.674208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:35.674251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:35.674292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:35.674334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:35.674376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.674418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.674458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.674501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:35.674561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:35.674613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:35.674664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:35.674712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:35.674764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:35.674811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:35.674861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:35.674907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:35.674957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:35.675836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:35.675905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:35.675956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:35.676006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:35.676046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:35.676108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:35.676151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:35.676198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:35.676235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:35.676282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:35.676325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:35.676372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:35.676412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.676459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.676501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.676550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.676593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.676641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.677136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:35.726711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:35.757524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:35.757569Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:35.757585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:35.757602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:35.757644Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 25 [2:7561400201094130874:2737]
2025-10-15T10:54:35.757694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:35.757747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:35.757760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.757771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.757781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.757838Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:35.757859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:35.757878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:35.759030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.759044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.759056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.759066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:35.760097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400198294424988:2534]
2025-10-15T10:54:35.760274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:35.760458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 25
2025-10-15T10:54:35.760538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 25
2025-10-15T10:54:35.761647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 25, pipe: [1:7561400198294424988:2534]
2025-10-15T10:54:35.769906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:35.769939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:35.770079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:35.770285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:35.770515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:35.770556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400198294424976:2825], now have 1 active actors on pipe
2025-10-15T10:54:35.770592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400198294424903:2467], now have 1 active actors on pipe
2025-10-15T10:54:35.770614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400198294424947:2534], now have 1 active actors on pipe
2025-10-15T10:54:35.770658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400198294424988:2534], now have 1 active actors on pipe
2025-10-15T10:54:35.770682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561400198294424947:2534] destroyed
2025-10-15T10:54:35.770729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:35.770749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:35.770836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:35.770849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:35.770927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400201094130869:2737]
2025-10-15T10:54:35.770941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400201094130869:2737]
2025-10-15T10:54:35.770953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400201094130869:2737]
2025-10-15T10:54:35.770994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:35.771081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:35.771113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.771129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.771139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:35.771172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.771209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:35.771261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:35.771465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:35.771486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:35.771610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:35.771672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400201094130869:2737]
2025-10-15T10:54:35.771690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:35.771756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:35.772102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:35.772115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:35.772170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400201094130869:2737]
2025-10-15T10:54:35.772181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400201094130869:2737]
2025-10-15T10:54:35.772201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:35.772652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:35.772673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:35.772682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:35.772716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:35.772737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:35.772747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:35.789343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:35.789385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:35.789480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:35.789856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 26 partition: 0 MaxSeqNo: 46 sessionId: src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0
2025-10-15T10:54:35.790760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2611c7d-35d885c8-3fac2c24-bd286fa9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:35.832539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0] Write session: try to update token
2025-10-15T10:54:35.832591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:35.938462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.938488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.938498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.938542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:35.938552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:35.938562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:35.938569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:35.938598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400201094130869:2737]
2025-10-15T10:54:35.938618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400201094130869:2737]
2025-10-15T10:54:35.938634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400201094130869:2737]
2025-10-15T10:54:35.938763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:35.938782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:35.940297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:35.940323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:35.940346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:35.941247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:35.990918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId: src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:36.083701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:36.113799Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:36.123484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:36.123521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:36.132394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:36.132425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:36.128098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400198294424988:2534]
2025-10-15T10:54:36.128268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:36.128296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:36.185410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:36.185532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 26 reason: error at write: Disconnected sessionId: src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0
2025-10-15T10:54:36.185812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 26 sessionId: src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0 is DEAD
2025-10-15T10:54:36.191559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:36.191598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0] Write session will restart in 0.007320s
2025-10-15T10:54:36.191707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0] Write session: Do CDS request
2025-10-15T10:54:36.191731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:36.211631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:36.226104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:36.229906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:36.229940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 27
2025-10-15T10:54:36.230872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:36.231007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 27 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:36.231025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=27 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:36.231034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:36.231103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400202589392352:2534]
2025-10-15T10:54:36.231247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:36.233955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 27 sessionId:  describe result for acl check
2025-10-15T10:54:36.234086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:36.234097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:36.234106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:36.234122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400202589392359:2837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:36.237190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400202589392359:2837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:36.249254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:36.250741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:36.250766Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:36.250810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:36.251069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:36.251243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400205389098281:2741]
2025-10-15T10:54:36.253370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:36.254960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:36.255197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:36.256533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:36.256832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:36.256839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:36.256845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:36.256850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:36.256855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:36.256860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:36.256866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:36.256871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:36.256877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:36.256882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:36.256888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:36.256894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:36.256899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:36.256905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:36.256967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:36.257066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:36.257137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:36.257182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:36.257225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:36.257269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:36.257310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:36.257351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:36.257390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:36.257433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:36.257491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:36.257534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:36.257575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:36.257617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:36.257657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:36.257716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:36.257768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:36.257845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:36.257890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:36.257938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:36.259583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400202589392359:2837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:36.267890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:36.267983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:36.268053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:36.268115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:36.268160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:36.268214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:36.268259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:36.268308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:36.268352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:36.268404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:36.268451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:36.268500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:36.268571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:36.268626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:36.268675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:36.268721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:36.268766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:36.268823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:36.268867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:36.268914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:36.268956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:36.269006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:36.269532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:36.273056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400202589392359:2837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:36.273100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400202589392359:2837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:36.273115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400202589392359:2837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:36.273141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 27 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:36.303416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:36.324854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:36.324893Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:36.324908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:36.324923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:36.324943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 26 [2:7561400205389098281:2741]
2025-10-15T10:54:36.324985Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:36.325028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:36.325040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.325051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.325061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.325104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:36.325129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:36.325152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:36.337591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:36.337610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:36.337617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:36.337623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:36.337824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:36.337853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:36.337960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:36.338103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:36.338315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:36.338390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400202589392397:2837], now have 1 active actors on pipe
2025-10-15T10:54:36.338413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400202589392331:2467], now have 1 active actors on pipe
2025-10-15T10:54:36.338430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400202589392352:2534], now have 1 active actors on pipe
2025-10-15T10:54:36.338450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400205389098274:2741]
2025-10-15T10:54:36.338463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400205389098274:2741]
2025-10-15T10:54:36.338473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400205389098274:2741]
2025-10-15T10:54:36.338503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:36.338559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:36.338720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:36.338744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:36.338849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400205389098274:2741]
2025-10-15T10:54:36.338871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:36.338721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 26
2025-10-15T10:54:36.338794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 26
2025-10-15T10:54:36.338881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 26, pipe: [1:7561400202589392352:2534]
2025-10-15T10:54:36.339240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:36.339258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:36.339268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:36.339291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:36.347448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:36.347485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:36.347580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:36.347592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:36.347655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:36.347682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.347696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.347704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:36.347736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.347772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:36.347824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:36.347896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:36.348218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:36.348236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:36.348267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400205389098274:2741]
2025-10-15T10:54:36.348279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400205389098274:2741]
2025-10-15T10:54:36.348311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:36.349100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:36.349115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:36.351253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:36.351279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:36.351355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:36.361717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 27 partition: 0 MaxSeqNo: 46 sessionId: src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0
2025-10-15T10:54:36.362639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f17cda-4ddba3aa-c663664c-94ab71fb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:36.426929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.426962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.426975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.452635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0] Write session: try to update token
2025-10-15T10:54:36.452694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:36.614807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.614846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.614859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.614932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:36.614948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:36.614963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:36.614975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:36.615014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400205389098274:2741]
2025-10-15T10:54:36.615042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400205389098274:2741]
2025-10-15T10:54:36.615065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400205389098274:2741]
2025-10-15T10:54:36.615217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:36.615238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:36.616310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:36.617931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:36.617966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:36.617998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:36.654765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:54:36.654872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-15T10:54:36.897170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId: src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:36.954948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:37.081336Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:37.092553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:37.092614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:37.097554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:37.097585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:37.103625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:37.103755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-15T10:54:37.103989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400202589392352:2534]
2025-10-15T10:54:37.128185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:37.128224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:37.211113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400206884359747:2534]
2025-10-15T10:54:37.211298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:37.213669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 27 reason: error at write: Disconnected sessionId: src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0
2025-10-15T10:54:37.214036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 27 sessionId: src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0 is DEAD
2025-10-15T10:54:37.219506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:37.219555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0] Write session will restart in 0.005742s
2025-10-15T10:54:37.219657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0] Write session: Do CDS request
2025-10-15T10:54:37.219695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:37.234844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:37.235790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:37.235819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 28
2025-10-15T10:54:37.236255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:37.236388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 28 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:37.236407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=28 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:37.236419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:37.245840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 28 sessionId:  describe result for acl check
2025-10-15T10:54:37.246001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:37.246013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:37.246025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:37.246043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400206884359774:2845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:37.253358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400206884359774:2845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:37.274420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:37.277906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:37.278805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:37.278824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:37.278875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:37.279129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:37.279320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400209684065686:2753]
2025-10-15T10:54:37.281294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:37.284200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:37.284408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:37.285667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:37.285990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:37.285997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:37.286004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:37.286009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:37.286013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:37.286020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:37.286025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:37.286032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:37.286038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:37.286044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:37.286051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:37.286056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.286063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.286069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.286109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:37.286204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:37.286242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:37.286276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:37.286328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:37.286371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:37.286407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:37.286444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:37.286479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:37.286531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:37.286568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:37.286608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.286643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.286675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.286712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:37.286764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:37.286810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:37.286852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:37.286890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:37.286928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:37.286960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:37.287020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:37.287058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:37.287105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:37.287142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:37.287183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:37.287220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:37.287308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:37.288800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:37.288866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:37.288912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:37.288955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:37.288991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:37.289067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:37.289102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:37.289141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:37.289175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.289212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.289246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.289303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.289335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.289375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.289802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:37.291902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400206884359774:2845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:37.310690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400206884359774:2845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:37.310732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400206884359774:2845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:37.310750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400206884359774:2845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:37.310779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 28 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:37.317435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:37.328752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:37.328794Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:37.328808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:37.328825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:37.328847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 27 [2:7561400209684065686:2753]
2025-10-15T10:54:37.328890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:37.328944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:37.328957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.328968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.328977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.329023Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:37.329078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:37.329099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:37.330838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.330850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.330859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.330869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:37.331963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 27
2025-10-15T10:54:37.332100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 27
2025-10-15T10:54:37.332202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 27, pipe: [1:7561400206884359747:2534]
2025-10-15T10:54:37.332371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:37.332678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.332801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.332975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.333138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:37.333177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400206884359823:2845], now have 1 active actors on pipe
2025-10-15T10:54:37.333196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400206884359733:2467], now have 1 active actors on pipe
2025-10-15T10:54:37.333214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400206884359747:2534], now have 1 active actors on pipe
2025-10-15T10:54:37.333301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:37.333323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:37.333459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:37.333471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:37.333516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.333527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.333538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.333591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:37.333662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:37.333825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:37.333841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:37.333921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:37.333949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.333966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.333976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:37.334010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.334053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:37.334244Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:54:37.334427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.334447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:37.334516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:37.334660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:37.334990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:37.335006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:37.335051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.335062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.335080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:37.338306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:54:37.338840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:54:37.335935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:37.335954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:37.335966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:37.335994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:37.336010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:37.336021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:37.339882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-15T10:54:37.344800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:37.344841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:37.351630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:37.352617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 28 partition: 0 MaxSeqNo: 46 sessionId: src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0
2025-10-15T10:54:37.353963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4bea5e-eb01a303-a6806235-6e08a152_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:37.405638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0] Write session: try to update token
2025-10-15T10:54:37.405706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:37.587873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.587902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.587915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.587982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:37.587999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:37.588014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:37.588027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:37.588064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.588092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.588118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.588336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:37.588357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:37.589349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:37.591846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:37.591886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:37.591915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:37.607401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId: src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:37.652153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:37.782260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:37.794069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:37.794116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:37.794197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:37.794211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:37.794255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400209684065680:2753]
2025-10-15T10:54:37.794630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:37.800548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:37.800591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:37.798419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400206884359747:2534]
2025-10-15T10:54:37.798615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:37.798640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:37.806828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:37.861479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 28 reason: error at write: Disconnected sessionId: src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0
2025-10-15T10:54:37.861868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 28 sessionId: src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0 is DEAD
2025-10-15T10:54:37.864007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:37.864046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0] Write session will restart in 0.007195s
2025-10-15T10:54:37.864144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0] Write session: Do CDS request
2025-10-15T10:54:37.864176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:37.878737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:37.879950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:37.879985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 29
2025-10-15T10:54:37.881574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:37.881726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 29 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:37.881745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=29 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:37.881758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:37.883580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 29 sessionId:  describe result for acl check
2025-10-15T10:54:37.883726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:37.883738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:37.883747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:37.883769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400206884359899:2851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:37.884424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:37.886617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400206884359899:2851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:37.892087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:37.893090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:37.893115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:37.893164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:37.893480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:37.893673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400209684065789:2762]
2025-10-15T10:54:37.896017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400206884359907:2534]
2025-10-15T10:54:37.896260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:37.899850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:37.903336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:37.903884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:37.906776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:37.911047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400206884359899:2851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:37.912880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:37.912907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:37.912917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:37.912923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:37.912931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:37.912939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:37.912946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:37.912954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:37.912961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:37.912968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:37.912977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:37.912985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.912992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.912999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.913059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:37.913192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:37.913245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:37.913298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:37.913352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:37.913405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:37.913457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:37.913509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:37.913560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:37.913614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:37.913664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:37.913712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.913763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.913810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.913887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:37.913966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:37.914035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:37.914094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:37.914144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:37.914201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:37.914252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:37.914309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:37.914361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:37.914419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:37.914468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:37.914524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:37.914580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:37.914642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:37.914687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:37.914748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:37.914801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:37.914865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:37.914915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:37.914975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:37.915025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:37.915079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:37.915128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.915186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:37.915236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.915294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:37.915374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.915437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:37.916018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:37.936628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400206884359899:2851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:37.936677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400206884359899:2851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:37.936695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400206884359899:2851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:37.936730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 29 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:37.957312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:37.969232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:37.969275Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:37.969297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:37.969320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:37.969346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 28 [2:7561400209684065789:2762]
2025-10-15T10:54:37.969405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:37.969470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:37.969487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.969503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.969514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.969567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:37.969592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:37.969615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:38.000287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:38.000317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:38.000326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:38.000336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:38.000592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:38.000609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:38.000749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:38.000897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:38.001072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:38.001137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400209684065783:2762]
2025-10-15T10:54:38.001149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400209684065783:2762]
2025-10-15T10:54:38.001160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400209684065783:2762]
2025-10-15T10:54:38.001198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:38.001269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:38.002987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 28
2025-10-15T10:54:38.003092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 28, pipe: [1:7561400206884359907:2534]
2025-10-15T10:54:38.003157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 28
2025-10-15T10:54:38.001449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:38.001472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:38.001587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400209684065783:2762]
2025-10-15T10:54:38.001605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:38.001834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:38.001846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:38.001871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:38.001894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:38.014823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400206884359933:2851], now have 1 active actors on pipe
2025-10-15T10:54:38.014874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400206884359907:2534], now have 1 active actors on pipe
2025-10-15T10:54:38.014899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400206884359859:2467], now have 1 active actors on pipe
2025-10-15T10:54:38.014973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:38.015001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:38.015106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:38.015123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:38.015234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:38.015273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.015291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.015302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:38.015343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.015417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:38.015507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:38.015595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:38.016022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:38.016043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:38.016080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400209684065783:2762]
2025-10-15T10:54:38.016094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400209684065783:2762]
2025-10-15T10:54:38.016129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:38.016892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:38.016909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:38.021740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:38.021784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:38.021892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:38.022402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 29 partition: 0 MaxSeqNo: 46 sessionId: src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0
2025-10-15T10:54:38.023433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf0a56-fcf4a797-58eb03e8-6e0d2ae3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:38.063173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0] Write session: try to update token
2025-10-15T10:54:38.063233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:38.094909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.095364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.095383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.095459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:38.095474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:38.095486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:38.095498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:38.095535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400209684065783:2762]
2025-10-15T10:54:38.095569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400209684065783:2762]
2025-10-15T10:54:38.095590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400209684065783:2762]
2025-10-15T10:54:38.095737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:38.095736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:38.095760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:38.095767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:38.095797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:38.108978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:38.270789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId: src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:38.294793Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:38.296688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:38.303093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:38.303368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:38.303387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:38.316792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400206884359907:2534]
2025-10-15T10:54:38.317003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 29 reason: error at write: Disconnected sessionId: src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0
2025-10-15T10:54:38.317371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 29 sessionId: src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0 is DEAD
2025-10-15T10:54:38.319550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:38.319595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0] Write session will restart in 0.005867s
2025-10-15T10:54:38.319687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0] Write session: Do CDS request
2025-10-15T10:54:38.319716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:38.337758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:38.340404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:38.343683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:38.343721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 30
2025-10-15T10:54:38.344656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:38.344799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 30 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:38.344816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=30 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:38.344824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:38.346310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 30 sessionId:  describe result for acl check
2025-10-15T10:54:38.346426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:38.346436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:38.346445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:38.346462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400211179327278:2862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:38.356511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400211179327278:2862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:38.382466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400211179327278:2862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:38.402257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:38.412390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:38.413278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:38.413298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:38.413339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:38.413593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:38.413768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400213979033184:2766]
2025-10-15T10:54:38.416089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:38.418353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400211179327278:2862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:38.418394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400211179327278:2862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:38.418414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400211179327278:2862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:38.418445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 30 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:38.418799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400211179327343:2534]
2025-10-15T10:54:38.418977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:38.420393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:38.420640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:38.421927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:38.422268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:38.422276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:38.422282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:38.422288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:38.422293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:38.422300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:38.422305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:38.422311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:38.422317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:38.422323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:38.422329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:38.422336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:38.422343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:38.422349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:38.422392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:38.422502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:38.422545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:38.422585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:38.422622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:38.422659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:38.422695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:38.422734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:38.422779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:38.422833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:38.422882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:38.422935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:38.422979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:38.423024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:38.423069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:38.423137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:38.423199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:38.423252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:38.423300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:38.424165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:38.424225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:38.424287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:38.424334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:38.424385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:38.424427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:38.424479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:38.424528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:38.424583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:38.424632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:38.424685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:38.424734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:38.424785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:38.424828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:38.424880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:38.424923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:38.424970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:38.425014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:38.425063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:38.425106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:38.425169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:38.425209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:38.425260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:38.425773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:38.458664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:38.487743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:38.487784Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:38.487798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:38.487819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:38.487843Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 29 [2:7561400213979033184:2766]
2025-10-15T10:54:38.487890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:38.487950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:38.487966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.487977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.487989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.488037Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:38.488060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:38.488082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:38.489975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:38.489992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:38.490007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:38.490018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:38.491708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 29
2025-10-15T10:54:38.491830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 29, pipe: [1:7561400211179327343:2534]
2025-10-15T10:54:38.491901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 29
2025-10-15T10:54:38.490891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:38.490925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:38.491061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:38.491237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:38.491464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:38.491562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400211179327342:2862], now have 1 active actors on pipe
2025-10-15T10:54:38.491584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400211179327343:2534], now have 1 active actors on pipe
2025-10-15T10:54:38.491604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400211179327264:2467], now have 1 active actors on pipe
2025-10-15T10:54:38.491630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.491645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.491657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.491696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:38.491769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:38.491946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:38.491961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:38.492078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.492095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:38.492524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:38.492547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:38.492557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:38.492582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:38.493771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:38.493804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:38.493913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:38.493926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:38.494022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:38.494059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.494081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.494090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:38.494127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.494175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:38.494240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:38.494313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:38.494659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:38.494676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:38.494707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.494719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.494750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:38.495334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:38.495361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:38.500151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:38.500188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:38.500269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:38.500779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 30 partition: 0 MaxSeqNo: 46 sessionId: src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0
2025-10-15T10:54:38.504057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4875d059-cec68e95-1d4ed7d6-d184afca_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:38.551164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0] Write session: try to update token
2025-10-15T10:54:38.551226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:38.682312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:38.682345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:38.682381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.682507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.682518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.682528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.682592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:38.683570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:38.696883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:38.700329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:38.701478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:38.816708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:38.818439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:54:38.818923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.818936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.818947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.818994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:54:38.945900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.945929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.945941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.945998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:38.946013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:38.946027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:38.946038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:38.946076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.946104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.946125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:38.946323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:38.946344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:38.947492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:38.947526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:38.947552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:38.972284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:39.014590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId: src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:39.070792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:39.260874Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:39.282313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:39.282357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:39.282415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:39.282428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:39.282440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:39.282478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:39.282501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400213979033178:2766]
2025-10-15T10:54:39.283513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:39.283556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:39.283596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:39.283627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:39.283654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:39.284805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:39.284832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:39.285682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400211179327343:2534]
2025-10-15T10:54:39.285788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:39.284890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:39.284935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:39.397988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400215474294738:2534]
2025-10-15T10:54:39.398144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:39.409633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:39.411653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 30 reason: error at write: Disconnected sessionId: src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0
2025-10-15T10:54:39.411933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 30 sessionId: src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0 is DEAD
2025-10-15T10:54:39.419587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:39.419644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0] Write session will restart in 0.006542s
2025-10-15T10:54:39.419760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0] Write session: Do CDS request
2025-10-15T10:54:39.419790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:39.419777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:39.420402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:39.420415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:39.420441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:39.420601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:39.420714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400218274000623:2778]
2025-10-15T10:54:39.422101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:39.426889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:39.427072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:39.428260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:39.428587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:39.428595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:39.428601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:39.428606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:39.428613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:39.428618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:39.428622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:39.428629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:39.428634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:39.428640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:39.428647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:39.428653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.428658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.428664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.428707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:39.428800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:39.428856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:39.428892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:39.428925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:39.428960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:39.428993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:39.429026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:39.429063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:39.429113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:39.429151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:39.429184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.429219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.429252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.429285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:39.429338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:39.429385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:39.429424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:39.429456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:39.429498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:39.429530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:39.429570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:39.429603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:39.429641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:39.432132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:39.431317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:39.431344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 31
2025-10-15T10:54:39.429672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:39.429712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:39.429746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:39.429784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:39.429814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:39.429851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:39.429895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:39.429934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:39.429965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:39.430007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:39.430039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:39.430077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:39.430125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.430166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.430201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.430242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.430275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.430317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.430708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:39.432756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:39.432890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 31 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:39.432905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=31 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:39.432916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:39.434537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 31 sessionId:  describe result for acl check
2025-10-15T10:54:39.434643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:39.434653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:39.434661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:39.434676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400215474294753:2873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:39.437191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400215474294753:2873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:39.445364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400215474294753:2873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:39.459731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:39.465591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400215474294753:2873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:39.465637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400215474294753:2873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:39.465655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400215474294753:2873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:39.465694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 31 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:39.470849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:39.470898Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:39.470918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:39.470939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:39.470966Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 30 [2:7561400218274000623:2778]
2025-10-15T10:54:39.471020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:39.471083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:39.471099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.471111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.471123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.471186Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:39.471211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:39.471234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:39.474698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 30
2025-10-15T10:54:39.474779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 30
2025-10-15T10:54:39.474867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 30, pipe: [1:7561400215474294738:2534]
2025-10-15T10:54:39.473235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.473261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.473276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.473288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:39.473614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:39.473654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.473809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.474026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.474280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:39.474368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400215474294778:2873], now have 1 active actors on pipe
2025-10-15T10:54:39.474393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400215474294685:2467], now have 1 active actors on pipe
2025-10-15T10:54:39.474416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400215474294738:2534], now have 1 active actors on pipe
2025-10-15T10:54:39.474443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400218274000617:2778]
2025-10-15T10:54:39.474459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400218274000617:2778]
2025-10-15T10:54:39.474474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400218274000617:2778]
2025-10-15T10:54:39.474515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:39.474595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:39.474778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:39.474799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:39.474926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400218274000617:2778]
2025-10-15T10:54:39.474946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:39.475816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:39.475837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:39.475848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:39.475873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:39.476929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:39.476962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:39.477078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:39.477095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:39.477201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:39.477236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.477257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.477268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:39.477325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.477372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:39.477463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:39.477542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:39.477955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:39.477972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:39.478005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400218274000617:2778]
2025-10-15T10:54:39.478019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400218274000617:2778]
2025-10-15T10:54:39.478051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:39.478650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:39.478665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:39.479635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:39.479663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:39.479733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:39.480079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 31 partition: 0 MaxSeqNo: 46 sessionId: src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0
2025-10-15T10:54:39.483674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede3e64-aed4ac5f-58907c45-6ea48946_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:39.545565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0] Write session: try to update token
2025-10-15T10:54:39.545627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:39.626124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.626152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.626164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.626221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:39.626235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:39.626246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:39.626256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:39.626290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400218274000617:2778]
2025-10-15T10:54:39.626313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400218274000617:2778]
2025-10-15T10:54:39.626335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400218274000617:2778]
2025-10-15T10:54:39.626478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:39.626501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:39.627523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:39.629179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:39.629226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:39.629264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:39.629302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:39.824931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId: src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:39.848386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:39.846392Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:39.857074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:39.857106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:39.860184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:39.860486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400215474294738:2534]
2025-10-15T10:54:39.865675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 31 reason: error at write: Disconnected sessionId: src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0
2025-10-15T10:54:39.866043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 31 sessionId: src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0 is DEAD
2025-10-15T10:54:39.871836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:39.871903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0] Write session will restart in 0.007239s
2025-10-15T10:54:39.871990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0] Write session: Do CDS request
2025-10-15T10:54:39.872017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:39.926409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:39.930732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:39.931492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:39.931523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 32
2025-10-15T10:54:39.936143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:39.936433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 32 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:39.936474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=32 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:39.936491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:39.944541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 32 sessionId:  describe result for acl check
2025-10-15T10:54:39.944659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:39.944669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:39.944678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:39.944692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400215474294844:2878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:39.947086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400215474294844:2878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:39.957879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400215474294844:2878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:39.961554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400215474294870:2534]
2025-10-15T10:54:39.961761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:39.967317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:39.971305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400215474294844:2878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:39.971370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400215474294844:2878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:39.971386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400215474294844:2878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:39.971415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 32 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:39.973637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:39.974421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:39.974451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:39.974493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:39.974722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:39.974881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400218274000711:2785]
2025-10-15T10:54:39.977007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:39.978541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:39.978740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:39.979949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:39.980284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:39.980303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:39.980310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:39.980318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:39.980324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:39.980331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:39.980336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:39.980342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:39.980348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:39.980354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:39.980361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:39.980367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.980373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.980379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.980422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:39.980519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:39.980562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:39.980605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:39.980644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:39.980688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:39.980733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:39.980776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:39.980819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:39.980859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:39.980902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:39.980942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.980984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.981024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.981065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:39.981129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:39.981181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:39.981227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:39.981270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:39.981315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:39.981355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:39.981402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:39.981447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:39.981494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:39.981531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:39.981576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:39.981618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:39.981664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:39.981702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:39.981749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:39.981792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:39.981843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:39.981880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:39.981943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:39.981983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:39.982029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:39.982069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.982113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:39.982154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.982200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:39.982241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.982288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:39.982732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:40.005669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:40.015143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:40.015186Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:40.015201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:40.015220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:40.015242Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 31 [2:7561400218274000711:2785]
2025-10-15T10:54:40.015289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:40.015342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:40.015447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.015462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.015472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.015522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:40.015544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:40.015564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:40.016604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:40.016627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:40.016638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:40.016648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:40.016910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:40.016943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:40.017060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:40.017221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:40.017422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:40.017495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.017516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.017528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.017568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:40.017642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:40.017815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:40.017837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:40.017960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.017985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:40.018239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:40.018255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:40.018265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:40.018285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:40.019383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 31, pipe: [1:7561400215474294870:2534]
2025-10-15T10:54:40.019501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 31
2025-10-15T10:54:40.019584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 31
2025-10-15T10:54:40.030492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400215474294799:2467], now have 1 active actors on pipe
2025-10-15T10:54:40.030550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400215474294876:2878], now have 1 active actors on pipe
2025-10-15T10:54:40.030573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400215474294870:2534], now have 1 active actors on pipe
2025-10-15T10:54:40.030682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:40.030708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:40.030788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:40.030812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:40.030902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4226e47-77f79475-4b28f4c1-abd78557_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:40.030941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.030964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.030975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:40.031011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.031054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:40.031127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:40.031189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:40.031571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:40.031590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:40.031624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.031636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.031673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:40.031916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:40.031929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:40.036239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:40.036275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:40.036360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:40.036892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 32 partition: 0 MaxSeqNo: 46 sessionId: src_id|4226e47-77f79475-4b28f4c1-abd78557_0
2025-10-15T10:54:40.039922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba46ddb-7dc375a5-b1e008d4-b2800d83_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4226e47-77f79475-4b28f4c1-abd78557_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:40.097137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4226e47-77f79475-4b28f4c1-abd78557_0] Write session: try to update token
2025-10-15T10:54:40.097192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4226e47-77f79475-4b28f4c1-abd78557_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:40.310176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.310200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.310213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.310265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:40.310279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:40.310290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:40.310302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:40.310333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.310358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.310379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.310579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:40.310599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:40.315499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:40.315548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:40.315588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:40.319639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:40.324447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: src_id|4226e47-77f79475-4b28f4c1-abd78557_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:40.391799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:40.541448Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:40.613781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:40.613818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:40.613874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:40.613885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:40.613934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.614012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:40.614022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:40.614032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:40.614057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.614077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400218274000704:2785]
2025-10-15T10:54:40.614139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:40.614177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:40.614209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:40.614288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:40.614313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:40.614343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:40.614365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:40.627483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:40.627511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:40.684633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:40.684666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:40.700078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 32 reason: error at write: Disconnected sessionId: src_id|4226e47-77f79475-4b28f4c1-abd78557_0
2025-10-15T10:54:40.700378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 32 sessionId: src_id|4226e47-77f79475-4b28f4c1-abd78557_0 is DEAD
2025-10-15T10:54:40.707628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4226e47-77f79475-4b28f4c1-abd78557_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:40.707681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4226e47-77f79475-4b28f4c1-abd78557_0] Write session will restart in 0.006937s
2025-10-15T10:54:40.707783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4226e47-77f79475-4b28f4c1-abd78557_0] Write session: Do CDS request
2025-10-15T10:54:40.707812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4226e47-77f79475-4b28f4c1-abd78557_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:40.728800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4226e47-77f79475-4b28f4c1-abd78557_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:40.729672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400215474294870:2534]
2025-10-15T10:54:40.729768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:40.729824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:40.729836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 33
2025-10-15T10:54:40.741745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:40.741939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 33 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:40.741955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=33 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:40.741966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:40.743758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 33 sessionId:  describe result for acl check
2025-10-15T10:54:40.743864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:40.743874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:40.743884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:40.743899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400219769262231:2890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:40.746250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400219769262231:2890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:40.766565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400219769262231:2890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:40.783114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400219769262231:2890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:40.783152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400219769262231:2890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:40.783167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400219769262231:2890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:40.783193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 33 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:40.811796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:40.812358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:40.813045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:40.813062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:40.813102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:40.813319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:40.813466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400222568968123:2795]
2025-10-15T10:54:40.816621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:40.820953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:40.821161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:40.822372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:40.822677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:40.822684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:40.822691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:40.822696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:40.822701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:40.822708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:40.822713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:40.822719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:40.822726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:40.822732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:40.822738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:40.822745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:40.822751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:40.822757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:40.822800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:40.822895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:40.822936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:40.822977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:40.823020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:40.823063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:40.823105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:40.823146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:40.823187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:40.823226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:40.823267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:40.823309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:40.823369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:40.823410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:40.823453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:40.823526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:40.823576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:40.823628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:40.823670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:40.823722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:40.823777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:40.823823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:40.823866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:40.823911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:40.823949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:40.823991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:40.824030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:40.824077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:40.824121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:40.824166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:40.824208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:40.824254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:40.824290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:40.824333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:40.824373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:40.824415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:40.824461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:40.824506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:40.824542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:40.824586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:40.824620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:40.824663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:40.827844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400219769262302:2534]
2025-10-15T10:54:40.828010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:40.831160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:40.855011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:40.876589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:40.876670Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:40.876687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:40.876703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:40.876722Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 32 [2:7561400222568968123:2795]
2025-10-15T10:54:40.876764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:40.876814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:40.876828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.876839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.876853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.876898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:40.876917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:40.876935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:40.879587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:40.879604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:40.879616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:40.879626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:40.879874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:40.879889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:40.880007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:40.880175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:40.880381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:40.880445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:40.880457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:40.880468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:40.880510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:40.880575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:40.880727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:40.880743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:40.880857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:40.880875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:40.881094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:40.881104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:40.881115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:40.881135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:40.883421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400219769262226:2467], now have 1 active actors on pipe
2025-10-15T10:54:40.883453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400219769262302:2534], now have 1 active actors on pipe
2025-10-15T10:54:40.883499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400219769262271:2890], now have 1 active actors on pipe
2025-10-15T10:54:40.884714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 32
2025-10-15T10:54:40.884842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 32, pipe: [1:7561400219769262302:2534]
2025-10-15T10:54:40.884902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 32
2025-10-15T10:54:40.887470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:40.887501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:40.887555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:40.887569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:40.887660Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:40.887690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.887705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.887714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:40.887746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.887782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:40.887841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:40.887892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:40.888230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:40.888247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:40.888280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:40.888292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:40.888323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:40.889075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:40.889091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:40.896701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:40.896761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:40.896832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:40.978011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.978034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.978044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.056986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 33 partition: 0 MaxSeqNo: 46 sessionId: src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0
2025-10-15T10:54:41.064566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4226e47-77f79475-4b28f4c1-abd78557_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:41.085926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:41.085950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:41.085961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:41.085970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:41.085998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:41.086018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:41.086036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:41.086172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.086182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.086192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.086272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:41.086292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:41.087330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:41.088466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:41.088506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:41.088539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:41.088563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:41.088588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:41.178123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0] Write session: try to update token
2025-10-15T10:54:41.178188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:41.362177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:41.395622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:41.395660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:41.395719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400222568968117:2795]
2025-10-15T10:54:41.400171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:41.400214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:41.403694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:41.403842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400219769262302:2534]
2025-10-15T10:54:41.403909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:41.403919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:41.403963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 33 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0
2025-10-15T10:54:41.404209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 33 sessionId: src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0 is DEAD
2025-10-15T10:54:41.466248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:41.480123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:54:41.480170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0] Write session will restart in 0.008587s
2025-10-15T10:54:41.480271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0] Write session: Do CDS request
2025-10-15T10:54:41.480301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:41.494835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:41.499401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:41.498755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:41.498785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 34
2025-10-15T10:54:41.500201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:41.500345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 34 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:41.500363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=34 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:41.500374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:41.501993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 34 sessionId:  describe result for acl check
2025-10-15T10:54:41.502117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:41.502127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:41.502138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:41.502155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400224064229691:2898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:41.504703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:41.505576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:41.505596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:41.505641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:41.505929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:41.506113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400226863935548:2806]
2025-10-15T10:54:41.507676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400224064229692:2534]
2025-10-15T10:54:41.507861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:41.511207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400224064229691:2898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:41.512385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:41.514768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:41.515056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:41.516636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:41.516998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:41.517006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:41.517014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:41.517021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:41.517028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:41.517036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:41.517044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:41.517050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:41.517057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:41.517065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:41.517072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:41.517079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:41.517086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:41.517094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:41.517144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:41.517264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:41.517316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:41.517366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:41.517410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:41.517457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:41.517505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:41.517551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:41.517598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:41.517644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:41.517692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:41.517734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:41.517777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:41.517825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:41.517871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:41.517956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:41.518012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:41.518066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:41.518114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:41.518173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:41.518218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:41.518272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:41.518319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:41.518374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:41.518420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:41.518476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:41.518523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:41.518577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:41.518622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:41.518677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:41.518728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:41.518784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:41.518830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:41.518884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:41.518933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:41.518986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:41.519029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:41.519084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:41.519131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:41.519182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:41.519229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:41.519283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:41.526046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:41.544252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400224064229691:2898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:41.555734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:41.568751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400224064229691:2898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:41.568791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400224064229691:2898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:41.568806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400224064229691:2898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:41.568833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 34 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:41.596186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:41.596233Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:41.596251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:41.596273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:41.596298Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 33 [2:7561400226863935548:2806]
2025-10-15T10:54:41.596353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:41.596420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:41.596436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.596450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.596462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.596515Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:41.596537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:41.596559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:41.597732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:41.597750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:41.604953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 33
2025-10-15T10:54:41.605070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 33, pipe: [1:7561400224064229692:2534]
2025-10-15T10:54:41.605135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 33
2025-10-15T10:54:41.597762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:41.597772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:41.598064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:41.598080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:41.598235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:41.598441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:41.598668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:41.598738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:41.598751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:41.598763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:41.598801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:41.598873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:41.599061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:41.599080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:41.599216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:41.599236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:41.599517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:41.599531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:41.599542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:41.599567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:41.605347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400224064229724:2898], now have 1 active actors on pipe
2025-10-15T10:54:41.605381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400224064229692:2534], now have 1 active actors on pipe
2025-10-15T10:54:41.605404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400224064229631:2467], now have 1 active actors on pipe
2025-10-15T10:54:41.614345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:41.614389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:41.614508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:41.614525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:41.614640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:41.614679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.614701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.614713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:41.614755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.614808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:41.614877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:41.614967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:41.615393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:41.615414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:41.615451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:41.615464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:41.615494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:41.619649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:41.619667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:41.624945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:41.624988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:41.625083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:41.626372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 34 partition: 0 MaxSeqNo: 46 sessionId: src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0
2025-10-15T10:54:41.628771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6142ceb4-7cdd5042-26f4ddbf-cdf8517b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:41.688843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0] Write session: try to update token
2025-10-15T10:54:41.688914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:41.698609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.698641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.698654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.851455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId: src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:41.910548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:41.910579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:41.910594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:41.910604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:41.910641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:41.910665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:41.910685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:41.910921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.910934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.910947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.911020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:41.911039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:41.911453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:41.911484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:41.911506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:41.912376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:41.924023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:42.194371Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:42.238323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:42.238375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:42.238447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:42.238463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:42.238503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:42.238600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:42.238611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:42.238618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:42.238641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:42.238663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400226863935542:2806]
2025-10-15T10:54:42.239555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:42.239617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:42.239654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:42.239687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:42.239718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:42.239743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:42.243527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:42.243719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:42.243733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:42.248767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:42.248828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:42.286023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400224064229692:2534]
2025-10-15T10:54:42.286122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 34 reason: error at write: Disconnected sessionId: src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0
2025-10-15T10:54:42.286379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 34 sessionId: src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0 is DEAD
2025-10-15T10:54:42.291772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:42.291803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0] Write session will restart in 0.009301s
2025-10-15T10:54:42.291871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0] Write session: Do CDS request
2025-10-15T10:54:42.291891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:42.307929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:42.352965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:42.352994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 35
2025-10-15T10:54:42.355662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:42.355917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 35 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:42.355945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=35 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:42.355967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:42.388046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400228359197074:2534]
2025-10-15T10:54:42.388224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:42.389312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 35 sessionId:  describe result for acl check
2025-10-15T10:54:42.389426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:42.389437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:42.389446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:42.389464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400228359197076:2909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:42.395505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400228359197076:2909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:42.421330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400228359197076:2909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:42.472305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:42.477184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:42.478099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:42.478116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:42.478158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:42.478410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:42.478583Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400231158902963:2814]
2025-10-15T10:54:42.488844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:42.498130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400228359197076:2909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:42.498173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400228359197076:2909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:42.498192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400228359197076:2909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:42.498231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 35 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:42.498799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:42.499100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:42.500421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:42.500797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:42.500806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:42.500813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:42.500819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:42.500825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:42.500831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:42.500838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:42.500845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:42.500851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:42.500857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:42.500863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:42.500871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:42.500878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:42.500885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:42.500932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:42.501038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:42.501087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:42.501134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:42.501178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:42.501225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:42.501274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:42.501319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:42.501366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:42.501413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:42.501457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:42.501501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:42.501560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:42.501609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:42.501651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:42.501716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:42.501775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:42.501830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:42.501879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:42.501943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:42.501989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:42.502045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:42.502095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:42.502150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:42.502196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:42.502252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:42.502299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:42.502352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:42.502396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:42.502447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:42.502495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:42.502546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:42.502589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:42.504530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:42.504624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:42.504691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:42.504739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:42.504792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:42.504840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:42.504897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:42.504954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:42.505011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:42.505582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:42.546303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:42.576490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:42.576559Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:42.576578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:42.576599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:42.576637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 34 [2:7561400231158902963:2814]
2025-10-15T10:54:42.576691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:42.576756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:42.576771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.576785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.576795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.576851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:42.576875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:42.576897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:42.579044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:42.579062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:42.579077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:42.579088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:42.579368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:42.579387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:42.581254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 34, pipe: [1:7561400228359197074:2534]
2025-10-15T10:54:42.581350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 34
2025-10-15T10:54:42.581413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 34
2025-10-15T10:54:42.586914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:42.587151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:42.587408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:42.587516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400228359197074:2534], now have 1 active actors on pipe
2025-10-15T10:54:42.587542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400228359197060:2467], now have 1 active actors on pipe
2025-10-15T10:54:42.587566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400228359197154:2909], now have 1 active actors on pipe
2025-10-15T10:54:42.587679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:42.587705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:42.587792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:42.587808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:42.587845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400231158902957:2814]
2025-10-15T10:54:42.587862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400231158902957:2814]
2025-10-15T10:54:42.587875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400231158902957:2814]
2025-10-15T10:54:42.587920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:42.588006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:42.588199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:42.588216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:42.588301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:42.588335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.588355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.588365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:42.588403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.588451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:42.588578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400231158902957:2814]
2025-10-15T10:54:42.588600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:42.588671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:42.588818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:42.589201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:42.589216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:42.590340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400231158902957:2814]
2025-10-15T10:54:42.590356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400231158902957:2814]
2025-10-15T10:54:42.590378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:42.591617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:42.591639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:42.591651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:42.591681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:42.591700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:42.591710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:42.597129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:42.597170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:42.597278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:42.597907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 35 partition: 0 MaxSeqNo: 46 sessionId: src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0
2025-10-15T10:54:42.603789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d32536d-f3ea179e-9cb830b9-88ae019b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:42.678360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.678390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.678412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.708770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0] Write session: try to update token
2025-10-15T10:54:42.708829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:42.810280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.810313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.810324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.810384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:42.810399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:42.810413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:42.810425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:42.810460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400231158902957:2814]
2025-10-15T10:54:42.810487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400231158902957:2814]
2025-10-15T10:54:42.810509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400231158902957:2814]
2025-10-15T10:54:42.810651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:42.810673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:42.811862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:42.811923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:42.811967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:42.812006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:42.812041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:42.813301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:43.004290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId: src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:43.026558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:43.091503Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:43.113666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:43.113716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:43.118397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400228359197074:2534]
2025-10-15T10:54:43.122179Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:43.122207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:43.118453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:43.118573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:43.118584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:43.140907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 35 reason: error at write: Disconnected sessionId: src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0
2025-10-15T10:54:43.141275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 35 sessionId: src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0 is DEAD
2025-10-15T10:54:43.144236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:43.144302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0] Write session will restart in 0.005677s
2025-10-15T10:54:43.144482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0] Write session: Do CDS request
2025-10-15T10:54:43.144535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:43.158403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:43.158429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 36
2025-10-15T10:54:43.159261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:43.159967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:43.160091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 36 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:43.160109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=36 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:43.160120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:43.161613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 36 sessionId:  describe result for acl check
2025-10-15T10:54:43.161726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:43.161736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:43.161746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:43.161762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400232654164506:2918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:43.164308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400232654164506:2918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:43.184536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400232654164506:2918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:43.203075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400232654164506:2918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:43.203123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400232654164506:2918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:43.203142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400232654164506:2918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:43.203179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 36 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:43.217415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400232654164575:2534]
2025-10-15T10:54:43.217622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:43.220518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:43.226385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:43.227197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:43.227215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:43.227261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:43.227536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:43.227712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400235453870378:2825]
2025-10-15T10:54:43.229721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:43.234666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:43.234861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:43.236167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:43.236530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:43.236555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:43.236562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:43.236568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:43.236574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:43.236579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:43.236585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:43.236592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:43.236598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:43.236605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:43.236611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:43.236617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.236624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.236631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.236674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:43.236771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:43.236822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:43.236866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:43.236912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:43.236955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:43.236997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:43.237052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:43.237192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:43.237250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:43.237300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:43.237342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.237387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.237431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.237474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:43.237534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:43.237588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:43.237638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:43.237683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:43.237732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:43.237774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:43.237820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:43.237861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:43.237909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:43.237964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:43.238012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:43.238052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:43.238100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:43.238140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:43.238184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:43.238222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:43.238268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:43.238308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:43.238355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:43.238395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:43.238442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:43.238481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.238528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.238572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.238614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.238653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.238702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.239174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:43.267259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:43.305189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:43.305225Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:43.305239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:43.305256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:43.305277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 35 [2:7561400235453870378:2825]
2025-10-15T10:54:43.305320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:43.305370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:43.305382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.305391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.305401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.305443Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:43.305464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:43.305482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:43.306392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.306404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.306414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.306425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:43.306663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:43.306679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.306805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.306963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.307166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:43.307224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.307237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.307247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.307283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:43.307343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:43.307519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:43.307534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:43.307633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.307649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:43.310342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 35
2025-10-15T10:54:43.310449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 35, pipe: [1:7561400232654164575:2534]
2025-10-15T10:54:43.310501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 35
2025-10-15T10:54:43.308575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:43.308590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:43.308603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:43.308626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:43.314214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400232654164492:2467], now have 1 active actors on pipe
2025-10-15T10:54:43.314249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400232654164575:2534], now have 1 active actors on pipe
2025-10-15T10:54:43.314268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400232654164562:2918], now have 1 active actors on pipe
2025-10-15T10:54:43.314368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:43.314385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:43.314434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:43.314448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:43.314506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7be3f304-472413c7-49db6f6f-45f8947b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:43.314526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.314537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.314543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:43.314571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.314614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:43.314655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:43.314691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:43.314987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:43.314997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:43.315018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.315025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.315047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:43.315731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:43.315748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:43.320252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:43.320284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:43.320362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:43.320978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 36 partition: 0 MaxSeqNo: 46 sessionId: src_id|7be3f304-472413c7-49db6f6f-45f8947b_0
2025-10-15T10:54:43.324111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc703bb-9f750667-8781cf3f-b628d37f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7be3f304-472413c7-49db6f6f-45f8947b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:43.382997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be3f304-472413c7-49db6f6f-45f8947b_0] Write session: try to update token
2025-10-15T10:54:43.383065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be3f304-472413c7-49db6f6f-45f8947b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:43.473829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.473856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.473869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.473922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:43.473948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:43.473962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:43.473971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:43.474008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.474032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.474054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.474196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:43.474229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:43.474266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:43.484837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:43.484869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:43.500286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:43.628434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId: src_id|7be3f304-472413c7-49db6f6f-45f8947b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:43.689364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:43.777665Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:43.789132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:43.789178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:43.791630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:43.791680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:43.791759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400235453870372:2825]
2025-10-15T10:54:43.790669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400232654164575:2534]
2025-10-15T10:54:43.790772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:43.790785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:43.795668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:43.795751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:43.798039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:43.798092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:43.883172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:43.883300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 36 reason: error at write: Disconnected sessionId: src_id|7be3f304-472413c7-49db6f6f-45f8947b_0
2025-10-15T10:54:43.883615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 36 sessionId: src_id|7be3f304-472413c7-49db6f6f-45f8947b_0 is DEAD
2025-10-15T10:54:43.887583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be3f304-472413c7-49db6f6f-45f8947b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:43.887620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be3f304-472413c7-49db6f6f-45f8947b_0] Write session will restart in 0.005155s
2025-10-15T10:54:43.887716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be3f304-472413c7-49db6f6f-45f8947b_0] Write session: Do CDS request
2025-10-15T10:54:43.887755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be3f304-472413c7-49db6f6f-45f8947b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:43.891711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400232654164681:2534]
2025-10-15T10:54:43.891872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:43.893096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:43.900336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:43.901104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:43.901120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:43.901158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:43.901399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:43.901562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400235453870488:2829]
2025-10-15T10:54:43.903613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:43.903637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 37
2025-10-15T10:54:43.903852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be3f304-472413c7-49db6f6f-45f8947b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:43.904258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:43.904359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 37 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:43.904372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=37 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:43.904380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:43.903711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:43.906283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 37 sessionId:  describe result for acl check
2025-10-15T10:54:43.906388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:43.906397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:43.906405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:43.906419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400232654164690:2932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:43.908866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400232654164690:2932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:43.907627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:43.907849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:43.909009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:43.909306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:43.909313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:43.909319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:43.909324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:43.909331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:43.909337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:43.909343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:43.909349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:43.909355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:43.909363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:43.909370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:43.909376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.909382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.909388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.909431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:43.909529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:43.909573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:43.909614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:43.909655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:43.909697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:43.909739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:43.909781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:43.909822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:43.909865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:43.909905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:43.909958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.909999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.910042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.910082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:43.910140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:43.910194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:43.910246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:43.910291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:43.910342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:43.910384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:43.910436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:43.910483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:43.910532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:43.910573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:43.910623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:43.910670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:43.910719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:43.910759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:43.910810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:43.910853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:43.910931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:43.910985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:43.911039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:43.911082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:43.911132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:43.911176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.911225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.911266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.911318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.918632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400232654164690:2932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:43.932872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400232654164690:2932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:43.932905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400232654164690:2932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:43.932922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400232654164690:2932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:43.932952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 37 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:43.925878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.925980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.926536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:43.959956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:43.985075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:43.985118Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:43.985135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:43.985156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:43.985179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 36 [2:7561400235453870488:2829]
2025-10-15T10:54:43.985228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:43.985280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:43.985294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.985305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.985316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.985361Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:43.985381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:43.985400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:43.987156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.987171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.987184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.987195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:43.988566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 36, pipe: [1:7561400232654164681:2534]
2025-10-15T10:54:43.988633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 36
2025-10-15T10:54:43.988693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 36
2025-10-15T10:54:43.991637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:43.991671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:43.991820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:43.992002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:43.992232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:43.992319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400232654164681:2534], now have 1 active actors on pipe
2025-10-15T10:54:43.992343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400232654164720:2932], now have 1 active actors on pipe
2025-10-15T10:54:43.992364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400232654164675:2467], now have 1 active actors on pipe
2025-10-15T10:54:43.992455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:43.992478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:43.992534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:43.992551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:43.992600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:43.992615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:43.992627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:43.992669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:43.992739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:43.992914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:43.992931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:43.993002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:43.993032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.993048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.993057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:43.993089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.993125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:43.993254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:43.993272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:43.993326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:43.993442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:43.993789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:43.993805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:43.993850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:43.993862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:43.993881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:43.994763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:43.994782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:43.994792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:43.994816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:43.994832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:43.994842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:43.996331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:43.996358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:43.996434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:43.998048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 37 partition: 0 MaxSeqNo: 46 sessionId: src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0
2025-10-15T10:54:43.998823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be3f304-472413c7-49db6f6f-45f8947b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:44.040744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0] Write session: try to update token
2025-10-15T10:54:44.040800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:44.088263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.088288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.088299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.317992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId: src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:44.341169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.341195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.341204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.341250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:44.341263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:44.341277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:44.341287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:44.341315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:44.341337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:44.341357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:44.341426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:44.341457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:44.341484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:44.341523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:44.341539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:44.342661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:44.380467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:44.514328Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:44.544531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:44.544564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:44.544611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:44.544623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:44.544653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400235453870482:2829]
2025-10-15T10:54:44.547594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:44.549214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:44.549265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:44.552397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:44.552573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400232654164681:2534]
2025-10-15T10:54:44.552433Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:44.552462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:44.594614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 37 reason: error at write: Disconnected sessionId: src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0
2025-10-15T10:54:44.595280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:44.595312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0] Write session will restart in 0.008623s
2025-10-15T10:54:44.595416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0] Write session: Do CDS request
2025-10-15T10:54:44.595446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:44.596024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 37 sessionId: src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0 is DEAD
2025-10-15T10:54:44.608876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:44.608903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 38
2025-10-15T10:54:44.610611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:44.612456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:44.612606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 38 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:44.612621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=38 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:44.612630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:44.613994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 38 sessionId:  describe result for acl check
2025-10-15T10:54:44.614099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:44.614109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:44.614117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:44.614131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400236949132071:2940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:44.616710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400236949132071:2940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:44.652576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400236949132071:2940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:44.656735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400236949132118:2534]
2025-10-15T10:54:44.656883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:44.664855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400236949132071:2940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:44.664916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400236949132071:2940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:44.664935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400236949132071:2940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:44.664964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 38 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:44.684802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:44.695616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:44.696521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:44.696537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:44.696581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:44.696854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:44.697056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400239748837916:2841]
2025-10-15T10:54:44.699191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:44.704556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:44.704842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:44.706231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:44.706565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:44.706573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:44.706580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:44.706586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:44.706592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:44.706598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:44.706604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:44.706609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:44.706615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:44.706621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:44.706627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:44.706633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:44.706639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:44.706645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:44.706691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:44.706804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:44.706853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:44.706899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:44.706948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:44.706993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:44.707038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:44.707084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:44.707131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:44.707179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:44.707227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:44.707272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:44.707318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:44.708065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:44.708134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:44.708205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:44.708271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:44.708328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:44.708377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:44.708430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:44.708480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:44.708533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:44.708584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:44.708639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:44.708687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:44.708742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:44.708789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:44.708842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:44.708887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:44.708942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:44.708989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:44.709044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:44.709086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:44.709137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:44.709182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:44.709236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:44.709283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:44.709333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:44.709378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:44.709435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:44.709480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:44.709533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:44.710082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:44.776071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:44.785737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:44.785781Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:44.785801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:44.785823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:44.785850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 37 [2:7561400239748837916:2841]
2025-10-15T10:54:44.785907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:44.785985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:44.786002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.786016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.786028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.786084Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:44.786108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:44.786135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:44.787287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:44.787305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:44.787319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:44.787332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:44.788105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:44.788135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:44.788290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:44.788480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:44.788711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:44.788785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:44.788800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:44.788812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:44.788857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:44.788936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:44.789130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:44.789149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:44.789279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:44.789301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:44.789547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:44.789562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:44.789575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:44.789599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:44.791206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 37
2025-10-15T10:54:44.791361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 37, pipe: [1:7561400236949132118:2534]
2025-10-15T10:54:44.791461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 37
2025-10-15T10:54:44.791651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400236949132046:2467], now have 1 active actors on pipe
2025-10-15T10:54:44.791686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400236949132118:2534], now have 1 active actors on pipe
2025-10-15T10:54:44.791708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400236949132140:2940], now have 1 active actors on pipe
2025-10-15T10:54:44.795235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:44.795261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:44.795308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:44.795317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:44.795412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:44.795436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.795449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.795456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:44.795487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.795535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:44.795603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:44.795642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:44.795938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:44.795950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:44.795974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:44.795984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:44.796007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:44.796252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:44.796261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:44.800073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:44.800107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:44.800194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:44.800794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 38 partition: 0 MaxSeqNo: 46 sessionId: src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0
2025-10-15T10:54:44.801648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d430ff2a-83e0cef1-ee0a185a-8b8f253e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:44.861844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0] Write session: try to update token
2025-10-15T10:54:44.861904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0] Send 10 message(s) (0 left), first sequence number is 47
E1015 10:54:45.058345173  824924 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:54:45.063784Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:54:45.089665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.089694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.089708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.089760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:45.089774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:45.089789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:45.089801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:45.089835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:45.089862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:45.089884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:45.090117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:45.090138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:45.090689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:45.090723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:45.090749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:45.091104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:45.121531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId: src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:45.158681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:45.287640Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:45.414038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:45.414192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:45.414262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:45.414275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:45.414315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:45.414394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:45.414405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:45.414414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:45.414439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:45.414460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400239748837910:2841]
2025-10-15T10:54:45.414913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:45.414967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:45.414999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:45.415031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:45.415063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:45.415090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:45.416110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:45.416164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:45.419929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:45.420188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:45.423799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400236949132118:2534]
2025-10-15T10:54:45.428077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 38 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0
2025-10-15T10:54:45.428354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 38 sessionId: src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0 is DEAD
2025-10-15T10:54:45.434781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:54:45.434822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0] Write session will restart in 0.007228s
2025-10-15T10:54:45.434910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0] Write session: Do CDS request
2025-10-15T10:54:45.434932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:45.461559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:45.464175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:45.464205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 39
2025-10-15T10:54:45.465854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:45.466027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 39 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:45.466050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=39 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:45.466060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:45.468806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 39 sessionId:  describe result for acl check
2025-10-15T10:54:45.468933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:45.468945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:45.468955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:45.468972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400241244099476:2945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:45.477013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400241244099476:2945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:45.487366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400241244099476:2945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:45.521294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400241244099476:2945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:45.521338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400241244099476:2945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:45.521358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400241244099476:2945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:45.521393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 39 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:45.522741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400241244099550:2534]
2025-10-15T10:54:45.522915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:45.528655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:45.535791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:45.536604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:45.536622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:45.536662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:45.536908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:45.537083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400244043805326:2848]
2025-10-15T10:54:45.539285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:45.540716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:45.540921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:45.542143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:45.542463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:45.542469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:45.542476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:45.542481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:45.542488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:45.542494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:45.542501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:45.542507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:45.542513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:45.542519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:45.542527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:45.542534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:45.542542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:45.542548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:45.542592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:45.542689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:45.542738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:45.542781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:45.542823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:45.542868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:45.542912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:45.542956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:45.542998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:45.543039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:45.543079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:45.543121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:45.543165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:45.543206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:45.543246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:45.543308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:45.543380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:45.543432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:45.543476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:45.543528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:45.543570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:45.543616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:45.543658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:45.543710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:45.543752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:45.543802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:45.543844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:45.543893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:45.543936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:45.543984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:45.544030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:45.544081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:45.544119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:45.544170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:45.544210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:45.544255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:45.544299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:45.544348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:45.544388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:45.544432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:45.544472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:45.544519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:45.545004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:45.626481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:45.660559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:45.660593Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:45.660607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:45.660623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:45.660643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 38 [2:7561400244043805326:2848]
2025-10-15T10:54:45.660689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:45.660737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:45.660751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.660761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.660771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.660813Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:45.660834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:45.660851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:45.664153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:45.664175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:45.664188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:45.664198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:45.664435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:45.664451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:45.664578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:45.664747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:45.664960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:45.665021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:45.665034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:45.665046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:45.665076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:45.665141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:45.665308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:45.665324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:45.665431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:45.665447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:45.666185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:45.666197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:45.666207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:45.666228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:45.668126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400241244099548:2945], now have 1 active actors on pipe
2025-10-15T10:54:45.668157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400241244099465:2467], now have 1 active actors on pipe
2025-10-15T10:54:45.668177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400241244099550:2534], now have 1 active actors on pipe
2025-10-15T10:54:45.667626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 38
2025-10-15T10:54:45.668222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:45.668241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:45.667705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 38
2025-10-15T10:54:45.668318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:45.668349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.667786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 38, pipe: [1:7561400241244099550:2534]
2025-10-15T10:54:45.668365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.668374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:45.668406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.668445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:45.668489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:45.675605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:45.675643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:45.675702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:45.675713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:45.675822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:45.675877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:45.676216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:45.676233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:45.676265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:45.676278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:45.676311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:45.676650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:45.676660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:45.680564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f821c6-ea1f8ac4-1d1d8f54-4bb1d7e8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:45.679753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 39 partition: 0 MaxSeqNo: 46 sessionId: src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0
2025-10-15T10:54:45.733491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0] Write session: try to update token
2025-10-15T10:54:45.733551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:45.848785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.848814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.848825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.848923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:45.848936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:45.848948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:45.848957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:45.848987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:45.849009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:45.849028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:45.849414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:45.849446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:45.849477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:45.849502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:45.849527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:45.961678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:45.961709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:45.963483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId: src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:45.973111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:46.051434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:46.289146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:46.291046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:46.291062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:46.291097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400244043805321:2848]
2025-10-15T10:54:46.291186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:46.291216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:46.299793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:46.299832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:46.310844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:46.310872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:46.334077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:46.334200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400241244099550:2534]
2025-10-15T10:54:46.334256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 39 reason: error at write: Disconnected sessionId: src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0
2025-10-15T10:54:46.334548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 39 sessionId: src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0 is DEAD
2025-10-15T10:54:46.347451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:46.347503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0] Write session will restart in 0.005446s
2025-10-15T10:54:46.347580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0] Write session: Do CDS request
2025-10-15T10:54:46.351454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:46.364725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:46.368234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:46.368263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:46.412126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:46.412153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 40
2025-10-15T10:54:46.419791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:46.419918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 40 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:46.419932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=40 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:46.419940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:46.421453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 40 sessionId:  describe result for acl check
2025-10-15T10:54:46.421553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:46.421562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:46.421570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:46.421585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400245539066920:2957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:46.423878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400245539066920:2957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:46.435016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400245539066926:2534]
2025-10-15T10:54:46.435174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:46.470095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400245539066920:2957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:46.476654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:46.484037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:46.484914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:46.484930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:46.484967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:46.485232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:46.485400Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400248338772748:2858]
2025-10-15T10:54:46.487434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:46.492691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:46.492893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:46.494141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:46.494472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:46.494478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:46.494485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:46.494491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:46.494498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:46.494505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:46.494511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:46.494518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:46.494524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:46.494531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:46.494536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:46.494541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:46.494547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:46.494553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:46.494591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:46.494680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:46.494717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:46.494768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:46.494803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:46.494841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:46.494877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:46.494909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:46.494940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:46.494976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:46.495010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:46.495044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:46.495074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:46.495109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:46.495142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:46.495195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:46.495242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:46.495282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:46.495315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:46.499301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400245539066920:2957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:46.499338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400245539066920:2957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:46.499369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400245539066920:2957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:46.499402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 40 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:46.501188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:46.501261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:46.501328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:46.501404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:46.501445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:46.501478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:46.501517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:46.501557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:46.501592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:46.501623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:46.501675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:46.501711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:46.501778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:46.501834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:46.501877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:46.501909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:46.501948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:46.501997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:46.502040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:46.502075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:46.502120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:46.502158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:46.502206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:46.502584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:46.546376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:46.554451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:46.554482Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:46.554492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:46.554503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:46.554518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 39 [2:7561400248338772748:2858]
2025-10-15T10:54:46.554549Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:46.554590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:46.554601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.554611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.554622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.554665Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:46.554685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:46.554700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:46.555933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:46.555956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:46.555969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:46.555976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:46.556218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:46.556236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:46.556364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:46.556551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:46.556766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:46.556847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400245539066903:2467], now have 1 active actors on pipe
2025-10-15T10:54:46.556868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400245539066996:2957], now have 1 active actors on pipe
2025-10-15T10:54:46.556886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400245539066926:2534], now have 1 active actors on pipe
2025-10-15T10:54:46.556907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.556920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.556932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.556964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:46.557026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:46.557179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:46.557194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:46.557295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.557314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:46.557417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:46.557428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:46.557453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:46.557473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:46.557163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 39
2025-10-15T10:54:46.557242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 39
2025-10-15T10:54:46.557313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 39, pipe: [1:7561400245539066926:2534]
2025-10-15T10:54:46.558478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:46.558503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:46.558573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:46.558583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:46.558667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:46.558696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.558711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.558719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:46.558759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.558806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:46.558859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:46.558936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:46.559261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:46.559275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:46.559300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.559311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.559338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:46.560188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:46.560203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:46.561356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:46.561378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:46.561435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:46.561871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 40 partition: 0 MaxSeqNo: 46 sessionId: src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0
2025-10-15T10:54:46.563685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdfcb55f-1be80f0e-bbd99717-ec0361eb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:46.615147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0] Write session: try to update token
2025-10-15T10:54:46.615202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:46.722207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.722233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.722244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.722297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:46.722311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:46.722323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:46.722333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:46.722365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.722389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.722414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.722589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:46.722595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:46.722615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:46.722650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:46.722696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:46.723963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:46.849064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId: src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:46.895783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:46.973119Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:46.994619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:46.994658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:46.994718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:46.994730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:46.994767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400248338772740:2858]
2025-10-15T10:54:46.995060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:46.995493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:46.995697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:46.995719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:46.996824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400245539066926:2534]
2025-10-15T10:54:47.012354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 40 reason: error at write: Disconnected sessionId: src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0
2025-10-15T10:54:47.012644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 40 sessionId: src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0 is DEAD
2025-10-15T10:54:47.015913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:47.015947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0] Write session will restart in 0.006431s
2025-10-15T10:54:47.016031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0] Write session: Do CDS request
2025-10-15T10:54:47.016055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:47.029773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:47.029802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 41
2025-10-15T10:54:47.032154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:47.032795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:47.032932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 41 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:47.032948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=41 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:47.032956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:47.034424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 41 sessionId:  describe result for acl check
2025-10-15T10:54:47.034536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:47.034547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:47.034556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:47.034575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400249834034346:2966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:47.037395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400249834034346:2966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:47.047144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400249834034346:2966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:47.065193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:47.065228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:47.082602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400249834034346:2966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:47.082689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400249834034346:2966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:47.082731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400249834034346:2966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:47.082797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 41 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:47.100047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:47.100898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:47.101738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:47.101758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:47.101808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:47.102098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:47.102296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400252633740179:2869]
2025-10-15T10:54:47.105880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400249834034415:2534]
2025-10-15T10:54:47.106103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:47.104373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:47.107372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:47.107620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:47.108930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:47.109262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:47.109272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:47.109278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:47.109285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:47.109292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:47.109298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:47.109306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:47.109311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:47.109318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:47.109325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:47.109332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:47.109337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.109343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.109349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.109398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:47.109504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:47.109550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:47.109595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:47.109644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:47.109687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:47.109732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:47.109776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:47.109820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:47.109863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:47.109902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:47.109945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.109987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.110043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.110088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:47.110150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:47.110740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:47.110807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:47.110860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:47.110915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:47.110958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:47.111013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:47.111058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:47.111107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:47.111150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:47.111202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:47.111249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:47.111320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:47.111378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:47.111448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:47.111495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:47.111548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:47.111591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:47.111646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:47.111692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:47.111745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:47.111788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.111838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.111881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.111931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.111976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.112024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.112525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:47.142549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:47.153046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:47.153087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:47.153103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:47.153121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:47.153144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 40 [2:7561400252633740179:2869]
2025-10-15T10:54:47.153197Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:47.153251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:47.153266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.153278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.153289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.153335Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:47.153356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:47.153375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:47.184958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.184980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.184991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.185000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:47.185236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:47.185250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.185356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.185495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.185673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:47.185731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.185743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.185753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.185788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:47.185852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:47.186020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:47.186034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:47.186135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.186150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:47.188582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 40, pipe: [1:7561400249834034415:2534]
2025-10-15T10:54:47.188660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 40
2025-10-15T10:54:47.188719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 40
2025-10-15T10:54:47.186814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:47.186830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:47.186840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:47.186860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:47.187272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400249834034415:2534], now have 1 active actors on pipe
2025-10-15T10:54:47.187303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400249834034401:2966], now have 1 active actors on pipe
2025-10-15T10:54:47.189369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400245539067035:2467], now have 1 active actors on pipe
2025-10-15T10:54:47.189453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:47.189477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:47.189553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:47.189564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:47.189650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:47.189676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.189691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.189700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:47.189729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.189765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:47.189834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:47.189879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:47.190239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:47.190258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:47.190289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.190300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.190333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:47.191089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:47.191104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:47.192019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:47.192046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:47.192108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:47.192446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 41 partition: 0 MaxSeqNo: 46 sessionId: src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0
2025-10-15T10:54:47.193326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990d6072-2cf3916f-54f64dc-6c4a373e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:47.243232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0] Write session: try to update token
2025-10-15T10:54:47.243269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:47.251861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.251891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.251903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.308725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:47.308754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:47.308768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:47.308780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:47.308816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.308839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.308859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.311738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:47.311778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:47.311808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:47.353890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:47.353931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:47.355017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:47.446236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId: src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:47.482321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:47.539229Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:47.541354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:47.541380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:47.541417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400252633740173:2869]
2025-10-15T10:54:47.541596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:47.541620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:47.543529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:47.546378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400249834034415:2534]
2025-10-15T10:54:47.546575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:47.546605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:47.547911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:47.547961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:47.571954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:47.583760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 41 reason: error at write: Disconnected sessionId: src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0
2025-10-15T10:54:47.584035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 41 sessionId: src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0 is DEAD
2025-10-15T10:54:47.587547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:47.587583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0] Write session will restart in 0.009161s
2025-10-15T10:54:47.587674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0] Write session: Do CDS request
2025-10-15T10:54:47.587700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:47.601955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:47.612016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:47.612045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 42
2025-10-15T10:54:47.612818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:47.612932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 42 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:47.612947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=42 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:47.612957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:47.614985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 42 sessionId:  describe result for acl check
2025-10-15T10:54:47.615084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:47.615100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:47.615109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:47.615125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400249834034486:2976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:47.617676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400249834034486:2976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:47.631266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400249834034486:2976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:47.641644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400249834034486:2976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:47.641677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400249834034486:2976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:47.641694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400249834034486:2976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:47.641723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 42 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:47.646632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400249834034529:2534]
2025-10-15T10:54:47.646799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:47.648211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:47.652831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:47.653641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:47.653662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:47.653713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:47.654018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:47.654194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400252633740291:2873]
2025-10-15T10:54:47.655769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:47.662398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:47.662665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:47.663900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:47.664261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:47.664271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:47.664279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:47.664286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:47.664293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:47.664300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:47.664307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:47.664314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:47.664321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:47.664328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:47.664334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:47.664340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.664348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.664355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.664404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:47.664517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:47.664567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:47.664613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:47.664658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:47.664704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:47.664749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:47.664796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:47.664842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:47.664893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:47.664940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:47.664984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.665031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.665077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.665121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:47.665190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:47.665251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:47.665306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:47.665358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:47.665414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:47.665459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:47.665521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:47.665576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:47.665638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:47.665687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:47.665743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:47.665797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:47.665858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:47.665907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:47.665966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:47.666034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:47.666094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:47.666142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:47.666202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:47.666249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:47.666306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:47.666354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.666413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.666461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.666516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.666564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.666624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.668503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:47.716180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:47.728452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:47.728496Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:47.728513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:47.728534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:47.728560Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 41 [2:7561400252633740291:2873]
2025-10-15T10:54:47.728627Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:47.728692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:47.728708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.728720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.728731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.728786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:47.728809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:47.728833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:47.730460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.730475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.730489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.730500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:47.730777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:47.730796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:47.730945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:47.731137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:47.732075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 41, pipe: [1:7561400249834034529:2534]
2025-10-15T10:54:47.732171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 41
2025-10-15T10:54:47.732235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 41
2025-10-15T10:54:47.734745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 42 partition: 0 MaxSeqNo: 46 sessionId: src_id|8efd583b-996861a1-6ff7568-4a653ed0_0
2025-10-15T10:54:47.732086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:47.732195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400249834034529:2534], now have 1 active actors on pipe
2025-10-15T10:54:47.732219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400249834034440:2467], now have 1 active actors on pipe
2025-10-15T10:54:47.732241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400249834034527:2976], now have 1 active actors on pipe
2025-10-15T10:54:47.732266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400252633740285:2873]
2025-10-15T10:54:47.732282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400252633740285:2873]
2025-10-15T10:54:47.732297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400252633740285:2873]
2025-10-15T10:54:47.732338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:47.732415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:47.732516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:47.732529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:47.732539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:47.732607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:47.732624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:47.732826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:47.732848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:47.732933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:47.732946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:47.733007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400252633740285:2873]
2025-10-15T10:54:47.733039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:47.733075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:47.733150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8efd583b-996861a1-6ff7568-4a653ed0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:47.733181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.733214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.733230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:47.733275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.733322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:47.733429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:47.733506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:47.733894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:47.733911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:47.733940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400252633740285:2873]
2025-10-15T10:54:47.733952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400252633740285:2873]
2025-10-15T10:54:47.733995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:47.734069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:47.734084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:47.734216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:47.734229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:47.734241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:47.739591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d1eb2d1-5e716d32-cba5f12f-1ff1d188_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8efd583b-996861a1-6ff7568-4a653ed0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:47.788219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8efd583b-996861a1-6ff7568-4a653ed0_0] Write session: try to update token
2025-10-15T10:54:47.788275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8efd583b-996861a1-6ff7568-4a653ed0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:47.909260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.909286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.909296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.909344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:47.909357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:47.909369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:47.909380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:47.909412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400252633740285:2873]
2025-10-15T10:54:47.909437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400252633740285:2873]
2025-10-15T10:54:47.909460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400252633740285:2873]
2025-10-15T10:54:47.909600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:47.909618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:47.909631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:47.909678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:47.909710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:47.910589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:48.017725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId: src_id|8efd583b-996861a1-6ff7568-4a653ed0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:48.042235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:48.065774Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:48.068348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:48.068383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:48.072105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400249834034529:2534]
2025-10-15T10:54:48.072188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:48.072295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:48.072306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:48.092669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 42 reason: error at write: Disconnected sessionId: src_id|8efd583b-996861a1-6ff7568-4a653ed0_0
2025-10-15T10:54:48.092966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 42 sessionId: src_id|8efd583b-996861a1-6ff7568-4a653ed0_0 is DEAD
2025-10-15T10:54:48.093465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efd583b-996861a1-6ff7568-4a653ed0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:48.093512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efd583b-996861a1-6ff7568-4a653ed0_0] Write session will restart in 0.007861s
2025-10-15T10:54:48.093643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efd583b-996861a1-6ff7568-4a653ed0_0] Write session: Do CDS request
2025-10-15T10:54:48.093684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efd583b-996861a1-6ff7568-4a653ed0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:48.100659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:48.106738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8efd583b-996861a1-6ff7568-4a653ed0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:48.106464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:48.130527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:48.130556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 43
2025-10-15T10:54:48.130939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:48.131035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 43 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:48.131048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=43 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:48.131057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:48.133179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 43 sessionId:  describe result for acl check
2025-10-15T10:54:48.133275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:48.133285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:48.133292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:48.133306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400254129001876:2982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:48.145168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400254129001876:2982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:48.156330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400254129001876:2982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:48.174002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400254129001943:2534]
2025-10-15T10:54:48.174155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:48.177507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400254129001876:2982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:48.177543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400254129001876:2982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:48.177558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400254129001876:2982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:48.177585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 43 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:48.180429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:48.185037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:48.185831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:48.185849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:48.185892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:48.186162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:48.186329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400256928707698:2881]
2025-10-15T10:54:48.187668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:48.188403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:48.188594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:48.189736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:48.190030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:48.190037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:48.190044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:48.190049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:48.190055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:48.190062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:48.190069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:48.190074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:48.190080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:48.190086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:48.190093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:48.190101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.190107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.190114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.190155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:48.190252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:48.190297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:48.190340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:48.190380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:48.190422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:48.190462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:48.190502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:48.190545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:48.190589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:48.190630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:48.190671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.190711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.190751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.190787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:48.190844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:48.190897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:48.190945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:48.190990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:48.191039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:48.191078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:48.191126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:48.191169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:48.191215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:48.191256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:48.191304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:48.192189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:48.192264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:48.192312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:48.192363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:48.192419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:48.192467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:48.192508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:48.192557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:48.192597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:48.192643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:48.192683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.192733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.192776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.192824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.192869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.192917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.193388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:48.239265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:48.249292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:48.249335Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:48.249352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:48.249372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:48.249397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 42 [2:7561400256928707698:2881]
2025-10-15T10:54:48.249450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:48.249512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:48.249526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.249539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.249551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.249602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:48.249631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:48.249652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:48.250960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.250981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.250993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.251004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:48.251922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:48.251950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.252085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.252261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.252457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:48.252502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400254129001863:2467], now have 1 active actors on pipe
2025-10-15T10:54:48.252527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400254129001948:2982], now have 1 active actors on pipe
2025-10-15T10:54:48.252550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400254129001943:2534], now have 1 active actors on pipe
2025-10-15T10:54:48.252368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 42
2025-10-15T10:54:48.252620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.252463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 42
2025-10-15T10:54:48.252639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.252548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 42, pipe: [1:7561400254129001943:2534]
2025-10-15T10:54:48.252651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.252702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:48.252793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:48.252803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:48.252817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:48.252827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:48.252974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:48.253004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:48.253166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:48.253190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:48.253274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:48.253292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:48.253333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.253364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:48.253479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:48.253510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.253532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.253541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:48.253576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.253620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:48.253741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:48.253825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:48.254156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:48.254177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:48.254205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.254218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.254239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:48.254541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:48.254574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:48.254585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:48.261497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:48.261539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:48.261611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:48.262558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 43 partition: 0 MaxSeqNo: 46 sessionId: src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0
2025-10-15T10:54:48.264107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8efd583b-996861a1-6ff7568-4a653ed0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:48.345348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0] Write session: try to update token
2025-10-15T10:54:48.345389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:48.535478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.535505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.535515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.535568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:48.535581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:48.535594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:48.535604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:48.535635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.535661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.535683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.535858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:48.535877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:48.536271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:48.536306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:48.536334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:48.544812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:48.610766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId: src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:48.645954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:48.701298Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:48.726198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:48.726240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:48.726301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:48.726312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:48.726347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400256928707691:2881]
2025-10-15T10:54:48.727609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:48.728325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:48.728333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400254129001943:2534]
2025-10-15T10:54:48.728359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:48.728419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:48.734859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:48.734890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:48.745238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 43 reason: error at write: Disconnected sessionId: src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0
2025-10-15T10:54:48.745518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 43 sessionId: src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0 is DEAD
2025-10-15T10:54:48.747793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:48.747840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0] Write session will restart in 0.009509s
2025-10-15T10:54:48.747929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0] Write session: Do CDS request
2025-10-15T10:54:48.747954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:48.764992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:48.768133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:48.768180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 44
2025-10-15T10:54:48.768702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:48.768804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 44 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:48.768817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=44 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:48.768827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:48.773187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 44 sessionId:  describe result for acl check
2025-10-15T10:54:48.773288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:48.773298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:48.773304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:48.773317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400254129002018:2991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:48.775912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400254129002018:2991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:48.790243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400254129002018:2991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:48.799261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400254129002018:2991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:48.799303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400254129002018:2991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:48.799318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400254129002018:2991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:48.799367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 44 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:48.811944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:48.814266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:48.815096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:48.815118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:48.815156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:48.815404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:48.815565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400256928707837:2892]
2025-10-15T10:54:48.817754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:48.819113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:48.819337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:48.821286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:48.821644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:48.821671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:48.821679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:48.821686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:48.821692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:48.821698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:48.821705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:48.821710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:48.821717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:48.821724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:48.821730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:48.821738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.821745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.821751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.821795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:48.821895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:48.821943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:48.821990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:48.822046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:48.822101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:48.822147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:48.822190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:48.822232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:48.822276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:48.822320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:48.822363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.822407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.822449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.822492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:48.822555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:48.822609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:48.822659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:48.822708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:48.822761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:48.822804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:48.822854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:48.822901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:48.822952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:48.822995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:48.823046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:48.823089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:48.823140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:48.823183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:48.823230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:48.823275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:48.823328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:48.827453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:48.827545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:48.827605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:48.827667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:48.827717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.827475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400254129002096:2534]
2025-10-15T10:54:48.827660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:48.827775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.827828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.827883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.827933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.827988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.828406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:48.956922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:48.971238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 43, pipe: [1:7561400254129002096:2534]
2025-10-15T10:54:48.971289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 43
2025-10-15T10:54:48.971330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 43
2025-10-15T10:54:48.968999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:48.969036Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:48.969060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:48.969077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:48.969098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 43 [2:7561400256928707837:2892]
2025-10-15T10:54:48.969147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:48.969198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:48.969212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.969224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.969235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.969291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:48.969311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:48.969331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:48.970339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.970355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.970367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.970377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:48.970628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:48.970643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:48.970771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:48.970941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:48.971150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:48.971215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400254129002096:2534], now have 1 active actors on pipe
2025-10-15T10:54:48.971236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400254129002072:2991], now have 1 active actors on pipe
2025-10-15T10:54:48.971254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400254129001984:2467], now have 1 active actors on pipe
2025-10-15T10:54:48.971275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:48.971288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:48.971298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:48.971335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:48.971521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:48.971530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:48.971536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:48.973091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:48.973276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:48.973298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:48.973406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:48.973437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:48.973491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:48.973503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:48.973636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:48.973667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:48.973710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:48.973748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a5718e4-50b64a74-808492b4-9d130b35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:48.973781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.973802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.973817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:48.973857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.973892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:48.974054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:48.974113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:48.974466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:48.974485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:48.974510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:48.974522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:48.974547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:48.974706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:48.974728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:48.975647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:48.975677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:48.975744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:48.979079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 44 partition: 0 MaxSeqNo: 46 sessionId: src_id|4a5718e4-50b64a74-808492b4-9d130b35_0
2025-10-15T10:54:48.983861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb3a9261-7db5b9cb-c41f70ef-89e2cd1b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4a5718e4-50b64a74-808492b4-9d130b35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:49.021458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5718e4-50b64a74-808492b4-9d130b35_0] Write session: try to update token
2025-10-15T10:54:49.021513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5718e4-50b64a74-808492b4-9d130b35_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:49.106200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:49.106219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:49.106226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:49.106232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:49.106253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:49.106266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:49.106278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:49.106381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:49.106412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:49.106429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:49.106431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.106439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.106446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.106475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:49.106487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:49.122396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:49.189141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId: src_id|4a5718e4-50b64a74-808492b4-9d130b35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:49.211887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:49.270436Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:49.287152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:49.287183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:49.287218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:49.287225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:49.287246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400256928707831:2892]
2025-10-15T10:54:49.290530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:49.291930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:49.291956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:49.292607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:49.296652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:49.296911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400254129002096:2534]
2025-10-15T10:54:49.299844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 44 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4a5718e4-50b64a74-808492b4-9d130b35_0
2025-10-15T10:54:49.300076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 44 sessionId: src_id|4a5718e4-50b64a74-808492b4-9d130b35_0 is DEAD
2025-10-15T10:54:49.303888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5718e4-50b64a74-808492b4-9d130b35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:54:49.303921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5718e4-50b64a74-808492b4-9d130b35_0] Write session will restart in 0.005144s
2025-10-15T10:54:49.304000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5718e4-50b64a74-808492b4-9d130b35_0] Write session: Do CDS request
2025-10-15T10:54:49.304023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5718e4-50b64a74-808492b4-9d130b35_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:49.324243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5718e4-50b64a74-808492b4-9d130b35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:49.326598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:49.326623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 45
2025-10-15T10:54:49.329947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:49.330125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 45 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:49.330140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=45 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:49.330150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:49.332587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 45 sessionId:  describe result for acl check
2025-10-15T10:54:49.332679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:49.332689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:49.332698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:49.332713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400258423969424:2999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:49.334949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400258423969424:2999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:49.345535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400258423969424:2999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:49.373497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400258423969424:2999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:49.373573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400258423969424:2999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:49.373608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400258423969424:2999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:49.373644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 45 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:49.399692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400258423969515:2534]
2025-10-15T10:54:49.399849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:49.406555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:49.413546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:49.414452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:49.414468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:49.414510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:49.414743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:49.414895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400261223675248:2900]
2025-10-15T10:54:49.416951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:49.421816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:49.422078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:49.423367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:49.423710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:49.423718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:49.423725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:49.423733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:49.423740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:49.423746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:49.423752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:49.423759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:49.423766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:49.423771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:49.423778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:49.423785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.423792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.423797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.423839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:49.423935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:49.423979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:49.424022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:49.424058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:49.424097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:49.424137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:49.424179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:49.424219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:49.424261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:49.424302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:49.424344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.424384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.424424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.424459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:49.424513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:49.424566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:49.424615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:49.424655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:49.424702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:49.424739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:49.424788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:49.424828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:49.424873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:49.424914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:49.424962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:49.425002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:49.425048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:49.425091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:49.425136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:49.425179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:49.425225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:49.425263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:49.425312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:49.425352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:49.425400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:49.425438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.425486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.425527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.425576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.425616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.425664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.426131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:49.458813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:49.470709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:49.470742Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:49.470753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:49.470769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:49.470787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 44 [2:7561400261223675248:2900]
2025-10-15T10:54:49.470824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:49.470873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:49.470885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.470894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.470904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.470941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:49.470958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:49.470975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:49.473014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.473032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.473043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.473055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:49.473264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:49.473276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.473379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.473505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.473660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:49.473705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400261223675242:2900]
2025-10-15T10:54:49.473714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400261223675242:2900]
2025-10-15T10:54:49.473723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400261223675242:2900]
2025-10-15T10:54:49.473749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:49.473801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:49.473939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:49.473950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:49.474056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400261223675242:2900]
2025-10-15T10:54:49.474068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:49.474750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:49.474763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:49.474771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:49.474785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:49.475553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400258423969486:2999], now have 1 active actors on pipe
2025-10-15T10:54:49.475584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400258423969414:2467], now have 1 active actors on pipe
2025-10-15T10:54:49.475606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400258423969515:2534], now have 1 active actors on pipe
2025-10-15T10:54:49.476378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 44
2025-10-15T10:54:49.476439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 44
2025-10-15T10:54:49.476503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 44, pipe: [1:7561400258423969515:2534]
2025-10-15T10:54:49.480203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:49.480239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:49.480355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:49.480371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:49.480457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:49.480492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.480512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.480523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:49.480563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.480608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:49.480678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:49.480759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:49.481160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:49.481179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:49.481214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400261223675242:2900]
2025-10-15T10:54:49.481230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400261223675242:2900]
2025-10-15T10:54:49.481267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:49.481885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:49.481901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:49.487993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:49.488031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:49.488114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:49.488573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 45 partition: 0 MaxSeqNo: 46 sessionId: src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0
2025-10-15T10:54:49.490282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a5718e4-50b64a74-808492b4-9d130b35_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:49.549849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0] Write session: try to update token
2025-10-15T10:54:49.549910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:49.627211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.627241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.627252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.627298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:49.627310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:49.627321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:49.627330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:49.627374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400261223675242:2900]
2025-10-15T10:54:49.627397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400261223675242:2900]
2025-10-15T10:54:49.627420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400261223675242:2900]
2025-10-15T10:54:49.627548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:49.627566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:49.628715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:49.628750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:49.628775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:49.630375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:49.788252Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:49.793198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:49.793221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:49.793276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 45 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0
2025-10-15T10:54:49.793612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 45 sessionId: src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0 is DEAD
2025-10-15T10:54:49.793918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:49.794061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400258423969515:2534]
2025-10-15T10:54:49.812607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:54:49.812685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0] Write session will restart in 0.008895s
2025-10-15T10:54:49.812893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0] Write session: Do CDS request
2025-10-15T10:54:49.812957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:49.834974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:49.835442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:49.835476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 46
2025-10-15T10:54:49.848190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:49.848345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 46 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:49.848363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=46 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:49.848373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:49.850374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 46 sessionId:  describe result for acl check
2025-10-15T10:54:49.850510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:49.850522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:49.850532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:49.850558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400258423969571:3009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:49.853285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400258423969571:3009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:49.868878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:49.873387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400258423969571:3009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:49.892534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400258423969571:3009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:49.892570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400258423969571:3009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:49.892587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400258423969571:3009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:49.892619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 46 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:49.896123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400258423969643:2534]
2025-10-15T10:54:49.896317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:49.899177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:49.901868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:49.902660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:49.902678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:49.902719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:49.902958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:49.903135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400261223675383:2904]
2025-10-15T10:54:49.905286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:49.906611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:49.906842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:49.908357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:49.908630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:49.908634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:49.908638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:49.908643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:49.908648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:49.908652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:49.908655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:49.908660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:49.908665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:49.908669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:49.908674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:49.908679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.908683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.908687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.908718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:49.908792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:49.908823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:49.908852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:49.908881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:49.908913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:49.908943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:49.908971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:49.908999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:49.909028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:49.909055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:49.909083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.909111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.909136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.909173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:49.909217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:49.909252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:49.909285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:49.909311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:49.909343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:49.909370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:49.909402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:49.909430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:49.909462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:49.909487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:49.909520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:49.909547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:49.909581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:49.909605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:49.909636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:49.909664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:49.909696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:49.909721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:49.909750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:49.909777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:49.909836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:49.909863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.909894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.909921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.909952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.909978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.910008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.910395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:49.946820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:49.963277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:49.963330Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:49.963365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:49.963386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:49.963414Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 45 [2:7561400261223675383:2904]
2025-10-15T10:54:49.963474Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:49.963542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:49.963557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.963571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.963585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.963643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:49.963668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:49.963692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:49.964793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.964812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.964828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.964841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:49.965169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:49.965191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:49.965354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:49.965556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:49.965814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:49.965928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400258423969643:2534], now have 1 active actors on pipe
2025-10-15T10:54:49.965955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400258423969640:3009], now have 1 active actors on pipe
2025-10-15T10:54:49.965975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400258423969553:2467], now have 1 active actors on pipe
2025-10-15T10:54:49.966001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:49.966016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:49.966048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:49.966094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:49.966174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:49.966359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:49.966376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:49.966528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:49.966548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:49.966789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:49.966819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:49.966833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:49.966861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:49.967788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:49.967822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:49.967881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:49.967893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:49.967992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:49.968024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.968043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.968054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:49.968092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.968137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:49.968206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:49.968311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:49.968732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:49.968758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:49.968792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:49.968804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:49.968833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:49.969130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:49.969144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:49.969323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:49.969341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:49.969406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:49.970633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a60f95-986cc767-b3804f08-c9ae7d04_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:49.966917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 45, pipe: [1:7561400258423969643:2534]
2025-10-15T10:54:49.967024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 45
2025-10-15T10:54:49.967124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 45
2025-10-15T10:54:49.969734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 46 partition: 0 MaxSeqNo: 46 sessionId: src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0
2025-10-15T10:54:50.041542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0] Write session: try to update token
2025-10-15T10:54:50.041613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:50.064119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.064140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.064148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.173505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:50.173537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:50.173548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:50.173555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:50.173582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:50.173602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:50.173618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:50.173800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:50.173812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.173823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.173832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.173853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:50.173865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:50.173881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:50.173885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:50.174909Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:50.279397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId: src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:50.304090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:50.368637Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:50.400690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:50.400730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:50.400787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:50.400801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:50.400839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400261223675377:2904]
2025-10-15T10:54:50.403752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:50.404597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:50.404976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:50.404624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:50.405101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400258423969643:2534]
2025-10-15T10:54:50.405165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:50.405174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:50.484165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 46 reason: error at write: Disconnected sessionId: src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0
2025-10-15T10:54:50.484450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 46 sessionId: src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0 is DEAD
2025-10-15T10:54:50.485114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:50.487702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:50.487768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0] Write session will restart in 0.005226s
2025-10-15T10:54:50.487934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0] Write session: Do CDS request
2025-10-15T10:54:50.488000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:50.492277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:50.493439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:50.493460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:50.493499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:50.493742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:50.493884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400265518642788:2913]
2025-10-15T10:54:50.495719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:50.499366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:50.499582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:50.500651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:50.500934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:50.500940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:50.500947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:50.500952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:50.500957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:50.500963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:50.500968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:50.500973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:50.500978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:50.500984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:50.500990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:50.500995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:50.501001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:50.501005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:50.501045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:50.501130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:50.501165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:50.501200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:50.501234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:50.501271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:50.501305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:50.501339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:50.501370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:50.501404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:50.501437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:50.501470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:50.501508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:50.501541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:50.501573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:50.501624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:50.501667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:50.501707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:50.501743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:50.501780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:50.501812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:50.501852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:50.501886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:50.501924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:50.501958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:50.501997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:50.502060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:50.502106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:50.502143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:50.502186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:50.502226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:50.502270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:50.502306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:50.502349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:50.502387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:50.502430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:50.502464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:50.502506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:50.502543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:50.502584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:50.502620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:50.502661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:50.503072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:50.507516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400262718937037:2534]
2025-10-15T10:54:50.507685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:50.507752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:50.507768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 47
2025-10-15T10:54:50.508034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:50.511621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:50.511762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 47 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:50.511780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=47 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:50.511791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:50.513256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 47 sessionId:  describe result for acl check
2025-10-15T10:54:50.513353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:50.513363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:50.513372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:50.513389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400262718937040:3016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:50.516025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400262718937040:3016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:50.530567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400262718937040:3016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:50.533774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:50.552476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400262718937040:3016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:50.552512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400262718937040:3016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:50.552528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400262718937040:3016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:50.552555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 47 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:50.555918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:50.555956Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:50.555970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:50.555990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:50.556011Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 46 [2:7561400265518642788:2913]
2025-10-15T10:54:50.556057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:50.556114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:50.556127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.556139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.556148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.556188Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:50.556208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:50.556227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:50.561199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:50.561226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:50.561240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:50.561262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:50.561536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:50.561554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:50.561691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:50.561875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:50.562131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:50.562196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400265518642782:2913]
2025-10-15T10:54:50.562209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400265518642782:2913]
2025-10-15T10:54:50.562221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400265518642782:2913]
2025-10-15T10:54:50.562260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:50.562329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:50.562508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:50.562524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:50.562634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400265518642782:2913]
2025-10-15T10:54:50.562651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:50.562788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:50.562802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:50.562814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:50.563469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 46
2025-10-15T10:54:50.562838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:50.563548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 46
2025-10-15T10:54:50.563602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 46, pipe: [1:7561400262718937037:2534]
2025-10-15T10:54:50.566317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400262718937069:3016], now have 1 active actors on pipe
2025-10-15T10:54:50.566349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400262718937037:2534], now have 1 active actors on pipe
2025-10-15T10:54:50.566380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400262718936970:2467], now have 1 active actors on pipe
2025-10-15T10:54:50.566499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:50.566520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:50.566580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:50.566592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:50.566702Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e2b562-4c13cd55-2778730-63768d16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:50.566733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.566748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.566757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:50.566793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.566830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:50.566887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:50.566931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:50.567297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:50.567315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:50.567361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400265518642782:2913]
2025-10-15T10:54:50.567376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400265518642782:2913]
2025-10-15T10:54:50.567409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:50.567646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:50.567659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:50.572974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 47 partition: 0 MaxSeqNo: 46 sessionId: src_id|3e2b562-4c13cd55-2778730-63768d16_0
2025-10-15T10:54:50.571820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:50.571857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:50.571935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:50.579552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe9cada9-d8c66796-ea7081d6-6cc0094b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3e2b562-4c13cd55-2778730-63768d16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:50.611667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2b562-4c13cd55-2778730-63768d16_0] Write session: try to update token
2025-10-15T10:54:50.611721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2b562-4c13cd55-2778730-63768d16_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:50.662266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.662294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.662304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.800806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.800844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.800856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.800924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:50.800940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:50.800956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:50.800967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:50.801006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400265518642782:2913]
2025-10-15T10:54:50.801033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400265518642782:2913]
2025-10-15T10:54:50.801058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400265518642782:2913]
2025-10-15T10:54:50.801219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:50.801243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:50.802394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:50.806520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:50.806580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:50.806614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:50.827506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId: src_id|3e2b562-4c13cd55-2778730-63768d16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:50.888090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:50.982276Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:50.984821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:50.984854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:50.988793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:50.988818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:51.008061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400262718937037:2534]
2025-10-15T10:54:51.008151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:51.008265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 47 reason: error at write: Disconnected sessionId: src_id|3e2b562-4c13cd55-2778730-63768d16_0
2025-10-15T10:54:51.008629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 47 sessionId: src_id|3e2b562-4c13cd55-2778730-63768d16_0 is DEAD
2025-10-15T10:54:51.012157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2b562-4c13cd55-2778730-63768d16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:51.012192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2b562-4c13cd55-2778730-63768d16_0] Write session will restart in 0.006853s
2025-10-15T10:54:51.012274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2b562-4c13cd55-2778730-63768d16_0] Write session: Do CDS request
2025-10-15T10:54:51.012297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2b562-4c13cd55-2778730-63768d16_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:51.012146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:51.012185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:51.034512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2b562-4c13cd55-2778730-63768d16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:51.074623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:51.074652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 48
2025-10-15T10:54:51.078918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:51.079053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 48 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:51.079067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=48 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:51.079077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:51.080470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 48 sessionId:  describe result for acl check
2025-10-15T10:54:51.080606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:51.080616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:51.080624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:51.080648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400267013904426:3028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:51.082974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400267013904426:3028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:51.103617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400267013904426:3028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:51.108604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400267013904463:2534]
2025-10-15T10:54:51.108785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:51.134572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400267013904426:3028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:51.134610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400267013904426:3028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:51.134626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400267013904426:3028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:51.134661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 48 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:51.145730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:51.148810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:51.149677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:51.149696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:51.149742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:51.150023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:51.150217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400269813610218:2923]
2025-10-15T10:54:51.152824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:51.155810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:51.156108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:51.157452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:51.157815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:51.157823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:51.157829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:51.157836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:51.157843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:51.157850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:51.157857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:51.157863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:51.157869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:51.157876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:51.157882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:51.157889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.157897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.157904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.157988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:51.158126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:51.158175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:51.158224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:51.158268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:51.158322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:51.158365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:51.158410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:51.158456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:51.158526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:51.158581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:51.158629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.158676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.158725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.158793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:51.158863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:51.158920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:51.158977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:51.159024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:51.159078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:51.159125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:51.159175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:51.159224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:51.159277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:51.159320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:51.160984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:51.161066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:51.161127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:51.161185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:51.161245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:51.161296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:51.161352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:51.161399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:51.161453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:51.161499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:51.161551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:51.161597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.161647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.161694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.161746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.161804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.161860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.162405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:51.183614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:51.198270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:51.198314Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:51.198330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:51.198347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:51.198370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 47 [2:7561400269813610218:2923]
2025-10-15T10:54:51.198422Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:51.198475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:51.198490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.198500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.198510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.198555Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:51.198577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:51.198596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:51.202347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 47, pipe: [1:7561400267013904463:2534]
2025-10-15T10:54:51.200985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.202428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 47
2025-10-15T10:54:51.202496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 47
2025-10-15T10:54:51.201012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.201025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.201035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:51.201285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:51.201301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.201431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.201608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.201818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:51.201891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400267013904463:2534], now have 1 active actors on pipe
2025-10-15T10:54:51.201914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400267013904502:3028], now have 1 active actors on pipe
2025-10-15T10:54:51.201934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400267013904415:2467], now have 1 active actors on pipe
2025-10-15T10:54:51.201956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.201969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.201981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.202021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:51.202079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:51.202094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:51.202101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:51.202104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:51.202276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:51.202290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:51.202395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.202422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:51.202457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:51.203047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:51.203075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:51.203164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:51.203190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:51.203300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3153e958-43a5508-42377f8a-f75e4c97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:51.203334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.203365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.203376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:51.203408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.203445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:51.203508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:51.203564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:51.203937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:51.203962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:51.203995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.204007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.204037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:51.204074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:51.204093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:51.205606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:51.205634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:51.205702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:51.211974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 48 partition: 0 MaxSeqNo: 46 sessionId: src_id|3153e958-43a5508-42377f8a-f75e4c97_0
2025-10-15T10:54:51.212844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e2b562-4c13cd55-2778730-63768d16_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3153e958-43a5508-42377f8a-f75e4c97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:51.261194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3153e958-43a5508-42377f8a-f75e4c97_0] Write session: try to update token
2025-10-15T10:54:51.261233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3153e958-43a5508-42377f8a-f75e4c97_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:51.361059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:51.361099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:51.361113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:51.361126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:51.361164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.361192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.361217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.361399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.361413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.361426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.361543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:51.361565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:51.362612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:51.363509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:51.363548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:51.363576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:51.590381Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:51.750020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:51.750053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:51.750111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400269813610213:2923]
2025-10-15T10:54:51.752036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:51.753808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:51.753831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:51.753892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 48 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|3153e958-43a5508-42377f8a-f75e4c97_0
2025-10-15T10:54:51.754286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 48 sessionId: src_id|3153e958-43a5508-42377f8a-f75e4c97_0 is DEAD
2025-10-15T10:54:51.754655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:51.754788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400267013904463:2534]
2025-10-15T10:54:51.792283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:51.855533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400267013904555:2534]
2025-10-15T10:54:51.855728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:51.877712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3153e958-43a5508-42377f8a-f75e4c97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:54:51.877766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3153e958-43a5508-42377f8a-f75e4c97_0] Write session will restart in 0.008934s
2025-10-15T10:54:51.877875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3153e958-43a5508-42377f8a-f75e4c97_0] Write session: Do CDS request
2025-10-15T10:54:51.877906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3153e958-43a5508-42377f8a-f75e4c97_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:51.892618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3153e958-43a5508-42377f8a-f75e4c97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:51.899652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:51.899686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 49
2025-10-15T10:54:51.900038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:51.900157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 49 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:51.900173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=49 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:51.900185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:51.901818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 49 sessionId:  describe result for acl check
2025-10-15T10:54:51.901941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:51.901952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:51.901961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:51.901979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400267013904569:3034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:51.905031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400267013904569:3034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:51.926479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400267013904569:3034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:51.957345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:51.958312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400267013904569:3034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:51.958358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400267013904569:3034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:51.958378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400267013904569:3034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:51.958414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 49 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:51.966129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:51.967081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:51.967104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:51.967168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:51.967504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:51.967705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400269813610363:2931]
2025-10-15T10:54:51.970003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:51.971716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:51.971967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:51.973424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:51.973820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:51.973829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:51.973838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:51.973847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:51.973855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:51.973862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:51.973870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:51.973877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:51.973884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:51.973892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:51.973899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:51.973907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.973915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.973923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.973975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:51.974113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:51.974166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:51.974220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:51.974275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:51.974329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:51.974391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:51.974446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:51.974499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:51.974552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:51.974626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:51.974682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.974733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.974783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.974838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:51.974912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:51.974980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:51.975043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:51.975111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:51.975171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:51.975222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:51.975279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:51.975328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:51.976344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:51.976431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:51.976493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:51.976547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:51.976610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:51.976664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:51.976724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:51.976780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:51.976840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:51.976893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:51.976954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:51.977006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:51.977067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:51.977118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.977177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:51.977230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.977305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:51.977357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.977415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:51.978004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:52.005174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:52.015549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:52.015598Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:52.015618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:52.015641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:52.015668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 48 [2:7561400269813610363:2931]
2025-10-15T10:54:52.015728Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:52.015796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:52.015813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.015829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.015844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.015899Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:52.015923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:52.015949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:52.016985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:52.017000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:52.017015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:52.017027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:52.017307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:52.017325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:52.017483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:52.017701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:52.017955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:52.018036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400267013904656:3034], now have 1 active actors on pipe
2025-10-15T10:54:52.018060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400267013904555:2534], now have 1 active actors on pipe
2025-10-15T10:54:52.018095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400267013904527:2467], now have 1 active actors on pipe
2025-10-15T10:54:52.018120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.018137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.018152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.018196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:52.018274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:52.018469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:52.018485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:52.018621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.018640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:52.019509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:52.019530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:52.019541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:52.019586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:52.020631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:52.020666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:52.020768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:52.020790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:52.020926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:52.020960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.020978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.020989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:52.021028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.021076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:52.021138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:52.021216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:52.021665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:52.021682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:52.021715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.021730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.021762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:52.021797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:52.021811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:52.019835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 48
2025-10-15T10:54:52.019961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 48, pipe: [1:7561400267013904555:2534]
2025-10-15T10:54:52.020035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 48
2025-10-15T10:54:52.025378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:52.025415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:52.025506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:52.031652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 49 partition: 0 MaxSeqNo: 46 sessionId: src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0
2025-10-15T10:54:52.033182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3153e958-43a5508-42377f8a-f75e4c97_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:52.083595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0] Write session: try to update token
2025-10-15T10:54:52.083659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:52.133340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:52.133374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:52.133414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.133542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.133555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.133568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.133701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:52.134201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:52.143359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:52.144555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:52.165299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:52.172433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:52.174047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:54:52.236110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:54:52.236291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:52.236313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:52.236328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:52.236339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:52.236383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.236411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.236435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400269813610356:2931]
2025-10-15T10:54:52.236548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:52.236579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:52.236598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.236607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:52.236622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.236635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.236682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:52.236707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:52.237775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:52.322868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId: src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:52.379528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:52.419260Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:52.453440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:52.453492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:52.455548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:52.455574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:52.459654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400267013904555:2534]
2025-10-15T10:54:52.459840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:52.471606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:52.471660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0] Write session will restart in 0.007207s
2025-10-15T10:54:52.471769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0] Write session: Do CDS request
2025-10-15T10:54:52.471807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:52.470118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 49 reason: error at write: Disconnected sessionId: src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0
2025-10-15T10:54:52.470469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 49 sessionId: src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0 is DEAD
2025-10-15T10:54:52.479673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:52.479714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:52.495505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:52.495535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 50
2025-10-15T10:54:52.496610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:52.497300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:52.497442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 50 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:52.497459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=50 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:52.497468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:52.504995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 50 sessionId:  describe result for acl check
2025-10-15T10:54:52.505177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:52.505194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:52.505205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:52.505223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400271308871986:3041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:52.509246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400271308871986:3041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:52.525297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400271308871986:3041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:52.539384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400271308871986:3041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:52.539430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400271308871986:3041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:52.539448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400271308871986:3041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:52.539485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 50 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:52.551628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:52.555484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:52.556539Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:52.556562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:52.556609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:52.556914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:52.557093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400274108577765:2936]
2025-10-15T10:54:52.560238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:52.561666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:52.561909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:52.563264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400271308872070:2534]
2025-10-15T10:54:52.563482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:52.563323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:52.563747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:52.563756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:52.563763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:52.563771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:52.563778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:52.563785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:52.563792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:52.563799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:52.563805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:52.563812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:52.563818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:52.563823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:52.563830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:52.563837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:52.563887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:52.564003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:52.564056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:52.564108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:52.564156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:52.564205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:52.564255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:52.564306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:52.564359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:52.564410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:52.564462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:52.564512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:52.564561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:52.564608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:52.566453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:52.566555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:52.566630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:52.566706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:52.566759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:52.566818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:52.566870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:52.566939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:52.567004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:52.567066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:52.567119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:52.567174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:52.567223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:52.567277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:52.567324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:52.567396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:52.567445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:52.567499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:52.567546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:52.567599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:52.567648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:52.567702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:52.567750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:52.567816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:52.567867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:52.567922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:52.567968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:52.568024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:52.568554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:52.607191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:52.617694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:52.617754Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:52.617775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:52.617798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:52.617827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 49 [2:7561400274108577765:2936]
2025-10-15T10:54:52.617881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:52.617953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:52.617969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.617982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.617993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.618046Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:52.618096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:52.618119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:52.619479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:52.619499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:52.619512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:52.619523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:52.619832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:52.619854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:52.620017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:52.620224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:52.620468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:52.620524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400274108577760:2936]
2025-10-15T10:54:52.620534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400274108577760:2936]
2025-10-15T10:54:52.620544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400274108577760:2936]
2025-10-15T10:54:52.620577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:52.620629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:52.620727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:52.620742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:52.620753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:52.620782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:52.620794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:52.620888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400274108577760:2936]
2025-10-15T10:54:52.620901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:52.620996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:52.622308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400271308872070:2534], now have 1 active actors on pipe
2025-10-15T10:54:52.622342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400271308872062:3041], now have 1 active actors on pipe
2025-10-15T10:54:52.622364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400271308871973:2467], now have 1 active actors on pipe
2025-10-15T10:54:52.622325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 49
2025-10-15T10:54:52.622407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 49
2025-10-15T10:54:52.622527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 49, pipe: [1:7561400271308872070:2534]
2025-10-15T10:54:52.623095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:52.623127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:52.623230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:52.623245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:52.623324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:52.623377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.623397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.623408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:52.623449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.623497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:52.623563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:52.623644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:52.624021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:52.624038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:52.624076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400274108577760:2936]
2025-10-15T10:54:52.624110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400274108577760:2936]
2025-10-15T10:54:52.624149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:52.624810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:52.624828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:52.630433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:52.630481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:52.630585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:52.631806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 50 partition: 0 MaxSeqNo: 46 sessionId: src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0
2025-10-15T10:54:52.643584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3afaa7-ff6ec7dc-9b542e67-f084a35e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:52.686893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0] Write session: try to update token
2025-10-15T10:54:52.686942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:52.763004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.763034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.763045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.763096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:52.763111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:52.763128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:52.763142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:52.763181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400274108577760:2936]
2025-10-15T10:54:52.763209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400274108577760:2936]
2025-10-15T10:54:52.763234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400274108577760:2936]
2025-10-15T10:54:52.763397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:52.763422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:52.764128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:52.764171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:52.764201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:52.765873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:52.868846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId: src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:52.906658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:52.952244Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:52.961931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:52.961979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:52.966900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400271308872070:2534]
2025-10-15T10:54:52.967006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:52.967019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:52.976213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:52.976253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:52.998606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:52.998909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 50 reason: error at write: Disconnected sessionId: src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0
2025-10-15T10:54:52.999262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 50 sessionId: src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0 is DEAD
2025-10-15T10:54:52.999671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:52.999711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0] Write session will restart in 0.006224s
2025-10-15T10:54:52.999807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0] Write session: Do CDS request
2025-10-15T10:54:52.999837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:53.013808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:53.014726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:53.014769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 51
2025-10-15T10:54:53.015391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:53.015521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 51 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:53.015544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=51 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:53.015553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:53.017402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 51 sessionId:  describe result for acl check
2025-10-15T10:54:53.017602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:53.017632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:53.017644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:53.017674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400275603839429:3051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:53.022168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400275603839429:3051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:53.032317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400275603839429:3051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:53.041685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:53.043498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:53.044274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:53.044305Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:53.044352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:53.044622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:53.044844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400278403545193:2945]
2025-10-15T10:54:53.045644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400275603839429:3051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:53.045680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400275603839429:3051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:53.045698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400275603839429:3051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:53.045729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 51 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:53.048153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:53.049067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:53.049287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:53.050611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:53.050920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.050931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.050936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.050943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.050951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.050958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.050964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.050971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.050977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.050981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.050986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.050991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.050995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.051000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.051034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.051113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.051159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.051218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.051261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.051305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.051372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.051427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.051473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.051524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.051572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.051628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.051680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.051728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.051779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.051844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.051905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.051962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.052010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.052064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.052107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.052157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.052206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.052260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.052308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.052358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.052873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.052948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.052999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.053053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.053103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.053163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.053208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.053263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.053308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.053360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.053415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.053471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.053517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.053567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.053611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.053666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.054196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:53.067153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400275603839512:2534]
2025-10-15T10:54:53.067381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:53.072866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:53.084682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:53.084725Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:53.084740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:53.084759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:53.084780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 50 [2:7561400278403545193:2945]
2025-10-15T10:54:53.084833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:53.084887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:53.084900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.084912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.084922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.084972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:53.085005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:53.085031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:53.096321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.096350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.096359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.096368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:53.096625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:53.096641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.096765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.096919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.097118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:53.097184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400278403545188:2945]
2025-10-15T10:54:53.097198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400278403545188:2945]
2025-10-15T10:54:53.097209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400278403545188:2945]
2025-10-15T10:54:53.097249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:53.097319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:53.097469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:53.097480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:53.097569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400278403545188:2945]
2025-10-15T10:54:53.097579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:53.098155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:53.098177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:53.098188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:53.098211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:53.099102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400275603839512:2534], now have 1 active actors on pipe
2025-10-15T10:54:53.099142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400275603839506:3051], now have 1 active actors on pipe
2025-10-15T10:54:53.099164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400271308872119:2467], now have 1 active actors on pipe
2025-10-15T10:54:53.100153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 50, pipe: [1:7561400275603839512:2534]
2025-10-15T10:54:53.100239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 50
2025-10-15T10:54:53.100304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 50
2025-10-15T10:54:53.100740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:53.100776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:53.100840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:53.100855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:53.100958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0352aad-582f044c-94e81df-e062bc21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:53.100992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.101010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.101020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:53.101059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.101108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:53.101184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:53.101247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:53.101648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:53.101669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:53.101709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400278403545188:2945]
2025-10-15T10:54:53.101722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400278403545188:2945]
2025-10-15T10:54:53.101760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:53.102056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:53.102069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:53.103224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:53.103255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:53.103331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:53.103753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 51 partition: 0 MaxSeqNo: 46 sessionId: src_id|c0352aad-582f044c-94e81df-e062bc21_0
2025-10-15T10:54:53.107905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47049f10-ecb2151f-84775a84-d2eca5c5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c0352aad-582f044c-94e81df-e062bc21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:53.162316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0352aad-582f044c-94e81df-e062bc21_0] Write session: try to update token
2025-10-15T10:54:53.162376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0352aad-582f044c-94e81df-e062bc21_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:53.192695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:53.192730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:53.192745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:53.192755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:53.192791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400278403545188:2945]
2025-10-15T10:54:53.192817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400278403545188:2945]
2025-10-15T10:54:53.192840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400278403545188:2945]
2025-10-15T10:54:53.192968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:53.193004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:53.193005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.193017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.193029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.193034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:53.193073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:53.193094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:53.194347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:53.332958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId: src_id|c0352aad-582f044c-94e81df-e062bc21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:53.346473Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:53.357209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:53.368462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400275603839512:2534]
2025-10-15T10:54:53.368649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:53.368671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:53.376828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 51 reason: error at write: Disconnected sessionId: src_id|c0352aad-582f044c-94e81df-e062bc21_0
2025-10-15T10:54:53.377146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 51 sessionId: src_id|c0352aad-582f044c-94e81df-e062bc21_0 is DEAD
2025-10-15T10:54:53.379593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0352aad-582f044c-94e81df-e062bc21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:53.379649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0352aad-582f044c-94e81df-e062bc21_0] Write session will restart in 0.007147s
2025-10-15T10:54:53.379774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0352aad-582f044c-94e81df-e062bc21_0] Write session: Do CDS request
2025-10-15T10:54:53.379805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0352aad-582f044c-94e81df-e062bc21_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:53.393875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:53.395743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:53.395778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 52
2025-10-15T10:54:53.396051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0352aad-582f044c-94e81df-e062bc21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:53.396634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:53.396760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 52 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:53.396795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=52 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:53.396810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:53.399171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 52 sessionId:  describe result for acl check
2025-10-15T10:54:53.399282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:53.399292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:53.399301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:53.399317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400275603839538:3057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:53.402072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400275603839538:3057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:53.408176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:53.413949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400275603839538:3057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:53.449501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:53.449520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400275603839538:3057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:53.449560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400275603839538:3057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:53.449579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400275603839538:3057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:53.449614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 52 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:53.454220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:53.455084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:53.455101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:53.455148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:53.455453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:53.455639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400278403545320:2953]
2025-10-15T10:54:53.458919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:53.460258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:53.460519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:53.461889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:53.462240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.462249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.462256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.462263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.462271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.462279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.462286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.462294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.462300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.462306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.462315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.462322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.462328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.462335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.462381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.462494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.462542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.462588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.462634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.462681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.462728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.462771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.462817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.462861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.462905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.462948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.462991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.463036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.463080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.463147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.463205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.463257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.463302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.464644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.464735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.464821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.464871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.464927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.464979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.465034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.465084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.465134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.465179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.465232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.465282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.465337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.465384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.465439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.465486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.465542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.465588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.465642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.465689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.465742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.465787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.465840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.466371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:53.473128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400275603839626:2534]
2025-10-15T10:54:53.473323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:53.488382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:53.501452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 51
2025-10-15T10:54:53.501594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 51
2025-10-15T10:54:53.501725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 51, pipe: [1:7561400275603839626:2534]
2025-10-15T10:54:53.499133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:53.499179Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:53.499199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:53.499220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:53.499246Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 51 [2:7561400278403545320:2953]
2025-10-15T10:54:53.499303Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:53.499381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:53.499399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.499411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.499425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.499475Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:53.499502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:53.499525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:53.500665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.500682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.500695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.500706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:53.500965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:53.500983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.501136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.501360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.501631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:53.501726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400275603839531:2467], now have 1 active actors on pipe
2025-10-15T10:54:53.501751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400275603839615:3057], now have 1 active actors on pipe
2025-10-15T10:54:53.501772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400275603839626:2534], now have 1 active actors on pipe
2025-10-15T10:54:53.501816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400278403545314:2953]
2025-10-15T10:54:53.501830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400278403545314:2953]
2025-10-15T10:54:53.501841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400278403545314:2953]
2025-10-15T10:54:53.501882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:53.501970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:53.502007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:53.502023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:53.502034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:53.502171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:53.502188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:53.502344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:53.502366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:53.502448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:53.502463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:53.502505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400278403545314:2953]
2025-10-15T10:54:53.502552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:53.502590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:53.502662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:53.502693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.502710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.502721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:53.502758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.502803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:53.502899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:53.502977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:53.504543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:53.504576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:53.504637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:53.504661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:53.504697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400278403545314:2953]
2025-10-15T10:54:53.504716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400278403545314:2953]
2025-10-15T10:54:53.504748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:53.504916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:53.505039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:53.505056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:53.505346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 52 partition: 0 MaxSeqNo: 46 sessionId: src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0
2025-10-15T10:54:53.506281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0352aad-582f044c-94e81df-e062bc21_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:53.534554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0] Write session: try to update token
2025-10-15T10:54:53.534621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:53.627732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.627775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.627788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.627857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:53.627873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:53.627887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:53.627899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:53.627937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400278403545314:2953]
2025-10-15T10:54:53.627974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400278403545314:2953]
2025-10-15T10:54:53.627998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400278403545314:2953]
2025-10-15T10:54:53.628166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:53.628189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:53.628319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:53.628356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:53.628386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:53.653108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:53.652341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId: src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:53.790111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:53.814870Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:53.817046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:53.817080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:53.820366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:53.820377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:53.820393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:53.820626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400275603839626:2534]
2025-10-15T10:54:53.829708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 52 reason: error at write: Disconnected sessionId: src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0
2025-10-15T10:54:53.830001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 52 sessionId: src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0 is DEAD
2025-10-15T10:54:53.835675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:53.835742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0] Write session will restart in 0.006116s
2025-10-15T10:54:53.835905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0] Write session: Do CDS request
2025-10-15T10:54:53.835959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:53.868192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:53.868068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:53.868101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 53
2025-10-15T10:54:53.871976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:53.872270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 53 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:53.872308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=53 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:53.872333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:53.876562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 53 sessionId:  describe result for acl check
2025-10-15T10:54:53.876693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:53.876704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:53.876714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:53.876733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400275603839680:3065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:53.879719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400275603839680:3065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:53.890198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400275603839680:3065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:53.921159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400275603839680:3065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:53.921211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400275603839680:3065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:53.921232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400275603839680:3065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:53.921269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 53 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:53.922046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400275603839751:2534]
2025-10-15T10:54:53.922265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:53.935233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:53.935265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:53.936254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:53.942487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400275603839751:2534]
2025-10-15T10:54:53.942583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: ERROR TabletId: 72075186224037892 Generation: 0, pipe: [0:0:0]
2025-10-15T10:54:53.942499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:53.943278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:53.943290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:53.943319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:53.945296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:53.945534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400278403545440:2957]
2025-10-15T10:54:53.947829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:53.948976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:53.949203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:53.950539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:53.950904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.950913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.950922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.950929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.950936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.950942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.950949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.950957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.950963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.950971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.950977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.950984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.950992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.951001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.951053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.951175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.951229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.951279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.951329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.951401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.951449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.951505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.951555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.951608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.951656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.951705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.951755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.951801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.951848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.951918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:53.951981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.952039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:53.952090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.952161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:53.952213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.952267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:53.952314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.952374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:53.952423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.952480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:53.952527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.952582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:53.952625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.952680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:53.952731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.952788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:53.952834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.952891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:53.952937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.952992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:53.953040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.953096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:53.953148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.953206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:53.953251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.953308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:53.953858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:53.974366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:53.998786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:53.998839Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:53.998857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:53.998875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:53.998901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 52 [2:7561400278403545440:2957]
2025-10-15T10:54:53.998954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:53.999014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:53.999029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.999041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.999053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.999103Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:53.999125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:53.999158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:54.000411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:54.000436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:54.000451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:54.000462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:54.000723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:54.000742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:54.000889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:54.001073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:54.001300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:54.001373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400278403545434:2957]
2025-10-15T10:54:54.001387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400278403545434:2957]
2025-10-15T10:54:54.001400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400278403545434:2957]
2025-10-15T10:54:54.001432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:54.001503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:54.001687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:54.001706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:54.001829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400278403545434:2957]
2025-10-15T10:54:54.001849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:54.003679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 52
2025-10-15T10:54:54.003684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 52
2025-10-15T10:54:54.002651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:54.002669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:54.002681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:54.002706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:54.004068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400275603839656:2467], now have 1 active actors on pipe
2025-10-15T10:54:54.004093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400275603839750:3065], now have 1 active actors on pipe
2025-10-15T10:54:54.004114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400275603839751:2534], now have 1 active actors on pipe
2025-10-15T10:54:54.005703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:54.005734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:54.005777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561400275603839751:2534] destroyed
2025-10-15T10:54:54.005842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:54.005876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.005894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.005905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:54.005944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.005988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:54.006034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:54.007392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:54.007416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:54.007486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:54.008446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 53 partition: 0 MaxSeqNo: 46 sessionId: src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0
2025-10-15T10:54:54.011103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f22171-c30ac1b5-c9546ab9-72695a45_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:54.046839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400279898807075:2534]
2025-10-15T10:54:54.047059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:54.048627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400279898807075:2534], now have 1 active actors on pipe
2025-10-15T10:54:54.049141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0] Write session: try to update token
2025-10-15T10:54:54.049187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:54.049324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 52, pipe: [1:7561400279898807075:2534]
2025-10-15T10:54:54.049587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:54.049624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:54.049739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:54.050184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:54.050204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:54.050245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400278403545434:2957]
2025-10-15T10:54:54.050260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400278403545434:2957]
2025-10-15T10:54:54.050307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:54.050829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:54.050848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:54.101724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:54.101754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:54.101770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:54.101783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:54.101822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400278403545434:2957]
2025-10-15T10:54:54.101850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400278403545434:2957]
2025-10-15T10:54:54.101875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400278403545434:2957]
2025-10-15T10:54:54.102059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.102083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.102104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.102157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:54.102181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:54.102465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:54.102505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:54.102533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:54.107059Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:54.183438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId: src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:54.211044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:54.262133Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:54.263556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:54.263599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:54.269228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:54.269371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400279898807075:2534]
2025-10-15T10:54:54.269460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:54.269481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:54.274225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 53 reason: error at write: Disconnected sessionId: src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0
2025-10-15T10:54:54.275163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:54.275210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0] Write session will restart in 0.008140s
2025-10-15T10:54:54.275318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0] Write session: Do CDS request
2025-10-15T10:54:54.275364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:54.277583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 53 sessionId: src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0 is DEAD
2025-10-15T10:54:54.295890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:54.295932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:54.304138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:54.304513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:54.304545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 54
2025-10-15T10:54:54.305014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:54.305151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 54 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:54.305176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=54 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:54.305188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:54.306691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 54 sessionId:  describe result for acl check
2025-10-15T10:54:54.306819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:54.306831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:54.306840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:54.306858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400279898807093:3072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:54.312951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400279898807093:3072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:54.326969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400279898807093:3072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:54.368996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400279898807093:3072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:54.369032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400279898807093:3072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:54.369049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400279898807093:3072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:54.369079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 54 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:54.370165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400279898807165:2534]
2025-10-15T10:54:54.370312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:54.387988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:54.391365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:54.392319Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:54.392348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:54.392416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:54.392763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:54.392963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400282698512870:2961]
2025-10-15T10:54:54.396401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:54.397791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:54.398048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:54.399374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:54.399719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:54.399739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:54.399745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:54.399752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:54.399759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:54.399766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:54.399772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:54.399780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:54.399788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:54.399794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:54.399801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:54.399807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:54.399813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:54.399820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:54.399867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:54.399976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:54.400026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:54.400072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:54.400114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:54.400161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:54.400207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:54.400251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:54.400296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:54.400341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:54.400385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:54.400429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:54.400473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:54.400519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:54.400575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:54.400641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:54.400701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:54.400756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:54.400807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:54.400857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:54.400900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:54.400952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:54.401001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:54.401053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:54.401100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:54.401154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:54.401199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:54.401251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:54.401295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:54.401347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:54.401392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:54.401449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:54.401493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:54.401545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:54.401589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:54.401640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:54.401686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:54.401739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:54.401784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:54.401834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:54.401877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:54.401930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:54.402421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:54.467033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:54.487308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:54.487343Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:54.487669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:54.487687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:54.487707Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 53 [2:7561400282698512870:2961]
2025-10-15T10:54:54.487755Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:54.487818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:54.487830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.487840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.487849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.487888Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:54.487905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:54.487923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:54.490243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:54.490271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:54.490282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:54.490293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:54.490558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:54.490574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:54.490699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:54.490870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:54.491100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:54.491167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.491181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.491192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.491237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:54.491304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:54.491480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:54.491495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:54.491605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.491624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:54.492621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:54.492637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:54.492650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:54.492673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:54.493541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400279898807163:3072], now have 1 active actors on pipe
2025-10-15T10:54:54.493572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400279898807165:2534], now have 1 active actors on pipe
2025-10-15T10:54:54.493594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400279898807082:2467], now have 1 active actors on pipe
2025-10-15T10:54:54.496588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 53
2025-10-15T10:54:54.496688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 53, pipe: [1:7561400279898807165:2534]
2025-10-15T10:54:54.496776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 53
2025-10-15T10:54:54.497892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:54.497941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:54.498041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:54.498065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:54.498189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53a12e31-3476cca-ed7c2753-73c69952_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:54.498233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.498274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.498291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:54.498331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.498386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:54.498464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:54.501105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 54 partition: 0 MaxSeqNo: 46 sessionId: src_id|53a12e31-3476cca-ed7c2753-73c69952_0
2025-10-15T10:54:54.498561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:54.498979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:54.499000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:54.499034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.499050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.499086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:54.499569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:54.499584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:54.500713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:54.500734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:54.500805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:54.501977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49b60d3-e75d568e-23fc2a51-76b40f08_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|53a12e31-3476cca-ed7c2753-73c69952_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:54.543157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53a12e31-3476cca-ed7c2753-73c69952_0] Write session: try to update token
2025-10-15T10:54:54.543218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53a12e31-3476cca-ed7c2753-73c69952_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:54.726067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.726098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.726124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.726181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:54.726205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:54.726220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:54.726230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:54.726263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.726286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.726307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.726431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:54.726473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:54.726501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:54.726509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:54.726529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:54.727635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:54.826740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId: src_id|53a12e31-3476cca-ed7c2753-73c69952_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:54.852026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:54.889463Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:54.901771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:54.901818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:54.901875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:54.901888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:54.901924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400282698512865:2961]
2025-10-15T10:54:54.902358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:54.903068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:54.903104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:54.909473Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:54.909516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:54.925753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 54 reason: error at write: Disconnected sessionId: src_id|53a12e31-3476cca-ed7c2753-73c69952_0
2025-10-15T10:54:54.926141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 54 sessionId: src_id|53a12e31-3476cca-ed7c2753-73c69952_0 is DEAD
2025-10-15T10:54:54.926458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a12e31-3476cca-ed7c2753-73c69952_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:54.926495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a12e31-3476cca-ed7c2753-73c69952_0] Write session will restart in 0.005376s
2025-10-15T10:54:54.926593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a12e31-3476cca-ed7c2753-73c69952_0] Write session: Do CDS request
2025-10-15T10:54:54.926622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a12e31-3476cca-ed7c2753-73c69952_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:54.944885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53a12e31-3476cca-ed7c2753-73c69952_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:54.962482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400279898807165:2534]
2025-10-15T10:54:54.962637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:54.962724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:54.962738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 55
2025-10-15T10:54:54.963525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:54.963638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 55 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:54.963654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=55 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:54.963664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:54.965040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 55 sessionId:  describe result for acl check
2025-10-15T10:54:54.965156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:54.965170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:54.965180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:54.965195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400279898807238:3083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:54.970756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400279898807238:3083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:55.005221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:55.004477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400279898807238:3083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:55.009598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:55.010492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:55.010511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:55.010558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:55.010807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:55.010975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400286993480296:2975]
2025-10-15T10:54:55.013153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:55.014823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:55.015059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:55.016518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:55.016857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:55.016873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:55.016879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:55.016887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:55.016893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:55.016900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:55.016906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:55.016912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:55.016918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:55.016925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:55.016933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:55.016939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.016946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.016953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.017001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:55.017108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:55.017152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:55.017201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:55.017249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:55.017325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:55.017381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:55.017426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:55.019866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400279898807238:3083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:55.019907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400279898807238:3083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:55.019923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400279898807238:3083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:55.019952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 55 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:55.017470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:55.017521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:55.017574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:55.017624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.017670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.017716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.017769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:55.017851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:55.017916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:55.017973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:55.018024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:55.018074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:55.018892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:55.018961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:55.019009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:55.019063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:55.019106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:55.019154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:55.019194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:55.019240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:55.019276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:55.019322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:55.019380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:55.019429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:55.019468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:55.019518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:55.019561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:55.019608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:55.019646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.019690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.019729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.019777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.019816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.019858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.020276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:55.061420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400284193774646:2534]
2025-10-15T10:54:55.061635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:55.073883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:55.086044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 54
2025-10-15T10:54:55.086151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 54
2025-10-15T10:54:55.086239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 54, pipe: [1:7561400284193774646:2534]
2025-10-15T10:54:55.083839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:55.083883Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:55.083899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:55.083916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:55.083940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 54 [2:7561400286993480296:2975]
2025-10-15T10:54:55.083986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:55.084040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:55.084053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.084064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.084075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.084118Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:55.084136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:55.084155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:55.085387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.085402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.085413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.085422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:55.085630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:55.085645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.085764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.085904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.086102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:55.086190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400284193774629:3083], now have 1 active actors on pipe
2025-10-15T10:54:55.086212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400279898807234:2467], now have 1 active actors on pipe
2025-10-15T10:54:55.086231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400284193774646:2534], now have 1 active actors on pipe
2025-10-15T10:54:55.086252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.086264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.086274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.086316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:55.086368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:55.086380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:55.086385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:55.086396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:55.086538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:55.086554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:55.086609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:55.086628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:55.086740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.086771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:55.086793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:55.087814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54078e61-7f10872c-a30daed6-510f25f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:55.087854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.087870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.087880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:55.087913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.087949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:55.088046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:55.088065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:55.088216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:55.088308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:55.088649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:55.088665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:55.088697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.088708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.088738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:55.089197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:55.089214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:55.089702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:55.089733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:55.089804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:55.090198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 55 partition: 0 MaxSeqNo: 46 sessionId: src_id|54078e61-7f10872c-a30daed6-510f25f_0
2025-10-15T10:54:55.095979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a12e31-3476cca-ed7c2753-73c69952_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|54078e61-7f10872c-a30daed6-510f25f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:55.140803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54078e61-7f10872c-a30daed6-510f25f_0] Write session: try to update token
2025-10-15T10:54:55.140855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54078e61-7f10872c-a30daed6-510f25f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:55.243421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.243470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.243489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.243566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:55.243589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:55.243614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:55.243634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:55.243686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.243725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.243759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.244045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:55.244053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:55.244091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:55.244132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:55.244175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:55.248154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:55.349277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId: src_id|54078e61-7f10872c-a30daed6-510f25f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:55.369583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:55.434208Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:55.453602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:55.453647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:55.453703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:55.453716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:55.453755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400286993480290:2975]
2025-10-15T10:54:55.455824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:55.457087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:55.457112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:55.465268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:55.465545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400284193774646:2534]
2025-10-15T10:54:55.466015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:55.466050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:55.547107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 55 reason: error at write: Disconnected sessionId: src_id|54078e61-7f10872c-a30daed6-510f25f_0
2025-10-15T10:54:55.547433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 55 sessionId: src_id|54078e61-7f10872c-a30daed6-510f25f_0 is DEAD
2025-10-15T10:54:55.551726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54078e61-7f10872c-a30daed6-510f25f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:55.551777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54078e61-7f10872c-a30daed6-510f25f_0] Write session will restart in 0.009052s
2025-10-15T10:54:55.551885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54078e61-7f10872c-a30daed6-510f25f_0] Write session: Do CDS request
2025-10-15T10:54:55.551918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54078e61-7f10872c-a30daed6-510f25f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:55.567453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:55.567900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400284193774729:2534]
2025-10-15T10:54:55.568058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:55.569641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:55.569670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 56
2025-10-15T10:54:55.569839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54078e61-7f10872c-a30daed6-510f25f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:55.570691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:55.570825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 56 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:55.570842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=56 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:55.570851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:55.570699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:55.572299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 56 sessionId:  describe result for acl check
2025-10-15T10:54:55.572413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:55.572428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:55.572436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:55.572453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400284193774733:3091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:55.571561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:55.571590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:55.571632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:55.571869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:55.572034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400286993480430:2980]
2025-10-15T10:54:55.574005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:55.576457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:55.576663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:55.577869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:55.574933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400284193774733:3091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:55.578196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:55.578214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:55.578221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:55.578227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:55.578233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:55.578239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:55.578247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:55.578254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:55.578259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:55.578265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:55.578272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:55.578277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.578283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.578289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.578330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:55.578423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:55.578463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:55.578503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:55.578553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:55.578596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:55.578636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:55.578676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:55.578717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:55.578757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:55.578799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:55.578840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.578878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.578917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.578957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:55.579015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:55.579066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:55.579111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:55.579150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:55.579196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:55.579232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:55.579276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:55.579316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:55.580751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:55.580807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:55.580859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:55.580902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:55.580948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:55.580989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:55.581035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:55.581079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:55.581125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:55.581164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:55.581210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:55.581250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:55.581321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:55.581432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.581519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.581626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.581782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.581884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.582002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.583066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:55.585799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400284193774733:3091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:55.596266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400284193774733:3091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:55.596306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400284193774733:3091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:55.596325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400284193774733:3091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:55.596358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 56 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:55.621457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:55.680048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:55.680097Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:55.680113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:55.680130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:55.680152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 55 [2:7561400286993480430:2980]
2025-10-15T10:54:55.680197Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:55.680250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:55.680264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.680275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.680285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.680328Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:55.680345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:55.680364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:55.681742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.681755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.681767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.681777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:55.682021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:55.682037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:55.682175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:55.682350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:55.682571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:55.682636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400286993480424:2980]
2025-10-15T10:54:55.682654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400286993480424:2980]
2025-10-15T10:54:55.682664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400286993480424:2980]
2025-10-15T10:54:55.682694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:55.682758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:55.682918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:55.682939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:55.683044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400286993480424:2980]
2025-10-15T10:54:55.683065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:55.683631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:55.683664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:55.683676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:55.683703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:55.687180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400284193774661:2467], now have 1 active actors on pipe
2025-10-15T10:54:55.687221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400284193774765:3091], now have 1 active actors on pipe
2025-10-15T10:54:55.687243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400284193774729:2534], now have 1 active actors on pipe
2025-10-15T10:54:55.687342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:55.687400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:55.685861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 55, pipe: [1:7561400284193774729:2534]
2025-10-15T10:54:55.685959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 55
2025-10-15T10:54:55.686028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 55
2025-10-15T10:54:55.687480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:55.687500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:55.687595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|429445f2-5414139c-806af530-25309350_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:55.687630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.687648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.687660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:55.687701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.687750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:55.687818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:55.687883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:55.688236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:55.688255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:55.688289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400286993480424:2980]
2025-10-15T10:54:55.688302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400286993480424:2980]
2025-10-15T10:54:55.688330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:55.688667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:55.688679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:55.692676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:55.692717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:55.692805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:55.693171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 56 partition: 0 MaxSeqNo: 46 sessionId: src_id|429445f2-5414139c-806af530-25309350_0
2025-10-15T10:54:55.695570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54078e61-7f10872c-a30daed6-510f25f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|429445f2-5414139c-806af530-25309350_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:55.751101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|429445f2-5414139c-806af530-25309350_0] Write session: try to update token
2025-10-15T10:54:55.751157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|429445f2-5414139c-806af530-25309350_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:55.800836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:55.800865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:55.800876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:55.800884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:55.800911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400286993480424:2980]
2025-10-15T10:54:55.800930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400286993480424:2980]
2025-10-15T10:54:55.800948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400286993480424:2980]
2025-10-15T10:54:55.801089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.801099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.801108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.801121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:55.801149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:55.801161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:55.801167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:55.801193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:55.802189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:55.951011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId: src_id|429445f2-5414139c-806af530-25309350_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:55.977661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:55.976330Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:55.983609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400284193774729:2534]
2025-10-15T10:54:55.983806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:55.984030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:55.984050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:56.009328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 56 reason: error at write: Disconnected sessionId: src_id|429445f2-5414139c-806af530-25309350_0
2025-10-15T10:54:56.009685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 56 sessionId: src_id|429445f2-5414139c-806af530-25309350_0 is DEAD
2025-10-15T10:54:56.015518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429445f2-5414139c-806af530-25309350_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:56.015571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429445f2-5414139c-806af530-25309350_0] Write session will restart in 0.007305s
2025-10-15T10:54:56.015679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429445f2-5414139c-806af530-25309350_0] Write session: Do CDS request
2025-10-15T10:54:56.015713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429445f2-5414139c-806af530-25309350_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:56.029458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|429445f2-5414139c-806af530-25309350_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:56.030094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:56.030138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 57
2025-10-15T10:54:56.031361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:56.031499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 57 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:56.031523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=57 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:56.031534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:56.032933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 57 sessionId:  describe result for acl check
2025-10-15T10:54:56.033050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:56.033061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:56.033069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:56.033084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400288488742108:3097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:56.037489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400288488742108:3097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:56.038045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:56.091160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400288488742126:2534]
2025-10-15T10:54:56.092860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400288488742108:3097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:56.099515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:56.110062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400288488742108:3097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:56.110104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400288488742108:3097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:56.110136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400288488742108:3097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:56.110171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 57 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:56.169225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:56.173364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:56.174240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:56.174259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:56.174303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:56.174583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:56.174764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400291288447868:2989]
2025-10-15T10:54:56.177408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:56.178579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:56.178806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:56.180046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:56.180383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:56.180391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:56.180398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:56.180404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:56.180411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:56.180418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:56.180424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:56.180430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:56.180435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:56.180442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:56.180449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:56.180455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.180461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.180466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.180563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:56.180677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:56.180729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:56.180779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:56.180828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:56.180876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:56.180921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:56.180965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:56.181014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:56.181062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:56.181105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:56.181151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.181195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.181241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.181285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:56.181350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:56.181411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:56.181471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:56.181520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:56.181575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:56.181621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:56.181673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:56.181723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:56.181777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:56.181820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:56.181875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:56.181924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:56.195330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:56.196786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:56.196868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:56.196915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:56.196967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:56.197003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:56.197052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:56.197087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:56.197133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:56.197168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.197208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.197241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.197288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.197321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.197368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.197762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:56.230237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:56.244893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:56.244966Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:56.244982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:56.245001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:56.245025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 56 [2:7561400291288447868:2989]
2025-10-15T10:54:56.245072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:56.245132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:56.245146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.245158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.245168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.245218Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:56.245241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:56.245263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:56.248098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.248122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.248136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.248147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:56.248487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:56.248504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.248652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.248865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.249097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:56.249175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.249190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.249202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.249245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:56.249318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:56.249495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:56.249512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:56.249636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.249655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:56.250596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:56.250613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:56.250626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:56.250649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:56.251589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400288488742126:2534], now have 1 active actors on pipe
2025-10-15T10:54:56.251615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400288488742145:3097], now have 1 active actors on pipe
2025-10-15T10:54:56.251637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400284193774789:2467], now have 1 active actors on pipe
2025-10-15T10:54:56.255113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:56.255153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:56.255218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:56.255233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:56.255341Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|560937e1-2ac8d49b-6413f728-47b85345_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:56.255401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.255423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.255433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:56.255473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.254327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 56, pipe: [1:7561400288488742126:2534]
2025-10-15T10:54:56.254415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 56
2025-10-15T10:54:56.255521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:56.254479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 56
2025-10-15T10:54:56.255601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:56.255682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:56.256101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:56.256134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:56.256197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:56.256220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:56.256257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.256275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.256311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:56.256374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:56.256410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:56.256506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:56.259579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 57 partition: 0 MaxSeqNo: 46 sessionId: src_id|560937e1-2ac8d49b-6413f728-47b85345_0
2025-10-15T10:54:56.260346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429445f2-5414139c-806af530-25309350_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|560937e1-2ac8d49b-6413f728-47b85345_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:56.287320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|560937e1-2ac8d49b-6413f728-47b85345_0] Write session: try to update token
2025-10-15T10:54:56.287401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|560937e1-2ac8d49b-6413f728-47b85345_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:56.578448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.591422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId: src_id|560937e1-2ac8d49b-6413f728-47b85345_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:56.591624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.591657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.591840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:56.591855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:56.591870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:56.591882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:56.591916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.591943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.591967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.592076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:56.592125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:56.592164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:56.617233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:56.617277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:56.618362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:56.673125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:56.776904Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:56.778397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:56.778417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:56.778463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400291288447862:2989]
2025-10-15T10:54:56.778688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:56.778714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:56.778923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:56.782083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400288488742126:2534]
2025-10-15T10:54:56.782284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:56.782315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:56.793635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:56.793672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:56.855328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 57 reason: error at write: Disconnected sessionId: src_id|560937e1-2ac8d49b-6413f728-47b85345_0
2025-10-15T10:54:56.855731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 57 sessionId: src_id|560937e1-2ac8d49b-6413f728-47b85345_0 is DEAD
2025-10-15T10:54:56.860653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560937e1-2ac8d49b-6413f728-47b85345_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:56.860696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560937e1-2ac8d49b-6413f728-47b85345_0] Write session will restart in 0.009976s
2025-10-15T10:54:56.860796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560937e1-2ac8d49b-6413f728-47b85345_0] Write session: Do CDS request
2025-10-15T10:54:56.860829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560937e1-2ac8d49b-6413f728-47b85345_0] Start write session. Will connect to endpoint: localhost:13695
E1015 10:54:56.873892388  821871 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:54:56.879830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|560937e1-2ac8d49b-6413f728-47b85345_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:56.947228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:56.954757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:56.955591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:56.955609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:56.955651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:56.955900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:56.956081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400291288448000:2997]
2025-10-15T10:54:56.954889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:56.955080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400288488742310:2534]
2025-10-15T10:54:56.955236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:56.955323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400288488742310:2534]
2025-10-15T10:54:56.956967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: ERROR TabletId: 72075186224037892 Generation: 0, pipe: [0:0:0]
2025-10-15T10:54:56.960292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:56.961423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:56.961643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:56.963336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:56.963904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:56.963919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:56.963926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:56.963933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:56.963940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:56.963946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:56.963953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:56.963959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:56.963965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:56.963971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:56.963977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:56.963984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.963990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.963997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.964042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:56.964142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:56.964199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:56.964243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:56.964291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:56.964335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:56.964374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:56.964428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:56.964478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:56.964523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:56.964565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:56.964607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.964647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.964690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.964730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:56.964806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:56.964860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:56.964908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:56.964953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:56.965007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:56.965062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:56.964852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:56.965112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:56.964886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 58
2025-10-15T10:54:56.965157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:56.965204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:56.965244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:56.965294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:56.965337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:56.965385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:56.965429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:56.965477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:56.965518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:56.965568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:56.965607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:56.965653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:56.965694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:56.965740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:56.965779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.965825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:56.965868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.965915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:56.965958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.966007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:56.966494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:56.972191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:56.972332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 58 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:56.972348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=58 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:56.972358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:56.976628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 58 sessionId:  describe result for acl check
2025-10-15T10:54:56.976745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:56.976756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:56.976767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:56.976783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400288488742325:3108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:56.979299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400288488742325:3108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:56.996438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400288488742325:3108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:57.006333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:57.017043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:57.017082Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:57.017099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:57.017116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:57.017139Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 57 [2:7561400291288448000:2997]
2025-10-15T10:54:57.017187Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:57.017241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:57.017254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.017266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.017278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.017323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:57.017343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:57.017362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:57.018565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:57.018580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:57.018593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:57.018605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:57.019488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 57
2025-10-15T10:54:57.020144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400288488742325:3108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:57.020170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400288488742325:3108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:57.020186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400288488742325:3108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:57.020213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 58 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:57.022256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:57.022284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:57.022414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:57.022576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:57.022798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:57.022841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400288488742308:2467], now have 1 active actors on pipe
2025-10-15T10:54:57.022920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.022932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.022944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.022984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:57.023060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:57.023234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:57.023250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:57.023385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.023406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:57.023915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:57.023932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:57.023944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:57.023966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:57.032599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400292783709654:3108], now have 1 active actors on pipe
2025-10-15T10:54:57.032879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 57
2025-10-15T10:54:57.033200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:57.033233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:57.033304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:57.033336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.033356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.033367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:57.033402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.033442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:57.033490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:57.034162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:57.034198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:57.034258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:57.034624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 58 partition: 0 MaxSeqNo: 46 sessionId: src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0
2025-10-15T10:54:57.035876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560937e1-2ac8d49b-6413f728-47b85345_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:57.059161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400292783709658:2534]
2025-10-15T10:54:57.059403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:57.063603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400292783709658:2534], now have 1 active actors on pipe
2025-10-15T10:54:57.063987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 57, pipe: [1:7561400292783709658:2534]
2025-10-15T10:54:57.066735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:57.066777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:57.066873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:57.067262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:57.067279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:57.067312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.067327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.067376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:57.067847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:57.067865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:57.118772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0] Write session: try to update token
2025-10-15T10:54:57.118827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:57.270927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:57.270960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:57.270994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.271108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.271120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.271132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.271479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:57.271590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:57.273460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:54:57.287523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId: src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:57.295641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:57.296768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:57.297880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:54:57.299702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:54:57.333308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:57.364235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:54:57.364375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:57.364390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:57.364405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:57.364416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:57.364451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.364474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.364496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.364661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:57.364682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:57.364714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:54:57.364725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:57.364734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:57.364759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.364782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400291288447994:2997]
2025-10-15T10:54:57.364862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:57.364883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:57.365877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:57.367906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:57.367946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:57.367977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:57.368031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:57.368067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:57.368101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:57.368128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:57.368154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:54:57.560256Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:57.583444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:57.583704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400292783709658:2534]
2025-10-15T10:54:57.580832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:57.580862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:57.583852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:57.597646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:54:57.597690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0] Write session will restart in 0.009589s
2025-10-15T10:54:57.597785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0] Write session: Do CDS request
2025-10-15T10:54:57.597814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:57.596945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 58 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0
2025-10-15T10:54:57.597237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 58 sessionId: src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0 is DEAD
2025-10-15T10:54:57.615113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:57.618055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:57.618085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 59
2025-10-15T10:54:57.619263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:57.619405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 59 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:57.619420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=59 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:57.619430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:57.621511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 59 sessionId:  describe result for acl check
2025-10-15T10:54:57.621630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:57.621648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:57.621656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:57.621673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400292783709694:3116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:57.623927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400292783709694:3116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:57.653095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:57.654516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400292783709694:3116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:57.655709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:57.656441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:57.656467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:57.656503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:57.656749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:57.656915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400295583415432:3003]
2025-10-15T10:54:57.658970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:57.660134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:57.660387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:57.661780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:57.662242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:57.662255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:57.662264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:57.662274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:57.662282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:57.662292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:57.662299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:57.662306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:57.662316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:57.662327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:57.662333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:57.662350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:57.662359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:57.662366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:57.662411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:57.662512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:57.662556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:57.663277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400292783709694:3116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:57.662603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:57.662645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:57.663316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400292783709694:3116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:57.662691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:57.663332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400292783709694:3116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:57.662733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:57.663391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 59 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:57.662775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:57.662822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:57.662866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:57.662909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:57.662956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:57.663049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:57.663135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:57.663205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:57.663294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:57.663375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:57.663429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:57.663475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:57.663526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:57.663565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:57.663613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:57.663657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:57.663705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:57.663744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:57.663793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:57.663836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:57.663900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:57.663946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:57.663994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:57.664036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:57.664086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:57.664128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:57.664181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:57.664224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:57.664269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:57.664308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:57.664358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:57.664400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:57.664447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:57.664487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:57.664595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:57.665172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:57.683758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400292783709788:2534]
2025-10-15T10:54:57.683928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:57.693517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:57.715477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:57.715519Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:57.715537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:57.715555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:57.715578Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 58 [2:7561400295583415432:3003]
2025-10-15T10:54:57.715629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:57.715684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:57.715697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.715709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.715719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.715765Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:57.715786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:57.715808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:57.717225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:57.717250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:57.717264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:57.717274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:57.717534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:57.717550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:57.717684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:57.717859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:57.718081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:57.718164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:57.718179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:57.718191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:57.718226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:57.718291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:57.718461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:57.718485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:57.718593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:57.718616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:57.719985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:57.720009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:57.720021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:57.720045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:57.722954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400292783709788:2534], now have 1 active actors on pipe
2025-10-15T10:54:57.723004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400292783709784:3116], now have 1 active actors on pipe
2025-10-15T10:54:57.723026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400292783709677:2467], now have 1 active actors on pipe
2025-10-15T10:54:57.724731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:57.724768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:57.724821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:57.724839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:57.724921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:57.724957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.724973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.724983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:57.725015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.725054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:57.725118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:57.725167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:57.723676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 58, pipe: [1:7561400292783709788:2534]
2025-10-15T10:54:57.723755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 58
2025-10-15T10:54:57.723829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 58
2025-10-15T10:54:57.725821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:57.725850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:57.725883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:57.725897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:57.725930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:57.732259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:57.732282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:57.733413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:57.733446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:57.733512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:57.736669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 59 partition: 0 MaxSeqNo: 46 sessionId: src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0
2025-10-15T10:54:57.739614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c7ea35c-85029696-f5f0b644-21e8a70_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:57.771575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0] Write session: try to update token
2025-10-15T10:54:57.771628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:57.856823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.856857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.856868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.856930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:57.856955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:57.856978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:57.856995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:57.857046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:57.857090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:57.857132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:57.857310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:57.857372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:57.857417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:57.857453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:57.857470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:57.857507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:57.857508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:57.865137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:57.992445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId: src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:58.052653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:58.080690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:58.094485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:58.094521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:58.094564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400295583415427:3003]
2025-10-15T10:54:58.094729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:54:58.094808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:58.097787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400292783709788:2534]
2025-10-15T10:54:58.097881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:58.097894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:58.112512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:58.161038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:58.161187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 59 reason: error at write: Disconnected sessionId: src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0
2025-10-15T10:54:58.161469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 59 sessionId: src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0 is DEAD
2025-10-15T10:54:58.163857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:58.163907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0] Write session will restart in 0.007015s
2025-10-15T10:54:58.164046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0] Write session: Do CDS request
2025-10-15T10:54:58.164092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:58.184471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:58.189361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:58.189387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 60
2025-10-15T10:54:58.190254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:58.190356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 60 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:58.190370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=60 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:58.190379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:58.192267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 60 sessionId:  describe result for acl check
2025-10-15T10:54:58.192358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:58.192368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:58.192377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:58.192391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400297078677200:3128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:58.195246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400297078677200:3128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:58.199776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400297078677213:2534]
2025-10-15T10:54:58.199941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:58.204438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400297078677200:3128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:58.206779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:58.212622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:58.213558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:58.213578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:58.213622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:58.213881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:58.214056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400299878382872:3012]
2025-10-15T10:54:58.216297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:58.218227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400297078677200:3128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:58.218275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400297078677200:3128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:58.218291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400297078677200:3128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:58.218317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 60 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:58.222979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:58.223342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:58.224901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:58.225266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:58.225276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:58.225283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:58.225290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:58.225296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:58.225304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:58.225312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:58.225320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:58.225328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:58.225335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:58.225343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:58.225349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.225356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.225364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.225415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:58.225525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:58.225574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:58.225623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:58.225669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:58.225716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:58.225763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:58.225809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:58.225851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:58.225897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:58.225944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:58.225989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.226035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.226079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.226123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:58.226204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:58.226264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:58.226324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:58.226373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:58.226428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:58.226478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:58.226532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:58.226588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:58.226650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:58.226700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:58.226763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:58.226816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:58.226881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:58.226930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:58.226987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:58.227036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:58.227089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:58.227135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:58.227196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:58.227246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:58.227305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:58.228479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.228555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.228609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.228666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.228714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.228769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.229303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:58.257293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:58.274999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:58.275044Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:58.275059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:58.275076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:58.275098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 59 [2:7561400299878382872:3012]
2025-10-15T10:54:58.275143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:58.275182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:58.275192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.275200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.275207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.275236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:58.275252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:58.275265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:58.298671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.298704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.298716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.298727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:58.298979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:58.298993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.299111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.299266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.300454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 59, pipe: [1:7561400297078677213:2534]
2025-10-15T10:54:58.300551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 59
2025-10-15T10:54:58.300612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 59
2025-10-15T10:54:58.307581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:58.307710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400297078677213:2534], now have 1 active actors on pipe
2025-10-15T10:54:58.307732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400297078677128:2467], now have 1 active actors on pipe
2025-10-15T10:54:58.307752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400297078677234:3128], now have 1 active actors on pipe
2025-10-15T10:54:58.307846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:58.307879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:58.307950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:58.307971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:58.308003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.308023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.308036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.308075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:58.308133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:58.308149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:58.308156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:58.308160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:58.308310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:58.308333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:58.308418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f16f85a2-670271da-a58ba5e8-fad80382_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:58.308452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.308466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.308475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:58.308504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.308542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:58.308660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.308689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:58.308716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:58.308743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:58.308852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:58.309218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:58.309233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:58.309285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.309298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.309318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:58.310058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:58.310069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:58.315154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:58.315217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:58.315311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:58.319439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 60 partition: 0 MaxSeqNo: 46 sessionId: src_id|f16f85a2-670271da-a58ba5e8-fad80382_0
2025-10-15T10:54:58.324015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bd9e3af-71b66ec3-515ab5c6-55a04f00_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f16f85a2-670271da-a58ba5e8-fad80382_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:58.373607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.373633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.373645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.405039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16f85a2-670271da-a58ba5e8-fad80382_0] Write session: try to update token
2025-10-15T10:54:58.405106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16f85a2-670271da-a58ba5e8-fad80382_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:58.519316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:58.523410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:58.523466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:58.523479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:58.523518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.523548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.523573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.523778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.523792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.523804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.524265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:58.524307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:58.524337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:58.614660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:58.614691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:58.616188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:58.621400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId: src_id|f16f85a2-670271da-a58ba5e8-fad80382_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:58.643497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:58.772201Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:58.773864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:58.773885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:58.773927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400299878382866:3012]
2025-10-15T10:54:58.774098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:58.774131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:58.774159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:58.776912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:58.776923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400297078677213:2534]
2025-10-15T10:54:58.777079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:58.777107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:58.781192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:58.781222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:58.807278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 60 reason: error at write: Disconnected sessionId: src_id|f16f85a2-670271da-a58ba5e8-fad80382_0
E1015 10:54:58.810389191  821221 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:54:58.813969Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:54:58.819648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 60 sessionId: src_id|f16f85a2-670271da-a58ba5e8-fad80382_0 is DEAD
2025-10-15T10:54:58.820948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16f85a2-670271da-a58ba5e8-fad80382_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:58.820976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16f85a2-670271da-a58ba5e8-fad80382_0] Write session will restart in 0.007616s
2025-10-15T10:54:58.821059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16f85a2-670271da-a58ba5e8-fad80382_0] Write session: Do CDS request
2025-10-15T10:54:58.821082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16f85a2-670271da-a58ba5e8-fad80382_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:58.832883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16f85a2-670271da-a58ba5e8-fad80382_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:58.835499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:58.835527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 61
2025-10-15T10:54:58.835918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:58.836031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 61 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:58.836052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=61 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:58.836062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:58.840535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 61 sessionId:  describe result for acl check
2025-10-15T10:54:58.840642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:58.840653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:58.840662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:58.840683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400297078677311:3135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:58.843206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400297078677311:3135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:58.859223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400297078677311:3135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:58.861901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:58.864608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:58.865547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:58.865566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:58.865608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:58.865866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:58.866055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400299878383015:3022]
2025-10-15T10:54:58.867312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400297078677311:3135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:58.867369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400297078677311:3135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:58.867386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400297078677311:3135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:58.867423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 61 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:58.870578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:58.871640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:58.871883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:58.873251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:58.873613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:58.873633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:58.873641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:58.873649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:58.873658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:58.873666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:58.873674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:58.873681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:58.873689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:58.873697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:58.873704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:58.873712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.873721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.873731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.873795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:58.873919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:58.873975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:58.874029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:58.874080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:58.874140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:58.874203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:58.874255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:58.874306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:58.874354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:58.874401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:58.874448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.874500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.874550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.874598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:58.874667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:58.874732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:58.874796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:58.874852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:58.874912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:58.874965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:58.875030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:58.875094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:58.875149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:58.875198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:58.875256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:58.875308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:58.876792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400297078677382:2534]
2025-10-15T10:54:58.876986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:58.876508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:58.876579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:58.876671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:58.876737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:58.876799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:58.876849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:58.876910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:58.876965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:58.877024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:58.877073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.877132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.877186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.877251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.877302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.877361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.877898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:58.897971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:58.907035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:58.907081Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:58.907100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:58.907121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:58.907147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 60 [2:7561400299878383015:3022]
2025-10-15T10:54:58.907204Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:58.907270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:58.907287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.907300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.907313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.907681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:58.907714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:58.907736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:58.960222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.960252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.960263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.960274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:58.960551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:58.960568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:58.960698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:58.960862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:58.961066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:58.961142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:58.961158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:58.961170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:58.961213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:58.961284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:58.961463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:58.961480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:58.961604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:58.961622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:58.963511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 60, pipe: [1:7561400297078677382:2534]
2025-10-15T10:54:58.963599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 60
2025-10-15T10:54:58.963679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 60
2025-10-15T10:54:58.962264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:58.962283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:58.962295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:58.962319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:58.970175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400297078677382:2534], now have 1 active actors on pipe
2025-10-15T10:54:58.970227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400297078677378:3135], now have 1 active actors on pipe
2025-10-15T10:54:58.970251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400297078677267:2467], now have 1 active actors on pipe
2025-10-15T10:54:58.970322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:58.970350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:58.970458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:58.970475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:58.970589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5b84974-c5ff962d-678898a8-88b8f351_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:58.970633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.970655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.970667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:58.970711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.970763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:58.970831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:58.970922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:58.971378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:58.971398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:58.971451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:58.971468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:58.971507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:58.971522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:58.971560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:58.971607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:58.971625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:58.971764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:58.972926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 61 partition: 0 MaxSeqNo: 46 sessionId: src_id|d5b84974-c5ff962d-678898a8-88b8f351_0
2025-10-15T10:54:58.973821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16f85a2-670271da-a58ba5e8-fad80382_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d5b84974-c5ff962d-678898a8-88b8f351_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:59.006941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.006975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.006987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.036890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b84974-c5ff962d-678898a8-88b8f351_0] Write session: try to update token
2025-10-15T10:54:59.036962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b84974-c5ff962d-678898a8-88b8f351_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:59.097760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:59.097793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:59.097806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:59.097817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:59.097848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:59.097872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:59.097896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:59.098010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:59.098041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:59.098066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:59.160008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:59.160052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:59.161110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:59.188224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId: src_id|d5b84974-c5ff962d-678898a8-88b8f351_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:59.233271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:59.334366Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:54:59.335983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:54:59.336011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:59.336061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400299878383009:3022]
2025-10-15T10:54:59.336200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:54:59.336295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:59.336328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:59.337342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400297078677382:2534]
2025-10-15T10:54:59.337498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:54:59.337537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:54:59.339593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:54:59.348259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:59.348300Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:54:59.355796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b84974-c5ff962d-678898a8-88b8f351_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:54:59.355837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b84974-c5ff962d-678898a8-88b8f351_0] Write session will restart in 0.008832s
2025-10-15T10:54:59.355939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b84974-c5ff962d-678898a8-88b8f351_0] Write session: Do CDS request
2025-10-15T10:54:59.355968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b84974-c5ff962d-678898a8-88b8f351_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:54:59.353448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 61 reason: error at write: Disconnected sessionId: src_id|d5b84974-c5ff962d-678898a8-88b8f351_0
2025-10-15T10:54:59.353808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 61 sessionId: src_id|d5b84974-c5ff962d-678898a8-88b8f351_0 is DEAD
2025-10-15T10:54:59.373593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b84974-c5ff962d-678898a8-88b8f351_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:59.376038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:59.376069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 62
2025-10-15T10:54:59.376354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:59.376463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 62 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:54:59.376477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=62 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:59.376487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:59.378413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 62 sessionId:  describe result for acl check
2025-10-15T10:54:59.378507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:59.378518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:59.378527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:59.378541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400301373644725:3143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:59.382149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400301373644725:3143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:59.410885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400301373644725:3143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:59.435472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400301373644725:3143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:59.435515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400301373644725:3143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:59.435531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400301373644725:3143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:59.435560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 62 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:59.437915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400301373644815:2534]
2025-10-15T10:54:59.438079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:54:59.445763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:59.449013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:59.450049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:59.450077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:54:59.450623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:59.450906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:59.451093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400304173350460:3026]
2025-10-15T10:54:59.453180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:54:59.459774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:54:59.460112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:54:59.461820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:54:59.462208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:59.462216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:59.462224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:59.462232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:59.462240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:59.462247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:59.462254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:59.462262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:59.462269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:59.462278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:59.462286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:59.462293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:59.462299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:59.462306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:59.462355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:59.462466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:59.462524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:59.462576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:59.462623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:59.462672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:59.462719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:59.462767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:59.462812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:59.462860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:59.462908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:59.462957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:59.463005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:59.463053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:59.463096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:59.463167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:54:59.463229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:59.463289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:54:59.463337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:59.463423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:54:59.463467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:59.463524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:54:59.463573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:59.463627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:54:59.463674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:59.463725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:54:59.463775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:59.463830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:54:59.463876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:59.463934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:54:59.463987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:59.464037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:54:59.464083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:59.464136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:54:59.464184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:59.464239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:54:59.464282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:59.464335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:59.464382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:59.464438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:59.464481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:59.464539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:59.465087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:54:59.503126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:54:59.514096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:54:59.514142Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:54:59.514160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:59.514191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:59.514214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 61 [2:7561400304173350460:3026]
2025-10-15T10:54:59.514265Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:54:59.514327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:54:59.514340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.514352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.514364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.514413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:54:59.514448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:59.514470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:59.518893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 61
2025-10-15T10:54:59.519005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 61
2025-10-15T10:54:59.519094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 61, pipe: [1:7561400301373644815:2534]
2025-10-15T10:54:59.516071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:59.516098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:59.516113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:59.516124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:54:59.516420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:54:59.516438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:54:59.516581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:54:59.516770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:54:59.516998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:54:59.517072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400304173350454:3026]
2025-10-15T10:54:59.517087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400304173350454:3026]
2025-10-15T10:54:59.517100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400304173350454:3026]
2025-10-15T10:54:59.517142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:54:59.517219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:54:59.517249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:54:59.517259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:54:59.517272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:54:59.517426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:54:59.517445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:59.517602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400304173350454:3026]
2025-10-15T10:54:59.517633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:54:59.517686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400301373644711:2467], now have 1 active actors on pipe
2025-10-15T10:54:59.517709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400301373644804:3143], now have 1 active actors on pipe
2025-10-15T10:54:59.517729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400301373644815:2534], now have 1 active actors on pipe
2025-10-15T10:54:59.517910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:54:59.523806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:59.523846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:59.523944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:59.523960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:59.524052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|923ab8f0-8a843538-225a5706-b16a5e67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:59.524088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.524105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.524118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:59.524159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.524208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:59.524289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:59.524372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:54:59.524775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:54:59.524793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:59.524830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400304173350454:3026]
2025-10-15T10:54:59.524844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400304173350454:3026]
2025-10-15T10:54:59.524883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:54:59.525145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:54:59.525161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:54:59.533329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:59.533375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:59.533472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:59.534166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 62 partition: 0 MaxSeqNo: 46 sessionId: src_id|923ab8f0-8a843538-225a5706-b16a5e67_0
2025-10-15T10:54:59.535949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b84974-c5ff962d-678898a8-88b8f351_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|923ab8f0-8a843538-225a5706-b16a5e67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:59.594822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|923ab8f0-8a843538-225a5706-b16a5e67_0] Write session: try to update token
2025-10-15T10:54:59.594881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|923ab8f0-8a843538-225a5706-b16a5e67_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:59.785825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.785855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.785867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.785927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:54:59.785940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:54:59.785953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:54:59.785963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:54:59.785995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400304173350454:3026]
2025-10-15T10:54:59.786021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400304173350454:3026]
2025-10-15T10:54:59.786044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400304173350454:3026]
2025-10-15T10:54:59.786252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:54:59.786258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:54:59.786280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:54:59.786287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:54:59.786318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:54:59.795438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:54:59.831334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: src_id|923ab8f0-8a843538-225a5706-b16a5e67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:59.855844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:00.055498Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:00.090259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:00.090309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:00.090382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:00.090396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:00.090438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400304173350454:3026]
2025-10-15T10:55:00.090945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:00.094987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:00.095305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:00.095335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:00.098292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:00.098359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:00.110632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400301373644815:2534]
2025-10-15T10:55:00.110740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 62 reason: error at write: Disconnected sessionId: src_id|923ab8f0-8a843538-225a5706-b16a5e67_0
2025-10-15T10:55:00.111083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 62 sessionId: src_id|923ab8f0-8a843538-225a5706-b16a5e67_0 is DEAD
2025-10-15T10:55:00.111477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923ab8f0-8a843538-225a5706-b16a5e67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:00.111515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923ab8f0-8a843538-225a5706-b16a5e67_0] Write session will restart in 0.008141s
2025-10-15T10:55:00.111625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923ab8f0-8a843538-225a5706-b16a5e67_0] Write session: Do CDS request
2025-10-15T10:55:00.111655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923ab8f0-8a843538-225a5706-b16a5e67_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:00.145007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|923ab8f0-8a843538-225a5706-b16a5e67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:00.156904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:00.156940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 63
2025-10-15T10:55:00.168069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:00.168221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 63 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:00.168247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=63 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:00.168258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:00.169995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 63 sessionId:  describe result for acl check
2025-10-15T10:55:00.170113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:00.170132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:00.170142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:00.170160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400305668612231:3154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:00.172839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400305668612231:3154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:00.177988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:00.182167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:00.183037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:00.183068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:00.183123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:00.183665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:00.183864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400308468317906:3039]
2025-10-15T10:55:00.186152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:00.187679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:00.187940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:00.189319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:00.189667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:00.189682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:00.189690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:00.189696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:00.189703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:00.189710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:00.189717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:00.189725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:00.189731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:00.189739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:00.189746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:00.189754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.189760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.189767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.189812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:00.189924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:00.189967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:00.190006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:00.190042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:00.190088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:00.190132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:00.190176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:00.190233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:00.190283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:00.190331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:00.190380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.190425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.190473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.189589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400305668612231:3154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:00.190522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:00.190592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:00.190651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:00.190707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:00.190763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:00.190818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:00.190869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:00.190926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:00.190981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:00.191041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:00.191086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:00.191137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:00.191185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:00.191265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:00.191314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:00.191397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:00.191443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:00.191504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:00.191554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:00.191611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:00.191667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:00.191729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:00.191780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.191840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.191894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.191951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.192004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.192059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.192579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:00.202262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400305668612231:3154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:00.202305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400305668612231:3154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:00.202324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400305668612231:3154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:00.202360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 63 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:00.210007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400305668612268:2534]
2025-10-15T10:55:00.210192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:00.233974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:00.244193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:00.244238Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:00.244254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:00.244276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:00.244302Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 62 [2:7561400308468317906:3039]
2025-10-15T10:55:00.244356Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:00.244416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:00.244429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.244442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.244453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.244504Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:00.244534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:00.244555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:00.245570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.245586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.245596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.245603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:00.245848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:00.245867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.246012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.246214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.246450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:00.246524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400305668612156:2467], now have 1 active actors on pipe
2025-10-15T10:55:00.246540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400305668612266:3154], now have 1 active actors on pipe
2025-10-15T10:55:00.246554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400305668612268:2534], now have 1 active actors on pipe
2025-10-15T10:55:00.246573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.246583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.246590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.246622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:00.246676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:00.246694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:00.246701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:00.246707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:00.246840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:00.246851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:00.246949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.246963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:00.246994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:00.249201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 62
2025-10-15T10:55:00.249311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 62
2025-10-15T10:55:00.249386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 62, pipe: [1:7561400305668612268:2534]
2025-10-15T10:55:00.250269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:00.250319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:00.250419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:00.250447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:00.250543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28863745-f78587bc-eaaa7f3-843474bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:00.250577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.250596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.250607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:00.250647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.250696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:00.250776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:00.250858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:00.251275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:00.251303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:00.251342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.251379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.251419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:00.251471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:00.251501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:00.252020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:00.252056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:00.252130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:00.252433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 63 partition: 0 MaxSeqNo: 46 sessionId: src_id|28863745-f78587bc-eaaa7f3-843474bf_0
2025-10-15T10:55:00.253276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923ab8f0-8a843538-225a5706-b16a5e67_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|28863745-f78587bc-eaaa7f3-843474bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:00.277052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28863745-f78587bc-eaaa7f3-843474bf_0] Write session: try to update token
2025-10-15T10:55:00.277117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28863745-f78587bc-eaaa7f3-843474bf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:00.325282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:00.325311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:00.325341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.325442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:00.326962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:00.327534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:00.332193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:00.333526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:00.395278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:00.407394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:00.408168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.408186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.408197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.408332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:00.439809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId: src_id|28863745-f78587bc-eaaa7f3-843474bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:00.466532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:00.466563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:00.466580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:00.466594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:00.466639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.466668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.466693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.466790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:00.466829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:00.466856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:00.466916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:00.466947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:00.468254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:00.471893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:00.616602Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:00.666740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:00.666788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:00.666869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:55:00.666883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:00.666895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:00.666935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.666958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400308468317895:3039]
2025-10-15T10:55:00.667370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:00.667432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:00.667468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:00.667506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:00.667533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:00.667560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:00.667582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:00.670897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:00.671106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:00.672321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400305668612268:2534]
2025-10-15T10:55:00.698239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 63 reason: status is not ok: tablet will be restarted right now sessionId: src_id|28863745-f78587bc-eaaa7f3-843474bf_0
2025-10-15T10:55:00.698594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 63 sessionId: src_id|28863745-f78587bc-eaaa7f3-843474bf_0 is DEAD
2025-10-15T10:55:00.699617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28863745-f78587bc-eaaa7f3-843474bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:00.699679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28863745-f78587bc-eaaa7f3-843474bf_0] Write session will restart in 0.006884s
2025-10-15T10:55:00.699840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28863745-f78587bc-eaaa7f3-843474bf_0] Write session: Do CDS request
2025-10-15T10:55:00.699893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28863745-f78587bc-eaaa7f3-843474bf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:00.728334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28863745-f78587bc-eaaa7f3-843474bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:00.731480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:00.731510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 64
2025-10-15T10:55:00.732098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:00.732228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 64 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:00.732247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=64 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:00.732257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:00.738406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 64 sessionId:  describe result for acl check
2025-10-15T10:55:00.738532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:00.738544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:00.738554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:00.738573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400305668612334:3162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:00.741106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400305668612334:3162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:00.759941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400305668612334:3162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:00.771151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400305668612417:2534]
2025-10-15T10:55:00.771378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:00.773430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400305668612334:3162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:00.773466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400305668612334:3162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:00.773483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400305668612334:3162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:00.773515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 64 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:00.774465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:00.776699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:00.777579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:00.777605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:00.777651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:00.777922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:00.778109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400308468318036:3045]
2025-10-15T10:55:00.780385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:00.781667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:00.781897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:00.783220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:00.783628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:00.783647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:00.783654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:00.783662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:00.783669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:00.783676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:00.783685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:00.783692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:00.783699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:00.783708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:00.783715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:00.783721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.783728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.783735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.783786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:00.783901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:00.783954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:00.784004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:00.784062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:00.784122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:00.784192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:00.784247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:00.784298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:00.784355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:00.784404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:00.784452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.784505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.784558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.784614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:00.784685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:00.784752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:00.784812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:00.784871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:00.784935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:00.784991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:00.785053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:00.785106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:00.785163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:00.785212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:00.785267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:00.785319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:00.785377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:00.785426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:00.785484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:00.785535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:00.785588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:00.785632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:00.785690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:00.785742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:00.785797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:00.785842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.785897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.785945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.785998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.786045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.786098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.786657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:00.806087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:00.816308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:00.816361Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:00.816381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:00.816402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:00.816426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 63 [2:7561400308468318036:3045]
2025-10-15T10:55:00.816481Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:00.816542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:00.816559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.816572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.816583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.816635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:00.816658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:00.816680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:00.833176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.833209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.833223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.833236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:00.833511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:00.833537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:00.833682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:00.833871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:00.834107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:00.834210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400305668612307:2467], now have 1 active actors on pipe
2025-10-15T10:55:00.834240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400305668612422:3162], now have 1 active actors on pipe
2025-10-15T10:55:00.834262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400305668612417:2534], now have 1 active actors on pipe
2025-10-15T10:55:00.834327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:00.834355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:00.834398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400308468318031:3045]
2025-10-15T10:55:00.834417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400308468318031:3045]
2025-10-15T10:55:00.834430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400308468318031:3045]
2025-10-15T10:55:00.833942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 63
2025-10-15T10:55:00.833942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 63
2025-10-15T10:55:00.834053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 63, pipe: [1:7561400305668612417:2534]
2025-10-15T10:55:00.834471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:00.834553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:00.834706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:00.834722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:00.834733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:00.834741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:00.834760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:00.834830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:00.834861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.834881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.834891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:00.834927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.834973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:00.835099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400308468318031:3045]
2025-10-15T10:55:00.835133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:00.835227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:00.835245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:00.835303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:00.835408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:00.835988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:00.836380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:00.836397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:00.836426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400308468318031:3045]
2025-10-15T10:55:00.836438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400308468318031:3045]
2025-10-15T10:55:00.836462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:00.836653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:00.836665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:00.837080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:00.837102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:00.837168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:00.837503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 64 partition: 0 MaxSeqNo: 46 sessionId: src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0
2025-10-15T10:55:00.839852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28863745-f78587bc-eaaa7f3-843474bf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:00.891252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0] Write session: try to update token
2025-10-15T10:55:00.891320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:00.917040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.917066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.917076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.943547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:00.943584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:00.943599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:00.943610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:00.943649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400308468318031:3045]
2025-10-15T10:55:00.943678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400308468318031:3045]
2025-10-15T10:55:00.943702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400308468318031:3045]
2025-10-15T10:55:00.943864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:00.943888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:00.944335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:00.944382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:00.944421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:00.944450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:00.944479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:00.959983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:01.117960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId: src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:01.140598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:01.181968Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:01.189157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:01.189207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:01.193495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:01.193644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:01.193657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:01.195505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400305668612417:2534]
2025-10-15T10:55:01.208384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:01.208424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:01.250905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 64 reason: error at write: Disconnected sessionId: src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0
2025-10-15T10:55:01.251261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 64 sessionId: src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0 is DEAD
2025-10-15T10:55:01.251705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:01.251797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0] Write session will restart in 0.009850s
2025-10-15T10:55:01.251998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0] Write session: Do CDS request
2025-10-15T10:55:01.252036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:01.269519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:01.272139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:01.272170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 65
2025-10-15T10:55:01.274788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:01.274962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 65 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:01.274980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=65 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:01.274994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:01.276672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 65 sessionId:  describe result for acl check
2025-10-15T10:55:01.276799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:01.276815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:01.276826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:01.276845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400309963579779:3168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:01.280443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400309963579779:3168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:01.289935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400309963579779:3168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:01.293648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400309963579806:2534]
2025-10-15T10:55:01.293837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:01.304905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400309963579779:3168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:01.304941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400309963579779:3168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:01.304954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400309963579779:3168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:01.304975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 65 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:01.335323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:01.339638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:01.340622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:01.340651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:01.340699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:01.340971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:01.341162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400312763285483:3054]
2025-10-15T10:55:01.343773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:01.344795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:01.345039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:01.346410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:01.346761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:01.346774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:01.346782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:01.346789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:01.346798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:01.346804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:01.346810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:01.346817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:01.346824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:01.346831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:01.346839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:01.346846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.346854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.346861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.346910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:01.347020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:01.347069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:01.347114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:01.347160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:01.347207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:01.347266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:01.347312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:01.347378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:01.347431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:01.347480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:01.347531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.347579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.347624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.347668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:01.347742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:01.347801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:01.347856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:01.347901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:01.347956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:01.348002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:01.348055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:01.348102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:01.348154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:01.348199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:01.348253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:01.348302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:01.348357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:01.348398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:01.348449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:01.348496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:01.348551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:01.348597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:01.348650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:01.348697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:01.348749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:01.348791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.348846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.348904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.348959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.349024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.349082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.349620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:01.376021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:01.388701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:01.388743Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:01.388759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:01.388779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:01.388803Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 64 [2:7561400312763285483:3054]
2025-10-15T10:55:01.388852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:01.388908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:01.388922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.388934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.388945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.388994Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:01.389014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:01.389036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:01.397848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.397881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.397896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.397922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:01.398253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:01.398297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.398537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.398736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.398964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:01.399058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400309963579845:3168], now have 1 active actors on pipe
2025-10-15T10:55:01.399087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400309963579806:2534], now have 1 active actors on pipe
2025-10-15T10:55:01.399108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400309963579743:2467], now have 1 active actors on pipe
2025-10-15T10:55:01.399134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.399153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.399173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.399212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:01.399294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:01.399332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:01.399338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:01.399375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:01.399678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:01.399705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:01.399909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 64
2025-10-15T10:55:01.399983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 64, pipe: [1:7561400309963579806:2534]
2025-10-15T10:55:01.400012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 64
2025-10-15T10:55:01.400121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.400160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:01.400673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:01.402154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:01.402220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:01.402317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:01.402333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:01.402431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:01.402466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.402485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.402497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:01.402536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.402585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:01.402647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:01.402731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:01.403151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:01.403171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:01.403208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.403222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.403250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:01.403518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:01.403533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:01.409966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:01.410009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:01.410099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:01.414731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 65 partition: 0 MaxSeqNo: 46 sessionId: src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0
2025-10-15T10:55:01.415632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecbce58f-7b43357f-615a69c8-cee5434d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:01.438434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0] Write session: try to update token
2025-10-15T10:55:01.438495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:01.546256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:01.546287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:01.546300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:01.546309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:01.546341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.546365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.546385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.546502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:01.546530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:01.546549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:01.546568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.546580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.546592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.546692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:01.546713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:01.547752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:01.583749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId: src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:01.608769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:01.701320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:01.718146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:01.718195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:01.718280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:01.718294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:01.718337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400312763285477:3054]
2025-10-15T10:55:01.718680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:01.718798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:01.720266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:01.720311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:01.728800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:01.728849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:01.821194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 65 reason: error at write: Disconnected sessionId: src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0
2025-10-15T10:55:01.821506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 65 sessionId: src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0 is DEAD
2025-10-15T10:55:01.823990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:01.824059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0] Write session will restart in 0.005095s
2025-10-15T10:55:01.824210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0] Write session: Do CDS request
2025-10-15T10:55:01.824276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:01.841488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:01.842420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:01.845829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:01.846684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:01.846700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:01.846744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:01.847011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:01.847194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400312763285619:3062]
2025-10-15T10:55:01.849758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:01.850683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:01.850826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:01.852585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:01.852844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:01.852870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:01.852877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:01.852884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:01.852890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:01.852896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:01.852901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:01.852905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:01.852909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:01.852913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:01.852917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:01.852921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.852925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.852928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.852958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:01.853028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:01.853057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:01.853085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:01.853113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:01.853141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:01.853184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:01.853230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:01.853282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:01.853338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:01.853389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:01.853440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.853486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.853544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.853588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:01.853651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:01.853706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:01.853766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:01.853815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:01.853875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:01.853923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:01.853973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:01.854027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:01.854082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:01.854132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:01.854166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:01.854194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:01.854238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:01.854261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:01.854290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:01.854315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:01.854345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:01.854369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:01.854398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:01.854423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:01.854451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:01.854479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.854508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.854533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.854563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.854586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.854615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.854910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:01.881495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:01.893685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400309963579806:2534]
2025-10-15T10:55:01.893788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:01.893912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:01.893926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 66
2025-10-15T10:55:01.896602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:01.896642Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:01.896660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:01.896681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:01.896704Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 65 [2:7561400312763285619:3062]
2025-10-15T10:55:01.896756Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:01.896815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:01.896827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.896838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.896848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.896892Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:01.896914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:01.896935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:01.898764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.898780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.898793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.898804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:01.899060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:01.899076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:01.899212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:01.899410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:01.899634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:01.899719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400309963579984:2467], now have 1 active actors on pipe
2025-10-15T10:55:01.899742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400312763285613:3062]
2025-10-15T10:55:01.899755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400312763285613:3062]
2025-10-15T10:55:01.899768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400312763285613:3062]
2025-10-15T10:55:01.899805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:01.899875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:01.900046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:01.900061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:01.900166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400312763285613:3062]
2025-10-15T10:55:01.900185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:01.900294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:01.900310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:01.900322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:01.900355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:01.901235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:01.901380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 66 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:01.901397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=66 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:01.901414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:01.901536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 65
2025-10-15T10:55:01.903570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 66 sessionId:  describe result for acl check
2025-10-15T10:55:01.903673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:01.903682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:01.903692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:01.903707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400309963579990:3178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:01.906117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400309963579990:3178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:01.912460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400309963579990:3178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:01.937453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400309963579990:3178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:01.937491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400309963579990:3178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:01.937506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400309963579990:3178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:01.937537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 66 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:01.939219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400309963580020:3178], now have 1 active actors on pipe
2025-10-15T10:55:01.943561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 65
2025-10-15T10:55:01.944073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:01.944120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:01.944208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92389196-b36ae73e-80f225ba-97631590_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:01.944247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.944267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.944280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:01.944321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.944372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:01.944420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:01.947602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:01.947648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:01.947752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:01.950519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55b5dc48-4a8d58df-941c8db8-c77ddd8d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|92389196-b36ae73e-80f225ba-97631590_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:01.948136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 66 partition: 0 MaxSeqNo: 46 sessionId: src_id|92389196-b36ae73e-80f225ba-97631590_0
2025-10-15T10:55:01.993388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400309963580029:2534]
2025-10-15T10:55:01.993587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:01.994514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 65, pipe: [1:7561400309963580029:2534]
2025-10-15T10:55:02.061975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92389196-b36ae73e-80f225ba-97631590_0] Write session: try to update token
2025-10-15T10:55:02.062048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92389196-b36ae73e-80f225ba-97631590_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:02.109196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400309963580029:2534], now have 1 active actors on pipe
2025-10-15T10:55:02.109330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:02.109362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:02.109434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.109448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.109459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.109584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:02.109598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:02.109611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:02.109622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:02.109654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400312763285613:3062]
2025-10-15T10:55:02.109681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400312763285613:3062]
2025-10-15T10:55:02.109702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400312763285613:3062]
2025-10-15T10:55:02.111627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:02.111673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:02.111704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:02.139224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:02.139267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:02.140304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:02.212877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId: src_id|92389196-b36ae73e-80f225ba-97631590_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:02.240837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:02.307169Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:02.308532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:02.308557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:02.308591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400312763285613:3062]
2025-10-15T10:55:02.308722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:02.308730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:02.308755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:02.309419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:02.309448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:02.309304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:02.309484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400309963580029:2534]
2025-10-15T10:55:02.309569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:02.309581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:02.366005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 66 reason: error at write: Disconnected sessionId: src_id|92389196-b36ae73e-80f225ba-97631590_0
2025-10-15T10:55:02.366729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92389196-b36ae73e-80f225ba-97631590_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:02.366777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92389196-b36ae73e-80f225ba-97631590_0] Write session will restart in 0.008713s
2025-10-15T10:55:02.366885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92389196-b36ae73e-80f225ba-97631590_0] Write session: Do CDS request
2025-10-15T10:55:02.366918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92389196-b36ae73e-80f225ba-97631590_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:02.366894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 66 sessionId: src_id|92389196-b36ae73e-80f225ba-97631590_0 is DEAD
2025-10-15T10:55:02.380850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92389196-b36ae73e-80f225ba-97631590_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:02.382570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:02.382601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 67
2025-10-15T10:55:02.387622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:02.387777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 67 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:02.387793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=67 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:02.387802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:02.388931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:02.389337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 67 sessionId:  describe result for acl check
2025-10-15T10:55:02.389447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:02.389457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:02.389467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:02.389483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400314258547435:3187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:02.397497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:02.398374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:02.398420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:02.398469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:02.398703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:02.398912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400317058253059:3068]
2025-10-15T10:55:02.400460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:02.402439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400314258547435:3187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:02.405215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:02.405530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:02.410010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:02.410569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:02.410589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:02.410597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:02.410604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:02.410612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:02.410618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:02.410625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:02.410633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:02.410639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:02.410647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:02.410655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:02.410664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.410671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.410679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.410732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:02.410857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:02.410920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:02.410979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:02.411035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:02.411090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:02.411146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:02.411201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:02.411256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:02.411315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:02.411382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:02.410987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400314258547456:2534]
2025-10-15T10:55:02.411435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.411486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.411150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:02.411536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.411596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:02.411681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:02.411751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:02.411814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:02.411873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:02.411941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:02.411999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:02.412063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:02.412124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:02.412184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:02.412232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:02.412289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:02.412339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:02.412395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:02.412444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:02.412500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:02.412551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:02.412606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:02.412655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:02.412714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:02.412767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:02.412821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:02.412869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.412928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.419257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400314258547435:3187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:02.422271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.422435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.422501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.422560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.423050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:02.439062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400314258547435:3187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:02.439102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400314258547435:3187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:02.439119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400314258547435:3187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:02.439147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 67 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:02.459310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:02.469324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:02.469375Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:02.469396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:02.469417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:02.469442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 66 [2:7561400317058253059:3068]
2025-10-15T10:55:02.469499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:02.469566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:02.469583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.469597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.469608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.469662Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:02.469686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:02.469709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:02.470990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.471009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.471024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.471036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:02.471319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:02.471337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.471518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.471726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.471971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:02.472048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.472063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.472078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.472121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:02.472203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:02.472205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:02.472225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:02.472237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:02.472401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:02.472421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:02.472555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.472577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:02.472592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:02.472631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400314258547353:2467], now have 1 active actors on pipe
2025-10-15T10:55:02.472658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400314258547469:3187], now have 1 active actors on pipe
2025-10-15T10:55:02.472732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400314258547456:2534], now have 1 active actors on pipe
2025-10-15T10:55:02.475829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 66
2025-10-15T10:55:02.475949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 66
2025-10-15T10:55:02.476035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 66, pipe: [1:7561400314258547456:2534]
2025-10-15T10:55:02.487659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:02.487712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:02.487826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:02.487846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:02.487947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:02.487989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.488010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.488022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:02.488064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.488117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:02.488185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:02.488280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:02.488700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:02.488721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:02.488761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.488776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.488817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:02.489506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:02.489526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:02.490461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:02.490497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:02.490574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:02.491037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 67 partition: 0 MaxSeqNo: 46 sessionId: src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0
2025-10-15T10:55:02.491962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92389196-b36ae73e-80f225ba-97631590_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:02.576309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0] Write session: try to update token
2025-10-15T10:55:02.576383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:02.655533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.655571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.655585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.655644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:02.655658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:02.655674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:02.655686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:02.655723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.655750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.655774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.655973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:02.655997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:02.656099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:02.656132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:02.656161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:02.666998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:02.761604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId: src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:02.791874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:02.845798Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:02.858605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:02.858678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:02.858757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:02.858774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:02.858821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400317058253054:3068]
2025-10-15T10:55:02.859422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:02.859836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:02.860081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:02.860100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:02.863241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400314258547456:2534]
2025-10-15T10:55:02.867075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:02.867136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:02.895308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 67 reason: error at write: Disconnected sessionId: src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0
2025-10-15T10:55:02.895696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 67 sessionId: src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0 is DEAD
2025-10-15T10:55:02.900296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:02.900371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0] Write session will restart in 0.005867s
2025-10-15T10:55:02.900551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0] Write session: Do CDS request
2025-10-15T10:55:02.900622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:02.914563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:02.914611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 68
2025-10-15T10:55:02.915213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:02.916292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:02.916512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 68 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:02.916535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=68 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:02.916556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:02.919217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 68 sessionId:  describe result for acl check
2025-10-15T10:55:02.919377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:02.919396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:02.919406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:02.919425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400314258547505:3191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:02.922148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400314258547505:3191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:02.937715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400314258547505:3191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:02.949690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400314258547505:3191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:02.949734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400314258547505:3191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:02.949750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400314258547505:3191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:02.949782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 68 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:02.951898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:02.955385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:02.956201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:02.956219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:02.956258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:02.956506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:02.956686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400317058253197:3076]
2025-10-15T10:55:02.958871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:02.960316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:02.960521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:02.961741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:02.962065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:02.962073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:02.962081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:02.962088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:02.962095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:02.962103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:02.962110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:02.962116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:02.963540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400314258547605:2534]
2025-10-15T10:55:02.962123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:02.962130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:02.962137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:02.962144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.962152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.962158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.962203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:02.962325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:02.962372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:02.962420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:02.963770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:02.962464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:02.962510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:02.962554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:02.962598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:02.962644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:02.962689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:02.962735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:02.962779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.962823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.962865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.962908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:02.962972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:02.963029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:02.963082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:02.963131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:02.963186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:02.963231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:02.963281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:02.963331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:02.964623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:02.964691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:02.964745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:02.964791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:02.964840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:02.964886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:02.964935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:02.964983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:02.965039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:02.965086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:02.965137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:02.965183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:02.965234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:02.965279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.965331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:02.965375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.965427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:02.965470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.965519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:02.966011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:03.001676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:03.017320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:03.017360Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:03.017370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:03.017385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:03.017403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 67 [2:7561400317058253197:3076]
2025-10-15T10:55:03.017439Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:03.017493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:03.017502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.017511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.017518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.017556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:03.017572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:03.017587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:03.019042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:03.019070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:03.019085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:03.019096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:03.019306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:03.019317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:03.019437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:03.019571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:03.019733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:03.019793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400314258547605:2534], now have 1 active actors on pipe
2025-10-15T10:55:03.019813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400314258547600:3191], now have 1 active actors on pipe
2025-10-15T10:55:03.019828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400314258547490:2467], now have 1 active actors on pipe
2025-10-15T10:55:03.019847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400317058253190:3076]
2025-10-15T10:55:03.019856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400317058253190:3076]
2025-10-15T10:55:03.019872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400317058253190:3076]
2025-10-15T10:55:03.019897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:03.019948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:03.019953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:03.019969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:03.019980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:03.020086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:03.020102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:03.020190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400317058253190:3076]
2025-10-15T10:55:03.020210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:03.020248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:03.022506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 67, pipe: [1:7561400314258547605:2534]
2025-10-15T10:55:03.022572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 67
2025-10-15T10:55:03.022619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 67
2025-10-15T10:55:03.023756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:03.023805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:03.023890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:03.023915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:03.024027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:03.024079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.024102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.024113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:03.024164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.024219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:03.024301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:03.024361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:03.024790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:03.024814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:03.024852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400317058253190:3076]
2025-10-15T10:55:03.024873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400317058253190:3076]
2025-10-15T10:55:03.024911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:03.025806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:03.025829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:03.026402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:03.026434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:03.026508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:03.026851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 68 partition: 0 MaxSeqNo: 46 sessionId: src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0
2025-10-15T10:55:03.028138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ccca3bb-63fa7ffb-1add7c73-7a24fc0e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:03.070169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0] Write session: try to update token
2025-10-15T10:55:03.070253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:03.150791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.150829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.150841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.150907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:03.150923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:03.150938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:03.150950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:03.150987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400317058253190:3076]
2025-10-15T10:55:03.151017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400317058253190:3076]
2025-10-15T10:55:03.151043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400317058253190:3076]
2025-10-15T10:55:03.151203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:03.151239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:03.151246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:03.151299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:03.151332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:03.152373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:03.246287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId: src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:03.289655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:03.304585Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:03.306726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:03.306773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:03.308974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400314258547605:2534]
2025-10-15T10:55:03.309108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:03.309122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:03.317174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:03.317215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:03.351838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:03.352005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 68 reason: error at write: Disconnected sessionId: src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0
2025-10-15T10:55:03.352234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 68 sessionId: src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0 is DEAD
2025-10-15T10:55:03.355975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:03.356052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0] Write session will restart in 0.007430s
2025-10-15T10:55:03.356208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0] Write session: Do CDS request
2025-10-15T10:55:03.356268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:03.370997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:03.375107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:03.375132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 69
2025-10-15T10:55:03.375732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:03.375845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 69 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:03.375861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=69 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:03.375871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:03.379480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 69 sessionId:  describe result for acl check
2025-10-15T10:55:03.379588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:03.379598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:03.379609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:03.379625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400318553515005:3203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:03.381270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400318553515005:3203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:03.391131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400318553515005:3203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:03.399526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:03.401996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:03.402887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:03.402922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:03.402966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:03.403237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:03.403483Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400321353220649:3085]
2025-10-15T10:55:03.405709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:03.406825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:03.407057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:03.408346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:03.408676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:03.408691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:03.408697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:03.408704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:03.408711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:03.408717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:03.408724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:03.408731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:03.408738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:03.408744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:03.408752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:03.408758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:03.408764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:03.408771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:03.408818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:03.408921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:03.408967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:03.409016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:03.409060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:03.408727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400318553515005:3203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:03.408766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400318553515005:3203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:03.408784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400318553515005:3203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:03.409114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:03.408816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 69 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:03.409162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:03.409198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400318553515057:2534]
2025-10-15T10:55:03.409205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:03.409250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:03.409298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:03.409349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:03.409398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:03.409451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:03.409494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:03.409537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:03.409606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:03.409670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:03.409729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:03.409780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:03.409358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:03.409833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:03.409882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:03.409940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:03.409992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:03.410048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:03.410095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:03.410143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:03.410192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:03.410260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:03.410310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:03.410361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:03.410410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:03.410469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:03.410518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:03.410571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:03.410622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:03.410679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:03.410734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:03.410789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:03.410839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:03.410897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:03.410944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:03.410999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:03.411876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:03.437973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:03.452743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:03.452787Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:03.452804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:03.452825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:03.452850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 68 [2:7561400321353220649:3085]
2025-10-15T10:55:03.452900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:03.452960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:03.452975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.452988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.453000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.453049Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:03.453074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:03.453097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:03.486249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 68
2025-10-15T10:55:03.486355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 68
2025-10-15T10:55:03.486434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 68, pipe: [1:7561400318553515057:2534]
2025-10-15T10:55:03.485045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:03.485080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:03.485094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:03.485105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:03.485394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:03.485412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:03.485544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:03.485713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:03.485935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:03.486016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400318553515056:3203], now have 1 active actors on pipe
2025-10-15T10:55:03.486039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400318553515057:2534], now have 1 active actors on pipe
2025-10-15T10:55:03.486061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400318553514953:2467], now have 1 active actors on pipe
2025-10-15T10:55:03.486087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.486102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.486115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.486157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:03.486204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:03.486219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:03.486242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:03.486242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:03.486415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:03.486433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:03.486549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.486576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:03.486590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:03.486747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:03.486771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:03.486869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:03.486883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:03.486954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:03.486986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.487004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.487015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:03.487052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.487096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:03.487149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:03.487216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:03.488291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:03.488322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:03.488358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.488372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.488404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:03.488608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:03.488626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:03.491792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:03.491832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:03.491913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:03.492235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 69 partition: 0 MaxSeqNo: 46 sessionId: src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0
2025-10-15T10:55:03.496385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2750e0-be03ba08-ce8d8f57-1c1144a0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:03.580349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0] Write session: try to update token
2025-10-15T10:55:03.580405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:03.588676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.588706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.588717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.588774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:03.588789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:03.588824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.588937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:03.590424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:03.623837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:03.624814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:03.625762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:03.626916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:03.647916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:03.648272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:03.779376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.779410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.779423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.779482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:03.779497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:03.779509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:03.779519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:03.779557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.779583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.779605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400321353220643:3085]
2025-10-15T10:55:03.779734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:03.779754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:03.780129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:03.780167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:03.780195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:03.796554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:03.905465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId: src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:03.958864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:04.005222Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:04.006701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:04.006728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:04.009870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:04.009995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:04.010006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:04.011719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400318553515057:2534]
2025-10-15T10:55:04.016845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:04.016881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:04.056795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:04.056860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0] Write session will restart in 0.009912s
2025-10-15T10:55:04.057013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0] Write session: Do CDS request
2025-10-15T10:55:04.057063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:04.056082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 69 reason: error at write: Disconnected sessionId: src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0
2025-10-15T10:55:04.056469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 69 sessionId: src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0 is DEAD
2025-10-15T10:55:04.080827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:04.082848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:04.082874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 70
2025-10-15T10:55:04.083524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:04.083632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 70 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:04.083646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=70 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:04.083654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:04.087213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 70 sessionId:  describe result for acl check
2025-10-15T10:55:04.087331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:04.087343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:04.087377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:04.087399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400322848482439:3213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:04.096840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400322848482439:3213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:04.110382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400322848482492:2534]
2025-10-15T10:55:04.110546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:04.120751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400322848482439:3213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:04.127424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:04.131074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400322848482439:3213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:04.131112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400322848482439:3213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:04.131128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400322848482439:3213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:04.131156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 70 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:04.132856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:04.133637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:04.133654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:04.133694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:04.133926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:04.134092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400325648188087:3089]
2025-10-15T10:55:04.136121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:04.138971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:04.139193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:04.140427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:04.140727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:04.140735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:04.140741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:04.140747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:04.140754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:04.140760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:04.140767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:04.140774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:04.140782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:04.140788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:04.140794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:04.140801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.140808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.140814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.140859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:04.140964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:04.141012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:04.141062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:04.141106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:04.141150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:04.141194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:04.141238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:04.141283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:04.141328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:04.141372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:04.141417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.141461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.141503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.141544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:04.141607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:04.141663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:04.141711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:04.141756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:04.141806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:04.141850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:04.141902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:04.141944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:04.141994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:04.142036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:04.142084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:04.142128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:04.142178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:04.142218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:04.142279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:04.142325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:04.142378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:04.142422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:04.142472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:04.142517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:04.142567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:04.142611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.142659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.142705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.142755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.142801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.142853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.143335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:04.167219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:04.177654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:04.177699Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:04.177716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:04.177735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:04.177758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 69 [2:7561400325648188087:3089]
2025-10-15T10:55:04.177807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:04.177861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:04.177876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.177886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.177896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.177938Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:04.177958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:04.177977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:04.222296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.222329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.222340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.222350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:04.222603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:04.222619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.222739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.222892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.223082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:04.223143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.223156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.223169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.223209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:04.223277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:04.223822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:04.223841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:04.223853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:04.224780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 69
2025-10-15T10:55:04.224882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 69
2025-10-15T10:55:04.224962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 69, pipe: [1:7561400322848482492:2534]
2025-10-15T10:55:04.225501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:04.225534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:04.225669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400322848482397:2467], now have 1 active actors on pipe
2025-10-15T10:55:04.225690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400322848482513:3213], now have 1 active actors on pipe
2025-10-15T10:55:04.225710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400322848482492:2534], now have 1 active actors on pipe
2025-10-15T10:55:04.225763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:04.225782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:04.225854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:04.225867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:04.225906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.225938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:04.226043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:04.226068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.226085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.226096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:04.226126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.226162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:04.226274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:04.226353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:04.226697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:04.226713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:04.226741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.226753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.226775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:04.226963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:04.226987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:04.226996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:04.230827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:04.230860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:04.230933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:04.231321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 70 partition: 0 MaxSeqNo: 46 sessionId: src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0
2025-10-15T10:55:04.232255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83837545-bc05e2e1-bf99fbef-d6a6e4ec_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:04.271001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0] Write session: try to update token
2025-10-15T10:55:04.271056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:04.279466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.279496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.279506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.438832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:04.438863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:04.438876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:04.438886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:04.438919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.438943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.438964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.439163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.439182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.439186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:04.439192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.439224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:04.439233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:04.439248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:04.439251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:04.440401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:04.453481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId: src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:04.475792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:04.581881Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:04.594792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:04.594838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:04.594896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:04.594908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:04.594946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400325648188080:3089]
2025-10-15T10:55:04.597008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:04.597129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:04.597140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:04.595704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:04.599001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400322848482492:2534]
2025-10-15T10:55:04.610823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:04.610849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:04.636865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 70 reason: error at write: Disconnected sessionId: src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0
2025-10-15T10:55:04.637440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:04.637476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0] Write session will restart in 0.006518s
2025-10-15T10:55:04.637577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0] Write session: Do CDS request
2025-10-15T10:55:04.637618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:04.637182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 70 sessionId: src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0 is DEAD
2025-10-15T10:55:04.648425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:04.650585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:04.650616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 71
2025-10-15T10:55:04.650885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:04.650985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 71 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:04.650999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=71 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:04.651008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:04.652435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 71 sessionId:  describe result for acl check
2025-10-15T10:55:04.652531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:04.652548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:04.652556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:04.652571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400322848482557:3218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:04.655165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400322848482557:3218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:04.665835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400322848482557:3218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:04.674012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400322848482557:3218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:04.674051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400322848482557:3218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:04.674066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400322848482557:3218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:04.674092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 71 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:04.693026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400322848482625:2534]
2025-10-15T10:55:04.693148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:04.716910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:04.718640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:04.719236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:04.719251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:04.719289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:04.719535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:04.719710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400325648188242:3099]
2025-10-15T10:55:04.722243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:04.723240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:04.723469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:04.724609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:04.724915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:04.724923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:04.724929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:04.724936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:04.724942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:04.724948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:04.724955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:04.724961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:04.724967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:04.724973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:04.724979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:04.724986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.724993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.724999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.725043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:04.725147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:04.725193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:04.725238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:04.725281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:04.725324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:04.725366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:04.725410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:04.725455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:04.725502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:04.725543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:04.725586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.725630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.725671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.725713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:04.725774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:04.725826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:04.725879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:04.725925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:04.725976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:04.726017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:04.726067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:04.726111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:04.726160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:04.726200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:04.726264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:04.726311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:04.726365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:04.726407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:04.726461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:04.726507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:04.726556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:04.726599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:04.726650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:04.726694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:04.726747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:04.726798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.726854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.726904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.726960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.727008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.727061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.732525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:04.758941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:04.798177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:04.798210Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:04.798220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:04.798232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:04.798259Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 70 [2:7561400325648188242:3099]
2025-10-15T10:55:04.798295Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:04.798332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:04.798340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.798347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.798353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.798385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:04.798399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:04.798413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:04.803933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.803965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.803978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.803986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:04.804225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:04.804239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:04.804355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:04.804505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:04.804699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:04.804758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:04.804783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:04.804794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:04.804832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:04.804892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:04.805001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:04.805029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:04.805051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:04.805051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:04.805064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:04.805162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:04.805189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:04.805322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:04.806667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 70, pipe: [1:7561400322848482625:2534]
2025-10-15T10:55:04.806762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 70
2025-10-15T10:55:04.806872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 70
2025-10-15T10:55:04.812824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400322848482625:2534], now have 1 active actors on pipe
2025-10-15T10:55:04.812877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400322848482593:3218], now have 1 active actors on pipe
2025-10-15T10:55:04.812895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400322848482541:2467], now have 1 active actors on pipe
2025-10-15T10:55:04.812989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:04.813019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:04.813073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:04.813093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:04.813181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:04.813219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.813235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.813244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:04.813276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.813313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:04.813379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:04.813432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:04.813775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:04.813791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:04.813822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:04.813834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:04.813872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:04.814135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:04.814148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:04.815046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:04.815072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:04.815135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:04.816473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e2aa49-37090622-dc6b73d4-8f9188f7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:04.815551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 71 partition: 0 MaxSeqNo: 46 sessionId: src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0
2025-10-15T10:55:04.863641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0] Write session: try to update token
2025-10-15T10:55:04.863703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:04.891978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:04.892019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:04.892055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:04.892192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:04.892395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:04.907931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:04.979127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:04.980642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:04.981826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:04.996443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:05.001530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.001566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.001577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.001712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:05.109421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:05.109456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:05.109472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:05.109482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:05.109524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:05.109550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:05.109573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400325648188237:3099]
2025-10-15T10:55:05.109750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.109761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.109772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.109821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:05.109841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:05.110674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:05.110706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:05.110735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:05.118769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:05.138576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId: src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:05.164676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:05.268362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:05.270528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:05.271399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400322848482625:2534]
2025-10-15T10:55:05.270564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:05.271551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:05.271581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:05.277933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:05.277974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:05.316479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:05.316629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 71 reason: error at write: Disconnected sessionId: src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0
2025-10-15T10:55:05.316972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 71 sessionId: src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0 is DEAD
2025-10-15T10:55:05.319488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:05.319529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0] Write session will restart in 0.007002s
2025-10-15T10:55:05.319662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0] Write session: Do CDS request
2025-10-15T10:55:05.319700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:05.330890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:05.349577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:05.349606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 72
2025-10-15T10:55:05.350204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:05.350342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 72 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:05.350361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=72 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:05.350370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:05.352856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 72 sessionId:  describe result for acl check
2025-10-15T10:55:05.352969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:05.352985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:05.352995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:05.353013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400327143450091:3230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:05.356448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:05.357443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400327143450091:3230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:05.360639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:05.361634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:05.361672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:05.361722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:05.362046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:05.362282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400329943155699:3107]
2025-10-15T10:55:05.365703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:05.366651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:05.366894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:05.365338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400327143450091:3230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:05.368341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:05.368691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:05.368715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:05.368722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:05.368728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:05.368735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:05.368743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:05.368750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:05.368757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:05.368763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:05.368771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:05.368778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:05.368785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.368791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.368797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.368844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:05.368959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:05.369007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:05.369062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:05.369116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:05.369170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:05.369220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:05.369273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:05.369324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:05.369373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:05.369425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:05.369485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.369541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.369596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.369645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:05.369716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:05.369778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:05.369841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:05.369893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:05.369953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:05.370003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:05.370078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:05.370143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:05.370206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:05.370267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:05.370328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:05.370377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:05.370450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:05.370502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:05.370557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:05.370615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:05.370988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:05.371061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:05.371124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:05.371179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:05.371238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:05.371288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.371357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.371428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.371488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.371475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400327143450129:2534]
2025-10-15T10:55:05.371544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.371669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:05.371618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.372166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:05.373898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400327143450091:3230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:05.373936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400327143450091:3230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:05.373955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400327143450091:3230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:05.373984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 72 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:05.392455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:05.433666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:05.433721Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:05.433742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:05.433765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:05.433799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 71 [2:7561400329943155699:3107]
2025-10-15T10:55:05.433857Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:05.433917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:05.433933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.433946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.433958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.434012Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:05.434037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:05.434061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:05.435060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.435076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.435090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.435103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:05.435757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 71
2025-10-15T10:55:05.435810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 71, pipe: [1:7561400327143450129:2534]
2025-10-15T10:55:05.435406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:05.435858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 71
2025-10-15T10:55:05.435433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.435606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.435855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.436112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:05.436218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400327143450136:3230], now have 1 active actors on pipe
2025-10-15T10:55:05.436255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400327143450129:2534], now have 1 active actors on pipe
2025-10-15T10:55:05.436279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400327143450003:2467], now have 1 active actors on pipe
2025-10-15T10:55:05.436307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.436327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.436343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.436381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:05.436444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:05.436469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:05.436476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:05.436481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:05.436688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:05.436720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:05.436781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:05.436808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:05.436920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:05.436940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:05.437055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.437087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:05.437127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:05.437169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68a91223-eaa93830-ce8d4389-5b772b17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:05.437206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.437220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.437227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:05.437257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.437290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:05.437443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:05.437550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:05.437942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:05.437966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:05.437997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.438011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.438035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:05.438077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:05.438099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:05.438545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:05.438575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:05.438641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:05.438904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 72 partition: 0 MaxSeqNo: 46 sessionId: src_id|68a91223-eaa93830-ce8d4389-5b772b17_0
2025-10-15T10:55:05.439727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a84343-ce7d6422-7cdcef9b-125698d1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|68a91223-eaa93830-ce8d4389-5b772b17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:05.461667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a91223-eaa93830-ce8d4389-5b772b17_0] Write session: try to update token
2025-10-15T10:55:05.461723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a91223-eaa93830-ce8d4389-5b772b17_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:05.569567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:05.569606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:05.569618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:05.569628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:05.569665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.569690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.569713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.569831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:05.569866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:05.569881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.569893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:05.569894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.569906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.570016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:05.570038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:05.571130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:05.631487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId: src_id|68a91223-eaa93830-ce8d4389-5b772b17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:05.656535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:05.723508Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:05.733902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:05.733950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:05.734018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:05.734032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:05.734072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400329943155692:3107]
2025-10-15T10:55:05.734686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:05.735651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:05.735691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:05.735860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400327143450129:2534]
2025-10-15T10:55:05.735971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:05.743368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 72 reason: error at write: Disconnected sessionId: src_id|68a91223-eaa93830-ce8d4389-5b772b17_0
2025-10-15T10:55:05.743716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 72 sessionId: src_id|68a91223-eaa93830-ce8d4389-5b772b17_0 is DEAD
2025-10-15T10:55:05.747705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a91223-eaa93830-ce8d4389-5b772b17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:05.747745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a91223-eaa93830-ce8d4389-5b772b17_0] Write session will restart in 0.007901s
2025-10-15T10:55:05.747844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a91223-eaa93830-ce8d4389-5b772b17_0] Write session: Do CDS request
2025-10-15T10:55:05.747871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a91223-eaa93830-ce8d4389-5b772b17_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:05.760450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a91223-eaa93830-ce8d4389-5b772b17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:05.760321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:05.760353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 73
2025-10-15T10:55:05.762226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:05.762401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 73 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:05.762428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=73 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:05.762438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:05.767145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:05.767193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:05.763926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 73 sessionId:  describe result for acl check
2025-10-15T10:55:05.764061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:05.764073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:05.764083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:05.764101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400327143450159:3236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:05.771693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400327143450159:3236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:05.801028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400327143450159:3236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:05.824717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400327143450159:3236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:05.824767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400327143450159:3236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:05.824787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400327143450159:3236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:05.824826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 73 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:05.837625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400327143450224:2534]
2025-10-15T10:55:05.837815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:05.867181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:05.873928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:05.875015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:05.875040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:05.875091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:05.875427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:05.875631Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400329943155833:3112]
2025-10-15T10:55:05.877908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:05.879569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:05.879840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:05.881154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:05.881513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:05.881526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:05.881533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:05.881539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:05.881547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:05.881553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:05.881562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:05.881570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:05.881575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:05.881583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:05.881590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:05.881599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.881605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.881613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.881664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:05.881784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:05.881834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:05.881886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:05.881936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:05.881983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:05.882030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:05.882079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:05.882127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:05.882175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:05.882221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:05.882283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.882330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.882376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.882422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:05.883552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:05.883641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:05.883723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:05.883774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:05.883831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:05.883881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:05.883936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:05.883985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:05.884043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:05.884094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:05.884150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:05.884201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:05.884257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:05.884762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:05.884833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:05.884890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:05.884946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:05.884993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:05.885049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:05.885101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:05.885159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:05.885207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.885262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.885315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.885369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.885417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.885471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.886026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:05.917149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:05.927940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:05.927998Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:05.928018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:05.928041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:05.928068Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 72 [2:7561400329943155833:3112]
2025-10-15T10:55:05.928129Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:05.928200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:05.928216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.928230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.928244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.928302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:05.928326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:05.928351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:05.929470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.929487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.929501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.929515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:05.929803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:05.929824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:05.929982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:05.930189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:05.930465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:05.930545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400329943155827:3112]
2025-10-15T10:55:05.930561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400329943155827:3112]
2025-10-15T10:55:05.930576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400329943155827:3112]
2025-10-15T10:55:05.930627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:05.930719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:05.930935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:05.930956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:05.931107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400329943155827:3112]
2025-10-15T10:55:05.931128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:05.931796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:05.931810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:05.931824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:05.931848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:05.932231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400327143450224:2534], now have 1 active actors on pipe
2025-10-15T10:55:05.932277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400327143450149:2467], now have 1 active actors on pipe
2025-10-15T10:55:05.932303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400327143450210:3236], now have 1 active actors on pipe
2025-10-15T10:55:05.933096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 72, pipe: [1:7561400327143450224:2534]
2025-10-15T10:55:05.933189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 72
2025-10-15T10:55:05.933259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 72
2025-10-15T10:55:05.933808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:05.933853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:05.933945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:05.933968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:05.934078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:05.934120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.934144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.934155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:05.934195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.934247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:05.934338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:05.934400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:05.934824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:05.934850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:05.934887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400329943155827:3112]
2025-10-15T10:55:05.934901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400329943155827:3112]
2025-10-15T10:55:05.934928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:05.935335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:05.935375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:05.936928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:05.936964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:05.937042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:05.937362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 73 partition: 0 MaxSeqNo: 46 sessionId: src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0
2025-10-15T10:55:05.938324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a91223-eaa93830-ce8d4389-5b772b17_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:05.980105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0] Write session: try to update token
2025-10-15T10:55:05.980173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:06.070648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.070684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.070696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.070761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:06.070776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:06.070790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:06.070803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:06.070840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400329943155827:3112]
2025-10-15T10:55:06.070865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400329943155827:3112]
2025-10-15T10:55:06.070887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400329943155827:3112]
2025-10-15T10:55:06.071041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:06.071065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:06.071326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:06.071381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:06.071413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:06.074173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:06.215455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId: src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:06.293377Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:06.299898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:06.301369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400327143450224:2534]
2025-10-15T10:55:06.301461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:06.309780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:06.309804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:06.326006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 73 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0
2025-10-15T10:55:06.326595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 73 sessionId: src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0 is DEAD
2025-10-15T10:55:06.327656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:55:06.327696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0] Write session will restart in 0.007372s
2025-10-15T10:55:06.327801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0] Write session: Do CDS request
2025-10-15T10:55:06.327832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:06.364558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:06.411258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:06.411291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 74
2025-10-15T10:55:06.412084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400331438417606:2534]
2025-10-15T10:55:06.412287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:06.417986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:06.418145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 74 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:06.418169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=74 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:06.418180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:06.425621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 74 sessionId:  describe result for acl check
2025-10-15T10:55:06.425757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:06.425770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:06.425781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:06.425801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400331438417616:3243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:06.435622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400331438417616:3243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:06.458294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400331438417616:3243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:06.458850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400331438417606:2534]
2025-10-15T10:55:06.458976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: ERROR TabletId: 72075186224037892 Generation: 0, pipe: [0:0:0]
2025-10-15T10:55:06.501887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400331438417616:3243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:06.501928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400331438417616:3243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:06.501944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400331438417616:3243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:06.501978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 74 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:06.548044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:06.551974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:06.552910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:06.552928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:06.552971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:06.553238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:06.553414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400334238123286:3120]
2025-10-15T10:55:06.555735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:06.559426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400331438417740:2534]
2025-10-15T10:55:06.559614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:06.557088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:06.557306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:06.558330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:06.558594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:06.558602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:06.558609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:06.558617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:06.558625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:06.558632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:06.558639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:06.558646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:06.558653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:06.558661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:06.558667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:06.558674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:06.558681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:06.558688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:06.558728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:06.558814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:06.558848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:06.558884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:06.558916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:06.558949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:06.558981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:06.559013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:06.559047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:06.559080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:06.559112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:06.559192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:06.559234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:06.559271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:06.559307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:06.559375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:06.559448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:06.559490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:06.559525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:06.559563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:06.559593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:06.559631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:06.559663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:06.559701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:06.559734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:06.559770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:06.559810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:06.559854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:06.559891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:06.559929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:06.559960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:06.559997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:06.560028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:06.560068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:06.560101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:06.560136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:06.560167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:06.560205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:06.560249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:06.560298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:06.560333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:06.560384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:06.562677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:06.589244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:06.617621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:06.617669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:06.617685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:06.617705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:06.617731Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 73 [2:7561400334238123286:3120]
2025-10-15T10:55:06.617784Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:06.617838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:06.617852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.617866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.617877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.617924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:06.617946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:06.617967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:06.621632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:06.621668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:06.621682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:06.621693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:06.621955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:06.621982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:06.622164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:06.622386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:06.622622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:06.622707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400334238123280:3120]
2025-10-15T10:55:06.622728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400334238123280:3120]
2025-10-15T10:55:06.622741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400334238123280:3120]
2025-10-15T10:55:06.622772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:06.622847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:06.622912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:06.622931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:06.622938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:06.623030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:06.623064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:06.623256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400331438417655:3243], now have 1 active actors on pipe
2025-10-15T10:55:06.623298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400331438417606:2534], now have 1 active actors on pipe
2025-10-15T10:55:06.623326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400334238123280:3120]
2025-10-15T10:55:06.623376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:06.623421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400331438417587:2467], now have 1 active actors on pipe
2025-10-15T10:55:06.623454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400331438417740:2534], now have 1 active actors on pipe
2025-10-15T10:55:06.623526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 73
2025-10-15T10:55:06.623652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 73, pipe: [1:7561400331438417740:2534]
2025-10-15T10:55:06.623727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 73
2025-10-15T10:55:06.627437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:06.629015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:06.629066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:06.629112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561400331438417606:2534] destroyed
2025-10-15T10:55:06.629191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:06.629215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:06.629322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89356f08-43b22398-558f7413-8503ec6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:06.629361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.629384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.629396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:06.629435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.629508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:06.629605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:06.629694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:06.630115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:06.630135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:06.630170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400334238123280:3120]
2025-10-15T10:55:06.630184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400334238123280:3120]
2025-10-15T10:55:06.630221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:06.630532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:06.630548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:06.640203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:06.640243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:06.640329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:06.647819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 74 partition: 0 MaxSeqNo: 46 sessionId: src_id|89356f08-43b22398-558f7413-8503ec6b_0
2025-10-15T10:55:06.649413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cd0f017-c09b9a96-10a58cdf-377736ea_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|89356f08-43b22398-558f7413-8503ec6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:06.655926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:55:06.655979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-15T10:55:06.688651Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:55:06.689397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:55:06.689559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:55:06.718113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.718144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.718156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.757628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89356f08-43b22398-558f7413-8503ec6b_0] Write session: try to update token
2025-10-15T10:55:06.757691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89356f08-43b22398-558f7413-8503ec6b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:06.824881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.824919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.824931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.824989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:06.825002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:06.825016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:06.825027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:06.825060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400334238123280:3120]
2025-10-15T10:55:06.825086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400334238123280:3120]
2025-10-15T10:55:06.825111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400334238123280:3120]
2025-10-15T10:55:06.825252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:06.825273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:06.825904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:06.825941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:06.825970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:06.852232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:07.035453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId: src_id|89356f08-43b22398-558f7413-8503ec6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:07.048729Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:07.139617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:07.146211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:07.146464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400331438417740:2534]
2025-10-15T10:55:07.146694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:07.146734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:07.165292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 74 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|89356f08-43b22398-558f7413-8503ec6b_0
2025-10-15T10:55:07.165644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 74 sessionId: src_id|89356f08-43b22398-558f7413-8503ec6b_0 is DEAD
2025-10-15T10:55:07.166079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89356f08-43b22398-558f7413-8503ec6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:55:07.166134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89356f08-43b22398-558f7413-8503ec6b_0] Write session will restart in 0.009236s
2025-10-15T10:55:07.166280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89356f08-43b22398-558f7413-8503ec6b_0] Write session: Do CDS request
2025-10-15T10:55:07.166342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89356f08-43b22398-558f7413-8503ec6b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:07.172065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:07.179294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89356f08-43b22398-558f7413-8503ec6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:07.177541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:07.178478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:07.178497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:07.178543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:07.178859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:07.179055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400338533090731:3125]
2025-10-15T10:55:07.181169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:07.183070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:07.183314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:07.185090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:07.185915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:07.185944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:07.185972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:07.185987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:07.186007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:07.186025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:07.186041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:07.186056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:07.186075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:07.186088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:07.186102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:07.186112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:07.186121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:07.186132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:07.186220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:07.186435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:07.186561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:07.186666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:07.186748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:07.186846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:07.186924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:07.187001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:07.187083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:07.187168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:07.187253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:07.187518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:07.187637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:07.187752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:07.187865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:07.188055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:07.188215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:07.188351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:07.188496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:07.188649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:07.188778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:07.188935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:07.189059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:07.189211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:07.189329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:07.189473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:07.189589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:07.189706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:07.189819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:07.189937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:07.190061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:07.190212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:07.190367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:07.190512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:07.190626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:07.191726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:07.190745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:07.191749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 75
2025-10-15T10:55:07.190855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:07.190998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:07.192223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:07.192352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 75 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:07.192372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=75 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:07.192382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:07.191908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:07.191996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:07.192048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:07.192111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:07.192648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:07.193763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 75 sessionId:  describe result for acl check
2025-10-15T10:55:07.193895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:07.193911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:07.193921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:07.193940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400335733385165:3253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:07.196569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400335733385165:3253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:07.204669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400335733385165:3253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:07.209490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:07.213885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400335733385165:3253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:07.213923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400335733385165:3253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:07.213941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400335733385165:3253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:07.213970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 75 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:07.247006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400335733385192:2534]
2025-10-15T10:55:07.247270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:07.273816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 74
2025-10-15T10:55:07.273942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 74, pipe: [1:7561400335733385192:2534]
2025-10-15T10:55:07.274024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 74
2025-10-15T10:55:07.271821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:07.271869Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:07.271887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:07.271906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:07.271929Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 74 [2:7561400338533090731:3125]
2025-10-15T10:55:07.271980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:07.272038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:07.272052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.272065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.272077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.272118Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:07.272141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:07.272164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:07.273166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:07.273183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:07.273209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:07.273222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:07.273501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:07.273525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:07.273671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:07.273860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:07.274084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:07.274170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400335733385190:3253], now have 1 active actors on pipe
2025-10-15T10:55:07.274194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400335733385192:2534], now have 1 active actors on pipe
2025-10-15T10:55:07.274216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400335733385090:2467], now have 1 active actors on pipe
2025-10-15T10:55:07.274319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:07.274340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:07.274399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:07.274413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:07.274448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.274463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.274477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.274519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:07.274554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:07.274569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:07.274581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:07.274611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:07.274794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:07.274813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:07.274892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:07.274921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.274938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.274948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:07.274985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.275025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:07.275157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.275184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:07.275211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:07.275247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:07.275402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:07.275766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:07.275779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:07.275828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.275841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.275863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:07.275922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:07.275926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:07.275938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:07.275940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:07.276106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:07.276438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 75 partition: 0 MaxSeqNo: 46 sessionId: src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0
2025-10-15T10:55:07.277255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89356f08-43b22398-558f7413-8503ec6b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:07.312891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0] Write session: try to update token
2025-10-15T10:55:07.312953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:07.535483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId: src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:07.537551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:07.537580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:07.537589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:07.537596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:07.537619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.537634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.537646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.537834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.537844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.537852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.537903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:07.537917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:07.543008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:07.543056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:07.543085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:07.544874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:07.573067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:07.801988Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:07.838080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:07.838126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:07.838203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:07.838221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:07.838259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.838373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:55:07.838384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:07.838392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:07.838417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.838445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400338533090726:3125]
2025-10-15T10:55:07.841601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:07.841624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:07.844800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400335733385192:2534]
2025-10-15T10:55:07.844894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:07.839161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:07.839225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:07.839262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:07.839306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:07.839338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:07.839384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:07.845557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:07.845582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:07.944820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400335733385300:2534]
2025-10-15T10:55:07.945027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:07.986665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:07.987223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:07.988065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:07.988100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:07.988148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:07.988421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:07.988611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400338533090890:3136]
2025-10-15T10:55:07.990870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:07.999896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:08.000181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:08.001478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:08.001820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:08.001829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:08.001835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:08.001842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:08.001848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:08.001856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:08.001863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:08.001869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:08.001876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:08.001882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:08.001888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:08.001895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.001901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.001906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.001953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:08.002060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:08.002105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:08.002151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:08.002195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:08.002241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:08.002286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:08.002347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:08.002390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:08.002435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:08.002481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:08.002522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.002564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.002608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.002654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:08.002717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:08.002777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:08.002831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:08.002875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:08.002926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:08.002971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:08.003022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:08.003070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:08.003121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:08.003163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:08.003214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:08.003258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:08.003308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:08.004368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:08.004480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:08.004546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:08.004611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:08.004667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:08.004726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:08.004774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:08.004827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:08.004873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.004927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.004978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.005031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.005076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.005124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.005638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:08.020903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:08.020989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0] Write session will restart in 0.007146s
2025-10-15T10:55:08.021221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0] Write session: Do CDS request
2025-10-15T10:55:08.021294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:08.019630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 75 reason: error at write: Disconnected sessionId: src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0
2025-10-15T10:55:08.020007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 75 sessionId: src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0 is DEAD
2025-10-15T10:55:08.040779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:08.043728Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:08.043769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 76
2025-10-15T10:55:08.044176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:08.044326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 76 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:08.044347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=76 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:08.044359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:08.045765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 76 sessionId:  describe result for acl check
2025-10-15T10:55:08.045887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:08.045904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:08.045914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:08.045932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400340028352636:3262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:08.048260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400340028352636:3262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:08.061326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400340028352636:3262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:08.070278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:08.077553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400340028352636:3262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:08.077595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400340028352636:3262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:08.077613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400340028352636:3262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:08.077647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 76 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:08.081207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:08.081250Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:08.081268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:08.081286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:08.081311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 75 [2:7561400338533090890:3136]
2025-10-15T10:55:08.081366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:08.081422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:08.081443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.081456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.081469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.081518Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:08.081541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:08.081562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:08.082638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.082675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.082689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.082702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:08.082998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:08.083024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.083173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.085162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 75
2025-10-15T10:55:08.085244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 75
2025-10-15T10:55:08.085350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 75, pipe: [1:7561400335733385300:2534]
2025-10-15T10:55:08.083839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.084125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:08.084217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400340028352661:3262], now have 1 active actors on pipe
2025-10-15T10:55:08.084258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400335733385240:2467], now have 1 active actors on pipe
2025-10-15T10:55:08.084284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400335733385300:2534], now have 1 active actors on pipe
2025-10-15T10:55:08.084314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400338533090885:3136]
2025-10-15T10:55:08.084329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400338533090885:3136]
2025-10-15T10:55:08.084343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400338533090885:3136]
2025-10-15T10:55:08.084379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:08.084472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:08.084627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:08.084643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:08.084658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:08.084674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:08.084694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:08.084826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400338533090885:3136]
2025-10-15T10:55:08.084858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:08.085509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:08.087023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:08.087061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:08.087189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:08.087215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:08.087309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:08.087362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.087382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.087392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:08.087459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.087511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:08.087583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:08.087689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:08.088136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:08.088156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:08.088199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400338533090885:3136]
2025-10-15T10:55:08.088213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400338533090885:3136]
2025-10-15T10:55:08.088254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:08.088664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:08.088677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:08.092763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:08.092809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:08.092898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:08.093563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 76 partition: 0 MaxSeqNo: 46 sessionId: src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0
2025-10-15T10:55:08.094570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2406041b-4d6fa7eb-5c592e71-e2c6f8e2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:08.136431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0] Write session: try to update token
2025-10-15T10:55:08.136496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:08.215140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.215176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.215190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.215253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:08.215268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:08.215282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:08.215294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:08.215331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400338533090885:3136]
2025-10-15T10:55:08.215378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400338533090885:3136]
2025-10-15T10:55:08.215403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400338533090885:3136]
2025-10-15T10:55:08.215557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:08.215580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:08.216691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:08.219879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:08.219937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:08.219982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:08.220010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:08.220043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:08.375461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId: src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:08.389698Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:08.401342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:08.401598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400335733385300:2534]
2025-10-15T10:55:08.425149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:08.467090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:08.467113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:08.488478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 76 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0
2025-10-15T10:55:08.491563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:55:08.491602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0] Write session will restart in 0.006191s
2025-10-15T10:55:08.491706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0] Write session: Do CDS request
2025-10-15T10:55:08.491734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:08.496083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 76 sessionId: src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0 is DEAD
2025-10-15T10:55:08.502678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:08.526150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400340028352766:2534]
2025-10-15T10:55:08.526435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:08.526683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:08.526714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 77
2025-10-15T10:55:08.532788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:08.532911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 77 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:08.532927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=77 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:08.532936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:08.534737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 77 sessionId:  describe result for acl check
2025-10-15T10:55:08.534845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:08.534854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:08.534862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:08.534876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400340028352779:3270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:08.537429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:08.540791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400340028352779:3270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:08.542147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:08.542955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:08.542973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:08.543010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:08.543233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:08.543417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400342828058345:3144]
2025-10-15T10:55:08.545436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:08.547967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:08.548182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:08.549442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:08.549776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:08.549785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:08.549792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:08.549800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:08.549807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:08.549814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:08.549821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:08.549828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:08.549835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:08.549843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:08.549849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:08.549856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.549862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.549868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.549912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:08.550008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:08.550053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:08.550098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:08.550143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:08.550185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:08.550229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:08.550271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:08.550329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:08.550370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:08.550412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:08.551462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.551531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.551575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.551617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:08.551675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:08.551726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:08.551773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:08.551817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:08.551863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:08.551900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:08.551958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:08.552007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:08.552054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:08.552095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:08.552142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:08.552185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:08.552234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:08.552275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:08.552335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:08.552380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:08.552429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:08.552470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:08.552518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:08.552561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:08.552609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:08.552648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.552694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.552737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.552784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.552822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.552869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.553331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:08.553600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400340028352779:3270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:08.567543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400340028352779:3270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:08.567596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400340028352779:3270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:08.567614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400340028352779:3270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:08.567645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 77 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:08.592373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:08.632894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:08.632937Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:08.632953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:08.632969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:08.632989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 76 [2:7561400342828058345:3144]
2025-10-15T10:55:08.633030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:08.633078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:08.633091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.633102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.633112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.633156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:08.633177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:08.633195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:08.635282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.635297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.635311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.635320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:08.636164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:08.636195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:08.636317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:08.636500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:08.636707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:08.636769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:08.636783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:08.636794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:08.636834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:08.636900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:08.637058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:08.637074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:08.637181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:08.637199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:08.637725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:08.637737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:08.637746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:08.637768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:08.639966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 76
2025-10-15T10:55:08.640048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 76
2025-10-15T10:55:08.640133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 76, pipe: [1:7561400340028352766:2534]
2025-10-15T10:55:08.640385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400340028352826:3270], now have 1 active actors on pipe
2025-10-15T10:55:08.640424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400340028352677:2467], now have 1 active actors on pipe
2025-10-15T10:55:08.640445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400340028352766:2534], now have 1 active actors on pipe
2025-10-15T10:55:08.640488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:08.640508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:08.640607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:08.640623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:08.640690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:08.640725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.640749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.640760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:08.640792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.640832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:08.640902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:08.640987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:08.641343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:08.641358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:08.641391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:08.641402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:08.641426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:08.641670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:08.641681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:08.647610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:08.647648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:08.647722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:08.651641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 77 partition: 0 MaxSeqNo: 46 sessionId: src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0
2025-10-15T10:55:08.656637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e2ec9-89f74d0c-80ac4895-701b8b86_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:08.720725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0] Write session: try to update token
2025-10-15T10:55:08.720790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:08.735630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.735662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.735672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.871113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.871796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.871847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.923717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId: src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:08.995052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:08.995089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:08.995103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:08.995113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:08.995149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:08.995174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:08.995199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:08.995397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.995410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.995422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.995472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:08.995501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:08.995522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:09.003667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:09.010521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:09.010569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:09.011801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
E1015 10:55:09.099818762  821272 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:55:09.184735Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:09.186236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:09.186279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:09.186341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:09.186356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:09.186397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400342828058340:3144]
2025-10-15T10:55:09.187732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:09.187798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:09.191675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:09.191716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:09.195829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:09.196122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400340028352766:2534]
2025-10-15T10:55:09.201189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 77 reason: error at write: Disconnected sessionId: src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0
2025-10-15T10:55:09.201528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 77 sessionId: src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0 is DEAD
2025-10-15T10:55:09.206362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 549 BytesWritten: 103628882 MessagesWritten: 46 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-15T10:55:09.206467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:09.206498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0] Write session will restart in 0.005750s
2025-10-15T10:55:09.206659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0] Write session: Do CDS request
2025-10-15T10:55:09.206724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:09.232229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:09.232193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:09.232231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 78
2025-10-15T10:55:09.235999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:09.236166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 78 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:09.236184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=78 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:09.236196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:09.241214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:09.241255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:09.244259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 78 sessionId:  describe result for acl check
2025-10-15T10:55:09.244448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:09.244487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:09.244506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:09.244536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400344323320184:3291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:09.249292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400344323320184:3291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:09.270481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400344323320184:3291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:09.290131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400344323320184:3291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:09.290176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400344323320184:3291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:09.290194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400344323320184:3291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:09.290224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 78 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:09.299502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400344323320229:2534]
2025-10-15T10:55:09.299682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:09.353609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:09.362825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:09.363811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:09.363845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:09.363891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:09.364196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:09.364410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400347123025803:3155]
2025-10-15T10:55:09.367601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:09.368794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:09.369064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:09.370423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:09.370789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:09.370797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:09.370804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:09.370810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:09.370816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:09.370823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:09.370831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:09.370838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:09.370845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:09.370851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:09.370861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:09.370869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:09.370875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:09.370882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:09.370934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:09.371055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:09.371107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:09.371159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:09.371209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:09.371259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:09.371308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:09.371377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:09.371427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:09.371492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:09.371542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:09.371592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:09.371642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:09.371689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:09.371740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:09.371815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:09.373004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:09.373100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:09.373163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:09.373226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:09.373286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:09.373346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:09.373401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:09.373467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:09.373524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:09.373586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:09.373635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:09.373694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:09.373739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:09.373797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:09.373847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:09.373903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:09.373951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:09.374011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:09.374060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:09.374118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:09.374169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:09.374225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:09.374276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:09.374348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:09.374399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:09.374883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:09.375489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:09.408623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:09.434508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:09.434579Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:09.434599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:09.434622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:09.434648Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 77 [2:7561400347123025803:3155]
2025-10-15T10:55:09.434699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:09.434760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:09.434776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.434790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.434815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.434863Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:09.434882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:09.434904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:09.478922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:09.478957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:09.478968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:09.478979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:09.479265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:09.479287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:09.480033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:09.480227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:09.480442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:09.480536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400344323320224:3291], now have 1 active actors on pipe
2025-10-15T10:55:09.480560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400344323320229:2534], now have 1 active actors on pipe
2025-10-15T10:55:09.480582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400344323320174:2467], now have 1 active actors on pipe
2025-10-15T10:55:09.480606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.480621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.480635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.480674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:09.480755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:09.480955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:09.480973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:09.481099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.481118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:09.480955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 77, pipe: [1:7561400344323320229:2534]
2025-10-15T10:55:09.481059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 77
2025-10-15T10:55:09.481147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 77
2025-10-15T10:55:09.481567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:09.481589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:09.481600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:09.481626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:09.482638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:09.482677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:09.482765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:09.482781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:09.482871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9631728-141b1416-634fe22-8a4c31a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:09.482906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.482925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.482937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:09.482976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.483020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:09.483091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:09.483146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:09.483594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:09.483616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:09.483661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.483682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.483717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:09.485170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:09.485192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:09.486682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:09.486718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:09.486807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:09.487240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 78 partition: 0 MaxSeqNo: 46 sessionId: src_id|b9631728-141b1416-634fe22-8a4c31a5_0
2025-10-15T10:55:09.490700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c1269f-e882d7ff-781e519e-4ce7f190_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b9631728-141b1416-634fe22-8a4c31a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:09.536970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.537004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.537016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.543962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9631728-141b1416-634fe22-8a4c31a5_0] Write session: try to update token
2025-10-15T10:55:09.544027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9631728-141b1416-634fe22-8a4c31a5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:09.637318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:09.637358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:09.637375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:09.637388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:09.637427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.637454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.637478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.637598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:09.637638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:09.637667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:09.637711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.637726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.637738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.637790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:09.637813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:09.638879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:09.843579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId: src_id|b9631728-141b1416-634fe22-8a4c31a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:09.889237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:09.891822Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:09.940704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:09.940750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:09.940814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:09.940828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:09.940867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400347123025797:3155]
2025-10-15T10:55:09.943621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:09.944051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:09.944075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:09.945673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:09.945948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400344323320229:2534]
2025-10-15T10:55:09.959468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9631728-141b1416-634fe22-8a4c31a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:09.959541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9631728-141b1416-634fe22-8a4c31a5_0] Write session will restart in 0.006195s
2025-10-15T10:55:09.959729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9631728-141b1416-634fe22-8a4c31a5_0] Write session: Do CDS request
2025-10-15T10:55:09.959795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9631728-141b1416-634fe22-8a4c31a5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:09.958683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 78 reason: error at write: Disconnected sessionId: src_id|b9631728-141b1416-634fe22-8a4c31a5_0
2025-10-15T10:55:09.959012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 78 sessionId: src_id|b9631728-141b1416-634fe22-8a4c31a5_0 is DEAD
2025-10-15T10:55:09.977728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9631728-141b1416-634fe22-8a4c31a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:09.976768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:09.976799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 79
2025-10-15T10:55:09.978316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:09.978480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 79 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:09.978499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=79 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:09.978509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:09.979193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:09.979232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:09.979885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 79 sessionId:  describe result for acl check
2025-10-15T10:55:09.979996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:09.980014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:09.980024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:09.980042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400344323320348:3296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:09.988965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400344323320348:3296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:10.005652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400344323320348:3296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:10.024203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400344323320348:3296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:10.024270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400344323320348:3296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:10.024295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400344323320348:3296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:10.024350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 79 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:10.046066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400348618287750:2534]
2025-10-15T10:55:10.046287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:10.056392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:10.068809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:10.069758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:10.069779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:10.069826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:10.070132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:10.070321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400351417993261:3159]
2025-10-15T10:55:10.083588Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 0 CurrentSessionLifetimeMs: 61375 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:55:10.088853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:10.098342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:10.098672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:10.100107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:10.100497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:10.100507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:10.100516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:10.100523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:10.100531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:10.100538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:10.100545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:10.100552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:10.100560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:10.100567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:10.100576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:10.100583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.100592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.100598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.100649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:10.100767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:10.100820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:10.100869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:10.100915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:10.100967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:10.101015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:10.101063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:10.101110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:10.101162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:10.101210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:10.101258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.101302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.101349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.101397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:10.101470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:10.101534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:10.101590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:10.101639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:10.101693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:10.101741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:10.101793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:10.101843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:10.101899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:10.101945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:10.101999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:10.102043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:10.102100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:10.102144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:10.102197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:10.102245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:10.102299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:10.102358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:10.102412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:10.102458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:10.102509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:10.102552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.102605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.102651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.102700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.102747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.102801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.103319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:10.133035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:10.155224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:10.155275Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:10.155292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:10.155310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:10.155335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 78 [2:7561400351417993261:3159]
2025-10-15T10:55:10.155652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:10.155717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:10.155730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.155743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.155754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.155803Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:10.155824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:10.155845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:10.157502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.157518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.157532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.157543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:10.157820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:10.157838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.157981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.158173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.158419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:10.158495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400351417993255:3159]
2025-10-15T10:55:10.158509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400351417993255:3159]
2025-10-15T10:55:10.158522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400351417993255:3159]
2025-10-15T10:55:10.158670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:10.158684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:10.158697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:10.159489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 78, pipe: [1:7561400348618287750:2534]
2025-10-15T10:55:10.159569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 78
2025-10-15T10:55:10.159639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 78
2025-10-15T10:55:10.161369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:10.161475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:10.161672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:10.161691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:10.161741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400348618287750:2534], now have 1 active actors on pipe
2025-10-15T10:55:10.161766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400348618287700:3296], now have 1 active actors on pipe
2025-10-15T10:55:10.161791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400344323320330:2467], now have 1 active actors on pipe
2025-10-15T10:55:10.161889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:10.161913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:10.161973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:10.161987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:10.162127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400351417993255:3159]
2025-10-15T10:55:10.162161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:10.162247Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38616df5-cc6ad348-81ed263-3928001f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:10.162278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.162298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.162308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:10.162357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.162401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:10.162565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:10.162625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:10.162995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:10.163010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:10.163041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400351417993255:3159]
2025-10-15T10:55:10.163054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400351417993255:3159]
2025-10-15T10:55:10.163078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:10.164336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:10.164376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:10.164388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:10.167286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:10.167319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:10.167421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:10.167925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 79 partition: 0 MaxSeqNo: 46 sessionId: src_id|38616df5-cc6ad348-81ed263-3928001f_0
2025-10-15T10:55:10.168680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9631728-141b1416-634fe22-8a4c31a5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|38616df5-cc6ad348-81ed263-3928001f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:10.224310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38616df5-cc6ad348-81ed263-3928001f_0] Write session: try to update token
2025-10-15T10:55:10.224359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38616df5-cc6ad348-81ed263-3928001f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:10.285652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.285690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.285704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.285766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:10.285782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:10.285797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:10.285808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:10.285845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400351417993255:3159]
2025-10-15T10:55:10.285873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400351417993255:3159]
2025-10-15T10:55:10.285897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400351417993255:3159]
2025-10-15T10:55:10.286047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:10.286070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:10.287147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:10.287539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:10.287574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:10.287608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:10.401991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId: src_id|38616df5-cc6ad348-81ed263-3928001f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:10.452143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:10.513152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:10.519263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:10.519324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:10.524996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400348618287750:2534]
2025-10-15T10:55:10.525088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:10.525214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:10.525229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:10.543849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:10.543909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:10.557206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38616df5-cc6ad348-81ed263-3928001f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:10.557274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38616df5-cc6ad348-81ed263-3928001f_0] Write session will restart in 0.007866s
2025-10-15T10:55:10.557436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38616df5-cc6ad348-81ed263-3928001f_0] Write session: Do CDS request
2025-10-15T10:55:10.557489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38616df5-cc6ad348-81ed263-3928001f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:10.556348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 79 reason: error at write: Disconnected sessionId: src_id|38616df5-cc6ad348-81ed263-3928001f_0
2025-10-15T10:55:10.556706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 79 sessionId: src_id|38616df5-cc6ad348-81ed263-3928001f_0 is DEAD
2025-10-15T10:55:10.579319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38616df5-cc6ad348-81ed263-3928001f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:10.579914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:10.579942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 80
2025-10-15T10:55:10.587520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:10.587688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 80 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:10.587707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=80 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:10.587718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:10.596653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 80 sessionId:  describe result for acl check
2025-10-15T10:55:10.596772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:10.596784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:10.596792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:10.596810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400348618287800:3307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:10.600031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400348618287800:3307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:10.609282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400348618287800:3307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:10.626164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400348618287800:3307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:10.626215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400348618287800:3307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:10.626232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400348618287800:3307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:10.626275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 80 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:10.627546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400348618287854:2534]
2025-10-15T10:55:10.627718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:10.654046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:10.660474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:10.661306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:10.661329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:10.661363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:10.661605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:10.661808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400351417993429:3167]
2025-10-15T10:55:10.664048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:10.665656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:10.665883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:10.667123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:10.667519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:10.667529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:10.667536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:10.667543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:10.667549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:10.667556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:10.667562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:10.667569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:10.667576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:10.667584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:10.667589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:10.667596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.667604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.667611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.667662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:10.667777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:10.667827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:10.667880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:10.667927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:10.667976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:10.668022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:10.668067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:10.668115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:10.668167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:10.668213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:10.668261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.668307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.668357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.668430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:10.668502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:10.668565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:10.668622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:10.668673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:10.668728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:10.668776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:10.668835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:10.668899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:10.668956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:10.669004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:10.669061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:10.669110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:10.669164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:10.669211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:10.669266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:10.669316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:10.669372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:10.669418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:10.669470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:10.669520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:10.669575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:10.669621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.669675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.669723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.669777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.669826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.669899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.671728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:10.721807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:10.730477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:10.730532Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:10.730550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:10.730571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:10.730597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 79 [2:7561400351417993429:3167]
2025-10-15T10:55:10.730653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:10.730719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:10.730734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.730748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.730759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.730806Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:10.730835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:10.730852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:10.732575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.732602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.732617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.732629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:10.732905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:10.732930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:10.733084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:10.733284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:10.733532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:10.733623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400348618287780:2467], now have 1 active actors on pipe
2025-10-15T10:55:10.733655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400348618287852:3307], now have 1 active actors on pipe
2025-10-15T10:55:10.733686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400348618287854:2534], now have 1 active actors on pipe
2025-10-15T10:55:10.733715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:10.733741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:10.733754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:10.733794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:10.733876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:10.734063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:10.734087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:10.733862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 79
2025-10-15T10:55:10.733949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 79
2025-10-15T10:55:10.734027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 79, pipe: [1:7561400348618287854:2534]
2025-10-15T10:55:10.734212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:10.734240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:10.734393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:10.734420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:10.734432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:10.734456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:10.734868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:10.734906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:10.734997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:10.735017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:10.735104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:10.735141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.735160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.735170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:10.735209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.735252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:10.735316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:10.735418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:10.735848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:10.735866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:10.735903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:10.735923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:10.735969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:10.736012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:10.736032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:10.736697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:10.736731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:10.736802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:10.740398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 80 partition: 0 MaxSeqNo: 46 sessionId: src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0
2025-10-15T10:55:10.741329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38616df5-cc6ad348-81ed263-3928001f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:10.791698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0] Write session: try to update token
2025-10-15T10:55:10.791737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:10.882616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.882668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.882699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.882790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:10.882822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:10.882851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:10.882879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:10.882946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:10.883001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:10.883042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:10.883178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:10.883211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:10.883226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:10.883236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:10.883244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:10.894807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:10.953076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId: src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:11.018166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:11.091830Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:11.111335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:11.111396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:11.111455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:11.111467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:11.111508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400351417993411:3167]
2025-10-15T10:55:11.115876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:11.118267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:11.118407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:11.118418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:11.118983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400348618287854:2534]
2025-10-15T10:55:11.126826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:11.126861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0] Write session will restart in 0.007607s
2025-10-15T10:55:11.126947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0] Write session: Do CDS request
2025-10-15T10:55:11.126970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:11.126116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 80 reason: error at write: Disconnected sessionId: src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0
2025-10-15T10:55:11.127568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 80 sessionId: src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0 is DEAD
2025-10-15T10:55:11.164320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:11.171478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:11.171506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 81
2025-10-15T10:55:11.172041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:11.193058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 81 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:11.193092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=81 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:11.193105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:11.195616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 81 sessionId:  describe result for acl check
2025-10-15T10:55:11.195723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:11.195734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:11.195742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:11.195757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400352913255298:3316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:11.197915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400352913255298:3316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:11.214164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400352913255298:3316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:11.219011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400352913255371:2534]
2025-10-15T10:55:11.219176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:11.245591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400352913255298:3316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:11.245655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400352913255298:3316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:11.245685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400352913255298:3316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:11.245732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 81 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:11.243693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:11.243728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:11.249995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:11.254998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:11.255885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:11.255916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:11.255960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:11.256197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:11.256371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400355712960869:3178]
2025-10-15T10:55:11.259706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:11.260839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:11.261038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:11.262219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:11.262547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:11.262554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:11.262561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:11.262566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:11.262573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:11.262580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:11.262586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:11.262593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:11.262598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:11.262605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:11.262613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:11.262618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:11.262623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:11.262630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:11.262674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:11.262773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:11.262815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:11.262857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:11.262899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:11.262937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:11.262978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:11.263017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:11.263056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:11.263098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:11.263137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:11.263179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:11.263221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:11.263262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:11.263301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:11.263389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:11.263444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:11.265056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:11.265135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:11.265204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:11.265248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:11.265299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:11.265348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:11.265399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:11.265441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:11.265493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:11.265537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:11.265587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:11.265629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:11.265679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:11.265725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:11.265780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:11.265822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:11.265872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:11.265916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:11.265963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:11.266004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:11.266055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:11.266101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:11.266153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:11.266200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:11.266250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:11.266749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:11.303951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:11.309554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400352913255371:2534]
2025-10-15T10:55:11.309664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: ERROR TabletId: 72075186224037892 Generation: 0, pipe: [0:0:0]
2025-10-15T10:55:11.343193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:11.343248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:11.343264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:11.343281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:11.343304Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 80 [2:7561400355712960869:3178]
2025-10-15T10:55:11.344909Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:11.344991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:11.345005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.345017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.345027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.345076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:11.345095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:11.345115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:11.415651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400352913255387:2534]
2025-10-15T10:55:11.415820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:11.439734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:11.439778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:11.439790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:11.439801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:11.440094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:11.440120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:11.440258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:11.440905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 80
2025-10-15T10:55:11.441020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 80, pipe: [1:7561400352913255387:2534]
2025-10-15T10:55:11.441082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 80
2025-10-15T10:55:11.440435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:11.440678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:11.440759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400352913255381:3316], now have 1 active actors on pipe
2025-10-15T10:55:11.440790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400352913255371:2534], now have 1 active actors on pipe
2025-10-15T10:55:11.440816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400352913255387:2534], now have 1 active actors on pipe
2025-10-15T10:55:11.440836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400352913255254:2467], now have 1 active actors on pipe
2025-10-15T10:55:11.440861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.440876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.440888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.440915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:11.440983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:11.441155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:11.441174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:11.441281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.441299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:11.441668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:11.441682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:11.441693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:11.441716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:11.441953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:11.441979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:11.442020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561400352913255371:2534] destroyed
2025-10-15T10:55:11.442091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:11.442105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:11.442192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:11.442222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.442237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.442248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:11.442284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.442322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:11.442397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:11.442470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:11.442857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:11.442874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:11.442905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.442918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.442950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:11.442982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:11.442995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:11.443445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:11.443465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:11.443543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:11.443802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 81 partition: 0 MaxSeqNo: 46 sessionId: src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0
2025-10-15T10:55:11.445294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.445319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.445328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.448059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f9398c-d2b51a60-34c48082-656ef05e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:11.510155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:11.510188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:11.510223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.510338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:11.511689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:11.514750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:11.520277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:11.521494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:11.522887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:11.528523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:11.528908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:11.529997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0] Write session: try to update token
2025-10-15T10:55:11.530041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:11.547529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.547560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.547572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.670694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:11.670725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:11.670738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:11.670749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:11.670783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.670805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.670828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400355712960864:3178]
2025-10-15T10:55:11.670972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.670985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.670994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.671034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:11.671052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:11.672108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:11.673357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:11.673387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:11.673411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:11.807428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId: src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:11.833645Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:11.844374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400352913255387:2534]
2025-10-15T10:55:11.844438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:11.858693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:11.858717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:11.877957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 81 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0
2025-10-15T10:55:11.878237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 81 sessionId: src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0 is DEAD
2025-10-15T10:55:11.883393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:55:11.883423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0] Write session will restart in 0.009151s
2025-10-15T10:55:11.883511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0] Write session: Do CDS request
2025-10-15T10:55:11.883535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:11.887661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:11.898541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:11.898569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 82
2025-10-15T10:55:11.898939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:11.899492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:11.899608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 82 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:11.899623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=82 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:11.899633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:11.900866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 82 sessionId:  describe result for acl check
2025-10-15T10:55:11.900961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:11.900975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:11.900983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:11.900997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400352913255445:3327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:11.902993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400352913255445:3327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:11.912833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400352913255445:3327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:11.923559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400352913255445:3327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:11.923599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400352913255445:3327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:11.923616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400352913255445:3327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:11.923649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 82 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:11.951492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400352913255497:2534]
2025-10-15T10:55:11.951699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:11.994371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:12.000008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:12.000889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:12.000922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:12.000967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:12.001231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:12.001421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400360007928335:3188]
2025-10-15T10:55:12.007850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:12.013828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:12.014126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:12.015541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:12.015850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:12.015855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:12.015860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:12.015867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:12.015872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:12.015876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:12.015881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:12.015886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:12.015890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:12.015895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:12.015899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:12.015904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.015908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.015913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.015962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:12.016052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:12.016089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:12.016126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:12.016162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:12.016207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:12.016240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:12.016274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:12.016309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:12.016344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:12.016380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:12.016415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.016460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.016496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.016525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:12.016574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:12.016615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:12.016655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:12.016697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:12.016742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:12.016775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:12.016811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:12.016842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:12.016878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:12.016909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:12.016947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:12.016989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:12.017028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:12.017060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:12.017098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:12.017131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:12.017167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:12.017199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:12.017245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:12.017279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:12.017316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:12.017347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.017384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.017417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.017460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.017503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.017543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.017962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:12.059393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:12.069998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:12.070048Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:12.070068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:12.070089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:12.070113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 81 [2:7561400360007928335:3188]
2025-10-15T10:55:12.070172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:12.070242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:12.070256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.070269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.070280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.070328Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:12.070352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:12.070389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:12.076641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 81
2025-10-15T10:55:12.076747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 81
2025-10-15T10:55:12.076845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 81, pipe: [1:7561400352913255497:2534]
2025-10-15T10:55:12.071893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.071929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.071944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.071956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:12.072254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:12.072276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.072436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.072643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.072892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:12.072971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.072988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.073002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.073047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:12.073127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:12.073331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:12.073351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:12.073490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.073515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:12.074141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:12.074155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:12.074167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:12.074191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:12.078685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400352913255474:3327], now have 1 active actors on pipe
2025-10-15T10:55:12.078734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400352913255424:2467], now have 1 active actors on pipe
2025-10-15T10:55:12.078757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400352913255497:2534], now have 1 active actors on pipe
2025-10-15T10:55:12.078836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:12.078860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:12.078961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:12.078977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:12.079072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:12.079106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.079124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.079134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:12.079173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.079221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:12.079283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:12.079382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:12.079799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:12.079820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:12.079863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.079879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.079916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:12.080743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:12.080771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:12.081989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:12.082054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:12.082150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:12.082797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 82 partition: 0 MaxSeqNo: 46 sessionId: src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0
2025-10-15T10:55:12.083542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|890c211e-c6ac8e6c-233c5719-239a6ecc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:12.144286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0] Write session: try to update token
2025-10-15T10:55:12.144327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:12.247323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:12.247636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:12.247655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:12.247666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:12.247696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.247720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.247743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.247887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.247899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.247910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.247997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:12.248014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:12.248374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:12.248411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:12.248437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:12.253338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:12.420696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId: src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:12.462825Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:12.465880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:12.485154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:12.485182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:12.485222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400355712961031:3188]
2025-10-15T10:55:12.486291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:12.488054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:12.488082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:12.489246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400352913255497:2534]
2025-10-15T10:55:12.489354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:12.506740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 82 reason: error at write: Disconnected sessionId: src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0
2025-10-15T10:55:12.507055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 82 sessionId: src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0 is DEAD
2025-10-15T10:55:12.509560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:12.509605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0] Write session will restart in 0.005052s
2025-10-15T10:55:12.509699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0] Write session: Do CDS request
2025-10-15T10:55:12.509724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:12.526914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:12.528439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:12.528490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 83
2025-10-15T10:55:12.529475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:12.529787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 83 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:12.529836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=83 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:12.529860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:12.526872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:12.533240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 83 sessionId:  describe result for acl check
2025-10-15T10:55:12.533372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:12.533384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:12.533391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:12.533408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400357208222905:3335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:12.546132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400357208222905:3335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:12.565619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400357208222905:3335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:12.588949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400357208222954:2534]
2025-10-15T10:55:12.589123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:12.600458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400357208222905:3335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:12.600497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400357208222905:3335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:12.600514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400357208222905:3335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:12.600547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 83 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:12.676744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:12.682198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:12.683183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:12.683221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:12.683269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:12.683581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:12.683786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400360007928514:3195]
2025-10-15T10:55:12.686624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:12.687831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:12.688059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:12.689478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:12.690976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:12.690996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:12.691003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:12.691012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:12.691019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:12.691027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:12.691034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:12.691041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:12.691049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:12.691055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:12.691064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:12.691071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.691079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.691086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.691146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:12.691288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:12.691366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:12.691423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:12.691474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:12.691526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:12.691576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:12.691623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:12.691674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:12.691728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:12.691777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:12.691825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.691873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.691927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.691987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:12.692059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:12.692125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:12.692186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:12.692239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:12.692298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:12.692348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:12.692408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:12.692455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:12.692518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:12.692566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:12.692622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:12.692672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:12.692726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:12.692769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:12.692823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:12.692874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:12.692932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:12.692981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:12.693045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:12.693093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:12.693150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:12.693200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.693259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.693312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.693381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.693431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.693488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.694044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:12.710891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:12.721908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:12.721962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:12.721982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:12.722004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:12.722030Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 82 [2:7561400360007928514:3195]
2025-10-15T10:55:12.722084Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:12.722147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:12.722164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.722177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.722190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.722239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:12.722262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:12.722285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:12.723312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.723342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.723407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.723420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:12.724634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 82
2025-10-15T10:55:12.724736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 82
2025-10-15T10:55:12.724831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 82, pipe: [1:7561400357208222954:2534]
2025-10-15T10:55:12.723672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:12.723698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:12.723850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:12.724063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:12.724334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:12.724426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400357208222885:2467], now have 1 active actors on pipe
2025-10-15T10:55:12.724452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400357208222969:3335], now have 1 active actors on pipe
2025-10-15T10:55:12.724477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400357208222954:2534], now have 1 active actors on pipe
2025-10-15T10:55:12.724506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400360007928508:3195]
2025-10-15T10:55:12.724523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400360007928508:3195]
2025-10-15T10:55:12.724536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400360007928508:3195]
2025-10-15T10:55:12.724588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:12.724660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:12.724675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:12.724679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:12.724691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:12.724880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:12.724898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:12.725026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400360007928508:3195]
2025-10-15T10:55:12.725058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:12.725118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:12.725148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:12.725173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:12.725263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:12.725278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:12.725444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:12.725476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.725497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.725508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:12.725548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.725589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:12.725663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:12.725722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:12.726113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:12.726130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:12.726162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400360007928508:3195]
2025-10-15T10:55:12.726176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400360007928508:3195]
2025-10-15T10:55:12.726200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:12.726591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:12.726605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:12.728402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:12.728442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:12.728519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:12.728961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 83 partition: 0 MaxSeqNo: 46 sessionId: src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0
2025-10-15T10:55:12.729826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96f7464a-2c7168a6-8ca6afd-585ef244_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:12.785793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0] Write session: try to update token
2025-10-15T10:55:12.785843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:12.853643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.853679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.853704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.853770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:12.853786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:12.853803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:12.853814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:12.853852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400360007928508:3195]
2025-10-15T10:55:12.853880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400360007928508:3195]
2025-10-15T10:55:12.853907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400360007928508:3195]
2025-10-15T10:55:12.854038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:12.854052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:12.854077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:12.854093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:12.854133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:12.856689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:12.950405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId: src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:12.973851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:13.021338Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:13.022988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:13.023033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:13.024285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:13.024536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:13.024559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:13.027598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400357208222954:2534]
2025-10-15T10:55:13.031267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:13.031313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:13.079427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:13.079469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0] Write session will restart in 0.005761s
2025-10-15T10:55:13.077534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 83 reason: error at write: Disconnected sessionId: src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0
2025-10-15T10:55:13.079564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0] Write session: Do CDS request
2025-10-15T10:55:13.077881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 83 sessionId: src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0 is DEAD
2025-10-15T10:55:13.079594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:13.095369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:13.096718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:13.096754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 84
2025-10-15T10:55:13.097234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:13.097481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 84 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:13.097519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=84 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:13.097543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:13.099723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 84 sessionId:  describe result for acl check
2025-10-15T10:55:13.099842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:13.099853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:13.099862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:13.099880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400361503190416:3341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:13.102598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400361503190416:3341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:13.114484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400361503190416:3341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:13.127199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400361503190478:2534]
2025-10-15T10:55:13.127401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:13.134142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400361503190416:3341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:13.134184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400361503190416:3341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:13.134199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400361503190416:3341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:13.134228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 84 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:13.135678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:13.138075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:13.138792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:13.138821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:13.138863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:13.139064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:13.139218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400364302895949:3201]
2025-10-15T10:55:13.140674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:13.141425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:13.141609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:13.142850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:13.143193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:13.143201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:13.143208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:13.143214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:13.143221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:13.143226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:13.143233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:13.143239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:13.143246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:13.143252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:13.143258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:13.143264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.143271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.143279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.143325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:13.143465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:13.143512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:13.143560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:13.143605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:13.143650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:13.143694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:13.143740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:13.143783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:13.143827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:13.143873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:13.143919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.143963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.144005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.144049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:13.144116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:13.144175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:13.144231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:13.144281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:13.144335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:13.144383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:13.144438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:13.144485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:13.144538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:13.144582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:13.144637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:13.144685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:13.144736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:13.144779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:13.144834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:13.144882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:13.144961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:13.145009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:13.145060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:13.145105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:13.145157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:13.145199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.145252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.145303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.145357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.145404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.145457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.145952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:13.166733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:13.176776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:13.176839Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:13.176855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:13.176874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:13.176898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 83 [2:7561400364302895949:3201]
2025-10-15T10:55:13.176945Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:13.176996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:13.177011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.177022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.177033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.177078Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:13.177098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:13.177118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:13.186658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.186690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.186703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.186713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:13.186977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:13.187003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.187133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.187302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.187625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:13.187690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400364302895944:3201]
2025-10-15T10:55:13.187703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400364302895944:3201]
2025-10-15T10:55:13.187713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400364302895944:3201]
2025-10-15T10:55:13.187740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:13.187809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:13.187809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:13.187822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:13.187834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:13.187978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:13.187995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:13.188036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400361503190486:3341], now have 1 active actors on pipe
2025-10-15T10:55:13.188057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400361503190478:2534], now have 1 active actors on pipe
2025-10-15T10:55:13.188075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400361503190357:2467], now have 1 active actors on pipe
2025-10-15T10:55:13.188172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400364302895944:3201]
2025-10-15T10:55:13.188202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:13.188255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:13.188726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:13.188757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:13.188818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:13.188852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.188604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 83
2025-10-15T10:55:13.188884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.188744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 83, pipe: [1:7561400361503190478:2534]
2025-10-15T10:55:13.188894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:13.188822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 83
2025-10-15T10:55:13.188924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.188962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:13.189043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:13.189066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:13.189127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:13.189216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:13.189599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:13.189624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:13.189663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:13.189686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:13.189716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400364302895944:3201]
2025-10-15T10:55:13.189733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400364302895944:3201]
2025-10-15T10:55:13.189761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:13.189806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:13.189829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:13.189925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:13.190280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 84 partition: 0 MaxSeqNo: 46 sessionId: src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0
2025-10-15T10:55:13.190947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea4685c6-463da29d-a3d8e6bd-c2958c35_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:13.210831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0] Write session: try to update token
2025-10-15T10:55:13.210885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:13.281021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:13.281063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:13.281080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:13.281090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:13.281121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400364302895944:3201]
2025-10-15T10:55:13.281144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400364302895944:3201]
2025-10-15T10:55:13.281166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400364302895944:3201]
2025-10-15T10:55:13.281305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.281325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.281336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.281374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:13.281393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:13.283466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:13.283513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:13.283543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:13.295753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:13.393889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId: src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:13.426321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:13.527159Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:13.530353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:13.530411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:13.534138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:13.534276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:13.534287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:13.552944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400361503190478:2534]
2025-10-15T10:55:13.553104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 84 reason: error at write: Disconnected sessionId: src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0
2025-10-15T10:55:13.553455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 84 sessionId: src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0 is DEAD
2025-10-15T10:55:13.565438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:13.565479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0] Write session will restart in 0.008569s
2025-10-15T10:55:13.565569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0] Write session: Do CDS request
2025-10-15T10:55:13.565594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:13.580622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:13.580571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:13.580610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 85
2025-10-15T10:55:13.583260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:13.583401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 85 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:13.583417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=85 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:13.583426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:13.585408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 85 sessionId:  describe result for acl check
2025-10-15T10:55:13.585511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:13.585526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:13.585535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:13.585550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400361503190527:3347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:13.589961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400361503190527:3347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:13.591902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:13.591938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:13.606554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400361503190527:3347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:13.628076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400361503190527:3347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:13.628121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400361503190527:3347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:13.628137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400361503190527:3347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:13.628164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 85 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:13.655673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400361503190616:2534]
2025-10-15T10:55:13.655840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:13.698193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:13.698975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:13.740161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:13.740199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:13.740285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:13.740669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:13.740864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400364302896120:3209]
2025-10-15T10:55:13.743828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:13.746121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:13.746346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
E1015 10:55:13.750594684  821071 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:55:13.747579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:13.747922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:13.747930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:13.747936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:13.747943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:13.747950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:13.747955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:13.747962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:13.747969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:13.747976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:13.747983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:13.747990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:13.747997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.748003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.748009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.748053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:13.748150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:13.748196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:13.748240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:13.748282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:13.748327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:13.748369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:13.748412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:13.748455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:13.748499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:13.748543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:13.748589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.748629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.748676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.748717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:13.748777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:13.748829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:13.748879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:13.748922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:13.748971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:13.749014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:13.749066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:13.749113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:13.749164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:13.749207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:13.749255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:13.749296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:13.749343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:13.749386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:13.749435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:13.749481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:13.749529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:13.749571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:13.749617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:13.749659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:13.749703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:13.749742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.749789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.749830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.749877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.749940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.749992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.750474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:13.753941Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:55:13.797953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:13.840044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:13.840080Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:13.840088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:13.840099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:13.840114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 84 [2:7561400364302896120:3209]
2025-10-15T10:55:13.840144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:13.840183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:13.840191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.840200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.840207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.840237Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:13.840252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:13.840264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:13.846421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.846458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.846471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.846481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:13.846755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:13.846785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:13.846926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:13.847123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:13.847361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:13.847438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:13.847460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:13.847472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:13.847509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:13.847578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:13.847745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:13.847763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:13.847878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:13.847897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:13.848222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:13.848234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:13.848245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:13.848265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:13.849801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400361503190616:2534], now have 1 active actors on pipe
2025-10-15T10:55:13.849852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400361503190569:3347], now have 1 active actors on pipe
2025-10-15T10:55:13.849877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400361503190505:2467], now have 1 active actors on pipe
2025-10-15T10:55:13.851612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 84, pipe: [1:7561400361503190616:2534]
2025-10-15T10:55:13.851690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 84
2025-10-15T10:55:13.851751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 84
2025-10-15T10:55:13.853007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:13.853038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:13.853089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:13.853100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:13.853183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:13.853209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.853225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.853235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:13.853267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.853301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:13.853358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:13.853406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:13.853744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:13.853777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:13.853810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:13.853823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:13.853855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:13.854463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:13.854481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:13.855253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:13.855279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:13.855343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:13.856473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3ee9567-9f7ea27b-f5396c87-a9e27e24_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:13.855771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 85 partition: 0 MaxSeqNo: 46 sessionId: src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0
2025-10-15T10:55:13.900485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0] Write session: try to update token
2025-10-15T10:55:13.900546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:14.052639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.052669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.052680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.052724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:14.052736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:14.052748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:14.052758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:14.052786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:14.052809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:14.052828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:14.052992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:14.053008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:14.054383Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:14.055653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:14.055682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:14.055708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:14.165262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId: src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:14.189908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:14.201626Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:14.212730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:14.212772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:14.212824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:14.212838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:14.212874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400364302896114:3209]
2025-10-15T10:55:14.215719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:14.216985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:14.217025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:14.218224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:14.218573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400361503190616:2534]
2025-10-15T10:55:14.219100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:14.219133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:14.249678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 85 reason: error at write: Disconnected sessionId: src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0
2025-10-15T10:55:14.249954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 85 sessionId: src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0 is DEAD
2025-10-15T10:55:14.250374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:14.250449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0] Write session will restart in 0.006125s
2025-10-15T10:55:14.250614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0] Write session: Do CDS request
2025-10-15T10:55:14.250662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:14.262214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:14.262255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:14.262287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 86
2025-10-15T10:55:14.264601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:14.264732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 86 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:14.264757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=86 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:14.264765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:14.266301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 86 sessionId:  describe result for acl check
2025-10-15T10:55:14.266459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:14.266479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:14.266490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:14.266508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400365798158032:3362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:14.269238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400365798158032:3362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:14.279022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400365798158032:3362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:14.290696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400365798158032:3362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:14.290741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400365798158032:3362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:14.290759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400365798158032:3362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:14.290815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 86 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:14.296736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:14.298719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:14.299369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:14.299388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:14.299433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:14.299678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:14.299863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400368597863586:3220]
2025-10-15T10:55:14.301784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:14.302638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:14.302854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:14.304051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:14.304367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:14.304381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:14.304387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:14.304391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:14.304396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:14.304401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:14.304405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:14.304410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:14.304416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:14.304422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:14.304430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:14.304438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.304446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.304454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.304511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:14.304624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:14.304672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:14.304720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:14.304756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:14.304793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:14.304836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:14.304879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:14.304918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:14.304965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:14.305009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:14.305051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.305099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.305137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.305171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:14.305229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:14.305278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:14.305330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:14.305368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:14.305410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:14.305447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:14.305496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:14.305541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:14.305595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:14.305639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:14.305677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:14.305715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:14.305765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:14.305809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:14.305866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:14.305916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:14.305975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:14.306024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:14.306075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:14.306127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:14.306192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:14.306227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.306270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.306306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.306356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.306406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.306462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.306897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:14.318566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400365798158149:2534]
2025-10-15T10:55:14.318776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:14.325963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:14.336197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:14.336260Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:14.336279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:14.336301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:14.336330Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 85 [2:7561400368597863586:3220]
2025-10-15T10:55:14.336421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:14.336494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:14.336511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.336525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.336539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.336596Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:14.336624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:14.336649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:14.371565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.371603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.371619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.371633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:14.371987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:14.372017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.372176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.372378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.372622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:14.372719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400365798158149:2534], now have 1 active actors on pipe
2025-10-15T10:55:14.372742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400365798158015:2467], now have 1 active actors on pipe
2025-10-15T10:55:14.372766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400365798158137:3362], now have 1 active actors on pipe
2025-10-15T10:55:14.372792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.372820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.372834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.372873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:14.372953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:14.372820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 85
2025-10-15T10:55:14.372907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 85
2025-10-15T10:55:14.373010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 85, pipe: [1:7561400365798158149:2534]
2025-10-15T10:55:14.373147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:14.373174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:14.373221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:14.373236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:14.373248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:14.373301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.373329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:14.373405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:14.373662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:14.373705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:14.373790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:14.373805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:14.373909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:14.373950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.373971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.373982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:14.374025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.374084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:14.374185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:14.374250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:14.374695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:14.374725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:14.374798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:14.374819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:14.374859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.374874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.374910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:14.374963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:14.374986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:14.375085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:14.375403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 86 partition: 0 MaxSeqNo: 46 sessionId: src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0
2025-10-15T10:55:14.376238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c312d32-641c0e3c-abe16b2f-2c715450_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:14.419369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0] Write session: try to update token
2025-10-15T10:55:14.419430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:14.441914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.441950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.441962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.442018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:14.442033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:14.442068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.442179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:14.442332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:14.448628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:14.449841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:14.451283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:14.481867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:14.484754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:14.485323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:14.640734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.640767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.640777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.640830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:14.640842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:14.640853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:14.640863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:14.640899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.640923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.640945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.641171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:14.641199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:14.641780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:14.641831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:14.641870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:14.642552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:14.665156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId: src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:14.689562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:14.788447Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:14.826537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:14.826593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:14.826661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:55:14.826673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:14.826683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:14.826716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.826736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400368597863581:3220]
2025-10-15T10:55:14.827749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:14.827814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:14.827855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:14.827889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:14.827919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:14.828102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:14.828124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:14.830678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400365798158149:2534]
2025-10-15T10:55:14.830879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:14.831519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:14.851073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 86 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0
2025-10-15T10:55:14.851409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 86 sessionId: src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0 is DEAD
2025-10-15T10:55:14.853637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:14.853692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0] Write session will restart in 0.006143s
2025-10-15T10:55:14.853859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0] Write session: Do CDS request
2025-10-15T10:55:14.853910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:14.872199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:14.901568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:14.901614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 87
2025-10-15T10:55:14.902163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:14.902294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 87 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:14.902311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=87 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:14.902320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:14.904085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 87 sessionId:  describe result for acl check
2025-10-15T10:55:14.904219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:14.904235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:14.904254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:14.904270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400365798158258:3367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:14.906962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400365798158258:3367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:14.913268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:14.914755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400365798158258:3367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:14.915945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:14.916877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:14.916923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:14.916979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:14.917290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:14.917500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400368597863745:3224]
2025-10-15T10:55:14.920225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:14.921164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:14.921426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:14.922761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:14.923099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:14.923118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:14.923125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:14.923132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:14.923140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:14.923147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:14.923154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:14.923160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:14.923167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:14.923175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:14.923182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:14.923189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.923195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.923202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.923249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:14.923383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:14.923432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:14.923484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:14.923541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:14.923588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:14.923632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:14.923677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:14.923730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:14.923775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:14.923826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:14.923877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.923928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.923980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.924022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:14.924090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:14.924151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:14.924212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:14.924268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:14.926379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400365798158258:3367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:14.924324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:14.926428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400365798158258:3367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:14.924371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:14.926446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400365798158258:3367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:14.924423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:14.924471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:14.926477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 87 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:14.924529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:14.924573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:14.924630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:14.924676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:14.924750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:14.924801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:14.924853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:14.924900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:14.924956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:14.925000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:14.925056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:14.925101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:14.925159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:14.925203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.925256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.925302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.925354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.925397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.925455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.925969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:14.931007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400365798158317:2534]
2025-10-15T10:55:14.931225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:14.948939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:14.961935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 86
2025-10-15T10:55:14.961977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 86, pipe: [1:7561400365798158317:2534]
2025-10-15T10:55:14.962031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 86
2025-10-15T10:55:14.959851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:14.959901Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:14.959921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:14.959943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:14.959971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 86 [2:7561400368597863745:3224]
2025-10-15T10:55:14.960031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:14.960100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:14.960119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.960132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.960149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.960201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:14.960224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:14.960246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:14.961235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.961253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.961268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.961281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:14.961571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:14.961590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:14.961753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:14.961976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:14.962240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:14.962333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400365798158317:2534], now have 1 active actors on pipe
2025-10-15T10:55:14.962357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400365798158314:3367], now have 1 active actors on pipe
2025-10-15T10:55:14.962381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400365798158180:2467], now have 1 active actors on pipe
2025-10-15T10:55:14.962421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:14.962437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:14.962451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:14.962484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:14.962545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:14.962563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:14.962568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:14.962577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:14.962769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:14.962787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:14.962843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:14.962868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:14.962976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:14.962992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:14.963121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:14.963149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:14.963184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:14.963221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:14.963253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.963271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.963282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:14.963320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.965014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:14.965259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:14.965357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:14.965768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:14.965789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:14.965825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:14.965840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:14.965873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:14.965898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:14.965910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:14.966597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:14.966638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:14.966742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:14.967088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 87 partition: 0 MaxSeqNo: 46 sessionId: src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0
2025-10-15T10:55:14.967898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c0f2f14-5fa5b639-13bba6b1-44e111b2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:15.015313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0] Write session: try to update token
2025-10-15T10:55:15.031434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:15.090356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.090443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.090471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.090573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:15.090596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:15.090619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:15.090645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:15.090723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:15.090782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:15.090827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:15.091054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:15.091173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:15.091200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:15.091237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:15.091263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:15.091299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:15.091380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:15.111479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:15.224352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId: src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:15.257068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:15.310204Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:15.333138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:15.333188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:15.333245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:15.333258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:15.333295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400368597863739:3224]
2025-10-15T10:55:15.335982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:15.336024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:15.340237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400365798158317:2534]
2025-10-15T10:55:15.340380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:15.340393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:15.341076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:15.341118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:15.351288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:15.361204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 87 reason: error at write: Disconnected sessionId: src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0
2025-10-15T10:55:15.361490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 87 sessionId: src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0 is DEAD
2025-10-15T10:55:15.363999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:15.364086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0] Write session will restart in 0.008574s
2025-10-15T10:55:15.364311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0] Write session: Do CDS request
2025-10-15T10:55:15.364377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:15.379515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:15.392289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:15.392317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 88
2025-10-15T10:55:15.395600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:15.395725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 88 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:15.395745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=88 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:15.395755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:15.398393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 88 sessionId:  describe result for acl check
2025-10-15T10:55:15.398503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:15.398515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:15.398523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:15.398539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400370093125661:3378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:15.400959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400370093125661:3378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:15.421601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400370093125661:3378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:15.445353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400370093125762:2534]
2025-10-15T10:55:15.445524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:15.450663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400370093125661:3378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:15.450701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400370093125661:3378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:15.450728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400370093125661:3378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:15.450755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 88 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:15.452749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:15.455374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:15.456096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:15.456110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:15.456146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:15.456348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:15.456495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400372892831201:3232]
2025-10-15T10:55:15.458248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:15.459084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:15.459263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:15.460450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:15.460734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:15.460742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:15.460748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:15.460754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:15.460759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:15.460765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:15.460770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:15.460776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:15.460781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:15.460787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:15.460792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:15.460798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.460803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.460809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.460848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:15.460938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:15.460978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:15.461022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:15.461062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:15.461102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:15.461140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:15.461177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:15.461213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:15.461250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:15.461285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:15.461324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.461360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.461394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.461431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:15.461483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:15.461528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:15.461570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:15.461608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:15.461650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:15.461688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:15.461733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:15.461775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:15.461823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:15.461861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:15.461904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:15.461942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:15.461988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:15.462026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:15.462070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:15.462108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:15.462151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:15.462188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:15.462231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:15.462269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:15.462312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:15.462351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.462394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.462448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.462492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.462529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.462571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.462973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:15.492568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:15.503553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:15.503595Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:15.503611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:15.503628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:15.503649Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 87 [2:7561400372892831201:3232]
2025-10-15T10:55:15.503695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:15.503747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:15.503760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.503771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.503781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.503823Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:15.503843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:15.503862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:15.521630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.521658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.521667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.521676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:15.521906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:15.521925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.522031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.522171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.522354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:15.522424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400372892831195:3232]
2025-10-15T10:55:15.522441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400372892831195:3232]
2025-10-15T10:55:15.522451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400372892831195:3232]
2025-10-15T10:55:15.522481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:15.522533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:15.522547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:15.522558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:15.522569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:15.522688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:15.522707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:15.522802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400372892831195:3232]
2025-10-15T10:55:15.522822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:15.522856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:15.522906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400370093125769:3378], now have 1 active actors on pipe
2025-10-15T10:55:15.522933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400370093125762:2534], now have 1 active actors on pipe
2025-10-15T10:55:15.522949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400370093125642:2467], now have 1 active actors on pipe
2025-10-15T10:55:15.523572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 87
2025-10-15T10:55:15.523680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 87, pipe: [1:7561400370093125762:2534]
2025-10-15T10:55:15.523750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 87
2025-10-15T10:55:15.527129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:15.527177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:15.527286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:15.527307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:15.527415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:15.527451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.527471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.527482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:15.527516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.527556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:15.527621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:15.527698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:15.528088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:15.528112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:15.528143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400372892831195:3232]
2025-10-15T10:55:15.528156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400372892831195:3232]
2025-10-15T10:55:15.528185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:15.528615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:15.528652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:15.529436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:15.529464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:15.529540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:15.529876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 88 partition: 0 MaxSeqNo: 46 sessionId: src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0
2025-10-15T10:55:15.531825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586f63fc-ef6d8fc4-ad92bb22-72aa6506_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:15.581102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0] Write session: try to update token
2025-10-15T10:55:15.581154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:15.605285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:15.605319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:15.605332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:15.605342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:15.605371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400372892831195:3232]
2025-10-15T10:55:15.605395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400372892831195:3232]
2025-10-15T10:55:15.605415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400372892831195:3232]
2025-10-15T10:55:15.605563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.605583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.605593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.605592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:15.605628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:15.605634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:15.605653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:15.605656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:15.606771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:15.764824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId: src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:15.786288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:15.798508Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:15.802226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:15.802288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:15.804870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:15.804922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:15.815757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400370093125762:2534]
2025-10-15T10:55:15.815852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:15.816004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 88 reason: error at write: Disconnected sessionId: src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0
2025-10-15T10:55:15.816377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 88 sessionId: src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0 is DEAD
2025-10-15T10:55:15.816795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:15.816848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0] Write session will restart in 0.008496s
2025-10-15T10:55:15.816950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0] Write session: Do CDS request
2025-10-15T10:55:15.816982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:15.831701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:15.831727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 89
2025-10-15T10:55:15.831830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:15.832261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:15.832374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 89 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:15.832396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=89 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:15.832407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:15.833654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 89 sessionId:  describe result for acl check
2025-10-15T10:55:15.833768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:15.833784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:15.833793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:15.833809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400370093125815:3383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:15.836192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400370093125815:3383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:15.847556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400370093125815:3383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:15.858173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:15.858227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:15.859882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400370093125815:3383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:15.859940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400370093125815:3383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:15.859965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400370093125815:3383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:15.860013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 89 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:15.886525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:15.888968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:15.889897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:15.889933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:15.889979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:15.890259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:15.890468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400372892831384:3241]
2025-10-15T10:55:15.892786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:15.893825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:15.894060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:15.897132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:15.897517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:15.897525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:15.897532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:15.897539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:15.897547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:15.897553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:15.897560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:15.897567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:15.897574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:15.897580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:15.897587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:15.897594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.897601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.897608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.897659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:15.897777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:15.897829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:15.897881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:15.897928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:15.897977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:15.898028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:15.898076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:15.898122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:15.898182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:15.898228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:15.898277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.898322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.898366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.898428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:15.898502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:15.898569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:15.898627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:15.898681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:15.898739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:15.898786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:15.898840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:15.898890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:15.898948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:15.898997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:15.899051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:15.899099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:15.899156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:15.899205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:15.899264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:15.899312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:15.900440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:15.900520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:15.900583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:15.900643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:15.900709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:15.900769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.900829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.900886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.900954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.901008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.901066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.901657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:15.916459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400370093125954:2534]
2025-10-15T10:55:15.916667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:15.920464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:15.929873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:15.929931Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:15.929952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:15.929974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:15.930002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 88 [2:7561400372892831384:3241]
2025-10-15T10:55:15.930060Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:15.930128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:15.930145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.930159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.930176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.930230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:15.930255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:15.930278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:15.932576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 88, pipe: [1:7561400370093125954:2534]
2025-10-15T10:55:15.932666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 88
2025-10-15T10:55:15.932735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 88
2025-10-15T10:55:15.931736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.931768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.931783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.931796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:15.932115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:15.932134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:15.932297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:15.932506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:15.932768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:15.932871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400370093125954:2534], now have 1 active actors on pipe
2025-10-15T10:55:15.932899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400370093125857:3383], now have 1 active actors on pipe
2025-10-15T10:55:15.932922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400370093125806:2467], now have 1 active actors on pipe
2025-10-15T10:55:15.932950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:15.932967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:15.932982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:15.933028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:15.933083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:15.933100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:15.933113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:15.933118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:15.933329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:15.933348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:15.933564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:15.933590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:15.933657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:15.933673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:15.933722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:15.933758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:15.933912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:15.933946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.933965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.933977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:15.934017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.934067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:15.934188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:15.934277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:15.934352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:15.934702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:15.934716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:15.934741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:15.934751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:15.934769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:15.934840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:15.934855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:15.935532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:15.935556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:15.935629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:15.936490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 89 partition: 0 MaxSeqNo: 46 sessionId: src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0
2025-10-15T10:55:15.937563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfa6486-97e1c747-d32c1e72-2ab166e9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:15.981365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0] Write session: try to update token
2025-10-15T10:55:15.981417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:16.197102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.197145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.197158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.197288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:16.197303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:16.197318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:16.197331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:16.197369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:16.197400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:16.197425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:16.197565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:16.197609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:16.197645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:16.214541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:16.214594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:16.220584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:16.248878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId: src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:16.270937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:16.383533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:16.414991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:16.415022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:16.415054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:16.415167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:16.415185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:16.415225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:55:16.415231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:16.415238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:16.415254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:16.415268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400372892831379:3241]
2025-10-15T10:55:16.415622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:16.415695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:16.415734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:16.415775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:16.415805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:16.415833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:16.417328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400370093125954:2534]
2025-10-15T10:55:16.417342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:16.417370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:16.417481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:16.422213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:16.422282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:16.429532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 89 reason: error at write: Disconnected sessionId: src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0
2025-10-15T10:55:16.429899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 89 sessionId: src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0 is DEAD
2025-10-15T10:55:16.435584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:16.435635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0] Write session will restart in 0.008825s
2025-10-15T10:55:16.435747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0] Write session: Do CDS request
2025-10-15T10:55:16.435791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:16.464238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:16.466046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:16.466074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 90
2025-10-15T10:55:16.466452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:16.466576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 90 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:16.466591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=90 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:16.466602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:16.468056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 90 sessionId:  describe result for acl check
2025-10-15T10:55:16.468172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:16.468182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:16.468193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:16.468216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400374388093278:3391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:16.470928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400374388093278:3391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:16.483708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400374388093278:3391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:16.502237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400374388093278:3391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:16.502277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400374388093278:3391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:16.502293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400374388093278:3391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:16.502322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 90 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:16.520452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400374388093383:2534]
2025-10-15T10:55:16.520624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:16.536530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:16.539194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:16.540044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:16.540080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:16.540124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:16.540374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:16.540568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400377187798828:3245]
2025-10-15T10:55:16.542967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:16.543996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:16.544239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:16.545568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:16.545934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:16.545960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:16.545966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:16.545974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:16.545981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:16.545989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:16.545997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:16.546004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:16.546011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:16.546018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:16.546026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:16.546034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:16.546042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:16.546048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:16.546101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:16.546222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:16.546275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:16.546327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:16.546384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:16.546454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:16.546508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:16.546560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:16.546615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:16.546670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:16.546723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:16.546779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:16.546831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:16.546883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:16.546938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:16.547015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:16.547082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:16.547144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:16.547199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:16.547267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:16.547320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:16.547524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:16.547595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:16.547657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:16.547710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:16.547772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:16.547825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:16.547884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:16.547933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:16.547988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:16.548038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:16.548095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:16.548144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:16.548209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:16.548258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:16.548323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:16.548374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:16.548451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:16.548510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:16.548570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:16.548620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:16.548679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:16.549221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:16.579242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:16.588470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:16.588524Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:16.588544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:16.588566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:16.588592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 89 [2:7561400377187798828:3245]
2025-10-15T10:55:16.588645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:16.588711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:16.588726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.588739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.588752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.588801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:16.588832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:16.588857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:16.589898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:16.589924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:16.589939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:16.589951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:16.590206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:16.590235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:16.590382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:16.590589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:16.590842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:16.590915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:16.590940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:16.590953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:16.590996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:16.591078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:16.591124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:16.591152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:16.591165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:16.591270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:16.591296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:16.591709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:16.591743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:16.591805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400374388093335:3391], now have 1 active actors on pipe
2025-10-15T10:55:16.591828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400374388093383:2534], now have 1 active actors on pipe
2025-10-15T10:55:16.591851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400374388093264:2467], now have 1 active actors on pipe
2025-10-15T10:55:16.592113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:16.592061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 89
2025-10-15T10:55:16.592180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 89, pipe: [1:7561400374388093383:2534]
2025-10-15T10:55:16.592249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 89
2025-10-15T10:55:16.592803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:16.592839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:16.592931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:16.592948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:16.593048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:16.593081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.593099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.593109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:16.593146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.593191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:16.593255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:16.593323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:16.593729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:16.593762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:16.593797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:16.593810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:16.593836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:16.594510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:16.594523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:16.595326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:16.595365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:16.595437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:16.595717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 90 partition: 0 MaxSeqNo: 46 sessionId: src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0
2025-10-15T10:55:16.596575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeefdf9b-836e5b46-3ee3af89-c2d23b1a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:16.637933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0] Write session: try to update token
2025-10-15T10:55:16.638001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:16.819333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId: src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:16.869255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.869294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.869305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.869428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:16.869441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:16.869454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:16.869464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:16.869496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:16.869523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:16.869545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:16.871559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:16.871612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:16.871651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:16.871678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:16.871707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:16.893399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:16.893452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:16.894516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:16.932990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:17.065461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:17.067681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:17.067721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:17.067764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400377187798823:3245]
2025-10-15T10:55:17.067955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:17.067991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:17.069173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:17.069224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:17.075542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:17.075568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:17.089717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:17.089785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0] Write session will restart in 0.005588s
2025-10-15T10:55:17.089951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0] Write session: Do CDS request
2025-10-15T10:55:17.090009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:17.088912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 90 reason: error at write: Disconnected sessionId: src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0
2025-10-15T10:55:17.089284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 90 sessionId: src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0 is DEAD
2025-10-15T10:55:17.102544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:17.103432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:17.105846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:17.135683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: status is not ok. Code: INITIALIZING. Reason: tablet will be restarted right now, current pipe: [1:7561400374388093383:2534]
2025-10-15T10:55:17.135769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:17.135889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:17.135904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 91
2025-10-15T10:55:17.136857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:17.136989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 91 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:17.137006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=91 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:17.137016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:17.138766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 91 sessionId:  describe result for acl check
2025-10-15T10:55:17.138875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:17.138892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:17.138902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:17.138919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400378683060761:3403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:17.144511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400378683060761:3403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:17.151235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400378683060761:3403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:17.164015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400378683060761:3403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:17.164058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400378683060761:3403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:17.164075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400378683060761:3403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:17.164105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 91 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:17.176340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:17.181150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:17.181983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:17.182000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:17.182043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:17.182283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:17.182488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400381482766298:3255]
2025-10-15T10:55:17.184699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:17.185721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:17.185933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:17.187188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:17.187536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:17.187545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:17.187551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:17.187558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:17.187566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:17.187573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:17.187581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:17.187588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:17.187595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:17.187601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:17.187609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:17.187616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.187624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.187630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.187678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:17.187788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:17.187840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:17.187888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:17.187934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:17.187985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:17.188031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:17.188077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:17.188130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:17.188178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:17.188224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:17.188268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.188314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.188360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.188399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:17.188465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:17.188524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:17.188577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:17.188627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:17.190552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:17.190623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:17.190685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:17.190734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:17.190790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:17.190836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:17.190890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:17.190938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:17.190990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:17.191034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:17.191089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:17.191139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:17.191198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:17.191244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:17.191298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:17.191357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:17.191412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:17.191458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.191509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.191567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.191619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.191665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.191716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.192229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:17.231454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:17.236104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400378683060887:2534]
2025-10-15T10:55:17.236313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:17.241919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:17.241962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:17.241977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:17.241995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:17.242016Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 90 [2:7561400381482766298:3255]
2025-10-15T10:55:17.242063Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:17.242115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:17.242128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.242139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.242149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.242194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:17.242216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:17.242236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:17.245213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.245248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.245261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.245272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:17.245562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:17.245590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.245717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.245896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.246128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:17.246211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.246229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.246241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.246281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:17.246351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:17.246423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:17.246459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:17.246472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:17.246537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:17.246554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:17.247038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 90
2025-10-15T10:55:17.246677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.246708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:17.246779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:17.246825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400378683060757:2467], now have 1 active actors on pipe
2025-10-15T10:55:17.246849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400378683060887:2534], now have 1 active actors on pipe
2025-10-15T10:55:17.247176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 90, pipe: [1:7561400378683060887:2534]
2025-10-15T10:55:17.246869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400378683060878:3403], now have 1 active actors on pipe
2025-10-15T10:55:17.247242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 90
2025-10-15T10:55:17.247593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:17.247622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:17.247704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:17.247723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:17.247804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:17.247841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.247858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.247868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:17.247918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.247964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:17.248022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:17.248105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:17.248474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:17.248489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:17.248532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:17.248549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:17.248584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.249077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 91 partition: 0 MaxSeqNo: 46 sessionId: src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0
2025-10-15T10:55:17.248597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.248627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:17.248656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:17.248670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:17.248778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:17.249865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3959926-8c6ab5d-1eb86a06-f37d94d5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:17.291031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0] Write session: try to update token
2025-10-15T10:55:17.291091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:17.334496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:17.334533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:17.334565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.334688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:17.334693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:17.336756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:17.338674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:17.340315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:17.342612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:17.352587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:17.355708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.355740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.355752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.355813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:17.467427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:17.467467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:17.467481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:17.467492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:17.467534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.467562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.467587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400381482766293:3255]
2025-10-15T10:55:17.467697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:17.467742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:17.467752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.467764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.467776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.467786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:17.467823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:17.467843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:17.473876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:17.518122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId: src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:17.549561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:17.626773Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:17.668744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:17.668791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:17.672196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:17.672368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400378683060887:2534]
2025-10-15T10:55:17.672459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:17.672478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:17.676037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:17.676107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:17.732500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 91 reason: error at write: Disconnected sessionId: src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0
2025-10-15T10:55:17.732866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 91 sessionId: src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0 is DEAD
2025-10-15T10:55:17.736218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:17.736307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0] Write session will restart in 0.008479s
2025-10-15T10:55:17.736581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0] Write session: Do CDS request
2025-10-15T10:55:17.736669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:17.749662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:17.752224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:17.752253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 92
2025-10-15T10:55:17.753633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:17.753888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 92 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:17.753918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=92 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:17.753929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:17.755876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 92 sessionId:  describe result for acl check
2025-10-15T10:55:17.755992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:17.756004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:17.756012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:17.756030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400378683060989:3411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:17.759707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400378683060989:3411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:17.775472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 1 ReadOffset 14 EndOffset 33 InitDone 1 WaitForData 0, pipe: [1:7561400378683061028:2534]
2025-10-15T10:55:17.775672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_7647013187117849532_v1" Offset: 14 Count: 22 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561400082330304938 RawX2: 4503603922340326 } Cookie: 14 } }
2025-10-15T10:55:17.797078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:17.801109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:17.802010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:17.802031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:17.802074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:17.802334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:17.802538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400381482766474:3264]
2025-10-15T10:55:17.805158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:17.805963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400378683060989:3411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:17.811885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:17.812185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:17.813552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:17.813896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:17.813905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:17.813912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:17.813918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:17.813924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:17.813930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:17.813936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:17.813941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:17.813948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:17.813954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:17.813960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:17.813967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.813975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.813982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.814031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:17.814142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:17.814187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:17.814232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:17.814276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:17.814319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:17.814360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:17.814402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:17.814485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:17.814527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:17.814571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:17.814613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.814655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.815509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.815570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:17.815637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:17.815693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:17.815745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:17.815789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:17.815835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:17.815870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:17.815913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:17.815945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:17.815983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:17.816015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:17.816055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:17.816104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:17.816143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:17.816176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:17.816215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:17.816248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:17.816291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:17.816323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:17.816375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:17.816411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:17.816454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:17.816488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.816528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.816560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.816597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.816626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.816662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.817024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:17.841732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400378683060989:3411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:17.841770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400378683060989:3411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:17.841787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400378683060989:3411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:17.841817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 92 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:17.852719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:17.863408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:17.863459Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:17.863477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:17.863495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:17.863521Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 91 [2:7561400381482766474:3264]
2025-10-15T10:55:17.863568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:17.863630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:17.863647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.863658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.863670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.863719Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:17.863741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:17.863762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:17.865916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.865942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.865953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.865964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:17.866228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:17.866245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:17.867523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 91, pipe: [1:7561400378683061028:2534]
2025-10-15T10:55:17.867601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 91
2025-10-15T10:55:17.867670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 91
2025-10-15T10:55:17.866373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:17.868135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:17.868357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:17.868444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400378683061028:2534], now have 1 active actors on pipe
2025-10-15T10:55:17.868466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400378683061071:3411], now have 1 active actors on pipe
2025-10-15T10:55:17.868488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400378683060914:2467], now have 1 active actors on pipe
2025-10-15T10:55:17.868580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:17.868603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:17.868658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:17.868670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:17.868716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:17.868731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:17.868742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:17.868772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:17.868847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:17.869022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:17.869039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:17.869112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:17.869143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.869162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.869172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:17.869207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.869249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:17.869373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:17.869392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:17.869448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:17.869585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 22 size 524288 endOffset 46 max time lag 0ms effective offset 14
2025-10-15T10:55:17.869936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 46
2025-10-15T10:55:17.869950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:55:17.870000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:17.870013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:17.870035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T10:55:17.871790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:17.871817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:17.871829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:17.871854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:17.871871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T10:55:17.871880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T10:55:17.875785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:17.875824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:17.875905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:17.876384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 92 partition: 0 MaxSeqNo: 46 sessionId: src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0
2025-10-15T10:55:17.877361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26293bf-94d1f80b-afab2e77-5c6ac42b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:17.933652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0] Write session: try to update token
2025-10-15T10:55:17.933718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:18.071616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId: src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:18.102052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.102088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.102101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.102162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:18.102178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:18.102193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:18.102205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:18.102242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:18.102269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:18.102294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:18.102429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:18.102485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:18.102520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:18.102540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:18.102563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:18.107305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:18.132987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:18.268952Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:18.306286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:18.306343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:18.306420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:18.306436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:18.306492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:18.306594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T10:55:18.306608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:18.306619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:18.306634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:18.306648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:18.306675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561400381482766468:3264]
2025-10-15T10:55:18.307257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:18.307279Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:18.307663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:18.307705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:18.307763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:18.307793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:18.307821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T10:55:18.311596Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T10:55:18.310270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400378683061028:2534]
2025-10-15T10:55:18.310315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:18.310335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:18.310461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:18.310653Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T10:55:18.311276Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_7647013187117849532_v1 is DEAD
2025-10-15T10:55:18.311860Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400082330304931:2522] disconnected; active server actors: 1
2025-10-15T10:55:18.311908Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400082330304931:2522] client user disconnected session shared/user_1_1_7647013187117849532_v1
2025-10-15T10:55:18.312419Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:55:18.312474Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:18.312614Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.009168s
2025-10-15T10:55:18.325650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 92 reason: error at write: Disconnected sessionId: src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0
2025-10-15T10:55:18.325975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 92 sessionId: src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0 is DEAD
2025-10-15T10:55:18.326441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:18.326508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0] Write session will restart in 0.005485s
2025-10-15T10:55:18.326677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0] Write session: Do CDS request
2025-10-15T10:55:18.326728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:18.337638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:18.337668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 93
2025-10-15T10:55:18.338357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:18.338926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:18.339197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 93 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:18.339238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=93 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:18.339270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:18.339844Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T10:55:18.340245Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:55:18.340262Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-15T10:55:18.342427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 93 sessionId:  describe result for acl check
2025-10-15T10:55:18.342640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:18.347171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:18.347222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:18.347249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400382978028401:3416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:18.347443Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:55:18.347680Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:55:18.348131Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 auth for : user
2025-10-15T10:55:18.351227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400382978028401:3416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:18.370204Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 Handle describe topics response
2025-10-15T10:55:18.370425Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 auth is DEAD
2025-10-15T10:55:18.370564Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:55:18.372746Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_2_17824226133827759393_v1
2025-10-15T10:55:18.372789Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:18.372975Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:55:18.372251Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:55:18.373318Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:55:18.373428Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 got read request: guid# da74da3a-61dc02db-d74de619-6ef436d1
2025-10-15T10:55:18.373482Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400382978028411:3418] connected; active server actors: 1
2025-10-15T10:55:18.373531Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561400382978028411:3418] session shared/user_1_2_17824226133827759393_v1
2025-10-15T10:55:18.373572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:55:18.373622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:55:18.373672Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_17824226133827759393_v1" (Sender=[1:7561400382978028400:3418], Pipe=[1:7561400382978028411:3418], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:55:18.373702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:55:18.373750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:55:18.373795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_17824226133827759393_v1" (Sender=[1:7561400382978028400:3418], Pipe=[1:7561400382978028411:3418], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:55:18.373846Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_17824226133827759393_v1" sender [1:7561400382978028400:3418] lock partition 0 for ReadingSession "shared/user_1_2_17824226133827759393_v1" (Sender=[1:7561400382978028400:3418], Pipe=[1:7561400382978028411:3418], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-15T10:55:18.373887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:55:18.373913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000143s
2025-10-15T10:55:18.374726Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_17824226133827759393_v1" ClientId: "user" PipeClient { RawX1: 7561400382978028411 RawX2: 4503603922341210 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:55:18.374806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:55:18.378513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400382978028401:3416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:18.399845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400382978028401:3416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:18.399886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400382978028401:3416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:18.399905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400382978028401:3416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:18.399939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 93 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:18.481072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:18.485812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:18.486740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:18.486775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:18.486819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:18.487100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:18.487285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400385777733937:3268]
2025-10-15T10:55:18.490067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:18.491480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:18.491719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:18.493034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:18.493398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:18.493407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:18.493415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:18.493422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:18.493430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:18.493438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:18.493445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:18.493452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:18.493462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:18.493469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:18.493476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:18.493483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:18.493490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:18.493497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:18.493550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:18.493664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:18.493716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:18.493765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:18.493810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:18.493856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:18.493900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:18.493948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:18.493994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:18.494043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:18.494089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:18.495305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:18.495394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:18.495443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:18.495503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:18.495585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:18.495650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:18.495707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:18.495754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:18.495810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:18.495857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:18.495911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:18.495961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:18.496019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:18.496064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:18.496118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:18.496166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:18.496219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:18.496266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:18.496322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:18.496373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:18.496427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:18.496474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:18.496528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:18.496574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:18.496630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:18.496675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:18.496729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:18.496778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:18.496834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:18.496880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:18.496934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:18.497450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:18.527463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:18.538122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:18.538188Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:18.538206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:18.538226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:18.538253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 92 [2:7561400385777733937:3268]
2025-10-15T10:55:18.538309Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:18.538370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:18.538384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.538396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.538410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.538475Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:18.538499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:18.538520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:18.540555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:18.540584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:18.540599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:18.540613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:18.540882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:18.540903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:18.541055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:18.541251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:18.541482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:18.541552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400385777733928:3268]
2025-10-15T10:55:18.541567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400385777733928:3268]
2025-10-15T10:55:18.541580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400385777733928:3268]
2025-10-15T10:55:18.541622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:18.541700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:18.541887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:18.541904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:18.542023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400385777733928:3268]
2025-10-15T10:55:18.542042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:18.544342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 92, pipe: [1:7561400382978028422:3423]
2025-10-15T10:55:18.544445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 92
2025-10-15T10:55:18.544523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 92
2025-10-15T10:55:18.543057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:18.543080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:18.543091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:18.543116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:18.559477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400382978028422:3423], now have 1 active actors on pipe
2025-10-15T10:55:18.559535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400382978028446:3416], now have 1 active actors on pipe
2025-10-15T10:55:18.559557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400382978028387:2467], now have 1 active actors on pipe
2025-10-15T10:55:18.559661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:18.559688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:18.559721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_17824226133827759393_v1 on pipe: [1:7561400382978028422:3423]
2025-10-15T10:55:18.559777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:18.559791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:18.559851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.559877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.559888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:18.559965Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_17824226133827759393_v1
2025-10-15T10:55:18.559978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.560140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:18.560171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:55:18.560191Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:55:18.560733Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_17824226133827759393_v1:1 with generation 92
2025-10-15T10:55:18.578506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:55:18.578594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:55:18.578624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.578649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.578660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:18.578701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.578749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:18.578779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:55:18.578819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:55:18.578868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:18.580819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:18.580857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:18.580929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:18.579673Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760525718537 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:55:18.579723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T10:55:18.579894Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 sending to client partition status
2025-10-15T10:55:18.585694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 93 partition: 0 MaxSeqNo: 46 sessionId: src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0
2025-10-15T10:55:18.588040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32112b4-b1fefb77-b5aed9a0-44902176_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:18.640140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0] Write session: try to update token
2025-10-15T10:55:18.640180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:18.757065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.757102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.757114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.757171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:18.757183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:18.757196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:18.757207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:18.757253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400385777733928:3268]
2025-10-15T10:55:18.757278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400385777733928:3268]
2025-10-15T10:55:18.757312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400385777733928:3268]
2025-10-15T10:55:18.757452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:18.757473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:18.757725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:18.757768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:18.757805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:18.757831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:18.757873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:18.768561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:18.815180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId: src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:18.836614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:18.926455Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:18.934296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:18.934343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:18.935679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400382978028422:3423]
2025-10-15T10:55:18.935876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:18.935909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:18.938712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_17824226133827759393_v1
2025-10-15T10:55:18.938788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:18.946971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 93 reason: error at write: Disconnected sessionId: src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0
2025-10-15T10:55:18.947325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 93 sessionId: src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0 is DEAD
2025-10-15T10:55:18.947744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:18.947790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0] Write session will restart in 0.009860s
2025-10-15T10:55:18.947963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0] Write session: Do CDS request
2025-10-15T10:55:18.948007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:18.972238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:18.972794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:18.973391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:18.973415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 94
2025-10-15T10:55:18.976920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:18.977067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 94 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:18.977091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=94 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:18.977101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:18.977781Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_17824226133827759393_v1
2025-10-15T10:55:18.978470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 94 sessionId:  describe result for acl check
2025-10-15T10:55:18.978578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:18.978593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:18.978603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:18.978620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400382978028593:3431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:18.983242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400382978028593:3431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:19.000806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400382978028593:3431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:19.012107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400382978028593:3431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:19.012147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400382978028593:3431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:19.012165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400382978028593:3431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:19.012195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 94 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:19.033473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:19.035771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400387272996019:3423]
2025-10-15T10:55:19.041509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:19.042512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:19.042549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:19.042596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:19.042866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:19.043086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400390072701424:3277]
2025-10-15T10:55:19.045260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:19.046355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:19.046598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:19.047986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:19.048401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.048422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.048427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.048433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.048438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.048442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.048447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.048452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.048456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.048461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.048466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.048471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.048477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.048483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.048523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.048656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.048692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.048737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.048777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.048811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.048847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.048879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.048911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.048948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.048980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.049012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.049043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.049077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.049163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.049235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.049287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.049334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.049369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.049416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.049472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.049520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.049573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.049621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.049653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.049691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.049721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.049761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.049796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.049864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.049902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.049951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.049990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.050031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.050085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.050126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.050158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.050213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.050251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.050299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.050331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.050372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.050839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:19.078510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:19.088654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:19.088700Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:19.088716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:19.088735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:19.088759Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 93 [2:7561400390072701424:3277]
2025-10-15T10:55:19.088804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:19.088856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:19.088868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.088886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.088895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.088944Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:19.088966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:19.088987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:19.089916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.089938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.089949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.089959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:19.090202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:19.090227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.090351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.090531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.090721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:19.090787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400387272996019:3423], now have 1 active actors on pipe
2025-10-15T10:55:19.090803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400387272995971:3431], now have 1 active actors on pipe
2025-10-15T10:55:19.090753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 93, pipe: [1:7561400387272996019:3423]
2025-10-15T10:55:19.090814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400382978028588:2467], now have 1 active actors on pipe
2025-10-15T10:55:19.090784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 93
2025-10-15T10:55:19.090868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 93
2025-10-15T10:55:19.090893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400390072701417:3277]
2025-10-15T10:55:19.090909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400390072701417:3277]
2025-10-15T10:55:19.090918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400390072701417:3277]
2025-10-15T10:55:19.090941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:19.090973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:19.090987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:19.090996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:19.090998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:19.091129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:19.091149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:19.091197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:19.091216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:19.091318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400390072701417:3277]
2025-10-15T10:55:19.091385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:19.091491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:19.091606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|beb17474-2b01fd2-f53b11b-d53093a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:19.091641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.091661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.091670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:19.091703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.091740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:19.091871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:19.092413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:19.092447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:19.092512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:19.092868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 94 partition: 0 MaxSeqNo: 46 sessionId: src_id|beb17474-2b01fd2-f53b11b-d53093a7_0
2025-10-15T10:55:19.093639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63d6609-30d7f36a-8d5f4678-f263bec2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|beb17474-2b01fd2-f53b11b-d53093a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:19.117326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17474-2b01fd2-f53b11b-d53093a7_0] Write session: try to update token
2025-10-15T10:55:19.117385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17474-2b01fd2-f53b11b-d53093a7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:19.148630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:19.148667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:19.148699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400390072701417:3277]
2025-10-15T10:55:19.148823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:19.148819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T10:55:19.148885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:19.172279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:19.173517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:19.174717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:19.176918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:19.180050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:19.180574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:19.214598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.214648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.214661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.214721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:19.214735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:19.214749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:19.214759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:19.214797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400390072701417:3277]
2025-10-15T10:55:19.214842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400390072701417:3277]
2025-10-15T10:55:19.214866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400390072701417:3277]
2025-10-15T10:55:19.214989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:19.215020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:19.215196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:19.215244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:19.215278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:19.264418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:19.346768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId: src_id|beb17474-2b01fd2-f53b11b-d53093a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:19.372604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:19.449936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:19.452220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:19.452266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:19.453372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400387272996019:3423]
2025-10-15T10:55:19.453382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:19.453400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:19.453473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:19.453099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:19.511725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 94 reason: error at write: Disconnected sessionId: src_id|beb17474-2b01fd2-f53b11b-d53093a7_0
2025-10-15T10:55:19.512550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17474-2b01fd2-f53b11b-d53093a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:19.512616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17474-2b01fd2-f53b11b-d53093a7_0] Write session will restart in 0.005713s
2025-10-15T10:55:19.512781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17474-2b01fd2-f53b11b-d53093a7_0] Write session: Do CDS request
2025-10-15T10:55:19.512841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17474-2b01fd2-f53b11b-d53093a7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:19.512112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 94 sessionId: src_id|beb17474-2b01fd2-f53b11b-d53093a7_0 is DEAD
2025-10-15T10:55:19.521820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:19.523514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17474-2b01fd2-f53b11b-d53093a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:19.523483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:19.523515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 95
2025-10-15T10:55:19.524085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:19.524247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 95 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:19.524271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=95 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:19.524281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:19.525612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 95 sessionId:  describe result for acl check
2025-10-15T10:55:19.525719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:19.525736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:19.525744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:19.525759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400387272996154:3441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:19.527738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:19.528178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400387272996154:3441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:19.528371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:19.528399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:19.528428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:19.528585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:19.528710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400390072701580:3287]
2025-10-15T10:55:19.530360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:19.534100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400387272996154:3441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:19.536135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:19.536411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:19.537919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:19.538242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.538257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.538264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.538270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.538281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.538290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.538296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.538303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.538310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.538316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.538322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.538328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.538335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.538341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.538385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.538493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.538544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.538585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.538621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.538670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.538709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.538755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.538798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.538847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.538897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.538938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.538978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.539016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.539057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.539115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.539181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.539234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.539281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.539329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.539395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.539454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.539498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.539548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.539650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.539758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.539848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.539959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.540065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.540182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.540289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.540398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.540495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.540616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.540731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.540865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.540962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.541054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.541102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.541153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.541198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.541248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.541703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:19.543745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400387272996154:3441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:19.543784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400387272996154:3441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:19.543801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400387272996154:3441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:19.543826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 95 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:19.551852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400387272996188:3423]
2025-10-15T10:55:19.557727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:19.568157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:19.568208Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:19.568225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:19.568244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:19.568266Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 94 [2:7561400390072701580:3287]
2025-10-15T10:55:19.568316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:19.568373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:19.568389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.568401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.568412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.568457Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:19.568477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:19.568496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:19.569622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.569648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.569663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.569673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:19.569934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:19.569956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.570087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.570288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.570533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:19.570604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400390072701575:3287]
2025-10-15T10:55:19.570622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400390072701575:3287]
2025-10-15T10:55:19.570633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400390072701575:3287]
2025-10-15T10:55:19.570672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:19.570740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:19.570907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:19.570927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:19.571033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400390072701575:3287]
2025-10-15T10:55:19.571058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:19.571712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 94
2025-10-15T10:55:19.571388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:19.571391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400387272996187:3441], now have 1 active actors on pipe
2025-10-15T10:55:19.571407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:19.571419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:19.571442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:19.571834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400387272996188:3423], now have 1 active actors on pipe
2025-10-15T10:55:19.571858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400387272996044:2467], now have 1 active actors on pipe
2025-10-15T10:55:19.572238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:19.572273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:19.572339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:19.572381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.572400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.572409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:19.572440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.572477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:19.572533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:19.572522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 94, pipe: [1:7561400387272996188:3423]
2025-10-15T10:55:19.572617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 94
2025-10-15T10:55:19.573077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:19.573102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:19.573164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:19.573435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 95 partition: 0 MaxSeqNo: 46 sessionId: src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0
2025-10-15T10:55:19.574207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beb17474-2b01fd2-f53b11b-d53093a7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:19.601244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0] Write session: try to update token
2025-10-15T10:55:19.601323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:19.659803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:19.659835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:19.659872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400390072701575:3287]
2025-10-15T10:55:19.660039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:19.660046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:19.662662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:19.663903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:19.665054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:19.666180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:19.689884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:19.720235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.720279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.720290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.720343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:19.720459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:19.720480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:19.720494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:19.720503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:19.720538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400390072701575:3287]
2025-10-15T10:55:19.720561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400390072701575:3287]
2025-10-15T10:55:19.720583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400390072701575:3287]
2025-10-15T10:55:19.720706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:19.720741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:19.720789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:19.720846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:19.720897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:19.723412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:19.726260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId: src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:19.748703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:19.866678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400387272996188:3423]
2025-10-15T10:55:19.866752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:19.866815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:19.864380Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:19.866827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:19.865895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:19.865950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:19.866894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:19.877224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:19.877291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0] Write session will restart in 0.006172s
2025-10-15T10:55:19.877487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0] Write session: Do CDS request
2025-10-15T10:55:19.877533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:19.876527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 95 reason: error at write: Disconnected sessionId: src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0
2025-10-15T10:55:19.876816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 95 sessionId: src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0 is DEAD
2025-10-15T10:55:19.897734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:19.899571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:19.899597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 96
2025-10-15T10:55:19.900763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:19.900874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 96 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:19.900893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=96 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:19.900902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:19.902001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 96 sessionId:  describe result for acl check
2025-10-15T10:55:19.902106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:19.902116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:19.902125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:19.902141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400387272996219:3445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:19.904308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400387272996219:3445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:19.919616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400387272996219:3445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:19.937339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400387272996219:3445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:19.937393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400387272996219:3445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:19.937413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400387272996219:3445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:19.937446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 96 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:19.967016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400387272996344:3423]
2025-10-15T10:55:19.970888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:19.974964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:19.975799Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:19.975816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:19.975859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:19.976095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:19.976267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400390072701739:3289]
2025-10-15T10:55:19.977770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:19.978637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:19.978771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:19.979553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:19.979764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.979769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.979773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.979777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.979782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.979786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.979790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.979795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.979799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.979803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.979807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.979811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.979815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.979819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.979849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.979922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.979964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.979995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.980024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.980066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.980094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.980120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.980149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.980179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.980207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.980235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.980263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.980291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.980314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.980354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:19.980387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.980419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:19.980447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.980479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:19.980508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.980552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:19.980588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.980620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:19.980648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.980676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:19.980703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.980732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:19.980756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.980786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:19.980812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.980844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:19.980883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.980917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:19.980944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.980975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:19.981000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.981032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:19.981057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.981087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:19.981108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.981135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:19.981405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:20.003190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:20.019635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:20.019679Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:20.019696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:20.019714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:20.019735Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 95 [2:7561400390072701739:3289]
2025-10-15T10:55:20.019782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:20.019833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:20.019849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.019859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.019870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.019912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:20.019932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:20.019953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:20.021227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.021244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.021258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.021268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:20.021538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:20.021557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.021694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.021886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.022125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:20.022187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400390072701732:3289]
2025-10-15T10:55:20.022201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400390072701732:3289]
2025-10-15T10:55:20.022213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400390072701732:3289]
2025-10-15T10:55:20.022254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:20.022323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:20.022515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:20.022541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:20.022646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400390072701732:3289]
2025-10-15T10:55:20.022666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:20.024658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 95
2025-10-15T10:55:20.024659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 95
2025-10-15T10:55:20.024750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 95, pipe: [1:7561400387272996344:3423]
2025-10-15T10:55:20.029234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 96 partition: 0 MaxSeqNo: 46 sessionId: src_id|63317520-a4a20f11-7efbbcc0-81a13040_0
2025-10-15T10:55:20.030070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296b3d9b-4519f012-47eb8b9b-1f324cb7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|63317520-a4a20f11-7efbbcc0-81a13040_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:20.023554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:20.023580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:20.023592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:20.023616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:20.025524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400387272996269:3445], now have 1 active actors on pipe
2025-10-15T10:55:20.025551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400387272996204:2467], now have 1 active actors on pipe
2025-10-15T10:55:20.025574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400387272996344:3423], now have 1 active actors on pipe
2025-10-15T10:55:20.025637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:20.025657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:20.025730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63317520-a4a20f11-7efbbcc0-81a13040_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:20.025760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.025795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.025807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:20.025840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.025880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:20.025924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:20.028595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:20.028616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:20.028675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:20.071398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63317520-a4a20f11-7efbbcc0-81a13040_0] Write session: try to update token
2025-10-15T10:55:20.071439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63317520-a4a20f11-7efbbcc0-81a13040_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:20.187516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.187547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.187556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.187603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:20.187614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:20.187625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:20.187634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:20.187661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400390072701732:3289]
2025-10-15T10:55:20.187681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400390072701732:3289]
2025-10-15T10:55:20.187702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400390072701732:3289]
2025-10-15T10:55:20.187886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:20.187905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:20.188045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:20.188073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:20.188097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:20.192367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:20.221057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId: src_id|63317520-a4a20f11-7efbbcc0-81a13040_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:20.264126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:20.369436Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:20.381969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:20.382011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:20.382072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:20.382083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:20.382114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400390072701732:3289]
2025-10-15T10:55:20.382521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:20.384248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:20.384268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:20.387988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:20.399331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:20.411983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63317520-a4a20f11-7efbbcc0-81a13040_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:20.412018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63317520-a4a20f11-7efbbcc0-81a13040_0] Write session will restart in 0.006102s
2025-10-15T10:55:20.412107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63317520-a4a20f11-7efbbcc0-81a13040_0] Write session: Do CDS request
2025-10-15T10:55:20.412133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63317520-a4a20f11-7efbbcc0-81a13040_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:20.407685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400387272996344:3423]
2025-10-15T10:55:20.407758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 96 reason: error at write: Disconnected sessionId: src_id|63317520-a4a20f11-7efbbcc0-81a13040_0
2025-10-15T10:55:20.408033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 96 sessionId: src_id|63317520-a4a20f11-7efbbcc0-81a13040_0 is DEAD
2025-10-15T10:55:20.429629Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:20.429655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 97
2025-10-15T10:55:20.430322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63317520-a4a20f11-7efbbcc0-81a13040_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:20.431571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:20.431677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 97 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:20.431691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=97 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:20.431699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:20.432983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 97 sessionId:  describe result for acl check
2025-10-15T10:55:20.433094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:20.433110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:20.433117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:20.433131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400391567963696:3457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:20.435319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400391567963696:3457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:20.459094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400391567963696:3457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:20.469078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400391567963696:3457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:20.469115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400391567963696:3457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:20.469130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400391567963696:3457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:20.469153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 97 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:20.475329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:20.477980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:20.478868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:20.478893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:20.478932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:20.479164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:20.479336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400394367669231:3299]
2025-10-15T10:55:20.481328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:20.482438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:20.482624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:20.483894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:20.484239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:20.484257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:20.484263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:20.484269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:20.484275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:20.484281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:20.484288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:20.484294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:20.484300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:20.484307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:20.484313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:20.484320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.484326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.484333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.484375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:20.484471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:20.484514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:20.484559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:20.484601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:20.484645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:20.484699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:20.484740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:20.484780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:20.484824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:20.484864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:20.484907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.484949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.484990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.485030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:20.485089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:20.485139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:20.485189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:20.485234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:20.485283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:20.485323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:20.485371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:20.485407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:20.485443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:20.485479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:20.485512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:20.485541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:20.485576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:20.485606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:20.485639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:20.485680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:20.485729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:20.485756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:20.485790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:20.485831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:20.485873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:20.485913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.485959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.486004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.486041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.486069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.486114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.486561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:20.507656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:20.511608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400391567963828:3423]
2025-10-15T10:55:20.519097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:20.519142Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:20.519155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:20.519171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:20.519190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 96 [2:7561400394367669231:3299]
2025-10-15T10:55:20.519236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:20.519283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:20.519296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.519306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.519316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.519374Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:20.519394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:20.519412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:20.520558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.520581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.520593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.520604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:20.520847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:20.520871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.520997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.521902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 96
2025-10-15T10:55:20.521968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 96, pipe: [1:7561400391567963828:3423]
2025-10-15T10:55:20.522044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 96
2025-10-15T10:55:20.521170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.521387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:20.521455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400391567963820:3457], now have 1 active actors on pipe
2025-10-15T10:55:20.521476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400391567963828:3423], now have 1 active actors on pipe
2025-10-15T10:55:20.521494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400391567963686:2467], now have 1 active actors on pipe
2025-10-15T10:55:20.521514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400394367669226:3299]
2025-10-15T10:55:20.521528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400394367669226:3299]
2025-10-15T10:55:20.521539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400394367669226:3299]
2025-10-15T10:55:20.521578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:20.521623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:20.521636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:20.521638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:20.521646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:20.521797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:20.521812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:20.521928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400394367669226:3299]
2025-10-15T10:55:20.521953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:20.521975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:20.522875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:20.522911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:20.522993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:20.523047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.523064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.523074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:20.523106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.523155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:20.523198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:20.524491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 97 partition: 0 MaxSeqNo: 46 sessionId: src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0
2025-10-15T10:55:20.525169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63317520-a4a20f11-7efbbcc0-81a13040_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:20.523974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:20.524001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:20.524163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:20.560622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0] Write session: try to update token
2025-10-15T10:55:20.560671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:20.574049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:20.574083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:20.574116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400394367669226:3299]
2025-10-15T10:55:20.574220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:20.574237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:20.576251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:20.582350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:20.583938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:20.585188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:20.586762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:20.587234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:20.619938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.620008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.620031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.668864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:20.668897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:20.668910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:20.668921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:20.668957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400394367669226:3299]
2025-10-15T10:55:20.668980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400394367669226:3299]
2025-10-15T10:55:20.669003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400394367669226:3299]
2025-10-15T10:55:20.669121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:20.669133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:20.669153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:20.669163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:20.669193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:20.670815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:20.680497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId: src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:20.702879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:20.818717Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:20.821262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400391567963828:3423]
2025-10-15T10:55:20.820498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:20.821345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:20.820539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:20.821450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:20.821460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:20.821198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:20.832917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:20.832987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0] Write session will restart in 0.005722s
2025-10-15T10:55:20.833164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0] Write session: Do CDS request
2025-10-15T10:55:20.833206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:20.831036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 97 reason: error at write: Disconnected sessionId: src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0
2025-10-15T10:55:20.831328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 97 sessionId: src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0 is DEAD
2025-10-15T10:55:20.846580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:20.846098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:20.846137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 98
2025-10-15T10:55:20.847126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:20.847269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 98 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:20.847285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=98 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:20.847295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:20.848702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 98 sessionId:  describe result for acl check
2025-10-15T10:55:20.848807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:20.848819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:20.848828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:20.848845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400391567963871:3464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:20.851908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400391567963871:3464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:20.860475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400391567963871:3464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:20.868270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400391567963871:3464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:20.868314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400391567963871:3464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:20.868332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400391567963871:3464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:20.868363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 98 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:20.902332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:20.904757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:20.905437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:20.905453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:20.905490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:20.905710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:20.905875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400394367669388:3308]
2025-10-15T10:55:20.907908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:20.909542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:20.909784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:20.911047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:20.911384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:20.911400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:20.911406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:20.911413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:20.911420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:20.911427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:20.911434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:20.911441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:20.911447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:20.911454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:20.911460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:20.911466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.911483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.911489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.911534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:20.911629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:20.911677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:20.911721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:20.911842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:20.911893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:20.911936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:20.911983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:20.912028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:20.912074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:20.912117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:20.912157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.912196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.912238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.912278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:20.912337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:20.912389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:20.912436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:20.912482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:20.912530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:20.912569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:20.912615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:20.912652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:20.912695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:20.912734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:20.912782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:20.912838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:20.912889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:20.912932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:20.912980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:20.913024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:20.913073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:20.913116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:20.913165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:20.913208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:20.913258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:20.913298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.913346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.913392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.913437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.913476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.913523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.913981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:20.922887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400391567964006:3423]
2025-10-15T10:55:20.934429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:20.945245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:20.947343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 97
2025-10-15T10:55:20.945292Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:20.945306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:20.947363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 97
2025-10-15T10:55:20.945323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:20.947436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 97, pipe: [1:7561400391567964006:3423]
2025-10-15T10:55:20.945343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 97 [2:7561400394367669388:3308]
2025-10-15T10:55:20.945383Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:20.945428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:20.945444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.945455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.945466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.945511Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:20.945531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:20.945550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:20.946670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.946685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.946699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.946710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:20.946963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:20.946979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:20.947116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:20.947289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:20.948113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:20.948201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400391567963907:3464], now have 1 active actors on pipe
2025-10-15T10:55:20.948222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400391567963855:2467], now have 1 active actors on pipe
2025-10-15T10:55:20.948243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400391567964006:3423], now have 1 active actors on pipe
2025-10-15T10:55:20.948283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:20.948302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:20.948351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400394367669383:3308]
2025-10-15T10:55:20.948364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400394367669383:3308]
2025-10-15T10:55:20.948375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400394367669383:3308]
2025-10-15T10:55:20.948414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:20.948480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:20.948483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:20.948511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:20.948525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:20.948649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:20.948667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:20.948724Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:20.948752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.948767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.948777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:20.948810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.948848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:20.948967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400394367669383:3308]
2025-10-15T10:55:20.948997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:20.949040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:20.949041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:20.949574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:20.949599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:20.949657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:20.950016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 98 partition: 0 MaxSeqNo: 46 sessionId: src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0
2025-10-15T10:55:20.950878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfc713b-2b4f0811-f35ebf02-2e4c49c1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:20.973755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0] Write session: try to update token
2025-10-15T10:55:20.973821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:21.072013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:21.072046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:21.072076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400394367669383:3308]
2025-10-15T10:55:21.072179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.072189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:21.072195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.072209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.072343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:21.083795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:21.084976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:21.086127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:21.087287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:21.089356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:21.144101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:21.144250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:21.144265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:21.144277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:21.144288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:21.144324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400394367669383:3308]
2025-10-15T10:55:21.144348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400394367669383:3308]
2025-10-15T10:55:21.144370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400394367669383:3308]
2025-10-15T10:55:21.144496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:21.144517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:21.145494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:21.147775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:21.147820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:21.147850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:21.166148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId: src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:21.208008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:21.295594Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:21.297194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:21.297236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:21.299237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:21.299566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400391567964006:3423]
2025-10-15T10:55:21.299720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:21.297911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:21.314733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 98 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0
2025-10-15T10:55:21.315211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 98 sessionId: src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0 is DEAD
2025-10-15T10:55:21.323388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:21.323422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0] Write session will restart in 0.009061s
2025-10-15T10:55:21.323514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0] Write session: Do CDS request
2025-10-15T10:55:21.343414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:21.356783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:21.356822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 99
2025-10-15T10:55:21.357496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:21.357992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:21.358129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 99 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:21.358152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=99 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:21.358163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:21.359927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 99 sessionId:  describe result for acl check
2025-10-15T10:55:21.360042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:21.360061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:21.360069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:21.360085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400395862931342:3470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:21.362602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400395862931342:3470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:21.375029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400395862931342:3470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:21.399478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400395862931387:3423]
2025-10-15T10:55:21.400246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400395862931342:3470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:21.400285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400395862931342:3470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:21.400301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400395862931342:3470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:21.400331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 99 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:21.454249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:21.462029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:21.462889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:21.462928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:21.462970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:21.463222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:21.463431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400398662636854:3312]
2025-10-15T10:55:21.465652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:21.466860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:21.467074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:21.468362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:21.468714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:21.468736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:21.468743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:21.468749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:21.468756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:21.468764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:21.468770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:21.468776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:21.468782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:21.468790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:21.468796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:21.468802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.468809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.468815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.468863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:21.468971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:21.469018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:21.469064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:21.469110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:21.469167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:21.469217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:21.469267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:21.469317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:21.469400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:21.469458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:21.469509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.469559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.469609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.469677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:21.469753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:21.469814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:21.469862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:21.469914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:21.469971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:21.470021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:21.470076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:21.470149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:21.470219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:21.470271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:21.470326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:21.470381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:21.470438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:21.470489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:21.470562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:21.470614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:21.470672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:21.470725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:21.470777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:21.470823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:21.470882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:21.470954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.471018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.471067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.471125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.471176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.471233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.471804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:21.490972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:21.501922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:21.501966Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:21.501979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:21.501996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:21.502017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 98 [2:7561400398662636854:3312]
2025-10-15T10:55:21.502060Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:21.502108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:21.502121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.502131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.502141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.502183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:21.502203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:21.502233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:21.503905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.503949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.503968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.503984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:21.504348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:21.504376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.504516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.504696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.505403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 98
2025-10-15T10:55:21.505506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 98
2025-10-15T10:55:21.505584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 98, pipe: [1:7561400395862931387:3423]
2025-10-15T10:55:21.505145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:21.505235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400395862931387:3423], now have 1 active actors on pipe
2025-10-15T10:55:21.505258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400395862931391:3470], now have 1 active actors on pipe
2025-10-15T10:55:21.505280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400395862931326:2467], now have 1 active actors on pipe
2025-10-15T10:55:21.505304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400398662636848:3312]
2025-10-15T10:55:21.505319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400398662636848:3312]
2025-10-15T10:55:21.505341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400398662636848:3312]
2025-10-15T10:55:21.505373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:21.505440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:21.505612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:21.505628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:21.505731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400398662636848:3312]
2025-10-15T10:55:21.505749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:21.506415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:21.506437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:21.506448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:21.506470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:21.506794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:21.506821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:21.506900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:21.506927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.506943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.506952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:21.506985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.507025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:21.507075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:21.508097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:21.508126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:21.508188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:21.512145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 99 partition: 0 MaxSeqNo: 46 sessionId: src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0
2025-10-15T10:55:21.515863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fdfe02-59f462a3-fca51934-e93b3a09_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:21.538764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0] Write session: try to update token
2025-10-15T10:55:21.538813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:21.625540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:21.625575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:21.625587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:21.625597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:21.625628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400398662636848:3312]
2025-10-15T10:55:21.625659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400398662636848:3312]
2025-10-15T10:55:21.625683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400398662636848:3312]
2025-10-15T10:55:21.625850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:21.625883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.625894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.625904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.625912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:21.625943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:21.625943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:21.625960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:21.629238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:21.653281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId: src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:21.678031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:21.769551Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:21.781972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:21.783325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:21.782025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:21.782125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:21.782137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:21.782173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400398662636848:3312]
2025-10-15T10:55:21.782408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:21.782732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:21.783495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400395862931387:3423]
2025-10-15T10:55:21.783577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:21.783589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:21.824486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:21.823748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 99 reason: error at write: Disconnected sessionId: src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0
2025-10-15T10:55:21.824531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0] Write session will restart in 0.007781s
2025-10-15T10:55:21.824031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 99 sessionId: src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0 is DEAD
2025-10-15T10:55:21.824626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0] Write session: Do CDS request
2025-10-15T10:55:21.824657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:21.836605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:21.865214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:21.865246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 100
2025-10-15T10:55:21.866331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:21.865819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:21.865937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:21.865951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:21.865959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:21.867254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 100 sessionId:  describe result for acl check
2025-10-15T10:55:21.867381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:21.867397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:21.867412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:21.867427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400395862931619:3480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:21.869787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400395862931619:3480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:21.869802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:21.870755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:21.870772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:21.870817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:21.871087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:21.871286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400398662637021:3320]
2025-10-15T10:55:21.873930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:21.876598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400395862931619:3480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:21.875010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:21.875245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:21.876586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:21.877061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:21.877070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:21.877077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:21.877084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:21.877090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:21.877097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:21.877103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:21.877109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:21.877115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:21.877128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:21.877137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:21.877143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.877150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.877162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.877210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:21.877313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:21.877358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:21.877404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:21.877450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:21.877493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:21.877538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:21.877580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:21.877620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:21.877667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:21.877708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:21.879447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.879514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.879557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.879609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:21.879676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:21.879748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:21.879812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:21.879864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:21.879920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:21.879967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:21.880023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:21.880076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:21.880133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:21.880190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:21.880253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:21.880303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:21.880359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:21.880406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:21.880466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:21.880515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:21.880570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:21.880616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:21.880678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:21.880733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:21.880789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:21.880830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.880879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.880927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.880982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.881031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.881088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.881542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:21.883978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400395862931649:3423]
2025-10-15T10:55:21.892067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400395862931619:3480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:21.892114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400395862931619:3480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:21.892143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400395862931619:3480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:21.892174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:21.908183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:21.918824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:21.918867Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:21.918883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:21.918916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:21.918940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 99 [2:7561400398662637021:3320]
2025-10-15T10:55:21.918985Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:21.919035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:21.919048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.919058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.919068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.919110Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:21.919131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:21.919150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:21.921015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.921041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.921053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.921063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:21.921275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:21.921298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:21.921403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:21.921591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:21.921791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 99
2025-10-15T10:55:21.921849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:21.921897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 99
2025-10-15T10:55:21.921924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400395862931501:2467], now have 1 active actors on pipe
2025-10-15T10:55:21.921964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 99, pipe: [1:7561400395862931649:3423]
2025-10-15T10:55:21.921961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400395862931649:3423], now have 1 active actors on pipe
2025-10-15T10:55:21.921990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400395862931654:3480], now have 1 active actors on pipe
2025-10-15T10:55:21.922013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400398662637016:3320]
2025-10-15T10:55:21.922026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400398662637016:3320]
2025-10-15T10:55:21.922037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400398662637016:3320]
2025-10-15T10:55:21.922067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:21.922096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:21.922111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:21.922122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:21.922152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:21.922332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:21.922355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:21.922406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:21.922428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:21.922544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400398662637016:3320]
2025-10-15T10:55:21.922575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:21.922617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:21.922641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:21.922666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.922680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.922689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:21.922720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.922758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:21.922880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:21.923377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:21.923406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:21.923478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:21.924213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 100 partition: 0 MaxSeqNo: 46 sessionId: src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0
2025-10-15T10:55:21.925040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ecc6248-73ac8e1d-a3b9e752-c440f4a3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:21.946802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0] Write session: try to update token
2025-10-15T10:55:21.946853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:21.956475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:21.956512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:21.956544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400398662637016:3320]
2025-10-15T10:55:21.956660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:21.958378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:21.958918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:21.960531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:21.967841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:21.973107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:21.975053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:21.975467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:22.021727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.021764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.021774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.100329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:22.100373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:22.100388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:22.100400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:22.100446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400398662637016:3320]
2025-10-15T10:55:22.100485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400398662637016:3320]
2025-10-15T10:55:22.100510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400398662637016:3320]
2025-10-15T10:55:22.100664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:22.100680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:22.100706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:22.100716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:22.100746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:22.102167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:22.114657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId: src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:22.136580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:22.248164Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:22.249466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:22.249502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:22.250140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:22.250185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:22.250189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400395862931649:3423]
2025-10-15T10:55:22.250302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:22.250327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:22.304146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:22.308614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:22.310210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:22.310268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:22.310341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:22.310891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:22.311226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400402957604509:3331]
2025-10-15T10:55:22.313049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 100 reason: error at write: Disconnected sessionId: src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0
2025-10-15T10:55:22.313398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 100 sessionId: src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0 is DEAD
2025-10-15T10:55:22.313896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:22.313961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0] Write session will restart in 0.008527s
2025-10-15T10:55:22.314124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0] Write session: Do CDS request
2025-10-15T10:55:22.314165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:22.315786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:22.317870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:22.318531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:22.320586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:22.320946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:22.320962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:22.320973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:22.320980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:22.320987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:22.320993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:22.321000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:22.321007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:22.321014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:22.321021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:22.321027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:22.321034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.321040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.321047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.321092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:22.321191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:22.321239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:22.321287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:22.321334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:22.321388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:22.321434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:22.321484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:22.321530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:22.321575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:22.321620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:22.321664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.321706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.321761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.321801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:22.321866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:22.321926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:22.321997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:22.322054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:22.322107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:22.322156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:22.322204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:22.322257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:22.322314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:22.322364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:22.322417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:22.322466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:22.322535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:22.322586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:22.322644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:22.322694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:22.322752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:22.322802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:22.322861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:22.322915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:22.322966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:22.323028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.323088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.323136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.323195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.323243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.323309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.323836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:22.327162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:22.327195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 101
2025-10-15T10:55:22.327322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:22.327910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:22.328060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:22.328085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:22.328096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:22.329485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 101 sessionId:  describe result for acl check
2025-10-15T10:55:22.329594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:22.329612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:22.329623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:22.329640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400400157899113:3489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:22.332187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400400157899113:3489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:22.343156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400400157899113:3489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:22.346707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:22.350455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400400157899139:3423]
2025-10-15T10:55:22.351888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400400157899113:3489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:22.351939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400400157899113:3489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:22.351968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400400157899113:3489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:22.352003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:22.356711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:22.356749Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:22.356760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:22.356775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:22.356799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 100 [2:7561400402957604509:3331]
2025-10-15T10:55:22.356852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:22.356916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:22.356932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.356946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.356959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.357011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:22.357044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:22.357068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:22.358091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.358110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.358119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.358127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:22.358327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:22.358346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.358447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.358592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.358710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 100
2025-10-15T10:55:22.358779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 100, pipe: [1:7561400400157899139:3423]
2025-10-15T10:55:22.358809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 100
2025-10-15T10:55:22.359032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:22.359105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400400157899143:3489], now have 1 active actors on pipe
2025-10-15T10:55:22.359135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400400157899139:3423], now have 1 active actors on pipe
2025-10-15T10:55:22.359164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400400157898992:2467], now have 1 active actors on pipe
2025-10-15T10:55:22.359215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:22.359243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:22.359299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400402957604503:3331]
2025-10-15T10:55:22.359321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400402957604503:3331]
2025-10-15T10:55:22.359334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400402957604503:3331]
2025-10-15T10:55:22.359393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:22.359417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:22.359437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:22.359445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:22.359473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:22.359661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:22.359697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:22.359763Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6698302-f8e833-9831a46f-157e1967_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:22.359829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.359859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.359871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:22.359909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.359967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:22.360120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400402957604503:3331]
2025-10-15T10:55:22.360157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:22.360182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:22.360214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:22.360679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:22.360714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:22.360803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:22.361118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 101 partition: 0 MaxSeqNo: 46 sessionId: src_id|a6698302-f8e833-9831a46f-157e1967_0
2025-10-15T10:55:22.361771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d9f216-e5bb6075-e4a67ec7-d0a69926_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a6698302-f8e833-9831a46f-157e1967_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:22.385081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6698302-f8e833-9831a46f-157e1967_0] Write session: try to update token
2025-10-15T10:55:22.385133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6698302-f8e833-9831a46f-157e1967_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:22.420660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:22.420695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:22.420727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400402957604503:3331]
2025-10-15T10:55:22.420851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:22.422033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:22.422934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:22.424758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:22.427654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:22.430742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:22.436002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:22.436557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:22.470416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.470453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.470465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.470526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:22.470540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:22.470552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:22.470562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:22.470596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400402957604503:3331]
2025-10-15T10:55:22.470620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400402957604503:3331]
2025-10-15T10:55:22.470644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400402957604503:3331]
2025-10-15T10:55:22.470748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:22.470773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:22.470790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:22.470792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:22.470816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:22.473133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:22.490844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId: src_id|a6698302-f8e833-9831a46f-157e1967_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:22.515253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:22.617586Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:22.619031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:22.619068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:22.619775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:22.619815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:22.619827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:22.619968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400400157899139:3423]
2025-10-15T10:55:22.619684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:22.629823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 101 reason: error at write: Disconnected sessionId: src_id|a6698302-f8e833-9831a46f-157e1967_0
2025-10-15T10:55:22.630162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 101 sessionId: src_id|a6698302-f8e833-9831a46f-157e1967_0 is DEAD
2025-10-15T10:55:22.630443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6698302-f8e833-9831a46f-157e1967_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:22.630483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6698302-f8e833-9831a46f-157e1967_0] Write session will restart in 0.009430s
2025-10-15T10:55:22.630620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6698302-f8e833-9831a46f-157e1967_0] Write session: Do CDS request
2025-10-15T10:55:22.630665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6698302-f8e833-9831a46f-157e1967_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:22.644693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6698302-f8e833-9831a46f-157e1967_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:22.645899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:22.645933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 102
2025-10-15T10:55:22.646190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:22.646293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:22.646314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:22.646322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:22.647557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 102 sessionId:  describe result for acl check
2025-10-15T10:55:22.647665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:22.647682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:22.647690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:22.647710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400400157899168:3493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:22.651865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400400157899168:3493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:22.659764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400400157899168:3493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:22.676201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400400157899168:3493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:22.676239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400400157899168:3493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:22.676255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400400157899168:3493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:22.676285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:22.695617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:22.697859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:22.698745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:22.698772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:22.698812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:22.699036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:22.699201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400402957604667:3333]
2025-10-15T10:55:22.701316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:22.702189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:22.702374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:22.703636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:22.703936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:22.703953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:22.703959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:22.703966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:22.703972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:22.703978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:22.703983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:22.703988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:22.703994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:22.704000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:22.704005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:22.704012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.704018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.704024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.704063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:22.704153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:22.704194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:22.704234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:22.704273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:22.704313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:22.704359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:22.704406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:22.704446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:22.704488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:22.704534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:22.704583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.704628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.704670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.704714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:22.704769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:22.704823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:22.704871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:22.704916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:22.704970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:22.705011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:22.705059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:22.705109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:22.705161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:22.705209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:22.705263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:22.705307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:22.705358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:22.705403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:22.705457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:22.705504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:22.705555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:22.705601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:22.705653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:22.705702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:22.705752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:22.705799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.705850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.705896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.705948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.705993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.706040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.706501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:22.720098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400400157899304:3423]
2025-10-15T10:55:22.731142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:22.740494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:22.740547Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:22.740563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:22.740580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:22.740602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 101 [2:7561400402957604667:3333]
2025-10-15T10:55:22.740652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:22.740708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:22.740722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.740733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.740744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.740816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:22.740838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:22.740857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:22.741931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.741957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.741970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.741980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:22.742227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:22.742243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:22.742374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:22.742564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:22.742488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 101
2025-10-15T10:55:22.742578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 101, pipe: [1:7561400400157899304:3423]
2025-10-15T10:55:22.742653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 101
2025-10-15T10:55:22.742792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:22.742872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400400157899208:3493], now have 1 active actors on pipe
2025-10-15T10:55:22.742902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400400157899304:3423], now have 1 active actors on pipe
2025-10-15T10:55:22.742924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400400157899153:2467], now have 1 active actors on pipe
2025-10-15T10:55:22.742946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400402957604661:3333]
2025-10-15T10:55:22.742960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400402957604661:3333]
2025-10-15T10:55:22.742972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400402957604661:3333]
2025-10-15T10:55:22.743007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:22.743071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:22.743239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:22.743262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:22.743327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:22.743395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:22.743407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:22.743418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:22.743465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:22.743591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400402957604661:3333]
2025-10-15T10:55:22.743613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:22.743681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:22.743707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.743723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.743733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:22.743764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.743796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:22.743915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:22.743928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:22.744417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:22.744440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:22.744517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:22.744792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 102 partition: 0 MaxSeqNo: 46 sessionId: src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0
2025-10-15T10:55:22.745449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6698302-f8e833-9831a46f-157e1967_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:22.768480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0] Write session: try to update token
2025-10-15T10:55:22.768542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:22.814988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:22.815017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:22.815050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400402957604661:3333]
2025-10-15T10:55:22.815154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:22.816835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:22.817968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:22.819112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:22.819476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:22.820533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:22.822256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:22.822694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:22.843539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.843571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.843586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.879821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:22.879858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:22.879871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:22.879882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:22.879918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400402957604661:3333]
2025-10-15T10:55:22.879943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400402957604661:3333]
2025-10-15T10:55:22.879963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400402957604661:3333]
2025-10-15T10:55:22.880080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:22.880087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:22.880106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:22.880122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:22.880157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:22.881150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:22.905283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId: src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:22.927508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:23.018882Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:23.020916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:23.020959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:23.021662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:23.021695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:23.021795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400400157899304:3423]
2025-10-15T10:55:23.021916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:23.022138Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:23.042972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 102 reason: error at write: Disconnected sessionId: src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0
2025-10-15T10:55:23.043707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:23.043801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0] Write session will restart in 0.006144s
2025-10-15T10:55:23.044019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0] Write session: Do CDS request
2025-10-15T10:55:23.044095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:23.043331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 102 sessionId: src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0 is DEAD
2025-10-15T10:55:23.054772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:23.054154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:23.054181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 103
2025-10-15T10:55:23.055320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:23.055720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:23.055768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:23.055793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:23.057431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 103 sessionId:  describe result for acl check
2025-10-15T10:55:23.057562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:23.057573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:23.057582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:23.057598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400404452866648:3499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:23.059970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400404452866648:3499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:23.077298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400404452866648:3499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:23.094943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400404452866648:3499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:23.094985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400404452866648:3499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:23.095001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400404452866648:3499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:23.095029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:23.117989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:23.120038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:23.120833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:23.120884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:23.120936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:23.121170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:23.121388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400407252572147:3338]
2025-10-15T10:55:23.122192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400404452866778:3423]
2025-10-15T10:55:23.124242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:23.127860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:23.128093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:23.129355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:23.129673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.129692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.129699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.129704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.129710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.129716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.129723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.129729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.129734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.129740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.129746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.129752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.129758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.129764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.129805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.129922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.129967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.130010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.130051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.130094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.130134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.130179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.130222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.130265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.130306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.130367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.130407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.130446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.130493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.130569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.130624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.130681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.130733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.130789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.131013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.131086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.131149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.131205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.131254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.131320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.131386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.131442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.131486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.131538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.131582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.131632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.131671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.131717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.131758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.131805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.131846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.131893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.131935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.131981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.132022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.132069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.132520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:23.148604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:23.162454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:23.162498Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:23.162514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:23.162542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:23.162564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 102 [2:7561400407252572147:3338]
2025-10-15T10:55:23.162609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:23.162659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:23.162672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.162682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.162691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.162731Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:23.162751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:23.162768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:23.165487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 102, pipe: [1:7561400404452866778:3423]
2025-10-15T10:55:23.165522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 102
2025-10-15T10:55:23.165586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 102
2025-10-15T10:55:23.164824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.164852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.164865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.164876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:23.165152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:23.165169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.165295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.165462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.165662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:23.165747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400404452866778:3423], now have 1 active actors on pipe
2025-10-15T10:55:23.165768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400404452866719:3499], now have 1 active actors on pipe
2025-10-15T10:55:23.165789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400404452866629:2467], now have 1 active actors on pipe
2025-10-15T10:55:23.165810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400407252572142:3338]
2025-10-15T10:55:23.165822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400407252572142:3338]
2025-10-15T10:55:23.165833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400407252572142:3338]
2025-10-15T10:55:23.165868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:23.165919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:23.165934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:23.165944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:23.165944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:23.166092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:23.166106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:23.166232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:23.166251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:23.166291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400407252572142:3338]
2025-10-15T10:55:23.166319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:23.166338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:23.166428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d8a76b2-5ded41bb-df55c551-60020816_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:23.166456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.166470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.166479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:23.166509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.166558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:23.166667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:23.167294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:23.167316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:23.167394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:23.167713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 103 partition: 0 MaxSeqNo: 46 sessionId: src_id|4d8a76b2-5ded41bb-df55c551-60020816_0
2025-10-15T10:55:23.168386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e08331f3-34d8fc0b-871a81d-91f70d22_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4d8a76b2-5ded41bb-df55c551-60020816_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:23.190196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a76b2-5ded41bb-df55c551-60020816_0] Write session: try to update token
2025-10-15T10:55:23.190245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a76b2-5ded41bb-df55c551-60020816_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:23.260335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:23.260365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:23.260376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:23.260384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:23.260411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400407252572142:3338]
2025-10-15T10:55:23.260433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400407252572142:3338]
2025-10-15T10:55:23.260452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400407252572142:3338]
2025-10-15T10:55:23.260591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.260607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.260617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.263459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:23.263509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:23.263533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:23.275939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:23.275987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:23.276769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:23.311435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId: src_id|4d8a76b2-5ded41bb-df55c551-60020816_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:23.348632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:23.434090Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:23.436512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:23.436540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:23.436580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400407252572142:3338]
2025-10-15T10:55:23.436705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:23.436738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:23.436865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:23.437542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:23.437611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400404452866778:3423]
2025-10-15T10:55:23.437693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:23.437703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:23.450886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a76b2-5ded41bb-df55c551-60020816_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:23.450980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a76b2-5ded41bb-df55c551-60020816_0] Write session will restart in 0.006340s
2025-10-15T10:55:23.451160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a76b2-5ded41bb-df55c551-60020816_0] Write session: Do CDS request
2025-10-15T10:55:23.451209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a76b2-5ded41bb-df55c551-60020816_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:23.448614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:23.448746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 103 reason: error at write: Disconnected sessionId: src_id|4d8a76b2-5ded41bb-df55c551-60020816_0
2025-10-15T10:55:23.449011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 103 sessionId: src_id|4d8a76b2-5ded41bb-df55c551-60020816_0 is DEAD
2025-10-15T10:55:23.468058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a76b2-5ded41bb-df55c551-60020816_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:23.484555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:23.484585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 104
2025-10-15T10:55:23.485112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:23.485268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:23.485287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:23.485299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:23.487470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 104 sessionId:  describe result for acl check
2025-10-15T10:55:23.487599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:23.487626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:23.487635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:23.487654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400404452866816:3509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:23.492341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400404452866816:3509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:23.503990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400404452866816:3509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:23.538093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400404452866816:3509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:23.538133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400404452866816:3509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:23.538161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400404452866816:3509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:23.538189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:23.538518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400404452866938:3423]
2025-10-15T10:55:23.545609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:23.548386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:23.549250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:23.549283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:23.549331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:23.549614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:23.549841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400407252572323:3345]
2025-10-15T10:55:23.552300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:23.553247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:23.553469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:23.554761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:23.555110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.555118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.555125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.555132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.555139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.555146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.555153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.555158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.555164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.555170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.555178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.555184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.555190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.555197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.555241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.555340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.555407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.555447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.555488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.555529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.555569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.555613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.555655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.555700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.555743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.555786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.555829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.555870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.555911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.555975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.556028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.556080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.556125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.556171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.556211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.556257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.556296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.556343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.556381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.557359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.557429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.557481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.557530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.557582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.557633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.557682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.557728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.557780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.557827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.557874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.557917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.557966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.558012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.558061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.558108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.558165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.558638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:23.578139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:23.588722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:23.588777Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:23.588794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:23.588816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:23.588845Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 103 [2:7561400407252572323:3345]
2025-10-15T10:55:23.588899Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:23.588963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:23.588980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.588993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.589005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.589057Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:23.589080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:23.589104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:23.590895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.590911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.590925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.590936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:23.591204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:23.591222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.591574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 103
2025-10-15T10:55:23.591693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 103
2025-10-15T10:55:23.591748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 103, pipe: [1:7561400404452866938:3423]
2025-10-15T10:55:23.591833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.592088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.592309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:23.592402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400404452866806:2467], now have 1 active actors on pipe
2025-10-15T10:55:23.592436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400404452866937:3509], now have 1 active actors on pipe
2025-10-15T10:55:23.592454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400404452866938:3423], now have 1 active actors on pipe
2025-10-15T10:55:23.592518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:23.592539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:23.592575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400407252572317:3345]
2025-10-15T10:55:23.592596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400407252572317:3345]
2025-10-15T10:55:23.592608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400407252572317:3345]
2025-10-15T10:55:23.592654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:23.592692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:23.592712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:23.592725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:23.592726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:23.592926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:23.592943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:23.593008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:23.593037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.593058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.593071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:23.593107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.593149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:23.593265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400407252572317:3345]
2025-10-15T10:55:23.593294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:23.593323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:23.593337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:23.593975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:23.594005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:23.594063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:23.594383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 104 partition: 0 MaxSeqNo: 46 sessionId: src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0
2025-10-15T10:55:23.595166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8a76b2-5ded41bb-df55c551-60020816_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:23.629211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0] Write session: try to update token
2025-10-15T10:55:23.629260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:23.645363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:23.645402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:23.645432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400407252572317:3345]
2025-10-15T10:55:23.645539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:23.645544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:23.647474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:23.648857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:23.650387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:23.652017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:23.653896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:23.654387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:23.712946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.712977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.712987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.713036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:23.713049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:23.713061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:23.713072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:23.713110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400407252572317:3345]
2025-10-15T10:55:23.713135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400407252572317:3345]
2025-10-15T10:55:23.713157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400407252572317:3345]
2025-10-15T10:55:23.713263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:23.713285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:23.713304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:23.713323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:23.713357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:23.714423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:23.742651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId: src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:23.765493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:23.854383Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:23.855995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:23.856042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:23.856674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:23.856783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:23.856806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:23.856841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400404452866938:3423]
2025-10-15T10:55:23.857106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:23.866165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 104 reason: error at write: Disconnected sessionId: src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0
2025-10-15T10:55:23.866821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:23.866854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0] Write session will restart in 0.008453s
2025-10-15T10:55:23.866942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0] Write session: Do CDS request
2025-10-15T10:55:23.866968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:23.866972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 104 sessionId: src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0 is DEAD
2025-10-15T10:55:23.884764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:23.884800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 105
2025-10-15T10:55:23.884979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:23.887246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:23.887383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:23.887395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:23.887404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:23.888499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 105 sessionId:  describe result for acl check
2025-10-15T10:55:23.888599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:23.888615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:23.888622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:23.888635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400404452867003:3516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:23.891942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400404452867003:3516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:23.901075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400404452867003:3516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:23.925055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400404452867003:3516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:23.925090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400404452867003:3516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:23.925510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400404452867003:3516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:23.925548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:23.941428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:23.946147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:23.947205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:23.947239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:23.947282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:23.947564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:23.947760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400407252572488:3354]
2025-10-15T10:55:23.949737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:23.950568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:23.950797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:23.951963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:23.952293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.952301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.952307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.952314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.952320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.952326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.952332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.952339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.952345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.952352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.952358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.952365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.952371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.952379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.952422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.952526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.952571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.952613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.952655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.952699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.952742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.952801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.952856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.952899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.952944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.952985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.953028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.953072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.953128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.953196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:23.953270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.953332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:23.953385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.953440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:23.953479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.953529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:23.953565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.953607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:23.953651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.953687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:23.953727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.953770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:23.953810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.953862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:23.953905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.953965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:23.954017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.954064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:23.954115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.954168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:23.954218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.954276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.954327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.954381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.954426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.954478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.957770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400404452867142:3423]
2025-10-15T10:55:23.956249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:23.978280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:23.988924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:23.988966Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:23.988979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:23.988995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:23.989017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 104 [2:7561400407252572488:3354]
2025-10-15T10:55:23.989067Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:23.989117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:23.989135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.989149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.989159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.989201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:23.989221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:23.989240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:23.991075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.991105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.991119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.991129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:23.991630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:23.991655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:23.991783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:23.991947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:23.992102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:23.992170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400404452867086:3516], now have 1 active actors on pipe
2025-10-15T10:55:23.992190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400404452866987:2467], now have 1 active actors on pipe
2025-10-15T10:55:23.992209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400404452867142:3423], now have 1 active actors on pipe
2025-10-15T10:55:23.992231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400407252572483:3354]
2025-10-15T10:55:23.992245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400407252572483:3354]
2025-10-15T10:55:23.992258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400407252572483:3354]
2025-10-15T10:55:23.992289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:23.992348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:23.992487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:23.992837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 104
2025-10-15T10:55:23.992502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:23.992917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 104
2025-10-15T10:55:23.992976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 104, pipe: [1:7561400404452867142:3423]
2025-10-15T10:55:23.992619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400407252572483:3354]
2025-10-15T10:55:23.992633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:23.994214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:23.994235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:23.994242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:23.994260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:23.994553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:23.994579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:23.994674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:23.994701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.994716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.994726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:23.994760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.994795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:23.994839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:23.998322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 105 partition: 0 MaxSeqNo: 46 sessionId: src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0
2025-10-15T10:55:23.997962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:23.997993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:23.998060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:23.999506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43fee81e-fc1a301c-797431b1-ea6054d2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:24.039009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0] Write session: try to update token
2025-10-15T10:55:24.039068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:24.166721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:24.166754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:24.166766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:24.166776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:24.166808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400407252572483:3354]
2025-10-15T10:55:24.166832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400407252572483:3354]
2025-10-15T10:55:24.166854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400407252572483:3354]
2025-10-15T10:55:24.167048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.167069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.167078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.167117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:24.167134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:24.167859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:24.167901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:24.167926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:24.168900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:24.201207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId: src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:24.229113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1015 10:55:24.296981881  821272 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:55:24.303570Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:55:24.314258Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:24.336722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:24.336770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:24.336834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:24.336846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:24.336885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400407252572483:3354]
2025-10-15T10:55:24.337132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:24.337498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:24.340089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400404452867142:3423]
2025-10-15T10:55:24.340277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:24.343666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:24.348337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 105 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0
2025-10-15T10:55:24.348621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 105 sessionId: src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0 is DEAD
2025-10-15T10:55:24.351776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:24.351828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0] Write session will restart in 0.007505s
2025-10-15T10:55:24.351971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0] Write session: Do CDS request
2025-10-15T10:55:24.352010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:24.374689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:24.374723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 106
2025-10-15T10:55:24.375867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:24.376420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:24.376562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:24.376579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:24.376589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:24.379105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 106 sessionId:  describe result for acl check
2025-10-15T10:55:24.379224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:24.379234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:24.379243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:24.379259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400408747834475:3524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:24.381905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400408747834475:3524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:24.387954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400408747834475:3524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:24.423491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400408747834475:3524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:24.423531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400408747834475:3524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:24.423548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400408747834475:3524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:24.423578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:24.443458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400408747834563:3423]
2025-10-15T10:55:24.497384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:24.500725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:24.501628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:24.501650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:24.501691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:24.501952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:24.502134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400411547539959:3358]
2025-10-15T10:55:24.504360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:24.510688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:24.510998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:24.512436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:24.512821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:24.512830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:24.512837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:24.512844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:24.512853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:24.512860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:24.512868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:24.512874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:24.512881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:24.512890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:24.512899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:24.512905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:24.512912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:24.512918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:24.512970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:24.513089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:24.513139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:24.513190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:24.513234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:24.513280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:24.513324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:24.513367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:24.513414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:24.513458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:24.513506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:24.513552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:24.513601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:24.513649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:24.513697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:24.513770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:24.513833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:24.513892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:24.513943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:24.513994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:24.514040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:24.514096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:24.514141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:24.514191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:24.514233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:24.514284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:24.514327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:24.514384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:24.514432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:24.514490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:24.514558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:24.514620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:24.514669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:24.514724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:24.514772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:24.514828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:24.514872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:24.516169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:24.516259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:24.516329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:24.516381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:24.516441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:24.516973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:24.537815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:24.549380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:24.549425Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:24.549437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:24.549453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:24.549474Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 105 [2:7561400411547539959:3358]
2025-10-15T10:55:24.549517Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:24.549566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:24.558533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.558589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.558601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.558660Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:24.558683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:24.558701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:24.562073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 105
2025-10-15T10:55:24.562074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 105
2025-10-15T10:55:24.560154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:24.560182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:24.560195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:24.560205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:24.560453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:24.560468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:24.560610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:24.563539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 105, pipe: [1:7561400408747834563:3423]
2025-10-15T10:55:24.560787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:24.561001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:24.561060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400411547539953:3358]
2025-10-15T10:55:24.561073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400411547539953:3358]
2025-10-15T10:55:24.561083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400411547539953:3358]
2025-10-15T10:55:24.561123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:24.561188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:24.561349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:24.561363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:24.561473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400411547539953:3358]
2025-10-15T10:55:24.561490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:24.561860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:24.561878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:24.561891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:24.561935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:24.563022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400408747834468:2467], now have 1 active actors on pipe
2025-10-15T10:55:24.563053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400408747834528:3524], now have 1 active actors on pipe
2025-10-15T10:55:24.563118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:24.563137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:24.563170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400408747834563:3423], now have 1 active actors on pipe
2025-10-15T10:55:24.563228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:24.563256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.563272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.563282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:24.563314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.563371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:24.563414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:24.567843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:24.567885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:24.567956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:24.568296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 106 partition: 0 MaxSeqNo: 46 sessionId: src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0
2025-10-15T10:55:24.569554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99729a9-3db0bed-7e4034fd-c395ebdb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:24.603220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0] Write session: try to update token
2025-10-15T10:55:24.603282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:24.786772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId: src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:24.824587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:24.833084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.833129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.833141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.833203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:24.833217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:24.833231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:24.833241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:24.833275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400411547539953:3358]
2025-10-15T10:55:24.833301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400411547539953:3358]
2025-10-15T10:55:24.833323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400411547539953:3358]
2025-10-15T10:55:24.833433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:24.833479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:24.833498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:24.833561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:24.833595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:24.833632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:24.833661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:24.834627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:24.978545Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:24.998975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:24.999010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:24.999052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400411547539953:3358]
2025-10-15T10:55:24.999311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:24.999998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:25.003636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400408747834563:3423]
2025-10-15T10:55:25.003788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:25.004002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:25.026136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 106 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0
2025-10-15T10:55:25.026485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 106 sessionId: src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0 is DEAD
2025-10-15T10:55:25.028512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:25.028563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0] Write session will restart in 0.006881s
2025-10-15T10:55:25.028659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0] Write session: Do CDS request
2025-10-15T10:55:25.028687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:25.049185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:25.055415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:25.055449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 107
2025-10-15T10:55:25.055984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:25.056505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:25.056533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:25.056545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:25.060701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 107 sessionId:  describe result for acl check
2025-10-15T10:55:25.060815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:25.060825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:25.060834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:25.060852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400413042801973:3534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:25.064440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400413042801973:3534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:25.072009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400413042801973:3534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:25.084081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400413042801973:3534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:25.084129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400413042801973:3534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:25.084147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400413042801973:3534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:25.084176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:25.101362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400413042802080:3423]
2025-10-15T10:55:25.119935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:25.123029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:25.123715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:25.123737Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:25.123768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:25.124070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:25.124250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400415842507460:3367]
2025-10-15T10:55:25.126478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:25.127707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:25.127923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:25.129162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:25.129488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:25.129505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:25.129509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:25.129514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:25.129519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:25.129524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:25.129531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:25.129536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:25.129542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:25.129552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:25.129560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:25.129566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.129570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.129576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.129621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:25.129735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:25.129800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:25.129846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:25.129908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:25.129953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:25.130004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:25.130051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:25.130099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:25.130142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:25.130192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:25.130241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.130290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.130336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.130382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:25.130470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:25.130534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:25.130601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:25.130651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:25.130729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:25.130780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:25.130829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:25.130878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:25.130931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:25.130989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:25.131047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:25.131093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:25.131145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:25.131190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:25.131241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:25.131286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:25.131374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:25.131438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:25.131497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:25.131543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:25.131601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:25.131660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.131720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.131771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.131827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.131866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.131924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.132395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:25.153455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:25.164086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:25.164135Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:25.164164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:25.164186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:25.164207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 106 [2:7561400415842507460:3367]
2025-10-15T10:55:25.164250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:25.164298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:25.164312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.164323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.164332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.164372Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:25.164390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:25.164407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:25.193990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.194024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.194034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.194043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:25.194317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:25.194332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.194448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.194614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.194807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:25.194865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400415842507454:3367]
2025-10-15T10:55:25.194878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400415842507454:3367]
2025-10-15T10:55:25.194890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400415842507454:3367]
2025-10-15T10:55:25.194927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:25.194990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:25.195147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:25.195160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:25.195256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400415842507454:3367]
2025-10-15T10:55:25.195270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:25.195922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:25.195943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:25.195954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:25.195975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:25.196940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400413042802080:3423], now have 1 active actors on pipe
2025-10-15T10:55:25.196970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400413042801955:2467], now have 1 active actors on pipe
2025-10-15T10:55:25.196988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400413042802012:3534], now have 1 active actors on pipe
2025-10-15T10:55:25.198942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 106, pipe: [1:7561400413042802080:3423]
2025-10-15T10:55:25.199084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 106
2025-10-15T10:55:25.199187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 106
2025-10-15T10:55:25.199451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:25.199485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:25.199555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:25.199583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.199598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.199608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:25.199640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.199678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:25.199715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:25.204741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:25.204780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:25.204856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:25.205348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 107 partition: 0 MaxSeqNo: 46 sessionId: src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0
2025-10-15T10:55:25.206225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f90e0ba-3a0df605-9a9f5f73-9ba482bd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:25.246252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0] Write session: try to update token
2025-10-15T10:55:25.246319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:25.295517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.295551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.295563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.295620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:25.295634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:25.295650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:25.295672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:25.295707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400415842507454:3367]
2025-10-15T10:55:25.295738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400415842507454:3367]
2025-10-15T10:55:25.295764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400415842507454:3367]
2025-10-15T10:55:25.295864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:25.295905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:25.295938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:25.295962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:25.295983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:25.297109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:25.348807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId: src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:25.378006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:25.458395Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:25.504419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:25.504484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:25.504550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:25.504562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:25.504599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400415842507454:3367]
2025-10-15T10:55:25.504783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:25.505117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:25.505058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:25.505224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:25.505242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:25.507771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400413042802080:3423]
2025-10-15T10:55:25.515246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 107 reason: error at write: Disconnected sessionId: src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0
2025-10-15T10:55:25.515634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 107 sessionId: src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0 is DEAD
2025-10-15T10:55:25.516069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:25.516159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0] Write session will restart in 0.005169s
2025-10-15T10:55:25.516323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0] Write session: Do CDS request
2025-10-15T10:55:25.516376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:25.527506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:25.527557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 108
2025-10-15T10:55:25.527721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:25.528416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:25.528550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:25.528573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:25.528582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:25.530797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 108 sessionId:  describe result for acl check
2025-10-15T10:55:25.530941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:25.530959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:25.530969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:25.530988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400413042802158:3543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:25.533969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400413042802158:3543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:25.540256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400413042802158:3543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:25.553512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400413042802158:3543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:25.553554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400413042802158:3543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:25.553571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400413042802158:3543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:25.553608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:25.593365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:25.599619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:25.600527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:25.600568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:25.600612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:25.600887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:25.601083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400415842507628:3377]
2025-10-15T10:55:25.603452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:25.604469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:25.604709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:25.606082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:25.606438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:25.606459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:25.606467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:25.606475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:25.606482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:25.606489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:25.606496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:25.606502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:25.606511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:25.606520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:25.606528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:25.606535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.606542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.606550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.606618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:25.606739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:25.606792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:25.606839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:25.606884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:25.606934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:25.606981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:25.607032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:25.607084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:25.607132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:25.607178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:25.607226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.607271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.607315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.607795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400413042802300:3423]
2025-10-15T10:55:25.607938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:25.608032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:25.608106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:25.608167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:25.608224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:25.608284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:25.608340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:25.608399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:25.608458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:25.608520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:25.608580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:25.608638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:25.608693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:25.608772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:25.608819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:25.608878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:25.608935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:25.609000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:25.609052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:25.609115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:25.609169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:25.609232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:25.609287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.609350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.609411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.609471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.609523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.609583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.610122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:25.628349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:25.638314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:25.638366Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:25.638381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:25.638396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:25.638417Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 107 [2:7561400415842507628:3377]
2025-10-15T10:55:25.638470Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:25.638529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:25.638553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.638575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.638588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.638636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:25.638661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:25.638678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:25.653096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.653133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.653149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.653160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:25.653456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:25.653487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:25.653642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:25.653841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:25.653861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 107, pipe: [1:7561400413042802300:3423]
2025-10-15T10:55:25.653895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 107
2025-10-15T10:55:25.653996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 107
2025-10-15T10:55:25.654041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:25.654136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400413042802300:3423], now have 1 active actors on pipe
2025-10-15T10:55:25.654171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400413042802196:3543], now have 1 active actors on pipe
2025-10-15T10:55:25.654195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400413042802143:2467], now have 1 active actors on pipe
2025-10-15T10:55:25.654223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400415842507623:3377]
2025-10-15T10:55:25.654237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400415842507623:3377]
2025-10-15T10:55:25.654250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400415842507623:3377]
2025-10-15T10:55:25.654289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:25.654329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:25.654344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:25.654356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:25.654371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:25.654575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:25.654593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:25.654673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:25.654692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:25.654814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400415842507623:3377]
2025-10-15T10:55:25.654849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:25.654890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:25.654916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36001a15-569a25ab-8de380a7-fe436b1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:25.654939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.654953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.654960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:25.654985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.655018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:25.655121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:25.655656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:25.655690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:25.655780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:25.656255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 108 partition: 0 MaxSeqNo: 46 sessionId: src_id|36001a15-569a25ab-8de380a7-fe436b1a_0
2025-10-15T10:55:25.657053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ce8bf1-e3a52228-499c9193-e0d5851f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|36001a15-569a25ab-8de380a7-fe436b1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:25.685230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:25.685272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:25.685312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400415842507623:3377]
2025-10-15T10:55:25.685433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:25.685441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:25.687130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:25.688623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:25.690382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36001a15-569a25ab-8de380a7-fe436b1a_0] Write session: try to update token
2025-10-15T10:55:25.690446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36001a15-569a25ab-8de380a7-fe436b1a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:25.689790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:25.691128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:25.696783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:25.697391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:25.738906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.738952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.738966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.780555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId: src_id|36001a15-569a25ab-8de380a7-fe436b1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:25.799367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:25.799409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:25.799426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:25.799439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:25.799483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400415842507623:3377]
2025-10-15T10:55:25.799515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400415842507623:3377]
2025-10-15T10:55:25.799541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400415842507623:3377]
2025-10-15T10:55:25.799706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:25.799716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:25.799740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:25.799753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:25.799784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:25.801025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:25.804637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:25.949532Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:25.952041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:25.952089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:25.953797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:25.953968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400413042802300:3423]
2025-10-15T10:55:25.954053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:25.954065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:25.953491Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:25.992836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36001a15-569a25ab-8de380a7-fe436b1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:25.992896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36001a15-569a25ab-8de380a7-fe436b1a_0] Write session will restart in 0.008705s
2025-10-15T10:55:25.993040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36001a15-569a25ab-8de380a7-fe436b1a_0] Write session: Do CDS request
2025-10-15T10:55:25.993081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36001a15-569a25ab-8de380a7-fe436b1a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:25.992013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 108 reason: error at write: Disconnected sessionId: src_id|36001a15-569a25ab-8de380a7-fe436b1a_0
2025-10-15T10:55:25.992376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 108 sessionId: src_id|36001a15-569a25ab-8de380a7-fe436b1a_0 is DEAD
2025-10-15T10:55:26.006960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:26.007012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 109
2025-10-15T10:55:26.007402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36001a15-569a25ab-8de380a7-fe436b1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:26.007953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:26.008084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:26.008101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:26.008112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:26.011267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 109 sessionId:  describe result for acl check
2025-10-15T10:55:26.011535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:26.011560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:26.011581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:26.011620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400417337769669:3547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:26.015757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400417337769669:3547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:26.026751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400417337769669:3547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:26.038160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400417337769669:3547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:26.038201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400417337769669:3547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:26.038220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400417337769669:3547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:26.038250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:26.042215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:26.045895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:26.046819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:26.046859Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:26.046907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:26.047195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:26.047424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400420137475087:3379]
2025-10-15T10:55:26.049762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:26.050748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:26.051009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:26.052379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:26.052728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.052746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.052753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.052761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.052769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.052777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.052786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.052795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.052803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.052812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.052820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.052826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.052832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.052838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.052885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.052998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.053050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.053097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.053143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.053202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.053250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.053304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.053356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.053410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.053467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.053519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.053578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.053632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.053688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.053769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.053845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.053783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400417337769773:3423]
2025-10-15T10:55:26.053914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.053976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.054050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.054106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.054171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.054226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.054289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.054346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.054407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.054465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.054531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.054596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.054664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.054721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.054785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.054845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.054909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.054967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.055028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.055086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.055155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.055220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.055282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.055341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.055563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.056189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:26.084661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:26.094481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:26.094749Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:26.094779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:26.094802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:26.094827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 108 [2:7561400420137475087:3379]
2025-10-15T10:55:26.094884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:26.098010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 108
2025-10-15T10:55:26.098022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 108
2025-10-15T10:55:26.098085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 108, pipe: [1:7561400417337769773:3423]
2025-10-15T10:55:26.094951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:26.094972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.094985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.094998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.095050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:26.095076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:26.095100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:26.096939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.096958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.096972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.096982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:26.097294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:26.097314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.097455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.097656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.097886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:26.097967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400417337769767:3547], now have 1 active actors on pipe
2025-10-15T10:55:26.097990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400413042802321:2467], now have 1 active actors on pipe
2025-10-15T10:55:26.098008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400417337769773:3423], now have 1 active actors on pipe
2025-10-15T10:55:26.098029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400420137475081:3379]
2025-10-15T10:55:26.098041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400420137475081:3379]
2025-10-15T10:55:26.098053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400420137475081:3379]
2025-10-15T10:55:26.098094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:26.098163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:26.098344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:26.098363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:26.098463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:26.098478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400420137475081:3379]
2025-10-15T10:55:26.098491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:26.098497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:26.098503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:26.098527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:26.099940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:26.099984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:26.100065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91347280-430a20d7-abbffa1c-7339ba40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:26.100097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.100117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.100129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:26.100167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.100212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:26.100259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:26.105712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:26.105755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:26.105834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:26.106531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 109 partition: 0 MaxSeqNo: 46 sessionId: src_id|91347280-430a20d7-abbffa1c-7339ba40_0
2025-10-15T10:55:26.111575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36001a15-569a25ab-8de380a7-fe436b1a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|91347280-430a20d7-abbffa1c-7339ba40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:26.141149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91347280-430a20d7-abbffa1c-7339ba40_0] Write session: try to update token
2025-10-15T10:55:26.143389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91347280-430a20d7-abbffa1c-7339ba40_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:26.203833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:26.203875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:26.203889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:26.203899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:26.203936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400420137475081:3379]
2025-10-15T10:55:26.203963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400420137475081:3379]
2025-10-15T10:55:26.203986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400420137475081:3379]
2025-10-15T10:55:26.204148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.204166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.204178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.207467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:26.207516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:26.207541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:26.243657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:26.243700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:26.250783Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:26.313825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId: src_id|91347280-430a20d7-abbffa1c-7339ba40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:26.337148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:26.428116Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:26.430489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:26.430527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:26.430585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400420137475081:3379]
2025-10-15T10:55:26.430746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:26.430901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:26.430988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:26.431702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:26.435529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:26.496181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91347280-430a20d7-abbffa1c-7339ba40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:26.496228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91347280-430a20d7-abbffa1c-7339ba40_0] Write session will restart in 0.009528s
2025-10-15T10:55:26.496339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91347280-430a20d7-abbffa1c-7339ba40_0] Write session: Do CDS request
2025-10-15T10:55:26.496369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91347280-430a20d7-abbffa1c-7339ba40_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:26.494205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:26.494338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400417337769773:3423]
2025-10-15T10:55:26.494387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91347280-430a20d7-abbffa1c-7339ba40_0
2025-10-15T10:55:26.494676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 109 sessionId: src_id|91347280-430a20d7-abbffa1c-7339ba40_0 is DEAD
2025-10-15T10:55:26.514298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91347280-430a20d7-abbffa1c-7339ba40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:26.529641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:26.529681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 110
2025-10-15T10:55:26.531603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:26.531757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:26.531775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:26.531785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:26.533248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 110 sessionId:  describe result for acl check
2025-10-15T10:55:26.533380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:26.533391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:26.533399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:26.533418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400417337769894:3559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:26.536588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400417337769894:3559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:26.549794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:26.553641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:26.554299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:26.554311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:26.554341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:26.554528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:26.554667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400420137475277:3389]
2025-10-15T10:55:26.556486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:26.558189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400417337769894:3559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:26.557558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:26.557764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:26.558952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:26.559273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.559281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.559288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.559295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.559302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.559307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.559315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.559321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.559327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.559333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.559340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.559365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.559372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.559379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.559425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.559946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.560011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.560055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.560104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.560149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.560190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.560229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.560271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.560313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.560362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.560426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.560468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.560509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.560553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.560616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.560670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.560723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.560770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.560823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.560864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.560916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.560961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.561027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.561072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.561122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.561167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.561224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.561266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.561317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.561364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.561415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.561459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.561506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.561547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.561598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.561639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.561705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.561777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.561833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.561877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.561923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.562383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:26.573069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400417337769894:3559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:26.573110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400417337769894:3559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:26.573128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400417337769894:3559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:26.573161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:26.582849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:26.595947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400417337769972:3423]
2025-10-15T10:55:26.607325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 109
2025-10-15T10:55:26.607441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 109
2025-10-15T10:55:26.607530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 109, pipe: [1:7561400417337769972:3423]
2025-10-15T10:55:26.604720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:26.604765Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:26.604780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:26.604792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:26.604807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 109 [2:7561400420137475277:3389]
2025-10-15T10:55:26.604842Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:26.604881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:26.604892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.604900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.604907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.604937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:26.604951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:26.604964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:26.606681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.606696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.606708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.606720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:26.606964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:26.606978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.607104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.607276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.607518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:26.607594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400417337769970:3559], now have 1 active actors on pipe
2025-10-15T10:55:26.607615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400417337769821:2467], now have 1 active actors on pipe
2025-10-15T10:55:26.607635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400417337769972:3423], now have 1 active actors on pipe
2025-10-15T10:55:26.607682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:26.607701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:26.607750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400420137475272:3389]
2025-10-15T10:55:26.607763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400420137475272:3389]
2025-10-15T10:55:26.607774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400420137475272:3389]
2025-10-15T10:55:26.607813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:26.607877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:26.608651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:26.608673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:26.608683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:26.608863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:26.608887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:26.608949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a776120b-a4a4818d-5fec758b-d8b113c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:26.608981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.608996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.609007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:26.609038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.609086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:26.609209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400420137475272:3389]
2025-10-15T10:55:26.609236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:26.609286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:26.609438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:26.610300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:26.610328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:26.610407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:26.610742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 110 partition: 0 MaxSeqNo: 46 sessionId: src_id|a776120b-a4a4818d-5fec758b-d8b113c_0
2025-10-15T10:55:26.611494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91347280-430a20d7-abbffa1c-7339ba40_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a776120b-a4a4818d-5fec758b-d8b113c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:26.655853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a776120b-a4a4818d-5fec758b-d8b113c_0] Write session: try to update token
2025-10-15T10:55:26.655912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a776120b-a4a4818d-5fec758b-d8b113c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:26.694019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:26.694053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:26.694067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:26.694077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:26.694111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400420137475272:3389]
2025-10-15T10:55:26.694135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400420137475272:3389]
2025-10-15T10:55:26.694156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400420137475272:3389]
2025-10-15T10:55:26.694486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:26.694529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:26.694855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:26.694889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:26.694916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:26.695655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:26.770660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId: src_id|a776120b-a4a4818d-5fec758b-d8b113c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:26.792472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:26.843288Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:26.860923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:26.860972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:26.861050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:26.861063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:26.861101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400420137475272:3389]
2025-10-15T10:55:26.861290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:26.861683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:26.861632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:26.861659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:26.870964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 110 reason: error at write: Disconnected sessionId: src_id|a776120b-a4a4818d-5fec758b-d8b113c_0
2025-10-15T10:55:26.871277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 110 sessionId: src_id|a776120b-a4a4818d-5fec758b-d8b113c_0 is DEAD
2025-10-15T10:55:26.871649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a776120b-a4a4818d-5fec758b-d8b113c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:26.871703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a776120b-a4a4818d-5fec758b-d8b113c_0] Write session will restart in 0.009586s
2025-10-15T10:55:26.871849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a776120b-a4a4818d-5fec758b-d8b113c_0] Write session: Do CDS request
2025-10-15T10:55:26.871923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a776120b-a4a4818d-5fec758b-d8b113c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:26.878106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:26.878361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400417337769972:3423]
2025-10-15T10:55:26.885838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a776120b-a4a4818d-5fec758b-d8b113c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:26.888065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:26.888093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 111
2025-10-15T10:55:26.888963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:26.889102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:26.889126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:26.889135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:26.890686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 111 sessionId:  describe result for acl check
2025-10-15T10:55:26.890843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:26.890875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:26.890894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:26.890924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400417337770003:3563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:26.893614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400417337770003:3563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:26.905839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400417337770003:3563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:26.915081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400417337770003:3563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:26.915114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400417337770003:3563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:26.915129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400417337770003:3563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:26.915150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:26.935692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:26.938267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:26.939038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:26.939065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:26.939099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:26.939315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:26.939500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400420137475467:3396]
2025-10-15T10:55:26.941561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:26.942365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:26.942563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:26.943766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:26.944069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.944086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.944093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.944100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.944106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.944113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.944121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.944128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.944133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.944140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.944149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.944154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.944160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.944167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.944215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.944319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.944365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.944410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.944455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.944509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.944554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.944604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.944654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.944706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.944755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.944803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.944856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.944911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.944951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.945012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:26.945069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.945120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:26.945165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.945216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:26.945259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.945308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:26.945353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.945402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:26.945442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.945489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:26.945534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.945584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:26.945627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.945680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:26.945726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.945790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:26.945832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.945879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:26.945919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.945969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:26.946008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.946054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.946094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.946137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.946175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.946223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.946690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:26.978753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400417337770156:3423]
2025-10-15T10:55:26.981081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:26.990431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:26.990480Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:26.990498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:26.990515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:26.990537Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 110 [2:7561400420137475467:3396]
2025-10-15T10:55:26.990594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:26.990649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:26.990661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.990672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.990681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.990723Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:26.990742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:26.990760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:26.992717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 110
2025-10-15T10:55:26.992817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 110
2025-10-15T10:55:26.992886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 110, pipe: [1:7561400417337770156:3423]
2025-10-15T10:55:26.994810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 111 partition: 0 MaxSeqNo: 46 sessionId: src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0
2025-10-15T10:55:26.991985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.992012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.995500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a776120b-a4a4818d-5fec758b-d8b113c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:26.992025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.992037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:26.992284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:26.992301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:26.992439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:26.992618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:26.992841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:26.992911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400417337770055:3563], now have 1 active actors on pipe
2025-10-15T10:55:26.992934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400417337769986:2467], now have 1 active actors on pipe
2025-10-15T10:55:26.992955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400417337770156:3423], now have 1 active actors on pipe
2025-10-15T10:55:26.992975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400420137475462:3396]
2025-10-15T10:55:26.992988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400420137475462:3396]
2025-10-15T10:55:26.993000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400420137475462:3396]
2025-10-15T10:55:26.993034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:26.993068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:26.993080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:26.993089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:26.993110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:26.993128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:26.993182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:26.993352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:26.993367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:26.993517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:26.993545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.993560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.993568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:26.993600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.993634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:26.993666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400420137475462:3396]
2025-10-15T10:55:26.993695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:26.993742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:26.993777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:26.994382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:26.994399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:26.994454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:27.017166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0] Write session: try to update token
2025-10-15T10:55:27.017220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:27.085509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:27.085553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:27.085567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:27.085578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:27.085619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400420137475462:3396]
2025-10-15T10:55:27.085647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400420137475462:3396]
2025-10-15T10:55:27.085681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400420137475462:3396]
2025-10-15T10:55:27.085920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:27.085942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:27.086224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:27.086252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:27.086286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:27.089429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:27.114601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId: src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:27.137968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:27.233936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:27.257496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:27.257540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:27.257597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:27.257610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:27.257643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400420137475462:3396]
2025-10-15T10:55:27.258163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:27.258804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:27.259193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400417337770156:3423]
2025-10-15T10:55:27.259295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:27.259311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:27.263580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:27.285501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:27.285575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0] Write session will restart in 0.005392s
2025-10-15T10:55:27.285749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0] Write session: Do CDS request
2025-10-15T10:55:27.285786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:27.284604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 111 reason: error at write: Disconnected sessionId: src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0
2025-10-15T10:55:27.284888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 111 sessionId: src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0 is DEAD
2025-10-15T10:55:27.295707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:27.295742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 112
2025-10-15T10:55:27.295845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:27.297252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:27.297421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:27.297444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:27.297455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:27.299022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 112 sessionId:  describe result for acl check
2025-10-15T10:55:27.299166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:27.299191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:27.299207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:27.299236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400421632737518:3572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:27.303673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400421632737518:3572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:27.316024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400421632737518:3572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:27.318081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:27.320905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:27.321609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:27.321639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:27.321676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:27.321922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:27.322116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400424432442942:3402]
2025-10-15T10:55:27.324291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:27.325120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:27.325308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:27.325622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400421632737518:3572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:27.325658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400421632737518:3572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:27.325672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400421632737518:3572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:27.325699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:27.326285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:27.326565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:27.326578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:27.326594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:27.326600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:27.326604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:27.326609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:27.326614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:27.326618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:27.326622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:27.326627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:27.326631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:27.326635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.326639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.326643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.326683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:27.326780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:27.326826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:27.326865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:27.326895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:27.326929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:27.326965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:27.327003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:27.327054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:27.327100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:27.327149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:27.327197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.327244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.327292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.327340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:27.327422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:27.327482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:27.327536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:27.327590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:27.327641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:27.327690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:27.327745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:27.327795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:27.327850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:27.327898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:27.327946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:27.327993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:27.328051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:27.328098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:27.328155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:27.328194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:27.328233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:27.328264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:27.328315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:27.328349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:27.328387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:27.328418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.328452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.328490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.328536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.328571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.328626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.328981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:27.344256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:27.358833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400421632737637:3423]
2025-10-15T10:55:27.367080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:27.367124Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:27.367139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:27.367157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:27.367179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 111 [2:7561400424432442942:3402]
2025-10-15T10:55:27.367227Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:27.367282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:27.367295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.367307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.367318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.367372Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:27.367391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:27.367409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:27.368197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.368222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.368235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.368246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:27.368488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:27.368511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.368641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.368814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.369029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:27.369102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400424432442936:3402]
2025-10-15T10:55:27.369122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400424432442936:3402]
2025-10-15T10:55:27.369133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400424432442936:3402]
2025-10-15T10:55:27.369180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:27.369251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:27.369384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:27.369407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:27.369417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:27.369419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:27.369434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:27.369556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400421632737634:3572], now have 1 active actors on pipe
2025-10-15T10:55:27.369585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400424432442936:3402]
2025-10-15T10:55:27.369605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:27.369583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 111
2025-10-15T10:55:27.369733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 111
2025-10-15T10:55:27.369812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 111, pipe: [1:7561400421632737637:3423]
2025-10-15T10:55:27.369643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:27.369673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400421632737477:2467], now have 1 active actors on pipe
2025-10-15T10:55:27.369692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400421632737637:3423], now have 1 active actors on pipe
2025-10-15T10:55:27.369763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:27.369781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:27.369848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:27.369866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.369876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.369883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:27.369912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.369945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:27.369986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:27.370441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:27.370469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:27.370531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:27.370801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 112 partition: 0 MaxSeqNo: 46 sessionId: src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0
2025-10-15T10:55:27.371568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2d61efb-c25325db-3b7c648-b95aa5dc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:27.393470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0] Write session: try to update token
2025-10-15T10:55:27.393521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:27.427660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:27.427696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:27.427709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:27.427721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:27.427752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400424432442936:3402]
2025-10-15T10:55:27.427777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400424432442936:3402]
2025-10-15T10:55:27.427799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400424432442936:3402]
2025-10-15T10:55:27.427934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:27.427957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:27.428377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:27.428429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:27.428456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:27.443931Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:27.531965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId: src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:27.556711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:27.595469Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:27.597451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:27.597485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:27.598691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:27.598787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400421632737637:3423]
2025-10-15T10:55:27.598901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:27.598920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:27.601401Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:27.626062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 112 reason: error at write: Disconnected sessionId: src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0
2025-10-15T10:55:27.626344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 112 sessionId: src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0 is DEAD
2025-10-15T10:55:27.626809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:27.626868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0] Write session will restart in 0.006899s
2025-10-15T10:55:27.627027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0] Write session: Do CDS request
2025-10-15T10:55:27.627071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:27.639093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:27.639131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 113
2025-10-15T10:55:27.639279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:27.639959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:27.640101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:27.640120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:27.640135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:27.641450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 113 sessionId:  describe result for acl check
2025-10-15T10:55:27.641565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:27.641582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:27.641590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:27.641606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400421632737660:3576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:27.644983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400421632737660:3576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:27.653443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400421632737660:3576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:27.667128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400421632737660:3576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:27.667168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400421632737660:3576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:27.667183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400421632737660:3576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:27.667208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:27.683732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:27.689639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:27.690433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:27.690462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:27.690500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:27.690783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:27.690959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400424432443121:3406]
2025-10-15T10:55:27.692969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:27.693933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:27.694168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:27.695304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:27.695724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:27.695748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:27.695754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:27.695760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:27.695766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:27.695771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:27.695777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:27.695783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:27.695788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:27.695794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:27.695800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:27.695806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.695812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.695818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.695861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:27.695978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:27.696035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:27.696081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:27.696128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:27.696195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:27.696242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:27.696294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:27.696339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:27.696387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:27.696434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:27.696493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.696543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.696598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.696658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:27.696725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:27.696784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:27.696845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:27.696906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:27.696976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:27.697034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:27.697096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:27.697151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:27.697221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:27.697279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:27.697352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:27.697414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:27.697480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:27.697535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:27.697596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:27.697648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:27.697695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:27.697737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:27.697784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:27.697825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:27.697873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:27.697912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.697958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.698000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.698051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.698101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.698176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.698651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:27.698755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400421632737807:3423]
2025-10-15T10:55:27.724889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:27.746667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:27.746712Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:27.746727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:27.746743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:27.746764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 112 [2:7561400424432443121:3406]
2025-10-15T10:55:27.746807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:27.746856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:27.746868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.746878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.746887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.746930Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:27.746950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:27.746968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:27.748683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.748712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.748724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.748735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:27.749193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 112
2025-10-15T10:55:27.749285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 112, pipe: [1:7561400421632737807:3423]
2025-10-15T10:55:27.748986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:27.749012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:27.749132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:27.749299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:27.749534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:27.749604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400421632737645:2467], now have 1 active actors on pipe
2025-10-15T10:55:27.749352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 112
2025-10-15T10:55:27.749624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400421632737807:3423], now have 1 active actors on pipe
2025-10-15T10:55:27.749642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400421632737774:3576], now have 1 active actors on pipe
2025-10-15T10:55:27.749663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400424432443116:3406]
2025-10-15T10:55:27.749676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400424432443116:3406]
2025-10-15T10:55:27.749708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400424432443116:3406]
2025-10-15T10:55:27.749742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:27.749808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:27.749828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:27.749838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:27.749845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:27.749966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:27.749981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:27.750158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:27.750176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:27.750201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400424432443116:3406]
2025-10-15T10:55:27.750228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:27.750329Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:27.750355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.750371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.750381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:27.750409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.750443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:27.750545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:27.750890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:27.752131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:27.752163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:27.752222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:27.753529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0bf5d60-60ef36d-6ce61531-e59ee152_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:27.752759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 113 partition: 0 MaxSeqNo: 46 sessionId: src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0
2025-10-15T10:55:27.802675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0] Write session: try to update token
2025-10-15T10:55:27.802744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:27.892439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:27.892469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:27.892480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:27.892489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:27.892517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400424432443116:3406]
2025-10-15T10:55:27.892538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400424432443116:3406]
2025-10-15T10:55:27.892558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400424432443116:3406]
2025-10-15T10:55:27.892711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.892723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.892733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.892895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:27.892932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:27.892955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:27.918219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:27.918262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:27.919578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId: src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:27.919649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:27.942334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:28.067213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:28.069373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:28.069412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:28.069465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400424432443116:3406]
2025-10-15T10:55:28.069651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:28.069677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:28.069836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:28.070587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:28.070766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400421632737807:3423]
2025-10-15T10:55:28.070849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:28.070778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:28.070861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:28.081281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 113 reason: error at write: Disconnected sessionId: src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0
2025-10-15T10:55:28.081633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 113 sessionId: src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0 is DEAD
2025-10-15T10:55:28.082102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:28.082166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0] Write session will restart in 0.006044s
2025-10-15T10:55:28.082307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0] Write session: Do CDS request
2025-10-15T10:55:28.082343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:28.097202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:28.112318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:28.112351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 114
2025-10-15T10:55:28.112990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:28.113107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:28.113124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:28.113133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:28.121667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 114 sessionId:  describe result for acl check
2025-10-15T10:55:28.121792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:28.121804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:28.121814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:28.121832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400425927705161:3588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:28.125109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400425927705161:3588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:28.134452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400425927705161:3588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:28.152121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400425927705161:3588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:28.152152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400425927705161:3588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:28.152164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400425927705161:3588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:28.152187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:28.164187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:28.166517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:28.167410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:28.167444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:28.167485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:28.167715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:28.167889Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400428727410617:3418]
2025-10-15T10:55:28.169923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:28.170836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400425927705310:3423]
2025-10-15T10:55:28.171011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:28.171295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:28.172540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:28.172886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:28.172905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:28.172912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:28.172918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:28.172924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:28.172930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:28.172936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:28.172941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:28.172948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:28.172954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:28.172961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:28.172968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.172974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.172980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.173023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:28.173132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:28.173175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:28.173216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:28.173259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:28.173300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:28.173339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:28.173392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:28.173429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:28.173470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:28.173517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:28.173561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.173601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.173647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.173687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:28.173749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:28.173810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:28.173862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:28.173906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:28.173952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:28.173998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:28.174045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:28.174086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:28.174141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:28.174188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:28.174237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:28.174283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:28.174332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:28.174375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:28.174427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:28.174467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:28.174517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:28.174563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:28.174630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:28.174679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:28.174729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:28.174777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.174820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.174864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.174904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.174930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.174965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.175296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:28.199490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:28.209289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:28.209333Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:28.209357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:28.209375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:28.209396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 113 [2:7561400428727410617:3418]
2025-10-15T10:55:28.209442Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:28.209489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:28.209503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.209515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.209525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.209568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:28.209583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:28.209597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:28.211070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.211093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.211106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.211116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:28.211641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:28.211667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.211793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.211967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.212142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 113
2025-10-15T10:55:28.212234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 113
2025-10-15T10:55:28.212292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 113, pipe: [1:7561400425927705310:3423]
2025-10-15T10:55:28.212185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:28.212270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400425927705271:3588], now have 1 active actors on pipe
2025-10-15T10:55:28.212289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400425927705137:2467], now have 1 active actors on pipe
2025-10-15T10:55:28.212309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400425927705310:3423], now have 1 active actors on pipe
2025-10-15T10:55:28.212331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400428727410612:3418]
2025-10-15T10:55:28.212343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400428727410612:3418]
2025-10-15T10:55:28.212354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400428727410612:3418]
2025-10-15T10:55:28.212389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:28.212418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:28.212430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:28.212442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:28.212452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:28.212609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:28.212623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:28.212751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:28.212772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:28.212811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400428727410612:3418]
2025-10-15T10:55:28.212837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:28.212858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:28.212941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:28.212968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.212984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.212993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:28.213023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.213055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:28.213145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:28.213752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:28.213777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:28.213841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:28.214120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 114 partition: 0 MaxSeqNo: 46 sessionId: src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0
2025-10-15T10:55:28.214900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb53a9f6-213fd6bc-b6a6708d-bb2346ab_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:28.239576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0] Write session: try to update token
2025-10-15T10:55:28.239634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:28.327924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:28.327965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:28.327979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:28.327991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:28.328026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400428727410612:3418]
2025-10-15T10:55:28.328056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400428727410612:3418]
2025-10-15T10:55:28.328079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400428727410612:3418]
2025-10-15T10:55:28.328302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.328325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.328336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.328383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:28.328405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:28.329439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:28.330997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:28.331042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:28.331075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:28.343555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId: src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:28.371478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:28.475852Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:28.493357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:28.493407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:28.493473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:28.493486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:28.493523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400428727410612:3418]
2025-10-15T10:55:28.493692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:28.494084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:28.494084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:28.494103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:28.494329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400425927705310:3423]
2025-10-15T10:55:28.494031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:28.502767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 114 reason: error at write: Disconnected sessionId: src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0
2025-10-15T10:55:28.503112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 114 sessionId: src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0 is DEAD
2025-10-15T10:55:28.503625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:28.503664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0] Write session will restart in 0.006745s
2025-10-15T10:55:28.503793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0] Write session: Do CDS request
2025-10-15T10:55:28.503841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:28.516367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:28.516415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 115
2025-10-15T10:55:28.516505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:28.517096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:28.517235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:28.517258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:28.517267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:28.518538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 115 sessionId:  describe result for acl check
2025-10-15T10:55:28.518671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:28.518686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:28.518695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:28.518711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400425927705349:3595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:28.521192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400425927705349:3595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:28.540127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400425927705349:3595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:28.551868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400425927705349:3595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:28.551908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400425927705349:3595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:28.551926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400425927705349:3595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:28.551958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:28.574609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:28.580386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:28.581242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:28.581271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:28.581315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:28.581551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:28.581724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400428727410794:3423]
2025-10-15T10:55:28.583893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:28.584902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:28.585080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:28.586235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:28.586519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:28.586526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:28.586532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:28.586538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:28.586544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:28.586550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:28.586556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:28.586563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:28.586571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:28.586578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:28.586584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:28.586591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.586598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.586619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.586669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:28.586783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:28.586830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:28.586872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:28.586912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:28.586953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:28.586996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:28.587039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:28.587082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:28.587125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:28.587167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:28.587206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.587248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.587287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.587327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:28.587417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:28.587479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:28.587528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:28.587573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:28.587625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:28.587670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:28.587753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:28.587797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:28.587842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:28.587882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:28.587929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:28.587971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:28.588017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:28.588056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:28.588105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:28.588149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:28.588203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:28.588259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:28.588308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:28.588348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:28.588390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:28.588427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.588472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.588512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.588559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.588600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.588647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.589008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:28.594822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400425927705499:3423]
2025-10-15T10:55:28.624707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:28.637056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 114
2025-10-15T10:55:28.637092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 114
2025-10-15T10:55:28.637158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 114, pipe: [1:7561400425927705499:3423]
2025-10-15T10:55:28.634987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:28.635033Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:28.635048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:28.635067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:28.635089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 114 [2:7561400428727410794:3423]
2025-10-15T10:55:28.635140Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:28.635193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:28.635207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.635220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.635231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.635274Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:28.635295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:28.635312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:28.636529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.636545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.636560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.636569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:28.636821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:28.636836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:28.636969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:28.637172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:28.637400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:28.637474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400425927705334:2467], now have 1 active actors on pipe
2025-10-15T10:55:28.637497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400425927705417:3595], now have 1 active actors on pipe
2025-10-15T10:55:28.637517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400425927705499:3423], now have 1 active actors on pipe
2025-10-15T10:55:28.637580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:28.637597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:28.637631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400428727410789:3423]
2025-10-15T10:55:28.637644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400428727410789:3423]
2025-10-15T10:55:28.637656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400428727410789:3423]
2025-10-15T10:55:28.637695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:28.637759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:28.637923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:28.637941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:28.638026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:28.638052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.638069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.638079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:28.638110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.638145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:28.638257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400428727410789:3423]
2025-10-15T10:55:28.638278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:28.638319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:28.638982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:28.638999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:28.639010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:28.639036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:28.640299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:28.640332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:28.640408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:28.640861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 115 partition: 0 MaxSeqNo: 46 sessionId: src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0
2025-10-15T10:55:28.641649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe378b89-6ab6916e-6ec775d5-7f8ff807_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:28.673973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0] Write session: try to update token
2025-10-15T10:55:28.674039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:28.734069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:28.734111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:28.734126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:28.734139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:28.734174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400428727410789:3423]
2025-10-15T10:55:28.734201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400428727410789:3423]
2025-10-15T10:55:28.734225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400428727410789:3423]
2025-10-15T10:55:28.734346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:28.734380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:28.734392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:28.734405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:28.734420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:28.735399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:28.821443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId: src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:28.847258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:28.907928Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:28.911597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:28.911633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:28.914886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:28.914911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:28.916616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400425927705499:3423]
2025-10-15T10:55:28.916688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:28.923960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 115 reason: error at write: Disconnected sessionId: src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0
2025-10-15T10:55:28.924325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 115 sessionId: src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0 is DEAD
2025-10-15T10:55:28.927575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:28.927625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0] Write session will restart in 0.006983s
2025-10-15T10:55:28.927785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0] Write session: Do CDS request
2025-10-15T10:55:28.927817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:28.939162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:28.944058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:28.943746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:28.943810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 116
2025-10-15T10:55:28.947622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:28.947759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:28.947777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:28.947788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:28.954055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 116 sessionId:  describe result for acl check
2025-10-15T10:55:28.954182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:28.954219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:28.954232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:28.954249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400425927705532:3599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:28.957049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400425927705532:3599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:28.976570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400425927705532:3599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:28.986441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400425927705532:3599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:28.986476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400425927705532:3599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:28.986493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400425927705532:3599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:28.986529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:29.016769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400430222672907:3423]
2025-10-15T10:55:29.076840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:29.084168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:29.085077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:29.085097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:29.085140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:29.085402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:29.085584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400433022378278:3425]
2025-10-15T10:55:29.095950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:29.097313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:29.097565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:29.098957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:29.099337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.099371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.099379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.099385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.099392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.099399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.099405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.099411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.099418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.099426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.099433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.099440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.099447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.099453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.099502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.099631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.099683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.099738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.099788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.099836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.099883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.099938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.099989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.100043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.100101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.100151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.100199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.100254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.100311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.100387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.100453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.100517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.100568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.100631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.100685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.100747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.100806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.100869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.100924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.100982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.101033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.101093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.101140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.101198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.101250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.101310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.101371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.101434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.101486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.101546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.101604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.101667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.101723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.101788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.101844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.101907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.102454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:29.128353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:29.140846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:29.140889Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:29.140904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:29.140922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:29.140945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 115 [2:7561400433022378278:3425]
2025-10-15T10:55:29.140988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:29.141035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:29.141048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.141059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.141068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.141111Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:29.141129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:29.141146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:29.144313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 115
2025-10-15T10:55:29.144415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 115, pipe: [1:7561400430222672907:3423]
2025-10-15T10:55:29.144489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 115
2025-10-15T10:55:29.143206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.143237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.143249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.143260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:29.143564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:29.143583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.143717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.143882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.144091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:29.144173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400425927705518:2467], now have 1 active actors on pipe
2025-10-15T10:55:29.144198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400430222672907:3423], now have 1 active actors on pipe
2025-10-15T10:55:29.144217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400425927705561:3599], now have 1 active actors on pipe
2025-10-15T10:55:29.144241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400433022378266:3425]
2025-10-15T10:55:29.144254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400433022378266:3425]
2025-10-15T10:55:29.144266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400433022378266:3425]
2025-10-15T10:55:29.144307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:29.144375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:29.144547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:29.144566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:29.144693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400433022378266:3425]
2025-10-15T10:55:29.144711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:29.144715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:29.144724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:29.144735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:29.144755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:29.151059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:29.151098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:29.151165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:29.151194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.151210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.151222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:29.151252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.151290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:29.151329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:29.152689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:29.152730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:29.152788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:29.153164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 116 partition: 0 MaxSeqNo: 46 sessionId: src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0
2025-10-15T10:55:29.153986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae636b2e-13f1e0ad-e8977839-7dcac3e0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:29.183782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0] Write session: try to update token
2025-10-15T10:55:29.183850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:29.268414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.268450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.268462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.268518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:29.268531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:29.268545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:29.268557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:29.268591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400433022378266:3425]
2025-10-15T10:55:29.268614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400433022378266:3425]
2025-10-15T10:55:29.268637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400433022378266:3425]
2025-10-15T10:55:29.268796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:29.268816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:29.268831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:29.268879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:29.268929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:29.272231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:29.340729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId: src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:29.362913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:29.422271Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:29.424639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:29.424682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:29.425513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400430222672907:3423]
2025-10-15T10:55:29.425663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:29.425681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:29.437389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:29.437538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 116 reason: error at write: Disconnected sessionId: src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0
2025-10-15T10:55:29.437888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 116 sessionId: src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0 is DEAD
2025-10-15T10:55:29.438305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:29.438359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0] Write session will restart in 0.007140s
2025-10-15T10:55:29.438506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0] Write session: Do CDS request
2025-10-15T10:55:29.438545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:29.447270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:29.452003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:29.470627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:29.470661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 117
2025-10-15T10:55:29.471207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:29.471387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:29.471411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:29.471423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:29.472727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 117 sessionId:  describe result for acl check
2025-10-15T10:55:29.472853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:29.472870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:29.472882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:29.472899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400430222673031:3613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:29.475919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400430222673031:3613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:29.481946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400430222673031:3613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:29.488935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400430222673031:3613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:29.488969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400430222673031:3613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:29.488993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400430222673031:3613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:29.489019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:29.519143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:29.521732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:29.522471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:29.522496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:29.522530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:29.522750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:29.522916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400433022378460:3435]
2025-10-15T10:55:29.524986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:29.525574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400430222673182:3423]
2025-10-15T10:55:29.525801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:29.525990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:29.526952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:29.527237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.527252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.527256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.527260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.527264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.527268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.527272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.527276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.527282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.527289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.527294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.527300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.527306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.527311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.527372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.527442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.527476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.527505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.527535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.527563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.527591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.527618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.527654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.527689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.527717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.527745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.527780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.527814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.527844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.527902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.527958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.528013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.528058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.528112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.528158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.528198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.528249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.528295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.528341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.528395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.528441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.528492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.528539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.528592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.528639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.528692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.528739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.528788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.528831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.528882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.528930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.528982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.529023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.529060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.529090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.529124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.529539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:29.548463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:29.566713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:29.566758Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:29.566773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:29.566790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:29.566811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 116 [2:7561400433022378460:3435]
2025-10-15T10:55:29.566854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:29.566900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:29.566913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.566924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.566933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.566977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:29.566996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:29.567014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:29.568534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.568555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.568563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.568570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:29.568806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:29.568830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.568946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.569104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.569120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 116
2025-10-15T10:55:29.569217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 116
2025-10-15T10:55:29.569271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 116, pipe: [1:7561400430222673182:3423]
2025-10-15T10:55:29.569313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:29.569388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400430222673022:2467], now have 1 active actors on pipe
2025-10-15T10:55:29.569417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400430222673061:3613], now have 1 active actors on pipe
2025-10-15T10:55:29.569431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400430222673182:3423], now have 1 active actors on pipe
2025-10-15T10:55:29.569469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:29.569481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:29.569506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400433022378455:3435]
2025-10-15T10:55:29.569519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400433022378455:3435]
2025-10-15T10:55:29.569531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400433022378455:3435]
2025-10-15T10:55:29.569560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:29.569580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:29.569591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:29.569602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:29.569621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:29.569779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:29.569800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:29.569857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:29.569887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.569906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.569915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:29.569948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.569982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:29.570098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400433022378455:3435]
2025-10-15T10:55:29.570125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:29.570143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:29.570162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:29.570730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:29.570775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:29.570834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:29.571052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 117 partition: 0 MaxSeqNo: 46 sessionId: src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0
2025-10-15T10:55:29.571842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db60aa2-c6a55f5e-edc20890-5d0c867f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:29.600580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0] Write session: try to update token
2025-10-15T10:55:29.600645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:29.669093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:29.669141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:29.669158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:29.669170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:29.669205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400433022378455:3435]
2025-10-15T10:55:29.669230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400433022378455:3435]
2025-10-15T10:55:29.669251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400433022378455:3435]
2025-10-15T10:55:29.669368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:29.669416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:29.669460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:29.669500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.669518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.669538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.669587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:29.669613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:29.671495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:29.704897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId: src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:29.726325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:29.837288Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:29.847145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:29.847197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:29.847266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:29.847277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:29.847312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400433022378455:3435]
2025-10-15T10:55:29.847870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:29.847948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:29.847963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:29.848058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400430222673182:3423]
2025-10-15T10:55:29.847538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:29.848192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:29.858338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 117 reason: error at write: Disconnected sessionId: src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0
2025-10-15T10:55:29.858632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 117 sessionId: src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0 is DEAD
2025-10-15T10:55:29.859485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:29.859551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0] Write session will restart in 0.006300s
2025-10-15T10:55:29.859687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0] Write session: Do CDS request
2025-10-15T10:55:29.859728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:29.872428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:29.875634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:29.875667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 118
2025-10-15T10:55:29.876009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:29.876129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:29.876151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:29.876161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:29.877299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 118 sessionId:  describe result for acl check
2025-10-15T10:55:29.877398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:29.877414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:29.877424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:29.877439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400430222673233:3620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:29.879691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400430222673233:3620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:29.884855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400430222673233:3620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:29.891580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400430222673233:3620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:29.891621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400430222673233:3620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:29.891636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400430222673233:3620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:29.891664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:29.936720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:29.939328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:29.940189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:29.940223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:29.940272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:29.940565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:29.940756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400433022378657:3444]
2025-10-15T10:55:29.942926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:29.943997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:29.944265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:29.945593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:29.945923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.945940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.945947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.945955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.945961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.945968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.945975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.945982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.945990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.945997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.946004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.946011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.946018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.946025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.946070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.946172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.946219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.946264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.946306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.946353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.946396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.946449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.946473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400430222673385:3423]
2025-10-15T10:55:29.946492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.946536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.946577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.946633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.946687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.946739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.946799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.946877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:29.946940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.946999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:29.947053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.947110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:29.947159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.947219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:29.947273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.947330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:29.947397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.947454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:29.947504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.947559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:29.947607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.947657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:29.947709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.947763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:29.947813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.947882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:29.947938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.947996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:29.948046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.948104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.948153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.948209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.948264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.948324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.948811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:29.981883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:29.991460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:29.991512Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:29.991528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:29.991547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:29.991570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 117 [2:7561400433022378657:3444]
2025-10-15T10:55:29.991619Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:29.991677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:29.991692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.991704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.991713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.991755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:29.991776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:29.991795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:29.993446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 117, pipe: [1:7561400430222673385:3423]
2025-10-15T10:55:29.993560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 117
2025-10-15T10:55:29.993627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 117
2025-10-15T10:55:29.992947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.992975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.992988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.992999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:29.993273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:29.993289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:29.993422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:29.993604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:29.993826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:29.993897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400430222673385:3423], now have 1 active actors on pipe
2025-10-15T10:55:29.993917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400430222673263:3620], now have 1 active actors on pipe
2025-10-15T10:55:29.993935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400430222673212:2467], now have 1 active actors on pipe
2025-10-15T10:55:29.993957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400433022378652:3444]
2025-10-15T10:55:29.993971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400433022378652:3444]
2025-10-15T10:55:29.993982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400433022378652:3444]
2025-10-15T10:55:29.994023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:29.994087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:29.994095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:29.994098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:29.994108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:29.994266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:29.994282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:29.994330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:29.994349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:29.994462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400433022378652:3444]
2025-10-15T10:55:29.994489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:29.994554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:29.994583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.994599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.994609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:29.994643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:29.994651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.994685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:29.994826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:29.995832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:29.995870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:29.995935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:29.996261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 118 partition: 0 MaxSeqNo: 46 sessionId: src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0
2025-10-15T10:55:29.997056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967c20e7-913e7d90-1abbff36-6e8900a4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:30.035709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0] Write session: try to update token
2025-10-15T10:55:30.035794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:30.090854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:30.090910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:30.090923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:30.090949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:30.090986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400433022378652:3444]
2025-10-15T10:55:30.091010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400433022378652:3444]
2025-10-15T10:55:30.091032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400433022378652:3444]
2025-10-15T10:55:30.091152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:30.091211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:30.091212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:30.091234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:30.091247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:30.092299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:30.159936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId: src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:30.217361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:30.252231Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:30.269966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:30.270010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:30.270071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:30.270082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:30.270115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400433022378652:3444]
2025-10-15T10:55:30.270275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:30.270811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:30.275477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:30.275643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400430222673385:3423]
2025-10-15T10:55:30.275706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:30.327511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:30.327578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0] Write session will restart in 0.007607s
2025-10-15T10:55:30.327772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0] Write session: Do CDS request
2025-10-15T10:55:30.327819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:30.326723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 118 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0
2025-10-15T10:55:30.327045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 118 sessionId: src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0 is DEAD
2025-10-15T10:55:30.339762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:30.339816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 119
2025-10-15T10:55:30.341320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:30.342318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:30.342573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:30.342608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:30.342641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:30.344670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 119 sessionId:  describe result for acl check
2025-10-15T10:55:30.344817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:30.344837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:30.344848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:30.344867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400434517640734:3626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:30.347811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400434517640734:3626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:30.356291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400434517640734:3626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:30.369599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400434517640734:3626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:30.369648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400434517640734:3626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:30.369666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400434517640734:3626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:30.369699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:30.379539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400434517640872:3423]
2025-10-15T10:55:30.383143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:30.386228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:30.387083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:30.387102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:30.387142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:30.387586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:30.387786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400437317346142:3448]
2025-10-15T10:55:30.390090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:30.391232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:30.391495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:30.392828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:30.393158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:30.393165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:30.393173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:30.393180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:30.393188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:30.393195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:30.393203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:30.393210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:30.393218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:30.393226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:30.393235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:30.393243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.393251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.393260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.393310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:30.393433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:30.393484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:30.393537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:30.393587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:30.393637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:30.393687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:30.393735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:30.393804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:30.393856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:30.393906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:30.393955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.394003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.394052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.394104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:30.394178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:30.394237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:30.394296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:30.394349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:30.394409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:30.394458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:30.394523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:30.394573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:30.394649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:30.394699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:30.394756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:30.394810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:30.394869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:30.394920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:30.394978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:30.395029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:30.395088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:30.395139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:30.395199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:30.395250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:30.395309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:30.396742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.396832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.396889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.396945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.396993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.397053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.397609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:30.417438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:30.433835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:30.433892Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:30.433912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:30.433936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:30.433962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 118 [2:7561400437317346142:3448]
2025-10-15T10:55:30.434019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:30.434088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:30.434104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.434133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.434146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.434208Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:30.434234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:30.434260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:30.444911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.444962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.444976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.444990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:30.445302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:30.445332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.445588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 118, pipe: [1:7561400434517640872:3423]
2025-10-15T10:55:30.445709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 118
2025-10-15T10:55:30.445804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 118
2025-10-15T10:55:30.445488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.445691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.445933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:30.446018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400434517640872:3423], now have 1 active actors on pipe
2025-10-15T10:55:30.446044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400434517640710:2467], now have 1 active actors on pipe
2025-10-15T10:55:30.446066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400434517640865:3626], now have 1 active actors on pipe
2025-10-15T10:55:30.446137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:30.446160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:30.446197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400437317346136:3448]
2025-10-15T10:55:30.446212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400437317346136:3448]
2025-10-15T10:55:30.446224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400437317346136:3448]
2025-10-15T10:55:30.446267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:30.446313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:30.446329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:30.446341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:30.446365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:30.446568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:30.446585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:30.446673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:30.446708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.446729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.446740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:30.446778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.446830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:30.446973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400437317346136:3448]
2025-10-15T10:55:30.447004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:30.447050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:30.447041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:30.447571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:30.447603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:30.447700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:30.448332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 119 partition: 0 MaxSeqNo: 46 sessionId: src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0
2025-10-15T10:55:30.451971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b8493d-20dd0df3-c9142ce7-8aa45d0d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:30.507135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0] Write session: try to update token
2025-10-15T10:55:30.507203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:30.512768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:30.512809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:30.512849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400437317346136:3448]
2025-10-15T10:55:30.512985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:30.513001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:30.515073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:30.516744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:30.522592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:30.523902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:30.525684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:30.526204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:30.530887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.530940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.530957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.631228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.631261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.631273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.656871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId: src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:30.677208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:30.677243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:30.677254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:30.677263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:30.677305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400437317346136:3448]
2025-10-15T10:55:30.677333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400437317346136:3448]
2025-10-15T10:55:30.677348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400437317346136:3448]
2025-10-15T10:55:30.677463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:30.677484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:30.677874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:30.677918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:30.677946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:30.679187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:30.685861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:30.824830Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:30.827189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:30.827219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:30.827911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400434517640872:3423]
2025-10-15T10:55:30.828007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:30.828127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:30.828163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:30.828191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:30.839232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 119 reason: error at write: Disconnected sessionId: src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0
2025-10-15T10:55:30.839607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 119 sessionId: src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0 is DEAD
2025-10-15T10:55:30.839947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:30.840008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0] Write session will restart in 0.006013s
2025-10-15T10:55:30.840170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0] Write session: Do CDS request
2025-10-15T10:55:30.840226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:30.853420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:30.866003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:30.866033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 120
2025-10-15T10:55:30.866459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:30.866585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:30.866606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:30.866615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:30.869020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 120 sessionId:  describe result for acl check
2025-10-15T10:55:30.869132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:30.869149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:30.869159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:30.869175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400434517640915:3634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:30.871700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400434517640915:3634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:30.882973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400434517640915:3634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:30.895992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400434517640915:3634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:30.896035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400434517640915:3634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:30.896052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400434517640915:3634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:30.896085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:30.928002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400434517641071:3423]
2025-10-15T10:55:30.932876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:30.937272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:30.938158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:30.938188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:30.938232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:30.938478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:30.938697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400437317346328:3456]
2025-10-15T10:55:30.940958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:30.944344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:30.944592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:30.946152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:30.946538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:30.946548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:30.946556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:30.946564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:30.946571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:30.946578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:30.946585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:30.946593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:30.946599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:30.946607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:30.946614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:30.946697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.946703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.946711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.946775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:30.946898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:30.946947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:30.946996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:30.947044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:30.947095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:30.947143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:30.947191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:30.947239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:30.947286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:30.949003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:30.949091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.949148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.949204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.949260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:30.949339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:30.949424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:30.949490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:30.949544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:30.949602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:30.949654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:30.949710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:30.949762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:30.949817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:30.949865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:30.949925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:30.949976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:30.950033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:30.950078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:30.950131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:30.950181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:30.950239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:30.950283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:30.950338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:30.950385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:30.950436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:30.950481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.950532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:30.950577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.950630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:30.950688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.950740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:30.951240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:30.981379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:30.997389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:30.997440Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:30.997457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:30.997478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:30.997501Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 119 [2:7561400437317346328:3456]
2025-10-15T10:55:30.997553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:30.997607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:30.997630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.997644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.997660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.997712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:30.997736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:30.997759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:31.015337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.015390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.015403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.015414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:31.015694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:31.015711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.015847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.016018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.016231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:31.016301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400437317346323:3456]
2025-10-15T10:55:31.016316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400437317346323:3456]
2025-10-15T10:55:31.016328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400437317346323:3456]
2025-10-15T10:55:31.016369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:31.016443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:31.016530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:31.016546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:31.016557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:31.016618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:31.016637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:31.016783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400437317346323:3456]
2025-10-15T10:55:31.016807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:31.016846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:31.016897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400434517641071:3423], now have 1 active actors on pipe
2025-10-15T10:55:31.016922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400434517640894:2467], now have 1 active actors on pipe
2025-10-15T10:55:31.016943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400434517640991:3634], now have 1 active actors on pipe
2025-10-15T10:55:31.017678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 119, pipe: [1:7561400434517641071:3423]
2025-10-15T10:55:31.017800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 119
2025-10-15T10:55:31.017900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 119
2025-10-15T10:55:31.018218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:31.018259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:31.018336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2f839fb-5f679594-8332d401-b2e398bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:31.018365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.018389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.018400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:31.018431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.018468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:31.018532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:31.021825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 120 partition: 0 MaxSeqNo: 46 sessionId: src_id|b2f839fb-5f679594-8332d401-b2e398bf_0
2025-10-15T10:55:31.022648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea0245e4-625d919d-5c817ca5-f3c96902_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b2f839fb-5f679594-8332d401-b2e398bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:31.021428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:31.021469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:31.021536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:31.048866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f839fb-5f679594-8332d401-b2e398bf_0] Write session: try to update token
2025-10-15T10:55:31.048932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f839fb-5f679594-8332d401-b2e398bf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:31.085103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:31.085155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:31.085178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:31.085205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:31.085258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400437317346323:3456]
2025-10-15T10:55:31.085302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400437317346323:3456]
2025-10-15T10:55:31.085338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400437317346323:3456]
2025-10-15T10:55:31.085463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:31.085525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:31.085542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:31.085552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:31.085565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:31.087771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:31.146374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId: src_id|b2f839fb-5f679594-8332d401-b2e398bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:31.180310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:31.239036Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:31.250926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:31.250983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:31.251059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:31.251075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:31.251123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400437317346323:3456]
2025-10-15T10:55:31.251419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:31.251690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400434517641071:3423]
2025-10-15T10:55:31.251778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:31.251797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:31.251890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:31.251912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:31.305507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 120 reason: error at write: Disconnected sessionId: src_id|b2f839fb-5f679594-8332d401-b2e398bf_0
2025-10-15T10:55:31.305788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 120 sessionId: src_id|b2f839fb-5f679594-8332d401-b2e398bf_0 is DEAD
2025-10-15T10:55:31.306142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f839fb-5f679594-8332d401-b2e398bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:31.306212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f839fb-5f679594-8332d401-b2e398bf_0] Write session will restart in 0.007776s
2025-10-15T10:55:31.306361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f839fb-5f679594-8332d401-b2e398bf_0] Write session: Do CDS request
2025-10-15T10:55:31.306412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f839fb-5f679594-8332d401-b2e398bf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:31.318839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:31.318869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 121
2025-10-15T10:55:31.319054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f839fb-5f679594-8332d401-b2e398bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:31.319696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:31.319833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:31.319853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:31.319868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:31.321104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 121 sessionId:  describe result for acl check
2025-10-15T10:55:31.321216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:31.321234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:31.321242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:31.321257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400438812608518:3645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:31.325344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400438812608518:3645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:31.332447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400438812608518:3645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:31.338013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:31.343130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:31.343616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400438812608518:3645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:31.343655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400438812608518:3645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:31.343671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400438812608518:3645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:31.343697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:31.344187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:31.344221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:31.344262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:31.344510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:31.344681Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400441612313836:3467]
2025-10-15T10:55:31.346733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:31.347597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:31.347789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:31.349084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:31.349376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:31.349384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:31.349390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:31.349396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:31.349402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:31.349407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:31.349414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:31.349420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:31.349426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:31.349432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:31.349437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:31.349443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.349450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.349455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.349500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:31.349596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:31.349639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:31.349681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:31.349720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:31.349760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:31.349802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:31.349844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:31.349883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:31.349924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:31.349964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:31.350024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.350065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.350105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.350143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:31.350201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:31.350251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:31.350297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:31.350339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:31.350385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:31.350424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:31.350472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:31.350514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:31.350561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:31.350599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:31.350658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:31.350700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:31.350744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:31.350784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:31.350829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:31.350873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:31.350920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:31.350960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:31.351007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:31.351048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:31.351095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:31.351134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.351197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.351252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.351302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.351339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.352845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.353333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:31.355572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400438812608578:3423]
2025-10-15T10:55:31.374181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:31.405168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:31.405211Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:31.405225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:31.405240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:31.405259Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 120 [2:7561400441612313836:3467]
2025-10-15T10:55:31.405299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:31.405347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:31.405358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.405368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.405377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.405419Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:31.405438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:31.405457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:31.406469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.406491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.406502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.406512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:31.406780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:31.406805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.406921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.407077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.407272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:31.407341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400438812608411:2467], now have 1 active actors on pipe
2025-10-15T10:55:31.407515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400438812608575:3645], now have 1 active actors on pipe
2025-10-15T10:55:31.407540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400438812608578:3423], now have 1 active actors on pipe
2025-10-15T10:55:31.407560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400441612313831:3467]
2025-10-15T10:55:31.407573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400441612313831:3467]
2025-10-15T10:55:31.407584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400441612313831:3467]
2025-10-15T10:55:31.407615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:31.407679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:31.407837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:31.407851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:31.407954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400441612313831:3467]
2025-10-15T10:55:31.407970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:31.408074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:31.408089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:31.408100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:31.408123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:31.411887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 120
2025-10-15T10:55:31.411993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 120
2025-10-15T10:55:31.412054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 120, pipe: [1:7561400438812608578:3423]
2025-10-15T10:55:31.415449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:31.415490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:31.415583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:31.415613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.415628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.415638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:31.415670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.415712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:31.415761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:31.417482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:31.417512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:31.417572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:31.417850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 121 partition: 0 MaxSeqNo: 46 sessionId: src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0
2025-10-15T10:55:31.418516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f839fb-5f679594-8332d401-b2e398bf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:31.438790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0] Write session: try to update token
2025-10-15T10:55:31.438848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:31.487513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:31.487541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:31.487557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:31.487568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:31.487601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400441612313831:3467]
2025-10-15T10:55:31.487627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400441612313831:3467]
2025-10-15T10:55:31.487651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400441612313831:3467]
2025-10-15T10:55:31.487762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:31.487777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:31.487795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:31.487797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:31.488946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:31.507455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:31.555448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId: src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:31.591263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:31.639945Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:31.642256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:31.642283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:31.643119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400438812608578:3423]
2025-10-15T10:55:31.643134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:31.643299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:31.643320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:31.654203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 121 reason: error at write: Disconnected sessionId: src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0
2025-10-15T10:55:31.654548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 121 sessionId: src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0 is DEAD
2025-10-15T10:55:31.659615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:31.659667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0] Write session will restart in 0.006651s
2025-10-15T10:55:31.659769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0] Write session: Do CDS request
2025-10-15T10:55:31.659798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:31.668800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:31.670659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:31.674255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:31.674301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 122
2025-10-15T10:55:31.674848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:31.675038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:31.675074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:31.675091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:31.676789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 122 sessionId:  describe result for acl check
2025-10-15T10:55:31.676892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:31.676913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:31.676921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:31.676937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400438812608605:3649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:31.679306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400438812608605:3649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:31.687898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400438812608605:3649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:31.703876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400438812608605:3649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:31.703918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400438812608605:3649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:31.703931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400438812608605:3649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:31.703958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:31.718353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:31.720514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:31.721294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:31.721322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:31.721362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:31.721583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:31.721776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400441612314014:3469]
2025-10-15T10:55:31.724064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:31.724961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:31.725165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:31.726300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:31.726632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:31.726665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:31.726671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:31.726677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:31.726681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:31.726686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:31.726693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:31.726701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:31.726708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:31.726715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:31.726721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:31.726727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.726733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.726740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.726785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:31.726899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:31.726943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:31.726990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:31.727038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:31.727089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:31.727138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:31.727182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:31.727230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:31.727292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:31.727340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:31.727401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.727461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.727511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.727555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:31.727623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:31.727684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:31.727739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:31.727789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:31.727840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:31.727881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:31.727935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:31.727982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:31.728035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:31.728083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:31.728135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:31.728184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:31.728251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:31.728293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:31.728346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:31.728397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:31.728453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:31.728498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:31.728553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:31.728601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:31.728656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:31.728707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.728754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.728801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.728850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.728908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.728967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.729447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:31.743575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400438812608762:3423]
2025-10-15T10:55:31.747539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:31.759314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:31.759369Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:31.759386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:31.759404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:31.759427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 121 [2:7561400441612314014:3469]
2025-10-15T10:55:31.759475Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:31.759529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:31.759543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.759555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.759565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.759609Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:31.759627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:31.759645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:31.760802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.760825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.760837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.760847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:31.761105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:31.761131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:31.761264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:31.761459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:31.761407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 121, pipe: [1:7561400438812608762:3423]
2025-10-15T10:55:31.761436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 121
2025-10-15T10:55:31.761514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 121
2025-10-15T10:55:31.761704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:31.761787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400438812608762:3423], now have 1 active actors on pipe
2025-10-15T10:55:31.761821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400438812608590:2467], now have 1 active actors on pipe
2025-10-15T10:55:31.761840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400438812608710:3649], now have 1 active actors on pipe
2025-10-15T10:55:31.761862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400441612314009:3469]
2025-10-15T10:55:31.761875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400441612314009:3469]
2025-10-15T10:55:31.761888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400441612314009:3469]
2025-10-15T10:55:31.761914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:31.761947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:31.761960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:31.761970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:31.761980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:31.762140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:31.762164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:31.762236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:31.762261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:31.762373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400441612314009:3469]
2025-10-15T10:55:31.762405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:31.762462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:31.762475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:31.762501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.762518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.762527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:31.762560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.762594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:31.762725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:31.763526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:31.763548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:31.763621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:31.765609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 122 partition: 0 MaxSeqNo: 46 sessionId: src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0
2025-10-15T10:55:31.766264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deeea222-f93e8c3a-96ce9f13-23e1904f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:31.793521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0] Write session: try to update token
2025-10-15T10:55:31.793575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:31.812751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:31.812776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:31.812806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400441612314009:3469]
2025-10-15T10:55:31.812908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:31.812921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:31.814974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:31.816759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:31.818209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:31.820117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:31.822580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:31.823076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:31.890795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.890825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.890836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.890886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:31.890899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:31.890911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:31.890923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:31.890958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400441612314009:3469]
2025-10-15T10:55:31.890984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400441612314009:3469]
2025-10-15T10:55:31.891003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400441612314009:3469]
2025-10-15T10:55:31.891126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:31.891128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:31.891150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:31.891160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:31.891206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:31.892331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:31.908387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId: src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:31.932532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:32.033264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:32.034939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.034968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.035544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400438812608762:3423]
2025-10-15T10:55:32.035561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:32.035626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:32.035636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:32.035763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:32.046131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 122 reason: error at write: Disconnected sessionId: src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0
2025-10-15T10:55:32.046415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 122 sessionId: src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0 is DEAD
2025-10-15T10:55:32.046925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:32.047007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0] Write session will restart in 0.009698s
2025-10-15T10:55:32.047156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0] Write session: Do CDS request
2025-10-15T10:55:32.047218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:32.064964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:32.064996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 123
2025-10-15T10:55:32.065299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:32.065923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:32.066071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:32.066097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:32.066114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:32.067308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 123 sessionId:  describe result for acl check
2025-10-15T10:55:32.067426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:32.067436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:32.067445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:32.067459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400443107576094:3654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:32.070009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400443107576094:3654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:32.075859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400443107576094:3654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:32.081926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400443107576094:3654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:32.081961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400443107576094:3654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:32.081976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400443107576094:3654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:32.082002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:32.112579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:32.115064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:32.115828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:32.115853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:32.115892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:32.116124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:32.116302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400445907281500:3477]
2025-10-15T10:55:32.118403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:32.119214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:32.119439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:32.120616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:32.120926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.120945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.120953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.120960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.120966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.120972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.120978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.120983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.120990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.120996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.121002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.121008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.121015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.121022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.121064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.121162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.121207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.121253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.121297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.121351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.121404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.121452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.121501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.121553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.121603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.121652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.121701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.121742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.121783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.121853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.121912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.121968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.122017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.122068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.122114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.122165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.122212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.122262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.122318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.122366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.122411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.122461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.122504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.122550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.122593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.122645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.122698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.122750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.122794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.122865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.122911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.122961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.123005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.123058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.123099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.123149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.124234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:32.135770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400443107576250:3423]
2025-10-15T10:55:32.139669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:32.150230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:32.150267Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:32.150282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:32.150301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:32.150322Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 122 [2:7561400445907281500:3477]
2025-10-15T10:55:32.150370Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:32.150422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:32.150435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.150447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.150460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.150504Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:32.150524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:32.150544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:32.152487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.152510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.152525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.152536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:32.152794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:32.152818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.152943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.153069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 122, pipe: [1:7561400443107576250:3423]
2025-10-15T10:55:32.153117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.153076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 122
2025-10-15T10:55:32.153164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 122
2025-10-15T10:55:32.153335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:32.153411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400443107576250:3423], now have 1 active actors on pipe
2025-10-15T10:55:32.153438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400443107576078:2467], now have 1 active actors on pipe
2025-10-15T10:55:32.153457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400443107576121:3654], now have 1 active actors on pipe
2025-10-15T10:55:32.153498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.153524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.153568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400445907281495:3477]
2025-10-15T10:55:32.153582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400445907281495:3477]
2025-10-15T10:55:32.153594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400445907281495:3477]
2025-10-15T10:55:32.153631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:32.153697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:32.153719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:32.153733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:32.153743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:32.153870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:32.153892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:32.153949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:32.153979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.153993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.154003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:32.154031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.154064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:32.154190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400445907281495:3477]
2025-10-15T10:55:32.154228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:32.154255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:32.154276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:32.154766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.154792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.154846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:32.155116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 123 partition: 0 MaxSeqNo: 46 sessionId: src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0
2025-10-15T10:55:32.155804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2f1ce9-3eb77297-615f0e28-5be08a4b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:32.186793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0] Write session: try to update token
2025-10-15T10:55:32.186849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:32.260555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:32.260591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:32.260604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:32.260617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:32.260652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400445907281495:3477]
2025-10-15T10:55:32.260680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400445907281495:3477]
2025-10-15T10:55:32.260704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400445907281495:3477]
2025-10-15T10:55:32.260860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:32.260896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:32.260936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:32.260938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.260952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.260965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.261014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:32.261034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:32.262078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:32.308416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId: src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:32.329817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:32.422961Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:32.436158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.436209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.436274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:32.436287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:32.436329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400445907281495:3477]
2025-10-15T10:55:32.436518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:32.436885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:32.437608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:32.448875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 123 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0
2025-10-15T10:55:32.449230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 123 sessionId: src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0 is DEAD
2025-10-15T10:55:32.449768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:32.449831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0] Write session will restart in 0.006927s
2025-10-15T10:55:32.449975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0] Write session: Do CDS request
2025-10-15T10:55:32.450033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:32.461291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400443107576250:3423]
2025-10-15T10:55:32.461380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:32.463597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:32.463627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 124
2025-10-15T10:55:32.463730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:32.464391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:32.464516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:32.464539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:32.464548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:32.465818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 124 sessionId:  describe result for acl check
2025-10-15T10:55:32.465931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:32.465950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:32.465960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:32.465977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400443107576295:3665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:32.468750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400443107576295:3665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:32.499412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400443107576295:3665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:32.509154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400443107576295:3665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:32.509194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400443107576295:3665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:32.509209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400443107576295:3665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:32.509235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:32.524392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:32.527638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:32.528474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:32.528507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:32.528550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:32.528799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:32.528992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400445907281708:3481]
2025-10-15T10:55:32.531226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:32.532187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:32.532418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:32.533751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:32.534118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.534137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.534145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.534152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.534159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.534166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.534173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.534179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.534187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.534194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.534201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.534209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.534216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.534224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.534274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.534396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.534449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.534502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.534558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.534614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.534728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.534785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.534841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.534902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.534952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.535007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.535061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.535117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.535166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.535241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.535309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.535423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.535481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.535551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.535601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.535666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.535716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.535780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.535842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.535900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.535957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.536012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.536058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.536129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.536195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.536256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.536304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.536359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.536410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.536480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.536533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.536587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.536645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.536708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.536775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.536835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.537417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:32.553362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:32.561748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400443107576459:3423]
2025-10-15T10:55:32.564129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:32.564169Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:32.564183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:32.564200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:32.564222Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 123 [2:7561400445907281708:3481]
2025-10-15T10:55:32.564267Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:32.564314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:32.564326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.564337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.564347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.564388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:32.564408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:32.564427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:32.581834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.581872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.581883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.581891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:32.582169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:32.582190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.582303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.582484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.582683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:32.582603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 123
2025-10-15T10:55:32.582723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 123, pipe: [1:7561400443107576459:3423]
2025-10-15T10:55:32.582758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400443107576376:3665], now have 1 active actors on pipe
2025-10-15T10:55:32.582783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400443107576459:3423], now have 1 active actors on pipe
2025-10-15T10:55:32.582799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400443107576291:2467], now have 1 active actors on pipe
2025-10-15T10:55:32.582820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400445907281695:3481]
2025-10-15T10:55:32.582799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 123
2025-10-15T10:55:32.582833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400445907281695:3481]
2025-10-15T10:55:32.582843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400445907281695:3481]
2025-10-15T10:55:32.582877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:32.582929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:32.582944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:32.582959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:32.582970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:32.583085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:32.583109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:32.583228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.583249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.583291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400445907281695:3481]
2025-10-15T10:55:32.583324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:32.583368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:32.583437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:32.583472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.583485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.583493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:32.583522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.583554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:32.583631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:32.584135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.584175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.584229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:32.584484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 124 partition: 0 MaxSeqNo: 46 sessionId: src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0
2025-10-15T10:55:32.585227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7141b8e-8e29a93a-8a71b397-eaee0a92_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:32.606557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0] Write session: try to update token
2025-10-15T10:55:32.606624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:32.640269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:32.640329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:32.640347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:32.640378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:32.640421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400445907281695:3481]
2025-10-15T10:55:32.640450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400445907281695:3481]
2025-10-15T10:55:32.640477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400445907281695:3481]
2025-10-15T10:55:32.640668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:32.640703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:32.640872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:32.640916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:32.640945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:32.642000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:32.707099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId: src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:32.728025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:32.794976Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:32.796620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.796667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.797739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:32.797809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:32.799604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400443107576459:3423]
2025-10-15T10:55:32.799794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:32.807320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 124 reason: error at write: Disconnected sessionId: src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0
2025-10-15T10:55:32.808413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:32.808466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0] Write session will restart in 0.008654s
2025-10-15T10:55:32.808617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0] Write session: Do CDS request
2025-10-15T10:55:32.808658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:32.807993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 124 sessionId: src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0 is DEAD
2025-10-15T10:55:32.814832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:32.823678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:32.823822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:32.823884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 125
2025-10-15T10:55:32.824365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:32.824513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:32.824532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:32.824543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:32.825929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 125 sessionId:  describe result for acl check
2025-10-15T10:55:32.826005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:32.826012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:32.826018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:32.826031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400443107576499:3672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:32.828344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400443107576499:3672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:32.834434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400443107576499:3672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:32.843188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400443107576499:3672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:32.843229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400443107576499:3672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:32.843246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400443107576499:3672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:32.843279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:32.896924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:32.901482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:32.902385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:32.902415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:32.903616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:32.903894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:32.904047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400445907281892:3490]
2025-10-15T10:55:32.905660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:32.905649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400443107576655:3423]
2025-10-15T10:55:32.906835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:32.907081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:32.908249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:32.908529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.908535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.908540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.908545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.908550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.908555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.908560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.908564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.908568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.908572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.908577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.908582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.908588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.908592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.908640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.908732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.908770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.908805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.908840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.908886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.908930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.908966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.909002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.909037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.909078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.909147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.909183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.909219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.909251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.909301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:32.909345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.909395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:32.909438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.909480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:32.909512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.909550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:32.909584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.909630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:32.909665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.909705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:32.909737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.909776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:32.909808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.909844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:32.909880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.909922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:32.909966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.910007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:32.910040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.910077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:32.910108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.910155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.910190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.910226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.910258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.910297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.910704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:32.929630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:32.952718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:32.952770Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:32.952786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:32.952803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:32.952823Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 124 [2:7561400445907281892:3490]
2025-10-15T10:55:32.952866Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:32.952913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:32.952926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.952936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.952945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.952986Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:32.953005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:32.953023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:32.954136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.954160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.954174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.954183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:32.954441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:32.954467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:32.954594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:32.954790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:32.955005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:32.955083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400443107576655:3423], now have 1 active actors on pipe
2025-10-15T10:55:32.955110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400443107576534:3672], now have 1 active actors on pipe
2025-10-15T10:55:32.955129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400443107576485:2467], now have 1 active actors on pipe
2025-10-15T10:55:32.955149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400445907281886:3490]
2025-10-15T10:55:32.955170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400445907281886:3490]
2025-10-15T10:55:32.955182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400445907281886:3490]
2025-10-15T10:55:32.955252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:32.955262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:32.955271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:32.955410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:32.955504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:32.955249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 124, pipe: [1:7561400443107576655:3423]
2025-10-15T10:55:32.955378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 124
2025-10-15T10:55:32.955458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 124
2025-10-15T10:55:32.955669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:32.955696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:32.955798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400445907281886:3490]
2025-10-15T10:55:32.955830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:32.955992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:32.956141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.956174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.956270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:32.956301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.956317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.956327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:32.956358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.956395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:32.956448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:32.956968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.956989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.957052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:32.957392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 125 partition: 0 MaxSeqNo: 46 sessionId: src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0
2025-10-15T10:55:32.959260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e65e4e7d-47e4c29c-8610275a-d5e8920d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:32.988449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0] Write session: try to update token
2025-10-15T10:55:32.988515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:33.047287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:33.047320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:33.047335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:33.052123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:33.052189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400445907281886:3490]
2025-10-15T10:55:33.052218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400445907281886:3490]
2025-10-15T10:55:33.052248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400445907281886:3490]
2025-10-15T10:55:33.052437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:33.052475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:33.052507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:33.052662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:33.052688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:33.053740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:33.162426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId: src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:33.183515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:33.199967Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:33.202623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:33.202658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:33.203230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400443107576655:3423]
2025-10-15T10:55:33.203241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:33.203262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:33.203367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:33.217882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 125 reason: error at write: Disconnected sessionId: src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0
2025-10-15T10:55:33.218275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 125 sessionId: src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0 is DEAD
2025-10-15T10:55:33.218699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:33.218761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0] Write session will restart in 0.007082s
2025-10-15T10:55:33.218925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0] Write session: Do CDS request
2025-10-15T10:55:33.218980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:33.224525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:33.231876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:33.231938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 126
2025-10-15T10:55:33.232181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:33.232978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:33.233242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:33.233293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:33.233309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:33.234850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 126 sessionId:  describe result for acl check
2025-10-15T10:55:33.234952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:33.234963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:33.234972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:33.234987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400447402543995:3678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:33.237640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400447402543995:3678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:33.243883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400447402543995:3678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:33.250469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400447402543995:3678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:33.250509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400447402543995:3678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:33.250526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400447402543995:3678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:33.250558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:33.268412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:33.271161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:33.271843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:33.271866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:33.271905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:33.272104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:33.272281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400450202249381:3494]
2025-10-15T10:55:33.274056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:33.274765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:33.274888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:33.275755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:33.275976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:33.275990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:33.275996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:33.276001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:33.276006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:33.276011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:33.276017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:33.276023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:33.276028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:33.276033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:33.276039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:33.276047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.276052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.276057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.276102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:33.276189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:33.276220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:33.276261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:33.276302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:33.276356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:33.276396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:33.276427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:33.276460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:33.276494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:33.276525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:33.276559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.276601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.276633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.276662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:33.276708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:33.276748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:33.276783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:33.276812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:33.276856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:33.276903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:33.276954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:33.276990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:33.277027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:33.277069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:33.277113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:33.277145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:33.277195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:33.277237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:33.277274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:33.277302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:33.277336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:33.277369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:33.277405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:33.277439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:33.277480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:33.277523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.277565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.277612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.277654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.277692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.277742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.278228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:33.302093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:33.303681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400447402544156:3423]
2025-10-15T10:55:33.313509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 125
2025-10-15T10:55:33.313585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 125
2025-10-15T10:55:33.313604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 125, pipe: [1:7561400447402544156:3423]
2025-10-15T10:55:33.311434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:33.311479Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:33.311498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:33.311517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:33.311539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 125 [2:7561400450202249381:3494]
2025-10-15T10:55:33.311587Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:33.311646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:33.311660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.311672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.311684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.311729Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:33.311748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:33.311768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:33.312849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.312863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.312878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.312889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:33.313184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:33.313201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.313340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.313524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.313769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:33.313848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400447402543973:2467], now have 1 active actors on pipe
2025-10-15T10:55:33.313872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400447402544033:3678], now have 1 active actors on pipe
2025-10-15T10:55:33.313893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400447402544156:3423], now have 1 active actors on pipe
2025-10-15T10:55:33.313932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400450202249375:3494]
2025-10-15T10:55:33.313945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400450202249375:3494]
2025-10-15T10:55:33.313956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400450202249375:3494]
2025-10-15T10:55:33.313998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:33.314053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:33.314069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:33.314079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:33.314081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:33.314102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:33.314143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:33.314315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:33.314329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:33.314463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:33.314488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.314503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.314513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:33.314541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.314574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:33.314608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400450202249375:3494]
2025-10-15T10:55:33.314638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:33.314678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:33.314721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:33.315708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 126 partition: 0 MaxSeqNo: 46 sessionId: src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0
2025-10-15T10:55:33.315318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:33.315339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:33.315420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:33.316456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|655bb363-a7ef343f-a81538cf-e74ee8fb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:33.336382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0] Write session: try to update token
2025-10-15T10:55:33.336450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:33.389349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:33.389406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:33.389421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:33.389451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:33.389488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400450202249375:3494]
2025-10-15T10:55:33.389506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400450202249375:3494]
2025-10-15T10:55:33.389523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400450202249375:3494]
2025-10-15T10:55:33.389652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:33.389696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:33.389708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:33.389721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:33.389735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:33.390884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:33.414173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId: src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:33.435113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:33.534295Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:33.551545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:33.551594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:33.551664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:33.551678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:33.551721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400450202249375:3494]
2025-10-15T10:55:33.551913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:33.552116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400447402544156:3423]
2025-10-15T10:55:33.552155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:33.552252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:33.552265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:33.552343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:33.563908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 126 reason: error at write: Disconnected sessionId: src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0
2025-10-15T10:55:33.564208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 126 sessionId: src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0 is DEAD
2025-10-15T10:55:33.564584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:33.564632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0] Write session will restart in 0.008921s
2025-10-15T10:55:33.564782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0] Write session: Do CDS request
2025-10-15T10:55:33.564837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:33.578833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:33.578873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 127
2025-10-15T10:55:33.579061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:33.579646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:33.579832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:33.579859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:33.579870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:33.581143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 127 sessionId:  describe result for acl check
2025-10-15T10:55:33.581244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:33.581255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:33.581262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:33.581274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400447402544178:3682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:33.584293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400447402544178:3682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:33.590889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400447402544178:3682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:33.600772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400447402544178:3682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:33.600815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400447402544178:3682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:33.600833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400447402544178:3682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:33.600863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:33.627178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:33.629713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:33.630368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:33.630393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:33.630426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:33.630616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:33.630771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400450202249575:3498]
2025-10-15T10:55:33.632402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:33.633145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:33.633323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:33.634269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:33.634501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:33.634512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:33.634518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:33.634522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:33.634527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:33.634531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:33.634535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:33.634539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:33.634543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:33.634547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:33.634551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:33.634555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.634560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.634565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.634598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:33.634693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:33.634740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:33.634778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:33.634815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:33.634862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:33.634897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:33.634953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:33.634993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:33.635030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:33.635065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:33.635101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.635136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.635173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.635226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:33.635290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:33.635372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:33.635433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:33.635479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:33.635530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:33.635564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:33.635608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:33.635647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:33.635712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:33.635765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:33.635808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:33.635842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:33.635889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:33.635939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:33.635995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:33.636047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:33.636103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:33.636150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:33.636206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:33.636256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:33.636312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:33.636360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.636415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.636461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.636497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.636526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.636560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.636912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:33.652358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400447402544341:3423]
2025-10-15T10:55:33.653510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:33.663532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:33.663572Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:33.663583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:33.663599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:33.663625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 126 [2:7561400450202249575:3498]
2025-10-15T10:55:33.663672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:33.663736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:33.663755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.663768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.663779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.663828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:33.663855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:33.663879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:33.665434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.665462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.665476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.665487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:33.665721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:33.665739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:33.665839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:33.666009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:33.666049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 126, pipe: [1:7561400447402544341:3423]
2025-10-15T10:55:33.666108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 126
2025-10-15T10:55:33.666167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 126
2025-10-15T10:55:33.666269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:33.666353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400447402544341:3423], now have 1 active actors on pipe
2025-10-15T10:55:33.666381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400447402544210:3682], now have 1 active actors on pipe
2025-10-15T10:55:33.666401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400447402544163:2467], now have 1 active actors on pipe
2025-10-15T10:55:33.666454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:33.666478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:33.666513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400450202249569:3498]
2025-10-15T10:55:33.666528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400450202249569:3498]
2025-10-15T10:55:33.666535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400450202249569:3498]
2025-10-15T10:55:33.666560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:33.666602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:33.666620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:33.666625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:33.666631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:33.666773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:33.666788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:33.666833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:33.666855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.666866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.666871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:33.666897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.666924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:33.667045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400450202249569:3498]
2025-10-15T10:55:33.667071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:33.667105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:33.667116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:33.667574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:33.667598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:33.667647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:33.667960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 127 partition: 0 MaxSeqNo: 46 sessionId: src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0
2025-10-15T10:55:33.668692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1778a68-e993b4c-c7c20874-bae9e33c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:33.687260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0] Write session: try to update token
2025-10-15T10:55:33.687303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:33.715602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:33.715638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:33.715671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400450202249569:3498]
2025-10-15T10:55:33.715806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:33.715812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:33.717886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:33.720487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:33.723405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:33.729899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:33.734785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:33.735444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:33.763490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId: src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:33.778566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:33.778605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:33.778618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:33.778629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:33.778670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400450202249569:3498]
2025-10-15T10:55:33.778707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400450202249569:3498]
2025-10-15T10:55:33.778730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400450202249569:3498]
2025-10-15T10:55:33.778845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:33.778892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.778896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:33.778909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.778920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.778926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:33.778967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:33.778988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:33.780018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:33.788252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:33.924063Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:33.927101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:33.927145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:33.927829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:33.934097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400447402544341:3423]
2025-10-15T10:55:33.934262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:33.981189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:33.981253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0] Write session will restart in 0.008700s
2025-10-15T10:55:33.981382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0] Write session: Do CDS request
2025-10-15T10:55:33.981410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:33.979325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:33.980511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 127 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0
2025-10-15T10:55:33.980882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 127 sessionId: src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0 is DEAD
2025-10-15T10:55:33.995827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:34.007259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:34.007296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 128
2025-10-15T10:55:34.015525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:34.015685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:34.015702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:34.015712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:34.017395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 128 sessionId:  describe result for acl check
2025-10-15T10:55:34.017527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:34.017540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:34.017549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:34.017567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400451697511751:3694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:34.020462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400451697511751:3694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:34.032195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400451697511751:3694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:34.039011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400451697511806:3423]
2025-10-15T10:55:34.056861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400451697511751:3694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:34.056904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400451697511751:3694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:34.056922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400451697511751:3694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:34.056958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:34.064260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:34.071088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:34.072063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:34.072083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:34.072139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:34.072416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:34.072604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400454497217071:3504]
2025-10-15T10:55:34.074725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:34.079649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:34.079922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:34.081226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:34.081564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:34.081574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:34.081581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:34.081587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:34.081594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:34.081602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:34.081609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:34.081617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:34.081623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:34.081630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:34.081637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:34.081644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.081651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.081657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.081704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:34.081818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:34.081868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:34.081919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:34.081964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:34.082009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:34.082051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:34.082094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:34.082137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:34.082182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:34.082228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:34.082272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.082317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.082358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.082401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:34.082464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:34.082522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:34.082572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:34.082617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:34.082667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:34.082726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:34.082778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:34.082824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:34.082893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:34.082939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:34.082992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:34.083039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:34.083100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:34.083145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:34.083197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:34.083242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:34.083294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:34.083335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:34.083425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:34.083474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:34.083525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:34.083571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.083655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.083704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.083759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.083804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.083859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.084403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:34.160912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:34.179163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:34.179211Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:34.179229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:34.179248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:34.179274Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 127 [2:7561400454497217071:3504]
2025-10-15T10:55:34.179326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:34.183553Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:34.183588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.183601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.183614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.183680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:34.183707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:34.183732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:34.185589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.185608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.185622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.185634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:34.185917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:34.185935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.186083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.186267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.186494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:34.186565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400454497217066:3504]
2025-10-15T10:55:34.186582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400454497217066:3504]
2025-10-15T10:55:34.186597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400454497217066:3504]
2025-10-15T10:55:34.186641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:34.186733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:34.188110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 127, pipe: [1:7561400451697511806:3423]
2025-10-15T10:55:34.188208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 127
2025-10-15T10:55:34.188274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 127
2025-10-15T10:55:34.187546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:34.187572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:34.187585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:34.191647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:34.191705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:34.191880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400451697511806:3423], now have 1 active actors on pipe
2025-10-15T10:55:34.191906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400451697511837:3694], now have 1 active actors on pipe
2025-10-15T10:55:34.191927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400447402544391:2467], now have 1 active actors on pipe
2025-10-15T10:55:34.191980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:34.192009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:34.192070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400454497217066:3504]
2025-10-15T10:55:34.192108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:34.192239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:34.192274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.192295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.192307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:34.192348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.192395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:34.192489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:34.192970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:34.199486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:34.199533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:34.199626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:34.203921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 128 partition: 0 MaxSeqNo: 46 sessionId: src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0
2025-10-15T10:55:34.204781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed39649-1d1f99f4-b1abd6a7-8842f1f0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:34.253253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0] Write session: try to update token
2025-10-15T10:55:34.253312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:34.284526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.284554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.284566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.400477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:34.400508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:34.400521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:34.400534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:34.400569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400454497217066:3504]
2025-10-15T10:55:34.400595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400454497217066:3504]
2025-10-15T10:55:34.400617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400454497217066:3504]
2025-10-15T10:55:34.400769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:34.400827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:34.400849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.400857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:34.400863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.400873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.400914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:34.400934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:34.402045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:34.421194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId: src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:34.442191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:34.542430Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:34.565609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:34.565657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:34.565727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:34.565740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:34.565779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400454497217066:3504]
2025-10-15T10:55:34.565947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:34.566240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400451697511806:3423]
2025-10-15T10:55:34.566321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:34.566334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:34.566347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:34.566365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:34.633379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:34.636400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 128 reason: error at write: Disconnected sessionId: src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0
2025-10-15T10:55:34.636746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 128 sessionId: src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0 is DEAD
2025-10-15T10:55:34.637146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:34.637220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0] Write session will restart in 0.007296s
2025-10-15T10:55:34.637365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0] Write session: Do CDS request
2025-10-15T10:55:34.637411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:34.637523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:34.638841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:34.638877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:34.638927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:34.639235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:34.639465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400454497217273:3515]
2025-10-15T10:55:34.643475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:34.644643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:34.644849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:34.645743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:34.646000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:34.646014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:34.646020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:34.646026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:34.646033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:34.646039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:34.646046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:34.646052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:34.646059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:34.646065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:34.646072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:34.646078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.646084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.646090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.646133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:34.646236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:34.646279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:34.646321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:34.646368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:34.646413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:34.646457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:34.646502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:34.646543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:34.646588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:34.646630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:34.646670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.646727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.646769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.646801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:34.646839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:34.646891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:34.646938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:34.646980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:34.647029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:34.647067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:34.647114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:34.647155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:34.647206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:34.647250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:34.647299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:34.647338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:34.647401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:34.647444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:34.647504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:34.647552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:34.647600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:34.647641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:34.647697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:34.647745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:34.647795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:34.647838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.647903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.647946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.648003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.648050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.648108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.648571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:34.649255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:34.649284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 129
2025-10-15T10:55:34.649424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:34.649860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:34.649991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:34.650020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:34.650030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:34.651477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 129 sessionId:  describe result for acl check
2025-10-15T10:55:34.651581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:34.651597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:34.651608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:34.651625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400451697512032:3703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:34.654102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400451697512032:3703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:34.660603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400451697512032:3703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:34.666655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400451697512058:3423]
2025-10-15T10:55:34.667623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:34.667942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400451697512032:3703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:34.667985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400451697512032:3703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:34.668002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400451697512032:3703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:34.668031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:34.676253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:34.676290Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:34.676302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:34.676319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:34.676337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 128 [2:7561400454497217273:3515]
2025-10-15T10:55:34.676376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:34.676437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:34.676453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.676467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.676475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.676513Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:34.676532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:34.676548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:34.677595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.677620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.677636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.677649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:34.677929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:34.677958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:34.678121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:34.678194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 128, pipe: [1:7561400451697512058:3423]
2025-10-15T10:55:34.678224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 128
2025-10-15T10:55:34.678316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 128
2025-10-15T10:55:34.678333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:34.678582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:34.678666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400451697512058:3423], now have 1 active actors on pipe
2025-10-15T10:55:34.678709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400451697511881:2467], now have 1 active actors on pipe
2025-10-15T10:55:34.678732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400451697512062:3703], now have 1 active actors on pipe
2025-10-15T10:55:34.678797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:34.678824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:34.678863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400454497217267:3515]
2025-10-15T10:55:34.678883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400454497217267:3515]
2025-10-15T10:55:34.678895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400454497217267:3515]
2025-10-15T10:55:34.678931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:34.678975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:34.678998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:34.679009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:34.679010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:34.679194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:34.679218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:34.679286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:34.679321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.679342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.679374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:34.679410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.679456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:34.679596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400454497217267:3515]
2025-10-15T10:55:34.679629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:34.679655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:34.679676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:34.680152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:34.680187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:34.680252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:34.682988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 129 partition: 0 MaxSeqNo: 46 sessionId: src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0
2025-10-15T10:55:34.683778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaf22e3-141cbdc8-ddef35f8-36f250b8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:34.703577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0] Write session: try to update token
2025-10-15T10:55:34.703643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:34.741886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:34.741983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:34.742066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400454497217267:3515]
2025-10-15T10:55:34.742245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:34.742404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:34.745048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:34.746913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:34.748450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:34.749783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:34.752250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:34.773721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:34.773897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:34.773914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:34.773929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:34.773940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:34.773983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400454497217267:3515]
2025-10-15T10:55:34.774029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400454497217267:3515]
2025-10-15T10:55:34.774059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400454497217267:3515]
2025-10-15T10:55:34.774218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:34.774217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:34.774244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:34.774253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:34.774282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:34.775309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:34.798718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId: src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:34.820839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:34.929481Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:34.931653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:34.931686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:34.932243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400451697512058:3423]
2025-10-15T10:55:34.932263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:34.932354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:34.932373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:34.932372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:34.948677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 129 reason: error at write: Disconnected sessionId: src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0
2025-10-15T10:55:34.948987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 129 sessionId: src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0 is DEAD
2025-10-15T10:55:34.949395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:34.949438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0] Write session will restart in 0.006550s
2025-10-15T10:55:34.949568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0] Write session: Do CDS request
2025-10-15T10:55:34.949611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:34.962968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:34.963031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 130
2025-10-15T10:55:34.963116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:34.963896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:34.964066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:34.964099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:34.964116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:34.965559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 130 sessionId:  describe result for acl check
2025-10-15T10:55:34.965683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:34.965699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:34.965710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:34.965730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400451697512095:3707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:34.968653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400451697512095:3707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:34.975887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400451697512095:3707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:34.984890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400451697512095:3707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:34.984930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400451697512095:3707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:34.984947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400451697512095:3707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:34.984977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:34.997150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:35.000055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:35.000717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:35.000738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:35.000771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:35.000956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:35.001116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400458792184757:3517]
2025-10-15T10:55:35.002954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:35.003760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:35.003922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:35.004792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:35.005023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.005035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.005039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.005044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.005047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.005053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.005058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.005063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.005068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.005072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.005077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.005084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.005091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.005098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.005140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.005219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.005268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.005316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.005359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.005410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.005447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.005477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.005511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.005542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.005578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.005622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.005657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.005692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.005720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.005769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.005813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.005862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.005899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.005941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.005972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.006007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.006040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.006080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.006121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.006166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.006200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.006236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.006270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.006310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.006355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.006405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.006439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.006478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.006511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.006551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.006591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.006634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.006667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.006726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.006755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.006794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.007204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:35.023136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:35.032704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400455992479552:3423]
2025-10-15T10:55:35.032857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:35.032902Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:35.032918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:35.032935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:35.032959Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 129 [2:7561400458792184757:3517]
2025-10-15T10:55:35.033012Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:35.033067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:35.033082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.033094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.033106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.033156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:35.033189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:35.033210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:35.034856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.034882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.034894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.034906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:35.035174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:35.035198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.035337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.035369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 129
2025-10-15T10:55:35.035437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 129, pipe: [1:7561400455992479552:3423]
2025-10-15T10:55:35.035452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 129
2025-10-15T10:55:35.035540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.035765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:35.035855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400451697512199:3707], now have 1 active actors on pipe
2025-10-15T10:55:35.035883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400451697512076:2467], now have 1 active actors on pipe
2025-10-15T10:55:35.035903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400455992479552:3423], now have 1 active actors on pipe
2025-10-15T10:55:35.035950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:35.035978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:35.036033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400454497217456:3517]
2025-10-15T10:55:35.036053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400454497217456:3517]
2025-10-15T10:55:35.036067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400454497217456:3517]
2025-10-15T10:55:35.036102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:35.036132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:35.036154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:35.036166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:35.036186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:35.036362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:35.036386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:35.036449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:35.036484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.036507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.036517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:35.036552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.036592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:35.036725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400454497217456:3517]
2025-10-15T10:55:35.036754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:35.036778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:35.036798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:35.037358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:35.037386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:35.037446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:35.037646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 130 partition: 0 MaxSeqNo: 46 sessionId: src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0
2025-10-15T10:55:35.038458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f505eb-a7e7e504-1cbc6834-3951ae0b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:35.058235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0] Write session: try to update token
2025-10-15T10:55:35.058297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:35.092898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:35.092934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:35.092948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:35.092966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:35.093002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400454497217456:3517]
2025-10-15T10:55:35.093028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400454497217456:3517]
2025-10-15T10:55:35.093055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400454497217456:3517]
2025-10-15T10:55:35.093177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:35.093215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:35.093245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:35.093275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:35.093298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:35.095784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:35.138216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId: src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:35.157325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:35.242575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:35.262729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:35.262792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:35.263871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:35.263899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:35.263946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400454497217456:3517]
2025-10-15T10:55:35.266109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:35.268022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:35.271588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:35.271639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:35.272527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:35.272729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400455992479552:3423]
2025-10-15T10:55:35.313369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:35.313440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0] Write session will restart in 0.008167s
2025-10-15T10:55:35.313586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0] Write session: Do CDS request
2025-10-15T10:55:35.313639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:35.310592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 130 reason: error at write: Disconnected sessionId: src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0
2025-10-15T10:55:35.310994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 130 sessionId: src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0 is DEAD
2025-10-15T10:55:35.331999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:35.339358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:35.339389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 131
2025-10-15T10:55:35.348404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:35.348558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:35.348575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:35.348583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:35.356516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 131 sessionId:  describe result for acl check
2025-10-15T10:55:35.356641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:35.356652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:35.356662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:35.356680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400455992479614:3718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:35.363529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400455992479614:3718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:35.374075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400455992479633:3423]
2025-10-15T10:55:35.385992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400455992479614:3718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:35.406422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400455992479614:3718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:35.406466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400455992479614:3718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:35.406483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400455992479614:3718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:35.406515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:35.430015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:35.434168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:35.434893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:35.434910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:35.434952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:35.435203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:35.435415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400458792184969:3527]
2025-10-15T10:55:35.437447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:35.438869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:35.439104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:35.440297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:35.440661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.440670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.440677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.440683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.440690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.440696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.440703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.440709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.440714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.440720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.440726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.440733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.440740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.440746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.440790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.440892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.440938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.440982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.441021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.441065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.441105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.441149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.441190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.441235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.441276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.441318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.441363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.441429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.441473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.441537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.441589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.441640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.441687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.441736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.441778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.441828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.441874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.441924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.441967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.442015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.442058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.442109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.442170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.442226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.442272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.442324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.442367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.442433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.442479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.442529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.442571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.442620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.442666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.442732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.442775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.442825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.443326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:35.473123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:35.490163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:35.490207Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:35.490222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:35.490243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:35.490271Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 130 [2:7561400458792184969:3527]
2025-10-15T10:55:35.490322Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:35.490377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:35.490390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.490402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.490413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.490462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:35.490483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:35.490505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:35.492505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.492534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.492547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.492558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:35.492816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:35.492841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.492976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.493250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.493194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 130
2025-10-15T10:55:35.493372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 130
2025-10-15T10:55:35.493463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 130, pipe: [1:7561400455992479633:3423]
2025-10-15T10:55:35.493521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:35.493605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400455992479576:2467], now have 1 active actors on pipe
2025-10-15T10:55:35.493625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400455992479721:3718], now have 1 active actors on pipe
2025-10-15T10:55:35.493640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400455992479633:3423], now have 1 active actors on pipe
2025-10-15T10:55:35.493659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400458792184960:3527]
2025-10-15T10:55:35.493669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400458792184960:3527]
2025-10-15T10:55:35.493676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400458792184960:3527]
2025-10-15T10:55:35.493704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:35.493754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:35.493770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:35.493774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:35.493781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:35.493788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:35.493821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:35.493944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:35.493961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:35.494098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34f79823-5cddb106-404b9f05-b1252bd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:35.494126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.494138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.494146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:35.494180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.494222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:35.494255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400458792184960:3527]
2025-10-15T10:55:35.494285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:35.494310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:35.494358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:35.494818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:35.494848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:35.494921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:35.495210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 131 partition: 0 MaxSeqNo: 46 sessionId: src_id|34f79823-5cddb106-404b9f05-b1252bd6_0
2025-10-15T10:55:35.495954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fafb0e-d84e7f6e-69b5d869-811dd18c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|34f79823-5cddb106-404b9f05-b1252bd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:35.517428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34f79823-5cddb106-404b9f05-b1252bd6_0] Write session: try to update token
2025-10-15T10:55:35.517492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34f79823-5cddb106-404b9f05-b1252bd6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:35.525232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:35.525266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:35.525304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400458792184960:3527]
2025-10-15T10:55:35.525444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:35.525432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:35.527686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:35.529183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:35.530638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:35.551384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:35.553069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:35.553645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:35.589267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:35.589303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:35.589318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:35.589330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:35.589371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400458792184960:3527]
2025-10-15T10:55:35.589398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400458792184960:3527]
2025-10-15T10:55:35.589421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400458792184960:3527]
2025-10-15T10:55:35.589587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:35.589620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:35.590813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:35.590856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:35.590882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:35.596939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:35.623032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId: src_id|34f79823-5cddb106-404b9f05-b1252bd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:35.645424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1015 10:55:35.665425838  827091 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:55:35.744229Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:35.746410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:35.746441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:35.747169Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:35.747068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:35.747204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:35.747216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:35.789387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34f79823-5cddb106-404b9f05-b1252bd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:35.789445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34f79823-5cddb106-404b9f05-b1252bd6_0] Write session will restart in 0.008387s
2025-10-15T10:55:35.789590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34f79823-5cddb106-404b9f05-b1252bd6_0] Write session: Do CDS request
2025-10-15T10:55:35.789622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34f79823-5cddb106-404b9f05-b1252bd6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:35.788721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 131 reason: error at write: Disconnected sessionId: src_id|34f79823-5cddb106-404b9f05-b1252bd6_0
2025-10-15T10:55:35.789011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 131 sessionId: src_id|34f79823-5cddb106-404b9f05-b1252bd6_0 is DEAD
2025-10-15T10:55:35.796513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400455992479633:3423]
2025-10-15T10:55:35.804617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34f79823-5cddb106-404b9f05-b1252bd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:35.807671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:35.807702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 132
2025-10-15T10:55:35.810135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:35.810303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:35.810327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:35.810337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:35.814862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 132 sessionId:  describe result for acl check
2025-10-15T10:55:35.814997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:35.815007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:35.815015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:35.815032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400455992479815:3723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:35.819295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400455992479815:3723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:35.833966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400455992479815:3723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:35.849238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400455992479815:3723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:35.849283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400455992479815:3723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:35.849302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400455992479815:3723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:35.849338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:35.889979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:35.893253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:35.894055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:35.894072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:35.894114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:35.894365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:35.894542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400458792185174:3534]
2025-10-15T10:55:35.896929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400455992479978:3423]
2025-10-15T10:55:35.898125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:35.900265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:35.900520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:35.901889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:35.902233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.902242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.902249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.902257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.902263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.902269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.902276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.902282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.902288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.902295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.902302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.902308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.902315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.902321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.902366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.902470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.902520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.902565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.902608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.902655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.902697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.902751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.902793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.902838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.902882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.902926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.902972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.903018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.903058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.903122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:35.903176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.903229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:35.903277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.903328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:35.904642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.904726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:35.904778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.904830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:35.904874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.904925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:35.904970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.905023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:35.905066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.905118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:35.905166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.905216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:35.905261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.905313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:35.905358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.905409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:35.905454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.905504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.905548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.905600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.905643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.905695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.906183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:35.926677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:35.949646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:35.949693Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:35.949707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:35.949723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:35.949743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 131 [2:7561400458792185174:3534]
2025-10-15T10:55:35.949789Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:35.949839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:35.949852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.949863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.949874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.949915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:35.949935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:35.949952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:35.952255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.952278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.952290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.952300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:35.952551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:35.952566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:35.952698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:35.952857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:35.953060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:35.953124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400458792185169:3534]
2025-10-15T10:55:35.953135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400458792185169:3534]
2025-10-15T10:55:35.953146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400458792185169:3534]
2025-10-15T10:55:35.953175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:35.953237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:35.953393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:35.953408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:35.953507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400458792185169:3534]
2025-10-15T10:55:35.953524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:35.953775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:35.953786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:35.953796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:35.953817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:35.955235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400455992479782:2467], now have 1 active actors on pipe
2025-10-15T10:55:35.955268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400455992479905:3723], now have 1 active actors on pipe
2025-10-15T10:55:35.955286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400455992479978:3423], now have 1 active actors on pipe
2025-10-15T10:55:35.955330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 131
2025-10-15T10:55:35.955458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 131
2025-10-15T10:55:35.955520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 131, pipe: [1:7561400455992479978:3423]
2025-10-15T10:55:35.955865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:35.955895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:35.955963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:35.955992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.956015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.956025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:35.956066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.956103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:35.956145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:35.957071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:35.957096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:35.957159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:35.957591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 132 partition: 0 MaxSeqNo: 46 sessionId: src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0
2025-10-15T10:55:35.958595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34f79823-5cddb106-404b9f05-b1252bd6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:35.996498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0] Write session: try to update token
2025-10-15T10:55:35.996555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:36.056604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:36.056633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:36.056646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:36.056655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:36.056687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400458792185169:3534]
2025-10-15T10:55:36.056709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400458792185169:3534]
2025-10-15T10:55:36.056732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400458792185169:3534]
2025-10-15T10:55:36.056930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.056942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.056952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.056990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:36.057007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:36.058020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:36.059823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:36.059861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:36.059885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:36.110516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId: src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:36.130764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:36.197970Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:36.206874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:36.206908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:36.206959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:36.206968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:36.207006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400458792185169:3534]
2025-10-15T10:55:36.207224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:36.207494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:36.207636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400455992479978:3423]
2025-10-15T10:55:36.207709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:36.207778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:36.252535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 132 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0
2025-10-15T10:55:36.252835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 132 sessionId: src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0 is DEAD
2025-10-15T10:55:36.253240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:36.253297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0] Write session will restart in 0.008731s
2025-10-15T10:55:36.253441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0] Write session: Do CDS request
2025-10-15T10:55:36.253511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:36.266766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:36.266795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 133
2025-10-15T10:55:36.266923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:36.267423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:36.267559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:36.267597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:36.267607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:36.267910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:36.268852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 133 sessionId:  describe result for acl check
2025-10-15T10:55:36.268954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:36.268970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:36.268979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:36.268994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400460287447441:3731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:36.271060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:36.272356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400460287447441:3731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:36.272590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:36.272645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:36.272716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:36.273257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:36.273621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400463087152656:3538]
2025-10-15T10:55:36.275731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:36.276630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:36.276853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:36.278100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:36.278432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:36.278450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:36.278456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:36.278462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:36.278468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:36.278474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:36.278480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:36.278487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:36.278493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:36.278499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:36.278505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:36.278512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.278518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.278536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.278577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:36.278726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:36.278779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:36.278828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:36.278870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:36.278919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:36.278972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:36.279015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:36.279062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:36.279118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:36.279167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:36.279218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.279265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.279312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.279381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:36.279446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:36.279514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:36.279570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:36.279621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:36.279673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:36.279721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:36.279773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:36.279823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:36.279871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:36.279920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:36.279976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:36.280026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:36.280081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:36.280123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:36.280178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:36.280228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:36.280280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:36.280326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:36.280384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:36.280434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:36.280487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:36.280532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.280583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.280630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.280619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400460287447441:3731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:36.280687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.280728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.280783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.281253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:36.291424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400460287447441:3731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:36.291469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400460287447441:3731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:36.291488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400460287447441:3731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:36.291520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:36.297425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:36.308086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400460287447487:3423]
2025-10-15T10:55:36.319813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:36.319853Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:36.319868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:36.319884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:36.319903Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 132 [2:7561400463087152656:3538]
2025-10-15T10:55:36.319948Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:36.319997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:36.320010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.320020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.320028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.320070Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:36.320091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:36.320108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:36.321173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.321199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.321210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.321219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:36.321473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:36.321498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.321621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.321794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.321844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 132
2025-10-15T10:55:36.321860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 132
2025-10-15T10:55:36.321923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 132, pipe: [1:7561400460287447487:3423]
2025-10-15T10:55:36.322013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:36.322088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400460287447486:3731], now have 1 active actors on pipe
2025-10-15T10:55:36.322117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400460287447291:2467], now have 1 active actors on pipe
2025-10-15T10:55:36.322139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400460287447487:3423], now have 1 active actors on pipe
2025-10-15T10:55:36.322204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:36.322228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:36.322260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400463087152651:3538]
2025-10-15T10:55:36.322278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400463087152651:3538]
2025-10-15T10:55:36.322291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400463087152651:3538]
2025-10-15T10:55:36.322326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:36.322395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:36.322393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:36.322410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:36.322423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:36.322565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:36.322587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:36.322645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:36.322676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.322698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.322707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:36.322751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.322791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:36.322917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400463087152651:3538]
2025-10-15T10:55:36.322951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:36.322996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:36.323004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:36.323571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:36.323598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:36.323663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:36.323952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 133 partition: 0 MaxSeqNo: 46 sessionId: src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0
2025-10-15T10:55:36.324738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5d23b5-7251a891-5092cd74-99db86e4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:36.345076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0] Write session: try to update token
2025-10-15T10:55:36.345136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:36.406361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:36.406400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:36.406414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:36.406426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:36.406481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400463087152651:3538]
2025-10-15T10:55:36.406509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400463087152651:3538]
2025-10-15T10:55:36.406533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400463087152651:3538]
2025-10-15T10:55:36.406680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:36.406747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:36.406773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:36.406778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:36.406797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:36.407859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:36.419879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId: src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:36.441350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:36.550954Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:36.575234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:36.575262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:36.574084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:36.574138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:36.574205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:36.574219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:36.574260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400463087152651:3538]
2025-10-15T10:55:36.574663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:36.574995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:36.576624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:36.576860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400460287447487:3423]
2025-10-15T10:55:36.614422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 133 reason: error at write: Disconnected sessionId: src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0
2025-10-15T10:55:36.614788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 133 sessionId: src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0 is DEAD
2025-10-15T10:55:36.618710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:36.618767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0] Write session will restart in 0.006490s
2025-10-15T10:55:36.618875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0] Write session: Do CDS request
2025-10-15T10:55:36.618907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:36.633125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:36.635061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:36.635096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 134
2025-10-15T10:55:36.639586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:36.639738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:36.639754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:36.639766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:36.641213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 134 sessionId:  describe result for acl check
2025-10-15T10:55:36.641321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:36.641333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:36.641343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:36.641360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400460287447513:3736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:36.645155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400460287447513:3736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:36.653856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400460287447513:3736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:36.656526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:55:36.656570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-15T10:55:36.675269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400460287447574:3423]
2025-10-15T10:55:36.686888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400460287447513:3736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:36.686932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400460287447513:3736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:36.686949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400460287447513:3736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:36.686982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:36.723409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:36.726738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:36.727643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:36.727663Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:36.727713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:36.727940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:36.728059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400463087152872:3548]
2025-10-15T10:55:36.741678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:36.743052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:36.743364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:36.744788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:36.745142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:36.745162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:36.745168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:36.745176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:36.745182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:36.745188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:36.745196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:36.745203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:36.745209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:36.745217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:36.745224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:36.745231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.745238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.745245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.745291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:36.745419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:36.745469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:36.745514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:36.745562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:36.745614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:36.745667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:36.745716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:36.745765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:36.745814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:36.745864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:36.745910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.745958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.746002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.746051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:36.746122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:36.746180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:36.746237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:36.746287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:36.746343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:36.746391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:36.746447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:36.746500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:36.746556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:36.746600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:36.746658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:36.746707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:36.746774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:36.746823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:36.746881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:36.746936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:36.747001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:36.747043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:36.747102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:36.747152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:36.747208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:36.747255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.747325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.751630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.751723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.751780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.751848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.752401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:36.797417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:36.807187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:36.807221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:36.807233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:36.807247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:36.807269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 133 [2:7561400463087152872:3548]
2025-10-15T10:55:36.807313Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:36.807372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:36.807385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.807398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.807407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.807458Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:36.807478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:36.807498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:36.809099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.809125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.809137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.809149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:36.809399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:36.809422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:36.809553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:36.809755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:36.809994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:36.810080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400460287447574:3423], now have 1 active actors on pipe
2025-10-15T10:55:36.810108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400460287447604:3736], now have 1 active actors on pipe
2025-10-15T10:55:36.810133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400460287447497:2467], now have 1 active actors on pipe
2025-10-15T10:55:36.810164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400463087152866:3548]
2025-10-15T10:55:36.810177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400463087152866:3548]
2025-10-15T10:55:36.810190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400463087152866:3548]
2025-10-15T10:55:36.810230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:36.810267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:36.810285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:36.810295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:36.810318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:36.810338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:36.810384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:36.810561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:36.810581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:36.809795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 133, pipe: [1:7561400460287447574:3423]
2025-10-15T10:55:36.809870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 133
2025-10-15T10:55:36.809971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 133
2025-10-15T10:55:36.810784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:36.810817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.810834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.810843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:36.810877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.810922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:36.810960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400463087152866:3548]
2025-10-15T10:55:36.810995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:36.811037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:36.811141Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:55:36.811275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:36.811842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:36.811870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:36.811933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:36.811955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 3 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:55:36.812088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:55:36.812243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 134 partition: 0 MaxSeqNo: 46 sessionId: src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0
2025-10-15T10:55:36.812987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ddb8e3-2ed6d302-f467a0a6-926e89a5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:36.836162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0] Write session: try to update token
2025-10-15T10:55:36.836218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:36.848025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:36.848061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:36.848095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400463087152866:3548]
2025-10-15T10:55:36.848219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:36.848219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:36.851174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:36.852857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:36.854455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:36.857691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:36.859957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:36.860580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:36.920217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.920245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.920258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.920327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:36.920344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:36.920358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:36.920369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:36.920411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400463087152866:3548]
2025-10-15T10:55:36.920439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400463087152866:3548]
2025-10-15T10:55:36.920460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400463087152866:3548]
2025-10-15T10:55:36.920584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:36.920602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:36.920623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:36.920623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:36.920650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:36.924250Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:36.942832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId: src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:36.966614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:37.069748Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:37.071429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:37.071472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:37.072000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400460287447574:3423]
2025-10-15T10:55:37.072155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:37.072169Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:37.072179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:37.118230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:37.118377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 134 reason: error at write: Disconnected sessionId: src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0
2025-10-15T10:55:37.118724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 134 sessionId: src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0 is DEAD
2025-10-15T10:55:37.119115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:37.119167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0] Write session will restart in 0.005974s
2025-10-15T10:55:37.119323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0] Write session: Do CDS request
2025-10-15T10:55:37.119386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:37.129908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:37.136924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:37.136952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 135
2025-10-15T10:55:37.137410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:37.137544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:37.137566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:37.137577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:37.138857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 135 sessionId:  describe result for acl check
2025-10-15T10:55:37.138967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:37.138983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:37.138993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:37.139009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400464582415167:3747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:37.140268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:37.141593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400464582415167:3747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:37.143118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:37.143972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:37.143998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:37.144035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:37.144261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:37.144435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400467382120373:3556]
2025-10-15T10:55:37.146613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:37.146652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400464582415167:3747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:37.147366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:37.147556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:37.148811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:37.149108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:37.149125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:37.149132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:37.149138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:37.149144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:37.149150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:37.149156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:37.149163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:37.149169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:37.149175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:37.149182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:37.149189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.149195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.149202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.149246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:37.149343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:37.149386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:37.149429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:37.149477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:37.149525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:37.149572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:37.149619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:37.149659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:37.149704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:37.149749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:37.149796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.149841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.149886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.149926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:37.149990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:37.150046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:37.150103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:37.150151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:37.150205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:37.150250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:37.150303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:37.150352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:37.150407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:37.150455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:37.150510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:37.150557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:37.150610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:37.150665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:37.150743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:37.150811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:37.150883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:37.150932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:37.150997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:37.151050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:37.151100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:37.151148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.151200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.151248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.151301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.151358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.151411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.151952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:37.153561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400464582415167:3747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:37.153603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400464582415167:3747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:37.153618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400464582415167:3747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:37.153648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:37.167297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:37.172331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400464582415202:3423]
2025-10-15T10:55:37.176831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:37.176869Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:37.176885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:37.176905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:37.176928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 134 [2:7561400467382120373:3556]
2025-10-15T10:55:37.176977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:37.177031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:37.177048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.177061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.177071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.177117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:37.177148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:37.177170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:37.178630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.178652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.178666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.178678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:37.178963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:37.178988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.179119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.179215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 134, pipe: [1:7561400464582415202:3423]
2025-10-15T10:55:37.179298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.179337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 134
2025-10-15T10:55:37.179435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 134
2025-10-15T10:55:37.179547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:37.179634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400464582415202:3423], now have 1 active actors on pipe
2025-10-15T10:55:37.179670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400464582415200:3747], now have 1 active actors on pipe
2025-10-15T10:55:37.179700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400464582415075:2467], now have 1 active actors on pipe
2025-10-15T10:55:37.179744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:37.179765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:37.179809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400467382120368:3556]
2025-10-15T10:55:37.179829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400467382120368:3556]
2025-10-15T10:55:37.179843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400467382120368:3556]
2025-10-15T10:55:37.179887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:37.179920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:37.179947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:37.179978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:37.179981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:37.180167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:37.180192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:37.180254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:37.180287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.180303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.180314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:37.180349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.180388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:37.180510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400467382120368:3556]
2025-10-15T10:55:37.180539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:37.180560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:37.180581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:37.181002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:37.181027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:37.181083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:37.181358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 135 partition: 0 MaxSeqNo: 46 sessionId: src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0
2025-10-15T10:55:37.182223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dffb5df-371d9277-179c6c90-455b3bbd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:37.200295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0] Write session: try to update token
2025-10-15T10:55:37.200351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:37.247249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:37.247290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:37.247328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400467382120368:3556]
2025-10-15T10:55:37.247478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:37.247541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:37.249762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:37.252582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:37.254718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:37.256519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:37.258361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:37.279917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId: src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:37.315853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:37.318718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:37.318897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.318916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.318928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.318985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:37.319005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:37.319020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:37.319032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:37.319074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400467382120368:3556]
2025-10-15T10:55:37.319105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400467382120368:3556]
2025-10-15T10:55:37.319134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400467382120368:3556]
2025-10-15T10:55:37.319247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:37.319309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:37.319321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:37.319343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:37.319364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:37.319400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:37.319423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:37.320420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:37.473795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:37.475788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400464582415202:3423]
2025-10-15T10:55:37.475822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:37.475900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:37.475915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:37.478552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:37.533804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 135 reason: error at write: Disconnected sessionId: src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0
2025-10-15T10:55:37.534163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 135 sessionId: src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0 is DEAD
2025-10-15T10:55:37.535845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:37.535884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0] Write session will restart in 0.006998s
2025-10-15T10:55:37.535997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0] Write session: Do CDS request
2025-10-15T10:55:37.536031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:37.551009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:37.552096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:37.552133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 136
2025-10-15T10:55:37.552617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:37.552767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:37.552790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:37.552801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:37.554204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 136 sessionId:  describe result for acl check
2025-10-15T10:55:37.554320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:37.554340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:37.554351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:37.554368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400464582415306:3755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:37.557214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400464582415306:3755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:37.565310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400464582415306:3755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:37.572703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400464582415306:3755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:37.572751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400464582415306:3755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:37.572768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400464582415306:3755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:37.572802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:37.575587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:37.575770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400464582415420:3423]
2025-10-15T10:55:37.580373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:37.581288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:37.581322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:37.581367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:37.581636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:37.581831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400467382120586:3562]
2025-10-15T10:55:37.584089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:37.585035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:37.585259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:37.586587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:37.586926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:37.586944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:37.586950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:37.586957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:37.586965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:37.586974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:37.586981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:37.586987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:37.586993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:37.587000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:37.587007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:37.587015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.587021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.587027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.587073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:37.587183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:37.587236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:37.587289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:37.587339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:37.587408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:37.587458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:37.587504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:37.587549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:37.587602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:37.587655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:37.587706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.587759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.587809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.587859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:37.587941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:37.588012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:37.588077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:37.588127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:37.588183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:37.588240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:37.588305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:37.588362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:37.588417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:37.588469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:37.588523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:37.588576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:37.588636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:37.588689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:37.588744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:37.588796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:37.588856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:37.588906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:37.588962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:37.589011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:37.589069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:37.589134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.589194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.589250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.589308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.589355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.589412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.589954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:37.621254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:37.630461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:37.630515Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:37.630534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:37.630554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:37.630580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 135 [2:7561400467382120586:3562]
2025-10-15T10:55:37.630636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:37.630703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:37.630718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.630731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.630755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.630808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:37.630842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:37.630870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:37.631937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.631967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.631981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.631994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:37.632302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:37.632333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:37.632566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 135, pipe: [1:7561400464582415420:3423]
2025-10-15T10:55:37.632682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 135
2025-10-15T10:55:37.632701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 135
2025-10-15T10:55:37.632489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:37.632702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:37.632972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:37.633081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400464582415420:3423], now have 1 active actors on pipe
2025-10-15T10:55:37.633124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400464582415238:2467], now have 1 active actors on pipe
2025-10-15T10:55:37.633152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400464582415418:3755], now have 1 active actors on pipe
2025-10-15T10:55:37.633202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:37.633224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:37.633279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400467382120580:3562]
2025-10-15T10:55:37.633305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400467382120580:3562]
2025-10-15T10:55:37.633318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400467382120580:3562]
2025-10-15T10:55:37.633354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:37.633406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:37.633429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:37.633439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:37.633452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:37.633632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:37.633668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:37.633742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:37.633781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.633801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.633811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:37.633852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.633905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:37.634022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400467382120580:3562]
2025-10-15T10:55:37.634057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:37.634083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:37.634105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:37.635115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:37.635153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:37.635227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:37.635612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 136 partition: 0 MaxSeqNo: 46 sessionId: src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0
2025-10-15T10:55:37.636440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3b3d7-690ff10d-e4ff0ec1-fa3a28a1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:37.671300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0] Write session: try to update token
2025-10-15T10:55:37.672505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:37.780512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId: src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:37.783261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:37.783295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:37.783312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:37.783325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:37.783383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400467382120580:3562]
2025-10-15T10:55:37.783412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400467382120580:3562]
2025-10-15T10:55:37.783436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400467382120580:3562]
2025-10-15T10:55:37.783616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.783631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.783643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.783757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:37.783782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:37.783946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:37.783978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:37.784007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:37.785218Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:37.816083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:37.940635Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:37.952529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:37.952555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400464582415420:3423]
2025-10-15T10:55:37.952646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:37.952659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:37.951734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:37.951798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:37.951888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:37.951905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:37.951950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400467382120580:3562]
2025-10-15T10:55:37.952140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:37.952547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:37.988613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 136 reason: error at write: Disconnected sessionId: src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0
2025-10-15T10:55:37.989419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:37.989488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0] Write session will restart in 0.006001s
2025-10-15T10:55:37.989709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0] Write session: Do CDS request
2025-10-15T10:55:37.989769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:37.988974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 136 sessionId: src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0 is DEAD
2025-10-15T10:55:38.004301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:38.004365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 137
2025-10-15T10:55:38.004471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:38.005501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:38.005736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:38.005785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:38.005803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:38.007719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 137 sessionId:  describe result for acl check
2025-10-15T10:55:38.007877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:38.007890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:38.007901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:38.007935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400468877382757:3759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:38.010900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400468877382757:3759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:38.022391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400468877382757:3759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:38.038925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400468877382757:3759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:38.038971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400468877382757:3759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:38.038989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400468877382757:3759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:38.039022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:38.055655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400468877382861:3423]
2025-10-15T10:55:38.077923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:38.081210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:38.082051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:38.082088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:38.082130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:38.082391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:38.082606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400471677088086:3564]
2025-10-15T10:55:38.084857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:38.085906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:38.086092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:38.087008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:38.087255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.087267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.087272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.087277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.087282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.087287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.087291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.087296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.087301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.087304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.087309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.087314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.087318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.087323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.087390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.087473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.087518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.087566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.087614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.087673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.087721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.087750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.087782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.087818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.087854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.087887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.087931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.087983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.088035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.088108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.088175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.088238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.088417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.088486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.088535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.088595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.088644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.088686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.088736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.088794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.088845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.088905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.088955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.089014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.089071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.089128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.089177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.089235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.089286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.089344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.089393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.089447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.089499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.089552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.089600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.089661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.090100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:38.122935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:38.134096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:38.134152Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:38.134171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:38.134199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:38.134225Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 136 [2:7561400471677088086:3564]
2025-10-15T10:55:38.134278Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:38.134335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:38.134350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.134362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.134374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.134425Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:38.134449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:38.134473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:38.136104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.136144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.136160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.136170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:38.136476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:38.136501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.136648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.136863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.136824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 136
2025-10-15T10:55:38.136843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 136
2025-10-15T10:55:38.136916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 136, pipe: [1:7561400468877382861:3423]
2025-10-15T10:55:38.137133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:38.137227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400468877382815:3759], now have 1 active actors on pipe
2025-10-15T10:55:38.137257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400464582415444:2467], now have 1 active actors on pipe
2025-10-15T10:55:38.137284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400468877382861:3423], now have 1 active actors on pipe
2025-10-15T10:55:38.137356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:38.137383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:38.137419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400471677088081:3564]
2025-10-15T10:55:38.137439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400471677088081:3564]
2025-10-15T10:55:38.137453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400471677088081:3564]
2025-10-15T10:55:38.137494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:38.137574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:38.137762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:38.137784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:38.137854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:38.137890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.137913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.137923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:38.137960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.138006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:38.138134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400471677088081:3564]
2025-10-15T10:55:38.138156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:38.138199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:38.138273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:38.138295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:38.138307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:38.138332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:38.138861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:38.138892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:38.138952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:38.139342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 137 partition: 0 MaxSeqNo: 46 sessionId: src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0
2025-10-15T10:55:38.143164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a4b06a-dc35f33f-b12ed9dd-1fa51566_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:38.166220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0] Write session: try to update token
2025-10-15T10:55:38.166276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:38.176846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:38.176891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:38.176928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400471677088081:3564]
2025-10-15T10:55:38.177027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:38.177057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:38.179138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:38.180555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:38.182174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:38.192587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:38.195034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:38.195610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:38.249745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.249779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.249787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.249836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:38.249851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:38.249865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:38.249875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:38.249912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400471677088081:3564]
2025-10-15T10:55:38.249937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400471677088081:3564]
2025-10-15T10:55:38.249962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400471677088081:3564]
2025-10-15T10:55:38.250107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:38.250117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:38.250138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:38.250150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:38.250185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:38.255594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:38.262717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId: src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:38.285089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:38.401807Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:38.405249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:38.405299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:38.405911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:38.405941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:38.406836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:38.440746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:38.440900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400468877382861:3423]
2025-10-15T10:55:38.442439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 137 reason: error at write: Disconnected sessionId: src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0
2025-10-15T10:55:38.442782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 137 sessionId: src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0 is DEAD
2025-10-15T10:55:38.443215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:38.443280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0] Write session will restart in 0.006569s
2025-10-15T10:55:38.443419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0] Write session: Do CDS request
2025-10-15T10:55:38.443462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:38.455445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:38.460741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:38.460773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 138
2025-10-15T10:55:38.461927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:38.462051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:38.462067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:38.462076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:38.463641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 138 sessionId:  describe result for acl check
2025-10-15T10:55:38.463759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:38.463775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:38.463786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:38.463805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400468877382985:3771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:38.466439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400468877382985:3771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:38.476195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400468877382985:3771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:38.490586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400468877382985:3771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:38.490626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400468877382985:3771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:38.490643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400468877382985:3771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:38.490670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:38.494622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:38.497417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:38.498240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:38.498272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:38.498314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:38.498557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:38.498742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400471677088308:3573]
2025-10-15T10:55:38.500959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:38.502000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:38.502234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:38.503489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:38.503810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.503818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.503825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.503833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.503840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.503847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.503854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.503861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.503868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.503875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.503881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.503888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.503895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.503901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.503947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.504055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.504116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.504163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.504204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.504250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.504294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.504337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.504381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.504425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.504467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.504513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.504556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.504600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.504648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.504733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.504809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.504864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.504924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.504985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.505050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.505111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.505159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.505217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.505265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.505321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.505381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.505445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.505497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.505553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.505603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.505660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.505707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.505759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.505809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.505867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.505926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.505987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.506030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.506087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.506135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.506205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.506699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:38.525393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:38.540926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400468877383151:3423]
2025-10-15T10:55:38.552364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:38.552411Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:38.552428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:38.552445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:38.552469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 137 [2:7561400471677088308:3573]
2025-10-15T10:55:38.552518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:38.552575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:38.552588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.552600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.552611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.552661Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:38.552684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:38.552708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:38.554469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.554500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.554514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.554525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:38.554819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:38.554846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.554995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.555115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 137, pipe: [1:7561400468877383151:3423]
2025-10-15T10:55:38.555192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.555234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 137
2025-10-15T10:55:38.555329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 137
2025-10-15T10:55:38.555458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:38.555550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400468877383151:3423], now have 1 active actors on pipe
2025-10-15T10:55:38.555580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400468877382970:2467], now have 1 active actors on pipe
2025-10-15T10:55:38.555611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400468877383140:3771], now have 1 active actors on pipe
2025-10-15T10:55:38.555648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400471677088303:3573]
2025-10-15T10:55:38.555667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400471677088303:3573]
2025-10-15T10:55:38.555680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400471677088303:3573]
2025-10-15T10:55:38.555718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:38.555747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:38.555772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:38.555783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:38.555794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:38.555983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:38.556009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:38.556085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:38.556111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:38.556242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400471677088303:3573]
2025-10-15T10:55:38.556280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:38.556316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:38.556343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:38.556365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.556377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.556383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:38.556411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.556441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:38.556540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:38.557150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:38.557187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:38.557254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:38.557546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 138 partition: 0 MaxSeqNo: 46 sessionId: src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0
2025-10-15T10:55:38.558437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de65f8f2-1337ee1-45d2fc68-c6e0774a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:38.577809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0] Write session: try to update token
2025-10-15T10:55:38.577871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:38.652602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:38.652661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:38.652686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:38.652696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:38.652742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400471677088303:3573]
2025-10-15T10:55:38.652772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400471677088303:3573]
2025-10-15T10:55:38.652794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400471677088303:3573]
2025-10-15T10:55:38.652973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.653003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.653015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.653075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:38.653103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:38.654817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:38.655527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:38.655566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:38.655592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:38.678669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId: src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:38.701536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:38.800707Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:38.803250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:38.802355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:38.803323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400468877383151:3423]
2025-10-15T10:55:38.802405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:38.803451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:38.803474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:38.806929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:38.855576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 138 reason: error at write: Disconnected sessionId: src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0
2025-10-15T10:55:38.855948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 138 sessionId: src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0 is DEAD
2025-10-15T10:55:38.859968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:38.860003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0] Write session will restart in 0.006396s
2025-10-15T10:55:38.860106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0] Write session: Do CDS request
2025-10-15T10:55:38.860138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:38.872714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:38.872532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:38.872574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 139
2025-10-15T10:55:38.873409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:38.873562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:38.873586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:38.873595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:38.875130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 139 sessionId:  describe result for acl check
2025-10-15T10:55:38.875244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:38.875260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:38.875269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:38.875284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400468877383331:3778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:38.876161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:38.877889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400468877383331:3778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:38.879229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:38.880100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:38.880131Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:38.880176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:38.880415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:38.880596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400471677088507:3583]
2025-10-15T10:55:38.882907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:38.883940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:38.883549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400468877383331:3778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:38.884155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:38.885604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:38.885936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.885943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.885950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.885967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.885976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.885982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.885989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.885996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.886004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.886011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.886017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.886025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.886032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.886039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.886088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.886199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.886249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.886296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.886342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.886387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.886430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.886475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.886519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.886562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.886606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.886650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.886696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.886741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.886797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.886876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:38.886939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.886996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:38.887048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.887100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:38.887148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.887199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:38.887248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.887298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:38.887342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.888212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:38.888286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.888345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:38.888399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.888461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:38.888514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.888579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:38.888629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.888693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:38.888741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.888794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:38.888840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.888894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.888943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.888997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.889044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.889098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.889623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:38.891162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400468877383331:3778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:38.891206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400468877383331:3778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:38.891224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400468877383331:3778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:38.891258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:38.903407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400468877383364:3423]
2025-10-15T10:55:38.908698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:38.942197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:38.942252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:38.942271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:38.942292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:38.942319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 138 [2:7561400471677088507:3583]
2025-10-15T10:55:38.942376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:38.942443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:38.942460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.942473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.942487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.942537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:38.942562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:38.942586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:38.944055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.944083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.944097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.944110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:38.944416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:38.944437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:38.944594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:38.944818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:38.945065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:38.945158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400468877383174:2467], now have 1 active actors on pipe
2025-10-15T10:55:38.945184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400468877383364:3423], now have 1 active actors on pipe
2025-10-15T10:55:38.945209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400468877383361:3778], now have 1 active actors on pipe
2025-10-15T10:55:38.945235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400471677088501:3583]
2025-10-15T10:55:38.945252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400471677088501:3583]
2025-10-15T10:55:38.945266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400471677088501:3583]
2025-10-15T10:55:38.945322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:38.945428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:38.945641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:38.945661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:38.945789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400471677088501:3583]
2025-10-15T10:55:38.945813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:38.946510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:38.946540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:38.946552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:38.946578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:38.947512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 138
2025-10-15T10:55:38.947614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 138, pipe: [1:7561400468877383364:3423]
2025-10-15T10:55:38.947692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 138
2025-10-15T10:55:38.947962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:38.948010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:38.948100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:38.948134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.948154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.948165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:38.948206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.948255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:38.948304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:38.952073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:38.952123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:38.952232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:38.955591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 139 partition: 0 MaxSeqNo: 46 sessionId: src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0
2025-10-15T10:55:38.956631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eff4845-5123cc26-2d2033fa-972aee5e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:39.041007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:39.041041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:39.041079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400471677088501:3583]
2025-10-15T10:55:39.041201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:39.043022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:39.043693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:39.048715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:39.049850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:39.050989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:39.060712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:39.062663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0] Write session: try to update token
2025-10-15T10:55:39.062724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:39.155606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.155638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.155650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.155715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:39.230414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId: src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:39.274493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:39.276792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:39.276829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:39.276850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:39.276865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:39.276913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400471677088501:3583]
2025-10-15T10:55:39.276943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400471677088501:3583]
2025-10-15T10:55:39.276968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400471677088501:3583]
2025-10-15T10:55:39.277109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:39.277138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.277143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:39.277151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.277162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.277170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:39.277259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:39.277285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:39.277319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:39.277342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:39.278283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:39.423163Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:39.425462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:39.425462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400468877383364:3423]
2025-10-15T10:55:39.425566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:39.425579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:39.425733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:39.442732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 139 reason: error at write: Disconnected sessionId: src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0
2025-10-15T10:55:39.442997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 139 sessionId: src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0 is DEAD
2025-10-15T10:55:39.443396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:39.443463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0] Write session will restart in 0.006268s
2025-10-15T10:55:39.443594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0] Write session: Do CDS request
2025-10-15T10:55:39.443637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:39.458428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:39.460381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:39.460436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 140
2025-10-15T10:55:39.460985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:39.461198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:39.461231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:39.461242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:39.463013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 140 sessionId:  describe result for acl check
2025-10-15T10:55:39.463187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:39.463209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:39.463218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:39.463237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400473172350704:3786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:39.469469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400473172350704:3786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:39.476168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400473172350704:3786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:39.494126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400473172350704:3786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:39.494174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400473172350704:3786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:39.494191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400473172350704:3786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:39.494235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:39.517806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:39.524291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:39.525199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:39.525230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:39.525272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:39.525462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400473172350876:3423]
2025-10-15T10:55:39.525547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:39.525750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400475972056025:3586]
2025-10-15T10:55:39.528210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:39.529137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:39.529373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:39.530721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:39.531083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:39.531102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:39.531109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:39.531117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:39.531124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:39.531131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:39.531139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:39.531146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:39.531153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:39.531162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:39.531170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:39.531177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.531184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.531202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.531254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:39.531416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:39.531474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:39.531539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:39.531593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:39.531643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:39.531693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:39.531742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:39.531801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:39.531857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:39.531917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:39.531979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.532042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.532097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.532151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:39.532232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:39.532309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:39.532372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:39.532442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:39.532504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:39.532558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:39.532633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:39.532688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:39.532753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:39.532816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:39.532878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:39.532945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:39.533009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:39.533059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:39.533126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:39.533190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:39.533255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:39.533314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:39.533379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:39.533442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:39.533497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:39.533565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.533628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.533690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.533756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.533817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.533887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.534528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:39.555408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:39.576760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:39.576805Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:39.576821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:39.576840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:39.576865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 139 [2:7561400475972056025:3586]
2025-10-15T10:55:39.576915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:39.576970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:39.576986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.576998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.577010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.577058Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:39.577080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:39.577102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:39.578932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.578946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.578961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.578972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:39.579244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:39.579261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.579415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.579621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.579873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:39.579955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400475972056011:3586]
2025-10-15T10:55:39.579971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400475972056011:3586]
2025-10-15T10:55:39.579984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400475972056011:3586]
2025-10-15T10:55:39.580017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:39.580104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:39.580302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:39.580323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:39.580471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400475972056011:3586]
2025-10-15T10:55:39.580494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:39.581512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:39.581536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:39.581547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:39.581572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:39.582237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400473172350677:2467], now have 1 active actors on pipe
2025-10-15T10:55:39.582275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400473172350876:3423], now have 1 active actors on pipe
2025-10-15T10:55:39.582295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400473172350789:3786], now have 1 active actors on pipe
2025-10-15T10:55:39.582548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 139
2025-10-15T10:55:39.582641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 139, pipe: [1:7561400473172350876:3423]
2025-10-15T10:55:39.582713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 139
2025-10-15T10:55:39.583420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:39.583460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:39.583544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|989e15ee-17d7da29-50162cb3-db2e7090_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:39.583594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.583635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.583657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:39.583702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.583760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:39.583820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:39.584442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:39.584474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:39.584539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:39.584805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 140 partition: 0 MaxSeqNo: 46 sessionId: src_id|989e15ee-17d7da29-50162cb3-db2e7090_0
2025-10-15T10:55:39.585546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8db532-7a9e0fd1-fce1fb69-188b73a4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|989e15ee-17d7da29-50162cb3-db2e7090_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:39.620103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989e15ee-17d7da29-50162cb3-db2e7090_0] Write session: try to update token
2025-10-15T10:55:39.620160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989e15ee-17d7da29-50162cb3-db2e7090_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:39.694397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:39.694436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:39.694458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:39.694471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:39.694520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400475972056011:3586]
2025-10-15T10:55:39.694549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400475972056011:3586]
2025-10-15T10:55:39.694573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400475972056011:3586]
2025-10-15T10:55:39.694727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:39.694803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:39.694837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:39.694847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.694860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.694876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.694931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:39.694961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:39.697814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:39.744458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId: src_id|989e15ee-17d7da29-50162cb3-db2e7090_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:39.766710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:39.845817Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:39.861318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:39.861383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:39.861458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:39.861472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:39.861513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400475972056011:3586]
2025-10-15T10:55:39.861709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:39.862062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400473172350876:3423]
2025-10-15T10:55:39.862108Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:39.862152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:39.862319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:39.862339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:39.888751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 140 reason: error at write: Disconnected sessionId: src_id|989e15ee-17d7da29-50162cb3-db2e7090_0
2025-10-15T10:55:39.889110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 140 sessionId: src_id|989e15ee-17d7da29-50162cb3-db2e7090_0 is DEAD
2025-10-15T10:55:39.889503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989e15ee-17d7da29-50162cb3-db2e7090_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:39.889555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989e15ee-17d7da29-50162cb3-db2e7090_0] Write session will restart in 0.009321s
2025-10-15T10:55:39.889770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989e15ee-17d7da29-50162cb3-db2e7090_0] Write session: Do CDS request
2025-10-15T10:55:39.889817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989e15ee-17d7da29-50162cb3-db2e7090_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:39.908050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:39.908086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 141
2025-10-15T10:55:39.912015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989e15ee-17d7da29-50162cb3-db2e7090_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:39.912833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:39.912979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:39.912995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:39.913004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:39.914696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 141 sessionId:  describe result for acl check
2025-10-15T10:55:39.914824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:39.914839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:39.914848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:39.914866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400473172350976:3796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:39.917678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400473172350976:3796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:39.930054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400473172350976:3796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:39.942189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400473172350976:3796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:39.942245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400473172350976:3796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:39.942263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400473172350976:3796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:39.942296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:39.947566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:39.953640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:39.954421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:39.954437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:39.954474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:39.954730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:39.955141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400475972056237:3595]
2025-10-15T10:55:39.957256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:39.958188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:39.958398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:39.959634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:39.959978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:39.959986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:39.959994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:39.960001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:39.960008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:39.960015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:39.960022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:39.960029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:39.960036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:39.960044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:39.960051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:39.960058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.960066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.960073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.960124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:39.960239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:39.960293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:39.960346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:39.960389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:39.960433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:39.960480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:39.960525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:39.960570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:39.960618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:39.960660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:39.960712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.960764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.960812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.960859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:39.960922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:39.960977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:39.961028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:39.961076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:39.961125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:39.961168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:39.961215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:39.961295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:39.961360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:39.961406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:39.961465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:39.961513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:39.961579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:39.961640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:39.961705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:39.961753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:39.961804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:39.961847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:39.961917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:39.961963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:39.962012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:39.962052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.962100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:39.962143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.962194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:39.962234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.962284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:39.962745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:39.963803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400473172351097:3423]
2025-10-15T10:55:39.990359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:40.008998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:40.009052Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:40.009069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:40.009088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:40.009111Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 140 [2:7561400475972056237:3595]
2025-10-15T10:55:40.009162Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:40.009235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:40.009259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.009273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.009283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.009327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:40.009354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:40.009377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:40.011145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.011173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.011186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.011197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:40.011488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:40.011515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.011652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.011849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.012077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:40.012151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400475972056230:3595]
2025-10-15T10:55:40.012167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400475972056230:3595]
2025-10-15T10:55:40.012180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400475972056230:3595]
2025-10-15T10:55:40.012222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:40.012294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:40.012360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:40.012392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:40.012406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:40.012488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:40.012508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:40.012628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400475972056230:3595]
2025-10-15T10:55:40.012648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:40.012704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:40.012752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400473172351097:3423], now have 1 active actors on pipe
2025-10-15T10:55:40.012817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400473172351089:3796], now have 1 active actors on pipe
2025-10-15T10:55:40.012844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400473172350906:2467], now have 1 active actors on pipe
2025-10-15T10:55:40.015528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 140, pipe: [1:7561400473172351097:3423]
2025-10-15T10:55:40.015664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 140
2025-10-15T10:55:40.015747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 140
2025-10-15T10:55:40.016765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:40.016807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:40.016904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:40.016939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.016957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.016969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:40.017009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.017057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:40.017111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:40.017683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:40.017713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:40.017789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:40.018190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 141 partition: 0 MaxSeqNo: 46 sessionId: src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0
2025-10-15T10:55:40.018924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989e15ee-17d7da29-50162cb3-db2e7090_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:40.045360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0] Write session: try to update token
2025-10-15T10:55:40.045831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:40.118101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:40.118137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:40.118150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:40.118160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:40.118194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400475972056230:3595]
2025-10-15T10:55:40.118219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400475972056230:3595]
2025-10-15T10:55:40.118243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400475972056230:3595]
2025-10-15T10:55:40.118376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:40.118418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:40.118444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:40.118475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.118496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.118508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.118552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:40.118578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:40.119599Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:40.144878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId: src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:40.167949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:40.264337Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:40.285762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:40.285827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:40.285926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:40.285946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:40.286003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400475972056230:3595]
2025-10-15T10:55:40.286283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:40.286631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:40.286669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:40.286831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:40.286837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400473172351097:3423]
2025-10-15T10:55:40.286849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:40.297660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 141 reason: error at write: Disconnected sessionId: src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0
2025-10-15T10:55:40.297945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 141 sessionId: src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0 is DEAD
2025-10-15T10:55:40.298430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:40.298495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0] Write session will restart in 0.007511s
2025-10-15T10:55:40.298668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0] Write session: Do CDS request
2025-10-15T10:55:40.298717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:40.312456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:40.318470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:40.318509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 142
2025-10-15T10:55:40.318984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:40.319105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:40.319126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:40.319136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:40.320351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 142 sessionId:  describe result for acl check
2025-10-15T10:55:40.320491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:40.320507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:40.320517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:40.320532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400477467318433:3804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:40.322292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400477467318433:3804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:40.335123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400477467318433:3804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:40.344533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400477467318433:3804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:40.344575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400477467318433:3804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:40.344590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400477467318433:3804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:40.344620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:40.376839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:40.379914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:40.380859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:40.380894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:40.380928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:40.381129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:40.381271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400480267023736:3604]
2025-10-15T10:55:40.383482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:40.384441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:40.384693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:40.385968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:40.386227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:40.386238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:40.386243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:40.386247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:40.386250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:40.386254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:40.386258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:40.386261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:40.386266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:40.386270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:40.386273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:40.386277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.386281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.386288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.386322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:40.386423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:40.386471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:40.386518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:40.386555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:40.386588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:40.386623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:40.386661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:40.386696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:40.386747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:40.386829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:40.386902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.386966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.387022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.387206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400477467318605:3423]
2025-10-15T10:55:40.387087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:40.387170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:40.387236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:40.387297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:40.387368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:40.387426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:40.387476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:40.387532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:40.387601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:40.387663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:40.387718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:40.387775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:40.387829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:40.387892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:40.387942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:40.388035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:40.388095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:40.388158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:40.388213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:40.388268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:40.388316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:40.388377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:40.388430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.388485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.388533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.388595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.388657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.388715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.389314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:40.406157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:40.415175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:40.415226Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:40.415245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:40.415266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:40.415292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 141 [2:7561400480267023736:3604]
2025-10-15T10:55:40.415366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:40.415448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:40.415464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.415479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.415493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.415544Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:40.415566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:40.415588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:40.418388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 141
2025-10-15T10:55:40.418392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 141
2025-10-15T10:55:40.418477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 141, pipe: [1:7561400477467318605:3423]
2025-10-15T10:55:40.416610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.416641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.416658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.416672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:40.416984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:40.417006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.417178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.417401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.417586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:40.417657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400477467318605:3423], now have 1 active actors on pipe
2025-10-15T10:55:40.417673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400477467318492:3804], now have 1 active actors on pipe
2025-10-15T10:55:40.417690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400477467318418:2467], now have 1 active actors on pipe
2025-10-15T10:55:40.417714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400480267023731:3604]
2025-10-15T10:55:40.417728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400480267023731:3604]
2025-10-15T10:55:40.417740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400480267023731:3604]
2025-10-15T10:55:40.417781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:40.417839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:40.417855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:40.417858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:40.417869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:40.418016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:40.418028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:40.418119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400480267023731:3604]
2025-10-15T10:55:40.418144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:40.418183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:40.418681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:40.418709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:40.418793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18f0a809-6a564172-8632b28f-4558a8f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:40.418818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.418832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.418838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:40.418865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.418898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:40.418931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:40.419332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:40.419365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:40.419424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:40.419704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 142 partition: 0 MaxSeqNo: 46 sessionId: src_id|18f0a809-6a564172-8632b28f-4558a8f4_0
2025-10-15T10:55:40.420684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|befb3d1f-e444122f-279d1bf4-a45d0bcb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|18f0a809-6a564172-8632b28f-4558a8f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:40.459884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f0a809-6a564172-8632b28f-4558a8f4_0] Write session: try to update token
2025-10-15T10:55:40.459935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f0a809-6a564172-8632b28f-4558a8f4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:40.465208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:40.465251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:40.465290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400480267023731:3604]
2025-10-15T10:55:40.465420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:40.466455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:40.468930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:40.470367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:40.472081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:40.506527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:40.508756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:40.509359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:40.515818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.515863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.515877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.554380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:40.554422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:40.554437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:40.554448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:40.554487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400480267023731:3604]
2025-10-15T10:55:40.554515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400480267023731:3604]
2025-10-15T10:55:40.554538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400480267023731:3604]
2025-10-15T10:55:40.554687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:40.554692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:40.554718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:40.554727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:40.554755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:40.558368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:40.567252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId: src_id|18f0a809-6a564172-8632b28f-4558a8f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:40.599830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:40.701088Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:40.702526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:40.702557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:40.703201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:40.703262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400477467318605:3423]
2025-10-15T10:55:40.703280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:40.703298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:40.703376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:40.753638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 142 reason: error at write: Disconnected sessionId: src_id|18f0a809-6a564172-8632b28f-4558a8f4_0
2025-10-15T10:55:40.753998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 142 sessionId: src_id|18f0a809-6a564172-8632b28f-4558a8f4_0 is DEAD
2025-10-15T10:55:40.754403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f0a809-6a564172-8632b28f-4558a8f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:40.754456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f0a809-6a564172-8632b28f-4558a8f4_0] Write session will restart in 0.005779s
2025-10-15T10:55:40.754590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f0a809-6a564172-8632b28f-4558a8f4_0] Write session: Do CDS request
2025-10-15T10:55:40.754637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f0a809-6a564172-8632b28f-4558a8f4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:40.764638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18f0a809-6a564172-8632b28f-4558a8f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:40.764576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:40.764608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 143
2025-10-15T10:55:40.765110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:40.765256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:40.765272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:40.765283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:40.767269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 143 sessionId:  describe result for acl check
2025-10-15T10:55:40.767479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:40.767496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:40.767511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:40.767542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400477467318740:3809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:40.771087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400477467318740:3809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:40.777167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400477467318740:3809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:40.781338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:40.784488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:40.784900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400477467318740:3809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:40.784939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400477467318740:3809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:40.784955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400477467318740:3809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:40.784996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:40.785298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:40.785341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:40.785378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:40.785593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:40.785771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400480267023945:3608]
2025-10-15T10:55:40.787505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:40.788458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:40.788697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:40.789940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:40.790301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:40.790319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:40.790328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:40.790335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:40.790343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:40.790349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:40.790356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:40.790363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:40.790371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:40.790379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:40.790386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:40.790394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.790401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.790408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.790462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:40.790581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:40.790631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:40.790682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:40.790733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:40.790807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:40.790865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:40.790919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:40.790974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:40.791032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:40.791079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:40.791129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.791176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.791222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.791273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:40.791370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:40.791438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:40.791499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:40.791549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:40.791604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:40.791651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:40.791706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:40.791757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:40.791814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:40.791861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:40.791916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:40.791977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:40.792037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:40.792084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:40.792138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:40.792188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:40.792253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:40.792298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:40.792352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:40.792414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:40.792477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:40.792528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.792585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.792633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.792697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.792747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.792806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.793369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:40.803472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400477467318823:3423]
2025-10-15T10:55:40.811105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:40.820950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:40.821006Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:40.821027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:40.821047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:40.821073Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 142 [2:7561400480267023945:3608]
2025-10-15T10:55:40.821130Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:40.821196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:40.821220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.821234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.821246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.821297Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:40.821328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:40.821356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:40.831132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.831162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.831175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.831187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:40.831475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:40.831497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:40.831638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:40.831829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:40.832047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:40.832134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400477467318823:3423], now have 1 active actors on pipe
2025-10-15T10:55:40.832161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400477467318817:3809], now have 1 active actors on pipe
2025-10-15T10:55:40.832181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400477467318628:2467], now have 1 active actors on pipe
2025-10-15T10:55:40.832206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400480267023940:3608]
2025-10-15T10:55:40.832225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400480267023940:3608]
2025-10-15T10:55:40.832238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400480267023940:3608]
2025-10-15T10:55:40.832273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:40.832297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 142, pipe: [1:7561400477467318823:3423]
2025-10-15T10:55:40.832318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:40.832398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 142
2025-10-15T10:55:40.832342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:40.832346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:40.832354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:40.832465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 142
2025-10-15T10:55:40.832509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:40.832533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:40.832650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400480267023940:3608]
2025-10-15T10:55:40.832677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:40.832702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:40.832795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:40.832823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:40.832933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:40.832967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.832990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.833001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:40.833040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.833089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:40.833175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:40.833604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:40.833642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:40.833711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:40.834118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 143 partition: 0 MaxSeqNo: 46 sessionId: src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0
2025-10-15T10:55:40.834859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18f0a809-6a564172-8632b28f-4558a8f4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:40.855811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0] Write session: try to update token
2025-10-15T10:55:40.855874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:40.889785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:40.889847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:40.889866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:40.889891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:40.889953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400480267023940:3608]
2025-10-15T10:55:40.890007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400480267023940:3608]
2025-10-15T10:55:40.890055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400480267023940:3608]
2025-10-15T10:55:40.890234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:40.890282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:40.890304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:40.890315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:40.890352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:40.893369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:40.931274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId: src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:40.953863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:41.041461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:41.043567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:41.043612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:41.048104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:41.051649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400477467318823:3423]
2025-10-15T10:55:41.051745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:41.052367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:41.069189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 143 reason: status is not ok: tablet will be restarted right now sessionId: src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0
2025-10-15T10:55:41.069566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 143 sessionId: src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0 is DEAD
2025-10-15T10:55:41.073863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:41.073908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0] Write session will restart in 0.006731s
2025-10-15T10:55:41.074009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0] Write session: Do CDS request
2025-10-15T10:55:41.074038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:41.086415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:41.086445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 144
2025-10-15T10:55:41.090166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:41.094048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:41.094184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:41.094199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:41.094210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:41.095956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 144 sessionId:  describe result for acl check
2025-10-15T10:55:41.096084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:41.096095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:41.096105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:41.096124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400481762286151:3814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:41.100019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400481762286151:3814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:41.109314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400481762286151:3814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:41.123229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400481762286151:3814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:41.123273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400481762286151:3814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:41.123289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400481762286151:3814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:41.123322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:41.152033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400481762286295:3423]
2025-10-15T10:55:41.164390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:41.168309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:41.169063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:41.169080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:41.169119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:41.169372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:41.169542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400484561991453:3616]
2025-10-15T10:55:41.172218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:41.173279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:41.173517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:41.174864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:41.175174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:41.175182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:41.175189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:41.175197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:41.175204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:41.175210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:41.175216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:41.175222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:41.175229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:41.175235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:41.175242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:41.175249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.175256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.175262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.175307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:41.175438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:41.175486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:41.175529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:41.175574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:41.175620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:41.175667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:41.175709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:41.175754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:41.175802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:41.175848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:41.175908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.178050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.178123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.178170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:41.178240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:41.178304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:41.178365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:41.178419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:41.178475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:41.178521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:41.178578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:41.178624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:41.178698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:41.178746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:41.178809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:41.178861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:41.178914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:41.178956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:41.179005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:41.179050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:41.179103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:41.179147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:41.179197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:41.179242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:41.179302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:41.179365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.179436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.179483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.179531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.179574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.179622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.180100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:41.197007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:41.208074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:41.208128Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:41.208146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:41.208165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:41.211491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 143, pipe: [1:7561400481762286295:3423]
2025-10-15T10:55:41.208190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 143 [2:7561400484561991453:3616]
2025-10-15T10:55:41.208243Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:41.208306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:41.208322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.211618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 143
2025-10-15T10:55:41.208335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.208346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.208394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:41.208416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:41.208439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:41.211696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 143
2025-10-15T10:55:41.210138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.210166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.210182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.210192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:41.210478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:41.210498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.210637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.210847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.211086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:41.211172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400481762286295:3423], now have 1 active actors on pipe
2025-10-15T10:55:41.211199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400481762286185:3814], now have 1 active actors on pipe
2025-10-15T10:55:41.211221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400481762286136:2467], now have 1 active actors on pipe
2025-10-15T10:55:41.211248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400484561991447:3616]
2025-10-15T10:55:41.211264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400484561991447:3616]
2025-10-15T10:55:41.211276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400484561991447:3616]
2025-10-15T10:55:41.211366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:41.211381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:41.211394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:41.215416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:41.215539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:41.215719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:41.215744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:41.215830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:41.215862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:41.216003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400484561991447:3616]
2025-10-15T10:55:41.216048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:41.216125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:41.216154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:41.216163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.216183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.216193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:41.216234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.216281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:41.216414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:41.223577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:41.223630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:41.223722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:41.225474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 144 partition: 0 MaxSeqNo: 46 sessionId: src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0
2025-10-15T10:55:41.231103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|880e001c-9f76f7d0-146c0851-a10c7f44_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:41.265137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0] Write session: try to update token
2025-10-15T10:55:41.265201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:41.366828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.366856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.366864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.366972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:41.366986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:41.366997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:41.367004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:41.367028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400484561991447:3616]
2025-10-15T10:55:41.367046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400484561991447:3616]
2025-10-15T10:55:41.367061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400484561991447:3616]
2025-10-15T10:55:41.367603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:41.367652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:41.367683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:41.377289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:41.377339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:41.379486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:41.405767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId: src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:41.430417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:41.519575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:41.521377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:41.521400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:41.521465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400484561991447:3616]
2025-10-15T10:55:41.521642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:41.521652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:41.521674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:41.522400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:41.522456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:41.522615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400481762286295:3423]
2025-10-15T10:55:41.522698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:41.522709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:41.533362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 144 reason: error at write: Disconnected sessionId: src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0
2025-10-15T10:55:41.533966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 144 sessionId: src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0 is DEAD
2025-10-15T10:55:41.534258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:41.534290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0] Write session will restart in 0.008790s
2025-10-15T10:55:41.534387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0] Write session: Do CDS request
2025-10-15T10:55:41.534411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:41.572914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:41.572945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 145
2025-10-15T10:55:41.574010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:41.574572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:41.574698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:41.574719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:41.574727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:41.576252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 145 sessionId:  describe result for acl check
2025-10-15T10:55:41.576357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:41.576374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:41.576382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:41.576398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400481762286386:3825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:41.578715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400481762286386:3825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:41.593262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400481762286386:3825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:41.618481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400481762286386:3825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:41.618528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400481762286386:3825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:41.618546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400481762286386:3825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:41.618576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:41.622580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400481762286493:3423]
2025-10-15T10:55:41.641065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:41.649626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:41.650389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:41.650405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:41.650442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:41.650673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:41.650849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400484561991685:3625]
2025-10-15T10:55:41.653159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:41.654156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:41.654406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:41.655674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:41.655979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:41.655985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:41.655992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:41.655998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:41.656004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:41.656010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:41.656016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:41.656022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:41.656029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:41.656035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:41.656043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:41.656049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.656055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.656062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.656103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:41.656195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:41.656238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:41.656279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:41.656331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:41.656373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:41.656429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:41.656493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:41.656537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:41.656580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:41.656621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:41.656663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.656704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.656743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.656779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:41.656837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:41.656886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:41.656933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:41.656980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:41.657027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:41.657066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:41.657114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:41.657181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:41.657236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:41.657280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:41.657327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:41.657384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:41.657431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:41.657470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:41.657517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:41.657581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:41.657633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:41.657674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:41.657721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:41.657762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:41.657808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:41.657849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.657895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.657939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.657987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.658028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.658082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.658549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:41.680936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:41.695041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 144, pipe: [1:7561400481762286493:3423]
2025-10-15T10:55:41.695163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 144
2025-10-15T10:55:41.691920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:41.695233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 144
2025-10-15T10:55:41.691971Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:41.691988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:41.692005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:41.692028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 144 [2:7561400484561991685:3625]
2025-10-15T10:55:41.692072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:41.692127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:41.692140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.692150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.692160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.692203Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:41.692225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:41.692245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:41.694115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.694132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.694144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.694153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:41.694419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:41.694434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:41.694578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:41.694752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:41.695013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:41.695082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400481762286493:3423], now have 1 active actors on pipe
2025-10-15T10:55:41.695105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400481762286482:3825], now have 1 active actors on pipe
2025-10-15T10:55:41.695124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400481762286370:2467], now have 1 active actors on pipe
2025-10-15T10:55:41.695146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400484561991679:3625]
2025-10-15T10:55:41.695159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400484561991679:3625]
2025-10-15T10:55:41.695171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400484561991679:3625]
2025-10-15T10:55:41.695207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:41.695250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:41.695263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:41.695271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:41.695274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:41.695449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:41.695464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:41.695581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400484561991679:3625]
2025-10-15T10:55:41.695606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:41.695655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:41.695750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:41.695770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:41.695850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:41.695878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.695894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.695928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:41.695960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.695994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:41.696030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:41.696496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:41.696532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:41.696625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:41.697131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 145 partition: 0 MaxSeqNo: 46 sessionId: src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0
2025-10-15T10:55:41.697781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6c7cd7f-533bcd38-bc05fb90-6665a35e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:41.725153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0] Write session: try to update token
2025-10-15T10:55:41.725206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:41.815642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:41.815704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:41.815736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:41.815751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:41.815795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400484561991679:3625]
2025-10-15T10:55:41.815824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400484561991679:3625]
2025-10-15T10:55:41.815852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400484561991679:3625]
2025-10-15T10:55:41.816090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:41.816108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.816121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.816133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.816152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:41.816171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:41.816189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:41.816202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:41.818924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:41.829519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId: src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:41.853054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:41.957897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:41.977208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:41.977253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:41.977313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:41.977326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:41.977359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400484561991679:3625]
2025-10-15T10:55:41.977897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:41.981692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:41.989103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:41.989234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400481762286493:3423]
2025-10-15T10:55:41.989359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:42.023386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 145 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0
2025-10-15T10:55:42.023699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 145 sessionId: src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0 is DEAD
2025-10-15T10:55:42.027571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:42.027608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0] Write session will restart in 0.006791s
2025-10-15T10:55:42.027699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0] Write session: Do CDS request
2025-10-15T10:55:42.027724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:42.038705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:42.038706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:42.038732Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 146
2025-10-15T10:55:42.039341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:42.039467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:42.039481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:42.039490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:42.040644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 146 sessionId:  describe result for acl check
2025-10-15T10:55:42.040736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:42.040746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:42.040754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:42.040770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400486057253957:3832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:42.043047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400486057253957:3832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:42.060073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400486057253957:3832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:42.074834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:42.079270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400486057253957:3832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:42.079310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400486057253957:3832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:42.079326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400486057253957:3832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:42.079368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:42.082716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:42.083691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:42.083724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:42.083766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:42.084066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:42.084258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400488856959186:3629]
2025-10-15T10:55:42.086839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:42.089140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:42.093641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400486057254090:3423]
2025-10-15T10:55:42.089384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:42.090586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:42.090905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:42.090912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:42.090919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:42.090925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:42.090932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:42.090937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:42.090943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:42.090949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:42.090956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:42.090962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:42.090969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:42.090975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.090982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.090988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.091029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:42.091125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:42.091169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:42.091214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:42.091254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:42.091297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:42.091336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:42.091400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:42.091441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:42.091484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:42.091526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:42.091567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.091632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.091676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.091715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:42.091776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:42.091828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:42.091875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:42.091920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:42.091967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:42.092009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:42.092058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:42.092099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:42.092147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:42.092188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:42.092234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:42.092276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:42.092320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:42.092357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:42.092403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:42.092446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:42.092494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:42.092532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:42.092580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:42.092622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:42.092669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:42.092710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.092758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.092801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.092845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.092884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.092931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.093368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:42.117462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:42.130219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 145
2025-10-15T10:55:42.130242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 145
2025-10-15T10:55:42.130317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 145, pipe: [1:7561400486057254090:3423]
2025-10-15T10:55:42.128000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:42.128050Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:42.128066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:42.128084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:42.128107Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 145 [2:7561400488856959186:3629]
2025-10-15T10:55:42.128154Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:42.128206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:42.128236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:42.128247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:42.128258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:42.128299Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:42.128319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:42.128340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:42.129389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.129404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.129417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.129427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:42.129681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:42.129698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.129828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.130006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.130224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:42.130297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400481762286601:2467], now have 1 active actors on pipe
2025-10-15T10:55:42.130320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400486057254085:3832], now have 1 active actors on pipe
2025-10-15T10:55:42.130341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400486057254090:3423], now have 1 active actors on pipe
2025-10-15T10:55:42.130363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400488856959179:3629]
2025-10-15T10:55:42.130380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400488856959179:3629]
2025-10-15T10:55:42.130390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400488856959179:3629]
2025-10-15T10:55:42.130434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:42.130477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:42.130496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:42.130497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:42.130510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:42.130665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:42.130681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:42.130743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:42.130760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:42.130872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400488856959179:3629]
2025-10-15T10:55:42.130904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:42.130938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:42.130968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4937b9f0-b216186-209efac3-2e441fa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:42.130993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:42.131010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:42.131020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:42.131050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:42.131081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:42.131197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:42.131956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:42.131982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:42.132064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:42.132475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 146 partition: 0 MaxSeqNo: 46 sessionId: src_id|4937b9f0-b216186-209efac3-2e441fa4_0
2025-10-15T10:55:42.136038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe63a1bd-9aea43a9-93cbb957-4969df2f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4937b9f0-b216186-209efac3-2e441fa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:42.178368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4937b9f0-b216186-209efac3-2e441fa4_0] Write session: try to update token
2025-10-15T10:55:42.178441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4937b9f0-b216186-209efac3-2e441fa4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:42.314919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId: src_id|4937b9f0-b216186-209efac3-2e441fa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:42.348220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:42.348261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:42.348275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:42.348348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:42.348362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:42.348375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:42.348385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:42.348431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400488856959179:3629]
2025-10-15T10:55:42.348457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400488856959179:3629]
2025-10-15T10:55:42.348482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400488856959179:3629]
2025-10-15T10:55:42.348628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:42.348675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:42.348693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:42.348707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:42.348717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:42.350342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:42.352132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:42.495232Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:42.509254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:42.509307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:42.509372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:42.509385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:42.509424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400488856959179:3629]
2025-10-15T10:55:42.509971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:42.510523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:42.510672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:42.510681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400486057254090:3423]
2025-10-15T10:55:42.510686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:42.511243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:42.521404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 146 reason: error at write: Disconnected sessionId: src_id|4937b9f0-b216186-209efac3-2e441fa4_0
2025-10-15T10:55:42.521770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 146 sessionId: src_id|4937b9f0-b216186-209efac3-2e441fa4_0 is DEAD
2025-10-15T10:55:42.527547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4937b9f0-b216186-209efac3-2e441fa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:42.527590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4937b9f0-b216186-209efac3-2e441fa4_0] Write session will restart in 0.007979s
2025-10-15T10:55:42.527690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4937b9f0-b216186-209efac3-2e441fa4_0] Write session: Do CDS request
2025-10-15T10:55:42.527718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4937b9f0-b216186-209efac3-2e441fa4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:42.560187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4937b9f0-b216186-209efac3-2e441fa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:42.560690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:42.560726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 147
2025-10-15T10:55:42.566259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:42.566427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:42.566444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:42.566456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:42.568108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 147 sessionId:  describe result for acl check
2025-10-15T10:55:42.568226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:42.568238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:42.568246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:42.568263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400486057254129:3838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:42.570960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400486057254129:3838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:42.581621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400486057254129:3838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:42.594311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400486057254129:3838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:42.594356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400486057254129:3838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:42.594372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400486057254129:3838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:42.594400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:42.613424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400486057254232:3423]
2025-10-15T10:55:42.641636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:42.643766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:42.644625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:42.644660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:42.644707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:42.644958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:42.645151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400488856959414:3635]
2025-10-15T10:55:42.647371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:42.648936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:42.649113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:42.650119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:42.650415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:42.650433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:42.650438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:42.650443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:42.650447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:42.650452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:42.650457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:42.650462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:42.650466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:42.650471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:42.650475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:42.650480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.650484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.650489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.650524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:42.650648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:42.650695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:42.650740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:42.650789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:42.650850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:42.650900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:42.650948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:42.650997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:42.651045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:42.651085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:42.651139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.651187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.651236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.651279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:42.651362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:42.651427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:42.651486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:42.651531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:42.651590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:42.651636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:42.651688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:42.651732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:42.651783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:42.651824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:42.651875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:42.651921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:42.651973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:42.652018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:42.652068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:42.652131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:42.652185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:42.652229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:42.652280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:42.652322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:42.652373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:42.652417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.652468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.652513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.652568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.652611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.652662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.653147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:42.694745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:42.705791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:42.705842Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:42.705859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:42.705880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:42.705904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 146 [2:7561400488856959414:3635]
2025-10-15T10:55:42.705954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:42.706011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:42.706025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:42.706036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:42.706047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:42.706102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:42.706126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:42.706148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:42.708179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.708208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.708223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.708233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:42.708514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:42.708531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:42.708666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:42.708846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:42.709069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:42.709135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400488856959409:3635]
2025-10-15T10:55:42.709151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400488856959409:3635]
2025-10-15T10:55:42.709162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400488856959409:3635]
2025-10-15T10:55:42.709194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:42.709278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:42.709457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:42.709475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:42.709600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400488856959409:3635]
2025-10-15T10:55:42.709620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:42.709885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:42.709897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:42.709907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:42.709929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:42.712568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 146, pipe: [1:7561400486057254232:3423]
2025-10-15T10:55:42.712675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 146
2025-10-15T10:55:42.712743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 146
2025-10-15T10:55:42.713071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400486057254232:3423], now have 1 active actors on pipe
2025-10-15T10:55:42.713108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400486057254159:3838], now have 1 active actors on pipe
2025-10-15T10:55:42.713139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400486057254114:2467], now have 1 active actors on pipe
2025-10-15T10:55:42.713195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:42.713219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:42.713306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88a12547-57bd5967-2173418c-82c3a92f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:42.713352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:42.713371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:42.713384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:42.713420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:42.713476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:42.713547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:42.715329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:42.715380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:42.715458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:42.715844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 147 partition: 0 MaxSeqNo: 46 sessionId: src_id|88a12547-57bd5967-2173418c-82c3a92f_0
2025-10-15T10:55:42.719577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4937b9f0-b216186-209efac3-2e441fa4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|88a12547-57bd5967-2173418c-82c3a92f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:42.744233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a12547-57bd5967-2173418c-82c3a92f_0] Write session: try to update token
2025-10-15T10:55:42.744290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a12547-57bd5967-2173418c-82c3a92f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:42.813337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:42.813372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:42.813386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:42.813397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:42.813428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400488856959409:3635]
2025-10-15T10:55:42.813453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400488856959409:3635]
2025-10-15T10:55:42.813475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400488856959409:3635]
2025-10-15T10:55:42.813633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:42.813670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:42.813699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:42.813706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:42.813719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:42.813729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:42.813772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:42.813792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:42.814900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:42.859394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId: src_id|88a12547-57bd5967-2173418c-82c3a92f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:42.880821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:42.963904Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:42.991258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:42.991308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:42.991395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:42.991410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:42.991450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400488856959409:3635]
2025-10-15T10:55:42.992128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400486057254232:3423]
2025-10-15T10:55:42.992239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:42.992255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:42.991776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:42.992212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:43.001793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 147 reason: error at write: Disconnected sessionId: src_id|88a12547-57bd5967-2173418c-82c3a92f_0
2025-10-15T10:55:43.002127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 147 sessionId: src_id|88a12547-57bd5967-2173418c-82c3a92f_0 is DEAD
2025-10-15T10:55:43.002569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a12547-57bd5967-2173418c-82c3a92f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:43.002633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a12547-57bd5967-2173418c-82c3a92f_0] Write session will restart in 0.007909s
2025-10-15T10:55:43.002849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a12547-57bd5967-2173418c-82c3a92f_0] Write session: Do CDS request
2025-10-15T10:55:43.002895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a12547-57bd5967-2173418c-82c3a92f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:43.026485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:43.027982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a12547-57bd5967-2173418c-82c3a92f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:43.032476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:43.032513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 148
2025-10-15T10:55:43.032957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:43.033078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:43.033098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:43.033109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:43.037144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 148 sessionId:  describe result for acl check
2025-10-15T10:55:43.037320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:43.037338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:43.037357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:43.037387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400490352221656:3848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:43.048560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400490352221656:3848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:43.059735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400490352221656:3848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:43.068770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400490352221656:3848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:43.068820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400490352221656:3848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:43.068837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400490352221656:3848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:43.068869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:43.092934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400490352221831:3423]
2025-10-15T10:55:43.096364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:43.099308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:43.100079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:43.100117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:43.100160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:43.100403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:43.100575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400493151926930:3641]
2025-10-15T10:55:43.102669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:43.103539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:43.103761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:43.105030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:43.105356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:43.105378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:43.105385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:43.105392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:43.105399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:43.105406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:43.105412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:43.105419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:43.105426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:43.105432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:43.105439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:43.105447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.105454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.105460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.105507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:43.105612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:43.105658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:43.105707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:43.105753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:43.105798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:43.105842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:43.105885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:43.105937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:43.105987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:43.106041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:43.106091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.106139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.106185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.106231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:43.106301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:43.106363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:43.106422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:43.106475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:43.106531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:43.106579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:43.106637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:43.106692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:43.106750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:43.106798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:43.106880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:43.106932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:43.106989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:43.107037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:43.107098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:43.107150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:43.107208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:43.107257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:43.107314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:43.107393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:43.107447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:43.107500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.107554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.107608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.107665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.107718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.107768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.108277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:43.129040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:43.139174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:43.139224Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:43.139240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:43.139259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:43.139283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 147 [2:7561400493151926930:3641]
2025-10-15T10:55:43.139337Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:43.143498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:43.143518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:43.143531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:43.143542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:43.143599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:43.143624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:43.143647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:43.145359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.145395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.145409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.145421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:43.145695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:43.145721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.145870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.146061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.146274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:43.146372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400490352221747:3848], now have 1 active actors on pipe
2025-10-15T10:55:43.146405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400490352221831:3423], now have 1 active actors on pipe
2025-10-15T10:55:43.146426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400490352221648:2467], now have 1 active actors on pipe
2025-10-15T10:55:43.146218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 147
2025-10-15T10:55:43.146451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400493151926925:3641]
2025-10-15T10:55:43.146295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 147, pipe: [1:7561400490352221831:3423]
2025-10-15T10:55:43.146470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400493151926925:3641]
2025-10-15T10:55:43.146384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 147
2025-10-15T10:55:43.146482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400493151926925:3641]
2025-10-15T10:55:43.146517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:43.146576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:43.146593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:43.146601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:43.146606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:43.146612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:43.146640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:43.146870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:43.146891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:43.147022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:43.147047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:43.147059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:43.147065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:43.147091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:43.147122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:43.147158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400493151926925:3641]
2025-10-15T10:55:43.147186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:43.147215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:43.147247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:43.147862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:43.147891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:43.147963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:43.148248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 148 partition: 0 MaxSeqNo: 46 sessionId: src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0
2025-10-15T10:55:43.149078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a12547-57bd5967-2173418c-82c3a92f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:43.168289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0] Write session: try to update token
2025-10-15T10:55:43.168332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:43.248978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:43.249034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:43.249076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400493151926925:3641]
2025-10-15T10:55:43.249186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:43.249305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:43.249326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:43.249337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:43.249407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:43.251378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:43.252650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:43.253900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:43.255094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:43.256967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:43.286225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:43.286395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:43.286421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:43.286436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:43.286446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:43.286492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400493151926925:3641]
2025-10-15T10:55:43.286518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400493151926925:3641]
2025-10-15T10:55:43.286547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400493151926925:3641]
2025-10-15T10:55:43.286658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:43.286695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:43.286730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:43.299592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:43.299637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:43.300561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:43.317037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId: src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:43.353072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:43.461136Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:43.462681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:43.462729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:43.463538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:43.463502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:43.463530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:43.465192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400490352221831:3423]
2025-10-15T10:55:43.465322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:43.472358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 148 reason: error at write: Disconnected sessionId: src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0
2025-10-15T10:55:43.472736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 148 sessionId: src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0 is DEAD
2025-10-15T10:55:43.474923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:43.474984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0] Write session will restart in 0.009171s
2025-10-15T10:55:43.475177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0] Write session: Do CDS request
2025-10-15T10:55:43.475242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:43.488758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:43.491612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:43.491642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 149
2025-10-15T10:55:43.491991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:43.492123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:43.492138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:43.492148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:43.493962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 149 sessionId:  describe result for acl check
2025-10-15T10:55:43.494062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:43.494073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:43.494083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:43.494100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400490352221874:3856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:43.496894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400490352221874:3856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:43.518051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400490352221874:3856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:43.529200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400490352221874:3856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:43.529245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400490352221874:3856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:43.529263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400490352221874:3856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:43.529297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:43.561547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400490352222067:3423]
2025-10-15T10:55:43.561836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:43.568215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:43.569123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:43.569146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:43.569191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:43.569466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:43.569653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400493151927141:3650]
2025-10-15T10:55:43.576303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:43.577504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:43.577776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:43.579151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:43.579545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:43.579565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:43.579572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:43.579580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:43.579587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:43.579594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:43.579601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:43.579609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:43.579616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:43.579623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:43.579631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:43.579638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.579645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.579652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.579712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:43.579830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:43.579877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:43.579928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:43.579986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:43.580034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:43.580084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:43.580129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:43.580174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:43.580223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:43.580277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:43.580322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.580369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.580415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.580469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:43.580539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:43.580609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:43.580664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:43.580711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:43.580777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:43.580824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:43.580879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:43.580927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:43.580981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:43.581025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:43.581078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:43.581124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:43.581179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:43.581223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:43.581290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:43.581342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:43.581416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:43.581464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:43.581530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:43.581578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:43.581631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:43.581681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.581734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.581781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.581834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.581879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.581935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.582430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:43.609102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:43.618552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:43.618721Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:43.618745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:43.618768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:43.618794Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 148 [2:7561400493151927141:3650]
2025-10-15T10:55:43.618863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:43.618934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:43.618949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:43.618961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:43.618975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:43.619029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:43.619053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:43.619077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:43.620471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.620489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.620503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.620515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:43.620776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:43.620794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:43.620952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:43.621168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:43.621416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:43.621488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400493151927134:3650]
2025-10-15T10:55:43.621503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400493151927134:3650]
2025-10-15T10:55:43.621518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400493151927134:3650]
2025-10-15T10:55:43.621563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:43.621639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:43.621703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:43.621719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:43.621731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:43.621836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:43.621855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:43.621979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400493151927134:3650]
2025-10-15T10:55:43.621998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:43.622030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:43.622090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400490352221944:3856], now have 1 active actors on pipe
2025-10-15T10:55:43.622114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400490352222067:3423], now have 1 active actors on pipe
2025-10-15T10:55:43.622138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400490352221860:2467], now have 1 active actors on pipe
2025-10-15T10:55:43.623016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 148
2025-10-15T10:55:43.623027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 148
2025-10-15T10:55:43.623099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 148, pipe: [1:7561400490352222067:3423]
2025-10-15T10:55:43.623330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:43.623386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:43.623470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|844861c0-877f7594-b1437a3a-389d1ab9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:43.623509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:43.623531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:43.623541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:43.623588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:43.623648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:43.623701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:43.624180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:43.624208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:43.624271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:43.624702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 149 partition: 0 MaxSeqNo: 46 sessionId: src_id|844861c0-877f7594-b1437a3a-389d1ab9_0
2025-10-15T10:55:43.625796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd82d2ca-8b87ee91-804ba96c-188f7438_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|844861c0-877f7594-b1437a3a-389d1ab9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:43.664581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844861c0-877f7594-b1437a3a-389d1ab9_0] Write session: try to update token
2025-10-15T10:55:43.664645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844861c0-877f7594-b1437a3a-389d1ab9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:43.753811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:43.753851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:43.753866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:43.753877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:43.753914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400493151927134:3650]
2025-10-15T10:55:43.753942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400493151927134:3650]
2025-10-15T10:55:43.753964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400493151927134:3650]
2025-10-15T10:55:43.754143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:43.754156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:43.754167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:43.754274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:43.754297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:43.754748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:43.754791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:43.754821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:43.763197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
E1015 10:55:43.769159944  821070 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:55:43.771604Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:55:43.794156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId: src_id|844861c0-877f7594-b1437a3a-389d1ab9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:43.819655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:43.924851Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:43.938155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:43.938211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:43.938292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:43.938308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:43.938354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400493151927134:3650]
2025-10-15T10:55:43.938605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:43.938974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:43.940374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:43.941552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400490352222067:3423]
2025-10-15T10:55:43.941677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:43.946732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 149 reason: status is not ok: tablet will be restarted right now sessionId: src_id|844861c0-877f7594-b1437a3a-389d1ab9_0
2025-10-15T10:55:43.947592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 149 sessionId: src_id|844861c0-877f7594-b1437a3a-389d1ab9_0 is DEAD
2025-10-15T10:55:43.951609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844861c0-877f7594-b1437a3a-389d1ab9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:43.951679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844861c0-877f7594-b1437a3a-389d1ab9_0] Write session will restart in 0.006081s
2025-10-15T10:55:43.951810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844861c0-877f7594-b1437a3a-389d1ab9_0] Write session: Do CDS request
2025-10-15T10:55:43.951847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844861c0-877f7594-b1437a3a-389d1ab9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:43.993177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844861c0-877f7594-b1437a3a-389d1ab9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:43.993618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:43.993658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 150
2025-10-15T10:55:43.994113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:43.994241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:43.994257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:43.994267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:43.998325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 150 sessionId:  describe result for acl check
2025-10-15T10:55:43.998643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:44.000542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:44.000573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:44.000595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400490352222109:3861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:44.005528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400490352222109:3861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:44.024093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400490352222109:3861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:44.041290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400494647189439:3423]
2025-10-15T10:55:44.042511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400490352222109:3861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:44.042540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400490352222109:3861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:44.042558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400490352222109:3861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:44.042591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:44.128813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:44.132343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:44.133200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:44.133233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:44.133277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:44.133518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:44.133712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400497446894671:3654]
2025-10-15T10:55:44.135584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:44.136429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:44.136625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:44.137874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:44.138187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:44.138196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:44.138203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:44.138210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:44.138216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:44.138223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:44.138229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:44.138236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:44.138242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:44.138250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:44.138258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:44.138265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.138271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.138278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.138323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:44.138434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:44.138498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:44.138544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:44.138590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:44.138636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:44.138684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:44.138729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:44.138774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:44.138817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:44.138876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:44.138918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.138964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.139008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.139049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:44.139116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:44.139178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:44.139232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:44.139278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:44.139331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:44.144120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:44.144217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:44.144282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:44.144344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:44.144393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:44.144451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:44.144502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:44.144564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:44.144611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:44.144657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:44.144706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:44.144761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:44.144805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:44.144849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:44.144880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:44.144916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:44.144947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.144982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.145015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.145053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.145096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.145138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.145498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:44.165897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:44.176191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:44.176245Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:44.176260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:44.176279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:44.176303Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 149 [2:7561400497446894671:3654]
2025-10-15T10:55:44.176353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:44.176416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:44.176429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:44.176443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:44.176454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:44.176502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:44.176525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:44.176546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:44.188715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 149, pipe: [1:7561400494647189439:3423]
2025-10-15T10:55:44.188829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 149
2025-10-15T10:55:44.188905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 149
2025-10-15T10:55:44.188070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.188105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.188116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.188125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:44.188346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:44.188360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.188482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.188633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.188817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:44.188892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400494647189439:3423], now have 1 active actors on pipe
2025-10-15T10:55:44.188913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400494647189451:3861], now have 1 active actors on pipe
2025-10-15T10:55:44.188933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400490352222091:2467], now have 1 active actors on pipe
2025-10-15T10:55:44.188966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400497446894665:3654]
2025-10-15T10:55:44.188984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400497446894665:3654]
2025-10-15T10:55:44.188995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400497446894665:3654]
2025-10-15T10:55:44.189023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:44.189096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:44.189101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:44.189112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:44.189122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:44.189273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:44.189290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:44.189339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:44.189357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:44.189468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400497446894665:3654]
2025-10-15T10:55:44.189490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:44.189518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:44.189556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:44.189584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:44.189601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:44.189611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:44.189647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:44.189688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:44.189825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:44.190368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:44.190384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:44.190445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:44.190761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 150 partition: 0 MaxSeqNo: 46 sessionId: src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0
2025-10-15T10:55:44.191674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844861c0-877f7594-b1437a3a-389d1ab9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:44.211126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0] Write session: try to update token
2025-10-15T10:55:44.211171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:44.220972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:44.221017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:44.221061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400497446894665:3654]
2025-10-15T10:55:44.221209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:44.221236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:44.223164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:44.224504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:44.225643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:44.226747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:44.228371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:44.228979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:44.276880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:44.276934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:44.276949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:44.311799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:44.311837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:44.311851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:44.311861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:44.311899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400497446894665:3654]
2025-10-15T10:55:44.311924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400497446894665:3654]
2025-10-15T10:55:44.311951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400497446894665:3654]
2025-10-15T10:55:44.312068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:44.312089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:44.312101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:44.312109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:44.312128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:44.314189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:44.319859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId: src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:44.342592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:44.451051Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:44.453250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:44.453280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:44.454080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:44.453876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400494647189439:3423]
2025-10-15T10:55:44.453980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:44.453993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:44.491260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 150 reason: error at write: Disconnected sessionId: src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0
2025-10-15T10:55:44.491651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 150 sessionId: src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0 is DEAD
2025-10-15T10:55:44.498287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:44.498342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0] Write session will restart in 0.006094s
2025-10-15T10:55:44.498478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0] Write session: Do CDS request
2025-10-15T10:55:44.498531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:44.516796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:44.517832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:44.518120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:44.518141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 151
2025-10-15T10:55:44.518859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:44.518975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:44.519005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:44.519014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:44.520400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 151 sessionId:  describe result for acl check
2025-10-15T10:55:44.520510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:44.520529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:44.520538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:44.520555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400494647189676:3874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:44.523298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400494647189676:3874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:44.536148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400494647189676:3874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:44.546244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400494647189676:3874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:44.546287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400494647189676:3874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:44.546303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400494647189676:3874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:44.546332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:44.554211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400494647189823:3423]
2025-10-15T10:55:44.555431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:44.559407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:44.560376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:44.560408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:44.560448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:44.560692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:44.560874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400497446894884:3662]
2025-10-15T10:55:44.562828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:44.563972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:44.564232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:44.565667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:44.566010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:44.566029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:44.566036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:44.566043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:44.566050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:44.566057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:44.566064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:44.566071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:44.566079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:44.566086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:44.566093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:44.566099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.566106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.566113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.566159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:44.566273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:44.566323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:44.566372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:44.566418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:44.566469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:44.566514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:44.566561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:44.566608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:44.566656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:44.566701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:44.566747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.566794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.566855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.566898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:44.566966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:44.567026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:44.567087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:44.567136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:44.567188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:44.567233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:44.567288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:44.567337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:44.567412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:44.567460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:44.567514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:44.567562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:44.567618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:44.567661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:44.567716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:44.567766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:44.567823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:44.567872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:44.567925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:44.567973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:44.568030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:44.568079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.568135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.568182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.568234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.568280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.568335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.568850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:44.589949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:44.622182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 150
2025-10-15T10:55:44.622289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 150
2025-10-15T10:55:44.622355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 150, pipe: [1:7561400494647189823:3423]
2025-10-15T10:55:44.619404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:44.619447Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:44.619460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:44.619475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:44.619494Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 150 [2:7561400497446894884:3662]
2025-10-15T10:55:44.619535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:44.619582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:44.619593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:44.619604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:44.619617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:44.619657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:44.619675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:44.619694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:44.621517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.621532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.621545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.621555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:44.621812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:44.621827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:44.621945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:44.622106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:44.622314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:44.622379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400494647189820:3874], now have 1 active actors on pipe
2025-10-15T10:55:44.622401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400494647189663:2467], now have 1 active actors on pipe
2025-10-15T10:55:44.622420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400494647189823:3423], now have 1 active actors on pipe
2025-10-15T10:55:44.622465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:44.622483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:44.622515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400497446894873:3662]
2025-10-15T10:55:44.622526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400497446894873:3662]
2025-10-15T10:55:44.622537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400497446894873:3662]
2025-10-15T10:55:44.622572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:44.622611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:44.622626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:44.622637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:44.622646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:44.622816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:44.622834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:44.622904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:44.622934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:44.622949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:44.622959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:44.622990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:44.623028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:44.623155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400497446894873:3662]
2025-10-15T10:55:44.623187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:44.623208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:44.623232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:44.624284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:44.624333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:44.624397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:44.624689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 151 partition: 0 MaxSeqNo: 46 sessionId: src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0
2025-10-15T10:55:44.625570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01d3a8b-68d6de29-cc0c8bb-fb351248_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:44.660796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0] Write session: try to update token
2025-10-15T10:55:44.660854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:44.693363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:44.693405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:44.693445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400497446894873:3662]
2025-10-15T10:55:44.693574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:44.693585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:44.695230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:44.716404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:44.717561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:44.718659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:44.732983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:44.762189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:44.762222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:44.762232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:44.762355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:44.805932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:44.805975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:44.805991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:44.806003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:44.806047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400497446894873:3662]
2025-10-15T10:55:44.806070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400497446894873:3662]
2025-10-15T10:55:44.806086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400497446894873:3662]
2025-10-15T10:55:44.806205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:44.806222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:44.806240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:44.806273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:44.806312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:44.807178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:44.817525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId: src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:44.839255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:44.948605Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:44.950181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:44.950216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:44.950960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:44.950852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:44.950882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:44.952157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:44.952411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400494647189823:3423]
2025-10-15T10:55:44.961549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 151 reason: error at write: Disconnected sessionId: src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0
2025-10-15T10:55:44.961882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 151 sessionId: src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0 is DEAD
2025-10-15T10:55:44.963869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:44.963929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0] Write session will restart in 0.007245s
2025-10-15T10:55:44.964092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0] Write session: Do CDS request
2025-10-15T10:55:44.964148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:44.975333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:44.975386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 152
2025-10-15T10:55:44.975467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:44.975897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:44.976026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:44.976042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:44.976052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:44.977693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 152 sessionId:  describe result for acl check
2025-10-15T10:55:44.977797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:44.977812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:44.977820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:44.977836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400494647189871:3882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:44.983044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400494647189871:3882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:44.990398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400494647189871:3882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:45.007197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400494647189871:3882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:45.007288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400494647189871:3882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:45.007334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400494647189871:3882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:45.007394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:45.031970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:45.051504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400498942157347:3423]
2025-10-15T10:55:45.051644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:45.052630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:45.052652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:45.052700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:45.053004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:45.053224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400501741862417:3673]
2025-10-15T10:55:45.055573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:45.058486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:45.058761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:45.060219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:45.060610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.060633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.060640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.060648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.060656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.060663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.060671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.060679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.060687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.060694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.060703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.060710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.060717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.060725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.060778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.060900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.060952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.061003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.061058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.061108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.061159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.061208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.061253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.061301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.061344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.061404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.061450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.061499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.061556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.061631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.061703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.061768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.061831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.061896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.061951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.062016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.062077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.062145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.062200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.062258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.062313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.062374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.062430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.062492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.062550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.062614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.062669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.062728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.062786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.062860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.062918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.062986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.063042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.063106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.063164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.063227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.063832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:45.080662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:45.089870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:45.089929Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:45.089951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:45.089975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:45.090006Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 151 [2:7561400501741862417:3673]
2025-10-15T10:55:45.090071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:45.090145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:45.090176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:45.090192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:45.090206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:45.090265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:45.090298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:45.090327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:45.091606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.091645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.091660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.091673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:45.091948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:45.091975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.092058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 151, pipe: [1:7561400498942157347:3423]
2025-10-15T10:55:45.092173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.092190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 151
2025-10-15T10:55:45.092278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 151
2025-10-15T10:55:45.092387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.092622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:45.092720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400498942157347:3423], now have 1 active actors on pipe
2025-10-15T10:55:45.092756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400498942157215:3882], now have 1 active actors on pipe
2025-10-15T10:55:45.092785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400494647189855:2467], now have 1 active actors on pipe
2025-10-15T10:55:45.092839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:45.092870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:45.092925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400501741862410:3673]
2025-10-15T10:55:45.092948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400501741862410:3673]
2025-10-15T10:55:45.092962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400501741862410:3673]
2025-10-15T10:55:45.092999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:45.093054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:45.093081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:45.093094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:45.093103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:45.093299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:45.093322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:45.093387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5984b202-25284705-650c7ff3-387c959c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:45.093429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:45.093450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:45.093461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:45.093501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:45.093547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:45.093674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400501741862410:3673]
2025-10-15T10:55:45.093740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:45.093757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:45.093795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:45.094423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:45.094486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:45.094594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:45.094926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 152 partition: 0 MaxSeqNo: 46 sessionId: src_id|5984b202-25284705-650c7ff3-387c959c_0
2025-10-15T10:55:45.095686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7509e4-7a51a2-d22e3b29-bc5a3a2d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5984b202-25284705-650c7ff3-387c959c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:45.117479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5984b202-25284705-650c7ff3-387c959c_0] Write session: try to update token
2025-10-15T10:55:45.117546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5984b202-25284705-650c7ff3-387c959c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:45.132302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:45.132341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:45.132374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400501741862410:3673]
2025-10-15T10:55:45.132484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:45.132503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:45.134326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:45.173111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:45.174303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:45.175278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:45.176615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:45.177100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:45.208950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:45.208988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:45.209000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:45.209056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:45.209071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:45.209085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:45.209096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:45.209134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400501741862410:3673]
2025-10-15T10:55:45.209160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400501741862410:3673]
2025-10-15T10:55:45.209183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400501741862410:3673]
2025-10-15T10:55:45.209322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:45.209343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:45.209968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:45.210014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:45.210042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:45.211454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:45.219329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId: src_id|5984b202-25284705-650c7ff3-387c959c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:45.244541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:45.351390Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:45.352808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:45.352848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:45.353406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:45.353421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:45.353437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:45.353557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:45.353633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400498942157347:3423]
2025-10-15T10:55:45.362487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 152 reason: error at write: Disconnected sessionId: src_id|5984b202-25284705-650c7ff3-387c959c_0
2025-10-15T10:55:45.362831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 152 sessionId: src_id|5984b202-25284705-650c7ff3-387c959c_0 is DEAD
2025-10-15T10:55:45.363242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5984b202-25284705-650c7ff3-387c959c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:45.363292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5984b202-25284705-650c7ff3-387c959c_0] Write session will restart in 0.009780s
2025-10-15T10:55:45.363486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5984b202-25284705-650c7ff3-387c959c_0] Write session: Do CDS request
2025-10-15T10:55:45.363545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5984b202-25284705-650c7ff3-387c959c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:45.379222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:45.379371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5984b202-25284705-650c7ff3-387c959c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:45.379264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 153
2025-10-15T10:55:45.380071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:45.380254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:45.380286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:45.380297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:45.381734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 153 sessionId:  describe result for acl check
2025-10-15T10:55:45.381841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:45.381857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:45.381866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:45.381884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400498942157377:3887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:45.384789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400498942157377:3887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:45.391341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400498942157377:3887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:45.409091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400498942157377:3887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:45.409134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400498942157377:3887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:45.409151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400498942157377:3887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:45.409181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:45.428933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:45.431845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:45.432690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:45.432724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:45.432766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:45.433034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:45.433241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400501741862623:3675]
2025-10-15T10:55:45.435465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:45.436404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:45.436625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:45.437796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:45.438109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.438123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.438128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.438132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.438137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.438141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.438145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.438150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.438154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.438160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.438167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.438175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.438183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.438190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.438237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.438352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.438396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.438445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.438493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.438541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.438594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.438651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.438703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.438752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.438809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.438870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.438920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.438966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.439002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.439062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.439125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.439170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.439220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.439273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.439325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.439385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.439426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.439485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.439534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.439592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.439641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.439690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.439741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.439798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.439852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.439898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.439934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.439985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.440018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.440060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.440097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.440138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.440171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.440222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.440257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.440297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.440771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:45.453963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400498942157565:3423]
2025-10-15T10:55:45.462760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:45.471966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:45.472024Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:45.472045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:45.472067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:45.472094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 152 [2:7561400501741862623:3675]
2025-10-15T10:55:45.472150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:45.472214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:45.472229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:45.472243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:45.472257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:45.472312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:45.472336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:45.472358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:45.473396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.473423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.473437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.473449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:45.473718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:45.473742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.473898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.474007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 152, pipe: [1:7561400498942157565:3423]
2025-10-15T10:55:45.474048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 152
2025-10-15T10:55:45.474103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.474136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 152
2025-10-15T10:55:45.474359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:45.474453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400498942157565:3423], now have 1 active actors on pipe
2025-10-15T10:55:45.474485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400498942157362:2467], now have 1 active actors on pipe
2025-10-15T10:55:45.474509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400498942157455:3887], now have 1 active actors on pipe
2025-10-15T10:55:45.474571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:45.474598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:45.474633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400501741862618:3675]
2025-10-15T10:55:45.474652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400501741862618:3675]
2025-10-15T10:55:45.474665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400501741862618:3675]
2025-10-15T10:55:45.474704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:45.474743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:45.474767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:45.474779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:45.474785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:45.474981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:45.475010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:45.475080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a27b8af3-2e473555-98095d1-10663048_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:45.475115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:45.475138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:45.475150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:45.475188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:45.475235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:45.475376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400501741862618:3675]
2025-10-15T10:55:45.475408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:45.475453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:45.475462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:45.476084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:45.476113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:45.476186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:45.476481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 153 partition: 0 MaxSeqNo: 46 sessionId: src_id|a27b8af3-2e473555-98095d1-10663048_0
2025-10-15T10:55:45.477276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5984b202-25284705-650c7ff3-387c959c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a27b8af3-2e473555-98095d1-10663048_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:45.497904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a27b8af3-2e473555-98095d1-10663048_0] Write session: try to update token
2025-10-15T10:55:45.497964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a27b8af3-2e473555-98095d1-10663048_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:45.561666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:45.561731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:45.561755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:45.561772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:45.561836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400501741862618:3675]
2025-10-15T10:55:45.561889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400501741862618:3675]
2025-10-15T10:55:45.561942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400501741862618:3675]
2025-10-15T10:55:45.562182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:45.562262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:45.562281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:45.562325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:45.562332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:45.564186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:45.573220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId: src_id|a27b8af3-2e473555-98095d1-10663048_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:45.595239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:45.712652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:45.728243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:45.730395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400498942157565:3423]
2025-10-15T10:55:45.728307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:45.728643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:45.730533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:45.728658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:45.728700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400501741862618:3675]
2025-10-15T10:55:45.728908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:45.729287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:45.730710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:45.743905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 153 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a27b8af3-2e473555-98095d1-10663048_0
2025-10-15T10:55:45.744367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 153 sessionId: src_id|a27b8af3-2e473555-98095d1-10663048_0 is DEAD
2025-10-15T10:55:45.747926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a27b8af3-2e473555-98095d1-10663048_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:45.747976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a27b8af3-2e473555-98095d1-10663048_0] Write session will restart in 0.006550s
2025-10-15T10:55:45.748125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a27b8af3-2e473555-98095d1-10663048_0] Write session: Do CDS request
2025-10-15T10:55:45.748171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a27b8af3-2e473555-98095d1-10663048_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:45.761103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a27b8af3-2e473555-98095d1-10663048_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:45.767373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:45.767403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 154
2025-10-15T10:55:45.767942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:45.768065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:45.768088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:45.768098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:45.769337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 154 sessionId:  describe result for acl check
2025-10-15T10:55:45.769447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:45.769476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:45.769485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:45.769502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400498942157613:3898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:45.772258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400498942157613:3898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:45.777540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400498942157613:3898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:45.785181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400498942157613:3898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:45.785230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400498942157613:3898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:45.785247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400498942157613:3898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:45.785276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:45.825798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:45.828835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:45.829558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:45.829588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:45.829630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:45.829844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:45.830005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400501741862857:3685]
2025-10-15T10:55:45.830736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400498942157801:3423]
2025-10-15T10:55:45.832027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:45.832923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:45.833162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:45.834554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:45.834897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.834917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.834925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.834933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.834941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.834949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.834956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.834963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.834970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.834977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.834984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.834992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.835000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.835006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.835055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.835160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.835213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.835264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.835322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.835394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.835448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.835501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.835553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.835605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.835662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.835711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.835760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.835810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.835860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.835927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:45.835990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.836048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:45.836101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.836159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:45.836208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.836265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:45.836317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.836370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:45.836418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.836474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:45.836526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.836585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:45.836629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.836688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:45.836751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.836808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:45.836859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.836917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:45.836962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.837019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:45.837067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.837120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.837172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.837223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.837360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.837415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.837905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:45.854997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:45.864671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:45.864710Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:45.864722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:45.864740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:45.864764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 153 [2:7561400501741862857:3685]
2025-10-15T10:55:45.864803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:45.864853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:45.864869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:45.864882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:45.864893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:45.864941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:45.864964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:45.864983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:45.867317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.867385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.867400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.867412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:45.867730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:45.867765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:45.867910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:45.868113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 153
2025-10-15T10:55:45.868216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 153
2025-10-15T10:55:45.868285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 153, pipe: [1:7561400498942157801:3423]
2025-10-15T10:55:45.868106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:45.868362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:45.868466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400498942157645:3898], now have 1 active actors on pipe
2025-10-15T10:55:45.868492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400498942157600:2467], now have 1 active actors on pipe
2025-10-15T10:55:45.868520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400498942157801:3423], now have 1 active actors on pipe
2025-10-15T10:55:45.868570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:45.868591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:45.868629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400501741862852:3685]
2025-10-15T10:55:45.868656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400501741862852:3685]
2025-10-15T10:55:45.868671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400501741862852:3685]
2025-10-15T10:55:45.868707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:45.868729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:45.868743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:45.868755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:45.868787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:45.868976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:45.869012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:45.869082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14419f02-b2b14d60-6015654c-adef2fe1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:45.869122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:45.869142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:45.869153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:45.869191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:45.869242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:45.869393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400501741862852:3685]
2025-10-15T10:55:45.869426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:45.869474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:45.869475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:45.869921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:45.869952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:45.870012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:45.870389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 154 partition: 0 MaxSeqNo: 46 sessionId: src_id|14419f02-b2b14d60-6015654c-adef2fe1_0
2025-10-15T10:55:45.871576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a27b8af3-2e473555-98095d1-10663048_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|14419f02-b2b14d60-6015654c-adef2fe1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:45.895159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14419f02-b2b14d60-6015654c-adef2fe1_0] Write session: try to update token
2025-10-15T10:55:45.895217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14419f02-b2b14d60-6015654c-adef2fe1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:45.902497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:45.902537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:45.902574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400501741862852:3685]
2025-10-15T10:55:45.902692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:45.902701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:45.906036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:45.910869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:45.912219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:45.915640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:45.917747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:45.918315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:45.998678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:45.998722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:45.998734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:45.998810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:45.998824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:45.998837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:45.998846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:45.998901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400501741862852:3685]
2025-10-15T10:55:45.998926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400501741862852:3685]
2025-10-15T10:55:45.998945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400501741862852:3685]
2025-10-15T10:55:45.999091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:45.999098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:45.999122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:45.999125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:45.999162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:46.001029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:46.008628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId: src_id|14419f02-b2b14d60-6015654c-adef2fe1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:46.035102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:46.151420Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:46.155419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:46.155462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:46.156062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:46.157003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:46.157170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:46.162217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400498942157801:3423]
2025-10-15T10:55:46.166639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 154 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14419f02-b2b14d60-6015654c-adef2fe1_0
2025-10-15T10:55:46.167035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 154 sessionId: src_id|14419f02-b2b14d60-6015654c-adef2fe1_0 is DEAD
2025-10-15T10:55:46.167956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14419f02-b2b14d60-6015654c-adef2fe1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:46.168022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14419f02-b2b14d60-6015654c-adef2fe1_0] Write session will restart in 0.005546s
2025-10-15T10:55:46.168188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14419f02-b2b14d60-6015654c-adef2fe1_0] Write session: Do CDS request
2025-10-15T10:55:46.168256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14419f02-b2b14d60-6015654c-adef2fe1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:46.181560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:46.181684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14419f02-b2b14d60-6015654c-adef2fe1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:46.181601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 155
2025-10-15T10:55:46.182119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:46.182258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:46.182278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:46.182288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:46.183502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 155 sessionId:  describe result for acl check
2025-10-15T10:55:46.183622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:46.183640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:46.183654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:46.183679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400503237125146:3906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:46.186045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400503237125146:3906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:46.192739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400503237125146:3906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:46.204501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400503237125146:3906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:46.204531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400503237125146:3906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:46.204543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400503237125146:3906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:46.204567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:46.223882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:46.228249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:46.229129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:46.229164Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:46.229211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:46.229481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:46.229679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400506036830387:3694]
2025-10-15T10:55:46.236116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:46.237338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:46.237596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:46.238890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:46.239221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:46.239238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:46.239246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:46.239254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:46.239261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:46.239268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:46.239275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:46.239283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:46.239289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:46.239295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:46.239303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:46.239311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.239317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.239324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.239388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:46.239506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:46.239558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:46.239608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:46.239656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:46.239705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:46.239764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:46.239812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:46.239867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:46.239916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:46.239959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:46.240007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.240057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.240105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.240150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:46.240217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:46.240279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:46.240340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:46.240392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:46.240447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:46.240495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:46.240548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:46.240597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:46.240650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:46.240696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:46.240748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:46.240798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:46.240849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:46.240895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:46.240952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:46.241004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:46.241059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:46.241104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:46.241160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:46.241210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:46.241267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:46.241312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.241369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.241416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.241473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.241519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.241572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.243108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:46.261626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:46.262396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400503237125333:3423]
2025-10-15T10:55:46.271631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:46.271693Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:46.271714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:46.271734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:46.271765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 154 [2:7561400506036830387:3694]
2025-10-15T10:55:46.271822Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:46.271889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:46.271904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:46.271918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:46.271930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:46.271985Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:46.272025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:46.272049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:46.273065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.273089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.273105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.273117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:46.273401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:46.273426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.273592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.273643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 154, pipe: [1:7561400503237125333:3423]
2025-10-15T10:55:46.273683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 154
2025-10-15T10:55:46.273750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 154
2025-10-15T10:55:46.273791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.274034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:46.274128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400503237125333:3423], now have 1 active actors on pipe
2025-10-15T10:55:46.274161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400503237125234:3906], now have 1 active actors on pipe
2025-10-15T10:55:46.274183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400503237125132:2467], now have 1 active actors on pipe
2025-10-15T10:55:46.274262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:46.274293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:46.274334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400506036830381:3694]
2025-10-15T10:55:46.274356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400506036830381:3694]
2025-10-15T10:55:46.274369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400506036830381:3694]
2025-10-15T10:55:46.274410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:46.274440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:46.274467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:46.274480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:46.274484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:46.274663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:46.274690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:46.274759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c94b172-d727b10-97f2b292-3cfca344_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:46.274790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:46.274808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:46.274819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:46.274878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:46.274920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:46.275047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400506036830381:3694]
2025-10-15T10:55:46.275081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:46.275119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:46.275128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:46.275754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:46.275783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:46.275866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:46.276142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 155 partition: 0 MaxSeqNo: 46 sessionId: src_id|5c94b172-d727b10-97f2b292-3cfca344_0
2025-10-15T10:55:46.276881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14419f02-b2b14d60-6015654c-adef2fe1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5c94b172-d727b10-97f2b292-3cfca344_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:46.299551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c94b172-d727b10-97f2b292-3cfca344_0] Write session: try to update token
2025-10-15T10:55:46.299623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c94b172-d727b10-97f2b292-3cfca344_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:46.354603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId: src_id|5c94b172-d727b10-97f2b292-3cfca344_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:46.377978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:46.378021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:46.378037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:46.378048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:46.378086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400506036830381:3694]
2025-10-15T10:55:46.378123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400506036830381:3694]
2025-10-15T10:55:46.378152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400506036830381:3694]
2025-10-15T10:55:46.378321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:46.378376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:46.378395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:46.378409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:46.378410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:46.378422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:46.378474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:46.378516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:46.380837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:46.388178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:46.525890Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:46.536158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:46.536221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:46.536301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:46.536317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:46.536362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400506036830381:3694]
2025-10-15T10:55:46.536574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:46.537158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400503237125333:3423]
2025-10-15T10:55:46.537219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:46.537236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:46.537253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:46.537105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:46.545373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 155 reason: error at write: Disconnected sessionId: src_id|5c94b172-d727b10-97f2b292-3cfca344_0
2025-10-15T10:55:46.545722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 155 sessionId: src_id|5c94b172-d727b10-97f2b292-3cfca344_0 is DEAD
2025-10-15T10:55:46.546094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c94b172-d727b10-97f2b292-3cfca344_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:46.546152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c94b172-d727b10-97f2b292-3cfca344_0] Write session will restart in 0.008043s
2025-10-15T10:55:46.546288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c94b172-d727b10-97f2b292-3cfca344_0] Write session: Do CDS request
2025-10-15T10:55:46.546334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c94b172-d727b10-97f2b292-3cfca344_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:46.558435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:46.558560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c94b172-d727b10-97f2b292-3cfca344_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:46.558471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 156
2025-10-15T10:55:46.559042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:46.559180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:46.559203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:46.559213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:46.561402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 156 sessionId:  describe result for acl check
2025-10-15T10:55:46.561585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:46.561621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:46.561640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:46.561670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400503237125362:3911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:46.572663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400503237125362:3911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:46.578404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400503237125362:3911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:46.585267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400503237125362:3911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:46.585305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400503237125362:3911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:46.585322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400503237125362:3911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:46.585348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:46.636650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400503237125533:3423]
2025-10-15T10:55:46.648037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:46.652848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:46.653736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:46.653764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:46.653802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:46.654060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:46.654415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400506036830599:3697]
2025-10-15T10:55:46.656506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:46.657399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:46.657585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:46.658891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:46.659230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:46.659262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:46.659269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:46.659275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:46.659291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:46.659298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:46.659303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:46.659309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:46.659316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:46.659322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:46.659327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:46.659334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.659339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.659344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.659404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:46.659502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:46.659543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:46.659587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:46.659640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:46.659685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:46.659731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:46.659779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:46.659827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:46.659875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:46.659920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:46.659967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.660012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.660057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.660094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:46.660151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:46.660203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:46.660256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:46.660303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:46.660352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:46.660396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:46.660447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:46.660495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:46.660545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:46.660599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:46.660652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:46.660699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:46.660750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:46.660794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:46.660845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:46.660894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:46.660947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:46.660992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:46.661044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:46.661093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:46.661139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:46.661182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.661232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.661288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.661346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.661386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.661482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.661967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:46.681502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:46.690675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:46.690711Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:46.690722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:46.690734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:46.690750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 155 [2:7561400506036830599:3697]
2025-10-15T10:55:46.690785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:46.690832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:46.690845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:46.690861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:46.690880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:46.690911Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:46.690927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:46.690942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:46.691969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.691997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.692013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.692022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:46.692261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:46.692286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:46.692418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:46.692564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:46.692585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 155, pipe: [1:7561400503237125533:3423]
2025-10-15T10:55:46.692631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 155
2025-10-15T10:55:46.692679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 155
2025-10-15T10:55:46.692745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:46.692799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400503237125533:3423], now have 1 active actors on pipe
2025-10-15T10:55:46.692815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400503237125342:2467], now have 1 active actors on pipe
2025-10-15T10:55:46.692827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400503237125397:3911], now have 1 active actors on pipe
2025-10-15T10:55:46.692843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400506036830593:3697]
2025-10-15T10:55:46.692851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400506036830593:3697]
2025-10-15T10:55:46.692882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400506036830593:3697]
2025-10-15T10:55:46.692917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:46.692962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:46.692976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:46.692984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:46.692985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:46.693158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:46.693183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:46.693310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:46.693337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:46.693378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400506036830593:3697]
2025-10-15T10:55:46.693413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:46.693444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:46.693543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a52773f6-63916b03-332f8a1-8018f9d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:46.693579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:46.693600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:46.693608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:46.693637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:46.693671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:46.693759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:46.694408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:46.694444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:46.694534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:46.694841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 156 partition: 0 MaxSeqNo: 46 sessionId: src_id|a52773f6-63916b03-332f8a1-8018f9d2_0
2025-10-15T10:55:46.695574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c94b172-d727b10-97f2b292-3cfca344_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a52773f6-63916b03-332f8a1-8018f9d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:46.719301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52773f6-63916b03-332f8a1-8018f9d2_0] Write session: try to update token
2025-10-15T10:55:46.719427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52773f6-63916b03-332f8a1-8018f9d2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:46.759710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:46.759743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:46.759756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:46.759765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:46.759799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400506036830593:3697]
2025-10-15T10:55:46.759829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400506036830593:3697]
2025-10-15T10:55:46.759849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400506036830593:3697]
2025-10-15T10:55:46.759978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:46.760005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:46.760786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:46.760824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:46.760847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:46.761274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:46.811841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId: src_id|a52773f6-63916b03-332f8a1-8018f9d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:46.837112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:46.902138Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:46.903792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:46.903828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:46.907847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:46.905617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:46.905660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:46.906378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400503237125533:3423]
2025-10-15T10:55:46.906514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:46.950492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 156 reason: error at write: Disconnected sessionId: src_id|a52773f6-63916b03-332f8a1-8018f9d2_0
2025-10-15T10:55:46.950789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 156 sessionId: src_id|a52773f6-63916b03-332f8a1-8018f9d2_0 is DEAD
2025-10-15T10:55:46.951894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52773f6-63916b03-332f8a1-8018f9d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:46.951960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52773f6-63916b03-332f8a1-8018f9d2_0] Write session will restart in 0.005796s
2025-10-15T10:55:46.952164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52773f6-63916b03-332f8a1-8018f9d2_0] Write session: Do CDS request
2025-10-15T10:55:46.952219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52773f6-63916b03-332f8a1-8018f9d2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:46.962246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:46.962276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 157
2025-10-15T10:55:46.962424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52773f6-63916b03-332f8a1-8018f9d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:46.963742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:46.963900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:46.963926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:46.963937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:46.965753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 157 sessionId:  describe result for acl check
2025-10-15T10:55:46.965883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:46.965894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:46.965904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:46.965923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400503237125602:3915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:46.968892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400503237125602:3915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:46.981338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400503237125602:3915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:47.000188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400503237125602:3915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:47.000237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400503237125602:3915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:47.000257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400503237125602:3915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:47.000289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:47.006819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400507532092975:3423]
2025-10-15T10:55:47.064645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:47.070168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:47.071163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:47.071186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:47.071238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:47.071541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:47.071731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400510331798129:3700]
2025-10-15T10:55:47.074006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:47.079646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:47.079916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:47.081287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:47.081636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.081645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.081654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.081662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.081669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.081676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.081687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.081695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.081703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.081709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.081717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.081725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.081733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.081741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.081791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.081911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.081958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.081994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.082036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.082080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.082123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.082169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.082218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.082269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.082318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.082368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.082420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.082467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.082516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.082608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.082675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.082735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.082786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.082843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.082933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.082985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.083055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.083114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.083161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.083203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.083249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.083323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.084384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.084468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.084524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.084587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.084637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.084701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.084757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.084816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.084869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.084925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.084965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.085003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.085036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.085093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.085569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:47.105106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:47.115638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:47.115696Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:47.115716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:47.115735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:47.115768Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 156 [2:7561400510331798129:3700]
2025-10-15T10:55:47.115820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:47.115878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:47.115906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:47.115918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:47.115930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:47.115979Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:47.116006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:47.116029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:47.117959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.117995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.118010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.118021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:47.120009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 156
2025-10-15T10:55:47.120107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 156, pipe: [1:7561400507532092975:3423]
2025-10-15T10:55:47.120201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 156
2025-10-15T10:55:47.118598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:47.118629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.118776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.118979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.119218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:47.119289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400510331798124:3700]
2025-10-15T10:55:47.119303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400510331798124:3700]
2025-10-15T10:55:47.119316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400510331798124:3700]
2025-10-15T10:55:47.119382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:47.119456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:47.119467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:47.119476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:47.119485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:47.119648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:47.119684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:47.119823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400503237125664:3915], now have 1 active actors on pipe
2025-10-15T10:55:47.119846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400507532092975:3423], now have 1 active actors on pipe
2025-10-15T10:55:47.119867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400503237125582:2467], now have 1 active actors on pipe
2025-10-15T10:55:47.119884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400510331798124:3700]
2025-10-15T10:55:47.119912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:47.119924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:47.121336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:47.121375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:47.121467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:47.121504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:47.121527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:47.121536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:47.121575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:47.121626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:47.121678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:47.122603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:47.122639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:47.122716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:47.123033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 157 partition: 0 MaxSeqNo: 46 sessionId: src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0
2025-10-15T10:55:47.123772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52773f6-63916b03-332f8a1-8018f9d2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:47.144461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0] Write session: try to update token
2025-10-15T10:55:47.144515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:47.229029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:47.229071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:47.229085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:47.229096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:47.229135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400510331798124:3700]
2025-10-15T10:55:47.229165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400510331798124:3700]
2025-10-15T10:55:47.229190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400510331798124:3700]
2025-10-15T10:55:47.229426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:47.229450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:47.229462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:47.229513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:47.229535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:47.230158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:47.230204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:47.230249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:47.233303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:47.259465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId: src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:47.300242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:47.389776Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:47.402514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:47.402544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:47.401846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:47.401904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:47.401985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:47.401999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:47.402041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400510331798124:3700]
2025-10-15T10:55:47.402238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:47.402694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:47.430147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:47.430206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0] Write session will restart in 0.009048s
2025-10-15T10:55:47.430349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0] Write session: Do CDS request
2025-10-15T10:55:47.430391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:47.429129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400507532092975:3423]
2025-10-15T10:55:47.429198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:47.429298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 157 reason: error at write: Disconnected sessionId: src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0
2025-10-15T10:55:47.429598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 157 sessionId: src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0 is DEAD
2025-10-15T10:55:47.443654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:47.445295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:47.445320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 158
2025-10-15T10:55:47.445608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:47.445698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:47.445716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:47.445724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:47.446774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 158 sessionId:  describe result for acl check
2025-10-15T10:55:47.446863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:47.446877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:47.446894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:47.446909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400507532093123:3926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:47.449093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400507532093123:3926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:47.454946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400507532093123:3926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:47.464766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400507532093123:3926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:47.464806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400507532093123:3926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:47.464820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400507532093123:3926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:47.464849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:47.484918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:47.488719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:47.489481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:47.489509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:47.489548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:47.489764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:47.489953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400510331798340:3708]
2025-10-15T10:55:47.493065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:47.493888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:47.494072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:47.495204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:47.495528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.495544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.495568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.495581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.495596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.495606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.495620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.495634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.495656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.495672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.495689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.495706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.495720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.495730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.495814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.495918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.495970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.496026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.496068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.496123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.496165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.496204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.496243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.496283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.496323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.496365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.496405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.496445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.496480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.496542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.496592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.496651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.496692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.496741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.496780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.496829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.496872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.496920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.496959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.497018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.497081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.497185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.497255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.497336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.497393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.497445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.497484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.497542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.497584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.497631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.497671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.497716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.497754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.497806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.497843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.497887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.498338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:47.526211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:47.529525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400507532093317:3423]
2025-10-15T10:55:47.536676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:47.536714Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:47.536727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:47.536743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:47.536762Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 157 [2:7561400510331798340:3708]
2025-10-15T10:55:47.536806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:47.536849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:47.536860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:47.536871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:47.536881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:47.536921Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:47.536941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:47.536959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:47.540064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 157, pipe: [1:7561400507532093317:3423]
2025-10-15T10:55:47.540163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 157
2025-10-15T10:55:47.540249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 157
2025-10-15T10:55:47.539578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.539607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.539620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.539629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:47.539875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:47.539891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.540004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.540149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.540333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:47.540395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400507532093317:3423], now have 1 active actors on pipe
2025-10-15T10:55:47.540411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400507532093117:2467], now have 1 active actors on pipe
2025-10-15T10:55:47.540447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400507532093219:3926], now have 1 active actors on pipe
2025-10-15T10:55:47.540493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400510331798335:3708]
2025-10-15T10:55:47.540506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400510331798335:3708]
2025-10-15T10:55:47.540517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400510331798335:3708]
2025-10-15T10:55:47.540550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:47.540588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:47.540605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:47.540613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:47.540618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:47.540624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:47.540638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:47.540771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:47.540787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:47.540909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:47.540937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:47.540953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:47.540962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:47.540991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:47.541026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:47.541058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400510331798335:3708]
2025-10-15T10:55:47.541085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:47.541122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:47.541159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:47.541826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:47.541849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:47.541907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:47.542365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 158 partition: 0 MaxSeqNo: 46 sessionId: src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0
2025-10-15T10:55:47.543155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8da204a1-fb673693-ffa4e6d4-930b8b2c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:47.564364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0] Write session: try to update token
2025-10-15T10:55:47.564409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:47.597815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:47.597851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:47.597864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:47.597873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:47.597903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400510331798335:3708]
2025-10-15T10:55:47.597927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400510331798335:3708]
2025-10-15T10:55:47.597950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400510331798335:3708]
2025-10-15T10:55:47.598061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:47.598080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:47.598101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:47.598120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:47.598175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:47.599177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:47.653275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId: src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:47.680249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:47.744352Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:47.746010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:47.746045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:47.747885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400507532093317:3423]
2025-10-15T10:55:47.747905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:47.748052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:47.748074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:47.748984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:47.757319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 158 reason: error at write: Disconnected sessionId: src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0
2025-10-15T10:55:47.757604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 158 sessionId: src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0 is DEAD
2025-10-15T10:55:47.757991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:47.758048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0] Write session will restart in 0.007559s
2025-10-15T10:55:47.758232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0] Write session: Do CDS request
2025-10-15T10:55:47.758299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:47.769980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:47.770009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 159
2025-10-15T10:55:47.770208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:47.770660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:47.770759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:47.770774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:47.770781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:47.771796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 159 sessionId:  describe result for acl check
2025-10-15T10:55:47.771905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:47.771919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:47.771927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:47.771940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400507532093367:3934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:47.773923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400507532093367:3934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:47.780389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400507532093367:3934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:47.792026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400507532093367:3934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:47.792071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400507532093367:3934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:47.792086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400507532093367:3934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:47.792115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:47.816935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:47.819737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:47.820556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:47.820584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:47.820614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:47.820818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:47.821011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400510331798591:3718]
2025-10-15T10:55:47.822951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:47.823822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:47.824028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:47.825115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:47.825354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.825371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.825377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.825383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.825389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.825396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.825402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.825408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.825415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.825421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.825428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.825435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.825441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.825447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.825489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.825592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.825628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.825659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.825697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.825741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.825783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.825825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.825860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.825898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.825947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.826003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.826051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.826105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.826151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.826229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:47.826286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.826351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:47.826403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.826456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:47.826503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.826557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:47.826606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.826658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:47.826705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.826749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:47.826780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.826833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:47.826865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.826916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:47.826971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.827021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:47.827056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.827093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:47.827124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.827168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:47.827205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.827255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.827305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.827404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.827459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.827496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.827840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:47.842726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:47.848042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400507532093564:3423]
2025-10-15T10:55:47.863361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:47.863394Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:47.863404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:47.863416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:47.863433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 158 [2:7561400510331798591:3718]
2025-10-15T10:55:47.863466Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:47.863507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:47.863516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:47.863526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:47.863534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:47.863566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:47.863586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:47.863608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:47.864738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.864756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.864763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.864770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:47.864987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:47.865008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:47.865092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:47.865276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 158
2025-10-15T10:55:47.865314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 158, pipe: [1:7561400507532093564:3423]
2025-10-15T10:55:47.865365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 158
2025-10-15T10:55:47.865264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:47.865479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:47.865553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400507532093440:3934], now have 1 active actors on pipe
2025-10-15T10:55:47.865584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400507532093564:3423], now have 1 active actors on pipe
2025-10-15T10:55:47.865603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400507532093352:2467], now have 1 active actors on pipe
2025-10-15T10:55:47.865634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:47.865648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:47.865684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400510331798586:3718]
2025-10-15T10:55:47.865697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400510331798586:3718]
2025-10-15T10:55:47.865705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400510331798586:3718]
2025-10-15T10:55:47.865729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:47.865773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:47.865774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:47.865800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:47.865811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:47.865900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:47.865917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:47.865957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:47.865978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:47.865987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:47.865992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:47.866014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:47.866038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:47.866135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400510331798586:3718]
2025-10-15T10:55:47.866157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:47.866184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:47.866186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:47.866654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:47.866686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:47.866758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:47.867113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 159 partition: 0 MaxSeqNo: 46 sessionId: src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0
2025-10-15T10:55:47.867698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd1ea9c-167b7061-5d3b7f01-48a3e8c5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:47.889048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0] Write session: try to update token
2025-10-15T10:55:47.889099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:47.893382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:47.893408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:47.893441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400510331798586:3718]
2025-10-15T10:55:47.893546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:47.893570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:47.895508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:47.896902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:47.898470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:47.899903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:47.902041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:47.902605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:47.981699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:47.981731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:47.981743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:47.981752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:47.981786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400510331798586:3718]
2025-10-15T10:55:47.981805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400510331798586:3718]
2025-10-15T10:55:47.981823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400510331798586:3718]
2025-10-15T10:55:47.981912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:47.981942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:47.981961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:47.981970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:47.981971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:47.981979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:47.982014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:47.982031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:47.982954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:47.993581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId: src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:48.020209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:48.118943Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:48.120326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:48.120359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:48.120981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:48.121156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:48.121166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400507532093564:3423]
2025-10-15T10:55:48.121186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:48.121246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:48.130845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 159 reason: error at write: Disconnected sessionId: src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0
2025-10-15T10:55:48.131177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 159 sessionId: src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0 is DEAD
2025-10-15T10:55:48.131583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:48.131631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0] Write session will restart in 0.006915s
2025-10-15T10:55:48.131754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0] Write session: Do CDS request
2025-10-15T10:55:48.131799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:48.143897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:48.143904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:48.143940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 160
2025-10-15T10:55:48.144565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:48.144715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:48.144749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:48.144761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:48.146117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 160 sessionId:  describe result for acl check
2025-10-15T10:55:48.146227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:48.146246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:48.146257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:48.146277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400511827060891:3939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:48.149381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400511827060891:3939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:48.155766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400511827060891:3939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:48.163810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400511827060891:3939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:48.163852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400511827060891:3939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:48.163869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400511827060891:3939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:48.163897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:48.186580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:48.189829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:48.190536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:48.190568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:48.190605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:48.190841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:48.191018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400514626766101:3721]
2025-10-15T10:55:48.193104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:48.193912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:48.194099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:48.194992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:48.195222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.195237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.195242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.195246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.195250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.195254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.195259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.195263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.195267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.195271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.195275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.195279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.195283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.195287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.195325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.195432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.195474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.195503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.195545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.195586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.195639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.195684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.195732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.195782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.195823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.195871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.195917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.195965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.196005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.196064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.196117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.196165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.196214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.196268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.196317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.196375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.196422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.196476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.196522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.196569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.196612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.196661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.196709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.196763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.196809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.196864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.196910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.196964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.197011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.197067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.197127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.197182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.197234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.197288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.197336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.197395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.197826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:48.212880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:48.221304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400511827061086:3423]
2025-10-15T10:55:48.222171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:48.222211Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:48.222223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:48.222235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:48.222251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 159 [2:7561400514626766101:3721]
2025-10-15T10:55:48.222284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:48.222352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:48.222365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:48.222376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:48.222387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:48.222428Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:48.222449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:48.222468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:48.223432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.223457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.223470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.223480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:48.223714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:48.223736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.223865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.224063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.224021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 159
2025-10-15T10:55:48.224025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 159
2025-10-15T10:55:48.224098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 159, pipe: [1:7561400511827061086:3423]
2025-10-15T10:55:48.224289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:48.224364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400511827060952:3939], now have 1 active actors on pipe
2025-10-15T10:55:48.224391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400511827060876:2467], now have 1 active actors on pipe
2025-10-15T10:55:48.224410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400511827061086:3423], now have 1 active actors on pipe
2025-10-15T10:55:48.224472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:48.224496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:48.224529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400514626766095:3721]
2025-10-15T10:55:48.224550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400514626766095:3721]
2025-10-15T10:55:48.224561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400514626766095:3721]
2025-10-15T10:55:48.224596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:48.224636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:48.224650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:48.224658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:48.224662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:48.224815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:48.224836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:48.224893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78382346-81565fd9-9e928f8f-316c4fe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:48.224927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:48.224943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:48.224953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:48.224986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:48.225017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:48.225134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400514626766095:3721]
2025-10-15T10:55:48.225173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:48.225214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:48.225288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:48.225774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:48.225799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:48.225857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:48.226118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 160 partition: 0 MaxSeqNo: 46 sessionId: src_id|78382346-81565fd9-9e928f8f-316c4fe8_0
2025-10-15T10:55:48.226927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a52ed9c-1d0659c3-fd060d05-27b35be4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|78382346-81565fd9-9e928f8f-316c4fe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:48.246776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78382346-81565fd9-9e928f8f-316c4fe8_0] Write session: try to update token
2025-10-15T10:55:48.246827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78382346-81565fd9-9e928f8f-316c4fe8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:48.264340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:48.264373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:48.264403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400514626766095:3721]
2025-10-15T10:55:48.264510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:48.264536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:48.266551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:48.268024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:48.269430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:48.270631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:48.272426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:48.272880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:48.301462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:48.301499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:48.301512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:48.301523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:48.301560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400514626766095:3721]
2025-10-15T10:55:48.301585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400514626766095:3721]
2025-10-15T10:55:48.301609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400514626766095:3721]
2025-10-15T10:55:48.301735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:48.301736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:48.301764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:48.301771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:48.301805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:48.303266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:48.314496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId: src_id|78382346-81565fd9-9e928f8f-316c4fe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:48.344301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:48.445899Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:48.447228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:48.447264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:48.447905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:48.447853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:48.447881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:48.447954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400511827061086:3423]
2025-10-15T10:55:48.448087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:48.458169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 160 reason: error at write: Disconnected sessionId: src_id|78382346-81565fd9-9e928f8f-316c4fe8_0
2025-10-15T10:55:48.458446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 160 sessionId: src_id|78382346-81565fd9-9e928f8f-316c4fe8_0 is DEAD
2025-10-15T10:55:48.460050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78382346-81565fd9-9e928f8f-316c4fe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:48.460122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78382346-81565fd9-9e928f8f-316c4fe8_0] Write session will restart in 0.006734s
2025-10-15T10:55:48.460305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78382346-81565fd9-9e928f8f-316c4fe8_0] Write session: Do CDS request
2025-10-15T10:55:48.460356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78382346-81565fd9-9e928f8f-316c4fe8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:48.473385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:48.473419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 161
2025-10-15T10:55:48.473545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78382346-81565fd9-9e928f8f-316c4fe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:48.474148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:48.474312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:48.474334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:48.474344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:48.475673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 161 sessionId:  describe result for acl check
2025-10-15T10:55:48.475784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:48.475799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:48.475810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:48.475828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400511827061107:3943] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:48.479428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400511827061107:3943] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:48.485561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400511827061107:3943] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:48.492434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400511827061107:3943] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:48.492477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400511827061107:3943] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:48.492493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400511827061107:3943] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:48.492522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:48.541468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:48.545654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:48.546491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:48.546524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:48.546566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:48.546803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:48.547010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400514626766317:3723]
2025-10-15T10:55:48.547968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400511827061301:3423]
2025-10-15T10:55:48.549252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:48.550107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:48.550330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:48.551684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:48.552055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.552072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.552079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.552086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.552095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.552102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.552110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.552118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.552125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.552132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.552139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.552147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.552154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.552161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.552212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.552330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.552381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.552430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.552479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.552539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.552593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.552650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.552701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.552756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.552810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.552865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.552916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.552968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.553041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.553119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.553185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.553245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.553302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.553365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.553417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.553482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.553528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.553590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.553638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.553702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.553756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.553821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.553867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.553920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.553980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.554034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.554084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.554143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.554194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.554252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.554303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.554367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.554416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.554474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.554525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.554583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.555116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:48.572715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:48.582870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:48.582939Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:48.582957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:48.582977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:48.583004Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 160 [2:7561400514626766317:3723]
2025-10-15T10:55:48.583058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:48.583121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:48.583136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:48.583148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:48.583160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:48.583209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:48.583247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:48.583268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:48.585022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.585054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.585068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.585080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:48.585344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:48.585366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.585504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.585622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 160
2025-10-15T10:55:48.585696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.585736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 160
2025-10-15T10:55:48.585807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 160, pipe: [1:7561400511827061301:3423]
2025-10-15T10:55:48.585954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:48.586051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400511827061093:2467], now have 1 active actors on pipe
2025-10-15T10:55:48.586083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400511827061301:3423], now have 1 active actors on pipe
2025-10-15T10:55:48.586105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400511827061137:3943], now have 1 active actors on pipe
2025-10-15T10:55:48.586168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:48.586194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:48.586238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400514626766312:3723]
2025-10-15T10:55:48.586253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400514626766312:3723]
2025-10-15T10:55:48.586263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400514626766312:3723]
2025-10-15T10:55:48.586303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:48.586340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:48.586362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:48.586370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:48.586378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:48.586559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:48.586585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:48.586650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:48.586686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:48.586707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:48.586716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:48.586751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:48.586792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:48.586929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400514626766312:3723]
2025-10-15T10:55:48.586964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:48.587001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:48.587012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:48.587534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:48.587559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:48.587617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:48.587863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 161 partition: 0 MaxSeqNo: 46 sessionId: src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0
2025-10-15T10:55:48.590812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78382346-81565fd9-9e928f8f-316c4fe8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:48.612630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0] Write session: try to update token
2025-10-15T10:55:48.612692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:48.644101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:48.644136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:48.644167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400514626766312:3723]
2025-10-15T10:55:48.644285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:48.644306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:48.671769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:48.674513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:48.678983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:48.681179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:48.684645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:48.685645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:48.685688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:48.685705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:48.685780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:48.708128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId: src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:48.721569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:48.721611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:48.721624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:48.721636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:48.721675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400514626766312:3723]
2025-10-15T10:55:48.721703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400514626766312:3723]
2025-10-15T10:55:48.721725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400514626766312:3723]
2025-10-15T10:55:48.721886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:48.721909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:48.721918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:48.721958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:48.721992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:48.722976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:48.733063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:48.862079Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:48.864641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:48.865175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:48.864676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:48.865325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:48.865337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:48.868258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:48.896326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400511827061301:3423]
2025-10-15T10:55:48.896436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 161 reason: error at write: Disconnected sessionId: src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0
2025-10-15T10:55:48.897101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:48.897156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0] Write session will restart in 0.006111s
2025-10-15T10:55:48.896704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 161 sessionId: src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0 is DEAD
2025-10-15T10:55:48.897309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0] Write session: Do CDS request
2025-10-15T10:55:48.897349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:48.914779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:48.925968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:48.925998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 162
2025-10-15T10:55:48.926468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:48.926573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:48.926593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:48.926603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:48.927567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 162 sessionId:  describe result for acl check
2025-10-15T10:55:48.927665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:48.927677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:48.927687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:48.927703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400511827061361:3954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:48.930280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400511827061361:3954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:48.934993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400511827061361:3954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:48.943218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400511827061361:3954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:48.943264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400511827061361:3954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:48.943280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400511827061361:3954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:48.943312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:48.977623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:48.981210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:48.982058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:48.982076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:48.982115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:48.982361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:48.982535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400514626766557:3733]
2025-10-15T10:55:48.984791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:48.985986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:48.986218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:48.987600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:48.987953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.987975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.987983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.987990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.987996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.988003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.988010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.988016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.988024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.988030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.988037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.988044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.988051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.988058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.988103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.988216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.988265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.988310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.988356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.988413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.988464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.988515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.988566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.988612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.988657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.988701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.988744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.988791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.988837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.988900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:48.988971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.989024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:48.989073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.989126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:48.989170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.989224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:48.989272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.989324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:48.989379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.989435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:48.989484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.989536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:48.989581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.989634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:48.989680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.989742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:48.989786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.989839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:48.989883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.989933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:48.989977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.990029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:48.990074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.990141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:48.990185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.990234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:48.990717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:48.993882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400511827061558:3423]
2025-10-15T10:55:49.020428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:49.036684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:49.036739Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:49.036757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:49.036779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:49.036805Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 161 [2:7561400514626766557:3733]
2025-10-15T10:55:49.036858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:49.036918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:49.036931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:49.036944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:49.036955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:49.037004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:49.037041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:49.037063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:49.038735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.038772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.038789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.038802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:49.039083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:49.039111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.039251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.039475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.039607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 161, pipe: [1:7561400511827061558:3423]
2025-10-15T10:55:49.039719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:49.039819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400511827061558:3423], now have 1 active actors on pipe
2025-10-15T10:55:49.039857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400511827061409:3954], now have 1 active actors on pipe
2025-10-15T10:55:49.039732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 161
2025-10-15T10:55:49.039881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400511827061345:2467], now have 1 active actors on pipe
2025-10-15T10:55:49.039819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 161
2025-10-15T10:55:49.039906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400514626766552:3733]
2025-10-15T10:55:49.039922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400514626766552:3733]
2025-10-15T10:55:49.039936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400514626766552:3733]
2025-10-15T10:55:49.039976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:49.040054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:49.040166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:49.040186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:49.040198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:49.040211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:49.040230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:49.040348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400514626766552:3733]
2025-10-15T10:55:49.040373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:49.040382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:49.040429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:49.040447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:49.040597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:49.040637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:49.040655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:49.040665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:49.040701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:49.040742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:49.040815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:49.042515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:49.042554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:49.042634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:49.042982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 162 partition: 0 MaxSeqNo: 46 sessionId: src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0
2025-10-15T10:55:49.043870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e8fb3b-8fdd4bf6-97fe78dc-3199ce9f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:49.067192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0] Write session: try to update token
2025-10-15T10:55:49.067241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:49.103199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:49.103272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:49.103312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:49.103331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:49.103393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400514626766552:3733]
2025-10-15T10:55:49.103419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400514626766552:3733]
2025-10-15T10:55:49.103443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400514626766552:3733]
2025-10-15T10:55:49.103581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:49.103634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:49.103663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:49.103670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:49.103694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:49.105017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:49.143524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId: src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:49.165604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:49.251750Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:49.273974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:49.274154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400511827061558:3423]
2025-10-15T10:55:49.274246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:49.274263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:49.273341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:49.273403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:49.273474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:49.273490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:49.273537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400514626766552:3733]
2025-10-15T10:55:49.273738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:49.274142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:49.330662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 162 reason: error at write: Disconnected sessionId: src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0
2025-10-15T10:55:49.331028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 162 sessionId: src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0 is DEAD
2025-10-15T10:55:49.331571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:49.331637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0] Write session will restart in 0.007405s
2025-10-15T10:55:49.331795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0] Write session: Do CDS request
2025-10-15T10:55:49.331840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:49.346337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:49.346372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 163
2025-10-15T10:55:49.346503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:49.347036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:49.347170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:49.347203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:49.347217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:49.348719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 163 sessionId:  describe result for acl check
2025-10-15T10:55:49.348853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:49.348871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:49.348881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:49.348900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400516122029057:3964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:49.351517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400516122029057:3964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:49.357763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400516122029057:3964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:49.358240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:49.362109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:49.363001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:49.363036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:49.363082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:49.363366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:49.363567Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400518921734093:3742]
2025-10-15T10:55:49.364698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400516122029057:3964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:49.364738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400516122029057:3964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:49.364756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400516122029057:3964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:49.364787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:49.365736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:49.366703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:49.366935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:49.368258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:49.368587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:49.368603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:49.368610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:49.368618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:49.368625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:49.368633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:49.368641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:49.368648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:49.368656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:49.368664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:49.368672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:49.368679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.368686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.368693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.368745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:49.368860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:49.368914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:49.368967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:49.369021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:49.369076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:49.369131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:49.369178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:49.369229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:49.369285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:49.369339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:49.369387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.369435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.369482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.369534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:49.369610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:49.369672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:49.369730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:49.369789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:49.369842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:49.369892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:49.369952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:49.370003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:49.370059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:49.370103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:49.370162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:49.370215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:49.370273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:49.370327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:49.370382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:49.370435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:49.370503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:49.370553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:49.370612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:49.370663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:49.370719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:49.370771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.370834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.370888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.370961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.371016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.371079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.371661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:49.374308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400516122029094:3423]
2025-10-15T10:55:49.388168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:49.412071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:49.412119Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:49.412138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:49.412161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:49.412189Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 162 [2:7561400518921734093:3742]
2025-10-15T10:55:49.412240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:49.412299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:49.412314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:49.412325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:49.412336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:49.412374Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:49.412391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:49.412409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:49.413241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.413261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.413275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.413288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:49.413536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:49.413561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.413717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.413873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.413834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 162, pipe: [1:7561400516122029094:3423]
2025-10-15T10:55:49.413879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 162
2025-10-15T10:55:49.413967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 162
2025-10-15T10:55:49.414057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:49.414148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400516122029094:3423], now have 1 active actors on pipe
2025-10-15T10:55:49.414171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400516122029089:3964], now have 1 active actors on pipe
2025-10-15T10:55:49.414185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400516122028881:2467], now have 1 active actors on pipe
2025-10-15T10:55:49.414221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:49.414240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:49.414289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400518921734088:3742]
2025-10-15T10:55:49.414304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400518921734088:3742]
2025-10-15T10:55:49.414313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400518921734088:3742]
2025-10-15T10:55:49.414348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:49.414390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:49.414417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:49.414420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:49.414440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:49.414568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:49.414592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:49.414652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:49.414680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:49.414692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:49.414699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:49.414731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:49.414767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:49.414892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400518921734088:3742]
2025-10-15T10:55:49.414932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:49.414946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:49.414970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:49.415501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:49.415530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:49.415581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:49.415835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 163 partition: 0 MaxSeqNo: 46 sessionId: src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0
2025-10-15T10:55:49.416564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c548f-1c1e3332-812349d0-afc1c0d1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:49.436705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0] Write session: try to update token
2025-10-15T10:55:49.436765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:49.441764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:49.441800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:49.441841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400518921734088:3742]
2025-10-15T10:55:49.441971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:49.447494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:49.447698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:49.448946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:49.450193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:49.451618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:49.453486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:49.454127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:49.490229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:49.490265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:49.490278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:49.490292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:49.490338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400518921734088:3742]
2025-10-15T10:55:49.490364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400518921734088:3742]
2025-10-15T10:55:49.490385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400518921734088:3742]
2025-10-15T10:55:49.490535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:49.490552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:49.490563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:49.490592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:49.490644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:49.491623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:49.549968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId: src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:49.575059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:49.642567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:49.644371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:49.644421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:49.645416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400516122029094:3423]
2025-10-15T10:55:49.645543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:49.645555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:49.648439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:49.649660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:49.683647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:49.683727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0] Write session will restart in 0.008155s
2025-10-15T10:55:49.682154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 163 reason: error at write: Disconnected sessionId: src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0
2025-10-15T10:55:49.682548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 163 sessionId: src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0 is DEAD
2025-10-15T10:55:49.683909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0] Write session: Do CDS request
2025-10-15T10:55:49.683963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:49.698554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:49.698586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 164
2025-10-15T10:55:49.698995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:49.699508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:49.699638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:49.699655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:49.699666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:49.701199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 164 sessionId:  describe result for acl check
2025-10-15T10:55:49.701313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:49.701332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:49.701341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:49.701361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400516122029132:3969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:49.704229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400516122029132:3969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:49.713318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400516122029132:3969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:49.725492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400516122029132:3969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:49.725542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400516122029132:3969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:49.725563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400516122029132:3969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:49.725604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:49.747297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400516122029235:3423]
2025-10-15T10:55:49.796369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:49.799754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:49.800616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:49.800652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:49.800696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:49.800959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:49.801152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400518921734317:3745]
2025-10-15T10:55:49.803451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:49.804474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:49.804711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:49.805985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:49.806318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:49.806326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:49.806333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:49.806340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:49.806348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:49.806355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:49.806362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:49.806368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:49.806375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:49.806382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:49.806388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:49.806396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.806403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.806409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.806457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:49.806569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:49.806622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:49.806673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:49.806721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:49.806767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:49.806814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:49.806863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:49.806911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:49.806977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:49.807040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:49.807087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.807134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.807181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.807240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:49.807311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:49.808082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:49.808165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:49.808227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:49.808289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:49.808341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:49.808404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:49.808461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:49.808527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:49.808584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:49.808650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:49.808708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:49.808769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:49.808823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:49.808896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:49.808953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:49.809013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:49.809068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:49.809127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:49.809185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:49.809245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:49.809299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.809362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.809415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.809474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.809528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.809587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.810126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:49.825982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:49.835015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:49.835069Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:49.835090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:49.835111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:49.835137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 163 [2:7561400518921734317:3745]
2025-10-15T10:55:49.835193Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:49.835258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:49.835273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:49.835285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:49.835297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:49.835362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:49.835392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:49.835415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:49.836375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.836401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.836416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.836428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:49.836694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:49.836719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:49.836885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:49.837110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:49.837119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 163
2025-10-15T10:55:49.837133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 163, pipe: [1:7561400516122029235:3423]
2025-10-15T10:55:49.837238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 163
2025-10-15T10:55:49.837356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:49.837447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400516122029170:3969], now have 1 active actors on pipe
2025-10-15T10:55:49.837479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400516122029235:3423], now have 1 active actors on pipe
2025-10-15T10:55:49.837502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400516122029117:2467], now have 1 active actors on pipe
2025-10-15T10:55:49.837552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:49.837574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:49.837626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400518921734311:3745]
2025-10-15T10:55:49.837647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400518921734311:3745]
2025-10-15T10:55:49.837660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400518921734311:3745]
2025-10-15T10:55:49.837696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:49.837749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:49.837773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:49.837772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:49.837785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:49.837965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:49.837988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:49.838052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:49.838088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:49.838111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:49.838121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:49.838161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:49.838206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:49.838335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400518921734311:3745]
2025-10-15T10:55:49.838366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:49.838410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:49.838416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:49.839008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:49.839044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:49.839134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:49.839507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 164 partition: 0 MaxSeqNo: 46 sessionId: src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0
2025-10-15T10:55:49.840369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f33ae1c2-21eaa3a7-6606f3c6-bc51b5e1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:49.861643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0] Write session: try to update token
2025-10-15T10:55:49.861697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:49.895442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:49.895477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:49.895512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400518921734311:3745]
2025-10-15T10:55:49.895635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:49.895655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:49.897560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:49.898825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:49.900355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:49.901733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:49.903512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:49.903955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:49.942698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:49.942738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:49.942761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:49.942772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:49.942830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400518921734311:3745]
2025-10-15T10:55:49.942872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400518921734311:3745]
2025-10-15T10:55:49.942897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400518921734311:3745]
2025-10-15T10:55:49.943039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:49.943080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:49.943083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:49.943102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:49.943114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:49.943118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:49.943165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:49.943187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:49.944253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:49.963588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId: src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:49.984427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:50.085622Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:50.087310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:50.087372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:50.087815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:50.087974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:50.087994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:50.088003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:50.088005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400516122029235:3423]
2025-10-15T10:55:50.118376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 164 reason: error at write: Disconnected sessionId: src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0
2025-10-15T10:55:50.118742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 164 sessionId: src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0 is DEAD
2025-10-15T10:55:50.119836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:50.119882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0] Write session will restart in 0.009781s
2025-10-15T10:55:50.120034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0] Write session: Do CDS request
2025-10-15T10:55:50.120095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:50.135868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:50.137365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:50.137401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 165
2025-10-15T10:55:50.137803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:50.137919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:50.137939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:50.137948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:50.139172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 165 sessionId:  describe result for acl check
2025-10-15T10:55:50.139281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:50.139298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:50.139308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:50.139325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400520416996716:3976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:50.141931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400520416996716:3976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:50.150657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400520416996716:3976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:50.158761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400520416996716:3976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:50.158799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400520416996716:3976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:50.158815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400520416996716:3976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:50.158853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:50.159461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:50.162946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:50.163746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:50.163783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:50.163822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:50.164051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:50.164220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400523216701854:3754]
2025-10-15T10:55:50.165793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:50.166531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:50.166724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:50.167761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:50.168033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.168046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.168052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.168057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.168062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.168067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.168073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.168079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.168086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.168093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.168100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.168107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.168113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.168118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.168163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.168265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.168310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.168354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.168397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.168445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.168501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.168549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.168596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.168647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.168694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.168743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.168791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.168841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.168884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.168951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.169010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.169066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.169122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.169188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.169246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.169310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.169368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.169429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.169482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.169546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.169599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.169656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.169706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.169767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.169821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.169883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.169935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.169993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.170047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.170118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.170176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.170235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.170293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.170361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.170412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.170469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.170962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:50.186501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:50.188401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400520416996873:3423]
2025-10-15T10:55:50.200332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:50.200376Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:50.200391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:50.200409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:50.200432Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 164 [2:7561400523216701854:3754]
2025-10-15T10:55:50.200479Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:50.200529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:50.200542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:50.200554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:50.200565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:50.200612Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:50.200635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:50.200653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:50.202148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.202166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.202174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.202184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:50.202433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:50.202472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.202607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.202682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 164
2025-10-15T10:55:50.202770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.202794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 164, pipe: [1:7561400520416996873:3423]
2025-10-15T10:55:50.202904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 164
2025-10-15T10:55:50.202964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:50.203049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400520416996643:2467], now have 1 active actors on pipe
2025-10-15T10:55:50.203074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400520416996873:3423], now have 1 active actors on pipe
2025-10-15T10:55:50.203094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400520416996866:3976], now have 1 active actors on pipe
2025-10-15T10:55:50.203136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400523216701848:3754]
2025-10-15T10:55:50.203155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400523216701848:3754]
2025-10-15T10:55:50.203168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400523216701848:3754]
2025-10-15T10:55:50.203192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:50.203223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:50.203243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:50.203247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:50.203257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:50.203258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:50.203289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:50.203447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:50.203465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:50.203583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:50.203619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:50.203641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:50.203653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:50.203692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:50.203737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:50.203777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400523216701848:3754]
2025-10-15T10:55:50.203806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:50.203832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:50.203890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:50.204400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:50.204427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:50.204488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:50.204833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 165 partition: 0 MaxSeqNo: 46 sessionId: src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0
2025-10-15T10:55:50.205554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f375db7-68de1e51-3e1fe2fd-9fa0e7e1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:50.225639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0] Write session: try to update token
2025-10-15T10:55:50.225698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:50.231424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:50.231473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:50.231508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400523216701848:3754]
2025-10-15T10:55:50.231631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:50.231637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:50.233709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:50.235481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:50.236990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:50.238470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:50.240827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:50.241410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:50.325563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:50.325601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:50.325613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:50.325672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:50.325687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:50.325702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:50.325716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:50.325757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400523216701848:3754]
2025-10-15T10:55:50.325785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400523216701848:3754]
2025-10-15T10:55:50.325808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400523216701848:3754]
2025-10-15T10:55:50.325932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:50.325954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:50.325976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:50.325976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:50.326006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:50.326990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:50.354447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId: src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:50.377937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:50.491198Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:50.492799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:50.492838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:50.493383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:50.493463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:50.493635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400520416996873:3423]
2025-10-15T10:55:50.493725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:50.493743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:50.516996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 165 reason: error at write: Disconnected sessionId: src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0
2025-10-15T10:55:50.517343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 165 sessionId: src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0 is DEAD
2025-10-15T10:55:50.517759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:50.517798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0] Write session will restart in 0.009932s
2025-10-15T10:55:50.517897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0] Write session: Do CDS request
2025-10-15T10:55:50.517928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:50.532607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:50.539610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:50.539647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 166
2025-10-15T10:55:50.540454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:50.540581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:50.540604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:50.540614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:50.542362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 166 sessionId:  describe result for acl check
2025-10-15T10:55:50.542472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:50.542486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:50.542492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:50.542512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400520416996924:3984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:50.546153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400520416996924:3984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:50.552391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400520416996924:3984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:50.562296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400520416996924:3984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:50.562343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400520416996924:3984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:50.562360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400520416996924:3984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:50.562391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:50.573920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:50.576735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:50.577667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:50.577705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:50.577756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:50.578051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:50.578312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400523216702103:3761]
2025-10-15T10:55:50.580492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:50.581402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:50.581622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:50.582909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:50.583268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.583290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.583298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.583306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.583313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.583320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.583328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.583334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.583341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.583365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.583373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.583380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.583388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.583394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.583442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.583557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.583609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.583667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.583728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.583783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.583835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.583886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.583936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.583990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.584037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.584086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.584136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.584185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.584236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.584308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.584378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.584440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.584493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.584552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.584607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.584667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.584721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.584783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.584835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.584893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.584948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.585010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.585061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.585123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.585182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.585243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.585297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.585351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.585404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.585464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.585514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.585574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.585629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.585688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.585741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.585799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.586339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:50.593891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400520416997109:3423]
2025-10-15T10:55:50.634619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:50.643617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:50.643669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:50.643687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:50.643709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:50.643734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 165 [2:7561400523216702103:3761]
2025-10-15T10:55:50.643800Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:50.643866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:50.643887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:50.643899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:50.643911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:50.643963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:50.643992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:50.644020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:50.645034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.645061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.645074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.645086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:50.645358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:50.645383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.645527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.645653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 165
2025-10-15T10:55:50.645733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.645660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 165, pipe: [1:7561400520416997109:3423]
2025-10-15T10:55:50.645756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 165
2025-10-15T10:55:50.645969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:50.646061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400520416996885:2467], now have 1 active actors on pipe
2025-10-15T10:55:50.646091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400520416997109:3423], now have 1 active actors on pipe
2025-10-15T10:55:50.646113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400520416997055:3984], now have 1 active actors on pipe
2025-10-15T10:55:50.646179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:50.646205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:50.646243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400523216702097:3761]
2025-10-15T10:55:50.646263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400523216702097:3761]
2025-10-15T10:55:50.646275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400523216702097:3761]
2025-10-15T10:55:50.646313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:50.646353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:50.646376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:50.646388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:50.646391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:50.646577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:50.646602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:50.646671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:50.646708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:50.646731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:50.646743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:50.646780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:50.646826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:50.646969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400523216702097:3761]
2025-10-15T10:55:50.647005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:50.647019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:50.647051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:50.647587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:50.647619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:50.647686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:50.648019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 166 partition: 0 MaxSeqNo: 46 sessionId: src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0
2025-10-15T10:55:50.648800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7b8a767-3b98ca3a-3ccba6ad-9235b488_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:50.666750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0] Write session: try to update token
2025-10-15T10:55:50.666796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:50.675703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:50.675741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:50.675782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400523216702097:3761]
2025-10-15T10:55:50.675913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:50.675954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:50.677849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:50.679181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:50.680504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:50.681879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:50.683533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:50.711106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:50.744280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:50.744323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:50.744340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:50.744352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:50.744398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400523216702097:3761]
2025-10-15T10:55:50.744428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400523216702097:3761]
2025-10-15T10:55:50.744454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400523216702097:3761]
2025-10-15T10:55:50.744600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:50.744631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:50.744645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:50.744659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:50.744662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:50.744697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:50.744711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:50.744734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:50.745720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:50.746974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId: src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:50.766516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:50.887297Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:50.888800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:50.888850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:50.889425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:50.889428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:50.889451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:50.889595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:50.889614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400520416997109:3423]
2025-10-15T10:55:50.948491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:50.954454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:50.955660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:50.955689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:50.955726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:50.955783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 166 reason: error at write: Disconnected sessionId: src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0
2025-10-15T10:55:50.955939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:50.956138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 166 sessionId: src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0 is DEAD
2025-10-15T10:55:50.956121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400523216702335:3766]
2025-10-15T10:55:50.956602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:50.956665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0] Write session will restart in 0.005323s
2025-10-15T10:55:50.956822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0] Write session: Do CDS request
2025-10-15T10:55:50.956864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:50.960132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:50.961230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:50.961468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:50.962710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:50.963035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.963051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.963058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.963064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.963070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.963077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.963086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.963092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.963099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.963105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.963115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.963125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.963132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.963139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.963185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.963299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.963364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.963416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.963472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.963524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.963588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.963632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.963686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.963735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.963789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.963840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.963892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.963945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.964003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.964079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:50.964143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.964214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:50.964272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.964330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:50.964390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.964452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:50.964506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.964565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:50.964622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.964681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:50.964732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.964796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:50.964850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.964918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:50.964976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.965043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:50.965099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.965156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:50.965207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.965269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:50.965320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.965378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:50.965428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.965519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:50.965596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.965694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:50.966464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:50.966665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:50.966722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 167
2025-10-15T10:55:50.966855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:50.967721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:50.967870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:50.967901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:50.967914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:50.970188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 167 sessionId:  describe result for acl check
2025-10-15T10:55:50.970362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:50.970392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:50.970412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:50.970438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400520416997325:3992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:50.973171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400520416997325:3992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:50.978725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400520416997325:3992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:50.985761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400520416997325:3992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:50.985803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400520416997325:3992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:50.985834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400520416997325:3992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:50.985881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:50.987437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:50.989652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400520416997352:3423]
2025-10-15T10:55:50.996220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:50.996258Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:50.996272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:50.996287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:50.996306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 166 [2:7561400523216702335:3766]
2025-10-15T10:55:50.996353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:50.996407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:50.996419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:50.996432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:50.996441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:50.996477Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:50.996494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:50.996511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:51.009717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.009749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.009760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.009771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:51.010034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:51.010059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.010188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.010347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.010341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 166, pipe: [1:7561400520416997352:3423]
2025-10-15T10:55:51.010389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 166
2025-10-15T10:55:51.010445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 166
2025-10-15T10:55:51.010540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:51.010620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400520416997352:3423], now have 1 active actors on pipe
2025-10-15T10:55:51.010647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400520416997351:3992], now have 1 active actors on pipe
2025-10-15T10:55:51.010667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400520416997134:2467], now have 1 active actors on pipe
2025-10-15T10:55:51.010691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400523216702330:3766]
2025-10-15T10:55:51.010709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400523216702330:3766]
2025-10-15T10:55:51.010722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400523216702330:3766]
2025-10-15T10:55:51.010753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:51.010777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:51.010788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:51.010799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:51.010846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:51.010872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:51.010917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:51.011102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:51.011126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:51.011283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:51.011316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:51.011338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:51.011363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:51.011397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:51.011438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:51.011476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400523216702330:3766]
2025-10-15T10:55:51.011507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:51.011564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:51.011592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:51.012075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:51.012102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:51.012163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:51.012574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 167 partition: 0 MaxSeqNo: 46 sessionId: src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0
2025-10-15T10:55:51.013372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9346b3c5-98cca325-b3b4babb-72151e9e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:51.033970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0] Write session: try to update token
2025-10-15T10:55:51.034028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:51.042427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:51.042464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:51.042506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400523216702330:3766]
2025-10-15T10:55:51.042633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:51.042648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:51.044743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:51.046105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:51.047560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:51.048939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:51.050603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:51.051101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:51.113255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:51.113291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:51.113304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:51.113315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:51.113350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400523216702330:3766]
2025-10-15T10:55:51.113371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400523216702330:3766]
2025-10-15T10:55:51.113392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400523216702330:3766]
2025-10-15T10:55:51.113547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:51.113554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:51.113566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:51.113577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:51.113597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:51.113618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:51.113628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:51.113637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:51.114641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:51.115649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId: src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:51.136642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:51.250388Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:51.258343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:51.258389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:51.258969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:51.259010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:51.259004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:51.259019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:51.259192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400520416997352:3423]
2025-10-15T10:55:51.268872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 167 reason: error at write: Disconnected sessionId: src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0
2025-10-15T10:55:51.269269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 167 sessionId: src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0 is DEAD
2025-10-15T10:55:51.269731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:51.269769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0] Write session will restart in 0.009887s
2025-10-15T10:55:51.269961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0] Write session: Do CDS request
2025-10-15T10:55:51.270037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:51.285311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:51.285374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 168
2025-10-15T10:55:51.285960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:51.286693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:51.286846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:51.286872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:51.286884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:51.288159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 168 sessionId:  describe result for acl check
2025-10-15T10:55:51.288244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:51.288255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:51.288261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:51.288273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400524711964675:3997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:51.290680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400524711964675:3997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:51.296476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400524711964675:3997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:51.306134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400524711964675:3997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:51.306177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400524711964675:3997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:51.306197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400524711964675:3997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:51.306246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:51.325467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:51.329086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:51.329934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:51.329967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:51.330022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:51.330289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:51.330493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400527511669855:3769]
2025-10-15T10:55:51.332809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:51.333761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:51.333988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:51.335321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:51.335703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:51.335722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:51.335730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:51.335737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:51.335744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:51.335753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:51.335760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:51.335767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:51.335776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:51.335783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:51.335791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:51.335799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.335807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.335814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.335869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:51.335991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:51.336055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:51.336112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:51.336166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:51.336223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:51.336282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:51.336331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:51.336388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:51.336444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:51.336491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:51.336543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.336595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.336649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.336699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:51.336774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:51.351819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:51.351905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:51.351946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:51.351986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:51.352023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:51.352065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:51.352104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:51.352134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:51.352160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:51.352205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:51.352240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:51.352279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:51.352319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:51.352367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:51.352414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:51.352473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:51.352521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:51.352576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:51.352625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:51.352681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:51.352727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.352783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.352829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.352876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.352912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.352948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.353357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:51.359321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400524711964877:3423]
2025-10-15T10:55:51.369418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:51.378838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:51.378891Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:51.378911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:51.378932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:51.378971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 167 [2:7561400527511669855:3769]
2025-10-15T10:55:51.379031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:51.379113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:51.379130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:51.379145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:51.379159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:51.379214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:51.379244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:51.379270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:51.380557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.380585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.380600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.380613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:51.381311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 167, pipe: [1:7561400524711964877:3423]
2025-10-15T10:55:51.381354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 167
2025-10-15T10:55:51.381436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 167
2025-10-15T10:55:51.380930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:51.380959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.381118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.381331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.381581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:51.381672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400524711964877:3423], now have 1 active actors on pipe
2025-10-15T10:55:51.381696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400524711964764:3997], now have 1 active actors on pipe
2025-10-15T10:55:51.381720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400524711964659:2467], now have 1 active actors on pipe
2025-10-15T10:55:51.381771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:51.381794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:51.381848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400527511669850:3769]
2025-10-15T10:55:51.381863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400527511669850:3769]
2025-10-15T10:55:51.381876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400527511669850:3769]
2025-10-15T10:55:51.381922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:51.381962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:51.381979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:51.381993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:51.382001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:51.382205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:51.382223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:51.382291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63d88927-3866636f-67c01b05-f0b9c699_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:51.382326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:51.382345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:51.382356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:51.382394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:51.382438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:51.382575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400527511669850:3769]
2025-10-15T10:55:51.382608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:51.382634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:51.382656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:51.383123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:51.383148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:51.383237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:51.383560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 168 partition: 0 MaxSeqNo: 46 sessionId: src_id|63d88927-3866636f-67c01b05-f0b9c699_0
2025-10-15T10:55:51.384437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93ae5afd-a411b0e1-d72d212a-6aa9eaa0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|63d88927-3866636f-67c01b05-f0b9c699_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:51.405585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d88927-3866636f-67c01b05-f0b9c699_0] Write session: try to update token
2025-10-15T10:55:51.405641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d88927-3866636f-67c01b05-f0b9c699_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:51.412579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:51.412611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:51.412656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400527511669850:3769]
2025-10-15T10:55:51.412796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:51.412799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:51.414904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:51.426969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:51.428213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:51.429498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:51.431278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:51.431812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:51.488041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:51.488072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:51.488084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:51.488093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:51.488127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400527511669850:3769]
2025-10-15T10:55:51.488153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400527511669850:3769]
2025-10-15T10:55:51.488175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400527511669850:3769]
2025-10-15T10:55:51.488302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:51.488329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:51.488335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:51.488341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:51.488352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:51.488364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:51.488396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:51.488414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:51.489592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:51.503129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId: src_id|63d88927-3866636f-67c01b05-f0b9c699_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:51.525013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:51.627230Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:51.630414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:51.630452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:51.631451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:51.631587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400524711964877:3423]
2025-10-15T10:55:51.631136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:51.631654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:51.661988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 168 reason: status is not ok: tablet will be restarted right now sessionId: src_id|63d88927-3866636f-67c01b05-f0b9c699_0
2025-10-15T10:55:51.662279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 168 sessionId: src_id|63d88927-3866636f-67c01b05-f0b9c699_0 is DEAD
2025-10-15T10:55:51.662724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d88927-3866636f-67c01b05-f0b9c699_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:51.662783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d88927-3866636f-67c01b05-f0b9c699_0] Write session will restart in 0.006448s
2025-10-15T10:55:51.662949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d88927-3866636f-67c01b05-f0b9c699_0] Write session: Do CDS request
2025-10-15T10:55:51.662988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d88927-3866636f-67c01b05-f0b9c699_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:51.679940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d88927-3866636f-67c01b05-f0b9c699_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:51.689848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:51.689879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 169
2025-10-15T10:55:51.690294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:51.690388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:51.690406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:51.690415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:51.691941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 169 sessionId:  describe result for acl check
2025-10-15T10:55:51.692034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:51.692049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:51.692057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:51.692073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400524711964976:4008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:51.694116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400524711964976:4008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:51.701905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400524711964976:4008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:51.712618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400524711964976:4008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:51.712653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400524711964976:4008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:51.712665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400524711964976:4008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:51.712689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:51.715928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:51.719003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:51.719844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:51.719869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:51.719909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:51.720147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:51.720353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400527511670093:3778]
2025-10-15T10:55:51.722388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:51.723282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:51.723531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:51.724644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:51.724952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:51.724966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:51.724972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:51.724978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:51.725008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:51.725017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:51.725034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:51.725039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:51.725045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:51.725053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:51.725059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:51.725066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.725072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.725079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.725131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:51.725253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:51.725306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:51.725364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:51.725419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:51.725477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:51.725528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:51.725584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:51.725634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:51.725693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:51.725753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:51.725801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.725861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.725914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.725962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:51.726032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:51.726085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:51.726129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:51.726163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:51.726204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:51.726242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:51.726287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:51.726323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:51.726365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:51.726416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:51.726470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:51.726520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:51.726574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:51.726610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:51.726662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:51.726697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:51.726739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:51.726773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:51.726814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:51.726857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:51.726895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:51.726928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.726988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.727029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.727084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.727123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.727168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.727547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:51.732078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400524711965130:3423]
2025-10-15T10:55:51.744366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:51.775674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:51.775717Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:51.775733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:51.775750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:51.775772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 168 [2:7561400527511670093:3778]
2025-10-15T10:55:51.775820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:51.775873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:51.775885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:51.775896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:51.775906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:51.775953Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:51.775974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:51.775995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:51.777937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.777966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.777978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.777989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:51.778273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:51.778299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:51.778453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:51.778644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:51.778876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:51.778979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400524711965122:4008], now have 1 active actors on pipe
2025-10-15T10:55:51.779008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400524711964913:2467], now have 1 active actors on pipe
2025-10-15T10:55:51.779030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400524711965130:3423], now have 1 active actors on pipe
2025-10-15T10:55:51.779060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400527511670088:3778]
2025-10-15T10:55:51.779080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400527511670088:3778]
2025-10-15T10:55:51.779093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400527511670088:3778]
2025-10-15T10:55:51.779134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:51.779213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:51.779264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:51.779288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:51.779299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:51.779186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 168
2025-10-15T10:55:51.779278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 168
2025-10-15T10:55:51.779339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 168, pipe: [1:7561400524711965130:3423]
2025-10-15T10:55:51.779446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:51.779471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:51.779618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:51.779655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:51.779691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400527511670088:3778]
2025-10-15T10:55:51.779726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:51.779840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:51.779877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:51.779898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:51.779909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:51.779945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:51.779989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:51.780086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:51.780284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:51.780862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:51.780890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:51.780953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:51.782210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d88927-3866636f-67c01b05-f0b9c699_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:51.781449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 169 partition: 0 MaxSeqNo: 46 sessionId: src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0
2025-10-15T10:55:51.808092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0] Write session: try to update token
2025-10-15T10:55:51.808142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:51.885397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:51.885424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:51.885436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:51.885446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:51.885476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400527511670088:3778]
2025-10-15T10:55:51.885499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400527511670088:3778]
2025-10-15T10:55:51.885522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400527511670088:3778]
2025-10-15T10:55:51.885648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:51.885681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:51.885710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:51.885717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:51.885729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:51.885738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:51.885778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:51.885796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:51.886826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:51.922591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId: src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:51.947155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:52.021933Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:52.048894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:52.048939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:52.049001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:52.049014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:52.049052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400527511670088:3778]
2025-10-15T10:55:52.049218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:52.049548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400524711965130:3423]
2025-10-15T10:55:52.049590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:52.049661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:52.049683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:52.050726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:52.095861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:52.095952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0] Write session will restart in 0.008815s
2025-10-15T10:55:52.096167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0] Write session: Do CDS request
2025-10-15T10:55:52.096219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:52.095139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 169 reason: error at write: Disconnected sessionId: src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0
2025-10-15T10:55:52.095455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 169 sessionId: src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0 is DEAD
2025-10-15T10:55:52.109916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:52.109949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 170
2025-10-15T10:55:52.110522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:52.111230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:52.111388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:52.111412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:52.111424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:52.112878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 170 sessionId:  describe result for acl check
2025-10-15T10:55:52.112997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:52.113012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:52.113022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:52.113045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400529006932556:4016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:52.115971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400529006932556:4016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:52.126735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400529006932556:4016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:52.134357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400529006932556:4016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:52.134394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400529006932556:4016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:52.134408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400529006932556:4016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:52.134435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:52.139373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:52.143855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:52.144649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:52.144681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:52.144721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:52.144958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:52.145148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400531806637649:3788]
2025-10-15T10:55:52.147500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:52.148505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:52.148706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:52.151702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400529006932678:3423]
2025-10-15T10:55:52.150047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:52.150377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:52.150385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:52.150392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:52.150399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:52.150461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:52.150472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:52.150478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:52.150484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:52.150490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:52.150496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:52.150502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:52.150507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.150512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.150519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.150564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:52.150669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:52.150715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:52.150760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:52.150801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:52.150859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:52.150907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:52.150969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:52.151014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:52.151058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:52.151103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:52.151148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.151191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.151235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.151277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:52.151338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:52.151414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:52.151471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:52.151520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:52.151573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:52.151616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:52.151666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:52.151708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:52.151755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:52.151805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:52.151857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:52.151901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:52.151954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:52.151995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:52.152043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:52.152087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:52.152135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:52.152179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:52.152230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:52.152274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:52.152324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:52.152365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.152413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.152458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.152509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.152551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.152608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.153106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:52.180367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:52.192074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:52.192117Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:52.192132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:52.192148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:52.192169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 169 [2:7561400531806637649:3788]
2025-10-15T10:55:52.192222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:52.192275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:52.192287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:52.192297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:52.192307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:52.192346Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:52.192365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:52.192385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:52.193520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.193536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.193543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.193549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:52.195064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:52.195089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.195228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.195425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.195642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:52.195679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400529006932457:2467], now have 1 active actors on pipe
2025-10-15T10:55:52.195699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400529006932678:3423], now have 1 active actors on pipe
2025-10-15T10:55:52.195729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400529006932672:4016], now have 1 active actors on pipe
2025-10-15T10:55:52.195681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 169
2025-10-15T10:55:52.195780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400531806637643:3788]
2025-10-15T10:55:52.195793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400531806637643:3788]
2025-10-15T10:55:52.195768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 169
2025-10-15T10:55:52.195804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400531806637643:3788]
2025-10-15T10:55:52.195824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 169, pipe: [1:7561400529006932678:3423]
2025-10-15T10:55:52.195831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:52.195898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:52.196060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:52.196075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:52.196089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:52.196101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:52.196111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:52.196174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400531806637643:3788]
2025-10-15T10:55:52.196202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:52.196253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:52.196270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:52.196399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:52.196424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:52.196454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:52.196470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:52.196485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:52.196500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:52.196532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:52.196594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:52.199881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:52.199909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:52.199973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:52.201017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b80f3fed-ecd24c87-c205dd0f-7caac121_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:52.200303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 170 partition: 0 MaxSeqNo: 46 sessionId: src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0
2025-10-15T10:55:52.235780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0] Write session: try to update token
2025-10-15T10:55:52.235823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:52.314025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:52.314050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:52.314061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:52.314111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:52.314125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:52.314138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:52.314147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:52.314179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400531806637643:3788]
2025-10-15T10:55:52.314203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400531806637643:3788]
2025-10-15T10:55:52.314225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400531806637643:3788]
2025-10-15T10:55:52.314350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:52.314356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:52.314374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:52.314388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:52.314420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:52.318055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:52.333976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId: src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:52.362462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:52.458084Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:52.459773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:52.459817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:52.462471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:52.463737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400529006932678:3423]
2025-10-15T10:55:52.463739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:52.463882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:52.471254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0
2025-10-15T10:55:52.471859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 170 sessionId: src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0 is DEAD
2025-10-15T10:55:52.474212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:55:52.474275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0] Write session will restart in 0.008291s
2025-10-15T10:55:52.474466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0] Write session: Do CDS request
2025-10-15T10:55:52.474520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:52.488356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:52.488392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 171
2025-10-15T10:55:52.488659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:52.489323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:52.489474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:52.489490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:52.489499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:52.492736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 171 sessionId:  describe result for acl check
2025-10-15T10:55:52.492847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:52.492867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:52.492875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:52.492890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400529006932697:4020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:52.495102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400529006932697:4020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:52.512528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400529006932697:4020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:52.529650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400529006932697:4020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:52.529690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400529006932697:4020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:52.529705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400529006932697:4020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:52.529730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:52.566253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400529006932859:3423]
2025-10-15T10:55:52.588184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:52.597029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:52.597863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:52.597885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:52.597923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:52.598190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:52.598391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400531806637877:3790]
2025-10-15T10:55:52.600644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:52.601738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:52.601938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:52.603151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:52.603492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:52.603498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:52.603504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:52.603511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:52.603515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:52.603521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:52.603526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:52.603531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:52.603536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:52.603541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:52.603546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:52.603551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.603556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.603562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.603607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:52.603705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:52.603751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:52.603797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:52.603840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:52.603883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:52.603930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:52.603972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:52.604014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:52.604058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:52.604101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:52.604143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.604184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.604226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.604263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:52.604323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:52.604375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:52.604429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:52.604474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:52.604523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:52.604570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:52.604619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:52.604664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:52.604713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:52.604754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:52.604804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:52.604847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:52.604895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:52.604936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:52.604982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:52.605027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:52.605078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:52.605117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:52.605167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:52.605214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:52.605269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:52.605322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.605370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.605415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.605461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.605497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.605540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.605978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:52.629140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:52.643085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:52.643149Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:52.643168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:52.643207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:52.643234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 170 [2:7561400531806637877:3790]
2025-10-15T10:55:52.643291Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:52.643369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:52.643395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:52.643408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:52.643420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:52.643472Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:52.643501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:52.643523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:52.644598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.644619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.644633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.644645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:52.644917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:52.644941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:52.645091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:52.645300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:52.645559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:52.645708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400529006932742:4020], now have 1 active actors on pipe
2025-10-15T10:55:52.645733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400529006932689:2467], now have 1 active actors on pipe
2025-10-15T10:55:52.645756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400529006932859:3423], now have 1 active actors on pipe
2025-10-15T10:55:52.645781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400531806637872:3790]
2025-10-15T10:55:52.645797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400531806637872:3790]
2025-10-15T10:55:52.645810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400531806637872:3790]
2025-10-15T10:55:52.645849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:52.645883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:52.645898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:52.645918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:52.645923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:52.646122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:52.646140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:52.646258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400531806637872:3790]
2025-10-15T10:55:52.646280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:52.646356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:52.645870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 170
2025-10-15T10:55:52.646405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:52.645962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 170
2025-10-15T10:55:52.646428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:52.646013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 170, pipe: [1:7561400529006932859:3423]
2025-10-15T10:55:52.646526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:52.646557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:52.646575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:52.646586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:52.646620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:52.646660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:52.646712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:52.648989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 171 partition: 0 MaxSeqNo: 46 sessionId: src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0
2025-10-15T10:55:52.648648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:52.648669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:52.648719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:52.655128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b958ac-f16270c4-4e1b862a-983ebd0b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:52.686384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0] Write session: try to update token
2025-10-15T10:55:52.686449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:52.728431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:52.728458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:52.728468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:52.728477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:52.728515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400531806637872:3790]
2025-10-15T10:55:52.728550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400531806637872:3790]
2025-10-15T10:55:52.728573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400531806637872:3790]
2025-10-15T10:55:52.728736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:52.728735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:52.728761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:52.728771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:52.728806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:52.729837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:52.837758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId: src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:52.859493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:52.904589Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:52.906080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:52.906110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:52.908735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:52.909052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:52.908847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400529006932859:3423]
2025-10-15T10:55:52.908899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:52.908906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:52.933518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 171 reason: error at write: Disconnected sessionId: src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0
2025-10-15T10:55:52.934215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:52.934264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0] Write session will restart in 0.006174s
2025-10-15T10:55:52.934406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0] Write session: Do CDS request
2025-10-15T10:55:52.934449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:52.933858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 171 sessionId: src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0 is DEAD
2025-10-15T10:55:52.946426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:52.946585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:52.946621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 172
2025-10-15T10:55:52.946919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:52.947075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:52.947098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:52.947107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:52.948434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 172 sessionId:  describe result for acl check
2025-10-15T10:55:52.948540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:52.948555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:52.948564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:52.948581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400529006932956:4025] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:52.951050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400529006932956:4025] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:52.964901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400529006932956:4025] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:52.979994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400529006932956:4025] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:52.980046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400529006932956:4025] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:52.980064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400529006932956:4025] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:52.980094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:53.008975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400533301900430:3423]
2025-10-15T10:55:53.018930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:53.044712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:53.045587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:53.045617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:53.045662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:53.045922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:53.046113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400536101605423:3793]
2025-10-15T10:55:53.048440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:53.055710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:53.055980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:53.057361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:53.057720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:53.057728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:53.057734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:53.057741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:53.057747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:53.057754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:53.057761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:53.057768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:53.057776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:53.057782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:53.057790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:53.057795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.057803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.057810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.057860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:53.057980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:53.058032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:53.058083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:53.058130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:53.058179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:53.058226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:53.058272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:53.058321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:53.058369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:53.058415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:53.058461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.058508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.058556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.058602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:53.058669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:53.058730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:53.058787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:53.058838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:53.058895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:53.058941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:53.059009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:53.059058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:53.059116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:53.059164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:53.059216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:53.059262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:53.059315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:53.059433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:53.059494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:53.059557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:53.059611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:53.059656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:53.059714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:53.059761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:53.059817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:53.059864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.059918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.059963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.060019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.060064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.060116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.060646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:53.092133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:53.109822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:53.109856Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:53.109870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:53.109885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:53.109907Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 171 [2:7561400536101605423:3793]
2025-10-15T10:55:53.109949Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:53.109996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:53.110007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:53.110017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:53.110027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:53.110068Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:53.110087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:53.110106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:53.111909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.111932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.111943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.111954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:53.112224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:53.112243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.112368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.112531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.112734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:53.112789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400536101605418:3793]
2025-10-15T10:55:53.112802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400536101605418:3793]
2025-10-15T10:55:53.112812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400536101605418:3793]
2025-10-15T10:55:53.112870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:53.112940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:53.113105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:53.113119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:53.113216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400536101605418:3793]
2025-10-15T10:55:53.113231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:53.113469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:53.113485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:53.113497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:53.113523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:53.114425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400529006933007:4025], now have 1 active actors on pipe
2025-10-15T10:55:53.114459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400529006932940:2467], now have 1 active actors on pipe
2025-10-15T10:55:53.114478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400533301900430:3423], now have 1 active actors on pipe
2025-10-15T10:55:53.115800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:53.115838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:53.115926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:53.115960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:53.115977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:53.116008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:53.116048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:53.116094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:53.115170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 171
2025-10-15T10:55:53.116143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:53.115252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 171
2025-10-15T10:55:53.115313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 171, pipe: [1:7561400533301900430:3423]
2025-10-15T10:55:53.121891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:53.121928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:53.122009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:53.123809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 172 partition: 0 MaxSeqNo: 46 sessionId: src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0
2025-10-15T10:55:53.124615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c29b0cc-4732352b-c86d131a-ab757d8f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:53.181406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0] Write session: try to update token
2025-10-15T10:55:53.181465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:53.272681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:53.272728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:53.272744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:53.272770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:53.272824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400536101605418:3793]
2025-10-15T10:55:53.272870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400536101605418:3793]
2025-10-15T10:55:53.272909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400536101605418:3793]
2025-10-15T10:55:53.273151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:53.273186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:53.273207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:53.275448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:53.275489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:53.275517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:53.289998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:53.290037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:53.291137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:53.314696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId: src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:53.349525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:53.459576Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:53.461754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:53.461771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:53.461808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400536101605418:3793]
2025-10-15T10:55:53.461935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:53.461957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:53.462617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:53.463973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:53.464005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:53.463508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:53.474900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:53.475065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400533301900430:3423]
2025-10-15T10:55:53.475143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 172 reason: error at write: Disconnected sessionId: src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0
2025-10-15T10:55:53.476178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:53.476233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0] Write session will restart in 0.007780s
2025-10-15T10:55:53.476337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0] Write session: Do CDS request
2025-10-15T10:55:53.476368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:53.492429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:53.491522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 172 sessionId: src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0 is DEAD
2025-10-15T10:55:53.511558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:53.511596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 173
2025-10-15T10:55:53.512204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:53.512374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:53.512398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:53.512410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:53.515543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 173 sessionId:  describe result for acl check
2025-10-15T10:55:53.515787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:53.515805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:53.515826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:53.515860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400533301900504:4036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:53.520755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400533301900504:4036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:53.541017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400533301900504:4036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:53.557018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400533301900504:4036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:53.557088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400533301900504:4036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:53.557107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400533301900504:4036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:53.557143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:53.575833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400533301900663:3423]
2025-10-15T10:55:53.597268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:53.600934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:53.601841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:53.601858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:53.601899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:53.602124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:53.602290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400536101605676:3803]
2025-10-15T10:55:53.604404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:53.606406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:53.606594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:53.607845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:53.608183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:53.608191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:53.608197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:53.608204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:53.608210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:53.608216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:53.608222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:53.608231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:53.608238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:53.608244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:53.608250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:53.608257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.608263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.608270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.608314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:53.608426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:53.608480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:53.608525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:53.608572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:53.608623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:53.608666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:53.608710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:53.608754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:53.608797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:53.608843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:53.608887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.608929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.608974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.609015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:53.609075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:53.609130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:53.609180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:53.609227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:53.609279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:53.609323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:53.609372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:53.609420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:53.609471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:53.609515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:53.609600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:53.609645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:53.609699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:53.609748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:53.609801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:53.609843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:53.609892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:53.609934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:53.609982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:53.610028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:53.610077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:53.610121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.610168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.610214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.610260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.610303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.610351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.610805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:53.630614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:53.641636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:53.641677Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:53.641693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:53.641711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:53.641733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 172 [2:7561400536101605676:3803]
2025-10-15T10:55:53.641775Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:53.641826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:53.641839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:53.641851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:53.641860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:53.641903Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:53.641922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:53.641958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:53.681143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 172
2025-10-15T10:55:53.681227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 172
2025-10-15T10:55:53.681277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 172, pipe: [1:7561400533301900663:3423]
2025-10-15T10:55:53.679917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.679940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.679951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.679961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:53.680220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:53.680235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:53.680353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:53.680506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:53.680701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:53.680762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400536101605671:3803]
2025-10-15T10:55:53.680775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400536101605671:3803]
2025-10-15T10:55:53.680785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400536101605671:3803]
2025-10-15T10:55:53.680813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:53.680877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:53.680909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:53.680918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:53.680924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:53.681028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:53.681042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:53.681162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400533301900663:3423], now have 1 active actors on pipe
2025-10-15T10:55:53.681184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400533301900597:4036], now have 1 active actors on pipe
2025-10-15T10:55:53.681202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400533301900489:2467], now have 1 active actors on pipe
2025-10-15T10:55:53.681219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400536101605671:3803]
2025-10-15T10:55:53.681237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:53.681560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:53.681746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:53.681769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:53.681848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56726042-cda24bdf-cb717858-16bc8590_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:53.681873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:53.681889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:53.681898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:53.681929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:53.681964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:53.682006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:53.684505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:53.684534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:53.684596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:53.684960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 173 partition: 0 MaxSeqNo: 46 sessionId: src_id|56726042-cda24bdf-cb717858-16bc8590_0
2025-10-15T10:55:53.685757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6530d7fa-81d0a8c0-ab9cc66d-12d2ae85_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|56726042-cda24bdf-cb717858-16bc8590_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:53.727481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56726042-cda24bdf-cb717858-16bc8590_0] Write session: try to update token
2025-10-15T10:55:53.727558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56726042-cda24bdf-cb717858-16bc8590_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:53.742180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:53.742208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:53.742220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:53.829481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:53.829515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:53.829528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:53.829539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:53.829574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400536101605671:3803]
2025-10-15T10:55:53.829601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400536101605671:3803]
2025-10-15T10:55:53.829625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400536101605671:3803]
2025-10-15T10:55:53.829848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:53.829871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:53.830044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:53.830081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:53.830107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:53.836414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:53.887406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId: src_id|56726042-cda24bdf-cb717858-16bc8590_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:53.911209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:53.982164Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:53.992042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:53.992096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:53.992174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:53.992189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:53.992232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400536101605671:3803]
2025-10-15T10:55:53.992477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:53.992839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:53.992779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:53.992807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:53.995546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400533301900663:3423]
2025-10-15T10:55:53.995673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:54.054438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 173 reason: error at write: Disconnected sessionId: src_id|56726042-cda24bdf-cb717858-16bc8590_0
2025-10-15T10:55:54.054760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 173 sessionId: src_id|56726042-cda24bdf-cb717858-16bc8590_0 is DEAD
2025-10-15T10:55:54.060046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56726042-cda24bdf-cb717858-16bc8590_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:54.060090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56726042-cda24bdf-cb717858-16bc8590_0] Write session will restart in 0.007189s
2025-10-15T10:55:54.060199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56726042-cda24bdf-cb717858-16bc8590_0] Write session: Do CDS request
2025-10-15T10:55:54.060232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56726042-cda24bdf-cb717858-16bc8590_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:54.077324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56726042-cda24bdf-cb717858-16bc8590_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:54.077711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:54.077747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 174
2025-10-15T10:55:54.078151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:54.078372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:54.078419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:54.078442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:54.081385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 174 sessionId:  describe result for acl check
2025-10-15T10:55:54.081561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:54.081584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:54.081596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:54.081614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400537596868143:4046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:54.084845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400537596868143:4046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:54.096540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400537596868143:4046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:54.096739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400537596868215:3423]
2025-10-15T10:55:54.112118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400537596868143:4046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:54.112162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400537596868143:4046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:54.112179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400537596868143:4046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:54.112210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:54.120570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:54.122815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:54.123659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:54.123688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:54.123730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:54.123972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:54.124149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400540396573212:3813]
2025-10-15T10:55:54.126153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:54.127887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:54.128094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:54.129282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:54.129579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:54.129586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:54.129592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:54.129598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:54.129603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:54.129609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:54.129616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:54.129622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:54.129628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:54.129634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:54.129640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:54.129646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.129652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.129658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.129704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:54.129805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:54.129851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:54.129893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:54.129933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:54.129975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:54.130022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:54.130067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:54.130114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:54.130156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:54.130208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:54.130249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.130296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.130345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.130389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:54.130449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:54.130513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:54.130574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:54.130619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:54.130670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:54.130714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:54.130763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:54.130808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:54.130854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:54.130897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:54.130946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:54.130999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:54.131047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:54.131086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:54.131135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:54.131180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:54.131230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:54.131272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:54.131320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:54.131514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:54.131568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:54.131614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.131662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.131706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.131785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.131830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.131879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.132380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:54.153034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:54.172514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:54.172552Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:54.172566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:54.172584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:54.172607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 173 [2:7561400540396573212:3813]
2025-10-15T10:55:54.172656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:54.172707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:54.172720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:54.172730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:54.172739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:54.172784Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:54.172805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:54.172825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:54.173825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.173840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.173851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.173861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:54.174115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:54.174131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.174255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.174418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.174629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:54.174691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400540396573207:3813]
2025-10-15T10:55:54.174703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400540396573207:3813]
2025-10-15T10:55:54.174715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400540396573207:3813]
2025-10-15T10:55:54.174754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:54.174820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:54.175002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:54.175019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:54.175130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400540396573207:3813]
2025-10-15T10:55:54.175149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:54.176203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:54.176222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:54.176234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:54.176258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:54.178173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400533301900750:2467], now have 1 active actors on pipe
2025-10-15T10:55:54.178200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400537596868215:3423], now have 1 active actors on pipe
2025-10-15T10:55:54.178219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400537596868266:4046], now have 1 active actors on pipe
2025-10-15T10:55:54.178277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:54.178295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:54.178356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a89892d5-79293d1-64d8286d-7385068d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:54.178382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:54.178396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:54.178405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:54.178435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:54.178471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:54.178508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:54.177384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 173
2025-10-15T10:55:54.177494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 173, pipe: [1:7561400537596868215:3423]
2025-10-15T10:55:54.177574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 173
2025-10-15T10:55:54.179711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:54.179727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:54.179770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:54.180721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 174 partition: 0 MaxSeqNo: 46 sessionId: src_id|a89892d5-79293d1-64d8286d-7385068d_0
2025-10-15T10:55:54.181479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56726042-cda24bdf-cb717858-16bc8590_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a89892d5-79293d1-64d8286d-7385068d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:54.214994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89892d5-79293d1-64d8286d-7385068d_0] Write session: try to update token
2025-10-15T10:55:54.215049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89892d5-79293d1-64d8286d-7385068d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:54.221461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:54.221486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:54.221522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400540396573207:3813]
2025-10-15T10:55:54.221626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:54.221683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:54.230159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:54.234623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:54.235877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:54.237141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:54.244660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:54.245013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:54.275598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:54.275626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:54.275638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:54.414865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId: src_id|a89892d5-79293d1-64d8286d-7385068d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:54.431280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:54.431318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:54.431334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:54.431361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:54.431408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400540396573207:3813]
2025-10-15T10:55:54.431438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400540396573207:3813]
2025-10-15T10:55:54.431462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400540396573207:3813]
2025-10-15T10:55:54.431649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:54.431666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:54.431678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:54.431728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:54.431761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:54.432777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:54.433587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:54.433626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:54.433656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:54.462394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:54.592742Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:54.595149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:54.595188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:54.596601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:54.596754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400537596868215:3423]
2025-10-15T10:55:54.596821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:54.596830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:54.599622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:54.638137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 174 reason: error at write: Disconnected sessionId: src_id|a89892d5-79293d1-64d8286d-7385068d_0
2025-10-15T10:55:54.638517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 174 sessionId: src_id|a89892d5-79293d1-64d8286d-7385068d_0 is DEAD
2025-10-15T10:55:54.646307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89892d5-79293d1-64d8286d-7385068d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:54.646347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89892d5-79293d1-64d8286d-7385068d_0] Write session will restart in 0.007306s
2025-10-15T10:55:54.646434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89892d5-79293d1-64d8286d-7385068d_0] Write session: Do CDS request
2025-10-15T10:55:54.646461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89892d5-79293d1-64d8286d-7385068d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:54.658887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a89892d5-79293d1-64d8286d-7385068d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:54.676408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:54.676440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 175
2025-10-15T10:55:54.677193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:54.677307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:54.677323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:54.677331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:54.681167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 175 sessionId:  describe result for acl check
2025-10-15T10:55:54.681281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:54.681291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:54.681300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:54.681318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400537596868363:4058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:54.686696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400537596868363:4058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:54.698438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400537596868363:4058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:54.698687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400537596868434:3423]
2025-10-15T10:55:54.711318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400537596868363:4058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:54.711374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400537596868363:4058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:54.711392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400537596868363:4058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:54.711423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:54.758047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:54.766331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:54.767306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:54.767326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:54.767395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:54.767607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:54.767769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400540396573456:3822]
2025-10-15T10:55:54.769426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:54.771276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:54.771496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:54.772421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:54.772706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:54.772720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:54.772727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:54.772736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:54.772743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:54.772750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:54.772757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:54.772763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:54.772769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:54.772775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:54.772782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:54.772788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.772794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.772801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.772846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:54.772953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:54.773001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:54.773055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:54.773106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:54.773160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:54.773208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:54.773257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:54.773308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:54.773359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:54.773409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:54.773457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.773504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.773555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.773598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:54.773668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:54.773730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:54.773789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:54.773840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:54.773898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:54.773946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:54.774004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:54.774059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:54.774117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:54.774166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:54.774226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:54.774279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:54.774336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:54.774386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:54.774444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:54.774495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:54.774565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:54.774631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:54.774689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:54.774736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:54.774796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:54.774845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.774899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.774946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.775013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.775063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.775119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.775799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:54.798281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:54.808959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:54.808993Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:54.809005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:54.809019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:54.809039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 174 [2:7561400540396573456:3822]
2025-10-15T10:55:54.809078Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:54.809126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:54.809141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:54.809154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:54.809166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:54.809217Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:54.809240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:54.809261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:54.835273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.835303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.835316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.835328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:54.836014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:54.836041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:54.836182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:54.836361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:54.836584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:54.837147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 174, pipe: [1:7561400537596868434:3423]
2025-10-15T10:55:54.836668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400537596868434:3423], now have 1 active actors on pipe
2025-10-15T10:55:54.836690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400537596868287:2467], now have 1 active actors on pipe
2025-10-15T10:55:54.837255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 174
2025-10-15T10:55:54.836711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400537596868471:4058], now have 1 active actors on pipe
2025-10-15T10:55:54.837329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 174
2025-10-15T10:55:54.836738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400540396573450:3822]
2025-10-15T10:55:54.836754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400540396573450:3822]
2025-10-15T10:55:54.836766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400540396573450:3822]
2025-10-15T10:55:54.836806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:54.836853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:54.836868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:54.836880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:54.836881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:54.837065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:54.837082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:54.837206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400540396573450:3822]
2025-10-15T10:55:54.837233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:54.837805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:54.838599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:54.838629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:54.838712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:54.838747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:54.838766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:54.838778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:54.838817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:54.838861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:54.838918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:54.843387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:54.843421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:54.843503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:54.843931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 175 partition: 0 MaxSeqNo: 46 sessionId: src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0
2025-10-15T10:55:54.844735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a89892d5-79293d1-64d8286d-7385068d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:54.870733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0] Write session: try to update token
2025-10-15T10:55:54.870797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:54.967954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:54.967982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:54.967995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:54.968107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:54.968121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:54.968134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:54.968144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:54.968178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400540396573450:3822]
2025-10-15T10:55:54.968201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400540396573450:3822]
2025-10-15T10:55:54.968225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400540396573450:3822]
2025-10-15T10:55:54.968329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:54.968369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:54.968398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:55.027837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:55.027880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:55.072166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:55.083207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId: src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:55.126678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:55.231074Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:55.236881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:55.236917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:55.236970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400540396573450:3822]
2025-10-15T10:55:55.237126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:55.237138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:55.237166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:55.237901Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:55.238025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400537596868434:3423]
2025-10-15T10:55:55.238122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:55.238236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:55.238248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:55.244797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 175 reason: error at write: Disconnected sessionId: src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0
2025-10-15T10:55:55.245176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 175 sessionId: src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0 is DEAD
2025-10-15T10:55:55.251887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:55.251932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0] Write session will restart in 0.005570s
2025-10-15T10:55:55.252031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0] Write session: Do CDS request
2025-10-15T10:55:55.252058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:55.268838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:55.268871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 176
2025-10-15T10:55:55.269289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:55.270252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:55.270414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:55.270431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:55.270441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:55.271862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 176 sessionId:  describe result for acl check
2025-10-15T10:55:55.271985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:55.272004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:55.272014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:55.272032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400541891835879:4066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:55.275096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400541891835879:4066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:55.283584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400541891835879:4066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:55.305202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400541891835879:4066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:55.305246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400541891835879:4066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:55.305263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400541891835879:4066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:55.305292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:55.337201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400541891836026:3423]
2025-10-15T10:55:55.363091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:55.364845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:55.365770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:55.365799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:55.365845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:55.366118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:55.366311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400544691541019:3832]
2025-10-15T10:55:55.368634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:55.370481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:55.370702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:55.372062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:55.372427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:55.372442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:55.372450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:55.372458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:55.372464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:55.372472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:55.372481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:55.372488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:55.372495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:55.372502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:55.372509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:55.372518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.372525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.372531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.372583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:55.372701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:55.372757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:55.372818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:55.372877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:55.372930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:55.372981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:55.373033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:55.373086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:55.373142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:55.373194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:55.373247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.373300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.373353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.373403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:55.373477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:55.373542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:55.373604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:55.373658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:55.373727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:55.373783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:55.373846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:55.373895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:55.373954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:55.374001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:55.374060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:55.374117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:55.374181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:55.374237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:55.374292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:55.374351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:55.374420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:55.374472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:55.374527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:55.374576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:55.374633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:55.374683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.374740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.374791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.374852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.374900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.374954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.375898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:55.403174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:55.413055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:55.413101Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:55.413122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:55.413143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:55.413170Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 175 [2:7561400544691541019:3832]
2025-10-15T10:55:55.413226Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:55.413288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:55.413305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:55.413319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:55.413331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:55.413385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:55.413409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:55.413435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:55.414438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.414455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.414471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.414485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:55.414759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:55.414782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.414939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.415175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.415780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:55.415881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400541891835943:4066], now have 1 active actors on pipe
2025-10-15T10:55:55.415906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400541891835865:2467], now have 1 active actors on pipe
2025-10-15T10:55:55.415929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400541891836026:3423], now have 1 active actors on pipe
2025-10-15T10:55:55.415956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400544691541013:3832]
2025-10-15T10:55:55.415972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400544691541013:3832]
2025-10-15T10:55:55.415986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400544691541013:3832]
2025-10-15T10:55:55.416026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:55.416105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:55.416168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:55.416183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:55.416195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:55.416321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:55.416338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:55.416489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:55.416512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:55.416543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400544691541013:3832]
2025-10-15T10:55:55.416565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:55.416677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:55.416709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:55.416729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:55.416739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:55.416776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:55.416820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:55.416901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:55.417147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:55.416076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 175
2025-10-15T10:55:55.416173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 175
2025-10-15T10:55:55.416251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 175, pipe: [1:7561400541891836026:3423]
2025-10-15T10:55:55.417915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:55.417942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:55.418012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:55.418501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 176 partition: 0 MaxSeqNo: 46 sessionId: src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0
2025-10-15T10:55:55.419339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843bbcce-e5e80253-1ea9b0d1-8e980906_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
E1015 10:55:55.469354067  821220 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:55:55.469432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0] Write session: try to update token
2025-10-15T10:55:55.469489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:55.605085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:55.605112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:55.605121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:55.605167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:55.605177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:55.605187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:55.605196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:55.605224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400544691541013:3832]
2025-10-15T10:55:55.605247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400544691541013:3832]
2025-10-15T10:55:55.605262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400544691541013:3832]
2025-10-15T10:55:55.605364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:55.605380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:55.606179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:55.607510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:55.607550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:55.607571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:55.651290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId: src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:55.681553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:55.752887Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:55.754466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:55.754500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:55.755382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:55.755433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:55.757898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:55.758049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400541891836026:3423]
2025-10-15T10:55:55.758390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:55.786396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 176 reason: error at write: Disconnected sessionId: src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0
2025-10-15T10:55:55.786693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 176 sessionId: src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0 is DEAD
2025-10-15T10:55:55.787245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:55.787318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0] Write session will restart in 0.008546s
2025-10-15T10:55:55.787510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0] Write session: Do CDS request
2025-10-15T10:55:55.787570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:55.800979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:55.804011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:55.804045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 177
2025-10-15T10:55:55.804418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:55.804563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:55.804585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:55.804595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:55.805980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 177 sessionId:  describe result for acl check
2025-10-15T10:55:55.806107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:55.806124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:55.806133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:55.806150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400541891836132:4071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:55.809037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400541891836132:4071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:55.817671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400541891836132:4071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:55.836585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400541891836132:4071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:55.836630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400541891836132:4071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:55.836646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400541891836132:4071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:55.836679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:55.857418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400541891836295:3423]
2025-10-15T10:55:55.874979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:55.884274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:55.885189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:55.885223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:55.885269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:55.885548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:55.885755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400544691541253:3835]
2025-10-15T10:55:55.888366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:55.889628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:55.889882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:55.891272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:55.891684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:55.891693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:55.891701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:55.891710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:55.891717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:55.891724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:55.891730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:55.891738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:55.891745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:55.891752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:55.891758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:55.891766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.891773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.891781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.891844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:55.891963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:55.892011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:55.892062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:55.892112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:55.892163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:55.892211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:55.892256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:55.892304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:55.892357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:55.892404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:55.892452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.892502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.892548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.892609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:55.892677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:55.892746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:55.892807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:55.892857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:55.892911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:55.892960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:55.893017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:55.893063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:55.893133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:55.893180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:55.893501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:55.893563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:55.893622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:55.893675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:55.893734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:55.893788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:55.893852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:55.893923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:55.893988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:55.894037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:55.894099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:55.894152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.894213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.894267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.894332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.894410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.894476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.895035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:55.911099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:55.920921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:55.920969Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:55.920988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:55.921009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:55.921038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 176 [2:7561400544691541253:3835]
2025-10-15T10:55:55.921095Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:55.921161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:55.921181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:55.921195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:55.921208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:55.921258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:55.921282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:55.921306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:55.922589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.922607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.923298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 176
2025-10-15T10:55:55.922622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.922635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:55.923314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 176
2025-10-15T10:55:55.923403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 176, pipe: [1:7561400541891836295:3423]
2025-10-15T10:55:55.923651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:55.923677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:55.923840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:55.924040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:55.924280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:55.924367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400541891836116:2467], now have 1 active actors on pipe
2025-10-15T10:55:55.924391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400541891836214:4071], now have 1 active actors on pipe
2025-10-15T10:55:55.924414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400541891836295:3423], now have 1 active actors on pipe
2025-10-15T10:55:55.924479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:55.924501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:55.924539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400544691541248:3835]
2025-10-15T10:55:55.924554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400544691541248:3835]
2025-10-15T10:55:55.924567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400544691541248:3835]
2025-10-15T10:55:55.924609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:55.924645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:55.924659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:55.924672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:55.924683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:55.924877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:55.924896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:55.924968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5565f86b-da9bf17-cb43c520-27339bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:55.924997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:55.925015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:55.925025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:55.925064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:55.925113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:55.925249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400544691541248:3835]
2025-10-15T10:55:55.925282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:55.925321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:55.925326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:55.926253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:55.926281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:55.926362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:55.926665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 177 partition: 0 MaxSeqNo: 46 sessionId: src_id|5565f86b-da9bf17-cb43c520-27339bb_0
2025-10-15T10:55:55.931904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd14470-45f1f2b3-a1cae015-2741caa0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5565f86b-da9bf17-cb43c520-27339bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:55.957804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5565f86b-da9bf17-cb43c520-27339bb_0] Write session: try to update token
2025-10-15T10:55:55.957866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5565f86b-da9bf17-cb43c520-27339bb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:56.017301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:56.017359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:56.017394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:56.017422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:56.017493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400544691541248:3835]
2025-10-15T10:55:56.017542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400544691541248:3835]
2025-10-15T10:55:56.017588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400544691541248:3835]
2025-10-15T10:55:56.017872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:56.017931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:56.018941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:56.019018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:56.019052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:56.019085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:56.068279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId: src_id|5565f86b-da9bf17-cb43c520-27339bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:56.088417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:56.168609Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:56.170732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:56.170763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:56.172991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:56.173020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:56.182145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:56.200918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 177 reason: error at write: Disconnected sessionId: src_id|5565f86b-da9bf17-cb43c520-27339bb_0
2025-10-15T10:55:56.201249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 177 sessionId: src_id|5565f86b-da9bf17-cb43c520-27339bb_0 is DEAD
2025-10-15T10:55:56.202579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5565f86b-da9bf17-cb43c520-27339bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:56.202633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5565f86b-da9bf17-cb43c520-27339bb_0] Write session will restart in 0.008816s
2025-10-15T10:55:56.202814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5565f86b-da9bf17-cb43c520-27339bb_0] Write session: Do CDS request
2025-10-15T10:55:56.202862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5565f86b-da9bf17-cb43c520-27339bb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:56.210687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400541891836295:3423]
2025-10-15T10:55:56.210764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:56.225183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:56.225214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 178
2025-10-15T10:55:56.228791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5565f86b-da9bf17-cb43c520-27339bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:56.233388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:56.233543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:56.233558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:56.233569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:56.235112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 178 sessionId:  describe result for acl check
2025-10-15T10:55:56.235217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:56.235228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:56.235236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:56.235251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400546186803685:4082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:56.238058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400546186803685:4082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:56.245022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400546186803685:4082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:56.253041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400546186803685:4082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:56.253087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400546186803685:4082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:56.253104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400546186803685:4082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:56.253135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:56.304206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:56.308373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:56.309393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:56.309423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:56.309470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:56.310840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400546186803892:3423]
2025-10-15T10:55:56.309731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:56.310046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400548986508804:3844]
2025-10-15T10:55:56.312211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:56.313067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:56.313282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:56.314206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:56.314429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:56.314438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:56.314443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:56.314447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:56.314451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:56.314456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:56.314460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:56.314465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:56.314469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:56.314475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:56.314479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:56.314483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.314488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.314492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.314525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:56.314662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:56.314696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:56.314729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:56.314759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:56.314791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:56.314833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:56.314862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:56.314896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:56.314928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:56.314963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:56.314997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.315046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.315083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.315114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:56.315161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:56.315200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:56.315238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:56.315271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:56.315308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:56.315337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:56.315403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:56.315435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:56.315470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:56.315503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:56.315547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:56.315591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:56.315641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:56.315687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:56.315739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:56.315785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:56.315825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:56.315856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:56.315904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:56.315940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:56.315978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:56.316007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.316043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.316076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.316113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.316190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.316230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.316600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:56.337877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:56.348486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:56.348536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:56.348552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:56.348569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:56.348595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 177 [2:7561400548986508804:3844]
2025-10-15T10:55:56.348641Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:56.348699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:56.348715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:56.348727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:56.348738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:56.348788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:56.348810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:56.348830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:56.350843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.350867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.350881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.350893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:56.351178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:56.351205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.351687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.352018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 177, pipe: [1:7561400546186803892:3423]
2025-10-15T10:55:56.352150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 177
2025-10-15T10:55:56.352255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 177
2025-10-15T10:55:56.351891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.352127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:56.352209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400546186803892:3423], now have 1 active actors on pipe
2025-10-15T10:55:56.352232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400546186803676:2467], now have 1 active actors on pipe
2025-10-15T10:55:56.352253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400546186803731:4082], now have 1 active actors on pipe
2025-10-15T10:55:56.352276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400548986508797:3844]
2025-10-15T10:55:56.352292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400548986508797:3844]
2025-10-15T10:55:56.352307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400548986508797:3844]
2025-10-15T10:55:56.352349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:56.352409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:56.352424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:56.352426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:56.352438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:56.352607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:56.352623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:56.352783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:56.352804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:56.352834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400548986508797:3844]
2025-10-15T10:55:56.352863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:56.352974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e174396-ec56ddda-8ccae078-451c3f06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:56.352974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:56.353007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:56.353026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:56.353036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:56.353074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:56.353115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:56.353191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:56.354650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:56.354681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:56.354746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:56.355131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 178 partition: 0 MaxSeqNo: 46 sessionId: src_id|6e174396-ec56ddda-8ccae078-451c3f06_0
2025-10-15T10:55:56.356730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5565f86b-da9bf17-cb43c520-27339bb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6e174396-ec56ddda-8ccae078-451c3f06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:56.389354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e174396-ec56ddda-8ccae078-451c3f06_0] Write session: try to update token
2025-10-15T10:55:56.389406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e174396-ec56ddda-8ccae078-451c3f06_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:56.428857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:56.428889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:56.428903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:56.428915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:56.428952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400548986508797:3844]
2025-10-15T10:55:56.428990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400548986508797:3844]
2025-10-15T10:55:56.429026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400548986508797:3844]
2025-10-15T10:55:56.429156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:56.429218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:56.429222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:56.429240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:56.429255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:56.430306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:56.480344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId: src_id|6e174396-ec56ddda-8ccae078-451c3f06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:56.519334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:56.613487Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:56.631094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:56.631142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:56.631212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:56.631228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:56.631271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400548986508797:3844]
2025-10-15T10:55:56.631485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:56.631909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:56.631992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:56.631957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400546186803892:3423]
2025-10-15T10:55:56.632059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:56.632073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:56.640400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 178 reason: error at write: Disconnected sessionId: src_id|6e174396-ec56ddda-8ccae078-451c3f06_0
2025-10-15T10:55:56.640817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 178 sessionId: src_id|6e174396-ec56ddda-8ccae078-451c3f06_0 is DEAD
2025-10-15T10:55:56.644026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e174396-ec56ddda-8ccae078-451c3f06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:56.644075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e174396-ec56ddda-8ccae078-451c3f06_0] Write session will restart in 0.009170s
2025-10-15T10:55:56.644176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e174396-ec56ddda-8ccae078-451c3f06_0] Write session: Do CDS request
2025-10-15T10:55:56.644225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e174396-ec56ddda-8ccae078-451c3f06_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:56.662113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e174396-ec56ddda-8ccae078-451c3f06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:56.661909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:56.661941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 179
2025-10-15T10:55:56.662666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:56.662811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:56.662827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:56.662836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:56.664828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 179 sessionId:  describe result for acl check
2025-10-15T10:55:56.664945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:56.664963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:56.664973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:56.664992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400546186803934:4089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:56.669409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400546186803934:4089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:56.676253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400546186803934:4089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:56.682731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400546186803934:4089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:56.682773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400546186803934:4089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:56.682791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400546186803934:4089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:56.682822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:56.729343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:56.730544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400546186804154:3423]
2025-10-15T10:55:56.734016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:56.734850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:56.734873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:56.734914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:56.735191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:56.735404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400548986509064:3854]
2025-10-15T10:55:56.737638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:56.738942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:56.739190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:56.740558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:56.740902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:56.740917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:56.740925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:56.740932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:56.740939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:56.740947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:56.740954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:56.740962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:56.740969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:56.740976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:56.740983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:56.740990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.740997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.741003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.741054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:56.741167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:56.741220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:56.741269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:56.741315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:56.741361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:56.741420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:56.741474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:56.741531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:56.741587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:56.741640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:56.741689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.741740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.741795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.741851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:56.741927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:56.742001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:56.742066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:56.742122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:56.742186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:56.742242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:56.742301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:56.742348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:56.742401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:56.742449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:56.742507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:56.742555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:56.742609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:56.742653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:56.742716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:56.742772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:56.742832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:56.742885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:56.742947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:56.743001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:56.743072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:56.743122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.743182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.743233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.743292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.743445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.743521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.744070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:56.801665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:56.810211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:56.810251Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:56.810269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:56.810289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:56.810314Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 178 [2:7561400548986509064:3854]
2025-10-15T10:55:56.810369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:56.810431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:56.810448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:56.810461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:56.810474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:56.810525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:56.810547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:56.810572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:56.812660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 178
2025-10-15T10:55:56.812671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 178, pipe: [1:7561400546186804154:3423]
2025-10-15T10:55:56.812780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 178
2025-10-15T10:55:56.811878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.811899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.811912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.811925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:56.812188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:56.812206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:56.812354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:56.812546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:56.812776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:56.812858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400546186803920:2467], now have 1 active actors on pipe
2025-10-15T10:55:56.812881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400546186804154:3423], now have 1 active actors on pipe
2025-10-15T10:55:56.812905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400546186803962:4089], now have 1 active actors on pipe
2025-10-15T10:55:56.812931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400548986509058:3854]
2025-10-15T10:55:56.812947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400548986509058:3854]
2025-10-15T10:55:56.812958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400548986509058:3854]
2025-10-15T10:55:56.812989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:56.813064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:56.813072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:56.813095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:56.813109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:56.813248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:56.813265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:56.813424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:56.813460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:56.813490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400548986509058:3854]
2025-10-15T10:55:56.813518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:56.813541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:56.813634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:56.813663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:56.813682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:56.813692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:56.813727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:56.813765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:56.813842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:56.814359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:56.814383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:56.814451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:56.814790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 179 partition: 0 MaxSeqNo: 46 sessionId: src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0
2025-10-15T10:55:56.819549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e174396-ec56ddda-8ccae078-451c3f06_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:56.849406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0] Write session: try to update token
2025-10-15T10:55:56.849476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:56.919313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:56.919370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:56.919387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:56.919398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:56.919437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400548986509058:3854]
2025-10-15T10:55:56.919469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400548986509058:3854]
2025-10-15T10:55:56.919513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400548986509058:3854]
2025-10-15T10:55:56.919847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:56.919870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:56.919902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:56.919973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:56.920005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:56.922708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:56.923528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:56.923574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:56.923604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:56.958911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId: src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:56.981307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:57.077431Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:57.087376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:57.087434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:57.087515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:57.087531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:57.087577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400548986509058:3854]
2025-10-15T10:55:57.087787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:57.087989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:57.088045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400546186804154:3423]
2025-10-15T10:55:57.088129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:57.088142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:57.088197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:57.109758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 179 reason: error at write: Disconnected sessionId: src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0
2025-10-15T10:55:57.110124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 179 sessionId: src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0 is DEAD
2025-10-15T10:55:57.119750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:57.119786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0] Write session will restart in 0.007171s
2025-10-15T10:55:57.119851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0] Write session: Do CDS request
2025-10-15T10:55:57.119881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:57.138575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:57.138675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:57.138625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 180
2025-10-15T10:55:57.139763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:57.139898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:57.139914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:57.139923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:57.145930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 180 sessionId:  describe result for acl check
2025-10-15T10:55:57.146095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:57.146131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:57.146149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:57.146176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400550481771490:4095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:57.149575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400550481771490:4095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:57.155464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400550481771490:4095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:57.167710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400550481771490:4095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:57.167749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400550481771490:4095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:57.167766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400550481771490:4095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:57.167796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:57.188822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400550481771673:3423]
2025-10-15T10:55:57.199713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:57.204871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:57.205705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:57.205718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:57.205762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:57.205950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:57.206088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400553281476605:3856]
2025-10-15T10:55:57.208198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:57.209095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:57.209321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:57.210690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:57.210962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:57.210976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:57.210983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:57.210990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:57.211146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:57.211160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:57.211165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:57.211170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:57.211174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:57.211179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:57.211183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:57.211187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.211192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.211197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.211243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:57.211371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:57.211421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:57.211474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:57.211533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:57.211573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:57.211612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:57.211647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:57.211684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:57.211735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:57.211785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:57.211832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.211871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.211923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.211973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:57.212044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:57.212111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:57.212171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:57.212226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:57.212288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:57.212338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:57.212389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:57.212425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:57.212475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:57.212525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:57.212582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:57.212635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:57.212691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:57.212742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:57.212804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:57.212856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:57.212916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:57.212967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:57.213022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:57.213072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:57.213131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:57.213180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.213239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.213286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.213344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.213392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.213460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.213983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:57.234224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:57.243111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:57.243153Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:57.243172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:57.243194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:57.243222Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 179 [2:7561400553281476605:3856]
2025-10-15T10:55:57.243277Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:57.243341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:57.243373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:57.243387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:57.243400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:57.243450Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:57.243480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:57.243510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:57.244508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.244534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.244547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.244559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:57.245128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 179
2025-10-15T10:55:57.245129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 179, pipe: [1:7561400550481771673:3423]
2025-10-15T10:55:57.245231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 179
2025-10-15T10:55:57.244823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:57.244849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.245001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.245199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.245448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:57.245528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400550481771472:2467], now have 1 active actors on pipe
2025-10-15T10:55:57.245551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400550481771673:3423], now have 1 active actors on pipe
2025-10-15T10:55:57.245572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400550481771595:4095], now have 1 active actors on pipe
2025-10-15T10:55:57.245615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400553281476600:3856]
2025-10-15T10:55:57.245629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400553281476600:3856]
2025-10-15T10:55:57.245642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400553281476600:3856]
2025-10-15T10:55:57.245676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:57.245713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:57.245737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:57.245747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:57.245750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:57.245938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:57.245955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:57.246012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:57.246032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:57.246147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400553281476600:3856]
2025-10-15T10:55:57.246182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:57.246206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:57.246257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:57.246288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:57.246306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:57.246317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:57.246355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:57.246395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:57.246524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:57.247173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:57.247204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:57.247295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:57.247713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 180 partition: 0 MaxSeqNo: 46 sessionId: src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0
2025-10-15T10:55:57.251579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d9a9f-56bb74b4-d0a92ea-9f403343_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:57.285378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0] Write session: try to update token
2025-10-15T10:55:57.285440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:57.351056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:57.351284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:57.351305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:57.351316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:57.351369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400553281476600:3856]
2025-10-15T10:55:57.351397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400553281476600:3856]
2025-10-15T10:55:57.351424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400553281476600:3856]
2025-10-15T10:55:57.351551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:57.351588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:57.351614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:57.351670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:57.351695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:57.351708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:57.351759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:57.351780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:57.352693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:57.398973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId: src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:57.420448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:57.497706Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:57.514650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:57.514691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:57.514764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:57.514778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:57.514820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400553281476600:3856]
2025-10-15T10:55:57.514989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:57.515324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:57.515450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400550481771673:3423]
2025-10-15T10:55:57.515532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:57.515548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:57.515530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:57.529395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 180 reason: error at write: Disconnected sessionId: src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0
2025-10-15T10:55:57.530223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:57.530277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0] Write session will restart in 0.008131s
2025-10-15T10:55:57.530443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0] Write session: Do CDS request
2025-10-15T10:55:57.530493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:57.529779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 180 sessionId: src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0 is DEAD
2025-10-15T10:55:57.544071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:57.543895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:57.543924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 181
2025-10-15T10:55:57.544621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:57.544750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:57.544775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:57.544784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:57.546728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 181 sessionId:  describe result for acl check
2025-10-15T10:55:57.546887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:57.546909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:57.546928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:57.546958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400550481771729:4099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:57.551601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400550481771729:4099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:57.558020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400550481771729:4099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:57.574817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400550481771729:4099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:57.574863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400550481771729:4099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:57.574880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400550481771729:4099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:57.574915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:57.615136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400550481771938:3423]
2025-10-15T10:55:57.629833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:57.638297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:57.639103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:57.639120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:57.639156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:57.639411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:57.639581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400553281476846:3859]
2025-10-15T10:55:57.642034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:57.643005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:57.643206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:57.644424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:57.644757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:57.644766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:57.644773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:57.644781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:57.644788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:57.644795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:57.644802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:57.644808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:57.644816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:57.644823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:57.644830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:57.644837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.644843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.644850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.644895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:57.645001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:57.645048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:57.645093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:57.645137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:57.645183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:57.645227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:57.647571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:57.647628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:57.647677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:57.647728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:57.647776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.647827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.647872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.647920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:57.647985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:57.648044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:57.648099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:57.648150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:57.648204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:57.648247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:57.648296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:57.648341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:57.648394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:57.648440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:57.648498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:57.648549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:57.648612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:57.648661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:57.648711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:57.648757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:57.648809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:57.648851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:57.648903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:57.648948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:57.649004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:57.649051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.649104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.649151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.649203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.649247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.649297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.649773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:57.681430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:57.693269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:57.693304Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:57.693320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:57.693339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:57.693362Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 180 [2:7561400553281476846:3859]
2025-10-15T10:55:57.693413Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:57.693479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:57.693495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:57.693507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:57.693519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:57.693568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:57.693593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:57.693614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:57.695486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.695507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.695521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.695532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:57.695765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:57.695786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:57.695897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:57.696043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:57.696237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:57.696550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400553281476839:3859]
2025-10-15T10:55:57.696571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400553281476839:3859]
2025-10-15T10:55:57.696583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400553281476839:3859]
2025-10-15T10:55:57.696616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:57.696705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400550481771793:4099], now have 1 active actors on pipe
2025-10-15T10:55:57.696730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400550481771938:3423], now have 1 active actors on pipe
2025-10-15T10:55:57.696751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400550481771714:2467], now have 1 active actors on pipe
2025-10-15T10:55:57.696780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:57.696952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:57.696972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:57.697078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:57.697085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400553281476839:3859]
2025-10-15T10:55:57.697102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:57.697109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:57.697122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:57.697161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:57.697633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:57.697659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:57.697735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:57.697771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:57.697801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:57.697816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:57.697852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:57.697903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:57.697958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:57.696852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 180
2025-10-15T10:55:57.696947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 180, pipe: [1:7561400550481771938:3423]
2025-10-15T10:55:57.697018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 180
2025-10-15T10:55:57.700818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:57.700859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:57.700929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:57.704481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 181 partition: 0 MaxSeqNo: 46 sessionId: src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0
2025-10-15T10:55:57.707972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea42060-e9e7a372-340b99a6-97f2036c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:57.739560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0] Write session: try to update token
2025-10-15T10:55:57.739620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:57.817519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:57.819128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:57.819195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400553281476839:3859]
2025-10-15T10:55:57.819401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:57.819414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:57.819433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:57.819450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:57.819648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:57.829023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:57.830474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:57.832512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:57.834032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:57.835606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:57.883313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:57.883482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:57.883498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:57.883511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:57.883522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:57.883561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400553281476839:3859]
2025-10-15T10:55:57.883589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400553281476839:3859]
2025-10-15T10:55:57.883613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400553281476839:3859]
2025-10-15T10:55:57.883757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:57.883760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:57.883781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:57.883802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:57.883848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:57.884765Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:57.899569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId: src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:57.920217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:58.035888Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:58.038118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:58.038155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:58.038833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:58.039505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:58.039532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:58.066168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 181 reason: error at write: Disconnected sessionId: src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0
2025-10-15T10:55:58.066506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 181 sessionId: src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0 is DEAD
2025-10-15T10:55:58.067785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:58.067820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0] Write session will restart in 0.009933s
2025-10-15T10:55:58.067921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0] Write session: Do CDS request
2025-10-15T10:55:58.067951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:58.084827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:58.086784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400550481771938:3423]
2025-10-15T10:55:58.086843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:58.086935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:58.086953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 182
2025-10-15T10:55:58.091566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:58.091727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:58.091742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:58.091752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:58.093630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 182 sessionId:  describe result for acl check
2025-10-15T10:55:58.093742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:58.093753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:58.093762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:58.093778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400554776739297:4110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:58.096657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400554776739297:4110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:58.105361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400554776739297:4110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:58.118556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400554776739297:4110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:58.118585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400554776739297:4110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:58.118597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400554776739297:4110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:58.118623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:58.152152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:58.156527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:58.157363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:58.157390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:58.157431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:58.157661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:58.157842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400557576444410:3868]
2025-10-15T10:55:58.159993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:58.161057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:58.161265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:58.162495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:58.162795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:58.162810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:58.162818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:58.162825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:58.162831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:58.162838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:58.162845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:58.162851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:58.162858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:58.162864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:58.162872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:58.162880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.162887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.162893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.162939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:58.163059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:58.163106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:58.163149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:58.163190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:58.163233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:58.163279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:58.163323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:58.163392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:58.163453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:58.163508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:58.163554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.163601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.163657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.163703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:58.163771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:58.163833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:58.163887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:58.163936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:58.163990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:58.164034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:58.164084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:58.164134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:58.164186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:58.164234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:58.164302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:58.164348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:58.164401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:58.164444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:58.164497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:58.164545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:58.164600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:58.164642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:58.164698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:58.164746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:58.164798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:58.164844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.164898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.164943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.164993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.165035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.165092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.165555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:58.186902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400554776739528:3423]
2025-10-15T10:55:58.204558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:58.213784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:58.213825Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:58.213843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:58.213863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:58.213890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 181 [2:7561400557576444410:3868]
2025-10-15T10:55:58.213942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:58.214003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:58.214018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:58.214029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:58.214042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:58.214091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:58.214122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:58.214142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:58.215187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.215206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.215215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.215222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:58.215499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:58.215518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.215667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.215859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.216093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:58.216173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400554776739293:2467], now have 1 active actors on pipe
2025-10-15T10:55:58.216200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400554776739528:3423], now have 1 active actors on pipe
2025-10-15T10:55:58.216224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400554776739386:4110], now have 1 active actors on pipe
2025-10-15T10:55:58.216251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400557576444404:3868]
2025-10-15T10:55:58.216266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400557576444404:3868]
2025-10-15T10:55:58.216279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400557576444404:3868]
2025-10-15T10:55:58.216321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:58.216380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:58.216397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:58.216409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:58.216417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:58.216439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:58.216497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:58.216687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:58.216706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:58.216860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:58.216889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:58.216906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:58.216916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:58.216953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:58.216997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:58.217039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400557576444404:3868]
2025-10-15T10:55:58.217069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:58.217095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:58.217154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:58.218015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:58.215865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 181, pipe: [1:7561400554776739528:3423]
2025-10-15T10:55:58.218050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:58.218132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:58.215879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 181
2025-10-15T10:55:58.215991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 181
2025-10-15T10:55:58.218489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 182 partition: 0 MaxSeqNo: 46 sessionId: src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0
2025-10-15T10:55:58.219845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b63a20-9e266ca9-3beff52a-c3ee2b80_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:58.254283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:58.254309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:58.254345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400557576444404:3868]
2025-10-15T10:55:58.254461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:58.255559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:58.256176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:58.264391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0] Write session: try to update token
2025-10-15T10:55:58.264470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:58.267934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:58.273645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:58.283966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:58.285624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:58.350560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId: src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:58.353101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:58.353129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:58.353142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:58.353272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:58.389530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:58.413649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:58.413693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:58.413744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:58.413758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:58.413771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:58.413781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:58.413816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400557576444404:3868]
2025-10-15T10:55:58.413832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400557576444404:3868]
2025-10-15T10:55:58.413845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400557576444404:3868]
2025-10-15T10:55:58.413979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:58.413997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:58.414767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:58.415458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:58.415499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:58.415529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:58.562370Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:58.563893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:55:58.564323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:58.569006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:58.569250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400554776739528:3423]
2025-10-15T10:55:58.666119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400554776739690:3423]
2025-10-15T10:55:58.680298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:58.684373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:58.684404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:58.684495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 182 reason: error at write: Disconnected sessionId: src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0
2025-10-15T10:55:58.685236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:58.685299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0] Write session will restart in 0.006519s
2025-10-15T10:55:58.685465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0] Write session: Do CDS request
2025-10-15T10:55:58.685513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:58.684806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 182 sessionId: src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0 is DEAD
2025-10-15T10:55:58.698192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:58.698253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 183
2025-10-15T10:55:58.698550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:58.699220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:58.699374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:58.699398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:58.699409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:58.700762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 183 sessionId:  describe result for acl check
2025-10-15T10:55:58.700876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:58.700892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:58.700902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:58.700919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400554776739738:4118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:58.703732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400554776739738:4118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:58.709864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400554776739738:4118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:58.716918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400554776739738:4118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:58.716958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400554776739738:4118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:58.716974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400554776739738:4118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:58.717001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:58.737616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:58.738659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:58.738693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:58.738742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:58.739038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:58.739240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400557576444663:3878]
2025-10-15T10:55:58.741550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:58.742665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:58.742910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:58.744146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:58.744484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:58.744499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:58.744506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:58.744513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:58.744520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:58.744527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:58.744534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:58.744540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:58.744545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:58.744552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:58.744559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:58.744565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.744571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.744577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.744619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:58.744718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:58.744762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:58.744806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:58.744851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:58.744895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:58.744935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:58.744984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:58.745031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:58.745079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:58.745129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:58.745177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.745224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.745276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.745317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:58.745382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:58.745443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:58.745499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:58.745549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:58.745607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:58.745660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:58.745714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:58.745765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:58.745816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:58.745855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:58.745916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:58.745960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:58.746006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:58.746046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:58.746099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:58.746141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:58.746191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:58.746231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:58.746279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:58.746331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:58.746379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:58.746420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.746467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.746509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.746558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.746597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.746644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.747421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:58.770951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:58.780049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:58.780083Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:58.780099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:58.780118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:58.780141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 182 [2:7561400557576444663:3878]
2025-10-15T10:55:58.780187Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:58.780242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:58.780255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:58.780266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:58.780276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:58.780319Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:58.780350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:58.780368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:58.781864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.781891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.781904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.781914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:58.782624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 182
2025-10-15T10:55:58.782735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 182
2025-10-15T10:55:58.782786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 182, pipe: [1:7561400554776739690:3423]
2025-10-15T10:55:58.782210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:58.782241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:58.782385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:58.782592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:58.782812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:58.782881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400554776739767:4118], now have 1 active actors on pipe
2025-10-15T10:55:58.782896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400554776739690:3423], now have 1 active actors on pipe
2025-10-15T10:55:58.782912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400554776739537:2467], now have 1 active actors on pipe
2025-10-15T10:55:58.782928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400557576444657:3878]
2025-10-15T10:55:58.782939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400557576444657:3878]
2025-10-15T10:55:58.782947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400557576444657:3878]
2025-10-15T10:55:58.782974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:58.783002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:58.783019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:58.783025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:58.783035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:58.783166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:58.783177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:58.783287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:58.783299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:58.783320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400557576444657:3878]
2025-10-15T10:55:58.783396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:58.783959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:58.784102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:58.784136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:58.784153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:58.784162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:58.784194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:58.784231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:58.784328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:58.785062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:58.785091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:58.785159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:58.785440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 183 partition: 0 MaxSeqNo: 46 sessionId: src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0
2025-10-15T10:55:58.786253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a090aadf-c0bfd07b-a0f23d52-b448f39_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:58.816721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0] Write session: try to update token
2025-10-15T10:55:58.816767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:58.877233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:58.877263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:58.877278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:58.877290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:58.877325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400557576444657:3878]
2025-10-15T10:55:58.877350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400557576444657:3878]
2025-10-15T10:55:58.877374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400557576444657:3878]
2025-10-15T10:55:58.877511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:58.877531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:58.878351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:58.878392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:58.878421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:58.878630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:58.927230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId: src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:58.953889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:59.021905Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:59.029154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:59.029201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:59.029953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:59.029988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400554776739690:3423]
2025-10-15T10:55:59.030002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:59.030133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:59.034055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:59.041224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 183 reason: error at write: Disconnected sessionId: src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0
2025-10-15T10:55:59.041569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 183 sessionId: src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0 is DEAD
2025-10-15T10:55:59.043138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:59.043175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0] Write session will restart in 0.008254s
2025-10-15T10:55:59.043286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0] Write session: Do CDS request
2025-10-15T10:55:59.043332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:59.060023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:59.060070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 184
2025-10-15T10:55:59.060241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:59.060778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:59.060921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:59.060947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:59.060957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:59.062416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 184 sessionId:  describe result for acl check
2025-10-15T10:55:59.062543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:59.062559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:59.062569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:59.062586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400559071707118:4125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:59.065460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400559071707118:4125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:59.072409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400559071707118:4125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:59.083177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400559071707118:4125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:59.083229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400559071707118:4125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:59.083249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400559071707118:4125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:59.083280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:59.110324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:59.114203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:59.115068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:59.115096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:59.115136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:59.115411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:59.115592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400561871412201:3881]
2025-10-15T10:55:59.117667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:59.118590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:59.118807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:59.120058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:59.120439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:59.120449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:59.120456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:59.120462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:59.120468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:59.120475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:59.120481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:59.120486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:59.120493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:59.120499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:59.120505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:59.120513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.120520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.120527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.120569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:59.120666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:59.120715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:59.120763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:59.120812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:59.120859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:59.120902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:59.120944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:59.120987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:59.121031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:59.121065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:59.121104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.121144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.121174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.121201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:59.121246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:59.121281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:59.121331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:59.121374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:59.121409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:59.121437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:59.121472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:59.121502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:59.121535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:59.121563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:59.121608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:59.121646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:59.121679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:59.121709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:59.121744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:59.121776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:59.121809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:59.121838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:59.121879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:59.121913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:59.121949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:59.121977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.122011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.122041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.122075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.122110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.122149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.122524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:59.131462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400559071707340:3423]
2025-10-15T10:55:59.139934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:59.150400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:59.150452Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:59.150469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:59.150488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:59.150513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 183 [2:7561400561871412201:3881]
2025-10-15T10:55:59.150562Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:59.150617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:59.150631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:59.150644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:59.150655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:59.150704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:59.150729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:59.150750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:59.153046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.153076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.153091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.153101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:59.153358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:59.153380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.153543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.153730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.153965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:59.154051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400559071707340:3423], now have 1 active actors on pipe
2025-10-15T10:55:59.154086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400559071707099:2467], now have 1 active actors on pipe
2025-10-15T10:55:59.154109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400559071707210:4125], now have 1 active actors on pipe
2025-10-15T10:55:59.154137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400561871412192:3881]
2025-10-15T10:55:59.154153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400561871412192:3881]
2025-10-15T10:55:59.154169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400561871412192:3881]
2025-10-15T10:55:59.154206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:59.154243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:59.154257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:59.154269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:59.154280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:59.154463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:59.154486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:59.154604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400561871412192:3881]
2025-10-15T10:55:59.154632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:59.154712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:59.155509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 183, pipe: [1:7561400559071707340:3423]
2025-10-15T10:55:59.155624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 183
2025-10-15T10:55:59.155713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 183
2025-10-15T10:55:59.155872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:59.155914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:59.156002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:59.156044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:59.156063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:59.156073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:59.156113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:59.156156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:59.156211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:59.156834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:59.156864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:59.156928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:59.157161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 184 partition: 0 MaxSeqNo: 46 sessionId: src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0
2025-10-15T10:55:59.158001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfc75cb7-3b1a01b7-3ab18a4e-206aaf11_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:59.178722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0] Write session: try to update token
2025-10-15T10:55:59.178781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:59.210867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:59.210895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:59.210929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400561871412192:3881]
2025-10-15T10:55:59.211049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:59.211118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:59.221140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:59.222549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:59.223863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:59.225051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:59.226668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:59.227203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:59.250844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:59.250893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:59.250917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:59.280991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:59.281026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:59.281042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:59.281055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:59.281095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400561871412192:3881]
2025-10-15T10:55:59.281122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400561871412192:3881]
2025-10-15T10:55:59.281146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400561871412192:3881]
2025-10-15T10:55:59.281280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:59.281310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:59.281319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:59.281334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:59.281358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:59.282430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:59.291631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId: src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:59.312771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:59.427306Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:59.431561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:59.431602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:59.432092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400559071707340:3423]
2025-10-15T10:55:59.432171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:59.432194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:59.432302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:59.432322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:59.442639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 184 reason: error at write: Disconnected sessionId: src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0
2025-10-15T10:55:59.443035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 184 sessionId: src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0 is DEAD
2025-10-15T10:55:59.444670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:59.444725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0] Write session will restart in 0.009705s
2025-10-15T10:55:59.444867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0] Write session: Do CDS request
2025-10-15T10:55:59.444908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:59.460139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:59.474255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:59.474285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 185
2025-10-15T10:55:59.474711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:59.474849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:59.474869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:59.474879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:59.476152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 185 sessionId:  describe result for acl check
2025-10-15T10:55:59.476276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:59.476292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:59.476301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:59.476326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400559071707371:4136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:59.478901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400559071707371:4136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:59.485347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400559071707371:4136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:59.494050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400559071707371:4136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:59.494095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400559071707371:4136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:59.494113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400559071707371:4136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:59.494145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:59.533545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400559071707533:3423]
2025-10-15T10:55:59.547700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:59.551210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:59.552095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:59.552122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:55:59.552161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:59.552412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:59.552595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400561871412480:3890]
2025-10-15T10:55:59.555031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:55:59.555860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:55:59.556077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:55:59.557461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:55:59.557802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:59.557819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:59.557826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:59.557835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:59.557842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:59.557850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:59.557856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:59.557865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:59.557873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:59.557879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:59.557887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:59.557894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.557900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.557907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.557953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:59.558064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:59.558113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:59.558166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:59.558211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:59.558270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:59.558323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:59.558371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:59.558424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:59.558474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:59.558525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:59.558577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.558627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.558678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.558725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:59.558796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:55:59.558858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:59.558917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:55:59.558971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:59.559030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:55:59.559095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:59.559155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:55:59.559209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:59.559269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:55:59.559320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:59.559398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:55:59.559453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:59.559515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:55:59.559562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:59.559623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:55:59.559678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:59.559739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:55:59.559790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:59.559845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:55:59.559897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:59.559953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:55:59.560002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.560062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.560112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.560174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.560225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.560289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.560807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:55:59.578724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:55:59.588670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:55:59.588714Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:55:59.588733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:59.588754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:59.588780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 184 [2:7561400561871412480:3890]
2025-10-15T10:55:59.588834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:55:59.588900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:55:59.588914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:59.588927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:59.588940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:59.588992Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:55:59.589018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:59.589046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:55:59.608880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.608906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.608917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.608928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:55:59.609191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:55:59.609219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:55:59.609361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:55:59.609449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 184
2025-10-15T10:55:59.609449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 184
2025-10-15T10:55:59.609531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:55:59.609518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 184, pipe: [1:7561400559071707533:3423]
2025-10-15T10:55:59.609742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:55:59.609829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400559071707401:4136], now have 1 active actors on pipe
2025-10-15T10:55:59.609854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400559071707358:2467], now have 1 active actors on pipe
2025-10-15T10:55:59.609872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400559071707533:3423], now have 1 active actors on pipe
2025-10-15T10:55:59.609932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:59.609956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:59.609992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400561871412475:3890]
2025-10-15T10:55:59.610009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400561871412475:3890]
2025-10-15T10:55:59.610022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400561871412475:3890]
2025-10-15T10:55:59.610059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:55:59.610105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:55:59.610124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:55:59.610132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:55:59.610136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:55:59.610312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:55:59.610334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:55:59.610400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:59.610434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:59.610458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:59.610468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:59.610504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:59.610552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:59.610674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400561871412475:3890]
2025-10-15T10:55:59.610702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:55:59.610725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:55:59.610745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:59.611194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:59.611220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:59.611281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:59.611574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 185 partition: 0 MaxSeqNo: 46 sessionId: src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0
2025-10-15T10:55:59.612365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66d3a50f-a483a85e-37ab10a2-6330fe42_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:59.632864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0] Write session: try to update token
2025-10-15T10:55:59.632935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:55:59.644660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:55:59.644694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:59.644736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400561871412475:3890]
2025-10-15T10:55:59.644853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:55:59.644869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:55:59.646888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:55:59.648429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:59.649770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:59.651074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:55:59.652927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:55:59.653461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:55:59.711724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:59.711756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:59.711768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:59.711819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:55:59.711830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:55:59.711841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:55:59.711849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:55:59.711878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400561871412475:3890]
2025-10-15T10:55:59.711897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400561871412475:3890]
2025-10-15T10:55:59.711914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400561871412475:3890]
2025-10-15T10:55:59.712058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:55:59.712064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:55:59.712085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:55:59.712116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:55:59.712163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:55:59.713061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:55:59.715991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId: src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:59.738188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:59.872505Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:55:59.884532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:59.884575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:59.885296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400559071707533:3423]
2025-10-15T10:55:59.885377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:55:59.885426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:55:59.885448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:55:59.885223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:55:59.893480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 185 reason: error at write: Disconnected sessionId: src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0
2025-10-15T10:55:59.893786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 185 sessionId: src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0 is DEAD
2025-10-15T10:55:59.894242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:55:59.894287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0] Write session will restart in 0.005276s
2025-10-15T10:55:59.894427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0] Write session: Do CDS request
2025-10-15T10:55:59.894472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:55:59.904581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:59.904611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 186
2025-10-15T10:55:59.904696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:59.905229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:59.905353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:55:59.905381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:59.905391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:59.906586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 186 sessionId:  describe result for acl check
2025-10-15T10:55:59.906698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:59.906709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:59.906717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:59.906734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400559071707643:4144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:59.909481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400559071707643:4144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:59.914982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400559071707643:4144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:59.922640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400559071707643:4144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:59.922701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400559071707643:4144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:59.922724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400559071707643:4144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:59.922769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:59.987483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400559071707861:3423]
2025-10-15T10:56:00.004383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:00.021051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:00.022078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:00.022100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:00.022144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:00.022427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:00.022623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400566166380024:3900]
2025-10-15T10:56:00.025806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:00.040193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:00.040510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:00.041973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:00.042408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.042417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.042426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.042434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.042441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.042450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.042458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.042467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.042475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.042483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.042491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.042499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.042507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.042515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.042581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.042723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.042783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.042838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.042892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.042947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.042997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.043050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.043117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.043174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.043227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.043280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.043333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.045839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.045937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.046025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.046100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.046163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.046222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.046283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.046335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.046398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.046459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.046522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.046575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.046636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.046692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.046755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.046832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.046892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.046948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.047006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.047062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.047144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.047199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.047262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.047314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.047404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.047461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.047525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.047582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.047642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.048255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:00.085472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:00.123718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:00.123762Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:00.123781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:00.123804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:00.123831Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 185 [2:7561400566166380024:3900]
2025-10-15T10:56:00.123893Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:00.123962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:00.123978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:00.123992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:00.124005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:00.124057Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:00.124082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:00.124105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:00.125217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.125228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.125239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.125246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:00.125499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:00.125510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.125621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.125791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.126019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:00.127084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 185
2025-10-15T10:56:00.126099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400566166380018:3900]
2025-10-15T10:56:00.126118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400566166380018:3900]
2025-10-15T10:56:00.127169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 185, pipe: [1:7561400559071707861:3423]
2025-10-15T10:56:00.126133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400566166380018:3900]
2025-10-15T10:56:00.126534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:00.126548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:00.127240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 185
2025-10-15T10:56:00.126562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:00.127817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:00.127927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:00.128149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:00.128167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:00.128219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400559071707675:4144], now have 1 active actors on pipe
2025-10-15T10:56:00.128244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400559071707861:3423], now have 1 active actors on pipe
2025-10-15T10:56:00.128268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400559071707630:2467], now have 1 active actors on pipe
2025-10-15T10:56:00.128319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:00.128343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:00.128489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400566166380018:3900]
2025-10-15T10:56:00.128521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:00.128600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:00.128636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:00.128654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:00.128666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:00.128707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:00.128751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:00.128888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:00.130227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:00.131890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:00.131932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:00.132019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:00.132455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 186 partition: 0 MaxSeqNo: 46 sessionId: src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0
2025-10-15T10:56:00.139582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1955bc7e-9cb5e4aa-65cd35d6-a67609c6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:00.199218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0] Write session: try to update token
2025-10-15T10:56:00.199285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:00.317546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:00.317580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:00.317589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:00.317636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:00.317647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:00.317657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:00.317667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:00.317703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400566166380018:3900]
2025-10-15T10:56:00.317738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400566166380018:3900]
2025-10-15T10:56:00.317761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400566166380018:3900]
2025-10-15T10:56:00.317872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:00.317922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:00.317948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:00.317969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:00.317990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:00.319166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:00.327434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId: src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:00.349294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:00.464642Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:00.481822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:00.481879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:00.481960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:00.481977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:00.482033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400566166380018:3900]
2025-10-15T10:56:00.482409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:00.482437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:00.484259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400559071707861:3423]
2025-10-15T10:56:00.484381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:00.482390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:00.482792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:00.490848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 186 reason: error at write: Disconnected sessionId: src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0
2025-10-15T10:56:00.491238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 186 sessionId: src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0 is DEAD
2025-10-15T10:56:00.491702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:00.491757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0] Write session will restart in 0.005684s
2025-10-15T10:56:00.491942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0] Write session: Do CDS request
2025-10-15T10:56:00.491992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:00.505443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:00.505483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 187
2025-10-15T10:56:00.506032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:00.506694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:00.506884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:00.506908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:00.506917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:00.508914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 187 sessionId:  describe result for acl check
2025-10-15T10:56:00.509144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:00.509182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:00.509197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:00.509221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400563366675190:4149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:00.513095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400563366675190:4149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:00.520905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400563366675190:4149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:00.528355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400563366675190:4149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:00.528400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400563366675190:4149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:00.528416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400563366675190:4149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:00.528447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:00.570895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:00.575310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:00.576194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:00.576223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:00.576267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:00.576526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:00.576720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400566166380290:3903]
2025-10-15T10:56:00.578848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:00.579874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:00.580103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:00.581420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:00.581739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.581757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.581764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.581771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.581777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.581784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.581790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.581796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.581804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.581809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.581816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.581822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.581829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.581835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.581881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.581986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.582036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.582087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.582134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.582194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.582238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.582292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.582343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.582401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.582446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.582503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.582560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.582612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.582660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.582733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.582796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.582855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.582907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.582966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.583020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.583094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.583149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.583202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.583249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.583303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.583476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.583534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.583588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.583643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.583706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.583761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.583811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.583874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.583928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.583995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.584053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.584113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.584165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.584221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.584272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.584327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.584515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400563366675414:3423]
2025-10-15T10:56:00.584848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:00.609517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:00.619244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:00.619274Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:00.619290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:00.619310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:00.619330Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 186 [2:7561400566166380290:3903]
2025-10-15T10:56:00.619382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:00.619437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:00.619451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:00.619465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:00.619476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:00.619530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:00.619553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:00.619575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:00.622383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.622403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.622411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.622418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:00.622611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:00.622626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.622718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.622894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.622936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 186
2025-10-15T10:56:00.623044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 186
2025-10-15T10:56:00.623113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 186, pipe: [1:7561400563366675414:3423]
2025-10-15T10:56:00.623128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:00.623236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400563366675175:2467], now have 1 active actors on pipe
2025-10-15T10:56:00.623273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400563366675221:4149], now have 1 active actors on pipe
2025-10-15T10:56:00.623298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400563366675414:3423], now have 1 active actors on pipe
2025-10-15T10:56:00.623382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:00.623412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:00.623453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400566166380285:3903]
2025-10-15T10:56:00.623477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400566166380285:3903]
2025-10-15T10:56:00.623493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400566166380285:3903]
2025-10-15T10:56:00.623533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:00.623573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:00.623596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:00.623608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:00.623621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:00.623813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:00.623846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:00.623927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fe3d124-ee47667e-150c5292-ce29b057_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:00.623973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:00.623992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:00.624002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:00.624040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:00.624090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:00.624251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400566166380285:3903]
2025-10-15T10:56:00.624290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:00.624322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:00.624347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:00.624808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:00.624831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:00.624886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:00.627301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 187 partition: 0 MaxSeqNo: 46 sessionId: src_id|1fe3d124-ee47667e-150c5292-ce29b057_0
2025-10-15T10:56:00.628058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7756ef2f-1b8012a0-77fe3d3-5ad915af_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1fe3d124-ee47667e-150c5292-ce29b057_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:00.647701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe3d124-ee47667e-150c5292-ce29b057_0] Write session: try to update token
2025-10-15T10:56:00.647754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe3d124-ee47667e-150c5292-ce29b057_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:00.679915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:00.679965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:00.680014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400566166380285:3903]
2025-10-15T10:56:00.680147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:00.680176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:00.684225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:00.687479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:00.689789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:00.691105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:00.695051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:00.695663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:00.722247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:00.722292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:00.722312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:00.722329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:00.722391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400566166380285:3903]
2025-10-15T10:56:00.722425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400566166380285:3903]
2025-10-15T10:56:00.722450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400566166380285:3903]
2025-10-15T10:56:00.722570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:00.722605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:00.722610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:00.722622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:00.722629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:00.722637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:00.722685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:00.722706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:00.723735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:00.747994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId: src_id|1fe3d124-ee47667e-150c5292-ce29b057_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:00.768333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:00.868455Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:00.871607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:00.871653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:00.872276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:00.872926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400563366675414:3423]
2025-10-15T10:56:00.873908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:00.874091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:00.907617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 187 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1fe3d124-ee47667e-150c5292-ce29b057_0
2025-10-15T10:56:00.907982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 187 sessionId: src_id|1fe3d124-ee47667e-150c5292-ce29b057_0 is DEAD
2025-10-15T10:56:00.908345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe3d124-ee47667e-150c5292-ce29b057_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:00.908396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe3d124-ee47667e-150c5292-ce29b057_0] Write session will restart in 0.005004s
2025-10-15T10:56:00.908554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe3d124-ee47667e-150c5292-ce29b057_0] Write session: Do CDS request
2025-10-15T10:56:00.908591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe3d124-ee47667e-150c5292-ce29b057_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:00.917277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe3d124-ee47667e-150c5292-ce29b057_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:00.928217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:00.928249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 188
2025-10-15T10:56:00.928591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:00.928707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:00.928730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:00.928740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:00.930839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 188 sessionId:  describe result for acl check
2025-10-15T10:56:00.930965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:00.930982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:00.930992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:00.931011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400563366675504:4160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:00.933471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400563366675504:4160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:00.942080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400563366675504:4160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:00.951282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400563366675504:4160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:00.951326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400563366675504:4160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:00.951344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400563366675504:4160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:00.951392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:00.958502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:00.962076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:00.962819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:00.962843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:00.962883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:00.963145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:00.963364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400566166380533:3912]
2025-10-15T10:56:00.965510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:00.966494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:00.966698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:00.967939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:00.968270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.968287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.968294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.968300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.968308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.968315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.968321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.968327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.968335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.968342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.968349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.968355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.968362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.968368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.968415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.968526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.968571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.968612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.968653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.968700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.968747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.968792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.968837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.968886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.968934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.968980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.969026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.969078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.969127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.969195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:00.969253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.969305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:00.969352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.969408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:00.969456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.969511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:00.969561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.969611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:00.969661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.969713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:00.969759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.969812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:00.969861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.969918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:00.969967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.970028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:00.970076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.970139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:00.970192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.970247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:00.970296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.970350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:00.970401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.970458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:00.970508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.970563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:00.971069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:00.973182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400563366675691:3423]
2025-10-15T10:56:01.005593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:01.018917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:01.018946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:01.018958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:01.018972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:01.018990Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 187 [2:7561400566166380533:3912]
2025-10-15T10:56:01.019027Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:01.019078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:01.019103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:01.019115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:01.019123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:01.019166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:01.019188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:01.019206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:01.021288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.021314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.021328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.021340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:01.021580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:01.021603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.021736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.021921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.021896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 187, pipe: [1:7561400563366675691:3423]
2025-10-15T10:56:01.022006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 187
2025-10-15T10:56:01.022090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 187
2025-10-15T10:56:01.022150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:01.022237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400563366675691:3423], now have 1 active actors on pipe
2025-10-15T10:56:01.022269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400563366675682:4160], now have 1 active actors on pipe
2025-10-15T10:56:01.022289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400563366675453:2467], now have 1 active actors on pipe
2025-10-15T10:56:01.022314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400566166380528:3912]
2025-10-15T10:56:01.022328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400566166380528:3912]
2025-10-15T10:56:01.022341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400566166380528:3912]
2025-10-15T10:56:01.022376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:01.022406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:01.022419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:01.022430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:01.022461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:01.022483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:01.022544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:01.022729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:01.022754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:01.022908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:01.022947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:01.022965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:01.022975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:01.023009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:01.023049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:01.023100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400566166380528:3912]
2025-10-15T10:56:01.023131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:01.023151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:01.023219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:01.023707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:01.023734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:01.023800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:01.024305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 188 partition: 0 MaxSeqNo: 46 sessionId: src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0
2025-10-15T10:56:01.027569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fe3d124-ee47667e-150c5292-ce29b057_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:01.052612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0] Write session: try to update token
2025-10-15T10:56:01.052658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:01.060093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:01.060149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:01.060192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400566166380528:3912]
2025-10-15T10:56:01.060317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:01.060335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:01.063365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:01.065012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:01.067288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:01.069132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:01.071403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:01.112206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:01.145563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:01.145596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:01.145609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:01.145681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:01.145696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:01.145721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:01.145731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:01.145771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400566166380528:3912]
2025-10-15T10:56:01.145798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400566166380528:3912]
2025-10-15T10:56:01.145820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400566166380528:3912]
2025-10-15T10:56:01.145917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:01.145945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:01.145963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:01.145968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:01.145990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:01.147061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:01.159927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId: src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:01.183570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:01.289911Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:01.291509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:01.291543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:01.292237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:01.295290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:01.295509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:01.295794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400563366675691:3423]
2025-10-15T10:56:01.300707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 188 reason: status is not ok: tablet will be restarted right now sessionId: src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0
2025-10-15T10:56:01.301152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 188 sessionId: src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0 is DEAD
2025-10-15T10:56:01.306464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:01.306508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0] Write session will restart in 0.008445s
2025-10-15T10:56:01.306615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0] Write session: Do CDS request
2025-10-15T10:56:01.306646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:01.328156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:01.327650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:01.327684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 189
2025-10-15T10:56:01.336752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:01.336893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:01.336908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:01.336918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:01.338354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 189 sessionId:  describe result for acl check
2025-10-15T10:56:01.338470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:01.338481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:01.338490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:01.338507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400567661643023:4168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:01.341002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400567661643023:4168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:01.348610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400567661643023:4168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:01.365215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400567661643023:4168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:01.365256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400567661643023:4168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:01.365273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400567661643023:4168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:01.365320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:01.398966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400567661643079:3423]
2025-10-15T10:56:01.433338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:01.437112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:01.437979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:01.438015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:01.438060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:01.438323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:01.438523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400570461348112:3922]
2025-10-15T10:56:01.441376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:01.442596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:01.442870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:01.444312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:01.444673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:01.444694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:01.444702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:01.444710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:01.444717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:01.444725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:01.444732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:01.444740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:01.444747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:01.444755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:01.444763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:01.444771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.444779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.444787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.444840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:01.444959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:01.445016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:01.445082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:01.445134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:01.445187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:01.445236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:01.445288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:01.445340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:01.445390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:01.445443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:01.445497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.445549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.445600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.445648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:01.445723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:01.445793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:01.445855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:01.445910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:01.445968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:01.446021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:01.446084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:01.446139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:01.446199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:01.446258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:01.446315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:01.446370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:01.446431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:01.446483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:01.446545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:01.446600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:01.446661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:01.446714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:01.446774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:01.446827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:01.446880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:01.446931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.446994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.447049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.447118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.447172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.447231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.447797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:01.468022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:01.478602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:01.478655Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:01.478676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:01.478698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:01.478724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 188 [2:7561400570461348112:3922]
2025-10-15T10:56:01.478781Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:01.478853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:01.478869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:01.478883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:01.478894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:01.478945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:01.478970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:01.478992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:01.507259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.507283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.507293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.507304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:01.507626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:01.507654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.507786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.507957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.507938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 188, pipe: [1:7561400567661643079:3423]
2025-10-15T10:56:01.508015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 188
2025-10-15T10:56:01.508046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 188
2025-10-15T10:56:01.508158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:01.508248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400567661643079:3423], now have 1 active actors on pipe
2025-10-15T10:56:01.508274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400567661643056:4168], now have 1 active actors on pipe
2025-10-15T10:56:01.508292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400567661643014:2467], now have 1 active actors on pipe
2025-10-15T10:56:01.508357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:01.508385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:01.508424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400570461348107:3922]
2025-10-15T10:56:01.508443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400570461348107:3922]
2025-10-15T10:56:01.508455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400570461348107:3922]
2025-10-15T10:56:01.508488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:01.508524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:01.508550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:01.508559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:01.508564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:01.508735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:01.508756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:01.508825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|125682bd-36de7413-fc17e04a-44493833_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:01.508864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:01.508888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:01.508898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:01.508933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:01.508979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:01.509119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400570461348107:3922]
2025-10-15T10:56:01.509150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:01.509186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:01.509203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:01.509672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:01.509697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:01.509755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:01.510085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 189 partition: 0 MaxSeqNo: 46 sessionId: src_id|125682bd-36de7413-fc17e04a-44493833_0
2025-10-15T10:56:01.510971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20c7f3ad-130a069a-30adcb13-17a5d113_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|125682bd-36de7413-fc17e04a-44493833_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:01.543734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|125682bd-36de7413-fc17e04a-44493833_0] Write session: try to update token
2025-10-15T10:56:01.543797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|125682bd-36de7413-fc17e04a-44493833_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:01.548906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:01.548943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:01.548986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400570461348107:3922]
2025-10-15T10:56:01.549116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:01.549135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:01.551082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:01.556422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:01.557862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:01.559321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:01.561236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:01.561681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:01.578408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:01.578437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:01.578449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:01.626309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:01.626353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:01.626368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:01.626378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:01.626423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400570461348107:3922]
2025-10-15T10:56:01.626452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400570461348107:3922]
2025-10-15T10:56:01.626475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400570461348107:3922]
2025-10-15T10:56:01.626612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:01.626659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:01.626661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:01.626690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:01.626696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:01.629197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:01.632574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId: src_id|125682bd-36de7413-fc17e04a-44493833_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:01.652001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:01.775319Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:01.782973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:01.783024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:01.783698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400567661643079:3423]
2025-10-15T10:56:01.783737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:01.783751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:01.783781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:01.783864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:01.805328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 189 reason: error at write: Disconnected sessionId: src_id|125682bd-36de7413-fc17e04a-44493833_0
2025-10-15T10:56:01.805643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 189 sessionId: src_id|125682bd-36de7413-fc17e04a-44493833_0 is DEAD
2025-10-15T10:56:01.806168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|125682bd-36de7413-fc17e04a-44493833_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:01.806244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|125682bd-36de7413-fc17e04a-44493833_0] Write session will restart in 0.008361s
2025-10-15T10:56:01.806475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|125682bd-36de7413-fc17e04a-44493833_0] Write session: Do CDS request
2025-10-15T10:56:01.806539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|125682bd-36de7413-fc17e04a-44493833_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:01.819982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:01.820030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 190
2025-10-15T10:56:01.820743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|125682bd-36de7413-fc17e04a-44493833_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:01.821518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:01.821739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:01.821780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:01.821797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:01.824004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 190 sessionId:  describe result for acl check
2025-10-15T10:56:01.824182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:01.824216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:01.824229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:01.824246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400567661643287:4172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:01.826700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400567661643287:4172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:01.835438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400567661643287:4172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:01.843134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400567661643287:4172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:01.843177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400567661643287:4172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:01.843193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400567661643287:4172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:01.843223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:01.854098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:01.857909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:01.858674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:01.858707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:01.858745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:01.858977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:01.859180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400570461348357:3925]
2025-10-15T10:56:01.861518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:01.862395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:01.862600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:01.863869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:01.864177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:01.864194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:01.864201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:01.864208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:01.864215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:01.864222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:01.864230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:01.864237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:01.864245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:01.864252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:01.864260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:01.864267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.864274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.864282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.864326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:01.864435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:01.864486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:01.864548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:01.864596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:01.864644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:01.864698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:01.864744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:01.864791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:01.864846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:01.864904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:01.864958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.865010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.865062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.865107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:01.865182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:01.865245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:01.865308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:01.865362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:01.865421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:01.865472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:01.865530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:01.865583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:01.865636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:01.865684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:01.865743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:01.865796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:01.865853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:01.865903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:01.865965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:01.866016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:01.866070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:01.866118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:01.866190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:01.866242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:01.866305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:01.866351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.866408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.866456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.866514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.866561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.866616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.867130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:01.883989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400567661643518:3423]
2025-10-15T10:56:01.890709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:01.900544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:01.900582Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:01.900599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:01.900618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:01.900639Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 189 [2:7561400570461348357:3925]
2025-10-15T10:56:01.900688Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:01.900742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:01.900756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:01.900768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:01.900780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:01.900825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:01.900849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:01.900868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:01.902010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.902033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.902046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.902057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:01.902310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:01.902336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:01.902469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:01.902656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:01.902886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:01.902974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400567661643518:3423], now have 1 active actors on pipe
2025-10-15T10:56:01.903002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400567661643449:4172], now have 1 active actors on pipe
2025-10-15T10:56:01.903024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400567661643260:2467], now have 1 active actors on pipe
2025-10-15T10:56:01.903084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:01.903123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:01.903156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400570461348352:3925]
2025-10-15T10:56:01.903169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400570461348352:3925]
2025-10-15T10:56:01.903181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400570461348352:3925]
2025-10-15T10:56:01.903219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:01.903250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:01.903269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:01.903279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:01.903296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:01.903490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:01.903516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:01.903580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:01.903613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:01.903629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:01.903639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:01.903672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:01.903713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:01.903833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400570461348352:3925]
2025-10-15T10:56:01.903868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:01.903895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:01.903922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:01.904556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:01.904585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:01.904647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:01.902601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 189, pipe: [1:7561400567661643518:3423]
2025-10-15T10:56:01.902648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 189
2025-10-15T10:56:01.902694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 189
2025-10-15T10:56:01.905193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 190 partition: 0 MaxSeqNo: 46 sessionId: src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0
2025-10-15T10:56:01.905931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|125682bd-36de7413-fc17e04a-44493833_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:01.926237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0] Write session: try to update token
2025-10-15T10:56:01.926299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:01.986785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:01.986819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:01.986830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:01.986839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:01.986869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400570461348352:3925]
2025-10-15T10:56:01.986891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400570461348352:3925]
2025-10-15T10:56:01.986909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400570461348352:3925]
2025-10-15T10:56:01.987039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:01.987077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:01.987123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:01.987129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:01.987145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:01.988212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:02.004327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId: src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:02.027989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:02.134566Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:02.160871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:02.160928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:02.160996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:02.161009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:02.161052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400570461348352:3925]
2025-10-15T10:56:02.161555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:02.162268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400567661643518:3423]
2025-10-15T10:56:02.162365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:02.162377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:02.164001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:02.196941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:02.197085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 190 reason: error at write: Disconnected sessionId: src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0
2025-10-15T10:56:02.199755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:02.199795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0] Write session will restart in 0.009194s
2025-10-15T10:56:02.199895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0] Write session: Do CDS request
2025-10-15T10:56:02.199924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:02.197436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 190 sessionId: src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0 is DEAD
2025-10-15T10:56:02.215123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:02.217063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:02.217096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 191
2025-10-15T10:56:02.217475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:02.217599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:02.217623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:02.217632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:02.218839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 191 sessionId:  describe result for acl check
2025-10-15T10:56:02.218967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:02.218979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:02.218988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:02.219006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400571956610856:4184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:02.221146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400571956610856:4184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:02.226735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400571956610856:4184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:02.234281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400571956610856:4184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:02.234322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400571956610856:4184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:02.234341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400571956610856:4184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:02.234373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:02.262401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400571956610939:3423]
2025-10-15T10:56:02.288954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:02.292351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:02.293203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:02.293231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:02.293275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:02.293525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:02.293707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400574756315924:3933]
2025-10-15T10:56:02.295849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:02.296786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:02.296990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:02.298291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:02.298613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:02.298628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:02.298635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:02.298643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:02.298650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:02.298657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:02.298664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:02.298671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:02.298678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:02.298685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:02.298693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:02.298701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.298708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.298715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.298761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:02.298871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:02.298917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:02.298960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:02.299011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:02.299064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:02.299126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:02.299179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:02.299221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:02.299287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:02.299336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:02.299403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.299450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.299499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.299545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:02.299612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:02.299673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:02.299730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:02.299780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:02.299837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:02.299885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:02.299941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:02.299991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:02.300046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:02.300095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:02.300153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:02.300197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:02.300256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:02.300310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:02.300365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:02.300415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:02.300474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:02.300525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:02.300575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:02.300626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:02.300679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:02.300726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.300779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.300833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.300888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.300933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.300989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.301492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:02.330714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:02.341348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:02.341388Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:02.341407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:02.341420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:02.341439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 190 [2:7561400574756315924:3933]
2025-10-15T10:56:02.341486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:02.341539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:02.341552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:02.341563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:02.341574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:02.341618Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:02.341644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:02.341665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:02.343628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.343652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.343666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.343676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:02.343933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:02.343954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.344082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.344259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.344331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 190
2025-10-15T10:56:02.344458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 190
2025-10-15T10:56:02.344484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:02.344538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 190, pipe: [1:7561400571956610939:3423]
2025-10-15T10:56:02.344579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400571956610850:2467], now have 1 active actors on pipe
2025-10-15T10:56:02.344609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400571956610884:4184], now have 1 active actors on pipe
2025-10-15T10:56:02.344631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400571956610939:3423], now have 1 active actors on pipe
2025-10-15T10:56:02.344675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400574756315919:3933]
2025-10-15T10:56:02.344689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400574756315919:3933]
2025-10-15T10:56:02.344702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400574756315919:3933]
2025-10-15T10:56:02.344738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:02.344772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:02.344797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:02.344807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:02.344815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:02.344977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:02.344995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:02.345045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:02.345061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:02.345155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400574756315919:3933]
2025-10-15T10:56:02.345176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:02.345197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:02.345235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:02.345267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:02.345289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:02.345300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:02.345328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:02.345358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:02.345450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:02.345805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:02.345840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:02.345905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:02.346335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 191 partition: 0 MaxSeqNo: 46 sessionId: src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0
2025-10-15T10:56:02.347084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13dfa6a9-a964dfb9-9edcebeb-8a0c05e6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:02.371228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0] Write session: try to update token
2025-10-15T10:56:02.371288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:02.400668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:02.400696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:02.400731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400574756315919:3933]
2025-10-15T10:56:02.400819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:02.400845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:02.404492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:02.406546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:02.408584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:02.409904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:02.411637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:02.412473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:02.476194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:02.476224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:02.476236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:02.476293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:02.476307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:02.476320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:02.476330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:02.476369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400574756315919:3933]
2025-10-15T10:56:02.476396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400574756315919:3933]
2025-10-15T10:56:02.476418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400574756315919:3933]
2025-10-15T10:56:02.476546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:02.476574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:02.476597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:02.476598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:02.476627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:02.477650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:02.480797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId: src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:02.504502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:02.625375Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:02.627302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:02.627361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:02.628037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:02.630269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:02.630314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:02.630336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:02.630507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400571956610939:3423]
2025-10-15T10:56:02.698347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 191 reason: error at write: Disconnected sessionId: src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0
2025-10-15T10:56:02.698954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 191 sessionId: src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0 is DEAD
2025-10-15T10:56:02.702700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:02.702733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0] Write session will restart in 0.009466s
2025-10-15T10:56:02.702839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0] Write session: Do CDS request
2025-10-15T10:56:02.702868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:02.718317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:02.718348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 192
2025-10-15T10:56:02.719292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:02.719891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:02.720034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:02.720052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:02.720064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:02.723646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 192 sessionId:  describe result for acl check
2025-10-15T10:56:02.723776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:02.723787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:02.723797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:02.723816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400571956611146:4191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:02.726661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400571956611146:4191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:02.731044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400571956611172:3423]
2025-10-15T10:56:02.743594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400571956611146:4191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:02.780464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400571956611146:4191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:02.780509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400571956611146:4191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:02.780527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400571956611146:4191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:02.780559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:02.814895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:02.820905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:02.821663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:02.821690Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:02.821737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:02.822016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:02.822220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400574756316196:3944]
2025-10-15T10:56:02.827167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:02.829138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:02.829424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:02.830837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:02.831198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:02.831207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:02.831216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:02.831224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:02.831232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:02.831240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:02.831248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:02.831257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:02.831265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:02.831273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:02.831281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:02.831288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.831294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.831301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.831374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:02.831497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:02.831545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:02.831600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:02.831650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:02.831702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:02.831751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:02.831798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:02.831847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:02.831896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:02.831955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:02.832005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.832055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.832103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.832153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:02.832222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:02.832287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:02.832347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:02.832398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:02.832457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:02.832507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:02.832564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:02.832619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:02.832675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:02.832726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:02.832784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:02.832833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:02.832892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:02.832943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:02.833002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:02.833054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:02.833112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:02.833160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:02.833218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:02.833267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:02.833324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:02.833373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.833432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.833481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.833540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.833589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.833646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.834192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:02.861879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:02.944041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:02.944100Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:02.944120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:02.944142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:02.944170Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 191 [2:7561400574756316196:3944]
2025-10-15T10:56:02.944228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:02.944298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:02.944314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:02.944328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:02.944339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:02.944392Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:02.944419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:02.944443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:02.945766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.945794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.945809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.945821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:02.946107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:02.946136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:02.946291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:02.946497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:02.946740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:02.946821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400574756316190:3944]
2025-10-15T10:56:02.946842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400574756316190:3944]
2025-10-15T10:56:02.946855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400574756316190:3944]
2025-10-15T10:56:02.946897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:02.946977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:02.947052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:02.947075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:02.947089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:02.947190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:02.947209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:02.947339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400574756316190:3944]
2025-10-15T10:56:02.951535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 191
2025-10-15T10:56:02.951626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 191, pipe: [1:7561400571956611172:3423]
2025-10-15T10:56:02.951680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 191
2025-10-15T10:56:02.955456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:02.955647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400571956611281:4191], now have 1 active actors on pipe
2025-10-15T10:56:02.955676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:02.955683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400571956611172:3423], now have 1 active actors on pipe
2025-10-15T10:56:02.955708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400571956611105:2467], now have 1 active actors on pipe
2025-10-15T10:56:02.955773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:02.955803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:02.956004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:02.956043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:02.956063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:02.956076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:02.956119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:02.956169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:02.956266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:02.957574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:02.957619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:02.957713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:02.959221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2696dc-ae6a89fa-583a893f-c20a8e0c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:02.958355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 192 partition: 0 MaxSeqNo: 46 sessionId: src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0
2025-10-15T10:56:02.987660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0] Write session: try to update token
2025-10-15T10:56:02.987728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:03.046565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:03.046618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:03.046644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:03.046660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:03.046716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400574756316190:3944]
2025-10-15T10:56:03.046770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400574756316190:3944]
2025-10-15T10:56:03.046812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400574756316190:3944]
2025-10-15T10:56:03.047062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:03.047141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:03.047141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:03.047160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:03.047181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:03.047202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:03.047232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:03.047253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:03.048720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:03.114504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId: src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:03.135974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:03.188232Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:03.216235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:03.216265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:03.216288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400571956611172:3423]
2025-10-15T10:56:03.216410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:03.216556Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T10:56:03.216956Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_17824226133827759393_v1 is DEAD
2025-10-15T10:56:03.217290Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T10:56:03.217566Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400382978028411:3418] disconnected; active server actors: 1
2025-10-15T10:56:03.217614Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400382978028411:3418] client user disconnected session shared/user_1_2_17824226133827759393_v1
2025-10-15T10:56:03.217934Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:56:03.217957Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:56:03.217994Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.007515s
2025-10-15T10:56:03.215761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:03.215800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:03.215856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:03.215867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:03.215898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400574756316190:3944]
2025-10-15T10:56:03.216083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:03.216382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:03.225791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 192 reason: error at write: Disconnected sessionId: src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0
2025-10-15T10:56:03.226169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 192 sessionId: src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0 is DEAD
2025-10-15T10:56:03.226555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:03.226625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0] Write session will restart in 0.005173s
2025-10-15T10:56:03.226849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0] Write session: Do CDS request
2025-10-15T10:56:03.226913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:03.243601Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T10:56:03.244289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:03.244215Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:56:03.244245Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-15T10:56:03.244371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:03.244386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 193
2025-10-15T10:56:03.244898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:03.244906Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:56:03.245029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:03.245052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:03.245061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:03.245143Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:56:03.245445Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 auth for : user
2025-10-15T10:56:03.245824Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 Handle describe topics response
2025-10-15T10:56:03.245951Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 auth is DEAD
2025-10-15T10:56:03.246055Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:56:03.246545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 193 sessionId:  describe result for acl check
2025-10-15T10:56:03.246644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:03.246656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:03.246666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:03.246692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400576251578694:4198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:03.247483Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_3_6895069221613495575_v1
2025-10-15T10:56:03.247513Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:56:03.247529Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:56:03.247713Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:56:03.247856Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400576251578695:4197] connected; active server actors: 1
2025-10-15T10:56:03.247901Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561400576251578695:4197] session shared/user_1_3_6895069221613495575_v1
2025-10-15T10:56:03.247940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:56:03.247989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:56:03.248026Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_3_6895069221613495575_v1" (Sender=[1:7561400576251578688:4197], Pipe=[1:7561400576251578695:4197], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:56:03.248052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:56:03.248099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:56:03.248145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_6895069221613495575_v1" (Sender=[1:7561400576251578688:4197], Pipe=[1:7561400576251578695:4197], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:56:03.248199Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_3_6895069221613495575_v1" sender [1:7561400576251578688:4197] lock partition 0 for ReadingSession "shared/user_1_3_6895069221613495575_v1" (Sender=[1:7561400576251578688:4197], Pipe=[1:7561400576251578695:4197], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-10-15T10:56:03.248240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:56:03.248267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000146s
2025-10-15T10:56:03.248338Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:56:03.249058Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_3_6895069221613495575_v1" ClientId: "user" PipeClient { RawX1: 7561400576251578695 RawX2: 4503603922341989 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:56:03.249144Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 got read request: guid# 1c8ef29e-83570118-9c777d1e-506a37a7
2025-10-15T10:56:03.249253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:56:03.249435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400576251578694:4198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:03.258135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400576251578694:4198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:03.264424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400576251578694:4198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:03.264465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400576251578694:4198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:03.264480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400576251578694:4198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:03.264508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:03.305633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:03.309991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:03.310774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:03.310807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:03.310849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:03.311089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:03.311285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400579051283751:3947]
2025-10-15T10:56:03.313418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:03.314292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:03.314507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:03.315763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:03.316091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:03.316106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:03.316112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:03.316119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:03.316126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:03.316134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:03.316140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:03.316147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:03.316154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:03.316160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:03.316166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:03.316172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.316179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.316185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.316255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:03.316365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:03.316415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:03.316462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:03.316507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:03.316556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:03.316601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:03.316653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:03.316708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:03.316757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:03.316803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:03.316850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.316894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.316940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.316984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:03.317049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:03.317107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:03.317161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:03.317211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:03.317264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:03.317313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:03.317368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:03.317415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:03.317469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:03.317517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:03.317568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:03.317614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:03.317668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:03.317711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:03.317769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:03.317819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:03.317876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:03.317922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:03.317973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:03.318019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:03.318070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:03.318115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.318170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.318218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.318273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.318317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.318369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.318889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:03.333747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:03.350125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:03.350159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:03.350170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:03.350182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:03.350200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 192 [2:7561400579051283751:3947]
2025-10-15T10:56:03.350239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:03.350280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:03.350290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:03.350300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:03.350311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:03.350349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:03.350364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:03.350380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:03.351467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.351489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.351503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.351512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:03.351755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:03.351780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.351907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.352077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.352048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 192, pipe: [1:7561400576251578699:4202]
2025-10-15T10:56:03.352048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 192
2025-10-15T10:56:03.352136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 192
2025-10-15T10:56:03.352276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:03.352346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400576251578728:4198], now have 1 active actors on pipe
2025-10-15T10:56:03.352373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400576251578699:4202], now have 1 active actors on pipe
2025-10-15T10:56:03.352394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400576251578676:2467], now have 1 active actors on pipe
2025-10-15T10:56:03.352439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:03.352462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:03.352520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:03.352538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:03.352563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_3_6895069221613495575_v1 on pipe: [1:7561400576251578699:4202]
2025-10-15T10:56:03.352605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400579051283746:3947]
2025-10-15T10:56:03.352623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400579051283746:3947]
2025-10-15T10:56:03.352634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400579051283746:3947]
2025-10-15T10:56:03.352642Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_6895069221613495575_v1:1 with generation 192
2025-10-15T10:56:03.352665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:03.352692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:03.352705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:03.352715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:03.352728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:03.352902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:03.352922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:03.352974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:03.353006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:03.353025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:03.353035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:03.353063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:03.353094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:03.353135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:03.353163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:03.353173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:03.353222Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_3_6895069221613495575_v1
2025-10-15T10:56:03.353232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:03.353400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400579051283746:3947]
2025-10-15T10:56:03.353428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:03.353450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:03.353466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:03.353496Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:56:03.353937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:03.353960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:03.354015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:03.354333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 193 partition: 0 MaxSeqNo: 46 sessionId: src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0
2025-10-15T10:56:03.355248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91915a96-4a5eb4df-d9a29a98-32e8476_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:03.356279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:56:03.356341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:56:03.356361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:03.356373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:03.356383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:03.356406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:56:03.356432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:56:03.356720Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760525763352 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:56:03.356767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T10:56:03.356847Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 sending to client partition status
2025-10-15T10:56:03.375602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0] Write session: try to update token
2025-10-15T10:56:03.375653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:03.429920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:03.429957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:03.429971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:03.429982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:03.430017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400579051283746:3947]
2025-10-15T10:56:03.430042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400579051283746:3947]
2025-10-15T10:56:03.430065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400579051283746:3947]
2025-10-15T10:56:03.430215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:03.430259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:03.430285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:03.446148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:03.446195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:03.448994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:03.453775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId: src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:03.475275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:03.602251Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:03.604776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:03.604806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:03.604854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400579051283746:3947]
2025-10-15T10:56:03.604997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:03.605034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:03.605061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:03.605707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_6895069221613495575_v1
2025-10-15T10:56:03.605734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:03.607633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:03.607851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:03.618484Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_6895069221613495575_v1
2025-10-15T10:56:03.635454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400576251578699:4202]
2025-10-15T10:56:03.635560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 193 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0
2025-10-15T10:56:03.635898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 193 sessionId: src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0 is DEAD
2025-10-15T10:56:03.639844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:03.639878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0] Write session will restart in 0.007423s
2025-10-15T10:56:03.639975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0] Write session: Do CDS request
2025-10-15T10:56:03.640004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:03.659340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:03.679997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:03.680027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 194
2025-10-15T10:56:03.680705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:03.680829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:03.680846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:03.680856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:03.686384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 194 sessionId:  describe result for acl check
2025-10-15T10:56:03.686504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:03.686515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:03.686523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:03.686540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400576251579015:4211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:03.689055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400576251579015:4211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:03.707024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400576251579015:4211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:03.717053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400576251579015:4211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:03.717099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400576251579015:4211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:03.717117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400576251579015:4211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:03.717151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:03.725840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:03.730376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:03.731332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:03.731364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:03.731408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:03.731609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:03.731755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400579051284015:3955]
2025-10-15T10:56:03.733885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:03.734923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:03.735145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:03.736547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:03.736860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:03.736875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:03.736882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:03.736889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:03.736897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:03.736904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:03.736910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:03.736918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:03.736926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:03.736932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:03.736952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:03.736960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.736968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.736976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.737022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:03.737131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:03.737178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:03.737232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:03.737286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:03.737331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:03.737380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:03.737429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:03.737474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:03.737517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:03.737568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:03.737619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.737677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.737729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.737775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:03.737844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:03.737903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:03.737961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:03.738016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:03.738076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:03.738126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:03.738185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:03.738238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:03.738295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:03.738346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:03.738403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:03.738456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:03.738508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:03.738559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:03.738617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:03.738666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:03.738726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:03.738772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:03.738831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:03.738883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:03.738939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:03.738990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.739047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.739097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.739165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.739217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.739276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.735899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400576251579189:4202]
2025-10-15T10:56:03.739825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:03.758793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:03.769695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:03.769749Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:03.769767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:03.769787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:03.769812Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 193 [2:7561400579051284015:3955]
2025-10-15T10:56:03.769864Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:03.769935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:03.769950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:03.769963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:03.769975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:03.770025Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:03.770047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:03.770069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:03.772128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.772158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.772172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.772183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:03.772445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:03.772469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:03.772607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:03.772796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:03.772808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 193
2025-10-15T10:56:03.772901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 193, pipe: [1:7561400576251579189:4202]
2025-10-15T10:56:03.772979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 193
2025-10-15T10:56:03.773026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:03.773115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400576251579182:4211], now have 1 active actors on pipe
2025-10-15T10:56:03.773143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400576251579189:4202], now have 1 active actors on pipe
2025-10-15T10:56:03.773165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400576251578948:2467], now have 1 active actors on pipe
2025-10-15T10:56:03.773192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400579051284010:3955]
2025-10-15T10:56:03.773211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400579051284010:3955]
2025-10-15T10:56:03.773225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400579051284010:3955]
2025-10-15T10:56:03.773265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:03.773300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:03.773318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:03.773330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:03.773342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:03.773526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:03.773551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:03.773714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:03.773749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:03.773801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400579051284010:3955]
2025-10-15T10:56:03.773833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:03.773866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:03.773949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:03.774001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:03.774023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:03.774032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:03.774071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:03.774121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:03.774227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:03.774853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:03.774884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:03.774962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:03.775278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 194 partition: 0 MaxSeqNo: 46 sessionId: src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0
2025-10-15T10:56:03.779880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed623135-f1baf81-8fd0aff3-a3cf1017_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:03.803888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0] Write session: try to update token
2025-10-15T10:56:03.803949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0] Send 10 message(s) (0 left), first sequence number is 47
E1015 10:56:03.812895418  821221 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:56:03.814372Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:56:03.851329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:03.851380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:03.851395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:03.851408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:03.851443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400579051284010:3955]
2025-10-15T10:56:03.851470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400579051284010:3955]
2025-10-15T10:56:03.851496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400579051284010:3955]
2025-10-15T10:56:03.851640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:03.851662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:03.851773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:03.851809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:03.851837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:03.861982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:03.970889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId: src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:04.005484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:04.015828Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:04.018939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:04.018977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:04.018996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:04.019172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400576251579189:4202]
2025-10-15T10:56:04.018446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:04.018491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:04.028673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 194 reason: error at write: Disconnected sessionId: src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0
2025-10-15T10:56:04.029035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 194 sessionId: src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0 is DEAD
2025-10-15T10:56:04.029457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:04.029511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0] Write session will restart in 0.009182s
2025-10-15T10:56:04.029678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0] Write session: Do CDS request
2025-10-15T10:56:04.029727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:04.038739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:04.045663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:04.045698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 195
2025-10-15T10:56:04.047978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:04.051548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:04.051704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:04.051720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:04.051731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:04.053356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 195 sessionId:  describe result for acl check
2025-10-15T10:56:04.053476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:04.053489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:04.053499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:04.053518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400580546546545:4221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:04.057036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400580546546545:4221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:04.064896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400580546546545:4221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:04.076726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400580546546545:4221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:04.076770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400580546546545:4221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:04.076785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400580546546545:4221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:04.076817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:04.119846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400580546546700:4202]
2025-10-15T10:56:04.144352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:04.150725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:04.151647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:04.151679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:04.151722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:04.151944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:04.152077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400583346251585:3965]
2025-10-15T10:56:04.154165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:04.155024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:04.155201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:04.156275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:04.156579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:04.156588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:04.156595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:04.156602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:04.156609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:04.156615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:04.156632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:04.156641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:04.156647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:04.156654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:04.156660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:04.156666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.156672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.156677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.156725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:04.156864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:04.156917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:04.156968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:04.157018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:04.157068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:04.157114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:04.157155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:04.157187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:04.157227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:04.157264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:04.157309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.157343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.157376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.157406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:04.157456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:04.157499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:04.157552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:04.157595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:04.157634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:04.157666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:04.157704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:04.157740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:04.158477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:04.158524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:04.158578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:04.158617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:04.158652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:04.158683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:04.158720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:04.158750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:04.158786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:04.158827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:04.158866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:04.158899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:04.158939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:04.158971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.159008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.159041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.159088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.159120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.159177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.159678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:04.179156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:04.188360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:04.188408Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:04.188428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:04.188450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:04.188477Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 194 [2:7561400583346251585:3965]
2025-10-15T10:56:04.188533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:04.188598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:04.188617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:04.188631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:04.188643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:04.188695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:04.188724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:04.188749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:04.201575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.201602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.201615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.201626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:04.202087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:04.202119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.202329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 194
2025-10-15T10:56:04.202330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 194
2025-10-15T10:56:04.202413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 194, pipe: [1:7561400580546546700:4202]
2025-10-15T10:56:04.202258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.202436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.202646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:04.202742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400580546546585:4221], now have 1 active actors on pipe
2025-10-15T10:56:04.202764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400580546546527:2467], now have 1 active actors on pipe
2025-10-15T10:56:04.202784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400580546546700:4202], now have 1 active actors on pipe
2025-10-15T10:56:04.202839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:04.202864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:04.202923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400583346251580:3965]
2025-10-15T10:56:04.202938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400583346251580:3965]
2025-10-15T10:56:04.202954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400583346251580:3965]
2025-10-15T10:56:04.203001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:04.203086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:04.203155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:04.203171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:04.203193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:04.203281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:04.203300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:04.203394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:04.203429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:04.203449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:04.203460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:04.203502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:04.203552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:04.203692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400583346251580:3965]
2025-10-15T10:56:04.203724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:04.203773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:04.203855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:04.204943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:04.204974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:04.205059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:04.205483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 195 partition: 0 MaxSeqNo: 46 sessionId: src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0
2025-10-15T10:56:04.206226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f19f7-140dd637-79931824-4ecf1cbe_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:04.235388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0] Write session: try to update token
2025-10-15T10:56:04.235453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:04.283359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:04.283402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:04.283420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:04.283434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:04.283478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400583346251580:3965]
2025-10-15T10:56:04.283512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400583346251580:3965]
2025-10-15T10:56:04.283539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400583346251580:3965]
2025-10-15T10:56:04.283688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:04.283716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:04.283752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:04.283763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:04.283785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:04.284828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:04.359226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId: src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:04.381627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:04.438921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:04.444528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:04.444568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:04.449002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:04.449265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:04.449287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:04.451521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:04.451669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400580546546700:4202]
2025-10-15T10:56:04.512257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 195 reason: error at write: Disconnected sessionId: src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0
2025-10-15T10:56:04.512621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 195 sessionId: src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0 is DEAD
2025-10-15T10:56:04.515986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:04.516036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0] Write session will restart in 0.008565s
2025-10-15T10:56:04.516150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0] Write session: Do CDS request
2025-10-15T10:56:04.516182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:04.536169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:04.536635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:04.536666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 196
2025-10-15T10:56:04.537016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:04.537123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:04.537138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:04.537148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:04.538563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 196 sessionId:  describe result for acl check
2025-10-15T10:56:04.538673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:04.538683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:04.538692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:04.538708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400580546546808:4226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:04.541438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400580546546808:4226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:04.548521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400580546546833:4202]
2025-10-15T10:56:04.565053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400580546546808:4226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:04.579344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400580546546808:4226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:04.579401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400580546546808:4226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:04.579418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400580546546808:4226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:04.579448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:04.613755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:04.615341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:04.615971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:04.615995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:04.616022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:04.616179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:04.616298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400583346251847:3968]
2025-10-15T10:56:04.617641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:04.618398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:04.618519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:04.619295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:04.619557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:04.619571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:04.619577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:04.619583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:04.619589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:04.619595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:04.619600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:04.619606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:04.619612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:04.619625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:04.619631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:04.619636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.619642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.619648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.619690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:04.619787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:04.619833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:04.619878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:04.619927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:04.619975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:04.620025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:04.620069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:04.620115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:04.620161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:04.620205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:04.620253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.620293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.620350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.620402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:04.620469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:04.620523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:04.620579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:04.620628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:04.620685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:04.620733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:04.620785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:04.620835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:04.620890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:04.620938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:04.620989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:04.621035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:04.621091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:04.621137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:04.621186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:04.621241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:04.621286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:04.621359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:04.621418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:04.621471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:04.621519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:04.621565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.621617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.621664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.621718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.621762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.621816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.622288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:04.646163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:04.667900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:04.667935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:04.667952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:04.667971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:04.667994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 195 [2:7561400583346251847:3968]
2025-10-15T10:56:04.668044Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:04.668103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:04.668117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:04.668127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:04.668138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:04.668182Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:04.668202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:04.668224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:04.669191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.669206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.669219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.669230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:04.669484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:04.669499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:04.669630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:04.669825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:04.670050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:04.670127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400583346251842:3968]
2025-10-15T10:56:04.670151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400583346251842:3968]
2025-10-15T10:56:04.670163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400583346251842:3968]
2025-10-15T10:56:04.670198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:04.670264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:04.670437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:04.670458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:04.670571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400583346251842:3968]
2025-10-15T10:56:04.670597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:04.670854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:04.670873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:04.670883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:04.670903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:04.671637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400580546546833:4202], now have 1 active actors on pipe
2025-10-15T10:56:04.671668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400580546546783:2467], now have 1 active actors on pipe
2025-10-15T10:56:04.671687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400580546546926:4226], now have 1 active actors on pipe
2025-10-15T10:56:04.672165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 195, pipe: [1:7561400580546546833:4202]
2025-10-15T10:56:04.672174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 195
2025-10-15T10:56:04.672257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 195
2025-10-15T10:56:04.673365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:04.673397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:04.673459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:04.673486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:04.673500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:04.673509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:04.673549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:04.673602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:04.673643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:04.678952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:04.678985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:04.679053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:04.680106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|193bd3e4-7db6534c-32b442d7-6b4ef5a2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:04.679382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 196 partition: 0 MaxSeqNo: 46 sessionId: src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0
2025-10-15T10:56:04.707516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0] Write session: try to update token
2025-10-15T10:56:04.707585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:04.767192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:04.767241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:04.767255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:04.767272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:04.767317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400583346251842:3968]
2025-10-15T10:56:04.767368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400583346251842:3968]
2025-10-15T10:56:04.767402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400583346251842:3968]
2025-10-15T10:56:04.767621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:04.767663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:04.767696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:04.767708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:04.767751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:04.770016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:04.819455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId: src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:04.873362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:04.911855Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:04.923603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:04.923646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:04.923698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:04.923711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:04.923752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400583346251842:3968]
2025-10-15T10:56:04.924265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:04.925030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:04.925967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400580546546833:4202]
2025-10-15T10:56:04.926038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:04.926171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:04.926190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:04.951037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 196 reason: error at write: Disconnected sessionId: src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0
2025-10-15T10:56:04.951446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 196 sessionId: src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0 is DEAD
2025-10-15T10:56:04.955665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:04.955735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0] Write session will restart in 0.007641s
2025-10-15T10:56:04.955932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0] Write session: Do CDS request
2025-10-15T10:56:04.955986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:04.975639Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:04.975764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:04.975682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 197
2025-10-15T10:56:04.980271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:04.980448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:04.980472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:04.980485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:04.982161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 197 sessionId:  describe result for acl check
2025-10-15T10:56:04.982304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:04.982331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:04.982342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:04.982385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400580546547063:4230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:04.985574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400580546547063:4230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:04.995845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400580546547063:4230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:05.014089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400580546547063:4230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:05.014131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400580546547063:4230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:05.014148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400580546547063:4230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:05.014180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:05.025622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400584841514549:4202]
2025-10-15T10:56:05.040425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:05.048251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:05.049031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:05.049060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:05.049094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:05.049315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:05.049473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400587641219408:3971]
2025-10-15T10:56:05.051735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:05.052656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:05.052838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:05.053982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:05.054275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.054283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.054289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.054296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.054302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.054309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.054315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.054320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.054327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.054332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.054338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.054346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.054353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.054359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.054402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.054497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.054540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.054586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.054625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.054671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.054712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.054753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.054796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.054841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.054881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.054922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.054963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.055005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.055039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.055096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.055158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.055208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.055252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.055300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.055363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.055423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.055472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.055524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.055572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.055630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.055681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.055738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.055780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.055828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.055872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.055922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.055964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.056017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.056089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.056142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.056186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.056241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.056295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.056352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.056397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.056445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.056894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:05.077620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:05.099934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:05.099971Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:05.099986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:05.100002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:05.100024Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 196 [2:7561400587641219408:3971]
2025-10-15T10:56:05.100069Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:05.100118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:05.100132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:05.100144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:05.100154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:05.100197Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:05.100217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:05.100237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:05.102218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.102245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.102258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.102268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:05.102553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:05.102580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.102727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.102906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.102997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 196
2025-10-15T10:56:05.103096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 196, pipe: [1:7561400584841514549:4202]
2025-10-15T10:56:05.103132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:05.103196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 196
2025-10-15T10:56:05.103219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400580546547044:2467], now have 1 active actors on pipe
2025-10-15T10:56:05.103246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400584841514549:4202], now have 1 active actors on pipe
2025-10-15T10:56:05.103266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400584841514488:4230], now have 1 active actors on pipe
2025-10-15T10:56:05.103287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400587641219393:3971]
2025-10-15T10:56:05.103299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400587641219393:3971]
2025-10-15T10:56:05.103310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400587641219393:3971]
2025-10-15T10:56:05.103368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:05.103393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:05.103407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:05.103430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:05.103460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:05.103622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:05.103642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:05.103692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:05.103715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:05.103819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400587641219393:3971]
2025-10-15T10:56:05.103848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:05.103872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:05.103906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:05.103929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:05.103952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:05.103962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:05.103992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:05.104029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:05.104134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:05.104718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:05.104744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:05.104808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:05.105062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 197 partition: 0 MaxSeqNo: 46 sessionId: src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0
2025-10-15T10:56:05.105841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dbebf77-4dd34c44-cdc8273-d165009b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:05.126195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0] Write session: try to update token
2025-10-15T10:56:05.126255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:05.183014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:05.183039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:05.183047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:05.183053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:05.183077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400587641219393:3971]
2025-10-15T10:56:05.183093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400587641219393:3971]
2025-10-15T10:56:05.183106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400587641219393:3971]
2025-10-15T10:56:05.183235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:05.183267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:05.183291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:05.183310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:05.183328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:05.186489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:05.214458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId: src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:05.235451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:05.375492Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:05.403771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:05.403827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:05.403898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:05.403912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:05.403954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400587641219393:3971]
2025-10-15T10:56:05.406565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:05.409299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:05.407663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:05.407840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400584841514549:4202]
2025-10-15T10:56:05.407950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:05.407963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:05.459615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 197 reason: error at write: Disconnected sessionId: src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0
2025-10-15T10:56:05.460008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 197 sessionId: src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0 is DEAD
2025-10-15T10:56:05.461814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:05.461890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0] Write session will restart in 0.008137s
2025-10-15T10:56:05.462099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0] Write session: Do CDS request
2025-10-15T10:56:05.462156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:05.480094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:05.485024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:05.485051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 198
2025-10-15T10:56:05.488016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:05.488173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:05.488198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:05.488208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:05.491019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 198 sessionId:  describe result for acl check
2025-10-15T10:56:05.491164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:05.491176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:05.491187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:05.491203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400584841514657:4242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:05.494219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400584841514657:4242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:05.508336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400584841514726:4202]
2025-10-15T10:56:05.510158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400584841514657:4242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:05.519545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400584841514657:4242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:05.519603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400584841514657:4242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:05.519622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400584841514657:4242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:05.519656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:05.559168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:05.564379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:05.565343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:05.565382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:05.565431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:05.565735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:05.565954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400587641219696:3980]
2025-10-15T10:56:05.568745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:05.569928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:05.570190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:05.571456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:05.571823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.571840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.571848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.571857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.571864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.571871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.571878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.571885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.571891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.571898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.571906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.571914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.571923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.571930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.571983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.572105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.572158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.572207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.572257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.572318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.572363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.572410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.572458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.572508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.572559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.572605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.572652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.572697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.572744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.572817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.572878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.572935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.572985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.573041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.573088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.573141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.573193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.573262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.573309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.573365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.573416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.573474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.573521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.573575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.573627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.573685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.573729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.573785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.573831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.573870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.573904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.573942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.573979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.574020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.574061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.574105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.574518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:05.594153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:05.603964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:05.604020Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:05.604039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:05.604060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:05.604088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 197 [2:7561400587641219696:3980]
2025-10-15T10:56:05.604147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:05.604215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:05.604231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:05.604243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:05.604256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:05.604305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:05.604330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:05.604354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:05.605413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.605440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.605456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.605469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:05.605746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:05.605774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.606077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 197
2025-10-15T10:56:05.606192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 197, pipe: [1:7561400584841514726:4202]
2025-10-15T10:56:05.606276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 197
2025-10-15T10:56:05.605934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.606147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.606397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:05.606509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400584841514624:2467], now have 1 active actors on pipe
2025-10-15T10:56:05.606533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400584841514726:4202], now have 1 active actors on pipe
2025-10-15T10:56:05.606559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400584841514790:4242], now have 1 active actors on pipe
2025-10-15T10:56:05.606584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400587641219690:3980]
2025-10-15T10:56:05.606599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400587641219690:3980]
2025-10-15T10:56:05.606615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400587641219690:3980]
2025-10-15T10:56:05.606646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:05.606698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:05.606712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:05.606724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:05.606724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:05.606917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:05.606935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:05.606995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:05.607016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:05.607179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400587641219690:3980]
2025-10-15T10:56:05.607210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:05.607235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:05.607287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:05.607320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:05.607339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:05.608033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:05.608096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:05.608146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:05.608319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:05.613353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:05.613402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:05.613496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:05.613892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 198 partition: 0 MaxSeqNo: 46 sessionId: src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0
2025-10-15T10:56:05.614722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|398810a3-fbcbb8e1-e0f60421-ac526b4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:05.638343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0] Write session: try to update token
2025-10-15T10:56:05.638413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:05.700273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:05.700303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:05.700335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400587641219690:3980]
2025-10-15T10:56:05.700488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:05.700564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:05.704293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:05.706039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:05.707213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:05.708362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:05.709804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:05.729914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:05.729946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:05.729958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:05.730021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:05.730149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:05.730169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:05.730183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:05.730193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:05.730231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400587641219690:3980]
2025-10-15T10:56:05.730257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400587641219690:3980]
2025-10-15T10:56:05.730285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400587641219690:3980]
2025-10-15T10:56:05.730408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:05.730440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:05.730445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:05.730462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:05.730464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:05.731484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:05.745770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId: src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:05.767260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:05.873559Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:05.874818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:05.874848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:05.875467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:05.875404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:05.875432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400584841514726:4202]
2025-10-15T10:56:05.875514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:05.875526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:05.946014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:05.950414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 198 reason: error at write: Disconnected sessionId: src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0
2025-10-15T10:56:05.950801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 198 sessionId: src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0 is DEAD
2025-10-15T10:56:05.950777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:05.951765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:05.951793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:05.951875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:05.955584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:05.952448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:05.952761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400587641219949:3990]
2025-10-15T10:56:05.955658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0] Write session will restart in 0.009936s
2025-10-15T10:56:05.955898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0] Write session: Do CDS request
2025-10-15T10:56:05.955954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:05.958361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:05.959491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:05.959735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:05.961088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:05.961448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.961465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.961472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.961479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.961486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.961492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.961498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.961508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.961519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.961525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.961532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.961539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.961547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.961553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.961603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.961723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.961771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.961816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.961867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.961919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.961971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.962016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.962063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.962112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.962166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.962215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.962260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.962317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.962370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.962441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:05.962501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.962556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:05.962613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.962672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:05.962730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.962797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:05.962846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.962905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:05.962955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.963020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:05.963086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.963145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:05.963202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.963265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:05.963319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.963397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:05.963442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.963499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:05.963547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.963613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:05.963663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.963719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.963776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.963832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.963884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.963943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.964455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:05.970168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:05.970219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 199
2025-10-15T10:56:05.970279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:05.970715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:05.970818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:05.970833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:05.970858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:05.972111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 199 sessionId:  describe result for acl check
2025-10-15T10:56:05.972247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:05.972264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:05.972274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:05.972290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400584841515122:4249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:05.974867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400584841515122:4249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:05.975329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400584841515125:4202]
2025-10-15T10:56:05.981063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400584841515122:4249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:05.982285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:05.989137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400584841515122:4249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:05.989180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400584841515122:4249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:05.989196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400584841515122:4249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:05.989226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:05.992103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:05.992146Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:05.992167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:05.992187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:05.992211Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 198 [2:7561400587641219949:3990]
2025-10-15T10:56:05.992266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:05.992324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:05.992339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:05.992351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:05.992363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:05.992413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:05.992444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:05.992466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:05.993466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.993491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.993503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.993516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:05.993778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:05.993807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:05.993960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:05.994025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 198, pipe: [1:7561400584841515125:4202]
2025-10-15T10:56:05.994072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 198
2025-10-15T10:56:05.994124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 198
2025-10-15T10:56:05.994176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:05.994436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:05.994528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400584841515149:4249], now have 1 active actors on pipe
2025-10-15T10:56:05.994558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400584841515125:4202], now have 1 active actors on pipe
2025-10-15T10:56:05.994582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400584841514897:2467], now have 1 active actors on pipe
2025-10-15T10:56:05.994632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:05.994660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:05.994711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400587641219944:3990]
2025-10-15T10:56:05.994732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400587641219944:3990]
2025-10-15T10:56:05.994746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400587641219944:3990]
2025-10-15T10:56:05.994783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:05.994819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:05.994839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:05.994848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:05.994861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:05.995066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:05.995088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:05.995164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:05.995199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:05.995226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:05.995237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:05.995274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:05.995318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:05.995474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400587641219944:3990]
2025-10-15T10:56:05.995510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:05.995530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:05.995553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:05.996016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:05.996037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:05.996107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:05.996428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 199 partition: 0 MaxSeqNo: 46 sessionId: src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0
2025-10-15T10:56:05.997127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f82c9d6-f02fb92d-7b49c9cb-f8b8d7cd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:06.030597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0] Write session: try to update token
2025-10-15T10:56:06.030650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:06.037541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:06.037583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:06.037625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400587641219944:3990]
2025-10-15T10:56:06.037758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:06.037774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:06.039961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:06.042020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:06.043650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:06.045437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:06.048624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:06.049901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:06.092702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:06.092756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:06.092767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:06.120315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId: src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:06.141537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:06.141572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:06.141586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:06.141597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:06.141631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400587641219944:3990]
2025-10-15T10:56:06.141654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400587641219944:3990]
2025-10-15T10:56:06.141677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400587641219944:3990]
2025-10-15T10:56:06.141814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:06.141824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:06.141835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:06.141860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:06.141903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:06.142937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:06.158241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:06.281020Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:06.282459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:06.282501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:06.283210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:06.283419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:06.283436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400584841515125:4202]
2025-10-15T10:56:06.283464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:06.283532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:06.313412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 199 reason: error at write: Disconnected sessionId: src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0
2025-10-15T10:56:06.313708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 199 sessionId: src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0 is DEAD
2025-10-15T10:56:06.314122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:06.314178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0] Write session will restart in 0.005926s
2025-10-15T10:56:06.314316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0] Write session: Do CDS request
2025-10-15T10:56:06.314356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:06.324129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:06.324161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 200
2025-10-15T10:56:06.324268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:06.324797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:06.324943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:06.324970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:06.324984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:06.326200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 200 sessionId:  describe result for acl check
2025-10-15T10:56:06.326309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:06.326325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:06.326334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:06.326352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400589136482492:4255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:06.328823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400589136482492:4255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:06.338691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400589136482492:4255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:06.347273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400589136482492:4255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:06.347313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400589136482492:4255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:06.347329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400589136482492:4255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:06.347375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:06.364726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:06.366461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:06.367223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:06.367246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:06.367290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:06.367538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:06.367712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400591936187499:3992]
2025-10-15T10:56:06.369323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:06.370134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:06.370333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:06.371524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:06.371793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:06.371813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:06.371820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:06.371827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:06.371833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:06.371840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:06.371846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:06.371851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:06.371858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:06.371863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:06.371867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:06.371871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.371876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.371880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.371912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:06.371987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:06.372018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:06.372046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:06.372073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:06.372107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:06.372141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:06.372169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:06.372212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:06.372243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:06.372294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:06.372344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.372390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.372428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.372468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:06.372531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:06.372587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:06.372636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:06.372685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:06.372736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:06.372772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:06.372826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:06.372877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:06.372929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:06.372973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:06.373025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:06.373070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:06.373120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:06.373153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:06.373185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:06.373229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:06.373282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:06.373327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:06.373383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:06.373430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:06.373484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:06.373532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.373581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.373628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.373677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.373722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.373775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.374237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:06.383531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400589136482718:4202]
2025-10-15T10:56:06.389412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:06.399237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:06.399277Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:06.399292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:06.399309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:06.399332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 199 [2:7561400591936187499:3992]
2025-10-15T10:56:06.399393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:06.399449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:06.399464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:06.399475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:06.399486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:06.399526Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:06.399545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:06.399563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:06.412908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.412931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.412941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.412949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:06.413195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:06.413219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.413335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.413488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.413476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 199, pipe: [1:7561400589136482718:4202]
2025-10-15T10:56:06.413614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 199
2025-10-15T10:56:06.413687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:06.413728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 199
2025-10-15T10:56:06.413768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400589136482718:4202], now have 1 active actors on pipe
2025-10-15T10:56:06.413801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400589136482467:2467], now have 1 active actors on pipe
2025-10-15T10:56:06.413820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400589136482638:4255], now have 1 active actors on pipe
2025-10-15T10:56:06.413842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400591936187494:3992]
2025-10-15T10:56:06.413857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400591936187494:3992]
2025-10-15T10:56:06.413868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400591936187494:3992]
2025-10-15T10:56:06.413899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:06.413921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:06.413931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:06.413942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:06.413964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:06.414115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:06.414136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:06.414195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:06.414216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:06.414297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400591936187494:3992]
2025-10-15T10:56:06.414320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:06.414368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:06.414382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:06.414401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:06.414411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:06.414416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:06.414438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:06.414464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:06.414561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:06.415452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:06.415476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:06.415545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:06.415887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 200 partition: 0 MaxSeqNo: 46 sessionId: src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0
2025-10-15T10:56:06.416647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3629c982-2b82696b-24e8cc6f-e4fbf1ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:06.436759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0] Write session: try to update token
2025-10-15T10:56:06.436808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:06.499032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:06.499064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:06.499074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:06.499085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:06.499115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400591936187494:3992]
2025-10-15T10:56:06.499140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400591936187494:3992]
2025-10-15T10:56:06.499161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400591936187494:3992]
2025-10-15T10:56:06.499297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:06.499330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:06.499372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:06.499386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:06.499393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:06.508314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:06.524835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId: src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:06.548111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:06.646302Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:06.656908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:56:06.656994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-15T10:56:06.661917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:06.661965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:06.662028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:06.662041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:06.662076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400591936187494:3992]
2025-10-15T10:56:06.662261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:06.662555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400589136482718:4202]
2025-10-15T10:56:06.662648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:06.662682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:06.662705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:06.674869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 200 reason: error at write: Disconnected sessionId: src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0
2025-10-15T10:56:06.675248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 200 sessionId: src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0 is DEAD
2025-10-15T10:56:06.675652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:06.675690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0] Write session will restart in 0.007843s
2025-10-15T10:56:06.675832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0] Write session: Do CDS request
2025-10-15T10:56:06.675892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:06.690708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:06.690768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-15T10:56:06.691955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:06.691990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 201
2025-10-15T10:56:06.692137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:06.692569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:06.692693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:06.692714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:06.692722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:06.694176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 201 sessionId:  describe result for acl check
2025-10-15T10:56:06.694329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:06.694352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:06.694369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:06.694395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400589136482754:4265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:06.698195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400589136482754:4265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:06.704562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400589136482754:4265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:06.711389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400589136482754:4265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:06.711427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400589136482754:4265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:06.711443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400589136482754:4265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:06.711470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:06.762868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400589136482969:4202]
2025-10-15T10:56:06.771591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:06.775456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:06.776207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:06.776234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:06.776272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:06.776510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:06.776712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400591936187781:4002]
2025-10-15T10:56:06.778942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:06.779842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:06.780023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:06.781245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:06.781531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:06.781539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:06.781546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:06.781552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:06.781559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:06.781566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:06.781572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:06.781578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:06.781585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:06.781591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:06.781618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:06.781625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.781631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.781638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.781680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:06.781778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:06.781824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:06.781867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:06.781908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:06.781953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:06.781996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:06.782041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:06.782086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:06.782135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:06.782178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:06.782220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.782264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.782337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.782379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:06.782440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:06.782496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:06.782545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:06.782592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:06.782643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:06.782682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:06.782730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:06.782774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:06.782818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:06.782857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:06.782903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:06.782941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:06.782986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:06.783025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:06.783072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:06.783115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:06.783161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:06.783214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:06.783260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:06.783298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:06.783344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:06.784373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.784443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.784503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.784552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.784599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.784644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.785128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:06.819424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:06.829257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:06.829298Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:06.829314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:06.829331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:06.829353Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 200 [2:7561400591936187781:4002]
2025-10-15T10:56:06.829400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:06.829457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:06.829470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:06.829482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:06.829492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:06.829535Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:06.829553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:06.829573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:06.831646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.831675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.831688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.831698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:06.831971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:06.831998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:06.832133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:06.832317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:06.832541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:06.832612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400591936187776:4002]
2025-10-15T10:56:06.832630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400591936187776:4002]
2025-10-15T10:56:06.832643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400591936187776:4002]
2025-10-15T10:56:06.832677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:06.832750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:06.832793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:06.832807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:06.832817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:06.832915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:06.832940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:06.833041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400591936187776:4002]
2025-10-15T10:56:06.833065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:06.833077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:06.833172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400589136482750:2467], now have 1 active actors on pipe
2025-10-15T10:56:06.833201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400589136482969:4202], now have 1 active actors on pipe
2025-10-15T10:56:06.833221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400589136482784:4265], now have 1 active actors on pipe
2025-10-15T10:56:06.833412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 200
2025-10-15T10:56:06.833526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 200, pipe: [1:7561400589136482969:4202]
2025-10-15T10:56:06.833605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 200
2025-10-15T10:56:06.833703Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:56:06.833801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:06.833820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:06.833861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0775012-19ed800c-15fc3dbf-23294362_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:06.833889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:06.833900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:06.833906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:06.833930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:06.833953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:06.833979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:06.834408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:06.834428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:06.834501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:06.834534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 4 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:56:06.834668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:56:06.834857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 201 partition: 0 MaxSeqNo: 46 sessionId: src_id|d0775012-19ed800c-15fc3dbf-23294362_0
2025-10-15T10:56:06.835604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8eeff0b-9003f183-b2c07c4d-39bc5716_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d0775012-19ed800c-15fc3dbf-23294362_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:06.859449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0775012-19ed800c-15fc3dbf-23294362_0] Write session: try to update token
2025-10-15T10:56:06.859519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0775012-19ed800c-15fc3dbf-23294362_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:06.932109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:06.932164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:06.932189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:06.932203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:06.932286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400591936187776:4002]
2025-10-15T10:56:06.932322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400591936187776:4002]
2025-10-15T10:56:06.932373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400591936187776:4002]
2025-10-15T10:56:06.932599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:06.932677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:06.932732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:06.932743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:06.932757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:06.932769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:06.932819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:06.932839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:06.934493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:06.955308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId: src_id|d0775012-19ed800c-15fc3dbf-23294362_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:06.978327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:07.089489Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:07.109331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:07.109381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:07.109461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:07.109476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:07.109517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400591936187776:4002]
2025-10-15T10:56:07.109773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:07.110124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:07.110100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:07.110263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400589136482969:4202]
2025-10-15T10:56:07.110343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:07.110356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:07.120688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0775012-19ed800c-15fc3dbf-23294362_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:07.120730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0775012-19ed800c-15fc3dbf-23294362_0] Write session will restart in 0.005935s
2025-10-15T10:56:07.120897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0775012-19ed800c-15fc3dbf-23294362_0] Write session: Do CDS request
2025-10-15T10:56:07.120953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0775012-19ed800c-15fc3dbf-23294362_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:07.119105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 201 reason: error at write: Disconnected sessionId: src_id|d0775012-19ed800c-15fc3dbf-23294362_0
2025-10-15T10:56:07.119420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 201 sessionId: src_id|d0775012-19ed800c-15fc3dbf-23294362_0 is DEAD
2025-10-15T10:56:07.132675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0775012-19ed800c-15fc3dbf-23294362_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:07.133034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:07.133073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 202
2025-10-15T10:56:07.135766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:07.135933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:07.135968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:07.135980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:07.137547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 202 sessionId:  describe result for acl check
2025-10-15T10:56:07.137664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:07.137675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:07.137684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:07.137701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400593431450353:4274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:07.140113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400593431450353:4274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:07.145979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400593431450353:4274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:07.153282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400593431450353:4274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:07.153323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400593431450353:4274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:07.153340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400593431450353:4274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:07.153370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:07.210390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400593431450570:4202]
2025-10-15T10:56:07.222568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:07.226920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:07.227858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:07.227888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:07.227930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:07.228183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:07.228378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400596231155359:4012]
2025-10-15T10:56:07.230650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:07.231804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:07.232049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:07.233360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:07.233700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:07.233718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:07.233725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:07.233735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:07.233742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:07.233750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:07.233757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:07.233764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:07.233772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:07.233780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:07.233788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:07.233795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.233802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.233810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.233860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:07.233978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:07.234027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:07.234082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:07.234135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:07.234188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:07.234239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:07.234289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:07.234341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:07.234396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:07.234442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:07.234488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.234536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.234588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.234637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:07.234712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:07.234789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:07.234850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:07.234907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:07.234963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:07.235016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:07.235076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:07.235130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:07.235202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:07.235253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:07.235312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:07.235389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:07.235445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:07.235497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:07.235557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:07.235627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:07.235686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:07.235735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:07.235794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:07.235859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:07.235920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:07.235970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.236031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.236088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.236149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.236200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.236256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.236775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:07.253061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:07.262177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:07.262235Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:07.262255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:07.262288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:07.262316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 201 [2:7561400596231155359:4012]
2025-10-15T10:56:07.262375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:07.262445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:07.262461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:07.262475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:07.262487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:07.262542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:07.262573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:07.262597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:07.263698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.263727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.263742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.263754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:07.264030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:07.264054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.264206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.264312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 201, pipe: [1:7561400593431450570:4202]
2025-10-15T10:56:07.264352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 201
2025-10-15T10:56:07.264419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 201
2025-10-15T10:56:07.264417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.264678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:07.264777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400593431450570:4202], now have 1 active actors on pipe
2025-10-15T10:56:07.264806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400593431450384:4274], now have 1 active actors on pipe
2025-10-15T10:56:07.264826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400593431450337:2467], now have 1 active actors on pipe
2025-10-15T10:56:07.264876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:07.264905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:07.264958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400596231155354:4012]
2025-10-15T10:56:07.264978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400596231155354:4012]
2025-10-15T10:56:07.264991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400596231155354:4012]
2025-10-15T10:56:07.265028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:07.265068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:07.265091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:07.265102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:07.265109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:07.265302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:07.265326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:07.265394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:07.265430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:07.265454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:07.265464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:07.265501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:07.265547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:07.265688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400596231155354:4012]
2025-10-15T10:56:07.265720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:07.265761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:07.265768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:07.266271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:07.266300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:07.266368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:07.266630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 202 partition: 0 MaxSeqNo: 46 sessionId: src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0
2025-10-15T10:56:07.267473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0775012-19ed800c-15fc3dbf-23294362_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:07.287851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0] Write session: try to update token
2025-10-15T10:56:07.287916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:07.294937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:07.294967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:07.294997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400596231155354:4012]
2025-10-15T10:56:07.295098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:07.295134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:07.297009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:07.298323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:07.299852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:07.301152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:07.303862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:07.304289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:07.361431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId: src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:07.363115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:07.363147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:07.363158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:07.387712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:07.391750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:07.391801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:07.391851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:07.391866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:07.391880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:07.391892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:07.391934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400596231155354:4012]
2025-10-15T10:56:07.391962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400596231155354:4012]
2025-10-15T10:56:07.391987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400596231155354:4012]
2025-10-15T10:56:07.392164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:07.392182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:07.392205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:07.392251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:07.392290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:07.393217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:07.537619Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:07.539797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:56:07.540163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:07.540456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:07.540611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400593431450570:4202]
2025-10-15T10:56:07.629792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:07.629868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0] Write session will restart in 0.005161s
2025-10-15T10:56:07.630057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0] Write session: Do CDS request
2025-10-15T10:56:07.630099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:07.628897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:07.628929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:07.629008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 202 reason: error at write: Disconnected sessionId: src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0
2025-10-15T10:56:07.629342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 202 sessionId: src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0 is DEAD
2025-10-15T10:56:07.645407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400593431450748:4202]
2025-10-15T10:56:07.647043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:07.647075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 203
2025-10-15T10:56:07.647299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:07.651854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:07.652036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:07.652081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:07.652093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:07.654110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 203 sessionId:  describe result for acl check
2025-10-15T10:56:07.654232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:07.654248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:07.654257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:07.654276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400593431450760:4278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:07.657116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400593431450760:4278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:07.668873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400593431450760:4278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:07.676746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:07.675596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400593431450760:4278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:07.675640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400593431450760:4278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:07.675657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400593431450760:4278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:07.675688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:07.680220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:07.681050Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:07.681077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:07.681115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:07.681291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:07.681423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400596231155628:4015]
2025-10-15T10:56:07.683719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:07.684695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:07.684884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:07.686134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:07.686482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:07.686502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:07.686509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:07.686516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:07.686524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:07.686533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:07.686541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:07.686548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:07.686556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:07.686563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:07.686569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:07.686576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.686582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.686590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.686643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:07.686766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:07.686819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:07.686870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:07.686922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:07.686983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:07.687036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:07.687088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:07.687144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:07.687208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:07.687263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:07.687315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.687386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.687439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.687489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:07.687564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:07.687631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:07.687691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:07.687749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:07.687810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:07.687868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:07.687926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:07.687983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:07.688038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:07.688091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:07.688149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:07.688198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:07.688253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:07.688302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:07.688360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:07.688410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:07.688467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:07.688513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:07.688570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:07.688617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:07.688675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:07.688724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.688778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.688825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.688881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.688932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.689006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.689516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:07.725186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:07.735066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:07.735107Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:07.735122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:07.735140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:07.735163Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 202 [2:7561400596231155628:4015]
2025-10-15T10:56:07.735219Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:07.735273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:07.735285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:07.735296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:07.735306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:07.735365Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:07.735387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:07.735406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:07.736408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.736437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.736451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.736463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:07.736714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:07.736737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:07.736864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:07.737049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:07.737049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 202, pipe: [1:7561400593431450748:4202]
2025-10-15T10:56:07.737057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 202
2025-10-15T10:56:07.737158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 202
2025-10-15T10:56:07.737285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:07.737372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400593431450851:4278], now have 1 active actors on pipe
2025-10-15T10:56:07.737402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400593431450748:4202], now have 1 active actors on pipe
2025-10-15T10:56:07.737422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400593431450601:2467], now have 1 active actors on pipe
2025-10-15T10:56:07.737470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:07.737497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:07.737550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400596231155622:4015]
2025-10-15T10:56:07.737570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400596231155622:4015]
2025-10-15T10:56:07.737582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400596231155622:4015]
2025-10-15T10:56:07.737617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:07.737653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:07.737674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:07.737686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:07.737692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:07.737863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:07.737884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:07.737939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:07.737972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:07.737992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:07.738000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:07.738031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:07.738062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:07.738187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400596231155622:4015]
2025-10-15T10:56:07.738218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:07.738248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:07.738260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:07.738787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:07.738839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:07.738926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:07.739242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 203 partition: 0 MaxSeqNo: 46 sessionId: src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0
2025-10-15T10:56:07.740089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c62f708-8abb7adf-cffae5b8-1bbc8c64_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:07.767936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0] Write session: try to update token
2025-10-15T10:56:07.767997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:07.777220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:07.777257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:07.777300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400596231155622:4015]
2025-10-15T10:56:07.777434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:07.777456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:07.779514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:07.781878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:07.783727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:07.785094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:07.786917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:07.787541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:07.843069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId: src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:07.853741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:07.853776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:07.853791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:07.853872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:07.853890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:07.853906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:07.853922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:07.853967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400596231155622:4015]
2025-10-15T10:56:07.853998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400596231155622:4015]
2025-10-15T10:56:07.854022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400596231155622:4015]
2025-10-15T10:56:07.854159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:07.854179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:07.854201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:07.854209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:07.854242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:07.855284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:07.866939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:08.000621Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:08.003585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:08.003631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:08.004332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:08.005410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:08.005415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:08.005442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:08.005573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400593431450748:4202]
2025-10-15T10:56:08.029438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 203 reason: error at write: Disconnected sessionId: src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0
2025-10-15T10:56:08.029781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 203 sessionId: src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0 is DEAD
2025-10-15T10:56:08.030223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:08.030273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0] Write session will restart in 0.007563s
2025-10-15T10:56:08.030436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0] Write session: Do CDS request
2025-10-15T10:56:08.030482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:08.042473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:08.060733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:08.060767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 204
2025-10-15T10:56:08.061419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:08.061545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:08.061569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:08.061578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:08.065171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 204 sessionId:  describe result for acl check
2025-10-15T10:56:08.065288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:08.065304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:08.065314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:08.065330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400597726418236:4289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:08.068010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400597726418236:4289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:08.074925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400597726418236:4289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:08.090357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400597726418236:4289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:08.090403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400597726418236:4289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:08.090421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400597726418236:4289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:08.090450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:08.105305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400597726418438:4202]
2025-10-15T10:56:08.110317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:08.113824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:08.114693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:08.114722Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:08.114764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:08.115009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:08.115200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400600526123197:4024]
2025-10-15T10:56:08.117448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:08.118421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:08.118648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:08.119909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:08.120224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.120240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.120246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.120254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.120260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.120265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.120272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.120279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.120286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.120293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.120299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.120307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.120313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.120319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.120363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.120466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.120512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.120556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.120598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.120653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.120699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.120755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.120803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.120853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.120899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.120952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.120995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.121042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.121089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.121153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.121221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.121280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.121331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.121385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.121434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.121490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.121540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.121594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.121640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.121705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.121749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.121807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.121859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.121911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.121961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.122029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.122086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.122143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.122190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.122247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.122309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.122367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.122418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.122476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.122527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.122585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.123076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:08.139610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:08.150811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:08.150855Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:08.150872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:08.150889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:08.150912Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 203 [2:7561400600526123197:4024]
2025-10-15T10:56:08.150959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:08.151028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:08.151046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:08.151058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:08.151069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:08.151117Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:08.151143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:08.151165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:08.153252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.153277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.153288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.153301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:08.153567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:08.153590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.153722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.153898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.153864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 203, pipe: [1:7561400597726418438:4202]
2025-10-15T10:56:08.153983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 203
2025-10-15T10:56:08.154067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 203
2025-10-15T10:56:08.154121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:08.154203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400597726418438:4202], now have 1 active actors on pipe
2025-10-15T10:56:08.154235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400597726418333:4289], now have 1 active actors on pipe
2025-10-15T10:56:08.154258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400597726418175:2467], now have 1 active actors on pipe
2025-10-15T10:56:08.154304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:08.154325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:08.154360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400600526123192:4024]
2025-10-15T10:56:08.154378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400600526123192:4024]
2025-10-15T10:56:08.154391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400600526123192:4024]
2025-10-15T10:56:08.154426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:08.154489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:08.154512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:08.154513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:08.154525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:08.154681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:08.154704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:08.154766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:08.154799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:08.154815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:08.154826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:08.154860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:08.154903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:08.155032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400600526123192:4024]
2025-10-15T10:56:08.155064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:08.155100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:08.155106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:08.155538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:08.155562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:08.155621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:08.155883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 204 partition: 0 MaxSeqNo: 46 sessionId: src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0
2025-10-15T10:56:08.156662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148e289a-2e3fe99c-ce7e2c17-b7644307_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:08.175678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0] Write session: try to update token
2025-10-15T10:56:08.175740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:08.202982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:08.203012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:08.203051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400600526123192:4024]
2025-10-15T10:56:08.203174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:08.203181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:08.205145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:08.206728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:08.209992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:08.213984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:08.221778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:08.222842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:08.256422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:08.256457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:08.256471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:08.256482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:08.256523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400600526123192:4024]
2025-10-15T10:56:08.256550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400600526123192:4024]
2025-10-15T10:56:08.256574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400600526123192:4024]
2025-10-15T10:56:08.256702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:08.256738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:08.256762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:08.256774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:08.256776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:08.256784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:08.256846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:08.256867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:08.259102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:08.262561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId: src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:08.281149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:08.403809Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:08.405899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:08.405938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:08.406397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400597726418438:4202]
2025-10-15T10:56:08.406526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:08.406547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:08.406614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:08.406695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:08.415012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 204 reason: error at write: Disconnected sessionId: src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0
2025-10-15T10:56:08.415313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 204 sessionId: src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0 is DEAD
2025-10-15T10:56:08.415773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:08.415814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0] Write session will restart in 0.009535s
2025-10-15T10:56:08.415933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0] Write session: Do CDS request
2025-10-15T10:56:08.415972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:08.431072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:08.431103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 205
2025-10-15T10:56:08.431319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:08.431821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:08.431970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:08.431993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:08.432003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:08.433893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 205 sessionId:  describe result for acl check
2025-10-15T10:56:08.434037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:08.434061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:08.434075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:08.434104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400597726418484:4297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:08.436952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400597726418484:4297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:08.445096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400597726418484:4297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:08.454207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400597726418484:4297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:08.454242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400597726418484:4297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:08.454253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400597726418484:4297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:08.454278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:08.487339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:08.491385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:08.492204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:08.492236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:08.492274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:08.492533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:08.492723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400600526123493:4033]
2025-10-15T10:56:08.494993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:08.495957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:08.496200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:08.497601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:08.497978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.497996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.498004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.498012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.498020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.498028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.498036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.498045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.498053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.498061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.498068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.498075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.498082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.498089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.498144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.498269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.498324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.498383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.498439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.498493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.498545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.498599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.498652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.498708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.498765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.498819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.498874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.498927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.498998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.499080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.499148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.499226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.499285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.499372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.499434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.499497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.499554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.499626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.499686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.499743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.499799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.499866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.499921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.499983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.500042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.500103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.500158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.500221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.500274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.500338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.500393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.500459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.500514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.500576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.500628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.500690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.501268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:08.506726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400597726418721:4202]
2025-10-15T10:56:08.516389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:08.524422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:08.524457Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:08.524469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:08.524484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:08.524504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 204 [2:7561400600526123493:4033]
2025-10-15T10:56:08.524543Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:08.524602Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:08.524618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:08.524628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:08.524636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:08.524673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:08.524691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:08.524708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:08.525458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.525479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.525488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.525497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:08.525703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:08.525718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.525831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.525975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.525996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 204, pipe: [1:7561400597726418721:4202]
2025-10-15T10:56:08.526069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 204
2025-10-15T10:56:08.526078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 204
2025-10-15T10:56:08.526147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:08.526208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400597726418721:4202], now have 1 active actors on pipe
2025-10-15T10:56:08.526228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400597726418551:4297], now have 1 active actors on pipe
2025-10-15T10:56:08.526243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400597726418469:2467], now have 1 active actors on pipe
2025-10-15T10:56:08.526265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400600526123488:4033]
2025-10-15T10:56:08.526278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400600526123488:4033]
2025-10-15T10:56:08.526292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400600526123488:4033]
2025-10-15T10:56:08.526327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:08.526360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:08.526383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:08.526395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:08.526398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:08.526416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:08.526461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:08.526600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:08.526615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:08.526732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:08.526757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:08.526774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:08.526781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:08.526806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:08.526833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:08.526858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400600526123488:4033]
2025-10-15T10:56:08.526881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:08.526903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:08.526948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:08.527366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:08.527410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:08.527480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:08.527719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 205 partition: 0 MaxSeqNo: 46 sessionId: src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0
2025-10-15T10:56:08.528384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8b850f-ad01c497-1752cd19-e86b3d4e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:08.548840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0] Write session: try to update token
2025-10-15T10:56:08.548900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:08.558501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:08.558527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:08.558556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400600526123488:4033]
2025-10-15T10:56:08.558654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:08.558673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:08.560837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:08.562241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:08.564609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:08.565994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:08.567846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:08.568389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:08.622261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:08.622300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:08.622315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:08.622329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:08.622372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400600526123488:4033]
2025-10-15T10:56:08.622399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400600526123488:4033]
2025-10-15T10:56:08.622422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400600526123488:4033]
2025-10-15T10:56:08.622575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:08.622586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:08.622603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:08.622625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:08.622666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:08.623631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:08.641691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId: src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:08.663775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:08.762253Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:08.763906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:08.763952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:08.764523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400597726418721:4202]
2025-10-15T10:56:08.764560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:08.764575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:08.764631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:08.764696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:08.775908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 205 reason: error at write: Disconnected sessionId: src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0
2025-10-15T10:56:08.776292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 205 sessionId: src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0 is DEAD
2025-10-15T10:56:08.776680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:08.776755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0] Write session will restart in 0.009439s
2025-10-15T10:56:08.776908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0] Write session: Do CDS request
2025-10-15T10:56:08.776957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:08.790966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:08.791022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 206
2025-10-15T10:56:08.791252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:08.791907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:08.792103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:08.792146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:08.792164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:08.793745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 206 sessionId:  describe result for acl check
2025-10-15T10:56:08.793866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:08.793890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:08.793897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:08.793920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400597726418747:4301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:08.796023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400597726418747:4301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:08.800790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400597726418747:4301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:08.809525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400597726418747:4301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:08.809569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400597726418747:4301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:08.809585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400597726418747:4301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:08.809611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:08.850250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:08.854168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:08.854966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:08.854997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:08.855042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:08.855249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:08.855449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400600526123753:4037]
2025-10-15T10:56:08.857352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:08.858167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:08.858368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:08.859610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:08.859944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.859961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.859968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.859974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.859982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.859989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.859996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.860003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.860010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.860016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.860023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.860029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.860036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.860044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.860088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.860194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.860244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.860292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.860337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.860390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.860439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.860490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.860540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.860592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.860642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.860696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.860743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.860788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.860835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.860901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:08.860958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.861006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:08.861045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.861093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:08.861131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.861185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:08.861225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.861263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:08.861301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.861358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:08.861423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.861477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:08.861528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.861570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:08.861607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.861647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:08.861682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.861721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:08.861756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.861796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:08.861833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.861890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.861931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.861990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.862042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.862089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.862562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:08.864659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400597726418991:4202]
2025-10-15T10:56:08.878814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:08.900573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:08.900623Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:08.900640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:08.900657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:08.900681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 205 [2:7561400600526123753:4037]
2025-10-15T10:56:08.900729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:08.900780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:08.900802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:08.900813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:08.900824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:08.900868Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:08.900895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:08.900919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:08.901955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.901980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.901992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.902003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:08.902245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:08.902268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:08.902393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:08.902569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:08.902596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 205
2025-10-15T10:56:08.902607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 205, pipe: [1:7561400597726418991:4202]
2025-10-15T10:56:08.902720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 205
2025-10-15T10:56:08.902796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:08.902875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400597726418731:2467], now have 1 active actors on pipe
2025-10-15T10:56:08.902903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400597726418991:4202], now have 1 active actors on pipe
2025-10-15T10:56:08.902923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400597726418791:4301], now have 1 active actors on pipe
2025-10-15T10:56:08.902985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:08.903008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:08.903042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400600526123748:4037]
2025-10-15T10:56:08.903059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400600526123748:4037]
2025-10-15T10:56:08.903071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400600526123748:4037]
2025-10-15T10:56:08.903109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:08.903145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:08.903172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:08.903174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:08.903185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:08.903368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:08.903391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:08.903453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:08.903484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:08.903504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:08.903518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:08.903549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:08.903586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:08.903708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400600526123748:4037]
2025-10-15T10:56:08.903752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:08.903799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:08.903804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:08.904297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:08.904321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:08.904379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:08.904674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 206 partition: 0 MaxSeqNo: 46 sessionId: src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0
2025-10-15T10:56:08.905354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1be50c7-dcdba554-b9ed47b1-5ada89ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:08.924538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0] Write session: try to update token
2025-10-15T10:56:08.924606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:08.934240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:08.934281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:08.934327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400600526123748:4037]
2025-10-15T10:56:08.934448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:08.934471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:08.936593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:08.938033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:08.939430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:08.940857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:08.942747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:08.943198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:09.005286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:09.005325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:09.005341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:09.005352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:09.005393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400600526123748:4037]
2025-10-15T10:56:09.005415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400600526123748:4037]
2025-10-15T10:56:09.005431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400600526123748:4037]
2025-10-15T10:56:09.005583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:09.005580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:09.005597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:09.005605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:09.005616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:09.005646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:09.005655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:09.005678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:09.006672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:09.006798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId: src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:09.030580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:09.151795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:09.152895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:09.152925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:09.153443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:09.153420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:09.153451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:09.153454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400597726418991:4202]
2025-10-15T10:56:09.153543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:09.162198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 206 reason: error at write: Disconnected sessionId: src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0
2025-10-15T10:56:09.162540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 206 sessionId: src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0 is DEAD
2025-10-15T10:56:09.162915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:09.162966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0] Write session will restart in 0.005064s
2025-10-15T10:56:09.163106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0] Write session: Do CDS request
2025-10-15T10:56:09.163157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:09.173908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:09.173944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 207
2025-10-15T10:56:09.174168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:09.174628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:09.174742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:09.174765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:09.174775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:09.176369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 207 sessionId:  describe result for acl check
2025-10-15T10:56:09.176488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:09.176507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:09.176516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:09.176535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400602021386339:4314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:09.179300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400602021386339:4314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:09.184732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400602021386339:4314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:09.191243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400602021386339:4314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:09.191292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400602021386339:4314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:09.191309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400602021386339:4314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:09.191365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:09.235243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:09.245042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:09.245957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:09.245990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:09.246035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:09.246311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:09.246516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400604821091310:4039]
2025-10-15T10:56:09.248808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:09.249829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:09.250068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:09.251446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:09.251797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:09.251814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:09.251821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:09.251830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:09.251837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:09.251845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:09.251852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:09.251861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:09.251867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:09.251874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:09.251881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:09.251888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.251895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.251903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.251954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:09.252070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:09.252131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:09.252187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:09.252241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:09.252294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:09.252346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:09.252398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:09.252449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:09.252503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:09.252557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:09.252607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.252657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.252713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.252764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:09.252841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:09.252906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:09.252967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:09.253026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:09.253089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:09.253144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:09.253203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:09.253260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:09.253323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:09.253372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:09.253430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:09.253485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:09.253549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:09.253601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:09.253658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:09.253688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400602021386580:4202]
2025-10-15T10:56:09.253715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:09.253780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:09.253828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:09.253889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:09.253940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:09.254000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:09.254056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.254116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.254167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.254229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.254281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.254338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.254867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:09.270034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:09.279644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:09.279701Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:09.279720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:09.279743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:09.279770Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 206 [2:7561400604821091310:4039]
2025-10-15T10:56:09.279824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:09.279889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:09.279913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:09.279926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:09.279939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:09.279991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:09.280021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:09.280049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:09.281042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.281066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.281080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.281092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:09.281360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:09.281384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.281539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.281755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.281763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 206
2025-10-15T10:56:09.281765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 206
2025-10-15T10:56:09.281841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 206, pipe: [1:7561400602021386580:4202]
2025-10-15T10:56:09.281990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:09.282077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400602021386370:4314], now have 1 active actors on pipe
2025-10-15T10:56:09.282104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400602021386318:2467], now have 1 active actors on pipe
2025-10-15T10:56:09.282123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400602021386580:4202], now have 1 active actors on pipe
2025-10-15T10:56:09.282160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:09.282181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:09.282235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400604821091305:4039]
2025-10-15T10:56:09.282248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400604821091305:4039]
2025-10-15T10:56:09.282256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400604821091305:4039]
2025-10-15T10:56:09.282281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:09.282328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:09.282334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:09.282357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:09.282369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:09.282501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:09.282518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:09.282586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|364685ee-afc385a1-aeec6187-93c310c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:09.282615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:09.282629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:09.282637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:09.282665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:09.282703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:09.282818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400604821091305:4039]
2025-10-15T10:56:09.282840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:09.282873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:09.282892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:09.283392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:09.283421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:09.283493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:09.283775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 207 partition: 0 MaxSeqNo: 46 sessionId: src_id|364685ee-afc385a1-aeec6187-93c310c8_0
2025-10-15T10:56:09.284470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 379 BytesWritten: 103628882 MessagesWritten: 46 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-15T10:56:09.284596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99481309-6bb360ea-cbdecf6a-96407d3c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|364685ee-afc385a1-aeec6187-93c310c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:09.301840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|364685ee-afc385a1-aeec6187-93c310c8_0] Write session: try to update token
2025-10-15T10:56:09.301883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|364685ee-afc385a1-aeec6187-93c310c8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:09.309742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:09.309779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:09.309838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400604821091305:4039]
2025-10-15T10:56:09.309957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:09.309996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:09.312102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:09.313373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:09.314533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:09.315987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:09.317566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:09.334831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:09.379056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:09.379096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:09.379111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:09.379122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:09.379158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400604821091305:4039]
2025-10-15T10:56:09.379184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400604821091305:4039]
2025-10-15T10:56:09.379213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400604821091305:4039]
2025-10-15T10:56:09.379342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:09.379375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:09.379392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:09.379392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:09.379418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:09.380407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:09.388627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId: src_id|364685ee-afc385a1-aeec6187-93c310c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:09.408183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:09.511607Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:09.513990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:09.514031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:09.514544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:09.514574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:09.517985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:09.531944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:09.532186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400602021386580:4202]
2025-10-15T10:56:09.532305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 207 reason: error at write: Disconnected sessionId: src_id|364685ee-afc385a1-aeec6187-93c310c8_0
2025-10-15T10:56:09.532658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 207 sessionId: src_id|364685ee-afc385a1-aeec6187-93c310c8_0 is DEAD
2025-10-15T10:56:09.533057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364685ee-afc385a1-aeec6187-93c310c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:09.533108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364685ee-afc385a1-aeec6187-93c310c8_0] Write session will restart in 0.008656s
2025-10-15T10:56:09.533285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364685ee-afc385a1-aeec6187-93c310c8_0] Write session: Do CDS request
2025-10-15T10:56:09.533344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364685ee-afc385a1-aeec6187-93c310c8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:09.548959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|364685ee-afc385a1-aeec6187-93c310c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:09.559043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:09.559076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 208
2025-10-15T10:56:09.559586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:09.559707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:09.559728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:09.559738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:09.561170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 208 sessionId:  describe result for acl check
2025-10-15T10:56:09.561283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:09.561300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:09.561310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:09.561324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400602021386615:4324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:09.564237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400602021386615:4324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:09.570505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400602021386615:4324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:09.576729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400602021386615:4324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:09.576771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400602021386615:4324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:09.576786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400602021386615:4324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:09.576812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:09.614027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:09.617070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:09.617623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:09.617653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:09.617679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:09.617849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:09.618024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400604821091595:4048]
2025-10-15T10:56:09.619784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:09.620464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:09.620604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:09.621465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:09.621695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:09.621705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:09.621709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:09.621712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:09.621716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:09.621719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:09.621722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:09.621725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:09.621735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:09.621739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:09.621743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:09.621747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.621752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.621758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.621795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:09.621866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:09.621908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:09.621951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:09.621996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:09.622044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:09.622093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:09.622130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:09.622163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:09.622197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:09.622228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:09.622272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.622306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.622339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.622363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:09.622408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:09.622450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:09.622484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:09.622514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:09.622560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:09.622591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:09.622629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:09.622671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:09.622710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:09.622740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:09.622782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:09.622826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:09.622862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:09.622897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:09.622930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:09.622977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:09.623022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:09.623068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:09.623115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:09.623160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:09.623202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:09.623248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.623284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.623331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.623398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.623445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.623497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.623965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:09.632605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400602021386860:4202]
2025-10-15T10:56:09.639288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:09.668289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:09.668327Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:09.668342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:09.668357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:09.668378Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 207 [2:7561400604821091595:4048]
2025-10-15T10:56:09.668423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:09.668474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:09.668485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:09.668494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:09.668501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:09.668545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:09.668568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:09.668590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:09.672028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.672049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.672057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.672064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:09.672251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:09.672266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:09.672371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:09.672493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 207
2025-10-15T10:56:09.672547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:09.672566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 207, pipe: [1:7561400602021386860:4202]
2025-10-15T10:56:09.672616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 207
2025-10-15T10:56:09.672756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:09.672823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400602021386645:4324], now have 1 active actors on pipe
2025-10-15T10:56:09.672852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400602021386860:4202], now have 1 active actors on pipe
2025-10-15T10:56:09.672873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400602021386606:2467], now have 1 active actors on pipe
2025-10-15T10:56:09.672911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:09.672930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:09.672975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400604821091590:4048]
2025-10-15T10:56:09.672993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400604821091590:4048]
2025-10-15T10:56:09.673005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400604821091590:4048]
2025-10-15T10:56:09.673036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:09.673068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:09.673092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:09.673102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:09.673103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:09.673257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:09.673278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:09.673336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:09.673365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:09.673381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:09.673390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:09.673421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:09.673460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:09.673588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400604821091590:4048]
2025-10-15T10:56:09.673619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:09.673648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:09.673662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:09.674107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:09.674126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:09.674172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:09.674441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 208 partition: 0 MaxSeqNo: 46 sessionId: src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0
2025-10-15T10:56:09.675113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364685ee-afc385a1-aeec6187-93c310c8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:09.695590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0] Write session: try to update token
2025-10-15T10:56:09.695635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:09.703325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:09.703384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:09.703420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400604821091590:4048]
2025-10-15T10:56:09.703530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:09.703537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:09.705966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:09.707976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:09.709608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:09.711113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:09.713683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:09.714534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:09.778058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:09.778089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:09.778100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:09.778111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:09.778149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400604821091590:4048]
2025-10-15T10:56:09.778175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400604821091590:4048]
2025-10-15T10:56:09.778199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400604821091590:4048]
2025-10-15T10:56:09.778266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:09.778311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:09.778337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:09.778361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:09.778383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:09.778394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:09.778439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:09.778464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:09.780645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:09.781247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId: src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:09.802624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:09.923576Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:09.924821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:09.924856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:09.925427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:09.925436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:09.925464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:09.925472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400602021386860:4202]
2025-10-15T10:56:09.925539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:09.933933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 208 reason: error at write: Disconnected sessionId: src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0
2025-10-15T10:56:09.934178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 208 sessionId: src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0 is DEAD
2025-10-15T10:56:09.934548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:09.934600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0] Write session will restart in 0.005724s
2025-10-15T10:56:09.934690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0] Write session: Do CDS request
2025-10-15T10:56:09.934720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:09.943990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:09.944087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:09.944024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 209
2025-10-15T10:56:09.944590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:09.944690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:09.944705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:09.944712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:09.945577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 209 sessionId:  describe result for acl check
2025-10-15T10:56:09.945663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:09.945675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:09.945680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:09.945691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400602021386900:4331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:09.947573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400602021386900:4331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:09.952223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400602021386900:4331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:09.957881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400602021386900:4331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:09.957919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400602021386900:4331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:09.957934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400602021386900:4331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:09.957959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:10.011125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:10.014959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:10.015747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:10.015775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:10.015814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:10.016029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:10.016202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400609116059181:4058]
2025-10-15T10:56:10.018199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:10.019057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:10.019293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:10.020495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:10.020804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.020822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.020828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.020834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.020840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.020846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.020853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.020860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.020867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.020873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.020879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.020886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.020892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.020898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.020939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.021032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.021078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.021121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.021166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.021231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.021275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.021320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.021366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.021412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.021460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.021504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.021550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.021596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.021642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.021704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.021762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.021816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.021864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.021920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.021968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.022021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.022069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.022122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.022167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.022218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.022264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.022316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.022360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.022410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.022458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.022510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.022555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.022610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.022654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.022706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.022750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.022817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.022863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.022916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.022965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.023018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.023518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:10.025837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400606316354443:4202]
2025-10-15T10:56:10.054267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:10.062226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:10.062254Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:10.062265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:10.062278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:10.062295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 208 [2:7561400609116059181:4058]
2025-10-15T10:56:10.062326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:10.062365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:10.062376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:10.062384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:10.062393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:10.062423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:10.062442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:10.062461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:10.063293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.063310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.063318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.063326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:10.063581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:10.063598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.063684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.063836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.063904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 208
2025-10-15T10:56:10.063990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 208
2025-10-15T10:56:10.064011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 208, pipe: [1:7561400606316354443:4202]
2025-10-15T10:56:10.064002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:10.064067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400602021386887:2467], now have 1 active actors on pipe
2025-10-15T10:56:10.064087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400602021386932:4331], now have 1 active actors on pipe
2025-10-15T10:56:10.064100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400606316354443:4202], now have 1 active actors on pipe
2025-10-15T10:56:10.064128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400609116059176:4058]
2025-10-15T10:56:10.064136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400609116059176:4058]
2025-10-15T10:56:10.064143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400609116059176:4058]
2025-10-15T10:56:10.064166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:10.064201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:10.064220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:10.064223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:10.064231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:10.064350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:10.064364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:10.064397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:10.064409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:10.064492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400609116059176:4058]
2025-10-15T10:56:10.064518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:10.064537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:10.064559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad811632-e4233350-9f37c4fe-750c872_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:10.064576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:10.064588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:10.064595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:10.064617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:10.064638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:10.064711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:10.065233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:10.065263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:10.065327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:10.065546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 209 partition: 0 MaxSeqNo: 46 sessionId: src_id|ad811632-e4233350-9f37c4fe-750c872_0
2025-10-15T10:56:10.066178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850be17-23d26f3-579f00fe-7ccf5e45_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ad811632-e4233350-9f37c4fe-750c872_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:10.084157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad811632-e4233350-9f37c4fe-750c872_0] Write session: try to update token
2025-10-15T10:56:10.084196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad811632-e4233350-9f37c4fe-750c872_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:10.147328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId: src_id|ad811632-e4233350-9f37c4fe-750c872_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:10.162265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:10.162300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:10.162313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:10.162324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:10.162362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400609116059176:4058]
2025-10-15T10:56:10.162387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400609116059176:4058]
2025-10-15T10:56:10.162411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400609116059176:4058]
2025-10-15T10:56:10.162542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:10.162575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:10.162619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:10.162670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:10.162696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:10.162710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:10.162759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:10.162788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:10.163970Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:10.171471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:10.210655Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 2 CurrentSessionLifetimeMs: 121502 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:56:10.320563Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:10.355866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:10.355915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:10.356003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:10.356017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:10.356057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400609116059176:4058]
2025-10-15T10:56:10.356288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:10.356578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:10.357637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400606316354443:4202]
2025-10-15T10:56:10.357640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:10.357716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:10.372290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 209 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad811632-e4233350-9f37c4fe-750c872_0
2025-10-15T10:56:10.372659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 209 sessionId: src_id|ad811632-e4233350-9f37c4fe-750c872_0 is DEAD
2025-10-15T10:56:10.373120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad811632-e4233350-9f37c4fe-750c872_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:10.373173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad811632-e4233350-9f37c4fe-750c872_0] Write session will restart in 0.008350s
2025-10-15T10:56:10.373273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad811632-e4233350-9f37c4fe-750c872_0] Write session: Do CDS request
2025-10-15T10:56:10.373331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad811632-e4233350-9f37c4fe-750c872_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:10.386393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:10.386427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 210
2025-10-15T10:56:10.386806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad811632-e4233350-9f37c4fe-750c872_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:10.387463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:10.387600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:10.387623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:10.387633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:10.389724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 210 sessionId:  describe result for acl check
2025-10-15T10:56:10.389893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:10.389925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:10.389944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:10.389968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400606316354481:4337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:10.393527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400606316354481:4337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:10.400503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400606316354481:4337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:10.408937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400606316354481:4337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:10.408984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400606316354481:4337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:10.409002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400606316354481:4337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:10.409037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:10.440173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:10.444372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:10.445235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:10.445264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:10.445304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:10.445558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:10.445743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400609116059446:4060]
2025-10-15T10:56:10.448010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:10.449048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:10.449261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:10.450485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:10.450834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.450855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.450863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.450870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.450877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.450883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.450891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.450898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.450905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.450911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.450917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.450939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.450946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.450953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.451001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.451113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.451159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.451206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.451267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.451322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.451387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.451436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.451487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.451537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.451582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.451631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.451680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.451728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.451774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.451843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.451906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.451966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.452016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.452069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.452116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.452174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.452230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.452289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.452345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.452419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.452472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.452544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.452592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.452650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.452703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.452765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.452810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.452866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.452912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.452968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.453017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.453070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.453121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.453181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.453234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.453295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.453809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:10.455919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400606316354725:4202]
2025-10-15T10:56:10.480678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:10.489443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:10.489488Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:10.489507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:10.489530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:10.489557Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 209 [2:7561400609116059446:4060]
2025-10-15T10:56:10.489615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:10.489680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:10.489695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:10.489708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:10.489721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:10.489772Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:10.489804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:10.489828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:10.490853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.490877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.490892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.490906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:10.491161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:10.491185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.491359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.491461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 209, pipe: [1:7561400606316354725:4202]
2025-10-15T10:56:10.491516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 209
2025-10-15T10:56:10.491579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 209
2025-10-15T10:56:10.491570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.491823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:10.491918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400606316354725:4202], now have 1 active actors on pipe
2025-10-15T10:56:10.491948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400606316354466:2467], now have 1 active actors on pipe
2025-10-15T10:56:10.491982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400606316354528:4337], now have 1 active actors on pipe
2025-10-15T10:56:10.492050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:10.492073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:10.492110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400609116059439:4060]
2025-10-15T10:56:10.492125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400609116059439:4060]
2025-10-15T10:56:10.492139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400609116059439:4060]
2025-10-15T10:56:10.492180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:10.492218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:10.492242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:10.492254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:10.492263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:10.492453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:10.492476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:10.492546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98dd0aef-713f4b16-5865b887-a0736469_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:10.492584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:10.492610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:10.492622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:10.492660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:10.492699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:10.492816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400609116059439:4060]
2025-10-15T10:56:10.492848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:10.492881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:10.492895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:10.493393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:10.493424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:10.493503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:10.493779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 210 partition: 0 MaxSeqNo: 46 sessionId: src_id|98dd0aef-713f4b16-5865b887-a0736469_0
2025-10-15T10:56:10.494506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad811632-e4233350-9f37c4fe-750c872_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|98dd0aef-713f4b16-5865b887-a0736469_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:10.513622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98dd0aef-713f4b16-5865b887-a0736469_0] Write session: try to update token
2025-10-15T10:56:10.513674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98dd0aef-713f4b16-5865b887-a0736469_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:10.520925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:10.520953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:10.520987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400609116059439:4060]
2025-10-15T10:56:10.521097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:10.521120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:10.522723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:10.523868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:10.525265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:10.526533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:10.528247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:10.528813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:10.585198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:10.585229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:10.585242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:10.585253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:10.585289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400609116059439:4060]
2025-10-15T10:56:10.585315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400609116059439:4060]
2025-10-15T10:56:10.585338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400609116059439:4060]
2025-10-15T10:56:10.585470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:10.585472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:10.585492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:10.585512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:10.585550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:10.586572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:10.597428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId: src_id|98dd0aef-713f4b16-5865b887-a0736469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:10.618179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:10.723851Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:10.725232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:10.725268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:10.725728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:10.725740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400606316354725:4202]
2025-10-15T10:56:10.725847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:10.725861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:10.725888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:10.760164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 210 reason: error at write: Disconnected sessionId: src_id|98dd0aef-713f4b16-5865b887-a0736469_0
2025-10-15T10:56:10.760549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 210 sessionId: src_id|98dd0aef-713f4b16-5865b887-a0736469_0 is DEAD
2025-10-15T10:56:10.760965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dd0aef-713f4b16-5865b887-a0736469_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:10.761025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dd0aef-713f4b16-5865b887-a0736469_0] Write session will restart in 0.007421s
2025-10-15T10:56:10.761202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dd0aef-713f4b16-5865b887-a0736469_0] Write session: Do CDS request
2025-10-15T10:56:10.761251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dd0aef-713f4b16-5865b887-a0736469_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:10.773231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:10.773264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 211
2025-10-15T10:56:10.773380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98dd0aef-713f4b16-5865b887-a0736469_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:10.773946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:10.774089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:10.774112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:10.774121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:10.775612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 211 sessionId:  describe result for acl check
2025-10-15T10:56:10.775739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:10.775757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:10.775768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:10.775785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400606316354790:4341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:10.778616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400606316354790:4341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:10.789442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400606316354790:4341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:10.798681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400606316354790:4341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:10.798722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400606316354790:4341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:10.798737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400606316354790:4341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:10.798766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:10.807046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:10.810639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:10.811436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:10.811462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:10.811503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:10.811745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:10.811921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400609116059737:4064]
2025-10-15T10:56:10.813629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:10.814377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:10.814621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:10.816015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:10.816346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.816363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.816369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.816376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.816383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.816389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.816396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.816402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.816408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.816415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.816422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.816430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.816436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.816442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.816489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.816612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.816666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.816723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.816773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.816832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.816886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.816937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.816992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.817045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.817101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.817155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.817204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.817259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.817314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.817392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:10.817460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.817529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:10.817585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.817641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:10.817691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.817737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:10.817774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.817815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:10.817851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.817891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:10.817926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.817968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:10.818003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.818045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:10.818082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.818121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:10.818156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.818197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:10.818232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.818274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:10.818304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.818339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.818371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.818412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.818445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.818482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.818862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:10.826105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400606316354997:4202]
2025-10-15T10:56:10.835327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:10.845078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:10.845120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:10.845135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:10.845154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:10.845178Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 210 [2:7561400609116059737:4064]
2025-10-15T10:56:10.845226Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:10.845280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:10.845294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:10.845307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:10.845318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:10.845367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:10.845393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:10.845415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:10.847269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.847295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.847309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.847321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:10.847600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:10.847627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:10.847762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:10.847944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:10.848174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:10.848266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400606316354997:4202], now have 1 active actors on pipe
2025-10-15T10:56:10.848294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400606316354977:4341], now have 1 active actors on pipe
2025-10-15T10:56:10.847821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 210, pipe: [1:7561400606316354997:4202]
2025-10-15T10:56:10.848315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400606316354733:2467], now have 1 active actors on pipe
2025-10-15T10:56:10.847951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 210
2025-10-15T10:56:10.848043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 210
2025-10-15T10:56:10.848359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:10.848386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:10.848439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400609116059723:4064]
2025-10-15T10:56:10.848458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400609116059723:4064]
2025-10-15T10:56:10.848470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400609116059723:4064]
2025-10-15T10:56:10.848506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:10.848528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:10.848542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:10.848553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:10.848573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:10.848751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:10.848777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:10.848842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:10.848876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:10.848898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:10.848909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:10.848946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:10.848992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:10.849125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400609116059723:4064]
2025-10-15T10:56:10.849156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:10.849182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:10.849200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:10.849586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:10.849618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:10.849677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:10.849927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 211 partition: 0 MaxSeqNo: 46 sessionId: src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0
2025-10-15T10:56:10.850717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98dd0aef-713f4b16-5865b887-a0736469_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:10.870236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0] Write session: try to update token
2025-10-15T10:56:10.870295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:10.926600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:10.926635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:10.926671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400609116059723:4064]
2025-10-15T10:56:10.926784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:10.926828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:10.928916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:10.930264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:10.931616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:10.932905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:10.934666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:10.954284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:10.954321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:10.954334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:10.954404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:10.974492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:10.974515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:10.974525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:10.974532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:10.974560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400609116059723:4064]
2025-10-15T10:56:10.974577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400609116059723:4064]
2025-10-15T10:56:10.974592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400609116059723:4064]
2025-10-15T10:56:10.974686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:10.974706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:10.974716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:10.974724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:10.974743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:10.977648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:10.985116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId: src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:11.006087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:11.117437Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:11.120595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:11.120629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:11.121153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:11.121982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:11.141244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:11.141425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400606316354997:4202]
2025-10-15T10:56:11.142395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 211 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0
2025-10-15T10:56:11.142713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 211 sessionId: src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0 is DEAD
2025-10-15T10:56:11.143010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:11.143038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0] Write session will restart in 0.005279s
2025-10-15T10:56:11.143153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0] Write session: Do CDS request
2025-10-15T10:56:11.143183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:11.152890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:11.160802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:11.160838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 212
2025-10-15T10:56:11.161347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:11.161465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:11.161484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:11.161495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:11.162360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 212 sessionId:  describe result for acl check
2025-10-15T10:56:11.162456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:11.162472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:11.162481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:11.162498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400610611322349:4353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:11.164384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400610611322349:4353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:11.169846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400610611322349:4353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:11.179487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400610611322349:4353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:11.179534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400610611322349:4353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:11.179551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400610611322349:4353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:11.179585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:11.206781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:11.211422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:11.212205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:11.212235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:11.212275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:11.212508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:11.212691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400613411027299:4072]
2025-10-15T10:56:11.214798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:11.215715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:11.215912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:11.217085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:11.217389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:11.217405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:11.217413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:11.217419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:11.217426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:11.217432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:11.217438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:11.217445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:11.217451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:11.217458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:11.217464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:11.217470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.217476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.217482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.217525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:11.217687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:11.217758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:11.217806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:11.217850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:11.217894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:11.217944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:11.217979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:11.218022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:11.218066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:11.218108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:11.218151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.218192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.218235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.218271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:11.218338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:11.218395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:11.218450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:11.218493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:11.218556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:11.218614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:11.218675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:11.218721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:11.218772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:11.218813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:11.218865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:11.218912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:11.218963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:11.219015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:11.219073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:11.219120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:11.219168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:11.219210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:11.219270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:11.219311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:11.219379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:11.219419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.219472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.219516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.219567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.219609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.219661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.220101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:11.236450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:11.241859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400610611322596:4202]
2025-10-15T10:56:11.250260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:11.250298Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:11.250313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:11.250331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:11.250354Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 211 [2:7561400613411027299:4072]
2025-10-15T10:56:11.250401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:11.250452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:11.250464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:11.250476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:11.250487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:11.250534Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:11.250556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:11.250577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:11.252590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.252614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.252628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.252638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:11.252907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:11.252931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.253061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.253232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.253187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 211
2025-10-15T10:56:11.253283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 211
2025-10-15T10:56:11.253356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 211, pipe: [1:7561400610611322596:4202]
2025-10-15T10:56:11.253438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:11.253520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400610611322425:4353], now have 1 active actors on pipe
2025-10-15T10:56:11.253550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400610611322340:2467], now have 1 active actors on pipe
2025-10-15T10:56:11.253569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400610611322596:4202], now have 1 active actors on pipe
2025-10-15T10:56:11.253616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:11.253640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:11.253693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400613411027293:4072]
2025-10-15T10:56:11.253712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400613411027293:4072]
2025-10-15T10:56:11.253725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400613411027293:4072]
2025-10-15T10:56:11.253760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:11.253795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:11.253821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:11.253833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:11.253834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:11.254008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:11.254053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:11.254121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:11.254159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:11.254175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:11.254190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:11.254226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:11.254266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:11.254400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400613411027293:4072]
2025-10-15T10:56:11.254434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:11.254482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:11.254481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:11.255006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:11.255027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:11.255103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:11.255448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 212 partition: 0 MaxSeqNo: 46 sessionId: src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0
2025-10-15T10:56:11.256360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f1dbfb8-177726c6-81b5b7dc-5a83cdec_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:11.275184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0] Write session: try to update token
2025-10-15T10:56:11.275251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:11.281995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:11.282025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:11.282060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400613411027293:4072]
2025-10-15T10:56:11.282166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:11.282183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:11.284428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:11.320569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:11.321797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:11.322964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:11.327656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:11.328367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:11.346215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId: src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:11.357460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:11.357497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:11.357513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:11.357525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:11.357568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400613411027293:4072]
2025-10-15T10:56:11.357595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400613411027293:4072]
2025-10-15T10:56:11.357619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400613411027293:4072]
2025-10-15T10:56:11.357762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:11.357786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:11.357800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:11.357806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:11.357814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:11.357834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:11.357865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:11.357885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:11.358943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:11.371673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:11.501251Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:11.502797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:11.502840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:11.503535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:11.503507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:11.503533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400610611322596:4202]
2025-10-15T10:56:11.503537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:11.503633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:11.555561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 212 reason: error at write: Disconnected sessionId: src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0
2025-10-15T10:56:11.555885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 212 sessionId: src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0 is DEAD
2025-10-15T10:56:11.556328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:11.556384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0] Write session will restart in 0.007741s
2025-10-15T10:56:11.556527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0] Write session: Do CDS request
2025-10-15T10:56:11.556572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:11.568627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:11.568746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:11.568687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 213
2025-10-15T10:56:11.569302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:11.569454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:11.569481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:11.569495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:11.571504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 213 sessionId:  describe result for acl check
2025-10-15T10:56:11.571590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:11.571608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:11.571618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:11.571637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400610611322707:4360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:11.575018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400610611322707:4360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:11.586691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400610611322707:4360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:11.594326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400610611322707:4360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:11.594364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400610611322707:4360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:11.594378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400610611322707:4360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:11.594404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:11.598272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:11.602017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:11.602730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:11.602759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:11.602796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:11.603008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:11.603175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400613411027602:4081]
2025-10-15T10:56:11.603819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400610611322877:4202]
2025-10-15T10:56:11.605164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:11.605995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:11.606190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:11.607311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:11.607642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:11.607659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:11.607666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:11.607675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:11.607682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:11.607687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:11.607695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:11.607700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:11.607706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:11.607713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:11.607719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:11.607725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.607732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.607738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.607780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:11.607878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:11.607923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:11.607965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:11.608007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:11.608047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:11.608096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:11.608143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:11.608189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:11.608237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:11.608283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:11.608327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.608375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.608419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.608462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:11.608524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:11.608577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:11.608631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:11.608681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:11.608733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:11.608780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:11.608832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:11.608880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:11.608933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:11.608980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:11.609031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:11.609080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:11.609130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:11.609174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:11.609223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:11.609276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:11.609324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:11.609371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:11.609425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:11.609468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:11.609518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:11.609564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.609617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.609662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.609715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.609758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.609804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.610257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:11.644996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:11.654450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:11.654499Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:11.654514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:11.654530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:11.654553Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 212 [2:7561400613411027602:4081]
2025-10-15T10:56:11.654602Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:11.654652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:11.654664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:11.654675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:11.654686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:11.654728Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:11.654749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:11.654769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:11.655865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.655891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.655904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.655914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:11.656185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:11.656213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:11.656339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:11.656405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 212
2025-10-15T10:56:11.656426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 212, pipe: [1:7561400610611322877:4202]
2025-10-15T10:56:11.656515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:11.656542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 212
2025-10-15T10:56:11.656746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:11.656822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400610611322877:4202], now have 1 active actors on pipe
2025-10-15T10:56:11.656849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400610611322616:2467], now have 1 active actors on pipe
2025-10-15T10:56:11.656869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400610611322873:4360], now have 1 active actors on pipe
2025-10-15T10:56:11.656925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:11.656949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:11.656986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400613411027597:4081]
2025-10-15T10:56:11.657003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400613411027597:4081]
2025-10-15T10:56:11.657014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400613411027597:4081]
2025-10-15T10:56:11.657046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:11.657078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:11.657090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:11.657101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:11.657114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:11.657274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:11.657294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:11.657347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:11.657376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:11.657394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:11.657406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:11.657435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:11.657465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:11.657575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400613411027597:4081]
2025-10-15T10:56:11.657605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:11.657629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:11.657642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:11.658061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:11.658085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:11.658137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:11.658411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 213 partition: 0 MaxSeqNo: 46 sessionId: src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0
2025-10-15T10:56:11.659409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9836e0a-9684bf63-1ef84b10-b0c66a91_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:11.678784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0] Write session: try to update token
2025-10-15T10:56:11.678835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:11.687224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:11.687267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:11.687305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400613411027597:4081]
2025-10-15T10:56:11.687436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:11.687462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:11.689517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:11.690827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:11.693176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:11.694483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:11.696181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:11.729967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:11.755177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId: src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:11.761055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:11.761094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:11.761113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:11.761125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:11.761168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400613411027597:4081]
2025-10-15T10:56:11.761195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400613411027597:4081]
2025-10-15T10:56:11.761218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400613411027597:4081]
2025-10-15T10:56:11.761408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:11.761434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:11.761445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:11.761501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:11.761523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:11.762518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:11.763462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:11.763506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:11.763539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:11.779315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:11.903075Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:11.904313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:11.904350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:11.904926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:11.904973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400610611322877:4202]
2025-10-15T10:56:11.905075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:11.905098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:11.905126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:11.925757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 213 reason: error at write: Disconnected sessionId: src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0
2025-10-15T10:56:11.926116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 213 sessionId: src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0 is DEAD
2025-10-15T10:56:11.926483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:11.926560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0] Write session will restart in 0.005737s
2025-10-15T10:56:11.926740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0] Write session: Do CDS request
2025-10-15T10:56:11.926805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:11.937221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:11.937270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 214
2025-10-15T10:56:11.937621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:11.938548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:11.938763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:11.938812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:11.938827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:11.940986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 214 sessionId:  describe result for acl check
2025-10-15T10:56:11.941161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:11.941193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:11.941209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:11.941237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400610611322911:4364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:11.944722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400610611322911:4364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:11.950723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400610611322911:4364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:11.962619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400610611322911:4364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:11.962662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400610611322911:4364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:11.962679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400610611322911:4364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:11.962710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:11.998638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:12.002562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:12.003380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:12.003404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:12.003439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:12.003652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:12.003792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400617705995169:4085]
2025-10-15T10:56:12.005209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400614906290454:4202]
2025-10-15T10:56:12.005513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:12.006273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:12.006431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:12.007416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:12.007743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.007755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.007760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.007764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.007770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.007775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.007779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.007784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.007788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.007793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.007797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.007802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.007806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.007811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.007848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.007947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.007999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.008051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.008087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.008141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.008183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.008235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.008276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.008314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.008349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.008382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.008431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.008480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.008512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.008565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.008613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.008654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.008692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.008736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.008771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.008812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.008848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.008890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.008923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.008978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.009015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.009057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.009093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.009129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.009167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.009210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.009244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.009289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.009325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.009367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.009400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.009441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.009476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.009517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.009552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.009591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.009963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:12.024826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:12.032635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:12.032671Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:12.032684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:12.032699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:12.032718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 213 [2:7561400617705995169:4085]
2025-10-15T10:56:12.032758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:12.032809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:12.032821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:12.032832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:12.032840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:12.032878Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:12.032898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:12.032919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:12.033757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.033782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.033797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.033809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:12.033999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:12.034018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.034134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.034275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.034414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 213
2025-10-15T10:56:12.034426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 213
2025-10-15T10:56:12.034493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 213, pipe: [1:7561400614906290454:4202]
2025-10-15T10:56:12.034519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:12.034596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400610611323003:4364], now have 1 active actors on pipe
2025-10-15T10:56:12.034621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400610611322894:2467], now have 1 active actors on pipe
2025-10-15T10:56:12.034635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400614906290454:4202], now have 1 active actors on pipe
2025-10-15T10:56:12.034654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400613411027868:4085]
2025-10-15T10:56:12.034663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400613411027868:4085]
2025-10-15T10:56:12.034672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400613411027868:4085]
2025-10-15T10:56:12.034699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:12.034748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:12.034769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:12.034772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:12.034783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:12.034784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:12.034814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:12.034953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:12.034969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:12.035099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8c49537-5005f29-f476a82a-d5e820a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:12.035123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:12.035135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:12.035143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:12.035172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:12.035207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:12.035235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400613411027868:4085]
2025-10-15T10:56:12.035268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:12.035292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:12.035330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:12.035786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:12.035811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:12.035861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:12.036126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 214 partition: 0 MaxSeqNo: 46 sessionId: src_id|e8c49537-5005f29-f476a82a-d5e820a9_0
2025-10-15T10:56:12.036868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b847efa6-b168eeaf-6780b47c-5f33b09e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e8c49537-5005f29-f476a82a-d5e820a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:12.052649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c49537-5005f29-f476a82a-d5e820a9_0] Write session: try to update token
2025-10-15T10:56:12.052702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c49537-5005f29-f476a82a-d5e820a9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:12.062780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:12.062816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:12.062857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400613411027868:4085]
2025-10-15T10:56:12.062990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:12.062992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:12.065033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:12.066458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:12.067751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:12.079534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:12.081175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:12.081746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:12.117070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId: src_id|e8c49537-5005f29-f476a82a-d5e820a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:12.124004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:12.124040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:12.124057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:12.124068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:12.124106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400613411027868:4085]
2025-10-15T10:56:12.124125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400613411027868:4085]
2025-10-15T10:56:12.124142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400613411027868:4085]
2025-10-15T10:56:12.124264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:12.124269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:12.124297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:12.124303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:12.124329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:12.125257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:12.138479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:12.262840Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:12.264903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:12.264946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:12.265649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:12.265559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:12.265575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:12.265606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:12.265754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400614906290454:4202]
2025-10-15T10:56:12.276489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 214 reason: error at write: Disconnected sessionId: src_id|e8c49537-5005f29-f476a82a-d5e820a9_0
2025-10-15T10:56:12.276833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 214 sessionId: src_id|e8c49537-5005f29-f476a82a-d5e820a9_0 is DEAD
2025-10-15T10:56:12.277250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c49537-5005f29-f476a82a-d5e820a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:12.277296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c49537-5005f29-f476a82a-d5e820a9_0] Write session will restart in 0.007038s
2025-10-15T10:56:12.277441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c49537-5005f29-f476a82a-d5e820a9_0] Write session: Do CDS request
2025-10-15T10:56:12.277487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c49537-5005f29-f476a82a-d5e820a9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:12.290087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c49537-5005f29-f476a82a-d5e820a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:12.290947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:12.290980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 215
2025-10-15T10:56:12.303768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:12.303930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:12.303955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:12.303966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:12.305323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 215 sessionId:  describe result for acl check
2025-10-15T10:56:12.305444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:12.305462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:12.305471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:12.305489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400614906290501:4371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:12.308143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400614906290501:4371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:12.313635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400614906290501:4371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:12.324368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400614906290501:4371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:12.324425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400614906290501:4371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:12.324441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400614906290501:4371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:12.324474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:12.349588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:12.353340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:12.353990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:12.354011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:12.354040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:12.354199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:12.354310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400617705995449:4089]
2025-10-15T10:56:12.355623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:12.356337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:12.356453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:12.357378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:12.357643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.357655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.357659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.357663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.357667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.357671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.357674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.357678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.357681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.357686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.357689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.357693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.357697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.357701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.357729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.357793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.357827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.357858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.357890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.357916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.357945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.357990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.358023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.358055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.358084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.358113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.358142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.358172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.358198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.358239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.358276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.358306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.358338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.358382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.358411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.358448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.358482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.358515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.358542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.358573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.358601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.358640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.358666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.358699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.358728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.358762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.358788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.358821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.358848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.358884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.358921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.358954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.358982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.359014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.359040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.359070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.359383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:12.366178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400614906290759:4202]
2025-10-15T10:56:12.375622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:12.385381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:12.385418Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:12.385427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:12.385441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:12.385462Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 214 [2:7561400617705995449:4089]
2025-10-15T10:56:12.385505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:12.385547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:12.385556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:12.385565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:12.385572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:12.385614Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:12.385632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:12.385649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:12.387589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.387614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.387626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.387636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:12.387909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:12.387930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.388045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.388229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.388442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:12.388525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400614906290480:2467], now have 1 active actors on pipe
2025-10-15T10:56:12.388554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400614906290759:4202], now have 1 active actors on pipe
2025-10-15T10:56:12.388572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400614906290615:4371], now have 1 active actors on pipe
2025-10-15T10:56:12.388592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400617705995444:4089]
2025-10-15T10:56:12.388604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400617705995444:4089]
2025-10-15T10:56:12.388616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400617705995444:4089]
2025-10-15T10:56:12.388646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:12.388679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:12.388710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:12.388718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:12.388730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:12.388869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:12.388893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:12.388995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400617705995444:4089]
2025-10-15T10:56:12.389030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:12.389131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:12.391490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 214
2025-10-15T10:56:12.391584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 214, pipe: [1:7561400614906290759:4202]
2025-10-15T10:56:12.391663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 214
2025-10-15T10:56:12.391891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:12.391921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:12.391981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:12.392021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:12.392042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:12.392052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:12.392082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:12.392122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:12.392165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:12.392604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:12.392625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:12.392676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:12.392948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 215 partition: 0 MaxSeqNo: 46 sessionId: src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0
2025-10-15T10:56:12.393642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c49537-5005f29-f476a82a-d5e820a9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:12.414896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0] Write session: try to update token
2025-10-15T10:56:12.414960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:12.469353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:12.469392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:12.469433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400617705995444:4089]
2025-10-15T10:56:12.469564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:12.469595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:12.472926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:12.475225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:12.480001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:12.481827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:12.484775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:12.485415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:12.485931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:12.485953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:12.485975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:12.502272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId: src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:12.523915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:12.529397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:12.529441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:12.529461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:12.529473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:12.529519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400617705995444:4089]
2025-10-15T10:56:12.529548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400617705995444:4089]
2025-10-15T10:56:12.529573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400617705995444:4089]
2025-10-15T10:56:12.529709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:12.529760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:12.529791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:12.529791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:12.529819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:12.529865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:12.529904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:12.530922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:12.672244Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:12.674954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:12.675118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400614906290759:4202]
2025-10-15T10:56:12.675111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:12.675201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:12.675220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:12.711118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 215 reason: error at write: Disconnected sessionId: src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0
2025-10-15T10:56:12.711508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 215 sessionId: src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0 is DEAD
2025-10-15T10:56:12.711837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:12.711908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0] Write session will restart in 0.008532s
2025-10-15T10:56:12.712058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0] Write session: Do CDS request
2025-10-15T10:56:12.712102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:12.725584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:12.725633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 216
2025-10-15T10:56:12.725866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:12.726550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:12.726731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:12.726772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:12.726788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:12.728469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 216 sessionId:  describe result for acl check
2025-10-15T10:56:12.728569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:12.728583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:12.728591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:12.728607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400614906290841:4383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:12.731019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400614906290841:4383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:12.739229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400614906290841:4383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:12.748305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400614906290841:4383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:12.748351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400614906290841:4383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:12.748368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400614906290841:4383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:12.748396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:12.758844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:12.762741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:12.763487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:12.763511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:12.763554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:12.763777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:12.763919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400617705995759:4101]
2025-10-15T10:56:12.765619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:12.766525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:12.766733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:12.767918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:12.768193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.768206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.768213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.768220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.768226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.768232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.768239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.768246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.768253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.768260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.768267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.768273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.768280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.768286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.768325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.768421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.768465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.768504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.768542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.768604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.768648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.768707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.768752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.768792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.768830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.768871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.768909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.768949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.768989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.769049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:12.769105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.769156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:12.769194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.769251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:12.769305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.769344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:12.769378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.769430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:12.769461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.769500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:12.769544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.769581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:12.769614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.769662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:12.769700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.769733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:12.769761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.769795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:12.769823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.769859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:12.769897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.769929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.769957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.770005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.770034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.770071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.770466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:12.775296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400614906291044:4202]
2025-10-15T10:56:12.819377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:12.828681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:12.828728Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:12.828748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:12.828770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:12.828799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 215 [2:7561400617705995759:4101]
2025-10-15T10:56:12.828855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:12.828921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:12.828937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:12.828951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:12.828963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:12.829011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:12.829034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:12.829057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:12.829993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.830020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.830035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.830050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:12.830329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:12.830354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:12.830506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:12.830610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 215
2025-10-15T10:56:12.830721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:12.830627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 215
2025-10-15T10:56:12.830717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 215, pipe: [1:7561400614906291044:4202]
2025-10-15T10:56:12.830972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:12.831062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400614906290771:2467], now have 1 active actors on pipe
2025-10-15T10:56:12.831091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400614906291003:4383], now have 1 active actors on pipe
2025-10-15T10:56:12.831116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400614906291044:4202], now have 1 active actors on pipe
2025-10-15T10:56:12.831190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:12.831218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:12.831255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400617705995754:4101]
2025-10-15T10:56:12.831281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400617705995754:4101]
2025-10-15T10:56:12.831294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400617705995754:4101]
2025-10-15T10:56:12.831334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:12.831399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:12.831427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:12.831434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:12.831440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:12.831629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:12.831652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:12.831722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:12.831759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:12.831777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:12.831788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:12.831823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:12.831861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:12.831981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400617705995754:4101]
2025-10-15T10:56:12.832014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:12.832032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:12.832060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:12.832781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:12.832804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:12.832872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:12.833211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 216 partition: 0 MaxSeqNo: 46 sessionId: src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0
2025-10-15T10:56:12.834038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|262a838c-188c5e7a-8d7b5846-6b2dfb78_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:12.854024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0] Write session: try to update token
2025-10-15T10:56:12.854089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:12.924041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:12.924084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:12.924101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:12.924112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:12.924153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400617705995754:4101]
2025-10-15T10:56:12.924181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400617705995754:4101]
2025-10-15T10:56:12.924206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400617705995754:4101]
2025-10-15T10:56:12.924337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:12.924374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:12.924407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:12.924481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:12.924512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:12.925784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:12.926250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId: src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:12.946971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:13.068114Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:13.076547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:13.076590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:13.076644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:13.076654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:13.076687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400617705995754:4101]
2025-10-15T10:56:13.076884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:13.077194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:13.077257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:13.077267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:13.077279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:13.077487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400614906291044:4202]
2025-10-15T10:56:13.149708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:13.153325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:13.154103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:13.154130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:13.154183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:13.154472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:13.154667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400622000963325:4106]
2025-10-15T10:56:13.156396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:13.157726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:13.158091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:13.160213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:13.160461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 216 reason: error at write: Disconnected sessionId: src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0
2025-10-15T10:56:13.160513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.160531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.160537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.160544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.160550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.160556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.160562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.160568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.160574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.160579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.160586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.160592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.160597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.160603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.160645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.160741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.160784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.160745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 216 sessionId: src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0 is DEAD
2025-10-15T10:56:13.160828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.160880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.160931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.161065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.161179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.161297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.161413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.161518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.161654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.161761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.161833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.161884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.161993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.162142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.162260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.162361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.162464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.162552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.162658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.162749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.162862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.162963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.163092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.163208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.163291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.163341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.163429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.163479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.163530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.163586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.163648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.163710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.163771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.163812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:13.163817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.163848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0] Write session will restart in 0.005493s
2025-10-15T10:56:13.163869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.163915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.163951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0] Write session: Do CDS request
2025-10-15T10:56:13.163980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:13.163968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.164013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.164067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.164510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:13.173654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:13.173703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 217
2025-10-15T10:56:13.174079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:13.175076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:13.175374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:13.175422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:13.175461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:13.177811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 217 sessionId:  describe result for acl check
2025-10-15T10:56:13.177982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:13.178016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:13.178038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:13.178072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400619201258611:4389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:13.178189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400619201258612:4202]
2025-10-15T10:56:13.180811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400619201258611:4389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:13.182988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:13.186259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400619201258611:4389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:13.192797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:13.192833Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:13.192844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:13.192859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:13.192878Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 216 [2:7561400622000963325:4106]
2025-10-15T10:56:13.192925Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:13.192982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:13.192996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:13.193008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:13.193020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:13.193016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400619201258611:4389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:13.193068Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:13.193090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:13.193053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400619201258611:4389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:13.193107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:13.193064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400619201258611:4389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:13.193085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:13.204527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.204555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.204567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.204578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:13.204823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:13.204843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.204944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.205104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.205156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 216
2025-10-15T10:56:13.205242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 216, pipe: [1:7561400619201258612:4202]
2025-10-15T10:56:13.205243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 216
2025-10-15T10:56:13.205249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:13.205321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400619201258359:2467], now have 1 active actors on pipe
2025-10-15T10:56:13.205347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400619201258641:4389], now have 1 active actors on pipe
2025-10-15T10:56:13.205370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400619201258612:4202], now have 1 active actors on pipe
2025-10-15T10:56:13.205403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400622000963318:4106]
2025-10-15T10:56:13.205412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400622000963318:4106]
2025-10-15T10:56:13.205422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400622000963318:4106]
2025-10-15T10:56:13.205459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:13.205511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:13.205534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:13.205538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:13.205546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:13.205558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:13.205602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:13.205767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:13.205793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:13.205929Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:13.205958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:13.205976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:13.205987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:13.206024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:13.206064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:13.206105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400622000963318:4106]
2025-10-15T10:56:13.206138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:13.206169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:13.206222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:13.206625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:13.206652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:13.206712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:13.207020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 217 partition: 0 MaxSeqNo: 46 sessionId: src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0
2025-10-15T10:56:13.207804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7884fa1-b37e5537-6bba52eb-fe060540_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:13.228653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0] Write session: try to update token
2025-10-15T10:56:13.228716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:13.283077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:13.283122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:13.283141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:13.283154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:13.283209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400622000963318:4106]
2025-10-15T10:56:13.283247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400622000963318:4106]
2025-10-15T10:56:13.283285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400622000963318:4106]
2025-10-15T10:56:13.283474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:13.283525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:13.283576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:13.283625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:13.283672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:13.285105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:13.299206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId: src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:13.320111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:13.429653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:13.438552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:13.438600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:13.438653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:13.438663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:13.438691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400622000963318:4106]
2025-10-15T10:56:13.438866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:13.439153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:13.439235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:13.439312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:13.439325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:13.439453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400619201258612:4202]
2025-10-15T10:56:13.470925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 217 reason: error at write: Disconnected sessionId: src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0
2025-10-15T10:56:13.471331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 217 sessionId: src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0 is DEAD
2025-10-15T10:56:13.471705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:13.471771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0] Write session will restart in 0.008091s
2025-10-15T10:56:13.471890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0] Write session: Do CDS request
2025-10-15T10:56:13.471922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:13.484532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:13.484575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 218
2025-10-15T10:56:13.484716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:13.485431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:13.485691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:13.485742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:13.485757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:13.487632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 218 sessionId:  describe result for acl check
2025-10-15T10:56:13.487810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:13.487839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:13.487857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:13.487884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400619201258674:4393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:13.490865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400619201258674:4393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:13.498915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400619201258674:4393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:13.508395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400619201258674:4393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:13.508441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400619201258674:4393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:13.508458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400619201258674:4393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:13.508491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:13.522619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:13.526817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:13.527630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:13.527657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:13.527694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:13.527923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:13.528105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400622000963597:4108]
2025-10-15T10:56:13.530186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:13.531057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:13.531285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:13.532637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:13.532961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.532977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.532984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.532990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.532997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.533002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.533009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.533016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.533022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.533028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.533035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.533043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.533051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.533058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.533098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.533212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.533303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.533425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.533476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.533523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.533592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.533644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.533690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.533743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.533793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.533853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.533910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.533958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.534004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.534070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.534130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.534210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.534308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.534403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.534453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.534503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.534568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.534609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.534645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.534683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.534720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.534773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.534806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.534844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.534883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.534926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.534966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.535000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.535043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.535084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.535118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.535150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.535289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.535436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.535494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.535542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.536015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:13.539709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400619201258918:4202]
2025-10-15T10:56:13.572979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:13.581759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:13.581800Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:13.581816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:13.581834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:13.581853Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 217 [2:7561400622000963597:4108]
2025-10-15T10:56:13.581890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:13.581936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:13.581947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:13.581958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:13.581965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:13.582011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:13.582031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:13.582051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:13.583127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.583153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.583167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.583179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:13.583500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:13.583526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.583655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.583806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.583841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 217, pipe: [1:7561400619201258918:4202]
2025-10-15T10:56:13.583860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 217
2025-10-15T10:56:13.583970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 217
2025-10-15T10:56:13.583960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:13.584039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400619201258836:4393], now have 1 active actors on pipe
2025-10-15T10:56:13.584060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400619201258918:4202], now have 1 active actors on pipe
2025-10-15T10:56:13.584073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400619201258648:2467], now have 1 active actors on pipe
2025-10-15T10:56:13.584090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400622000963592:4108]
2025-10-15T10:56:13.584098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400622000963592:4108]
2025-10-15T10:56:13.584106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400622000963592:4108]
2025-10-15T10:56:13.584130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:13.584163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:13.584179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:13.584189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:13.584190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:13.584202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:13.584227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:13.584374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:13.584392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:13.584526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11f6211-dd58c418-897e4037-3b71a7eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:13.584563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:13.584581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:13.584593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:13.584625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:13.584655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:13.584691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400622000963592:4108]
2025-10-15T10:56:13.584727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:13.584779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:13.584820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:13.585296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:13.585326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:13.585390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:13.585793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 218 partition: 0 MaxSeqNo: 46 sessionId: src_id|11f6211-dd58c418-897e4037-3b71a7eb_0
2025-10-15T10:56:13.586576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7583aa03-c5cbbb5-71c36f6b-4a59d60c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|11f6211-dd58c418-897e4037-3b71a7eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:13.606750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11f6211-dd58c418-897e4037-3b71a7eb_0] Write session: try to update token
2025-10-15T10:56:13.606821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11f6211-dd58c418-897e4037-3b71a7eb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:13.641424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:13.641483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:13.641510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:13.641532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:13.641578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400622000963592:4108]
2025-10-15T10:56:13.641634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400622000963592:4108]
2025-10-15T10:56:13.641690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400622000963592:4108]
2025-10-15T10:56:13.641871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:13.641955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:13.641994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:13.642032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:13.642033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:13.652500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:13.689942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId: src_id|11f6211-dd58c418-897e4037-3b71a7eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:13.711509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:13.797262Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:13.813330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:13.813382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:13.813446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:13.813462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:13.813501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400622000963592:4108]
2025-10-15T10:56:13.813691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:13.813934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:13.813962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:13.814091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:13.829065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:13.829289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400619201258918:4202]
2025-10-15T10:56:13.829407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 218 reason: error at write: Disconnected sessionId: src_id|11f6211-dd58c418-897e4037-3b71a7eb_0
2025-10-15T10:56:13.829867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 218 sessionId: src_id|11f6211-dd58c418-897e4037-3b71a7eb_0 is DEAD
2025-10-15T10:56:13.830281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f6211-dd58c418-897e4037-3b71a7eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:13.830333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f6211-dd58c418-897e4037-3b71a7eb_0] Write session will restart in 0.008436s
2025-10-15T10:56:13.830499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f6211-dd58c418-897e4037-3b71a7eb_0] Write session: Do CDS request
2025-10-15T10:56:13.830544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f6211-dd58c418-897e4037-3b71a7eb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:13.844674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11f6211-dd58c418-897e4037-3b71a7eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:13.846715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:13.846745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 219
2025-10-15T10:56:13.847059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:13.847206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:13.847227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:13.847238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:13.848587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 219 sessionId:  describe result for acl check
2025-10-15T10:56:13.848696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:13.848717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:13.848726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:13.848745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400619201258964:4406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:13.851593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400619201258964:4406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:13.858058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400619201258964:4406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:13.867624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400619201258964:4406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:13.867669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400619201258964:4406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:13.867686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400619201258964:4406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:13.867717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:13.908721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:13.912861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:13.913664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:13.913695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:13.913737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:13.913983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:13.914167Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400622000963898:4118]
2025-10-15T10:56:13.916336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:13.917243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:13.917464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:13.918662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:13.919003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.919018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.919026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.919034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.919040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.919047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.919054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.919060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.919067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.919073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.919081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.919087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.919094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.919102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.919147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.919254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.919326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.919393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.919437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.919486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.919533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.919579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.919624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.919672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.919721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.919767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.919814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.919862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.919909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.919980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:13.920046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.920110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:13.920186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.920253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:13.920306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.920363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:13.920417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.920475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:13.920525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.920582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:13.920636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.920692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:13.920756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.920812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:13.920862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.920920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:13.920973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.921036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:13.921088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.921143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:13.921192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.921249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.921294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.921350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.921397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.921451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.921969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:13.929313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400619201259220:4202]
2025-10-15T10:56:13.938439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:13.949161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:13.949204Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:13.949220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:13.949241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:13.949264Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 218 [2:7561400622000963898:4118]
2025-10-15T10:56:13.949316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:13.949371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:13.949385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:13.949397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:13.949408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:13.949459Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:13.949482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:13.949505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:13.951670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.951697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.951708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.951720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:13.951974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:13.951991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:13.952126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:13.952312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:13.952533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:13.952626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400619201259037:4406], now have 1 active actors on pipe
2025-10-15T10:56:13.952652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400619201259220:4202], now have 1 active actors on pipe
2025-10-15T10:56:13.952671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400619201258956:2467], now have 1 active actors on pipe
2025-10-15T10:56:13.952695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400622000963893:4118]
2025-10-15T10:56:13.952712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400622000963893:4118]
2025-10-15T10:56:13.952724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400622000963893:4118]
2025-10-15T10:56:13.952763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:13.952844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:13.953019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:13.953043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:13.953166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400622000963893:4118]
2025-10-15T10:56:13.953189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:13.953340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:13.953359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:13.953369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:13.953389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:13.954626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 218
2025-10-15T10:56:13.954722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 218, pipe: [1:7561400619201259220:4202]
2025-10-15T10:56:13.954795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 218
2025-10-15T10:56:13.954852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:13.954885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:13.954956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:13.954995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:13.955018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:13.955028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:13.955073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:13.955125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:13.955198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:13.955838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:13.955865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:13.955930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:13.959703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 219 partition: 0 MaxSeqNo: 46 sessionId: src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0
2025-10-15T10:56:13.960654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f6211-dd58c418-897e4037-3b71a7eb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:13.981390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0] Write session: try to update token
2025-10-15T10:56:13.981448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:14.021335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:14.021379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:14.021394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:14.021405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:14.022403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400622000963893:4118]
2025-10-15T10:56:14.022441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400622000963893:4118]
2025-10-15T10:56:14.022460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400622000963893:4118]
2025-10-15T10:56:14.022574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:14.022619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:14.022660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:14.022663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:14.022701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:14.025724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:14.063000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId: src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:14.091246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:14.177768Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:14.179316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:14.179374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:14.180691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:14.180729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400619201259220:4202]
2025-10-15T10:56:14.180739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:14.180825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:14.189644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 219 reason: error at write: Disconnected sessionId: src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0
2025-10-15T10:56:14.189958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 219 sessionId: src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0 is DEAD
2025-10-15T10:56:14.190350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:14.190419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0] Write session will restart in 0.009346s
2025-10-15T10:56:14.190598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0] Write session: Do CDS request
2025-10-15T10:56:14.190649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:14.193539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:14.204391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:14.204419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 220
2025-10-15T10:56:14.204513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:14.205121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:14.205224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:14.205242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:14.205251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:14.206274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 220 sessionId:  describe result for acl check
2025-10-15T10:56:14.206363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:14.206381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:14.206389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:14.206402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400623496226572:4417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:14.208480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400623496226572:4417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:14.217483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400623496226572:4417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:14.232029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400623496226572:4417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:14.232083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400623496226572:4417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:14.232100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400623496226572:4417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:14.232139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:14.264067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:14.268310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:14.269234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:14.269259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:14.269299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:14.269551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:14.269718Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400626295931494:4127]
2025-10-15T10:56:14.271625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:14.272637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:14.272868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:14.273886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:14.274133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:14.274145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:14.274150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:14.274155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:14.274160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:14.274164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:14.274168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:14.274172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:14.274177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:14.274181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:14.274185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:14.274190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.274195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.274200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.274235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:14.274321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:14.274357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:14.274390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:14.274425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:14.274464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:14.274506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:14.274545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:14.274581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:14.274617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:14.274653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:14.274691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.274734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.274781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.274817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:14.274868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:14.274913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:14.274962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:14.275004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:14.275045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:14.275080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:14.275123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:14.275158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:14.275200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:14.275231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:14.275275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:14.275327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:14.275400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:14.275437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:14.275480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:14.275515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:14.275572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:14.275609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:14.275651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:14.275686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:14.275727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:14.275761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.275802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.275846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.275890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.275921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.275964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.276366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:14.281064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400623496226823:4202]
2025-10-15T10:56:14.291514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:14.309589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:14.309627Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:14.309639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:14.309654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:14.309678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 219 [2:7561400626295931494:4127]
2025-10-15T10:56:14.309735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:14.309799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:14.309814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:14.309827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:14.309840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:14.309893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:14.309918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:14.309950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:14.310887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.310904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.310915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.310927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:14.311151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:14.311169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.311286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.311453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.311487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 219, pipe: [1:7561400623496226823:4202]
2025-10-15T10:56:14.311497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 219
2025-10-15T10:56:14.311592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 219
2025-10-15T10:56:14.311667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:14.311729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400623496226823:4202], now have 1 active actors on pipe
2025-10-15T10:56:14.311749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400623496226636:4417], now have 1 active actors on pipe
2025-10-15T10:56:14.311762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400623496226557:2467], now have 1 active actors on pipe
2025-10-15T10:56:14.311797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:14.311812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:14.311845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400626295931489:4127]
2025-10-15T10:56:14.311865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400626295931489:4127]
2025-10-15T10:56:14.311878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400626295931489:4127]
2025-10-15T10:56:14.311912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:14.311956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:14.311971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:14.311978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:14.311992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:14.312110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:14.312128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:14.312182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:14.312204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:14.312216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:14.312222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:14.312248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:14.312276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:14.312374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400626295931489:4127]
2025-10-15T10:56:14.312394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:14.312413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:14.312425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:14.312807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:14.312826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:14.312877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:14.313196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 220 partition: 0 MaxSeqNo: 46 sessionId: src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0
2025-10-15T10:56:14.313881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44031605-ace70a9-18aa1dab-bd7bacf8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:14.334038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0] Write session: try to update token
2025-10-15T10:56:14.334099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:14.341701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:14.341736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:14.341771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400626295931489:4127]
2025-10-15T10:56:14.341893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:14.341902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:14.344166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:14.345458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:14.346798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:14.348155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:14.349947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:14.350458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:14.401112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId: src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:14.435991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:14.437138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:14.437169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:14.437182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:14.437191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:14.437226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400626295931489:4127]
2025-10-15T10:56:14.437249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400626295931489:4127]
2025-10-15T10:56:14.437270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400626295931489:4127]
2025-10-15T10:56:14.437408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:14.437413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:14.437425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:14.437436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:14.437471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:14.437503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:14.437514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:14.437537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:14.437565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:14.437584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:14.438569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:14.574485Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:14.576296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400623496226823:4202]
2025-10-15T10:56:14.576394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:14.576407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:14.576433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:14.576481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:14.586386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 220 reason: error at write: Disconnected sessionId: src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0
2025-10-15T10:56:14.586753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 220 sessionId: src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0 is DEAD
2025-10-15T10:56:14.587756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:14.587819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0] Write session will restart in 0.005485s
2025-10-15T10:56:14.587960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0] Write session: Do CDS request
2025-10-15T10:56:14.588004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:14.598618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:14.598660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 221
2025-10-15T10:56:14.598847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:14.599367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:14.599507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:14.599529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:14.599539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:14.600880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 221 sessionId:  describe result for acl check
2025-10-15T10:56:14.600997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:14.601015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:14.601033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:14.601054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400623496226848:4421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:14.603866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400623496226848:4421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:14.609801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400623496226848:4421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:14.616534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400623496226848:4421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:14.616572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400623496226848:4421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:14.616588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400623496226848:4421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:14.616614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:14.660619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:14.664040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:14.664818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:14.664845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:14.664883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:14.665105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:14.665281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400626295931769:4129]
2025-10-15T10:56:14.667410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:14.668229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:14.668413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:14.669545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:14.669868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:14.669884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:14.669890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:14.669896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:14.669902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:14.669909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:14.669916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:14.669922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:14.669928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:14.669933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:14.669940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:14.669945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.669952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.669958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.670000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:14.670155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:14.670204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:14.670246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:14.670307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:14.670351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:14.670393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:14.670440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:14.670489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:14.670536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:14.670583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:14.670628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.670673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.670721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.670757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:14.670822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:14.670878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:14.670930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:14.670994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:14.671046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:14.671091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:14.671143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:14.671206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:14.671265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:14.671335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:14.671427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:14.671477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:14.671538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:14.671603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:14.671658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:14.671714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:14.671782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:14.671834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:14.671894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:14.671961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:14.672020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:14.672089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.672152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.672198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.672244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.672289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.672340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.672808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:14.676347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400623496227104:4202]
2025-10-15T10:56:14.688673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:14.698478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:14.698518Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:14.698536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:14.698553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:14.698576Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 220 [2:7561400626295931769:4129]
2025-10-15T10:56:14.698625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:14.698677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:14.698690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:14.698701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:14.698713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:14.698754Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:14.698774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:14.698794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:14.699827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.699849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.699863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.699874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:14.700139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:14.700164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:14.700289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:14.700448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 220, pipe: [1:7561400623496227104:4202]
2025-10-15T10:56:14.700467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:14.700536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 220
2025-10-15T10:56:14.700547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 220
2025-10-15T10:56:14.700691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:14.700770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400623496227104:4202], now have 1 active actors on pipe
2025-10-15T10:56:14.700803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400623496226834:2467], now have 1 active actors on pipe
2025-10-15T10:56:14.700824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400623496226882:4421], now have 1 active actors on pipe
2025-10-15T10:56:14.700866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:14.700891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:14.700941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400626295931763:4129]
2025-10-15T10:56:14.700958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400626295931763:4129]
2025-10-15T10:56:14.700972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400626295931763:4129]
2025-10-15T10:56:14.701007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:14.701039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:14.701052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:14.701062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:14.701072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:14.701234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:14.701258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:14.701311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:14.701340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:14.701361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:14.701369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:14.701398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:14.701429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:14.701547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400626295931763:4129]
2025-10-15T10:56:14.701578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:14.701600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:14.701618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:14.701965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:14.701988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:14.702039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:14.702258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 221 partition: 0 MaxSeqNo: 46 sessionId: src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0
2025-10-15T10:56:14.703064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc1a48d-1e506823-820c9232-ee86dc44_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:14.724084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0] Write session: try to update token
2025-10-15T10:56:14.724142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:14.750817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:14.750844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:14.750873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400626295931763:4129]
2025-10-15T10:56:14.751003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:14.751008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:14.752809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:14.753995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:14.755219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:14.756449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:14.758530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:14.758964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:14.795030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:14.795068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:14.795085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:14.795098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:14.795140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400626295931763:4129]
2025-10-15T10:56:14.795170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400626295931763:4129]
2025-10-15T10:56:14.795207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400626295931763:4129]
2025-10-15T10:56:14.795381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:14.795391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:14.795416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:14.795443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:14.795479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:14.796509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:14.801006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId: src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:14.821238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:14.939393Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:14.941039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:14.941071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:14.941532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400623496227104:4202]
2025-10-15T10:56:14.941540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:14.941628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:14.941637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:14.941662Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:14.977493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 221 reason: error at write: Disconnected sessionId: src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0
2025-10-15T10:56:14.977865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 221 sessionId: src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0 is DEAD
2025-10-15T10:56:14.978329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:14.978392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0] Write session will restart in 0.006420s
2025-10-15T10:56:14.978571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0] Write session: Do CDS request
2025-10-15T10:56:14.978625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:14.989522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:14.989568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 222
2025-10-15T10:56:14.989635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:14.990298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:14.990454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:14.990483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:14.990492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:14.992504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 222 sessionId:  describe result for acl check
2025-10-15T10:56:14.992632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:14.992650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:14.992660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:14.992677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400623496227174:4425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:14.995509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400623496227174:4425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:15.004307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400623496227174:4425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:15.016848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400623496227174:4425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:15.016895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400623496227174:4425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:15.016911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400623496227174:4425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:15.016941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:15.029189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:15.033812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:15.034756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:15.034788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:15.034831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:15.035102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:15.035286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400630590899355:4133]
2025-10-15T10:56:15.037645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:15.038615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:15.038808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:15.040044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:15.040368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.040380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.040386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.040391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.040400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.040407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.040416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.040423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.040429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.040434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.040439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.040444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.040449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.040454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.040502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.040613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.040655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.040693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.040731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.040782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.040835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.040874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.040917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.040957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.041005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.041062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.041113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.041165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.041208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.041286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.041356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.041424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.041485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.041549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.041607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.041675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.041732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.041796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.041850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.041915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.041969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.042031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.042084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.042147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.042207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.042269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.042323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.042388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.042445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.042512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.042566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.042628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.042676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.042733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.042789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.042849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.043316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:15.047516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400627791194687:4202]
2025-10-15T10:56:15.064866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:15.076100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:15.076150Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:15.076169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:15.076192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:15.076213Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 221 [2:7561400630590899355:4133]
2025-10-15T10:56:15.076262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:15.076327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:15.076343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:15.076357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:15.076370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:15.076423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:15.076444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:15.076465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:15.077531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.077557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.077572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.077584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:15.077865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:15.077892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.078068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.078176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 221
2025-10-15T10:56:15.078183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 221
2025-10-15T10:56:15.078267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 221, pipe: [1:7561400627791194687:4202]
2025-10-15T10:56:15.078300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.078515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:15.078603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400627791194638:4425], now have 1 active actors on pipe
2025-10-15T10:56:15.078625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400623496227118:2467], now have 1 active actors on pipe
2025-10-15T10:56:15.078640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400627791194687:4202], now have 1 active actors on pipe
2025-10-15T10:56:15.078700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:15.078731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:15.078763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400630590899349:4133]
2025-10-15T10:56:15.078773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400630590899349:4133]
2025-10-15T10:56:15.078783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400630590899349:4133]
2025-10-15T10:56:15.078810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:15.078857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:15.078864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:15.078872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:15.078884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:15.079011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:15.079030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:15.079079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:15.079106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:15.079119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:15.079126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:15.079153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:15.079187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:15.079336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400630590899349:4133]
2025-10-15T10:56:15.079387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:15.079436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:15.079438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:15.079937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:15.079961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:15.080015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:15.080281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 222 partition: 0 MaxSeqNo: 46 sessionId: src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0
2025-10-15T10:56:15.081089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95d8b42a-56d92673-a5c157ad-ee902e2d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:15.105776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0] Write session: try to update token
2025-10-15T10:56:15.105826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:15.134151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:15.134183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:15.134215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400630590899349:4133]
2025-10-15T10:56:15.134300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:15.134328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:15.137875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:15.139624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:15.141361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:15.143137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:15.145471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:15.146171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:15.194337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:15.194380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:15.194394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:15.194453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:15.194472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:15.194486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:15.194497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:15.194551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400630590899349:4133]
2025-10-15T10:56:15.194579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400630590899349:4133]
2025-10-15T10:56:15.194603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400630590899349:4133]
2025-10-15T10:56:15.194741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:15.194759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:15.194777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:15.194781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:15.194796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:15.197223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:15.216149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId: src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:15.242904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:15.343774Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:15.346996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:15.347042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:15.347621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:15.347781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400627791194687:4202]
2025-10-15T10:56:15.347771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:15.347862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:15.347878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:15.367180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 222 reason: error at write: Disconnected sessionId: src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0
2025-10-15T10:56:15.367590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 222 sessionId: src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0 is DEAD
2025-10-15T10:56:15.367957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:15.368004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0] Write session will restart in 0.005147s
2025-10-15T10:56:15.368160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0] Write session: Do CDS request
2025-10-15T10:56:15.368209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:15.388456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:15.395717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:15.395749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 223
2025-10-15T10:56:15.396079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:15.396189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:15.396198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:15.396206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:15.397292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 223 sessionId:  describe result for acl check
2025-10-15T10:56:15.397366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:15.397375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:15.397381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:15.397398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400627791194737:4437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:15.399995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400627791194737:4437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:15.405775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400627791194737:4437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:15.412968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400627791194737:4437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:15.413029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400627791194737:4437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:15.413047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400627791194737:4437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:15.413079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:15.447898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400627791194989:4202]
2025-10-15T10:56:15.450030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:15.453893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:15.454950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:15.454979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:15.455021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:15.455292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:15.455506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400630590899645:4141]
2025-10-15T10:56:15.457600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:15.460849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:15.461110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:15.462454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:15.462803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.462820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.462827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.462835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.462843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.462850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.462856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.462864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.462872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.462878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.462887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.462893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.462900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.462908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.462961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.463069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.463121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.463185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.463240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.463290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.463373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.463427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.463481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.463541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.463598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.463656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.463707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.463762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.463816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.463890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.463955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.464012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.464072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.464135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.464189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.464248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.464307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.464371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.464422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.464483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.464530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.464590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.464642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.464700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.464751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.464814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.464871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.464934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.464981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.465042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.465095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.465157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.465209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.465274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.465326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.465384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.465906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:15.492338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:15.501516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:15.501565Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:15.501581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:15.501596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:15.501615Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 222 [2:7561400630590899645:4141]
2025-10-15T10:56:15.501658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:15.501708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:15.501722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:15.501733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:15.501741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:15.501778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:15.501794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:15.501811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:15.503458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.503478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.503489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.503500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:15.503748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:15.503775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.503908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.504075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.504105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 222
2025-10-15T10:56:15.504217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 222, pipe: [1:7561400627791194989:4202]
2025-10-15T10:56:15.504237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:15.504294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400627791194723:2467], now have 1 active actors on pipe
2025-10-15T10:56:15.504314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400627791194989:4202], now have 1 active actors on pipe
2025-10-15T10:56:15.504301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 222
2025-10-15T10:56:15.504327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400627791194774:4437], now have 1 active actors on pipe
2025-10-15T10:56:15.504358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400630590899640:4141]
2025-10-15T10:56:15.504373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400630590899640:4141]
2025-10-15T10:56:15.504385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400630590899640:4141]
2025-10-15T10:56:15.504417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:15.504442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:15.504457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:15.504468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:15.504484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:15.504609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:15.504624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:15.504665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:15.504682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:15.504766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400630590899640:4141]
2025-10-15T10:56:15.504785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:15.504801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:15.504832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|231e524c-ea724158-2931fd70-57cb86fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:15.504855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:15.504868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:15.504874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:15.504906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:15.504944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:15.505050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:15.505415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:15.505438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:15.505501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:15.505785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 223 partition: 0 MaxSeqNo: 46 sessionId: src_id|231e524c-ea724158-2931fd70-57cb86fa_0
2025-10-15T10:56:15.506586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2d3e59-598b7f04-51b5c6fa-594e992a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|231e524c-ea724158-2931fd70-57cb86fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:15.527369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231e524c-ea724158-2931fd70-57cb86fa_0] Write session: try to update token
2025-10-15T10:56:15.527427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231e524c-ea724158-2931fd70-57cb86fa_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:15.539125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:15.539157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:15.539196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400630590899640:4141]
2025-10-15T10:56:15.539335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:15.539368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:15.541443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:15.543627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:15.545171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:15.546840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:15.568385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:15.568774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:15.618382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:15.618964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:15.618984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:15.619059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:15.619074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:15.619091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:15.619103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:15.619146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400630590899640:4141]
2025-10-15T10:56:15.619175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400630590899640:4141]
2025-10-15T10:56:15.619208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400630590899640:4141]
2025-10-15T10:56:15.619390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:15.619418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:15.621331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:15.621378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:15.621410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:15.621449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:15.655677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId: src_id|231e524c-ea724158-2931fd70-57cb86fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:15.676430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:15.764548Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:15.805887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:15.805935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:15.806563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400627791194989:4202]
2025-10-15T10:56:15.806572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:15.806628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:15.806588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:15.806666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:15.816903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 223 reason: error at write: Disconnected sessionId: src_id|231e524c-ea724158-2931fd70-57cb86fa_0
2025-10-15T10:56:15.817204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 223 sessionId: src_id|231e524c-ea724158-2931fd70-57cb86fa_0 is DEAD
2025-10-15T10:56:15.817660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e524c-ea724158-2931fd70-57cb86fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:15.817727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e524c-ea724158-2931fd70-57cb86fa_0] Write session will restart in 0.006249s
2025-10-15T10:56:15.817896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e524c-ea724158-2931fd70-57cb86fa_0] Write session: Do CDS request
2025-10-15T10:56:15.817945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e524c-ea724158-2931fd70-57cb86fa_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:15.828751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:15.828821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|231e524c-ea724158-2931fd70-57cb86fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:15.828782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 224
2025-10-15T10:56:15.829347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:15.829500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:15.829524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:15.829532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:15.830816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 224 sessionId:  describe result for acl check
2025-10-15T10:56:15.830927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:15.830944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:15.830954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:15.830969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400627791195035:4444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:15.833482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400627791195035:4444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:15.840551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400627791195035:4444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:15.848611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400627791195035:4444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:15.848650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400627791195035:4444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:15.848666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400627791195035:4444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:15.848694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:15.885621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:15.889147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:15.889721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:15.889751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:15.889779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:15.889930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:15.890062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400630590899960:4151]
2025-10-15T10:56:15.891418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:15.892240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:15.892384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:15.893453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:15.893691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.893703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.893706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.893710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.893714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.893718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.893724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.893730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.893735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.893741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.893748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.893754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.893761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.893767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.893800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.893892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.893924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.893955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.893992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.894036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.894078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.894122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.894162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.894207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.894255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.894305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.894356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.894404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.894445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.894509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:15.894569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.894622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:15.894673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.894728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:15.894777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.894832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:15.894877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.894910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:15.894937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.894975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:15.895005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.895041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:15.895073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.895112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:15.895148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.895186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:15.895215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.895254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:15.895287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.895337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:15.895391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.895431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.895460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.895493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.895523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.895557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.895894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:15.906674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400627791195296:4202]
2025-10-15T10:56:15.928924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:15.937415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:15.937467Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:15.937485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:15.937503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:15.937533Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 223 [2:7561400630590899960:4151]
2025-10-15T10:56:15.937593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:15.937651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:15.937666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:15.937679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:15.937690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:15.937739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:15.937760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:15.937780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:15.938861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.938887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.938902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.938913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:15.939197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:15.939226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:15.939383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:15.939583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:15.939561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 223, pipe: [1:7561400627791195296:4202]
2025-10-15T10:56:15.939588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 223
2025-10-15T10:56:15.939708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 223
2025-10-15T10:56:15.939819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:15.939900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400627791195019:2467], now have 1 active actors on pipe
2025-10-15T10:56:15.939930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400627791195296:4202], now have 1 active actors on pipe
2025-10-15T10:56:15.939954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400627791195066:4444], now have 1 active actors on pipe
2025-10-15T10:56:15.940021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:15.940048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:15.940081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400630590899955:4151]
2025-10-15T10:56:15.940094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400630590899955:4151]
2025-10-15T10:56:15.940107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400630590899955:4151]
2025-10-15T10:56:15.940143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:15.940202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:15.940209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:15.940226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:15.940237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:15.940376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:15.940400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:15.940456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0beb375-3cfa624d-f295534a-7617f21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:15.940483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:15.940500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:15.940510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:15.940541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:15.940577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:15.940710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400630590899955:4151]
2025-10-15T10:56:15.940748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:15.940773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:15.940789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:15.941236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:15.941260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:15.941331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:15.941582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 224 partition: 0 MaxSeqNo: 46 sessionId: src_id|e0beb375-3cfa624d-f295534a-7617f21_0
2025-10-15T10:56:15.942276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|231e524c-ea724158-2931fd70-57cb86fa_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e0beb375-3cfa624d-f295534a-7617f21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:15.961030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0beb375-3cfa624d-f295534a-7617f21_0] Write session: try to update token
2025-10-15T10:56:15.961078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0beb375-3cfa624d-f295534a-7617f21_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:15.968319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:15.968354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:15.968398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400630590899955:4151]
2025-10-15T10:56:15.968536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:15.968557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:15.970253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:15.971742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:15.973071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:15.974375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:15.976087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:15.976664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:16.038263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:16.038295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:16.038329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:16.040194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId: src_id|e0beb375-3cfa624d-f295534a-7617f21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:16.062241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:16.070398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:16.070430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:16.070445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:16.070457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:16.070501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400630590899955:4151]
2025-10-15T10:56:16.070527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400630590899955:4151]
2025-10-15T10:56:16.070549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400630590899955:4151]
2025-10-15T10:56:16.070692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:16.070731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:16.070737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:16.070757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:16.070769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:16.070801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:16.070825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:16.071628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:16.217331Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:16.219624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:16.223574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:16.223907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400627791195296:4202]
2025-10-15T10:56:16.224064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:16.244630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 224 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0beb375-3cfa624d-f295534a-7617f21_0
2025-10-15T10:56:16.244993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 224 sessionId: src_id|e0beb375-3cfa624d-f295534a-7617f21_0 is DEAD
2025-10-15T10:56:16.247959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0beb375-3cfa624d-f295534a-7617f21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:16.248025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0beb375-3cfa624d-f295534a-7617f21_0] Write session will restart in 0.006919s
2025-10-15T10:56:16.248206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0beb375-3cfa624d-f295534a-7617f21_0] Write session: Do CDS request
2025-10-15T10:56:16.248271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0beb375-3cfa624d-f295534a-7617f21_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:16.260705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0beb375-3cfa624d-f295534a-7617f21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:16.263652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:16.263688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 225
2025-10-15T10:56:16.264222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:16.264386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:16.264405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:16.264417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:16.266086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 225 sessionId:  describe result for acl check
2025-10-15T10:56:16.266208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:16.266220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:16.266232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:16.266250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400632086162632:4450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:16.269433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400632086162632:4450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:16.281679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400632086162632:4450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:16.296607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400632086162632:4450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:16.296655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400632086162632:4450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:16.296673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400632086162632:4450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:16.296709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:16.325443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400632086162712:4202]
2025-10-15T10:56:16.394429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:16.399045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:16.399998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:16.400031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:16.400078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:16.400371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:16.400559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400634885867536:4154]
2025-10-15T10:56:16.402809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:16.403898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:16.404134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:16.405486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:16.405845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:16.405865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:16.405873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:16.405881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:16.405888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:16.405894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:16.405901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:16.405908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:16.405915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:16.405923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:16.405930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:16.405938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.405945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.405952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.406005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:16.406125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:16.406182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:16.406236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:16.406288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:16.406340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:16.406392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:16.406441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:16.406489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:16.406556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:16.406605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:16.406658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.406714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.406763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.406815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:16.406889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:16.406953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:16.407009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:16.407062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:16.407123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:16.407175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:16.407238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:16.407293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:16.407674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:16.407735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:16.407809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:16.407866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:16.407932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:16.407986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:16.408048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:16.408106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:16.408164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:16.408215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:16.408274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:16.408328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:16.408388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:16.408437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.408496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.408548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.408608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.408663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.408721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.409287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:16.434285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:16.443799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:16.443850Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:16.443871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:16.443893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:16.443925Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 224 [2:7561400634885867536:4154]
2025-10-15T10:56:16.443982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:16.444050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:16.444066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:16.444080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:16.444093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:16.444145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:16.444169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:16.444192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:16.445210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.445235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.445251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.445265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:16.445540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:16.445567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.445722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.445931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.446177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:16.446265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400632086162619:2467], now have 1 active actors on pipe
2025-10-15T10:56:16.446302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400632086162666:4450], now have 1 active actors on pipe
2025-10-15T10:56:16.446328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400632086162712:4202], now have 1 active actors on pipe
2025-10-15T10:56:16.446354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400634885867531:4154]
2025-10-15T10:56:16.446374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400634885867531:4154]
2025-10-15T10:56:16.446388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400634885867531:4154]
2025-10-15T10:56:16.446428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:16.446473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:16.446496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:16.446509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:16.446512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:16.446490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 224
2025-10-15T10:56:16.446610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 224
2025-10-15T10:56:16.446676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 224, pipe: [1:7561400632086162712:4202]
2025-10-15T10:56:16.446708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:16.446734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:16.446871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400634885867531:4154]
2025-10-15T10:56:16.446901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:16.446920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:16.447006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:16.447031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:16.447136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:16.447176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:16.447194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:16.447204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:16.447241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:16.447277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:16.447338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:16.449728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:16.449761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:16.449852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:16.450161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 225 partition: 0 MaxSeqNo: 46 sessionId: src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0
2025-10-15T10:56:16.450880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0beb375-3cfa624d-f295534a-7617f21_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:16.474699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0] Write session: try to update token
2025-10-15T10:56:16.474752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:16.559007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:16.559040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:16.559054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:16.559067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:16.559110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400634885867531:4154]
2025-10-15T10:56:16.559134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400634885867531:4154]
2025-10-15T10:56:16.559169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400634885867531:4154]
2025-10-15T10:56:16.559331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:16.559393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:16.559412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:16.559421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:16.559425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:16.559437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:16.559484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:16.559504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:16.561025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:16.570199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId: src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:16.591975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:16.699387Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:16.717379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:16.717422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:16.717490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:16.717504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:16.717540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400634885867531:4154]
2025-10-15T10:56:16.718126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:16.718287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400632086162712:4202]
2025-10-15T10:56:16.718365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:16.717743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:16.718102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:16.730507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 225 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0
2025-10-15T10:56:16.730884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 225 sessionId: src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0 is DEAD
2025-10-15T10:56:16.731259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:16.731333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0] Write session will restart in 0.008673s
2025-10-15T10:56:16.731508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0] Write session: Do CDS request
2025-10-15T10:56:16.731554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:16.745405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:16.757325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:16.757352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 226
2025-10-15T10:56:16.757744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:16.757889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:16.757911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:16.757922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:16.759175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 226 sessionId:  describe result for acl check
2025-10-15T10:56:16.759286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:16.759305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:16.759314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:16.759340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400632086162928:4460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:16.761904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400632086162928:4460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:16.767805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400632086162928:4460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:16.775457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400632086162928:4460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:16.775501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400632086162928:4460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:16.775518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400632086162928:4460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:16.775550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:16.818525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400632086163187:4202]
2025-10-15T10:56:16.819775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:16.823909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:16.824786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:16.824812Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:16.824854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:16.825105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:16.825308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400634885867840:4162]
2025-10-15T10:56:16.827233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:16.828203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:16.828422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:16.829808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:16.830167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:16.830183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:16.830191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:16.830198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:16.830205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:16.830213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:16.830220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:16.830226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:16.830233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:16.830240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:16.830247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:16.830254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.830261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.830269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.830316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:16.830431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:16.830483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:16.830531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:16.830576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:16.830624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:16.830680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:16.830725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:16.830770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:16.830830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:16.830882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:16.830935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.830987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.831030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.831078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:16.831148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:16.831213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:16.831276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:16.831340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:16.831423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:16.831475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:16.831537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:16.831584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:16.831636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:16.831682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:16.831735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:16.831785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:16.831841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:16.831887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:16.831944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:16.831994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:16.832047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:16.832094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:16.832147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:16.832194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:16.832248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:16.832293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.832343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.832390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.832441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.832484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.832537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.832961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:16.859558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:16.870151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:16.870200Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:16.870216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:16.870238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:16.870262Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 225 [2:7561400634885867840:4162]
2025-10-15T10:56:16.870314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:16.870379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:16.870393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:16.870405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:16.870417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:16.870469Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:16.870498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:16.870527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:16.872816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.872850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.872866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.872878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:16.873166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:16.873193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:16.873337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:16.873533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:16.873767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:16.873857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400634885867835:4162]
2025-10-15T10:56:16.873873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400634885867835:4162]
2025-10-15T10:56:16.873887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400634885867835:4162]
2025-10-15T10:56:16.873933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:16.874012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:16.874216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:16.874236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:16.874323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:16.874336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:16.874350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:16.874369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400634885867835:4162]
2025-10-15T10:56:16.874392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:16.874424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:16.874455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400632086163187:4202], now have 1 active actors on pipe
2025-10-15T10:56:16.874482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400632086162957:4460], now have 1 active actors on pipe
2025-10-15T10:56:16.874503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400632086162914:2467], now have 1 active actors on pipe
2025-10-15T10:56:16.874595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 225, pipe: [1:7561400632086163187:4202]
2025-10-15T10:56:16.874703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 225
2025-10-15T10:56:16.874767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 225
2025-10-15T10:56:16.875622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:16.875656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:16.875749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|442bee73-427a8c96-e1aeafb4-b5380378_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:16.875783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:16.875802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:16.875812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:16.875850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:16.875896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:16.875946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:16.876612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:16.876637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:16.876711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:16.877029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 226 partition: 0 MaxSeqNo: 46 sessionId: src_id|442bee73-427a8c96-e1aeafb4-b5380378_0
2025-10-15T10:56:16.879582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bdd64c-8b7c9920-712ee196-fc9ed5e5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|442bee73-427a8c96-e1aeafb4-b5380378_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:16.902249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442bee73-427a8c96-e1aeafb4-b5380378_0] Write session: try to update token
2025-10-15T10:56:16.902311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442bee73-427a8c96-e1aeafb4-b5380378_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:16.930285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:16.930316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:16.930348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400634885867835:4162]
2025-10-15T10:56:16.930472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:16.931433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:16.932572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:16.933901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:16.935217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:16.940760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:16.963986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:16.964691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:17.001330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:17.001358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:17.001372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:17.001431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:17.001446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:17.001459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:17.001470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:17.001507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400634885867835:4162]
2025-10-15T10:56:17.001530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400634885867835:4162]
2025-10-15T10:56:17.001556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400634885867835:4162]
2025-10-15T10:56:17.001658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:17.001691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:17.001694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:17.001716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:17.001718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:17.003311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:17.011682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId: src_id|442bee73-427a8c96-e1aeafb4-b5380378_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:17.033579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:17.144652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:17.146029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:17.146072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:17.146601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400632086163187:4202]
2025-10-15T10:56:17.146637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:17.146650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:17.146688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:17.146840Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:17.217168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 226 reason: error at write: Disconnected sessionId: src_id|442bee73-427a8c96-e1aeafb4-b5380378_0
2025-10-15T10:56:17.217516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 226 sessionId: src_id|442bee73-427a8c96-e1aeafb4-b5380378_0 is DEAD
2025-10-15T10:56:17.217901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442bee73-427a8c96-e1aeafb4-b5380378_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:17.217965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442bee73-427a8c96-e1aeafb4-b5380378_0] Write session will restart in 0.006399s
2025-10-15T10:56:17.218138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442bee73-427a8c96-e1aeafb4-b5380378_0] Write session: Do CDS request
2025-10-15T10:56:17.218193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442bee73-427a8c96-e1aeafb4-b5380378_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:17.228837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442bee73-427a8c96-e1aeafb4-b5380378_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:17.232036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:17.232075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 227
2025-10-15T10:56:17.232547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:17.232703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:17.232732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:17.232752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:17.235028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 227 sessionId:  describe result for acl check
2025-10-15T10:56:17.235156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:17.235169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:17.235179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:17.235197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400636381130768:4469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:17.239623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400636381130768:4469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:17.246103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400636381130768:4469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:17.246545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:17.247041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400636381130793:4202]
2025-10-15T10:56:17.249405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:17.252168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:17.252193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:17.252238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:17.252453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:17.252597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400639180835450:4173]
2025-10-15T10:56:17.253613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400636381130768:4469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:17.253658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400636381130768:4469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:17.253677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400636381130768:4469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:17.253712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:17.254564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:17.255488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:17.255730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:17.257097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:17.257437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.257454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.257461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.257467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.257475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.257482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.257487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.257495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.257500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.257507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.257513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.257519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.257525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.257530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.257579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.257692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.257739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.257787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.257835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.257881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.257944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.257997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.258045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.258097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.258147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.258201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.258256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.258305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.258352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.258423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.258492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.258557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.258611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.258668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.258715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.258775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.258828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.258888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.258935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.259008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.259060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.259120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.259170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.259231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.259285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.259399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.259453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.259512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.259562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.259616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.259662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.259720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.259768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.259824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.259872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.259927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.260473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:17.312404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:17.320245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:17.320283Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:17.320295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:17.320310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:17.320329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 226 [2:7561400639180835450:4173]
2025-10-15T10:56:17.320367Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:17.320422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:17.320437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:17.320450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:17.320462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:17.320510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:17.320529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:17.320547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:17.321340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.321358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.321367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.321375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:17.321561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:17.321580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.321676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.321800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.321912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 226, pipe: [1:7561400636381130793:4202]
2025-10-15T10:56:17.321958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:17.321968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 226
2025-10-15T10:56:17.322025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 226
2025-10-15T10:56:17.322037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400636381130793:4202], now have 1 active actors on pipe
2025-10-15T10:56:17.322057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400636381130513:2467], now have 1 active actors on pipe
2025-10-15T10:56:17.322071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400636381130804:4469], now have 1 active actors on pipe
2025-10-15T10:56:17.322089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400639180835436:4173]
2025-10-15T10:56:17.322103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400639180835436:4173]
2025-10-15T10:56:17.322112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400639180835436:4173]
2025-10-15T10:56:17.322136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:17.322167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:17.322181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:17.322193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:17.322201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:17.322358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:17.322375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:17.322439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:17.322457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:17.322548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400639180835436:4173]
2025-10-15T10:56:17.322569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:17.322605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:17.322620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47284c52-206fd233-39efc3ef-94af7513_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:17.322640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:17.322651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:17.322658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:17.322685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:17.322711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:17.322808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:17.323391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:17.323432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:17.323499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:17.323779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 227 partition: 0 MaxSeqNo: 46 sessionId: src_id|47284c52-206fd233-39efc3ef-94af7513_0
2025-10-15T10:56:17.324608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442bee73-427a8c96-e1aeafb4-b5380378_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|47284c52-206fd233-39efc3ef-94af7513_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:17.345252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47284c52-206fd233-39efc3ef-94af7513_0] Write session: try to update token
2025-10-15T10:56:17.345314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47284c52-206fd233-39efc3ef-94af7513_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:17.354956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:17.354992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:17.355034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400639180835436:4173]
2025-10-15T10:56:17.355169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:17.355172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:17.357338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:17.358664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:17.360129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:17.398811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:17.404610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:17.405435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:17.428214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:17.428248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:17.428260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:17.428312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:17.428325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:17.428338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:17.428348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:17.428386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400639180835436:4173]
2025-10-15T10:56:17.428409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400639180835436:4173]
2025-10-15T10:56:17.428431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400639180835436:4173]
2025-10-15T10:56:17.428554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:17.428553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:17.428582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:17.428592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:17.428624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:17.429773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:17.455441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId: src_id|47284c52-206fd233-39efc3ef-94af7513_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:17.476227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:17.572763Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:17.574129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:17.574166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:17.574837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:17.574861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400636381130793:4202]
2025-10-15T10:56:17.574967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:17.574982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:17.574871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:17.613886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 227 reason: error at write: Disconnected sessionId: src_id|47284c52-206fd233-39efc3ef-94af7513_0
2025-10-15T10:56:17.614187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 227 sessionId: src_id|47284c52-206fd233-39efc3ef-94af7513_0 is DEAD
2025-10-15T10:56:17.614570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47284c52-206fd233-39efc3ef-94af7513_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:17.614634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47284c52-206fd233-39efc3ef-94af7513_0] Write session will restart in 0.007304s
2025-10-15T10:56:17.614782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47284c52-206fd233-39efc3ef-94af7513_0] Write session: Do CDS request
2025-10-15T10:56:17.614840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47284c52-206fd233-39efc3ef-94af7513_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:17.614476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:17.622551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:17.623555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:17.623588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:17.623636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:17.623916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:17.624158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400639180835508:4175]
2025-10-15T10:56:17.626186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:17.626229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 228
2025-10-15T10:56:17.626345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47284c52-206fd233-39efc3ef-94af7513_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:17.626471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:17.626838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:17.626994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:17.627018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:17.627029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:17.627518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:17.627761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:17.628362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 228 sessionId:  describe result for acl check
2025-10-15T10:56:17.628481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:17.628497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:17.628506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:17.628524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400636381130840:4473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:17.629020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:17.629325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.629341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.629347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.629354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.629360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.629367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.629374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.629381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.629388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.629395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.629401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.629415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.629427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.629434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.629497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.629598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.629653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.629697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.629739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.629795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.629841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.629882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.629937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.629980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.630030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.630082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.630141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.630195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.630252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.630322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.630381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.630437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.630482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.630536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.630608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.630665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.630720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.630788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.630842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.630911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.630971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.630933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400636381130840:4473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:17.631023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.631072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.631125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.631177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.631234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.631278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.631463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.631539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.631605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.631659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.631716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.631767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.631818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.631860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.631928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.632468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:17.636226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400636381130840:4473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:17.643543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400636381130840:4473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:17.643584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400636381130840:4473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:17.643601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400636381130840:4473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:17.643634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:17.649323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:17.657994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:17.658027Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:17.658037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:17.658050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:17.658069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 227 [2:7561400639180835508:4175]
2025-10-15T10:56:17.658101Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:17.658141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:17.658152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:17.658159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:17.658168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:17.658200Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:17.658217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:17.658230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:17.659091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.659106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.659114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.659122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:17.659642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 227
2025-10-15T10:56:17.659763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 227
2025-10-15T10:56:17.659324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:17.659374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.659491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.659645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.659833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:17.659901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400636381130871:4473], now have 1 active actors on pipe
2025-10-15T10:56:17.659923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400636381130816:2467], now have 1 active actors on pipe
2025-10-15T10:56:17.659964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:17.659983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:17.660031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400639180835502:4175]
2025-10-15T10:56:17.660045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400639180835502:4175]
2025-10-15T10:56:17.660056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400639180835502:4175]
2025-10-15T10:56:17.660097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:17.660136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:17.660150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:17.660158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:17.660161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:17.660321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:17.660335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:17.660389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:17.660412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:17.660428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:17.660437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:17.660467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:17.660497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:17.660614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400639180835502:4175]
2025-10-15T10:56:17.660636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:17.660657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:17.660674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:17.661146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:17.661166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:17.661225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:17.661546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 228 partition: 0 MaxSeqNo: 46 sessionId: src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0
2025-10-15T10:56:17.662432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47284c52-206fd233-39efc3ef-94af7513_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:17.674088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400636381130876:4202]
2025-10-15T10:56:17.674671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400636381130876:4202], now have 1 active actors on pipe
2025-10-15T10:56:17.674796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 227, pipe: [1:7561400636381130876:4202]
2025-10-15T10:56:17.681356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0] Write session: try to update token
2025-10-15T10:56:17.681409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:17.701615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:17.701642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:17.701669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400639180835502:4175]
2025-10-15T10:56:17.701769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:17.701774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:17.703814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:17.705223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:17.706686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:17.708164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:17.710098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:17.710627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:17.754742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:17.754793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:17.754811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:17.754824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:17.754868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400639180835502:4175]
2025-10-15T10:56:17.754899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400639180835502:4175]
2025-10-15T10:56:17.754928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400639180835502:4175]
2025-10-15T10:56:17.755055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:17.755090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:17.755114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:17.755115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:17.755144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:17.758766Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:17.761259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId: src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:17.783964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:17.900605Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:17.901851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:17.901883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:17.902394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:17.902446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:17.902454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400636381130876:4202]
2025-10-15T10:56:17.902521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:17.902530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:17.913742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 228 reason: error at write: Disconnected sessionId: src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0
2025-10-15T10:56:17.914300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 228 sessionId: src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0 is DEAD
2025-10-15T10:56:17.914858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:17.914916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0] Write session will restart in 0.005127s
2025-10-15T10:56:17.915097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0] Write session: Do CDS request
2025-10-15T10:56:17.915144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:17.926376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:17.926337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:17.926373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 229
2025-10-15T10:56:17.927655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:17.927822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:17.927851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:17.927862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:17.929295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 229 sessionId:  describe result for acl check
2025-10-15T10:56:17.929396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:17.929417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:17.929423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:17.929436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400636381130902:4477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:17.931553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400636381130902:4477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:17.934482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:17.938168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400636381130902:4477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:17.938197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:17.939040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:17.939071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:17.939114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:17.939398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:17.939578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400639180835579:4179]
2025-10-15T10:56:17.941818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:17.942596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:17.942804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:17.944075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:17.944402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.944420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.944428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.944447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400636381130902:4477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:17.944436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.944443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.944490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400636381130902:4477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:17.944449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.944508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400636381130902:4477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:17.944456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.944538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:17.944463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.944471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.944478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.944485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.944493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.944501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.944508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.944562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.944679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.944727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.944777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.944824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.944880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.944933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.944979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.945027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.945077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.945126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.945173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.945224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.945274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.945324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.945392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:17.945459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.945520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:17.945575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.945636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:17.945705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.945760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:17.945813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.945872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:17.945921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.945980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:17.946031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.946090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:17.946146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.946209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:17.946264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.946319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:17.946369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.946427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:17.946478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.946537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:17.946586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.946645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.946696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.946755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.946804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.946860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.947410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:17.964189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:17.978744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:17.978797Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:17.978816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:17.978838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:17.978865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 228 [2:7561400639180835579:4179]
2025-10-15T10:56:17.978922Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:17.978984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:17.979000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:17.979014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:17.979027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:17.979079Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:17.979102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:17.979127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:17.980282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.980308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.980323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.980335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:17.980601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:17.980626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:17.980778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:17.980980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:17.981024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 228
2025-10-15T10:56:17.981059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 228
2025-10-15T10:56:17.981236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:17.981324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400636381130936:4477], now have 1 active actors on pipe
2025-10-15T10:56:17.981354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400636381130884:2467], now have 1 active actors on pipe
2025-10-15T10:56:17.981403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:17.981430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:17.981486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400639180835574:4179]
2025-10-15T10:56:17.981508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400639180835574:4179]
2025-10-15T10:56:17.981523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400639180835574:4179]
2025-10-15T10:56:17.981560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:17.981588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:17.981604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:17.981618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:17.981634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:17.981826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:17.981850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:17.981914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:17.981951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:17.981970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:17.981981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:17.982018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:17.982063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:17.982192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400639180835574:4179]
2025-10-15T10:56:17.982223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:17.982244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:17.982269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:17.983002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:17.983031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:17.983098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:17.983454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 229 partition: 0 MaxSeqNo: 46 sessionId: src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0
2025-10-15T10:56:17.984274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f0ab86-d528a1cf-88e51b63-51eb383c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:18.002807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400640676098240:4202]
2025-10-15T10:56:18.003319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098240:4202], now have 1 active actors on pipe
2025-10-15T10:56:18.003452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 228, pipe: [1:7561400640676098240:4202]
2025-10-15T10:56:18.004702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0] Write session: try to update token
2025-10-15T10:56:18.004751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:18.059990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:18.060027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:18.060043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:18.060054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:18.060092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400639180835574:4179]
2025-10-15T10:56:18.060111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400639180835574:4179]
2025-10-15T10:56:18.060128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400639180835574:4179]
2025-10-15T10:56:18.060236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:18.060266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:18.060296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:18.060304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:18.060323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:18.061173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:18.081874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId: src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:18.104468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:18.204275Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:18.224915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:18.224955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:18.225006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:18.225016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:18.225047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400639180835574:4179]
2025-10-15T10:56:18.225193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:18.225421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:18.225448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:18.225522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:18.242284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:18.242430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400640676098240:4202]
2025-10-15T10:56:18.242498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 229 reason: error at write: Disconnected sessionId: src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0
2025-10-15T10:56:18.242790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 229 sessionId: src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0 is DEAD
2025-10-15T10:56:18.243113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:18.243183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0] Write session will restart in 0.005622s
2025-10-15T10:56:18.243303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0] Write session: Do CDS request
2025-10-15T10:56:18.243335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:18.253797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:18.263034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:18.263063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 230
2025-10-15T10:56:18.263470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:18.263596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:18.263611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:18.263620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:18.264717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 230 sessionId:  describe result for acl check
2025-10-15T10:56:18.264818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:18.264834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:18.264842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:18.264858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400640676098287:4489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:18.267395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400640676098287:4489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:18.267810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:18.270295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:18.270912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:18.270932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:18.270957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:18.271117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:18.271254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400643475802946:4187]
2025-10-15T10:56:18.272632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:18.272662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400640676098287:4489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:18.273279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:18.273410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:18.274256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:18.274456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.274466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.274470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.274474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.274479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.274483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.274487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.274491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.274494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.274498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.274503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.274534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.274542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.274548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.274586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.274661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.274697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.274725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.274754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.274801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.274831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.274886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.274918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.274945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.274972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.274998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.275032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.275088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.275112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.275154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.275191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.275227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.275265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.275295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.275321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.275402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.275437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.275468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.275500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.275536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.275577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.275615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.275640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.275674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.275706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.275747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.275776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.275807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.275834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.275871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.275906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.275958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.276000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.276033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.276070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.276115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.276444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:18.285123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400640676098287:4489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:18.285168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400640676098287:4489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:18.285186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400640676098287:4489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:18.285234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:18.292541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:18.309842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:18.309883Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:18.309897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:18.309913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:18.309934Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 229 [2:7561400643475802946:4187]
2025-10-15T10:56:18.309988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:18.310037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:18.310050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:18.310061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:18.310071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:18.310113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:18.310133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:18.310152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:18.312054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.312080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.312092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.312103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:18.312357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:18.312382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.312499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.312563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 229
2025-10-15T10:56:18.312665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 229
2025-10-15T10:56:18.312660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.312870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:18.312947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098278:2467], now have 1 active actors on pipe
2025-10-15T10:56:18.312974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098323:4489], now have 1 active actors on pipe
2025-10-15T10:56:18.313031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:18.313057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:18.313086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400643475802941:4187]
2025-10-15T10:56:18.313098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400643475802941:4187]
2025-10-15T10:56:18.313108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400643475802941:4187]
2025-10-15T10:56:18.313141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:18.313171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:18.313184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:18.313195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:18.313204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:18.313350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:18.313365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:18.313443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:18.313487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:18.313502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:18.313512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:18.313541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:18.313577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:18.313704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400643475802941:4187]
2025-10-15T10:56:18.313742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:18.313762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:18.313783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:18.314138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:18.314163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:18.314214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:18.314474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 230 partition: 0 MaxSeqNo: 46 sessionId: src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0
2025-10-15T10:56:18.315234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148ae910-1a72885b-124a4d2d-4d0cab45_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:18.336312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0] Write session: try to update token
2025-10-15T10:56:18.336378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:18.342734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400640676098331:4202]
2025-10-15T10:56:18.343368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 229, pipe: [1:7561400640676098331:4202]
2025-10-15T10:56:18.347870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:18.347899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:18.347930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400643475802941:4187]
2025-10-15T10:56:18.348008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:18.348037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098331:4202], now have 1 active actors on pipe
2025-10-15T10:56:18.348076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:18.350199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:18.351734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:18.353242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:18.354942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:18.356979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:18.372142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:18.424961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId: src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:18.429553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:18.429581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:18.429591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:18.429653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:18.429666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:18.429677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:18.429688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:18.429730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400643475802941:4187]
2025-10-15T10:56:18.429753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400643475802941:4187]
2025-10-15T10:56:18.429774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400643475802941:4187]
2025-10-15T10:56:18.429878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:18.429889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:18.429906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:18.429921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:18.429952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:18.431025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:18.447519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:18.571725Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:18.573090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:18.573126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:18.573683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400640676098331:4202]
2025-10-15T10:56:18.573708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:18.573756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:18.573767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:18.573804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:18.582976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 230 reason: error at write: Disconnected sessionId: src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0
2025-10-15T10:56:18.583218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 230 sessionId: src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0 is DEAD
2025-10-15T10:56:18.583541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:18.583610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0] Write session will restart in 0.009900s
2025-10-15T10:56:18.583759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0] Write session: Do CDS request
2025-10-15T10:56:18.583812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:18.597311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:18.597367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 231
2025-10-15T10:56:18.597684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:18.598302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:18.598516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:18.598536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:18.598552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
E1015 10:56:18.598815012  821221 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:56:18.600165Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:56:18.600505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 231 sessionId:  describe result for acl check
2025-10-15T10:56:18.600630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:18.600648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:18.600661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:18.600683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400640676098368:4496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:18.602868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400640676098368:4496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:18.601308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:18.603616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:18.604371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:18.604386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:18.604429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:18.604630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:18.604777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400643475803030:4196]
2025-10-15T10:56:18.606713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:18.607236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400640676098368:4496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:18.607522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:18.607731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:18.608810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:18.609092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.609106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.609111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.609116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.609122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.609127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.609132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.609137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.609142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.609147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.609152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.609158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.609162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.609168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.609216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.609296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.609332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.609368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.609409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.609463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.609503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.609541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.609579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.609623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.609655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.609687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.609725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.609756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.609793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.609849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.609902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.609989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.610037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.610086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.610128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.610197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.610267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.610321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.610359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.610421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.610465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.610518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.610568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.610621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.610669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.610704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.610737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.610768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.610806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.610840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.610875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.610921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.610948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.610975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.611007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.611038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.611339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:18.613629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400640676098368:4496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:18.613668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400640676098368:4496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:18.613683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400640676098368:4496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:18.613712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:18.632032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:18.648349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:18.648380Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:18.648390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:18.648402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:18.648418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 230 [2:7561400643475803030:4196]
2025-10-15T10:56:18.648450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:18.648490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:18.648500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:18.648508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:18.648514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:18.648546Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:18.648561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:18.648575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:18.649379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.649397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.649404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.649411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:18.649618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:18.649639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.649738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.649884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.649893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 230
2025-10-15T10:56:18.649942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 230
2025-10-15T10:56:18.650068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:18.650133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098402:4496], now have 1 active actors on pipe
2025-10-15T10:56:18.650161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098347:2467], now have 1 active actors on pipe
2025-10-15T10:56:18.650199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:18.650215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:18.650238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400643475803025:4196]
2025-10-15T10:56:18.650245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400643475803025:4196]
2025-10-15T10:56:18.650253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400643475803025:4196]
2025-10-15T10:56:18.650274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:18.650323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:18.650331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:18.650346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:18.650356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:18.650483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:18.650505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:18.650559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:18.650588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:18.650603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:18.650612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:18.650641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:18.650669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:18.650769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400643475803025:4196]
2025-10-15T10:56:18.650797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:18.650833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:18.650837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:18.651213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:18.651233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:18.651272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:18.651512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 231 partition: 0 MaxSeqNo: 46 sessionId: src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0
2025-10-15T10:56:18.652121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e909bec-7e87cd54-9a2791ad-edc5180b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:18.671542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0] Write session: try to update token
2025-10-15T10:56:18.671596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:18.673990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400640676098409:4202]
2025-10-15T10:56:18.674548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 230, pipe: [1:7561400640676098409:4202]
2025-10-15T10:56:18.681454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098409:4202], now have 1 active actors on pipe
2025-10-15T10:56:18.681500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:18.681515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:18.681550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400643475803025:4196]
2025-10-15T10:56:18.681668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:18.681691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:18.683264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:18.684758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:18.686120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:18.687406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:18.689184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:18.689737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:18.746537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:18.746569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:18.746583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:18.746592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:18.746618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400643475803025:4196]
2025-10-15T10:56:18.746634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400643475803025:4196]
2025-10-15T10:56:18.746647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400643475803025:4196]
2025-10-15T10:56:18.746777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:18.746797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:18.746810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:18.746860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:18.746917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:18.747835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:18.765283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId: src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:18.785749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:18.879590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:18.881078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:18.881118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:18.881572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400640676098409:4202]
2025-10-15T10:56:18.881659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:18.881707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:18.881729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:18.881836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:18.891041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 231 reason: error at write: Disconnected sessionId: src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0
2025-10-15T10:56:18.891416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 231 sessionId: src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0 is DEAD
2025-10-15T10:56:18.891812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:18.891888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0] Write session will restart in 0.009009s
2025-10-15T10:56:18.892045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0] Write session: Do CDS request
2025-10-15T10:56:18.892102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:18.905415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:18.905379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:18.905412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 232
2025-10-15T10:56:18.906032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:18.906190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:18.906216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:18.906227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:18.907560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 232 sessionId:  describe result for acl check
2025-10-15T10:56:18.907684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:18.907701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:18.907710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:18.907742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400640676098432:4500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:18.910314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400640676098432:4500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:18.915633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:18.917919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400640676098432:4500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:18.919602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:18.920419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:18.920455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:18.920497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:18.920763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:18.920955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400643475803104:4200]
2025-10-15T10:56:18.923388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:18.924278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:18.924490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:18.926201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:18.926200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400640676098432:4500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:18.926260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400640676098432:4500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:18.926284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400640676098432:4500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:18.926327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:18.926728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.926759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.926769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.926785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.926799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.926811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.926823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.926831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.926841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.926850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.926878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.926890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.926902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.926916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.926998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.927171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.927264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.927343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.927483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.927572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.927672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.927741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.927793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.927856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.927909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.927962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.928013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.928075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.928127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.928245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:18.928365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.928500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:18.928564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.928639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:18.928693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.928748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:18.928787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.928831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:18.928878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.928933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:18.928982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.929035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:18.929081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.929138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:18.929198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.929260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:18.929310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.929361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:18.929413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.929468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:18.929516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.929577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.929629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.929681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.929726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.929778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.930283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:18.945960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:18.955750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:18.955793Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:18.955811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:18.955830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:18.955854Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 231 [2:7561400643475803104:4200]
2025-10-15T10:56:18.955907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:18.955962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:18.955975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:18.955987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:18.955997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:18.956041Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:18.956058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:18.956072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:18.957026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.957044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.957052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.957059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:18.957306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:18.957330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:18.957461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:18.957657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:18.957726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 231
2025-10-15T10:56:18.957727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 231
2025-10-15T10:56:18.957914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:18.958014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098470:4500], now have 1 active actors on pipe
2025-10-15T10:56:18.958048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098416:2467], now have 1 active actors on pipe
2025-10-15T10:56:18.958105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:18.958136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:18.958204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400643475803099:4200]
2025-10-15T10:56:18.958227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400643475803099:4200]
2025-10-15T10:56:18.958241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400643475803099:4200]
2025-10-15T10:56:18.958283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:18.958319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:18.958347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:18.958361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:18.958363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:18.958541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:18.958571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:18.958635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e214ace5-75cb3773-4fb6cb5-10687240_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:18.958672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:18.958695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:18.958706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:18.958737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:18.958778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:18.958917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400643475803099:4200]
2025-10-15T10:56:18.958961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:18.959007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:18.959011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:18.959480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:18.959507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:18.959567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:18.959829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 232 partition: 0 MaxSeqNo: 46 sessionId: src_id|e214ace5-75cb3773-4fb6cb5-10687240_0
2025-10-15T10:56:18.960627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e207011-968d6ffd-cf24276c-7ec50f5b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e214ace5-75cb3773-4fb6cb5-10687240_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:18.980768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e214ace5-75cb3773-4fb6cb5-10687240_0] Write session: try to update token
2025-10-15T10:56:18.980818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e214ace5-75cb3773-4fb6cb5-10687240_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:18.981771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400640676098482:4202]
2025-10-15T10:56:18.982372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 231, pipe: [1:7561400640676098482:4202]
2025-10-15T10:56:18.988817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400640676098482:4202], now have 1 active actors on pipe
2025-10-15T10:56:18.988865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:18.988881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:18.988918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400643475803099:4200]
2025-10-15T10:56:18.989046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:18.989097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:18.991014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:18.992422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:18.993870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:18.995116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:18.996780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:19.007900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:19.051937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId: src_id|e214ace5-75cb3773-4fb6cb5-10687240_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:19.055133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:19.055167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:19.055181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:19.055190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:19.055221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400643475803099:4200]
2025-10-15T10:56:19.055236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400643475803099:4200]
2025-10-15T10:56:19.055250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400643475803099:4200]
2025-10-15T10:56:19.055386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:19.055391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:19.055409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:19.055433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:19.055468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:19.056193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:19.073521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:19.197734Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:19.205865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:19.205918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:19.206492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:19.206519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:19.206529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400640676098482:4202]
2025-10-15T10:56:19.206643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:19.206724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:19.217022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 232 reason: error at write: Disconnected sessionId: src_id|e214ace5-75cb3773-4fb6cb5-10687240_0
2025-10-15T10:56:19.217364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 232 sessionId: src_id|e214ace5-75cb3773-4fb6cb5-10687240_0 is DEAD
2025-10-15T10:56:19.217791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e214ace5-75cb3773-4fb6cb5-10687240_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:19.217866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e214ace5-75cb3773-4fb6cb5-10687240_0] Write session will restart in 0.009239s
2025-10-15T10:56:19.218053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e214ace5-75cb3773-4fb6cb5-10687240_0] Write session: Do CDS request
2025-10-15T10:56:19.218110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e214ace5-75cb3773-4fb6cb5-10687240_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:19.231323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e214ace5-75cb3773-4fb6cb5-10687240_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:19.231326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:19.231382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 233
2025-10-15T10:56:19.231802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:19.231940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:19.231962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:19.231972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:19.233116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 233 sessionId:  describe result for acl check
2025-10-15T10:56:19.233246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:19.233268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:19.233296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:19.233319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400644971065817:4508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:19.235813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400644971065817:4508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:19.241364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:19.242995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400644971065817:4508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:19.244219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:19.245375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:19.245424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:19.245481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:19.245789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:19.245971Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400647770770462:4202]
2025-10-15T10:56:19.248028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:19.249153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:19.249413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:19.250835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:19.251036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400644971065817:4508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:19.251083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400644971065817:4508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:19.251101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400644971065817:4508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:19.251133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:19.251123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.251138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.251142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.251147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.251151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.251156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.251164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.251170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.251176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.251183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.251190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.251197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.251204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.251210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.251255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.251339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.251422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.251468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.251511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.251556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.251602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.251647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.251702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.251751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.251802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.251845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.251886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.251939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.251989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.252069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.252129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.252193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.252249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.252318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.252366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.252423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.252476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.252531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.252582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.252638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.252688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.252751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.252801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.252858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.252912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.252973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.253024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.253079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.253128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.253175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.253209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.253254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.253288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.253334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.253369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.253416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.253830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:19.268628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:19.283125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:19.283158Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:19.283169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:19.283183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:19.283201Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 232 [2:7561400647770770462:4202]
2025-10-15T10:56:19.283241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:19.283293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:19.283304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:19.283314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:19.283322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:19.283391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:19.283410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:19.283426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:19.284233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.284251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.284261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.284268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:19.284451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:19.284472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.284627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.284849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.284835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 232
2025-10-15T10:56:19.284849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 232
2025-10-15T10:56:19.285100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:19.285197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400644971065851:4508], now have 1 active actors on pipe
2025-10-15T10:56:19.285227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400644971065785:2467], now have 1 active actors on pipe
2025-10-15T10:56:19.285277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:19.285305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:19.285365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400647770770456:4202]
2025-10-15T10:56:19.285394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400647770770456:4202]
2025-10-15T10:56:19.285422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400647770770456:4202]
2025-10-15T10:56:19.285460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:19.285502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:19.285523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:19.285535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:19.285546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:19.285739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:19.285771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:19.285844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:19.285887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:19.285915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:19.285927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:19.285968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:19.286007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:19.286132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400647770770456:4202]
2025-10-15T10:56:19.286165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:19.286191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:19.286210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:19.286714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:19.286742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:19.286804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:19.287127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 233 partition: 0 MaxSeqNo: 46 sessionId: src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0
2025-10-15T10:56:19.287881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e214ace5-75cb3773-4fb6cb5-10687240_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:19.306837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400644971065860:4202]
2025-10-15T10:56:19.307409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 232, pipe: [1:7561400644971065860:4202]
2025-10-15T10:56:19.307513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0] Write session: try to update token
2025-10-15T10:56:19.307568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:19.312709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400644971065860:4202], now have 1 active actors on pipe
2025-10-15T10:56:19.312755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:19.312771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:19.312809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400647770770456:4202]
2025-10-15T10:56:19.312942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:19.312941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:19.315011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:19.316364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:19.317644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:19.318756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:19.320675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:19.321217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:19.366444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:19.366501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:19.366531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:19.366553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:19.366643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400647770770456:4202]
2025-10-15T10:56:19.366693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400647770770456:4202]
2025-10-15T10:56:19.366744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400647770770456:4202]
2025-10-15T10:56:19.366939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:19.367008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:19.367020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:19.367060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:19.367073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:19.368522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:19.386507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId: src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:19.407509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:19.513979Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:19.516192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:19.516232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:19.516879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400644971065860:4202]
2025-10-15T10:56:19.517005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:19.517018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:19.517295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:19.552382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:19.552532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 233 reason: error at write: Disconnected sessionId: src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0
2025-10-15T10:56:19.553290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:19.553344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0] Write session will restart in 0.006598s
2025-10-15T10:56:19.553496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0] Write session: Do CDS request
2025-10-15T10:56:19.552850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 233 sessionId: src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0 is DEAD
2025-10-15T10:56:19.553542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:19.563554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:19.564816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:19.568467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:19.569347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:19.569378Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:19.569426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:19.569745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:19.572189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:19.572219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 234
2025-10-15T10:56:19.572664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:19.572788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:19.572810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:19.572822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:19.574069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 234 sessionId:  describe result for acl check
2025-10-15T10:56:19.574178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:19.574191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:19.574197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:19.574209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400644971065902:4518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:19.569935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400647770770536:4210]
2025-10-15T10:56:19.572945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:19.573812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:19.574022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:19.575162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:19.575451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.575456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.575461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.575466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.575471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.575475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.575480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.575484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.575489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.575495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.575499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.575504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.575508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.575513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.575545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.575627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.575674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.575724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.575769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.575816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.575873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.575911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.575960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.576016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.576062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.576110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.576159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.576203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.576247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.576323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.576392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.576450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.576504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.576518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400644971065902:4518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:19.576568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.576621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.576691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.576747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.576802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.576853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.576915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.576972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.577034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.577085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.577144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.577199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.577261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.577312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.577368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.577414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.577473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.577523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.577581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.577632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.577689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.577732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.577773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.578181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:19.581976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400644971065902:4518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:19.589269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400644971065902:4518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:19.589312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400644971065902:4518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:19.589330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400644971065902:4518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:19.589363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:19.597150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:19.607603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:19.607652Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:19.607668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:19.607687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:19.607712Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 233 [2:7561400647770770536:4210]
2025-10-15T10:56:19.607763Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:19.607817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:19.607830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:19.607842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:19.607853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:19.607904Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:19.607926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:19.607948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:19.609862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.609889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.609902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.609914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:19.610186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:19.610210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.610336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.610510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.610467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 233
2025-10-15T10:56:19.610576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 233
2025-10-15T10:56:19.610719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:19.610800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400644971065932:4518], now have 1 active actors on pipe
2025-10-15T10:56:19.610827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400644971065885:2467], now have 1 active actors on pipe
2025-10-15T10:56:19.610872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:19.610897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:19.610949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400647770770531:4210]
2025-10-15T10:56:19.610966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400647770770531:4210]
2025-10-15T10:56:19.610977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400647770770531:4210]
2025-10-15T10:56:19.611012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:19.611060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:19.611081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:19.611084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:19.611092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:19.611255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:19.611277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:19.611378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:19.611413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:19.611431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:19.611441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:19.611478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:19.611521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:19.611659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400647770770531:4210]
2025-10-15T10:56:19.611692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:19.611723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:19.611736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:19.612172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:19.612202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:19.612270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:19.612558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 234 partition: 0 MaxSeqNo: 46 sessionId: src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0
2025-10-15T10:56:19.613395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42491ca1-aa04d0ee-fb343e35-ef99befc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:19.617094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400644971065938:4202]
2025-10-15T10:56:19.617609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400644971065938:4202], now have 1 active actors on pipe
2025-10-15T10:56:19.617676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 233, pipe: [1:7561400644971065938:4202]
2025-10-15T10:56:19.635333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0] Write session: try to update token
2025-10-15T10:56:19.635416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:19.654907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:19.654944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:19.654974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400647770770531:4210]
2025-10-15T10:56:19.655084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:19.655091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:19.657629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:19.659595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:19.661012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:19.662303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:19.664078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:19.664620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:19.708137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:19.708164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:19.708175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:19.708185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:19.708219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400647770770531:4210]
2025-10-15T10:56:19.708243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400647770770531:4210]
2025-10-15T10:56:19.708262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400647770770531:4210]
2025-10-15T10:56:19.708385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:19.708407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:19.708432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:19.708440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:19.708447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:19.708468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:19.708488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:19.708507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:19.710731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:19.726719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId: src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:19.746790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:19.845871Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:19.851095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:19.851131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:19.851760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:19.851788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:19.856462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:19.862905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 234 reason: error at write: Disconnected sessionId: src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0
2025-10-15T10:56:19.863289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 234 sessionId: src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0 is DEAD
2025-10-15T10:56:19.863713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:19.863754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0] Write session will restart in 0.005994s
2025-10-15T10:56:19.863862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0] Write session: Do CDS request
2025-10-15T10:56:19.863901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:19.874683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400644971065938:4202]
2025-10-15T10:56:19.874827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:19.877713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:19.877822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:19.877777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 235
2025-10-15T10:56:19.878332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:19.878468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:19.878491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:19.878502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:19.879822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 235 sessionId:  describe result for acl check
2025-10-15T10:56:19.879931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:19.879947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:19.879956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:19.879973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400644971065956:4522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:19.882632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400644971065956:4522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:19.889839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400644971065956:4522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:19.901254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400644971065956:4522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:19.901295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400644971065956:4522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:19.901319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400644971065956:4522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:19.901351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:19.906873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:19.910199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:19.910893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:19.910922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:19.910962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:19.911220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:19.911400Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400647770770635:4214]
2025-10-15T10:56:19.913153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:19.913882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:19.914125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:19.915301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:19.915647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.915674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.915680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.915688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.915694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.915702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.915709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.915716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.915723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.915730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.915757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.915766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.915773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.915780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.915828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.915938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.915985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.916029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.916073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.916129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.916174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.916223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.916271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.916322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.916371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.916419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.916466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.916513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.916559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.916632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:19.916696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.916748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:19.916786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.916829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:19.916869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.916911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:19.916956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.917015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:19.917053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.917107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:19.917140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.917198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:19.917236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.917275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:19.917311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.917361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:19.917408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.917453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:19.917496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.917552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:19.917600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.917672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.917721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.917774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.917822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.917880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.918365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:19.933839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:19.957339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:19.957382Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:19.957397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:19.957411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:19.957431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 234 [2:7561400647770770635:4214]
2025-10-15T10:56:19.957472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:19.957520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:19.957530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:19.957540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:19.957548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:19.957589Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:19.957607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:19.957625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:19.958546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.958568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.958581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.958591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:19.958823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:19.958842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:19.958964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:19.959130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:19.959146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 234
2025-10-15T10:56:19.959161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 234
2025-10-15T10:56:19.959341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:19.959440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400644971065952:2467], now have 1 active actors on pipe
2025-10-15T10:56:19.959466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400644971065995:4522], now have 1 active actors on pipe
2025-10-15T10:56:19.959531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:19.959554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:19.959587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400647770770628:4214]
2025-10-15T10:56:19.959600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400647770770628:4214]
2025-10-15T10:56:19.959610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400647770770628:4214]
2025-10-15T10:56:19.959643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:19.959678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:19.959701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:19.959707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:19.959715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:19.959857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:19.959881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:19.959943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:19.959968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:19.959982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:19.959991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:19.960022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:19.960058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:19.960167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400647770770628:4214]
2025-10-15T10:56:19.960200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:19.960216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:19.960245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:19.960727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:19.960754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:19.960826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:19.961114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 235 partition: 0 MaxSeqNo: 46 sessionId: src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0
2025-10-15T10:56:19.961923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0ac068-42dd93d8-2263a563-7aa78cb0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:19.975022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400644971066020:4202]
2025-10-15T10:56:19.975628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400644971066020:4202], now have 1 active actors on pipe
2025-10-15T10:56:19.975700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 234, pipe: [1:7561400644971066020:4202]
2025-10-15T10:56:19.982397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0] Write session: try to update token
2025-10-15T10:56:19.982457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:19.988929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:19.988973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:19.989026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400647770770628:4214]
2025-10-15T10:56:19.989130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:19.989170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:19.991190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:19.992562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:19.993866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:19.995060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:19.996698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:19.997228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:20.066923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:20.066954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:20.066967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:20.067026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:20.067042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:20.067056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:20.067068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:20.067113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400647770770628:4214]
2025-10-15T10:56:20.067142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400647770770628:4214]
2025-10-15T10:56:20.067165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400647770770628:4214]
2025-10-15T10:56:20.067289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:20.067309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:20.067329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:20.067334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:20.067379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:20.069620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:20.083714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId: src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:20.103898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:20.208797Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:20.210717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:20.210762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:20.211163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:20.211238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400644971066020:4202]
2025-10-15T10:56:20.211341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:20.211389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:20.211480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:20.229675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 235 reason: error at write: Disconnected sessionId: src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0
2025-10-15T10:56:20.230032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 235 sessionId: src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0 is DEAD
2025-10-15T10:56:20.230441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:20.230511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0] Write session will restart in 0.006170s
2025-10-15T10:56:20.230650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0] Write session: Do CDS request
2025-10-15T10:56:20.230695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:20.241304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:20.241336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 236
2025-10-15T10:56:20.241480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:20.242004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:20.242153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:20.242179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:20.242188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:20.242296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:20.243520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 236 sessionId:  describe result for acl check
2025-10-15T10:56:20.243625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:20.243641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:20.243650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:20.243668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400649266033362:4531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:20.245476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:20.246222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400649266033362:4531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:20.246407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:20.246433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:20.246475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:20.246891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:20.247087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400652065738001:4223]
2025-10-15T10:56:20.249518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:20.250638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:20.250869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:20.252297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400649266033362:4531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:20.252475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:20.252811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.252832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.252839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.252845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.252852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.252859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.252866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.252872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.252878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.252885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.252893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.252900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.252907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.252914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.252960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.253078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.253122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.253164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.253203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.253247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.253286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.253330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.253373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.253569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.253626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.253671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.253715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.253761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.253800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.253861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.253934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.253990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.254035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.254087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.254130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.254179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.254223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.254274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.254314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.254375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.254418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.254472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.254515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.254575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.254620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.254671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.254713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.254767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.254818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.254874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.254920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.254973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.255019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.255072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.255117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.255170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.255662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:20.266474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400649266033362:4531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:20.266514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400649266033362:4531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:20.266531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400649266033362:4531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:20.266561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:20.272480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:20.294941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:20.294988Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:20.295010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:20.295032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:20.295058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 235 [2:7561400652065738001:4223]
2025-10-15T10:56:20.295112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:20.295177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:20.295200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:20.295212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:20.295225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:20.295276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:20.295306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:20.295340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:20.296335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.296370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.296386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.296399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:20.296604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:20.296629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.296743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.296960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.296976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 235
2025-10-15T10:56:20.296981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 235
2025-10-15T10:56:20.297240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:20.297337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400649266033322:2467], now have 1 active actors on pipe
2025-10-15T10:56:20.297368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400649266033394:4531], now have 1 active actors on pipe
2025-10-15T10:56:20.297425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:20.297456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:20.297513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400652065737996:4223]
2025-10-15T10:56:20.297535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400652065737996:4223]
2025-10-15T10:56:20.297550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400652065737996:4223]
2025-10-15T10:56:20.297587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:20.297614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:20.297634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:20.297647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:20.297666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:20.297855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:20.297883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:20.297966Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:20.298002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:20.298026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:20.298038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:20.298079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:20.298133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:20.298277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400652065737996:4223]
2025-10-15T10:56:20.298310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:20.298327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:20.298360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:20.298832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:20.298862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:20.298950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:20.299197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 236 partition: 0 MaxSeqNo: 46 sessionId: src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0
2025-10-15T10:56:20.300004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8df1437-b2ca540f-a67ac1e0-d7d029dc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:20.311460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400649266033400:4202]
2025-10-15T10:56:20.312015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 235, pipe: [1:7561400649266033400:4202]
2025-10-15T10:56:20.311982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400649266033400:4202], now have 1 active actors on pipe
2025-10-15T10:56:20.319461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0] Write session: try to update token
2025-10-15T10:56:20.319529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:20.327736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:20.327772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:20.327816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400652065737996:4223]
2025-10-15T10:56:20.327956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:20.327952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:20.330125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:20.356221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:20.360272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:20.363028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:20.366936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:20.368020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:20.392169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:20.392209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:20.392236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:20.392252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:20.392302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400652065737996:4223]
2025-10-15T10:56:20.392333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400652065737996:4223]
2025-10-15T10:56:20.392374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400652065737996:4223]
2025-10-15T10:56:20.392529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:20.392567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:20.392571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:20.392600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:20.392604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:20.393973Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:20.408936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId: src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:20.430326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:20.536714Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:20.538524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:20.538566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:20.539151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:20.539176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400649266033400:4202]
2025-10-15T10:56:20.539292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:20.539312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:20.539448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:20.555576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 236 reason: error at write: Disconnected sessionId: src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0
2025-10-15T10:56:20.555950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 236 sessionId: src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0 is DEAD
2025-10-15T10:56:20.556478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:20.556543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0] Write session will restart in 0.007248s
2025-10-15T10:56:20.556729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0] Write session: Do CDS request
2025-10-15T10:56:20.556782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:20.568618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:20.568628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:20.568667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 237
2025-10-15T10:56:20.569101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:20.569252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:20.569276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:20.569287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:20.570733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 237 sessionId:  describe result for acl check
2025-10-15T10:56:20.570856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:20.570878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:20.570889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:20.570907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400649266033423:4535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:20.574547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400649266033423:4535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:20.577793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:20.582308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:20.582496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400649266033423:4535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:20.583055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:20.583079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:20.583115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:20.583334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:20.583543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400652065738066:4225]
2025-10-15T10:56:20.585554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:20.586595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:20.586785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:20.587937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:20.588268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.588283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.588290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.588296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.588302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.588308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.588314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.588320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.588325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.588331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.588338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.588344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.588349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.588356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.588397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.588494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.588536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.588579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.588619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.588660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.588707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.588750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.588793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.588838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.588882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.588928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.588974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.589015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.589056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.589120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.589177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.589229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.589279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.589332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.589377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.589429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.589477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.589529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.589574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.589625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.589669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.589720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.589718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400649266033423:4535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:20.589767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400649266033423:4535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:20.589767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.589785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400649266033423:4535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:20.589816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:20.589820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.589861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.589907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.589948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.589994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.590035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.590079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.590118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.590167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.590216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.590267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.590311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.590363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.590812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:20.607255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:20.616414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:20.616452Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:20.616467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:20.616484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:20.616507Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 236 [2:7561400652065738066:4225]
2025-10-15T10:56:20.616554Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:20.616607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:20.616621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:20.616631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:20.616642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:20.616683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:20.616703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:20.616722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:20.617855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.617877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.617890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.617901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:20.618149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:20.618170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.618289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.618456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.618559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 236
2025-10-15T10:56:20.618673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 236
2025-10-15T10:56:20.618671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:20.618743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400649266033465:4535], now have 1 active actors on pipe
2025-10-15T10:56:20.618763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400649266033404:2467], now have 1 active actors on pipe
2025-10-15T10:56:20.618809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:20.618829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:20.618866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400652065738061:4225]
2025-10-15T10:56:20.618882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400652065738061:4225]
2025-10-15T10:56:20.618894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400652065738061:4225]
2025-10-15T10:56:20.618926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:20.618960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:20.618980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:20.618985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:20.618990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:20.619142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:20.619161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:20.619230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:20.619260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:20.619279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:20.619288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:20.619319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:20.619367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:20.619477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400652065738061:4225]
2025-10-15T10:56:20.619509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:20.619551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:20.619696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:20.620005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:20.620036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:20.620101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:20.620388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 237 partition: 0 MaxSeqNo: 46 sessionId: src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0
2025-10-15T10:56:20.621155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add10aa1-59ef5dfa-bb00b998-9ab27432_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:20.639626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400649266033474:4202]
2025-10-15T10:56:20.640180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 236, pipe: [1:7561400649266033474:4202]
2025-10-15T10:56:20.642206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0] Write session: try to update token
2025-10-15T10:56:20.642258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:20.650814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400649266033474:4202], now have 1 active actors on pipe
2025-10-15T10:56:20.650854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:20.650868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:20.650905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400652065738061:4225]
2025-10-15T10:56:20.651014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:20.651049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:20.653089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:20.667776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:20.669132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:20.670571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:20.672624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:20.673142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:20.715437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:20.715507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:20.715537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:20.715553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:20.715622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400652065738061:4225]
2025-10-15T10:56:20.715664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400652065738061:4225]
2025-10-15T10:56:20.715704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400652065738061:4225]
2025-10-15T10:56:20.715916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:20.715929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:20.715956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:20.715970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:20.716030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:20.717522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:20.727476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId: src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:20.746265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:20.863614Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:20.865108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:20.865142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:20.866522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:20.865894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:20.865932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:20.866862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400649266033474:4202]
2025-10-15T10:56:20.866959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:20.890637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 237 reason: error at write: Disconnected sessionId: src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0
2025-10-15T10:56:20.891013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 237 sessionId: src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0 is DEAD
2025-10-15T10:56:20.895566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:20.895622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0] Write session will restart in 0.007726s
2025-10-15T10:56:20.895735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0] Write session: Do CDS request
2025-10-15T10:56:20.895765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:20.909939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:20.912072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:20.912115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 238
2025-10-15T10:56:20.912547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:20.912698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:20.912723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:20.912735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:20.914156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 238 sessionId:  describe result for acl check
2025-10-15T10:56:20.914271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:20.914283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:20.914295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:20.914315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400649266033497:4539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:20.917366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400649266033497:4539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:20.932237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400649266033497:4539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:20.937626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:20.946055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400649266033497:4539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:20.946108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400649266033497:4539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:20.946125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400649266033497:4539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:20.946156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:20.948230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:20.949066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:20.949082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:20.949122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:20.949374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:20.949553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400652065738151:4227]
2025-10-15T10:56:20.954551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:20.956002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:20.956271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:20.957712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:20.958097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.958106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.958112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.958119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.958126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.958134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.958141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.958149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.958157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.958164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.958170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.958177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.958185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.958192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.958241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.958357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.958405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.958453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.958499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.958546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.958595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.958644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.958690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.958740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.958783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.958825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.958871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.958916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.958964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.959030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:20.959095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.959152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:20.959204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.959259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:20.959305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.963551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:20.963655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.963739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:20.963791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.963847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:20.963901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.963959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:20.964007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.964060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:20.964111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.964175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:20.964238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.964304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:20.964357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.964416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:20.964471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.964536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:20.964588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.964652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:20.964701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.964753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:20.965274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:20.967334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400649266033550:4202]
2025-10-15T10:56:20.992905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:21.017664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:21.017716Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:21.017736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:21.017757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:21.017784Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 237 [2:7561400652065738151:4227]
2025-10-15T10:56:21.017838Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:21.017904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:21.017919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:21.017934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:21.017945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:21.018000Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:21.018024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:21.018049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:21.024741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 237
2025-10-15T10:56:21.024855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 237
2025-10-15T10:56:21.024920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 237, pipe: [1:7561400649266033550:4202]
2025-10-15T10:56:21.024042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.024078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.024094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.024107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:21.024410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:21.024431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.024585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.024782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.025040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:21.025129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400649266033479:2467], now have 1 active actors on pipe
2025-10-15T10:56:21.025156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400649266033545:4539], now have 1 active actors on pipe
2025-10-15T10:56:21.025180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400649266033550:4202], now have 1 active actors on pipe
2025-10-15T10:56:21.025230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400652065738144:4227]
2025-10-15T10:56:21.025245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400652065738144:4227]
2025-10-15T10:56:21.025258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400652065738144:4227]
2025-10-15T10:56:21.025306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:21.025339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:21.025353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:21.025365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:21.025388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:21.025584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:21.025601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:21.025662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:21.025682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:21.025819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400652065738144:4227]
2025-10-15T10:56:21.025853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:21.025915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:21.025932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e19366ad-8a81de23-d437339e-e158cbad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:21.025964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:21.025982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:21.025994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:21.026032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:21.026077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:21.026208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:21.031512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:21.031562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:21.031657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:21.032027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 238 partition: 0 MaxSeqNo: 46 sessionId: src_id|e19366ad-8a81de23-d437339e-e158cbad_0
2025-10-15T10:56:21.035565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd62277-4da7fc32-c108cc90-dee72e6f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e19366ad-8a81de23-d437339e-e158cbad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:21.066851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e19366ad-8a81de23-d437339e-e158cbad_0] Write session: try to update token
2025-10-15T10:56:21.066904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e19366ad-8a81de23-d437339e-e158cbad_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:21.073039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:21.073079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:21.073113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400652065738144:4227]
2025-10-15T10:56:21.073230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:21.073262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:21.075520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:21.080512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:21.081942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:21.083236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:21.084909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:21.085293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:21.148717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:21.148743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:21.148750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:21.148790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:21.148798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:21.148807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:21.148813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:21.148838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400652065738144:4227]
2025-10-15T10:56:21.148854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400652065738144:4227]
2025-10-15T10:56:21.148867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400652065738144:4227]
2025-10-15T10:56:21.148946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:21.148974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:21.148995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:21.149139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:21.149173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:21.150277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:21.169032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId: src_id|e19366ad-8a81de23-d437339e-e158cbad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:21.205755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:21.290139Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:21.292863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:21.292899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:21.293491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:21.293647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:21.293667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:21.294142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:21.327738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400649266033550:4202]
2025-10-15T10:56:21.328503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:21.329113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 238 reason: error at write: Disconnected sessionId: src_id|e19366ad-8a81de23-d437339e-e158cbad_0
2025-10-15T10:56:21.329878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19366ad-8a81de23-d437339e-e158cbad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:21.329958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19366ad-8a81de23-d437339e-e158cbad_0] Write session will restart in 0.005971s
2025-10-15T10:56:21.330127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19366ad-8a81de23-d437339e-e158cbad_0] Write session: Do CDS request
2025-10-15T10:56:21.330190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19366ad-8a81de23-d437339e-e158cbad_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:21.329404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 238 sessionId: src_id|e19366ad-8a81de23-d437339e-e158cbad_0 is DEAD
2025-10-15T10:56:21.335150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:21.336268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:21.336310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:21.336373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:21.336790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:21.337059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400656360705522:4237]
2025-10-15T10:56:21.339445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:21.340447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:21.340660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:21.341210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e19366ad-8a81de23-d437339e-e158cbad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:21.342006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:21.342333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:21.342349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:21.342355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:21.342362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:21.342369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:21.342376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:21.342383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:21.342389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:21.342395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:21.342403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:21.342409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:21.342415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.342422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.342429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.342479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:21.342586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:21.342635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:21.342679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:21.342727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:21.342781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:21.342832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:21.342875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:21.342922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:21.342972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:21.343026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:21.343076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.343128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.343176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.343220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:21.343293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:21.343598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:21.343678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:21.343741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:21.343793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:21.343839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:21.343894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:21.343947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:21.344003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:21.344047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:21.344103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:21.344153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:21.344209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:21.344286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:21.344380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:21.344462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:21.344566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:21.344636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:21.344726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:21.344814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:21.344908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:21.344978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.345074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.345165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.345264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.345342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.345423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.346246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:21.347986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:21.348027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 239
2025-10-15T10:56:21.349125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:21.349258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:21.349282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:21.349292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:21.350518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 239 sessionId:  describe result for acl check
2025-10-15T10:56:21.350623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:21.350633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:21.350642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:21.350658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400653561000914:4551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:21.353258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400653561000914:4551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:21.359470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400653561000914:4551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:21.364916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:21.368064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400653561000914:4551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:21.368115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400653561000914:4551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:21.368132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400653561000914:4551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:21.368164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:21.375262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:21.375305Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:21.375322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:21.375339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:21.375377Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 238 [2:7561400656360705522:4237]
2025-10-15T10:56:21.375435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:21.375489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:21.375504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:21.375516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:21.375526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:21.375569Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:21.375589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:21.375609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:21.394423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.394448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.394459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.394469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:21.394726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:21.394747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.394871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.394949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 238
2025-10-15T10:56:21.395046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.395262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:21.395275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 238
2025-10-15T10:56:21.395339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400653561000951:4551], now have 1 active actors on pipe
2025-10-15T10:56:21.395384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400653561000880:2467], now have 1 active actors on pipe
2025-10-15T10:56:21.395443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:21.395462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:21.395496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400656360705517:4237]
2025-10-15T10:56:21.395508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400656360705517:4237]
2025-10-15T10:56:21.395520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400656360705517:4237]
2025-10-15T10:56:21.395556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:21.395588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:21.395612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:21.395618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:21.395623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:21.395778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:21.395800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:21.395867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:21.395897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:21.395912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:21.395921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:21.395949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:21.395983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:21.396089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400656360705517:4237]
2025-10-15T10:56:21.396121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:21.396148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:21.396165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:21.396662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:21.396690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:21.396744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:21.396964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 239 partition: 0 MaxSeqNo: 46 sessionId: src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0
2025-10-15T10:56:21.397750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e19366ad-8a81de23-d437339e-e158cbad_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:21.418302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0] Write session: try to update token
2025-10-15T10:56:21.418358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:21.426416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:21.426443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:21.426468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400656360705517:4237]
2025-10-15T10:56:21.426569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:21.426613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:21.428047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400653561000959:4202]
2025-10-15T10:56:21.428739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 238, pipe: [1:7561400653561000959:4202]
2025-10-15T10:56:21.429183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:21.430374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:21.432251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:21.433893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:21.435477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:21.435996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400653561000959:4202], now have 1 active actors on pipe
2025-10-15T10:56:21.436041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:21.489967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId: src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:21.501453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:21.501479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:21.501489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:21.501497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:21.501523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400656360705517:4237]
2025-10-15T10:56:21.501539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400656360705517:4237]
2025-10-15T10:56:21.501554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400656360705517:4237]
2025-10-15T10:56:21.501673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:21.501686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:21.501697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:21.501715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:21.501735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:21.501750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:21.501760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:21.501795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:21.503323Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:21.522797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:21.642245Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:21.643691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:21.643733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:21.644466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:21.644406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400653561000959:4202]
2025-10-15T10:56:21.644595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:21.644630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:21.647597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:21.681207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:21.684169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:21.684939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:21.684960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:21.685000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:21.685188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:21.685354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400656360705616:4246]
2025-10-15T10:56:21.687149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:21.688250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:21.688456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:21.689554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:21.689808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:21.689825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:21.689832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:21.689839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:21.689845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:21.689852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:21.689858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:21.689863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:21.689870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:21.689877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:21.689883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:21.689889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.689895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.689902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.689947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:21.690049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:21.690115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:21.690221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:21.690347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:21.690486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:21.690598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:21.690692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:21.690815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:21.690952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:21.691061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:21.691189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.691305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.691464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.691583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:21.691724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:21.691867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:21.692039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:21.692174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:21.692357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:21.692421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:21.692484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:21.692483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 239 reason: error at write: Disconnected sessionId: src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0
2025-10-15T10:56:21.692540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:21.692597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:21.692647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:21.692706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:21.692745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 239 sessionId: src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0 is DEAD
2025-10-15T10:56:21.692759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:21.692816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:21.692867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:21.692994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:21.693120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:21.693246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:21.693289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:21.693340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0] Write session will restart in 0.009908s
2025-10-15T10:56:21.693341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:21.693464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:21.693518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0] Write session: Do CDS request
2025-10-15T10:56:21.693575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:21.693568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:21.693687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:21.693799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.693943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.694063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.694202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.694290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.694347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.694828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:21.707728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:21.707739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:21.707775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 240
2025-10-15T10:56:21.708326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:21.708464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:21.708484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:21.708495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:21.709643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 240 sessionId:  describe result for acl check
2025-10-15T10:56:21.709753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:21.709768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:21.709777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:21.709794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400653561000999:4557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:21.713078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400653561000999:4557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:21.713469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:21.722327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400653561000999:4557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:21.733207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400653561000999:4557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:21.733255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400653561000999:4557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:21.733275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400653561000999:4557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:21.733308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:21.736086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:21.736131Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:21.736149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:21.736171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:21.736195Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 239 [2:7561400656360705616:4246]
2025-10-15T10:56:21.736247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:21.736310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:21.736326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:21.736339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:21.736352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:21.736401Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:21.736432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:21.736454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:21.737465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.737488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.737502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.737514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:21.737809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:21.737835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:21.737996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:21.738210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:21.738133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 239
2025-10-15T10:56:21.738175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 239
2025-10-15T10:56:21.738462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:21.738553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400653561000963:2467], now have 1 active actors on pipe
2025-10-15T10:56:21.738581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400653561001028:4557], now have 1 active actors on pipe
2025-10-15T10:56:21.738648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:21.738675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:21.738713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400656360705611:4246]
2025-10-15T10:56:21.738732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400656360705611:4246]
2025-10-15T10:56:21.738745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400656360705611:4246]
2025-10-15T10:56:21.738783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:21.738820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:21.738842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:21.738854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:21.738861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:21.739057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:21.739079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:21.739150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:21.739185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:21.739207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:21.739219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:21.739256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:21.739300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:21.739472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400656360705611:4246]
2025-10-15T10:56:21.739512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:21.739538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:21.739573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:21.740442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:21.740471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:21.740538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:21.740829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 240 partition: 0 MaxSeqNo: 46 sessionId: src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0
2025-10-15T10:56:21.741833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18bc8e1c-4b448845-cd1c0300-15b4b542_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:21.744471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400653561001033:4202]
2025-10-15T10:56:21.744933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400653561001033:4202], now have 1 active actors on pipe
2025-10-15T10:56:21.744983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 239, pipe: [1:7561400653561001033:4202]
2025-10-15T10:56:21.762212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0] Write session: try to update token
2025-10-15T10:56:21.762274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:21.823508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:21.823544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:21.823571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:21.823581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:21.823628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400656360705611:4246]
2025-10-15T10:56:21.823654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400656360705611:4246]
2025-10-15T10:56:21.823678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400656360705611:4246]
2025-10-15T10:56:21.823798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:21.823839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:21.823871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:21.823898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:21.823928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:21.825346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:21.840135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId: src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:21.860220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:21.966718Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:21.976917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:21.976963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:21.977025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:21.977040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:21.977082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400656360705611:4246]
2025-10-15T10:56:21.977406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:21.977571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:21.977672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:21.977703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400653561001033:4202]
2025-10-15T10:56:21.977725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:21.977738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:22.006469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 240 reason: error at write: Disconnected sessionId: src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0
2025-10-15T10:56:22.006844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 240 sessionId: src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0 is DEAD
2025-10-15T10:56:22.007234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:22.007295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0] Write session will restart in 0.005357s
2025-10-15T10:56:22.007491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0] Write session: Do CDS request
2025-10-15T10:56:22.007542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:22.015204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:22.017814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:22.018165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:22.018454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:22.018493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 241
2025-10-15T10:56:22.018781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:22.018912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:22.018934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:22.018946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:22.019006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:22.019036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:22.019080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:22.019363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:22.019569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400660655672996:4250]
2025-10-15T10:56:22.020242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 241 sessionId:  describe result for acl check
2025-10-15T10:56:22.020349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:22.020365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:22.020374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:22.020388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400657855968376:4561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:22.021834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:22.022947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:22.023047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400657855968376:4561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:22.023164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:22.024815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:22.025365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.025392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.025407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.025423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.025441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.025458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.025471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.025483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.025493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.025506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.025519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.025531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.025542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.025555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.025642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.025849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.025930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.026003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.026087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.026207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.026307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.026397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.026480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.026572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.026638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.026685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.026732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.026780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.026824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.026892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.026953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.027007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.027056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.027112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.027160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.027213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.027263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.027316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.028169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.028242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.028298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.028360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.028414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.028477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.028533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.028596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.028644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.028707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.028763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.028828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.028881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.028943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.029000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.029060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.029114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.029174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.029215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400657855968376:4561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:22.029709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:22.040660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400657855968376:4561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:22.040716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400657855968376:4561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:22.040739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400657855968376:4561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:22.040774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:22.047993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:22.057108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:22.057158Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:22.057177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:22.057198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:22.057225Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 240 [2:7561400660655672996:4250]
2025-10-15T10:56:22.057279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:22.057343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:22.057367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:22.057381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:22.057393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:22.057445Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:22.057469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:22.057490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:22.058649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.058687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.058703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.058715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:22.059010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:22.059042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.059205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.059223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 240
2025-10-15T10:56:22.059244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 240
2025-10-15T10:56:22.059449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.059705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:22.059796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400657855968406:4561], now have 1 active actors on pipe
2025-10-15T10:56:22.059828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400653561001049:2467], now have 1 active actors on pipe
2025-10-15T10:56:22.059875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:22.059903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:22.059961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400660655672990:4250]
2025-10-15T10:56:22.059985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400660655672990:4250]
2025-10-15T10:56:22.059999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400660655672990:4250]
2025-10-15T10:56:22.060046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:22.060091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:22.060119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:22.060125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:22.060130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:22.060327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:22.060355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:22.060423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:22.060453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:22.060482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:22.060492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:22.060528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:22.060573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:22.060730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400660655672990:4250]
2025-10-15T10:56:22.060768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:22.060810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:22.060815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:22.061337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:22.061365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:22.061431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:22.061766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 241 partition: 0 MaxSeqNo: 46 sessionId: src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0
2025-10-15T10:56:22.062471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a036b4-6c2f5c9e-e87c6c25-e2d38c44_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:22.077840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400657855968411:4202]
2025-10-15T10:56:22.078409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400657855968411:4202], now have 1 active actors on pipe
2025-10-15T10:56:22.078464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 240, pipe: [1:7561400657855968411:4202]
2025-10-15T10:56:22.081565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0] Write session: try to update token
2025-10-15T10:56:22.081622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:22.098144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:22.098176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:22.098214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400660655672990:4250]
2025-10-15T10:56:22.098337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:22.098375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:22.100246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:22.101517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:22.102856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:22.104161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:22.106101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:22.106637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:22.160380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:22.160406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:22.160418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:22.160429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:22.160488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400660655672990:4250]
2025-10-15T10:56:22.160517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400660655672990:4250]
2025-10-15T10:56:22.160543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400660655672990:4250]
2025-10-15T10:56:22.160712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:22.160725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:22.160740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:22.160753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:22.160780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:22.160803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:22.160819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:22.160827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:22.161834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:22.169047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId: src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:22.189455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:22.306373Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:22.307902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:22.307942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:22.308418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:22.308431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:22.308446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:22.308678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400657855968411:4202]
2025-10-15T10:56:22.308800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:22.334853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 241 reason: error at write: Disconnected sessionId: src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0
2025-10-15T10:56:22.335235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 241 sessionId: src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0 is DEAD
2025-10-15T10:56:22.335704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:22.335756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0] Write session will restart in 0.006680s
2025-10-15T10:56:22.335906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0] Write session: Do CDS request
2025-10-15T10:56:22.335971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:22.345423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:22.347620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:22.347717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:22.347660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 242
2025-10-15T10:56:22.348187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:22.348325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:22.348350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:22.348360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:22.348957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:22.349567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 242 sessionId:  describe result for acl check
2025-10-15T10:56:22.349678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:22.349695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:22.349706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:22.349721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400657855968463:4567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:22.349850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:22.349877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:22.349917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:22.350183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:22.350380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400660655673066:4252]
2025-10-15T10:56:22.353582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400657855968463:4567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:22.354068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:22.355052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:22.355274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:22.356583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:22.356919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.356935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.356943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.356950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.356957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.356963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.356970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.356977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.356984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.356990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.356997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.357004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.357018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.357028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.357076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.357184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.357235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.357282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.357337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.357395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.357443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.357492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.358769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400657855968463:4567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:22.357542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.357608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.357668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.357722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.357771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.357817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.357862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.357930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.357990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.358043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.358096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.358150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.358196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.358253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.358303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.358358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.358403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.358461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.358507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.358564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.358611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.358665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.358719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.358774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.358838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.358894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.358940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.358994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.359036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.359087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.359132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.359185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.359227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.359279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.359914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:22.370540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400657855968463:4567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:22.370588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400657855968463:4567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:22.370608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400657855968463:4567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:22.370640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:22.378864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:22.388009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:22.388060Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:22.388082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:22.388106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:22.388134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 241 [2:7561400660655673066:4252]
2025-10-15T10:56:22.388193Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:22.388261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:22.388277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:22.388291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:22.388304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:22.388358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:22.388394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:22.388418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:22.389532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.389555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.389569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.389581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:22.389855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:22.389878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.390026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.390172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 241
2025-10-15T10:56:22.390238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.390198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 241
2025-10-15T10:56:22.390500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:22.390594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400657855968496:4567], now have 1 active actors on pipe
2025-10-15T10:56:22.390624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400657855968418:2467], now have 1 active actors on pipe
2025-10-15T10:56:22.390695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:22.390721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:22.390760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400660655673061:4252]
2025-10-15T10:56:22.390779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400660655673061:4252]
2025-10-15T10:56:22.390794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400660655673061:4252]
2025-10-15T10:56:22.390834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:22.390871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:22.390894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:22.390906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:22.390910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:22.391104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:22.391128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:22.391197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d413930-e7ef5b88-25f02c70-e0176623_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:22.391231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:22.391252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:22.391262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:22.391301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:22.391366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:22.391518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400660655673061:4252]
2025-10-15T10:56:22.391553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:22.391601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:22.391674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:22.392189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:22.392216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:22.392276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:22.392563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 242 partition: 0 MaxSeqNo: 46 sessionId: src_id|4d413930-e7ef5b88-25f02c70-e0176623_0
2025-10-15T10:56:22.393382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f27e3b6-4d4a8934-9735bb2-8a99908c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4d413930-e7ef5b88-25f02c70-e0176623_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:22.409379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400657855968505:4202]
2025-10-15T10:56:22.410094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400657855968505:4202], now have 1 active actors on pipe
2025-10-15T10:56:22.410210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 241, pipe: [1:7561400657855968505:4202]
2025-10-15T10:56:22.414554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d413930-e7ef5b88-25f02c70-e0176623_0] Write session: try to update token
2025-10-15T10:56:22.414609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d413930-e7ef5b88-25f02c70-e0176623_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:22.458797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:22.458829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:22.458861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400660655673061:4252]
2025-10-15T10:56:22.458981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:22.458993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:22.468390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:22.474657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:22.476344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:22.479809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:22.485406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:22.486273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:22.510424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:22.510460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:22.510472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:22.510544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:22.510560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:22.510575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:22.510585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:22.510627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400660655673061:4252]
2025-10-15T10:56:22.510653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400660655673061:4252]
2025-10-15T10:56:22.510677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400660655673061:4252]
2025-10-15T10:56:22.510836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:22.510849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:22.510872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:22.510891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:22.510920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:22.523631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId: src_id|4d413930-e7ef5b88-25f02c70-e0176623_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:22.524620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:22.546050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:22.673065Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:22.678905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:22.678952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:22.679508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:22.679689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400657855968505:4202]
2025-10-15T10:56:22.679678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:22.679787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:22.679815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:22.690458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 242 reason: error at write: Disconnected sessionId: src_id|4d413930-e7ef5b88-25f02c70-e0176623_0
2025-10-15T10:56:22.690814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 242 sessionId: src_id|4d413930-e7ef5b88-25f02c70-e0176623_0 is DEAD
2025-10-15T10:56:22.691302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d413930-e7ef5b88-25f02c70-e0176623_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:22.691367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d413930-e7ef5b88-25f02c70-e0176623_0] Write session will restart in 0.009134s
2025-10-15T10:56:22.691504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d413930-e7ef5b88-25f02c70-e0176623_0] Write session: Do CDS request
2025-10-15T10:56:22.691549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d413930-e7ef5b88-25f02c70-e0176623_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:22.707008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d413930-e7ef5b88-25f02c70-e0176623_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:22.719203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:22.719244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 243
2025-10-15T10:56:22.719702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:22.719823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:22.719840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:22.719848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:22.720803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 243 sessionId:  describe result for acl check
2025-10-15T10:56:22.720888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:22.720905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:22.720914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:22.720932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400657855968535:4577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:22.723256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400657855968535:4577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:22.729086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400657855968535:4577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:22.730509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:22.733766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:22.734538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:22.734564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:22.734609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:22.734802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:22.734934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400660655673150:4260]
2025-10-15T10:56:22.736915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:22.737773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:22.737969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:22.739089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:22.739424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.739439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.739446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.739453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.737258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400657855968535:4577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:22.739460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.737305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400657855968535:4577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:22.739465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.737324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400657855968535:4577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:22.739471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.737355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:22.739477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.739483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.739489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.739496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.739502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.739508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.739514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.739558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.739659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.739703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.739747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.739788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.739831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.739887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.739930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.739981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.740028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.740085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.740136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.740184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.740232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.740277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.740343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:22.740398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.740457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:22.740501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.740556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:22.740606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.740652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:22.740696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.740760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:22.740800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.740854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:22.740906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.740962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:22.741040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.741099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:22.741149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.741197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:22.741243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.741296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:22.741345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.741401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:22.741449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.741503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.741545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.741604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.741651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.741712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.742188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:22.759342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:22.771171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:22.771211Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:22.771223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:22.771240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:22.771261Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 242 [2:7561400660655673150:4260]
2025-10-15T10:56:22.771302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:22.771364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:22.771375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:22.771387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:22.771397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:22.771450Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:22.771469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:22.771486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:22.779799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400657855968589:4202]
2025-10-15T10:56:22.784004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.784030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.784040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.784048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:22.784287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:22.784306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:22.784409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:22.784575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:22.784646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 242
2025-10-15T10:56:22.784757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 242, pipe: [1:7561400657855968589:4202]
2025-10-15T10:56:22.784788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:22.784848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 242
2025-10-15T10:56:22.784874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400657855968520:2467], now have 1 active actors on pipe
2025-10-15T10:56:22.784902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400657855968589:4202], now have 1 active actors on pipe
2025-10-15T10:56:22.784921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400657855968584:4577], now have 1 active actors on pipe
2025-10-15T10:56:22.784960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400660655673145:4260]
2025-10-15T10:56:22.784980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400660655673145:4260]
2025-10-15T10:56:22.784991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400660655673145:4260]
2025-10-15T10:56:22.785016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:22.785049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:22.785063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:22.785073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:22.785076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:22.785222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:22.785243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:22.785291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:22.785312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:22.785417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400660655673145:4260]
2025-10-15T10:56:22.785447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:22.785505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee948626-5e28130a-4c13390c-ca235669_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:22.785508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:22.785535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:22.785549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:22.785558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:22.785587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:22.785621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:22.785731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:22.786153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:22.786176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:22.786241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:22.786490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 243 partition: 0 MaxSeqNo: 46 sessionId: src_id|ee948626-5e28130a-4c13390c-ca235669_0
2025-10-15T10:56:22.787401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d413930-e7ef5b88-25f02c70-e0176623_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ee948626-5e28130a-4c13390c-ca235669_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:22.806714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee948626-5e28130a-4c13390c-ca235669_0] Write session: try to update token
2025-10-15T10:56:22.806781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee948626-5e28130a-4c13390c-ca235669_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:22.860428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:22.860461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:22.860477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:22.860492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:22.860524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400660655673145:4260]
2025-10-15T10:56:22.860550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400660655673145:4260]
2025-10-15T10:56:22.860574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400660655673145:4260]
2025-10-15T10:56:22.860701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:22.860763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:22.860795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:22.860818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:22.860843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:22.862121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:22.888991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId: src_id|ee948626-5e28130a-4c13390c-ca235669_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:22.909042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:23.010001Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:23.024890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.024932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.024994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:23.025010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:23.025056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400660655673145:4260]
2025-10-15T10:56:23.025277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:23.025522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:23.025573Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:23.025556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400657855968589:4202]
2025-10-15T10:56:23.025669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:23.025685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:23.052454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:23.055458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:23.056266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:23.056296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:23.056339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:23.056593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:23.056776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400664950640559:4271]
2025-10-15T10:56:23.058880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:23.059614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:23.059818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:23.060979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:23.061302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.061322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.061328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.061335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.061341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.061347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.061353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.061359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.061365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.061371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.061378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.061383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.061389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.061396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.061438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.061539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.061601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.061646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.061687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.061730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.061792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.061840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.061889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.061939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.061992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.062033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.062096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.062146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.062191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.062258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.062319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.062374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.062426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.062484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.062531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.062600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.062656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.062715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.062765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.062822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.062873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.062928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.062976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.063037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.063088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.063144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.063192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.063242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.063288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.063366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.063430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.063482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.063535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.063589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.063646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.063694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.064165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:23.079010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:23.088571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 243 reason: error at write: Disconnected sessionId: src_id|ee948626-5e28130a-4c13390c-ca235669_0
2025-10-15T10:56:23.088935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 243 sessionId: src_id|ee948626-5e28130a-4c13390c-ca235669_0 is DEAD
2025-10-15T10:56:23.089375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee948626-5e28130a-4c13390c-ca235669_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:23.089430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee948626-5e28130a-4c13390c-ca235669_0] Write session will restart in 0.005863s
2025-10-15T10:56:23.089616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee948626-5e28130a-4c13390c-ca235669_0] Write session: Do CDS request
2025-10-15T10:56:23.089668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee948626-5e28130a-4c13390c-ca235669_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:23.098702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:23.098749Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:23.098767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:23.098786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:23.098808Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 243 [2:7561400664950640559:4271]
2025-10-15T10:56:23.098858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:23.098915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:23.098937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:23.098949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:23.098960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:23.099003Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:23.099029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:23.099052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:23.101314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:23.101358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 244
2025-10-15T10:56:23.101651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee948626-5e28130a-4c13390c-ca235669_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:23.102081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:23.102234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:23.102255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:23.102267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:23.103808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 244 sessionId:  describe result for acl check
2025-10-15T10:56:23.103925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:23.103952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:23.103965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:23.103984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400662150935951:4584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:23.106385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400662150935951:4584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:23.111830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400662150935951:4584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:23.119666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.119690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.119700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.119709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:23.119909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400662150935951:4584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:23.119958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:23.119959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400662150935951:4584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:23.119980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.119976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400662150935951:4584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:23.120007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:23.120090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.120235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.120421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:23.120451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 243
2025-10-15T10:56:23.120491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150935913:2467], now have 1 active actors on pipe
2025-10-15T10:56:23.120515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400664950640553:4271]
2025-10-15T10:56:23.120527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400664950640553:4271]
2025-10-15T10:56:23.120537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400664950640553:4271]
2025-10-15T10:56:23.120562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:23.120587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:23.120599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:23.120611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:23.120622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:23.120787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:23.120816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 243
2025-10-15T10:56:23.120810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:23.120940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150935980:4584], now have 1 active actors on pipe
2025-10-15T10:56:23.120963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400664950640553:4271]
2025-10-15T10:56:23.120985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:23.121010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:23.121075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.121097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.121185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:23.121217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:23.121233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:23.121241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:23.121272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:23.121311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:23.121377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:23.121836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.121861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.121931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:23.122227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 244 partition: 0 MaxSeqNo: 46 sessionId: src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0
2025-10-15T10:56:23.122886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee948626-5e28130a-4c13390c-ca235669_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:23.125859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400662150935985:4202]
2025-10-15T10:56:23.126291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150935985:4202], now have 1 active actors on pipe
2025-10-15T10:56:23.126328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 243, pipe: [1:7561400662150935985:4202]
2025-10-15T10:56:23.141826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0] Write session: try to update token
2025-10-15T10:56:23.141885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:23.188719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:23.188750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:23.188761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:23.188768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:23.188799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400664950640553:4271]
2025-10-15T10:56:23.188828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400664950640553:4271]
2025-10-15T10:56:23.188868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400664950640553:4271]
2025-10-15T10:56:23.189022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:23.189045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:23.189064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:23.189070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:23.189091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:23.190174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:23.206473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId: src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:23.228082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:23.333847Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:23.335494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.335530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.336423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400662150935985:4202]
2025-10-15T10:56:23.336455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:23.336570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:23.336593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:23.348101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 244 reason: error at write: Disconnected sessionId: src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0
2025-10-15T10:56:23.348472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 244 sessionId: src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0 is DEAD
2025-10-15T10:56:23.348807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:23.348846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0] Write session will restart in 0.009085s
2025-10-15T10:56:23.348972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0] Write session: Do CDS request
2025-10-15T10:56:23.349032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:23.362531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:23.362574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 245
2025-10-15T10:56:23.362720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:23.363206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:23.363339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:23.363371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:23.363379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:23.364375Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:23.364606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 245 sessionId:  describe result for acl check
2025-10-15T10:56:23.364714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:23.364735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:23.364744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:23.364762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400662150936036:4590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:23.368108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400662150936036:4590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:23.371009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:23.375823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400662150936036:4590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:23.376536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:23.377250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:23.377274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:23.377309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:23.377529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:23.377708Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400664950640632:4273]
2025-10-15T10:56:23.381237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:23.382274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:23.382470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:23.383402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:23.383707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.383723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.383729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.383735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.383742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.383747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.383753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.383759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.383765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.383771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.383777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.383783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.383789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.383795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.383835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.383934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.383978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.384026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.384071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.384112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.384151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.384193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.384238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.384290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.384340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.384380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.384420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.384463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.384508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.384571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.384629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.384677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.384726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.384778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.384820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.384863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.384920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.384977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.385022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.385074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.385121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.385170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.385223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.385276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.385322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.385373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.385414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.385477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.385519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.385563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.385608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.385657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.385697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.385619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400662150936036:4590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:23.385749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.385678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400662150936036:4590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:23.385693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400662150936036:4590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:23.385794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.385722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:23.385846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.386315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:23.402323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:23.411362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:23.411404Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:23.411433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:23.411451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:23.411473Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 244 [2:7561400664950640632:4273]
2025-10-15T10:56:23.411519Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:23.411570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:23.411583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:23.411595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:23.411606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:23.411668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:23.411687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:23.411707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:23.412710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.412735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.412748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.412758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:23.412958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:23.412979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.413093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.413242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.413311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 244
2025-10-15T10:56:23.413426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:23.413318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 244
2025-10-15T10:56:23.413498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150935991:2467], now have 1 active actors on pipe
2025-10-15T10:56:23.413525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150936068:4590], now have 1 active actors on pipe
2025-10-15T10:56:23.413564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.413586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.413632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400664950640627:4273]
2025-10-15T10:56:23.413648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400664950640627:4273]
2025-10-15T10:56:23.413656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400664950640627:4273]
2025-10-15T10:56:23.413679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:23.413709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:23.413720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:23.413721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:23.413732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:23.413835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:23.413851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:23.413889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:23.413918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:23.413937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:23.413946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:23.413970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:23.413995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:23.414075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400664950640627:4273]
2025-10-15T10:56:23.414095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:23.414113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:23.414120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:23.414536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.414557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.414597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:23.414825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 245 partition: 0 MaxSeqNo: 46 sessionId: src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0
2025-10-15T10:56:23.415605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87a5e0ca-5d486d00-5fea5585-ea3e73bf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:23.436370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0] Write session: try to update token
2025-10-15T10:56:23.436430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:23.436647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400662150936078:4202]
2025-10-15T10:56:23.437178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 244, pipe: [1:7561400662150936078:4202]
2025-10-15T10:56:23.444115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150936078:4202], now have 1 active actors on pipe
2025-10-15T10:56:23.444155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:23.444173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:23.444208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400664950640627:4273]
2025-10-15T10:56:23.444320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:23.444324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:23.446398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:23.460851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:23.462212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:23.463541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:23.465176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:23.465736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:23.505294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId: src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:23.510501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:23.510522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:23.510531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:23.510539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:23.510561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400664950640627:4273]
2025-10-15T10:56:23.510577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400664950640627:4273]
2025-10-15T10:56:23.510589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400664950640627:4273]
2025-10-15T10:56:23.510680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:23.510695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:23.510695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:23.510734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:23.510772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:23.511574Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:23.528137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:23.638132Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:23.639230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.639253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.639755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:23.639781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400662150936078:4202]
2025-10-15T10:56:23.639873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:23.639852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:23.639885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:23.667468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 245 reason: error at write: Disconnected sessionId: src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0
2025-10-15T10:56:23.667724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 245 sessionId: src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0 is DEAD
2025-10-15T10:56:23.668048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:23.668103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0] Write session will restart in 0.007488s
2025-10-15T10:56:23.668241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0] Write session: Do CDS request
2025-10-15T10:56:23.668273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:23.671795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:23.677676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:23.678492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:23.678520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:23.678557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:23.678797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:23.678984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400664950640706:4275]
2025-10-15T10:56:23.680223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:23.680253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 246
2025-10-15T10:56:23.680388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:23.680825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:23.680938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:23.680951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:23.680960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:23.681079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:23.681824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:23.681999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:23.682183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 246 sessionId:  describe result for acl check
2025-10-15T10:56:23.682271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:23.682280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:23.682288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:23.682303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400662150936121:4594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:23.683053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:23.683406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.683434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.683443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.683449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.683455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.683461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.683467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.683473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.683479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.683486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.683493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.683500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.683506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.683512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.683554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.683646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.683696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.683740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.683786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.683833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.683878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.684576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400662150936121:4594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:23.690523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400662150936121:4594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:23.683928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.683971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.684012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.684068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.684110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.684150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.684189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.684227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.684290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:23.684345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.684404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:23.684453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.684501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:23.684540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.684586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:23.684627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.684687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:23.684732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.684781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:23.684826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.684871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:23.684912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.684960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:23.685002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.685049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:23.685091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.685139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:23.685183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.685229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:23.685283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.685334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.685375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.685421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.685465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.685520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.685992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:23.696350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400662150936121:4594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:23.696379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400662150936121:4594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:23.696389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400662150936121:4594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:23.696411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:23.700132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:23.708983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:23.709023Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:23.709040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:23.709058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:23.709081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 245 [2:7561400664950640706:4275]
2025-10-15T10:56:23.709129Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:23.709180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:23.709194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:23.709206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:23.709216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:23.709259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:23.709278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:23.709296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:23.710598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.710619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.710639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.710650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:23.710864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:23.710882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:23.710996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:23.711063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 245
2025-10-15T10:56:23.711137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:23.711063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 245
2025-10-15T10:56:23.711337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:23.711437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150936152:4594], now have 1 active actors on pipe
2025-10-15T10:56:23.711464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150936082:2467], now have 1 active actors on pipe
2025-10-15T10:56:23.711520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.711539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.711571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400664950640701:4275]
2025-10-15T10:56:23.711587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400664950640701:4275]
2025-10-15T10:56:23.711596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400664950640701:4275]
2025-10-15T10:56:23.711624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:23.711647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:23.711656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:23.711663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:23.711685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:23.711827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:23.711843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:23.711891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|caf584d-52dcb75f-ebfb1286-6c922156_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:23.711922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:23.711944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:23.711951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:23.711979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:23.712009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:23.712105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400664950640701:4275]
2025-10-15T10:56:23.712126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:23.712147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:23.712164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:23.712588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.712626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.712695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:23.712930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 246 partition: 0 MaxSeqNo: 46 sessionId: src_id|caf584d-52dcb75f-ebfb1286-6c922156_0
2025-10-15T10:56:23.713506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab896e1c-2594b13c-9cdac314-4291edb9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|caf584d-52dcb75f-ebfb1286-6c922156_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:23.731280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caf584d-52dcb75f-ebfb1286-6c922156_0] Write session: try to update token
2025-10-15T10:56:23.731328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caf584d-52dcb75f-ebfb1286-6c922156_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:23.740282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400662150936159:4202]
2025-10-15T10:56:23.740929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:23.740960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:23.740994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400664950640701:4275]
2025-10-15T10:56:23.741023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 245, pipe: [1:7561400662150936159:4202]
2025-10-15T10:56:23.741096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150936159:4202], now have 1 active actors on pipe
2025-10-15T10:56:23.741098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:23.741153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:23.743056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:23.744405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:23.745870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:23.748003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:23.751183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:23.751716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:23.804378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId: src_id|caf584d-52dcb75f-ebfb1286-6c922156_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:23.813420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:23.813442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:23.813451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:23.813459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:23.813486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400664950640701:4275]
2025-10-15T10:56:23.813504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400664950640701:4275]
2025-10-15T10:56:23.813532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400664950640701:4275]
2025-10-15T10:56:23.813634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:23.813642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:23.813649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:23.813680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:23.813674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:23.813693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:23.813715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:23.813756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:23.814555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:23.827702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:23.947582Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:23.949355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:23.949382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:23.949892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:23.949922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:23.953849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:23.965836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:23.966062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400662150936159:4202]
2025-10-15T10:56:23.966177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 246 reason: error at write: Disconnected sessionId: src_id|caf584d-52dcb75f-ebfb1286-6c922156_0
2025-10-15T10:56:23.966540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 246 sessionId: src_id|caf584d-52dcb75f-ebfb1286-6c922156_0 is DEAD
2025-10-15T10:56:23.966922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf584d-52dcb75f-ebfb1286-6c922156_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:23.966961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf584d-52dcb75f-ebfb1286-6c922156_0] Write session will restart in 0.008258s
2025-10-15T10:56:23.967073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf584d-52dcb75f-ebfb1286-6c922156_0] Write session: Do CDS request
2025-10-15T10:56:23.967123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf584d-52dcb75f-ebfb1286-6c922156_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:23.980304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:23.980337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 247
2025-10-15T10:56:23.980488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caf584d-52dcb75f-ebfb1286-6c922156_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:23.980995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:23.981130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:23.981152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:23.981161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:23.982280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 247 sessionId:  describe result for acl check
2025-10-15T10:56:23.982381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:23.982399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:23.982408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:23.982434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400662150936194:4604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:23.985200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400662150936194:4604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:23.990036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400662150936194:4604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:23.997447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400662150936194:4604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:23.997490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400662150936194:4604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:23.997518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400662150936194:4604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:23.997554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:24.002128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:24.004980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:24.005688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:24.005716Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:24.005750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:24.005928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:24.006051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400669245608105:4285]
2025-10-15T10:56:24.007509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:24.008354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:24.008551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:24.009843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:24.010172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.010187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.010194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.010201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.010208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.010215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.010221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.010228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.010236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.010241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.010246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.010250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.010255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.010260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.010294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.010373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.010408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.010443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.010477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.010512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.010545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.010575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.010609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.010647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.010696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.010746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.010797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.010850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.010881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.010932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.010981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.011022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.011062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.011116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.011161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.011202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.011235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.011272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.011311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.011383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.011435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.011472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.011508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.011547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.011606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.011657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.011694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.011743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.011794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.011852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.011902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.011962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.012007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.012050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.012088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.012131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.012612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:24.037822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:24.047820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:24.047869Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:24.047886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:24.047904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:24.047928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 246 [2:7561400669245608105:4285]
2025-10-15T10:56:24.047974Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:24.048031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:24.048042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:24.048052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:24.048062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:24.048111Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:24.048132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:24.048155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:24.050194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.050219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.050232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.050243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:24.050500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:24.050522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.050652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.050747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 246
2025-10-15T10:56:24.050837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.050860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 246
2025-10-15T10:56:24.051011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:24.051076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150936187:2467], now have 1 active actors on pipe
2025-10-15T10:56:24.051096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400662150936241:4604], now have 1 active actors on pipe
2025-10-15T10:56:24.051142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:24.051160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:24.051188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400669245608100:4285]
2025-10-15T10:56:24.051197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400669245608100:4285]
2025-10-15T10:56:24.051206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400669245608100:4285]
2025-10-15T10:56:24.051229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:24.051268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:24.051277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:24.051283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:24.051295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:24.051488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:24.051506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:24.051557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e574a314-383e4943-9b805693-5c20cb6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:24.051588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:24.051603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:24.051609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:24.051641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:24.051681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:24.051774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400669245608100:4285]
2025-10-15T10:56:24.051795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:24.051818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:24.051825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:24.052261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:24.052279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:24.052322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:24.052530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 247 partition: 0 MaxSeqNo: 46 sessionId: src_id|e574a314-383e4943-9b805693-5c20cb6d_0
2025-10-15T10:56:24.053106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caf584d-52dcb75f-ebfb1286-6c922156_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e574a314-383e4943-9b805693-5c20cb6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:24.066373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400666445903553:4202]
2025-10-15T10:56:24.067017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400666445903553:4202], now have 1 active actors on pipe
2025-10-15T10:56:24.067062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 246, pipe: [1:7561400666445903553:4202]
2025-10-15T10:56:24.073679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e574a314-383e4943-9b805693-5c20cb6d_0] Write session: try to update token
2025-10-15T10:56:24.073728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e574a314-383e4943-9b805693-5c20cb6d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:24.081377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:24.081415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:24.081444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400669245608100:4285]
2025-10-15T10:56:24.081542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:24.081571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:24.083488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:24.084951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:24.086423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:24.087851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:24.089994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:24.098331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:24.143035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:24.143070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:24.143086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:24.143098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:24.143138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400669245608100:4285]
2025-10-15T10:56:24.143166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400669245608100:4285]
2025-10-15T10:56:24.143190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400669245608100:4285]
2025-10-15T10:56:24.143365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:24.143365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:24.143393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:24.143406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:24.143443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:24.145078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:24.165206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId: src_id|e574a314-383e4943-9b805693-5c20cb6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:24.184456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:24.295826Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:24.298369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:24.298401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:24.299235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:24.299382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400666445903553:4202]
2025-10-15T10:56:24.299476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:24.299485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:24.299702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:24.332004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:24.334764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 247 reason: error at write: Disconnected sessionId: src_id|e574a314-383e4943-9b805693-5c20cb6d_0
2025-10-15T10:56:24.335155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 247 sessionId: src_id|e574a314-383e4943-9b805693-5c20cb6d_0 is DEAD
2025-10-15T10:56:24.335531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574a314-383e4943-9b805693-5c20cb6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:24.335585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574a314-383e4943-9b805693-5c20cb6d_0] Write session will restart in 0.008614s
2025-10-15T10:56:24.335716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574a314-383e4943-9b805693-5c20cb6d_0] Write session: Do CDS request
2025-10-15T10:56:24.335754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574a314-383e4943-9b805693-5c20cb6d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:24.336802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:24.338291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:24.338335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:24.338421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:24.338895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:24.339200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400669245608191:4289]
2025-10-15T10:56:24.342089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:24.343128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:24.343437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:24.345019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:24.345434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.345454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.345462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.345470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.345477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.345484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.345492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.345500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.345507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.345514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.345521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.345529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.345536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.345543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.345594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.345720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.345774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.345823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.345873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.345929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.345977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.346033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.346090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.346137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.346188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.346239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.346300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.346367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.346419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.346508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.346584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.346658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.346716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.346779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.346832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.346897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.346954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.347011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.347060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.347119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.347166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.347220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.347267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.347334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.347406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.347479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.347532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.347578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.347625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.347673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.347711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.347749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.347783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.347822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.347858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.347896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.348322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:24.350429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:24.350475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 248
2025-10-15T10:56:24.351287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e574a314-383e4943-9b805693-5c20cb6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:24.354937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:24.355073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:24.355098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:24.355107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:24.356317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 248 sessionId:  describe result for acl check
2025-10-15T10:56:24.356416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:24.356432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:24.356441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:24.356457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400666445903624:4614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:24.358792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400666445903624:4614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:24.364399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400666445903624:4614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:24.366813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:24.372333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400666445903624:4614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:24.372388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400666445903624:4614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:24.372405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400666445903624:4614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:24.372435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:24.377448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:24.377492Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:24.377510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:24.377530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:24.377555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 247 [2:7561400669245608191:4289]
2025-10-15T10:56:24.377613Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:24.377674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:24.377689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:24.377702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:24.377714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:24.377766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:24.377800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:24.377823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:24.399667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400666445903656:4202]
2025-10-15T10:56:24.403545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.403575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.403587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.403599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:24.403884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:24.403917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.404059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.404177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 247
2025-10-15T10:56:24.404184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 247
2025-10-15T10:56:24.404250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 247, pipe: [1:7561400666445903656:4202]
2025-10-15T10:56:24.404241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.404471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:24.404559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400666445903573:2467], now have 1 active actors on pipe
2025-10-15T10:56:24.404589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400666445903655:4614], now have 1 active actors on pipe
2025-10-15T10:56:24.404612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400666445903656:4202], now have 1 active actors on pipe
2025-10-15T10:56:24.404686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:24.404714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:24.404754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400669245608182:4289]
2025-10-15T10:56:24.404770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400669245608182:4289]
2025-10-15T10:56:24.404784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400669245608182:4289]
2025-10-15T10:56:24.404834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:24.404860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:24.404883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:24.404895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:24.404916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:24.405105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:24.405131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:24.405201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:24.405237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:24.405261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:24.405272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:24.405310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:24.405361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:24.405485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400669245608182:4289]
2025-10-15T10:56:24.405518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:24.405559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:24.405567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:24.407387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:24.407419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:24.407503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:24.407784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 248 partition: 0 MaxSeqNo: 46 sessionId: src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0
2025-10-15T10:56:24.408443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e574a314-383e4943-9b805693-5c20cb6d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:24.428111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0] Write session: try to update token
2025-10-15T10:56:24.428152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:24.433367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:24.433397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:24.433442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400669245608182:4289]
2025-10-15T10:56:24.433560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:24.433578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:24.435869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:24.437472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:24.438940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:24.440454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:24.442316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:24.442914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:24.503968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:24.503999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:24.504009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:24.504065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:24.504088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:24.504102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:24.504112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:24.504159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400669245608182:4289]
2025-10-15T10:56:24.504185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400669245608182:4289]
2025-10-15T10:56:24.504207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400669245608182:4289]
2025-10-15T10:56:24.504363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:24.504396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:24.504394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:24.504457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:24.504491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:24.506886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:24.528172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId: src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:24.550472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:24.640848Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:24.642178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:24.642208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:24.642722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:24.642745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:24.642813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400666445903656:4202]
2025-10-15T10:56:24.642936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:24.642980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:24.655756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 248 reason: error at write: Disconnected sessionId: src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0
2025-10-15T10:56:24.656014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 248 sessionId: src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0 is DEAD
2025-10-15T10:56:24.656396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:24.656438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0] Write session will restart in 0.005911s
2025-10-15T10:56:24.656546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0] Write session: Do CDS request
2025-10-15T10:56:24.656574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:24.667239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:24.667278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 249
2025-10-15T10:56:24.667430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:24.667881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:24.667997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:24.668015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:24.668025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:24.669208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 249 sessionId:  describe result for acl check
2025-10-15T10:56:24.669314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:24.669328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:24.669336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:24.669351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400666445903680:4619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:24.671117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400666445903680:4619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:24.676545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400666445903680:4619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:24.680289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:24.684059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:24.684399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400666445903680:4619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:24.684448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400666445903680:4619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:24.684462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400666445903680:4619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:24.684499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:24.684890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:24.684922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:24.684966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:24.685209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:24.685397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400669245608282:4296]
2025-10-15T10:56:24.687711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:24.688486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:24.688710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:24.689956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:24.690263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.690278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.690285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.690292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.690298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.690304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.690312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.690318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.690325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.690332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.690340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.690347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.690353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.690360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.690404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.690516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.690565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.690622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.690672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.690726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.690776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.690828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.690881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.690928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.690972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.691027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.691079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.691127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.691172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.691242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:24.691315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.691392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:24.691455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.691513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:24.691559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.691609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:24.691660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.691715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:24.691778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.691837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:24.691922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.691985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:24.692044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.692107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:24.692167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.692236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:24.692300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.692374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:24.692430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.692505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:24.692563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.692627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.692678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.692736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.692785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.692839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.693357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:24.710143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:24.718393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:24.718422Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:24.718433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:24.718444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:24.718459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 248 [2:7561400669245608282:4296]
2025-10-15T10:56:24.718495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:24.718548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:24.718559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:24.718567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:24.718575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:24.718606Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:24.718622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:24.718642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:24.728766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.728783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.728791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.728798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:24.728972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:24.728986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:24.729077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:24.729195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:24.729371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:24.729355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 248
2025-10-15T10:56:24.729424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400666445903734:4619], now have 1 active actors on pipe
2025-10-15T10:56:24.729364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 248
2025-10-15T10:56:24.729441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400666445903665:2467], now have 1 active actors on pipe
2025-10-15T10:56:24.729457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400669245608277:4296]
2025-10-15T10:56:24.729465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400669245608277:4296]
2025-10-15T10:56:24.729471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400669245608277:4296]
2025-10-15T10:56:24.729493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:24.729529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:24.729536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:24.729545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:24.729558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:24.729665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:24.729684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:24.729726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:24.729744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:24.729859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400669245608277:4296]
2025-10-15T10:56:24.729883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:24.729919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:24.729944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:24.729965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:24.729976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:24.729982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:24.730004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:24.730030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:24.730124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:24.730778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:24.730799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:24.730853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:24.731155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 249 partition: 0 MaxSeqNo: 46 sessionId: src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0
2025-10-15T10:56:24.731974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f50ebe-a4c86d9-d867d5d3-ade8de0d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:24.743281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400666445903743:4202]
2025-10-15T10:56:24.743994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400666445903743:4202], now have 1 active actors on pipe
2025-10-15T10:56:24.744089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 248, pipe: [1:7561400666445903743:4202]
2025-10-15T10:56:24.752466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0] Write session: try to update token
2025-10-15T10:56:24.752527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:24.760353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:24.760383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:24.760418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400669245608277:4296]
2025-10-15T10:56:24.760535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:24.760555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:24.762795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:24.764199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:24.765509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:24.766877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:24.768740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:24.769220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:24.817391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:24.817430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:24.817448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:24.817462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:24.817504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400669245608277:4296]
2025-10-15T10:56:24.817539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400669245608277:4296]
2025-10-15T10:56:24.817565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400669245608277:4296]
2025-10-15T10:56:24.817671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:24.817693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:24.817696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:24.817717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:24.817730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:24.819717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:24.828930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId: src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:24.850672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:24.958526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:24.960091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:24.960130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:24.960616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400666445903743:4202]
2025-10-15T10:56:24.960678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:24.960752Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:24.960702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:24.960718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:24.970830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 249 reason: error at write: Disconnected sessionId: src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0
2025-10-15T10:56:24.971194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 249 sessionId: src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0 is DEAD
2025-10-15T10:56:24.971580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:24.971636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0] Write session will restart in 0.008262s
2025-10-15T10:56:24.971813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0] Write session: Do CDS request
2025-10-15T10:56:24.971855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:24.984293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:24.984347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 250
2025-10-15T10:56:24.984521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:24.985229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:24.985466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:24.985504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:24.985520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:24.987238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 250 sessionId:  describe result for acl check
2025-10-15T10:56:24.987384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:24.987406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:24.987419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:24.987453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400666445903796:4623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:24.990939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400666445903796:4623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:24.993939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:24.995831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400666445903796:4623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:24.996985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:24.997830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:24.997860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:24.997905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:24.998157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:24.998335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400669245608375:4299]
2025-10-15T10:56:25.000687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:25.001469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400666445903796:4623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:25.001500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400666445903796:4623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:25.001518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400666445903796:4623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:25.001548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:25.001542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:25.001742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:25.003041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:25.003400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.003422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.003429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.003436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.003456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.003463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.003470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.003477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.003484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.003492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.003500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.003507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.003515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.003522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.003568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.003681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.003732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.003789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.003842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.003899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.003944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.003999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.004051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.004107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.004161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.004212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.004265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.004319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.004372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.004453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.004523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.004587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.004641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.004703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.004757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.004820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.004877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.004939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.004996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.005059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.005114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.005177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.005231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.005306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.005363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.005425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.005482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.005544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.005599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.005662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.005731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.005795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.005850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.005916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.005970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.006035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.006591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:25.032168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:25.041673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:25.041731Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:25.041752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:25.041774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:25.041799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 249 [2:7561400669245608375:4299]
2025-10-15T10:56:25.041858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:25.041927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:25.041952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:25.041965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:25.041977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:25.042028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:25.042059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:25.042082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:25.043191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.043218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.043232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.043246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:25.043569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:25.043603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.043762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.043874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 249
2025-10-15T10:56:25.043882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 249
2025-10-15T10:56:25.043972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.044228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:25.044324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871122:4623], now have 1 active actors on pipe
2025-10-15T10:56:25.044357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400666445903757:2467], now have 1 active actors on pipe
2025-10-15T10:56:25.044419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:25.044442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:25.044501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400669245608363:4299]
2025-10-15T10:56:25.044523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400669245608363:4299]
2025-10-15T10:56:25.044538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400669245608363:4299]
2025-10-15T10:56:25.044577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:25.044603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:25.044618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:25.044631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:25.044657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:25.044850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:25.044880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:25.044947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b957539-2fc2ddba-2986134-e103c709_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:25.044986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:25.045010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:25.045021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:25.045057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:25.045109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:25.045256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400669245608363:4299]
2025-10-15T10:56:25.045296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:25.045326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:25.045345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:25.045828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:25.045857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:25.045932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:25.046236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 250 partition: 0 MaxSeqNo: 46 sessionId: src_id|1b957539-2fc2ddba-2986134-e103c709_0
2025-10-15T10:56:25.047122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f49a8a3-d0ed15d6-a4e38d32-f4bdbac7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1b957539-2fc2ddba-2986134-e103c709_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:25.060705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400670740871133:4202]
2025-10-15T10:56:25.061243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871133:4202], now have 1 active actors on pipe
2025-10-15T10:56:25.061334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 249, pipe: [1:7561400670740871133:4202]
2025-10-15T10:56:25.067910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b957539-2fc2ddba-2986134-e103c709_0] Write session: try to update token
2025-10-15T10:56:25.067965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b957539-2fc2ddba-2986134-e103c709_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:25.074888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:25.074918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:25.074951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400669245608363:4299]
2025-10-15T10:56:25.075061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:25.075079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:25.077283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:25.078986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:25.080463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:25.081826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:25.083649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:25.084060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:25.135815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId: src_id|1b957539-2fc2ddba-2986134-e103c709_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:25.138833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:25.138863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:25.138876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:25.138884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:25.138918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400669245608363:4299]
2025-10-15T10:56:25.138941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400669245608363:4299]
2025-10-15T10:56:25.138962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400669245608363:4299]
2025-10-15T10:56:25.139088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:25.139086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:25.139114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:25.139121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:25.139150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:25.140169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:25.154787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:25.282054Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:25.283422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:25.283470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:25.284036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:25.284097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:25.284044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:25.284075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:25.284256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400670740871133:4202]
2025-10-15T10:56:25.300929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 250 reason: error at write: Disconnected sessionId: src_id|1b957539-2fc2ddba-2986134-e103c709_0
2025-10-15T10:56:25.301269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 250 sessionId: src_id|1b957539-2fc2ddba-2986134-e103c709_0 is DEAD
2025-10-15T10:56:25.301635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b957539-2fc2ddba-2986134-e103c709_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:25.301691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b957539-2fc2ddba-2986134-e103c709_0] Write session will restart in 0.008299s
2025-10-15T10:56:25.301861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b957539-2fc2ddba-2986134-e103c709_0] Write session: Do CDS request
2025-10-15T10:56:25.301921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b957539-2fc2ddba-2986134-e103c709_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:25.319254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:25.319291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 251
2025-10-15T10:56:25.319519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b957539-2fc2ddba-2986134-e103c709_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:25.319990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:25.320153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:25.320178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:25.320189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:25.321549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 251 sessionId:  describe result for acl check
2025-10-15T10:56:25.321664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:25.321685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:25.321695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:25.321712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400670740871185:4628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:25.320107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:25.323128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:25.323857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:25.323885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:25.323920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:25.324141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:25.324312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400673540575752:4302]
2025-10-15T10:56:25.324296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400670740871185:4628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:25.326361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:25.327149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:25.327327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:25.328277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:25.328568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.328583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.328588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.328594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.328601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.328607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.328614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.328621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.328628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.328634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.328642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.328647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.328653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.328659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.328701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.328799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.328844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.328885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.328926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.328970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.329017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.329077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.329123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.329170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.329215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.329260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.329308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.329268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400670740871185:4628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:25.329354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.329403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.329460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.329509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.329563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.329615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.329671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.329718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.329756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.329790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.329844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.329889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.329937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.329969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.330005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.330040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.330081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.330115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.330159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.330197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.330235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.330269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.330308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.330342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.330376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.330424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.330469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.330505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.330545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.330977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:25.339691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400670740871185:4628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:25.339736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400670740871185:4628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:25.339753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400670740871185:4628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:25.339784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:25.352442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:25.362722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:25.362750Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:25.362759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:25.362769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:25.362785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 250 [2:7561400673540575752:4302]
2025-10-15T10:56:25.362816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:25.362852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:25.362861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:25.362870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:25.362879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:25.362915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:25.362929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:25.362945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:25.364972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.364995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.365008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.365016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:25.365248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:25.365271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.365371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.365501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.365471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 250
2025-10-15T10:56:25.365559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 250
2025-10-15T10:56:25.365714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:25.365784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871218:4628], now have 1 active actors on pipe
2025-10-15T10:56:25.365810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871139:2467], now have 1 active actors on pipe
2025-10-15T10:56:25.365849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:25.365871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:25.365914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400673540575747:4302]
2025-10-15T10:56:25.365932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400673540575747:4302]
2025-10-15T10:56:25.365943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400673540575747:4302]
2025-10-15T10:56:25.365971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:25.366006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:25.366025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:25.366026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:25.366036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:25.366175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:25.366197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:25.366249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80d8de00-33366a5e-927a084e-c23cbeea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:25.366281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:25.366297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:25.366307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:25.366335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:25.366370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:25.366487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400673540575747:4302]
2025-10-15T10:56:25.366518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:25.366541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:25.366556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:25.367131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:25.367150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:25.367187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:25.368602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 251 partition: 0 MaxSeqNo: 46 sessionId: src_id|80d8de00-33366a5e-927a084e-c23cbeea_0
2025-10-15T10:56:25.369286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b957539-2fc2ddba-2986134-e103c709_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|80d8de00-33366a5e-927a084e-c23cbeea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:25.384298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400670740871245:4202]
2025-10-15T10:56:25.384718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871245:4202], now have 1 active actors on pipe
2025-10-15T10:56:25.384759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 250, pipe: [1:7561400670740871245:4202]
2025-10-15T10:56:25.389563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80d8de00-33366a5e-927a084e-c23cbeea_0] Write session: try to update token
2025-10-15T10:56:25.389610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80d8de00-33366a5e-927a084e-c23cbeea_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:25.408920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:25.408947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:25.408974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400673540575747:4302]
2025-10-15T10:56:25.409081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:25.409127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:25.411050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:25.412391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:25.413574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:25.415036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:25.416700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:25.417280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:25.446344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:25.446370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:25.446384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:25.446402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:25.446436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400673540575747:4302]
2025-10-15T10:56:25.446461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400673540575747:4302]
2025-10-15T10:56:25.446487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400673540575747:4302]
2025-10-15T10:56:25.446631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:25.446666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:25.446741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:25.446814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:25.446866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:25.448635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:25.476344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId: src_id|80d8de00-33366a5e-927a084e-c23cbeea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:25.497054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:25.586037Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:25.592345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:25.592387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:25.592865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:25.592896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:25.593214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:25.617964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400670740871245:4202]
2025-10-15T10:56:25.618044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:25.618175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 251 reason: error at write: Disconnected sessionId: src_id|80d8de00-33366a5e-927a084e-c23cbeea_0
2025-10-15T10:56:25.618516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 251 sessionId: src_id|80d8de00-33366a5e-927a084e-c23cbeea_0 is DEAD
2025-10-15T10:56:25.618920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d8de00-33366a5e-927a084e-c23cbeea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:25.618966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d8de00-33366a5e-927a084e-c23cbeea_0] Write session will restart in 0.006561s
2025-10-15T10:56:25.619155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d8de00-33366a5e-927a084e-c23cbeea_0] Write session: Do CDS request
2025-10-15T10:56:25.619203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d8de00-33366a5e-927a084e-c23cbeea_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:25.628423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:25.631028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80d8de00-33366a5e-927a084e-c23cbeea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:25.633203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:25.634373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:25.634411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:25.634459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:25.634835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:25.635085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400673540575844:4310]
2025-10-15T10:56:25.637592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:25.637624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 252
2025-10-15T10:56:25.638004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:25.638074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:25.638131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:25.638154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:25.638165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:25.638860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:25.639027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:25.639473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 252 sessionId:  describe result for acl check
2025-10-15T10:56:25.639585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:25.639601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:25.639610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:25.639628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400670740871293:4639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:25.640095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:25.640356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.640367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.640371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.640375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.640380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.640384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.640388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.640394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.640401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.640407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.640415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.640421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.640427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.640433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.640475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.640584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.640627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.640670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.640720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.640769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.640816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.640862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.640901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.640949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.640997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.641044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.641089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.641124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.641153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.641206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.641260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.641310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.641359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.641413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.641460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.641507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.641555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.641611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.641659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.641706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.641753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.641804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.641849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.641904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.641949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.642006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.642053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.642109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.642154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.642201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.642244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.642298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.642275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400670740871293:4639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:25.642346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.642397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.642441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.642494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.642948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:25.647638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400670740871293:4639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:25.654944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400670740871293:4639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:25.654986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400670740871293:4639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:25.655004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400670740871293:4639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:25.655034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:25.658291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:25.676073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:25.676107Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:25.676117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:25.676130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:25.676146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 251 [2:7561400673540575844:4310]
2025-10-15T10:56:25.676179Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:25.676223Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:25.676232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:25.676241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:25.676248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:25.676279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:25.676293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:25.676308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:25.678294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.678317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.678331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.678341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:25.678606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:25.678636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.678766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.678848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 251
2025-10-15T10:56:25.678942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.678964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 251
2025-10-15T10:56:25.679177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:25.679250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871260:2467], now have 1 active actors on pipe
2025-10-15T10:56:25.679278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871323:4639], now have 1 active actors on pipe
2025-10-15T10:56:25.679333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:25.679368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:25.679402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400673540575838:4310]
2025-10-15T10:56:25.679419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400673540575838:4310]
2025-10-15T10:56:25.679431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400673540575838:4310]
2025-10-15T10:56:25.679477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:25.679529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:25.679549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:25.679568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:25.679582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:25.679725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:25.679747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:25.679807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a38fce26-f4ad602c-556dae22-fcf40746_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:25.679837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:25.679853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:25.679863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:25.679904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:25.679941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:25.680053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400673540575838:4310]
2025-10-15T10:56:25.680090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:25.680132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:25.680148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:25.680786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:25.680812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:25.680872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:25.681158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 252 partition: 0 MaxSeqNo: 46 sessionId: src_id|a38fce26-f4ad602c-556dae22-fcf40746_0
2025-10-15T10:56:25.681913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80d8de00-33366a5e-927a084e-c23cbeea_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a38fce26-f4ad602c-556dae22-fcf40746_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:25.702809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fce26-f4ad602c-556dae22-fcf40746_0] Write session: try to update token
2025-10-15T10:56:25.702864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fce26-f4ad602c-556dae22-fcf40746_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:25.709391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:25.709437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:25.709491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400673540575838:4310]
2025-10-15T10:56:25.709621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:25.709633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:25.711719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:25.713205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:25.714572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:25.715938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:25.717986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:25.718134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400670740871331:4202]
2025-10-15T10:56:25.718840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 251, pipe: [1:7561400670740871331:4202]
2025-10-15T10:56:25.750748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871331:4202], now have 1 active actors on pipe
2025-10-15T10:56:25.750804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:25.792585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:25.792618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:25.792635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:25.792646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:25.792688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400673540575838:4310]
2025-10-15T10:56:25.792713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400673540575838:4310]
2025-10-15T10:56:25.792736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400673540575838:4310]
2025-10-15T10:56:25.792859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:25.792898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:25.792909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:25.792922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:25.792934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:25.792934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:25.792983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:25.793004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:25.794190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:25.824075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId: src_id|a38fce26-f4ad602c-556dae22-fcf40746_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:25.844418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:25.936493Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:25.937791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:25.937829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:25.938486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:25.938494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:25.938499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400670740871331:4202]
2025-10-15T10:56:25.938526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:25.938575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:25.947770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 252 reason: error at write: Disconnected sessionId: src_id|a38fce26-f4ad602c-556dae22-fcf40746_0
2025-10-15T10:56:25.948124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 252 sessionId: src_id|a38fce26-f4ad602c-556dae22-fcf40746_0 is DEAD
2025-10-15T10:56:25.948476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fce26-f4ad602c-556dae22-fcf40746_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:25.948556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fce26-f4ad602c-556dae22-fcf40746_0] Write session will restart in 0.006941s
2025-10-15T10:56:25.948731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fce26-f4ad602c-556dae22-fcf40746_0] Write session: Do CDS request
2025-10-15T10:56:25.948781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fce26-f4ad602c-556dae22-fcf40746_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:25.960295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fce26-f4ad602c-556dae22-fcf40746_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:25.960274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:25.960316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 253
2025-10-15T10:56:25.960778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:25.960892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:25.960907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:25.960914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:25.961973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 253 sessionId:  describe result for acl check
2025-10-15T10:56:25.962083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:25.962115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:25.962125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:25.962136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400670740871370:4646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:25.964659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400670740871370:4646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:25.973369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400670740871370:4646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:25.975232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:25.978284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:25.979102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:25.979130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:25.979170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:25.979429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:25.979628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400673540575953:4320]
2025-10-15T10:56:25.980107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400670740871370:4646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:25.980163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400670740871370:4646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:25.980179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400670740871370:4646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:25.980206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:25.981780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:25.982623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:25.982821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:25.984078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:25.984384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.984401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.984407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.984415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.984421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.984428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.984434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.984440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.984446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.984453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.984460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.984465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.984472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.984480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.984524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.984625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.984667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.984708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.984755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.984800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.984846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.984892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.984937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.984979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.985021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.985064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.985107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.985149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.985186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.985243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:25.985294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.985346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:25.985390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.985440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:25.985480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.985527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:25.985569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.985617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:25.985657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.985708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:25.985751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.985800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:25.985842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.985890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:25.985933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.985989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:25.986026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.986074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:25.986120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.986163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:25.986202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.986248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:25.986290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.986337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:25.986377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.986427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:25.986852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:26.005206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:26.014843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:26.014878Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:26.014890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:26.014907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:26.014927Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 252 [2:7561400673540575953:4320]
2025-10-15T10:56:26.014967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:26.015019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:26.015032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:26.015043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:26.015053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:26.015090Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:26.015109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:26.015128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:26.016213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.016238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.016256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.016268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:26.016556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:26.016579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.016735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.016831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 252
2025-10-15T10:56:26.016880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 252
2025-10-15T10:56:26.016943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.017196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:26.017289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871425:4646], now have 1 active actors on pipe
2025-10-15T10:56:26.017319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400670740871352:2467], now have 1 active actors on pipe
2025-10-15T10:56:26.017389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:26.017415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:26.017457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400673540575948:4320]
2025-10-15T10:56:26.017477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400673540575948:4320]
2025-10-15T10:56:26.017491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400673540575948:4320]
2025-10-15T10:56:26.017527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:26.017547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:26.017557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:26.017565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:26.017613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:26.017810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:26.017833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:26.017902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:26.017938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:26.017960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:26.017972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:26.018008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:26.018056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:26.018201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400673540575948:4320]
2025-10-15T10:56:26.018239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:26.018284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:26.018282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:26.018786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:26.018815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:26.018888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:26.019156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 253 partition: 0 MaxSeqNo: 46 sessionId: src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0
2025-10-15T10:56:26.019910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fce26-f4ad602c-556dae22-fcf40746_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:26.038633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400675035838733:4202]
2025-10-15T10:56:26.039111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 252, pipe: [1:7561400675035838733:4202]
2025-10-15T10:56:26.040570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0] Write session: try to update token
2025-10-15T10:56:26.040631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:26.048935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400675035838733:4202], now have 1 active actors on pipe
2025-10-15T10:56:26.048982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:26.049000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:26.049039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400673540575948:4320]
2025-10-15T10:56:26.049170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:26.049180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:26.051174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:26.052573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:26.053981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:26.055383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:26.057262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:26.088007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:26.124584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId: src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:26.132228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:26.132261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:26.132274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:26.132285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:26.132326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400673540575948:4320]
2025-10-15T10:56:26.132352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400673540575948:4320]
2025-10-15T10:56:26.132375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400673540575948:4320]
2025-10-15T10:56:26.132523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:26.132545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:26.132558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:26.132564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:26.132570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:26.132594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:26.132616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:26.132638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:26.133592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:26.144266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:26.282918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:26.284340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:26.284380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:26.284949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400675035838733:4202]
2025-10-15T10:56:26.284998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:26.285012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:26.285048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:26.285139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:26.294769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 253 reason: error at write: Disconnected sessionId: src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0
2025-10-15T10:56:26.295025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 253 sessionId: src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0 is DEAD
2025-10-15T10:56:26.295407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:26.295436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0] Write session will restart in 0.009699s
2025-10-15T10:56:26.295536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0] Write session: Do CDS request
2025-10-15T10:56:26.295564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:26.316961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:26.316994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 254
2025-10-15T10:56:26.317258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:26.317886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:26.318040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:26.318064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:26.318074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:26.319175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 254 sessionId:  describe result for acl check
2025-10-15T10:56:26.319280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:26.319297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:26.319308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:26.319325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400675035838781:4651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:26.321697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400675035838781:4651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:26.322189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:26.326114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:26.326880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:26.326909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:26.326947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:26.327172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:26.327397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400677835543343:4323]
2025-10-15T10:56:26.328354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400675035838781:4651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:26.329399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:26.330328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:26.330537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:26.331812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:26.332134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:26.332155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:26.332163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:26.332170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:26.332178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:26.332185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:26.332190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:26.332196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:26.332203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:26.332209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:26.332214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:26.332220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.332226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.332232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.332274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:26.332370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:26.332412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:26.332456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:26.332497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:26.332546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:26.332591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:26.332637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:26.332686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:26.332733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:26.332778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:26.332823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.332871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.332916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.332962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:26.333024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:26.333082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:26.333138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:26.333190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:26.333240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:26.333287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:26.333342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:26.333392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:26.333445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:26.333490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:26.333545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:26.333596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:26.333651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:26.333702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:26.333755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:26.333804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:26.333856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:26.333902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:26.333955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:26.334000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:26.334050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:26.334095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.334146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.334193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.334245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.334290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.334339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.334543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400675035838781:4651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:26.334591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400675035838781:4651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:26.334607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400675035838781:4651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:26.334639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:26.334811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:26.350342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:26.370330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:26.370366Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:26.370382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:26.370400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:26.370421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 253 [2:7561400677835543343:4323]
2025-10-15T10:56:26.370467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:26.370515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:26.370527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:26.370538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:26.370548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:26.370587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:26.370606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:26.370623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:26.372073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.372091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.372101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.372111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:26.372383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:26.372409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.372683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 253
2025-10-15T10:56:26.372719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 253
2025-10-15T10:56:26.372550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.372726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.372950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:26.373008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400675035838738:2467], now have 1 active actors on pipe
2025-10-15T10:56:26.373022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400675035838814:4651], now have 1 active actors on pipe
2025-10-15T10:56:26.373066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:26.373079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:26.373103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400677835543338:4323]
2025-10-15T10:56:26.373116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400677835543338:4323]
2025-10-15T10:56:26.373128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400677835543338:4323]
2025-10-15T10:56:26.373165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:26.373205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:26.373219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:26.373219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:26.373230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:26.373366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:26.373377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:26.373420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:26.373447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:26.373463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:26.373472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:26.373499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:26.373531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:26.373643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400677835543338:4323]
2025-10-15T10:56:26.373673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:26.373694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:26.373713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:26.374295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:26.374316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:26.374396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:26.374728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 254 partition: 0 MaxSeqNo: 46 sessionId: src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0
2025-10-15T10:56:26.375565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d17071e-7c78aeb2-892f9a6c-c0496510_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:26.385276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400675035838833:4202]
2025-10-15T10:56:26.385852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400675035838833:4202], now have 1 active actors on pipe
2025-10-15T10:56:26.385909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 253, pipe: [1:7561400675035838833:4202]
2025-10-15T10:56:26.397182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0] Write session: try to update token
2025-10-15T10:56:26.397234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:26.402899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:26.402929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:26.402963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400677835543338:4323]
2025-10-15T10:56:26.403070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:26.403078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:26.404941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:26.406411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:26.407843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:26.409392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:26.411307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:26.422515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:26.471915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:26.471942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:26.471955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:26.471963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:26.471995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400677835543338:4323]
2025-10-15T10:56:26.472016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400677835543338:4323]
2025-10-15T10:56:26.472035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400677835543338:4323]
2025-10-15T10:56:26.472162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:26.472173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:26.472184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:26.472194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:26.472201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:26.472233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:26.472236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:26.472248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:26.473347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:26.475915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId: src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:26.496789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:26.605616Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:26.606982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:26.607017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:26.607449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:26.607595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:26.607614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:26.607617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400675035838833:4202]
2025-10-15T10:56:26.607825Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:26.616699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 254 reason: error at write: Disconnected sessionId: src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0
2025-10-15T10:56:26.617021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 254 sessionId: src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0 is DEAD
2025-10-15T10:56:26.617399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:26.617474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0] Write session will restart in 0.007802s
2025-10-15T10:56:26.617662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0] Write session: Do CDS request
2025-10-15T10:56:26.617733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:26.629903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:26.629939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 255
2025-10-15T10:56:26.630137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:26.630604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:26.630725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:26.630743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:26.630752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:26.632143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 255 sessionId:  describe result for acl check
2025-10-15T10:56:26.632259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:26.632279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:26.632288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:26.632311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400675035838854:4656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:26.635107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400675035838854:4656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:26.642470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400675035838854:4656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:26.644953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:26.647890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:26.648525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400675035838854:4656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:26.648562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400675035838854:4656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:26.648577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400675035838854:4656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:26.648602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:26.648700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:26.648728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:26.648770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:26.649014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:26.649199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400677835543426:4325]
2025-10-15T10:56:26.651486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:26.652334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:26.652552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:26.653693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:26.653985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:26.654021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:26.654029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:26.654036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:26.654042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:26.654050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:26.654057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:26.654065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:26.654073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:26.654080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:26.654089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:26.654095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.654104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.654112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.654155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:26.654240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:26.654275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:26.654312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:26.654347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:26.654379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:26.654422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:26.654469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:26.654530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:26.654583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:26.654637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:26.654688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.654737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.654777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.654813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:26.654878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:26.654942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:26.654999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:26.655049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:26.655121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:26.655168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:26.655227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:26.655282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:26.655324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:26.655374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:26.655418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:26.655456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:26.655510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:26.655547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:26.655588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:26.655628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:26.655671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:26.655708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:26.655753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:26.655790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:26.655834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:26.655871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.655915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.655952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.656009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.656047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.656106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.656615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:26.684729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:26.694449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:26.694491Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:26.694507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:26.694526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:26.694549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 254 [2:7561400677835543426:4325]
2025-10-15T10:56:26.694594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:26.694648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:26.694662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:26.694672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:26.694683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:26.694728Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:26.694748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:26.694769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:26.695989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.696012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.696026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.696036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:26.696301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:26.696325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:26.696458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:26.696539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 254
2025-10-15T10:56:26.696642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:26.696652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 254
2025-10-15T10:56:26.696865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:26.696949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400675035838914:4656], now have 1 active actors on pipe
2025-10-15T10:56:26.696978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400675035838839:2467], now have 1 active actors on pipe
2025-10-15T10:56:26.697022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:26.697046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:26.697091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400677835543421:4325]
2025-10-15T10:56:26.697115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400677835543421:4325]
2025-10-15T10:56:26.697129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400677835543421:4325]
2025-10-15T10:56:26.697163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:26.697201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:26.697216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:26.697226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:26.697226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:26.697388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:26.697410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:26.697467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:26.697500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:26.697516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:26.697525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:26.697556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:26.697600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:26.697715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400677835543421:4325]
2025-10-15T10:56:26.697745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:26.697789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:26.697788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:26.698267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:26.698298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:26.698370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:26.698694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 255 partition: 0 MaxSeqNo: 46 sessionId: src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0
2025-10-15T10:56:26.699545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1de5574-43b55c39-e03987f0-26e5a3f4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:26.709027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400675035838923:4202]
2025-10-15T10:56:26.709880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400675035838923:4202], now have 1 active actors on pipe
2025-10-15T10:56:26.710045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 254, pipe: [1:7561400675035838923:4202]
2025-10-15T10:56:26.728652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0] Write session: try to update token
2025-10-15T10:56:26.728735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:26.743385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:26.743417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:26.743477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400677835543421:4325]
2025-10-15T10:56:26.743612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:26.743699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:26.761234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:26.762497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:26.763765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:26.764940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:26.766532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:26.766910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:26.798845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:26.798867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:26.798877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:26.852950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:26.852989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:26.853001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:26.853013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:26.853056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400677835543421:4325]
2025-10-15T10:56:26.853083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400677835543421:4325]
2025-10-15T10:56:26.853105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400677835543421:4325]
2025-10-15T10:56:26.853221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:26.853241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:26.853252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:26.853259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:26.853276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:26.854262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:26.916658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId: src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:26.935890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:27.008013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:27.010589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:27.010623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:27.011496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:27.011653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400675035838923:4202]
2025-10-15T10:56:27.011729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:27.011744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:27.014700Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:27.049659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 255 reason: error at write: Disconnected sessionId: src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0
2025-10-15T10:56:27.050379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:27.050427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0] Write session will restart in 0.007394s
2025-10-15T10:56:27.050549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0] Write session: Do CDS request
2025-10-15T10:56:27.050601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:27.049966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 255 sessionId: src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0 is DEAD
2025-10-15T10:56:27.056221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:27.061647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:27.062451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:27.062484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:27.062519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:27.062740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:27.062772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:27.062964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400682130510832:4335]
2025-10-15T10:56:27.065054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:27.066013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:27.066235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:27.067517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:27.067825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.067839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.067846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.067853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.067859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.067865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.067871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.067878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.067882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.067886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.067890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.067894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.067898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.067903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.067943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.068015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.068044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.068079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.068112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.068141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.068169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.068195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.068222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.068258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.068298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.068338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.068383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.068428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.068414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:27.068470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.068441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 256
2025-10-15T10:56:27.068532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.068588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.068642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.068691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.068743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.068723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:27.068789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.068821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:27.068841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.068841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:27.068850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:27.068888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.068940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.068985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.069034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.069081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.069137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.069182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.069245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.069295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.069347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.069391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.069444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.069494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.069546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.069590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.069638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.069692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.069740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.069770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.069805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.069906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 256 sessionId:  describe result for acl check
2025-10-15T10:56:27.070006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:27.070021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:27.070029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:27.070045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400679330806293:4666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:27.070246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:27.072221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400679330806293:4666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:27.077107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400679330806293:4666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:27.083610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400679330806293:4666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:27.083647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400679330806293:4666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:27.083663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400679330806293:4666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:27.083689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:27.086762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:27.096212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:27.096249Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:27.096262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:27.096277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:27.096297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 255 [2:7561400682130510832:4335]
2025-10-15T10:56:27.096336Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:27.096377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:27.096386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:27.096394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:27.096401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:27.096429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:27.096444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:27.096459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:27.097950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.097965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.097972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.097979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:27.098156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:27.098170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.098246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.098368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.098464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 255
2025-10-15T10:56:27.098550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:27.098581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 255
2025-10-15T10:56:27.098623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400679330806320:4666], now have 1 active actors on pipe
2025-10-15T10:56:27.098649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400679330806245:2467], now have 1 active actors on pipe
2025-10-15T10:56:27.098670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400682130510827:4335]
2025-10-15T10:56:27.098678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400682130510827:4335]
2025-10-15T10:56:27.098685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400682130510827:4335]
2025-10-15T10:56:27.098707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:27.098728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:27.098736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:27.098743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:27.098757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:27.098769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:27.098798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:27.098935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:27.098950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:27.099051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:27.099079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:27.099090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:27.099095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:27.099115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:27.099136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:27.099155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400682130510827:4335]
2025-10-15T10:56:27.099172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:27.099191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:27.099235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:27.099615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:27.099642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:27.099697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:27.099944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 256 partition: 0 MaxSeqNo: 46 sessionId: src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0
2025-10-15T10:56:27.100559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9958d71-4cd1b17a-e0f7d44c-ec5ae165_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:27.111763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400679330806326:4202]
2025-10-15T10:56:27.112243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400679330806326:4202], now have 1 active actors on pipe
2025-10-15T10:56:27.112313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 255, pipe: [1:7561400679330806326:4202]
2025-10-15T10:56:27.120334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0] Write session: try to update token
2025-10-15T10:56:27.120379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:27.139800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:27.139825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:27.139851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400682130510827:4335]
2025-10-15T10:56:27.139958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:27.139962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:27.141903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:27.143262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:27.144624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:27.145985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:27.147782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:27.148285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:27.196190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:27.196216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:27.196225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:27.196232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:27.196254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400682130510827:4335]
2025-10-15T10:56:27.196272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400682130510827:4335]
2025-10-15T10:56:27.196292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400682130510827:4335]
2025-10-15T10:56:27.196376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:27.196406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:27.196415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:27.196430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:27.196434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:27.199092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:27.206641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId: src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:27.226892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:27.332544Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:27.347161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:27.347206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:27.348030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:27.347803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:27.347824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:27.347838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:27.348017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400679330806326:4202]
2025-10-15T10:56:27.357350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 256 reason: error at write: Disconnected sessionId: src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0
2025-10-15T10:56:27.357666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 256 sessionId: src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0 is DEAD
2025-10-15T10:56:27.358010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:27.358062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0] Write session will restart in 0.007605s
2025-10-15T10:56:27.358243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0] Write session: Do CDS request
2025-10-15T10:56:27.358286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:27.369925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:27.369967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 257
2025-10-15T10:56:27.370110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:27.370588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:27.370733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:27.370752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:27.370760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:27.371835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 257 sessionId:  describe result for acl check
2025-10-15T10:56:27.371939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:27.371954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:27.371963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:27.371978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400679330806361:4674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:27.374233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400679330806361:4674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:27.382737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:27.382865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400679330806361:4674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:27.385741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:27.386627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:27.386654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:27.386703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:27.386965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:27.387167Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400682130510943:4344]
2025-10-15T10:56:27.389370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:27.389947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400679330806361:4674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:27.389993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400679330806361:4674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:27.390011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400679330806361:4674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:27.390039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:27.390236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:27.390434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:27.392195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:27.392786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.392820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.392835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.392851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.392866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.392883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.392896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.392911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.392930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.392944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.392960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.392969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.392979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.392997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.393096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.393287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.393391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.393460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.393538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.393674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.393769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.393867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.393941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.394049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.394137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.394246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.394337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.394437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.394521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.394651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.394776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.394886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.394994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.395122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.395219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.395315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.395378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.395438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.395492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.395546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.395595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.395646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.395692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.395736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.395786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.395841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.395889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.395943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.395994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.396053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.396094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.396145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.396191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.396243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.396287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.396338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.396757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:27.411457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:27.435917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:27.435973Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:27.435993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:27.436015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:27.436043Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 256 [2:7561400682130510943:4344]
2025-10-15T10:56:27.436100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:27.436167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:27.436184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:27.436197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:27.436210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:27.436262Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:27.436295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:27.436318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:27.437856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.437885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.437901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.437913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:27.438187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:27.438214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.438362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.438448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 256
2025-10-15T10:56:27.438503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 256
2025-10-15T10:56:27.438577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.438826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:27.438929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400679330806346:2467], now have 1 active actors on pipe
2025-10-15T10:56:27.438960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400679330806436:4674], now have 1 active actors on pipe
2025-10-15T10:56:27.439034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:27.439060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:27.439100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400682130510938:4344]
2025-10-15T10:56:27.439120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400682130510938:4344]
2025-10-15T10:56:27.439134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400682130510938:4344]
2025-10-15T10:56:27.439172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:27.439208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:27.439234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:27.439246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:27.439247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:27.439456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:27.439495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:27.439571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:27.439608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:27.439626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:27.439637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:27.439672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:27.439719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:27.439855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400682130510938:4344]
2025-10-15T10:56:27.439891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:27.439917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:27.439940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:27.440452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:27.440480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:27.440547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:27.440819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 257 partition: 0 MaxSeqNo: 46 sessionId: src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0
2025-10-15T10:56:27.441432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9be40f3-884c618b-bc5731f6-5c0ed0fa_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:27.448178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400679330806444:4202]
2025-10-15T10:56:27.448702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 256, pipe: [1:7561400679330806444:4202]
2025-10-15T10:56:27.448676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400679330806444:4202], now have 1 active actors on pipe
2025-10-15T10:56:27.461196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0] Write session: try to update token
2025-10-15T10:56:27.461247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:27.469143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:27.469180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:27.469222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400682130510938:4344]
2025-10-15T10:56:27.469366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:27.469385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:27.471990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:27.473570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:27.475021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:27.476604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:27.478483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:27.479051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:27.530581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId: src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:27.565137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:27.572574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:27.572601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:27.572612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:27.572620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:27.572651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400682130510938:4344]
2025-10-15T10:56:27.572670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400682130510938:4344]
2025-10-15T10:56:27.572687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400682130510938:4344]
2025-10-15T10:56:27.572830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:27.572828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:27.572842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:27.572851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:27.572867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:27.572906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:27.572928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:27.572949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:27.572977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:27.572994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:27.573898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:27.703863Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:27.705578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400679330806444:4202]
2025-10-15T10:56:27.705603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:27.705618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:27.705656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:27.705677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:27.713904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 257 reason: error at write: Disconnected sessionId: src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0
2025-10-15T10:56:27.714207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 257 sessionId: src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0 is DEAD
2025-10-15T10:56:27.714592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:27.714657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0] Write session will restart in 0.008546s
2025-10-15T10:56:27.714823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0] Write session: Do CDS request
2025-10-15T10:56:27.714872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:27.728408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:27.728448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:27.728490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 258
2025-10-15T10:56:27.728894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:27.729010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:27.729029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:27.729038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:27.730181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 258 sessionId:  describe result for acl check
2025-10-15T10:56:27.730274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:27.730290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:27.730298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:27.730313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400679330806464:4679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:27.732549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400679330806464:4679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:27.742248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400679330806464:4679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:27.744128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:27.747363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:27.748188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:27.748216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:27.748254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:27.748480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:27.748657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400682130511029:4346]
2025-10-15T10:56:27.750686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:27.751496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:27.751700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:27.752327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400679330806464:4679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:27.752366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400679330806464:4679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:27.752382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400679330806464:4679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:27.752409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:27.752783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:27.753069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.753084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.753090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.753097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.753102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.753109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.753115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.753120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.753125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.753131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.753138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.753143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.753150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.753155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.753195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.753285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.753326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.753366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.753404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.753441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.753479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.753516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.753560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.753604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.753649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.753687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.753730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.753772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.753813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.753868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:27.753919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.753970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:27.754030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.754083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:27.754121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.754171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:27.754216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.754267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:27.754309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.754361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:27.754402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.754450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:27.754492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.754542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:27.754586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.754634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:27.754677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.754728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:27.754767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.754812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:27.754868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.754912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.754955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.755007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.755050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.755101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.755639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:27.773167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:27.787838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:27.787886Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:27.787903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:27.787921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:27.787944Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 257 [2:7561400682130511029:4346]
2025-10-15T10:56:27.787994Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:27.788051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:27.788064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:27.788076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:27.788087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:27.788132Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:27.788152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:27.788188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:27.789404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.789428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.789445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.789456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:27.789721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:27.789747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:27.789880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:27.790061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:27.790299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:27.790378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400682130511024:4346]
2025-10-15T10:56:27.790397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400682130511024:4346]
2025-10-15T10:56:27.790408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400682130511024:4346]
2025-10-15T10:56:27.790448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:27.790517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:27.790691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:27.790714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:27.790822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400682130511024:4346]
2025-10-15T10:56:27.790847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:27.792318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:27.792342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:27.792353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:27.792377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:27.793251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400679330806448:2467], now have 1 active actors on pipe
2025-10-15T10:56:27.793286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400679330806529:4679], now have 1 active actors on pipe
2025-10-15T10:56:27.793405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 257
2025-10-15T10:56:27.793528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 257
2025-10-15T10:56:27.794495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:27.794526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:27.794593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95a07027-7cd2aa8b-a1452011-28211239_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:27.794624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:27.794642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:27.794670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:27.794705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:27.794743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:27.794788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:27.795565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:27.795595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:27.795653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:27.795945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 258 partition: 0 MaxSeqNo: 46 sessionId: src_id|95a07027-7cd2aa8b-a1452011-28211239_0
2025-10-15T10:56:27.796740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7d4f40-e5bc81f2-d6f76d23-621b2956_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|95a07027-7cd2aa8b-a1452011-28211239_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:27.806856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400679330806537:4202]
2025-10-15T10:56:27.807362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400679330806537:4202], now have 1 active actors on pipe
2025-10-15T10:56:27.807398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 257, pipe: [1:7561400679330806537:4202]
2025-10-15T10:56:27.831297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07027-7cd2aa8b-a1452011-28211239_0] Write session: try to update token
2025-10-15T10:56:27.831416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07027-7cd2aa8b-a1452011-28211239_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:27.907606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:27.907647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:27.907665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:27.907745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:27.907767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:27.907799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:27.907826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:27.907885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400682130511024:4346]
2025-10-15T10:56:27.907936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400682130511024:4346]
2025-10-15T10:56:27.907986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400682130511024:4346]
2025-10-15T10:56:27.908126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:27.908191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:27.908238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:27.908240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:27.908273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:27.925530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:27.978745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId: src_id|95a07027-7cd2aa8b-a1452011-28211239_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:28.000984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:28.082961Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:28.095627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:28.095664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:28.095721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:28.095733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:28.095770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400682130511024:4346]
2025-10-15T10:56:28.095874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:28.096307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400679330806537:4202]
2025-10-15T10:56:28.096385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:28.096509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:28.096526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:28.096344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:28.105784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 258 reason: error at write: Disconnected sessionId: src_id|95a07027-7cd2aa8b-a1452011-28211239_0
2025-10-15T10:56:28.106078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 258 sessionId: src_id|95a07027-7cd2aa8b-a1452011-28211239_0 is DEAD
2025-10-15T10:56:28.106456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07027-7cd2aa8b-a1452011-28211239_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:28.106505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07027-7cd2aa8b-a1452011-28211239_0] Write session will restart in 0.005140s
2025-10-15T10:56:28.106648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07027-7cd2aa8b-a1452011-28211239_0] Write session: Do CDS request
2025-10-15T10:56:28.106689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07027-7cd2aa8b-a1452011-28211239_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:28.117212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:28.117276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 259
2025-10-15T10:56:28.117481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07027-7cd2aa8b-a1452011-28211239_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:28.118092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:28.118313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:28.118354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:28.118368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:28.120519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 259 sessionId:  describe result for acl check
2025-10-15T10:56:28.120677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:28.120718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:28.120734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:28.120767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400683625773859:4683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:28.123640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400683625773859:4683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:28.129556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400683625773859:4683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:28.142552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400683625773859:4683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:28.142540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:28.142595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400683625773859:4683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:28.142611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400683625773859:4683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:28.142639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:28.144336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:28.145183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:28.145212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:28.145257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:28.145516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:28.145731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400686425478427:4350]
2025-10-15T10:56:28.148226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:28.149190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:28.149396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:28.150825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:28.151215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.151231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.151239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.151246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.151254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.151261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.151268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.151276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.151283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.151291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.151298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.151305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.151313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.151321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.151386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.151520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.151571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.151621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.151677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.151731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.151779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.151832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.151886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.151951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.152015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.152073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.152124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.152178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.152230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.152303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.152368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.152429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.152485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.152551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.152606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.152667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.152721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.152788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.152843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.152903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.152960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.153023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.153077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.153153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.153215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.153283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.153350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.153439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.153505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.153570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.153624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.153685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.153737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.153801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.153855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.153911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.154480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:28.172933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:28.181334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:28.181375Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:28.181391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:28.181409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:28.181433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 258 [2:7561400686425478427:4350]
2025-10-15T10:56:28.181495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:28.181550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:28.181564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:28.181576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:28.181588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:28.181637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:28.181658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:28.181678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:28.182778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.182805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.182819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.182828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:28.183114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:28.183150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.183292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.183416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 258
2025-10-15T10:56:28.183426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 258
2025-10-15T10:56:28.183545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.183798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:28.183879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400683625773924:4683], now have 1 active actors on pipe
2025-10-15T10:56:28.183908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400683625773845:2467], now have 1 active actors on pipe
2025-10-15T10:56:28.183964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:28.183991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:28.184023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400686425478421:4350]
2025-10-15T10:56:28.184036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400686425478421:4350]
2025-10-15T10:56:28.184047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400686425478421:4350]
2025-10-15T10:56:28.184082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:28.184122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:28.184145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:28.184156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:28.184167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:28.184305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:28.184330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:28.184389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:28.184420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:28.184436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:28.184445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:28.184472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:28.184502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:28.184615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400686425478421:4350]
2025-10-15T10:56:28.184652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:28.184692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:28.184746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:28.185182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:28.185206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:28.185257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:28.185754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 259 partition: 0 MaxSeqNo: 46 sessionId: src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0
2025-10-15T10:56:28.186409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a07027-7cd2aa8b-a1452011-28211239_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:28.196922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400683625773934:4202]
2025-10-15T10:56:28.197439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400683625773934:4202], now have 1 active actors on pipe
2025-10-15T10:56:28.197657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 258, pipe: [1:7561400683625773934:4202]
2025-10-15T10:56:28.205034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0] Write session: try to update token
2025-10-15T10:56:28.205082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:28.225315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:28.225347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:28.225380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400686425478421:4350]
2025-10-15T10:56:28.225483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:28.225492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:28.227638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:28.229077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:28.230397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:28.231772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:28.233454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:28.233949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:28.283194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:28.283223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:28.283235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:28.283245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:28.283280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400686425478421:4350]
2025-10-15T10:56:28.283304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400686425478421:4350]
2025-10-15T10:56:28.283326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400686425478421:4350]
2025-10-15T10:56:28.283437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:28.283465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:28.283477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:28.283500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:28.283500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:28.283510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:28.283542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:28.283559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:28.284486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:28.297979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId: src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:28.320520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:28.420736Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:28.428183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:28.428223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:28.428896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:28.429337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:28.429367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:28.450405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 259 reason: error at write: Disconnected sessionId: src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0
2025-10-15T10:56:28.450712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 259 sessionId: src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0 is DEAD
2025-10-15T10:56:28.451031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:28.451084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0] Write session will restart in 0.006851s
2025-10-15T10:56:28.451205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0] Write session: Do CDS request
2025-10-15T10:56:28.451244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:28.463175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:28.468308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400683625773934:4202]
2025-10-15T10:56:28.468451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:28.468605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:28.468623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 260
2025-10-15T10:56:28.468935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:28.469039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:28.469057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:28.469067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:28.470144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 260 sessionId:  describe result for acl check
2025-10-15T10:56:28.470269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:28.470285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:28.470293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:28.470308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400683625774011:4695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:28.472521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400683625774011:4695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:28.474110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:28.477502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:28.478332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:28.478361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:28.478401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:28.478450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400683625774011:4695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:28.478650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:28.478840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400686425478528:4358]
2025-10-15T10:56:28.481142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:28.481994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:28.482202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:28.483475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:28.483848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.483865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.483873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.483880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.483886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.483893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.483901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.483909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.483916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.483925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.483931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.483938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.483945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.483952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.483998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.484107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.484156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.484203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.484251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.484302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.484347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.484398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.484456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.484512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.484560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.484609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.484665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.484717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.484767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.484839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.484904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.484964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.485019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.485076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.485124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.485182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.485232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.485288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.485341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.485398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.485449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.485506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.485557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.485613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.485661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.485724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.485786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.485841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.485896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.485949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.485996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.486058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.485992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400683625774011:4695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:28.486039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400683625774011:4695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:28.486109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.486057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400683625774011:4695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:28.486091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:28.486164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.486214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.486271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.486765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:28.511113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:28.521271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:28.521316Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:28.521332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:28.521351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:28.521379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 259 [2:7561400686425478528:4358]
2025-10-15T10:56:28.521433Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:28.521500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:28.521515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:28.521528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:28.521540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:28.521589Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:28.521612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:28.521634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:28.523554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.523585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.523599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.523616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:28.523893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:28.523920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.524059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.524254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.524171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 259
2025-10-15T10:56:28.524275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 259
2025-10-15T10:56:28.524477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:28.524562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400683625774045:4695], now have 1 active actors on pipe
2025-10-15T10:56:28.524589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400683625774007:2467], now have 1 active actors on pipe
2025-10-15T10:56:28.524636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:28.524661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:28.524711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400686425478523:4358]
2025-10-15T10:56:28.524731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400686425478523:4358]
2025-10-15T10:56:28.524743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400686425478523:4358]
2025-10-15T10:56:28.524780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:28.524817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:28.524837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:28.524849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:28.524849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:28.525024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:28.525047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:28.525108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c21f1738-cec8a6de-4723b525-613e3aae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:28.525140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:28.525158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:28.525169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:28.525204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:28.525248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:28.525389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400686425478523:4358]
2025-10-15T10:56:28.525420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:28.525445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:28.525468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:28.525899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:28.525922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:28.525978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:28.526248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 260 partition: 0 MaxSeqNo: 46 sessionId: src_id|c21f1738-cec8a6de-4723b525-613e3aae_0
2025-10-15T10:56:28.527048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ba4153-70d1e18c-4c9d100f-8ec4d838_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c21f1738-cec8a6de-4723b525-613e3aae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:28.550472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21f1738-cec8a6de-4723b525-613e3aae_0] Write session: try to update token
2025-10-15T10:56:28.550531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21f1738-cec8a6de-4723b525-613e3aae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:28.568414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400683625774055:4202]
2025-10-15T10:56:28.569045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 259, pipe: [1:7561400683625774055:4202]
2025-10-15T10:56:28.576528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:28.576554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:28.576582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400686425478523:4358]
2025-10-15T10:56:28.576665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:28.576681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400683625774055:4202], now have 1 active actors on pipe
2025-10-15T10:56:28.576714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:28.578773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:28.580154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:28.582108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:28.583613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:28.585453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:28.585955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:28.618741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:28.618772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:28.618784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:28.618793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:28.618832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400686425478523:4358]
2025-10-15T10:56:28.618857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400686425478523:4358]
2025-10-15T10:56:28.618877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400686425478523:4358]
2025-10-15T10:56:28.618998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:28.619009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:28.619028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:28.619035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:28.619076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:28.620102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:28.643344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId: src_id|c21f1738-cec8a6de-4723b525-613e3aae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:28.664145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:28.756330Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:28.757655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:28.757688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:28.758244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:28.758275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:28.758353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:28.758369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:28.758558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400683625774055:4202]
2025-10-15T10:56:28.809587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:28.821225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:28.822329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:28.822380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:28.822449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:28.823044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:28.823305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400686425478643:4367]
2025-10-15T10:56:28.821163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 260 reason: error at write: Disconnected sessionId: src_id|c21f1738-cec8a6de-4723b525-613e3aae_0
2025-10-15T10:56:28.821510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 260 sessionId: src_id|c21f1738-cec8a6de-4723b525-613e3aae_0 is DEAD
2025-10-15T10:56:28.824021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21f1738-cec8a6de-4723b525-613e3aae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:28.824088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21f1738-cec8a6de-4723b525-613e3aae_0] Write session will restart in 0.005839s
2025-10-15T10:56:28.824271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21f1738-cec8a6de-4723b525-613e3aae_0] Write session: Do CDS request
2025-10-15T10:56:28.824324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21f1738-cec8a6de-4723b525-613e3aae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:28.826644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:28.827629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:28.827835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:28.828964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:28.829274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.829289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.829296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.829302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.829309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.829315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.829321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.829329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.829335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.829343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.829349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.829356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.829363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.829370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.829413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.829519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.829565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.829606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.829650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.829697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.829741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.829783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.829827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.829869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.829912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.829954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.829996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.830039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.830078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.830139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:28.830196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.830247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:28.830293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.830359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:28.830403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.830459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:28.830510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.830568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:28.830611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.830665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:28.830713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.830771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:28.830819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.830874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:28.830926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.830985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:28.831036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.831094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:28.831145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.831198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:28.831242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.831299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.831370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.831426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.831475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.831545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.832053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:28.835234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21f1738-cec8a6de-4723b525-613e3aae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:28.835198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:28.835241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 261
2025-10-15T10:56:28.837415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:28.837585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:28.837613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:28.837624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:28.839403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 261 sessionId:  describe result for acl check
2025-10-15T10:56:28.839547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:28.839559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:28.839569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:28.839587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400683625774131:4702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:28.844328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400683625774131:4702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:28.850307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400683625774131:4702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:28.854243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:28.859153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400683625774158:4202]
2025-10-15T10:56:28.860246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400683625774131:4702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:28.860307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400683625774131:4702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:28.860332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400683625774131:4702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:28.860370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:28.864678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:28.864719Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:28.864735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:28.864752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:28.864773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 260 [2:7561400686425478643:4367]
2025-10-15T10:56:28.864819Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:28.864872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:28.864884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:28.864894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:28.864905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:28.864947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:28.864978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:28.864996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:28.866770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 260
2025-10-15T10:56:28.866772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 260, pipe: [1:7561400683625774158:4202]
2025-10-15T10:56:28.866860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 260
2025-10-15T10:56:28.866148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.866175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.866189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.866200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:28.866684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:28.866704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:28.866832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:28.867013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:28.867236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:28.867321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400683625774162:4702], now have 1 active actors on pipe
2025-10-15T10:56:28.867363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400683625774158:4202], now have 1 active actors on pipe
2025-10-15T10:56:28.867388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400683625774068:2467], now have 1 active actors on pipe
2025-10-15T10:56:28.867441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:28.867464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:28.867511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400686425478637:4367]
2025-10-15T10:56:28.867526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400686425478637:4367]
2025-10-15T10:56:28.867538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400686425478637:4367]
2025-10-15T10:56:28.867578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:28.867651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:28.867845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:28.867865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:28.867952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:28.867982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:28.867998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:28.868009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:28.868040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:28.868075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:28.868195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400686425478637:4367]
2025-10-15T10:56:28.868214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:28.868259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:28.868341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:28.868359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:28.868370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:28.868398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:28.869308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:28.869333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:28.869415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:28.871954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 261 partition: 0 MaxSeqNo: 46 sessionId: src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0
2025-10-15T10:56:28.873402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21f1738-cec8a6de-4723b525-613e3aae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:28.905098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0] Write session: try to update token
2025-10-15T10:56:28.905149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:28.945805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:28.945856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:28.945885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:28.945905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:28.945960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400686425478637:4367]
2025-10-15T10:56:28.946004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400686425478637:4367]
2025-10-15T10:56:28.946041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400686425478637:4367]
2025-10-15T10:56:28.946173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:28.946233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:28.946284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:28.946385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:28.946453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:28.948381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:28.976372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId: src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:29.010716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:29.143516Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:29.152369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:29.152410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:29.152464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:29.152474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:29.152504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400686425478637:4367]
2025-10-15T10:56:29.152662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:29.152843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:29.152964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:29.152984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:29.152993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400683625774158:4202]
2025-10-15T10:56:29.153010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:29.178663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 261 reason: error at write: Disconnected sessionId: src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0
2025-10-15T10:56:29.179043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 261 sessionId: src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0 is DEAD
2025-10-15T10:56:29.179419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:29.179475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0] Write session will restart in 0.005669s
2025-10-15T10:56:29.179638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0] Write session: Do CDS request
2025-10-15T10:56:29.179674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:29.189201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:29.189240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 262
2025-10-15T10:56:29.189318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:29.189707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:29.189850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:29.189870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:29.189880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:29.191373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 262 sessionId:  describe result for acl check
2025-10-15T10:56:29.191459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:29.191470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:29.191475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:29.191488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400687920741524:4708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:29.193173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:29.193842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400687920741524:4708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:29.196758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:29.197586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:29.197618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:29.197662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:29.197918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:29.198115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400690720446046:4371]
2025-10-15T10:56:29.201277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400687920741524:4708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:29.201628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:29.202546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:29.202793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:29.204109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:29.204435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.204452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.204458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.204464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.204470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.204478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.204485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.204492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.204500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.204508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.204515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.204521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.204528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.204533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.204579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.204694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.204745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.204795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.204853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.204901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.204945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.204999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.205052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.205106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.205153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.205205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.205255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.205307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.205352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.205420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.205486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.205544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.205598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.205660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.205711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.205773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.205822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.205883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.205934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.206000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.206053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.206110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.206161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.206219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.206273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.206328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.206376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.206432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.206482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.206543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.206590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.206650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.206703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.206760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.206814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.206871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.207694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:29.209227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400687920741524:4708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:29.209274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400687920741524:4708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:29.209291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400687920741524:4708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:29.209322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:29.222956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:29.232975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:29.233028Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:29.233048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:29.233070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:29.233095Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 261 [2:7561400690720446046:4371]
2025-10-15T10:56:29.233150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:29.233216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:29.233232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:29.233245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:29.233256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:29.233309Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:29.233334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:29.233356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:29.235363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 261
2025-10-15T10:56:29.235493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 261
2025-10-15T10:56:29.234375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.234402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.234415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.234426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:29.234693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:29.234711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.234862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.235059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.235314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:29.235421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400687920741558:4708], now have 1 active actors on pipe
2025-10-15T10:56:29.235446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400687920741473:2467], now have 1 active actors on pipe
2025-10-15T10:56:29.235472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400690720446041:4371]
2025-10-15T10:56:29.235488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400690720446041:4371]
2025-10-15T10:56:29.235501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400690720446041:4371]
2025-10-15T10:56:29.235614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:29.235662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:29.235677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:29.235689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:29.235694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:29.235900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:29.235917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:29.236069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:29.236094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:29.236140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400690720446041:4371]
2025-10-15T10:56:29.236172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:29.236283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:29.236316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:29.236335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:29.236345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:29.236383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:29.236439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:29.236528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:29.237311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:29.238108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:29.238140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:29.238214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:29.239005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 262 partition: 0 MaxSeqNo: 46 sessionId: src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0
2025-10-15T10:56:29.239806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e2de5e-343e1c32-fb8953e-3e3258f7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:29.254380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400687920741565:4202], now have 1 active actors on pipe
2025-10-15T10:56:29.252969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400687920741565:4202]
2025-10-15T10:56:29.254597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 261, pipe: [1:7561400687920741565:4202]
2025-10-15T10:56:29.269280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0] Write session: try to update token
2025-10-15T10:56:29.269348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:29.377350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:29.377386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:29.377401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:29.377412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:29.377448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400690720446041:4371]
2025-10-15T10:56:29.377474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400690720446041:4371]
2025-10-15T10:56:29.377498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400690720446041:4371]
2025-10-15T10:56:29.377602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:29.377633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:29.377661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:29.383659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:29.383690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:29.383703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:29.383824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:29.383847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:29.388424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:29.400700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId: src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:29.423091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:29.536390Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:29.546439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:29.546490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:29.546565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:29.546579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:29.546622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400690720446041:4371]
2025-10-15T10:56:29.546817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:29.547144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400687920741565:4202]
2025-10-15T10:56:29.547199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:29.547250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:29.547269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:29.549682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:29.559448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 262 reason: error at write: Disconnected sessionId: src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0
2025-10-15T10:56:29.560183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:29.560253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0] Write session will restart in 0.005371s
2025-10-15T10:56:29.560411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0] Write session: Do CDS request
2025-10-15T10:56:29.560455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:29.559754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 262 sessionId: src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0 is DEAD
2025-10-15T10:56:29.578350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:29.578309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:29.578354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 263
2025-10-15T10:56:29.586487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:29.586645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:29.586663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:29.586675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:29.594470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 263 sessionId:  describe result for acl check
2025-10-15T10:56:29.594600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:29.594622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:29.594632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:29.594653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400687920741629:4714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:29.609695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:29.613900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:29.614469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400687920741629:4714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:29.614666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:29.614693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:29.614728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:29.614952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:29.615129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400690720446142:4373]
2025-10-15T10:56:29.617295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:29.619125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:29.619359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:29.620760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:29.621124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.621141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.621148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.621154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.621161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.621168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.621177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.621184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.621191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.621198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.621204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.621210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.621217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.621225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.621271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.621371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.621414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.621457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.621498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.621552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.621489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400687920741629:4714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:29.621595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.621643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.621683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.621731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.621772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.621811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.621853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.621890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.621927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.621983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.622032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.622081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.622127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.622184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.622233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.622283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.622332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.622379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.622424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.622480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.622528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.622582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.622626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.622679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.622731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.622787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.622830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.622878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.622939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.622992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.623033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.623080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.623126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.623174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.623213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.623260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.624104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:29.633880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400687920741629:4714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:29.633926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400687920741629:4714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:29.633944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400687920741629:4714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:29.633976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:29.642079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:29.647260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400687920741684:4202]
2025-10-15T10:56:29.653250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:29.653287Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:29.653302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:29.653318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:29.653340Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 262 [2:7561400690720446142:4373]
2025-10-15T10:56:29.653384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:29.653445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:29.653457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:29.653468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:29.653479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:29.653521Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:29.653540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:29.653558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:29.665873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.665890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.665896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.665901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:29.666115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:29.666140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.666233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.666365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.666396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 262, pipe: [1:7561400687920741684:4202]
2025-10-15T10:56:29.666539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:29.666531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 262
2025-10-15T10:56:29.666609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400687920741684:4202], now have 1 active actors on pipe
2025-10-15T10:56:29.666634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400687920741584:2467], now have 1 active actors on pipe
2025-10-15T10:56:29.666623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 262
2025-10-15T10:56:29.666652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400687920741682:4714], now have 1 active actors on pipe
2025-10-15T10:56:29.666674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400690720446136:4373]
2025-10-15T10:56:29.666689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400690720446136:4373]
2025-10-15T10:56:29.666699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400690720446136:4373]
2025-10-15T10:56:29.666726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:29.666746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:29.666756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:29.666766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:29.666786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:29.666921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:29.666936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:29.666981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:29.666992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:29.667096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400690720446136:4373]
2025-10-15T10:56:29.667122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:29.667141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:29.667180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:29.667207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:29.667221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:29.667230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:29.667259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:29.667298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:29.667431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:29.667910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:29.667933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:29.667997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:29.668230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 263 partition: 0 MaxSeqNo: 46 sessionId: src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0
2025-10-15T10:56:29.668966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b02dfe-b00aa731-84dc8c55-71c85a19_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:29.689228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0] Write session: try to update token
2025-10-15T10:56:29.689287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:29.695617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:29.695641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:29.695672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400690720446136:4373]
2025-10-15T10:56:29.695778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:29.695905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:29.697622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:29.699071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:29.700331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:29.701926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:29.703905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:29.704367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:29.757741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:29.757801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:29.757815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:29.757825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:29.757863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400690720446136:4373]
2025-10-15T10:56:29.757899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400690720446136:4373]
2025-10-15T10:56:29.757924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400690720446136:4373]
2025-10-15T10:56:29.758079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:29.758127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:29.758137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:29.758151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:29.758171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:29.758173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:29.758242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:29.758261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:29.760542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:29.769529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId: src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:29.790802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:29.892312Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:29.894369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:29.894396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:29.894963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:29.895048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:29.895081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:29.907501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 263 reason: error at write: Disconnected sessionId: src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0
2025-10-15T10:56:29.907915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 263 sessionId: src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0 is DEAD
2025-10-15T10:56:29.908290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:29.908341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0] Write session will restart in 0.007443s
2025-10-15T10:56:29.908476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0] Write session: Do CDS request
2025-10-15T10:56:29.908511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:29.920290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
E1015 10:56:29.925796437  821271 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:56:29.927647Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:56:29.929540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400687920741684:4202]
2025-10-15T10:56:29.929702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:29.930038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:29.930068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 264
2025-10-15T10:56:29.930527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:29.930707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:29.930741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:29.930757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:29.932982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 264 sessionId:  describe result for acl check
2025-10-15T10:56:29.933158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:29.933188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:29.933212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:29.933243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400687920741707:4724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:29.936054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400687920741707:4724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:29.941186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400687920741707:4724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:29.950087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400687920741707:4724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:29.950130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400687920741707:4724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:29.950146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400687920741707:4724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:29.950179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:29.955465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:29.959320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:29.960199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:29.960232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:29.960273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:29.960526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:29.960712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400690720446244:4381]
2025-10-15T10:56:29.962776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:29.964130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:29.964364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:29.965665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:29.965980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.965988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.965995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.966002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.966009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.966016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.966022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.966029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.966036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.966044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.966052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.966059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.966065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.966072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.966119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.966230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.966279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.966325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.966370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.966417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.966463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.966509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.966555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.966603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.966648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.966693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.966739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.966782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.966823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.966888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:29.966948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.967002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:29.967053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.967107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:29.967151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.967204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:29.967252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.967304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:29.968207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.968297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:29.968359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.968414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:29.968465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.968518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:29.968569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.968628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:29.968678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.968739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:29.968791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.968853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:29.968903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.968963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.969013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.969068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.969129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.969193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.969716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:29.985485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:29.995088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:29.995120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:29.995130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:29.995143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:29.995159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 263 [2:7561400690720446244:4381]
2025-10-15T10:56:29.995194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:29.995235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:29.995245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:29.995254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:29.995261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:29.995293Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:29.995307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:29.995321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:29.996845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.996862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.996871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.996878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:29.997094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:29.997111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:29.997223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:29.997366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:29.997514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:29.997568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400687920741703:2467], now have 1 active actors on pipe
2025-10-15T10:56:29.997583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400687920741775:4724], now have 1 active actors on pipe
2025-10-15T10:56:29.997600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400690720446239:4381]
2025-10-15T10:56:29.997609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400690720446239:4381]
2025-10-15T10:56:29.997616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400690720446239:4381]
2025-10-15T10:56:29.997473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 263
2025-10-15T10:56:29.997636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:29.997598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 263
2025-10-15T10:56:29.997680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:29.997692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:29.997710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:29.997722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:29.997803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:29.997819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:29.997873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:29.997884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:29.997965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400690720446239:4381]
2025-10-15T10:56:29.997988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:29.998029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:29.998033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:29.998055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:29.998065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:29.998071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:29.998100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:29.998130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:29.998260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:29.998832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:29.998862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:29.998932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:29.999268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 264 partition: 0 MaxSeqNo: 46 sessionId: src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0
2025-10-15T10:56:30.000048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce41c5c2-2dede24d-18075009-8e2207ba_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:30.022187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0] Write session: try to update token
2025-10-15T10:56:30.022242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:30.029697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400692215709098:4202]
2025-10-15T10:56:30.030359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 263, pipe: [1:7561400692215709098:4202]
2025-10-15T10:56:30.058866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:30.058903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:30.058937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400690720446239:4381]
2025-10-15T10:56:30.059076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400692215709098:4202], now have 1 active actors on pipe
2025-10-15T10:56:30.059118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:30.061387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:30.062011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:30.063425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:30.070965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:30.082316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:30.085860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:30.086588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:30.118621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId: src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:30.142792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:30.142823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:30.142835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:30.142885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:30.142899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:30.142911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:30.142921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:30.142957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400690720446239:4381]
2025-10-15T10:56:30.142981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400690720446239:4381]
2025-10-15T10:56:30.143002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400690720446239:4381]
2025-10-15T10:56:30.143129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:30.143155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:30.143199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:30.143247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:30.143279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:30.144123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:30.158757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:30.291617Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:30.292994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:30.293032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:30.293572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400692215709098:4202]
2025-10-15T10:56:30.293578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:30.293701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:30.293721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:30.293720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:30.334330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:30.339489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:30.340288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:30.340313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:30.340352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:30.340563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:30.340713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400695015413671:4392]
2025-10-15T10:56:30.343486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:30.344590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:30.344814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:30.345948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:30.346223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:30.346230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:30.346235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:30.346242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:30.346249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:30.346255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:30.346261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:30.346267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:30.346272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:30.346278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:30.346284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:30.346290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.346296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.346302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.346343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:30.346439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:30.346478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:30.346516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:30.346556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:30.346595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:30.346632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:30.346687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:30.346723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:30.346762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:30.346798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:30.346833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.346867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.346905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.346941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:30.346996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:30.347040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:30.347082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:30.347120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:30.347162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:30.347197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:30.347240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:30.347276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:30.347320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:30.347401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:30.347446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:30.347483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:30.347540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:30.347578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:30.347622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:30.347660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:30.347703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:30.347738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:30.347782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:30.347827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:30.347883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:30.347930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.347987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.348032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.348088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.348126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.348176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.348658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:30.357775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 264 reason: error at write: Disconnected sessionId: src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0
2025-10-15T10:56:30.358060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 264 sessionId: src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0 is DEAD
2025-10-15T10:56:30.358503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:30.358559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0] Write session will restart in 0.006870s
2025-10-15T10:56:30.358704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0] Write session: Do CDS request
2025-10-15T10:56:30.358756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:30.369430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:30.371492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:30.371541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 265
2025-10-15T10:56:30.372087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:30.372236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:30.372254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:30.372265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:30.374263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 265 sessionId:  describe result for acl check
2025-10-15T10:56:30.374441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:30.374472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:30.374488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:30.374518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400692215709163:4732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:30.377225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400692215709163:4732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:30.380948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:30.383716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400692215709163:4732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:30.391922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:30.391961Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:30.391976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:30.391993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:30.392014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 264 [2:7561400695015413671:4392]
2025-10-15T10:56:30.392059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:30.392109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:30.392121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:30.392132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:30.392143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:30.392186Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:30.392204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:30.392224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:30.393463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.393486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.393497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.393507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:30.393721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:30.393735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.393850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.394001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.391143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400692215709163:4732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:30.394190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:30.394244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400695015413666:4392]
2025-10-15T10:56:30.391186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400692215709163:4732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:30.391203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400692215709163:4732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:30.391231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:30.393688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400692215709193:4202]
2025-10-15T10:56:30.394257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400695015413666:4392]
2025-10-15T10:56:30.394769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 264
2025-10-15T10:56:30.394773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 264, pipe: [1:7561400692215709193:4202]
2025-10-15T10:56:30.394855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 264
2025-10-15T10:56:30.394267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400695015413666:4392]
2025-10-15T10:56:30.394294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:30.394354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:30.394357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:30.394366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:30.394379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:30.394508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:30.394523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:30.394560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400692215709191:4732], now have 1 active actors on pipe
2025-10-15T10:56:30.394657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400692215709103:2467], now have 1 active actors on pipe
2025-10-15T10:56:30.394676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400692215709193:4202], now have 1 active actors on pipe
2025-10-15T10:56:30.394693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400695015413666:4392]
2025-10-15T10:56:30.394721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:30.394862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:30.395278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:30.395302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:30.395386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|814591d1-95595315-dfa2b3d3-c5a79000_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:30.395416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:30.395432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:30.395442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:30.395472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:30.395507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:30.395574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:30.396276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:30.396306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:30.396398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:30.398073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 265 partition: 0 MaxSeqNo: 46 sessionId: src_id|814591d1-95595315-dfa2b3d3-c5a79000_0
2025-10-15T10:56:30.398779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c026187-e89a1e87-18f35ac3-c91e51bb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|814591d1-95595315-dfa2b3d3-c5a79000_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:30.422896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814591d1-95595315-dfa2b3d3-c5a79000_0] Write session: try to update token
2025-10-15T10:56:30.422950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814591d1-95595315-dfa2b3d3-c5a79000_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:30.492512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:30.492544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:30.492556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:30.492566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:30.492598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400695015413666:4392]
2025-10-15T10:56:30.492622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400695015413666:4392]
2025-10-15T10:56:30.492642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400695015413666:4392]
2025-10-15T10:56:30.492761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:30.492794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:30.492820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:30.492842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:30.492855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:30.492865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:30.492906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:30.492924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:30.493838Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:30.507952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId: src_id|814591d1-95595315-dfa2b3d3-c5a79000_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:30.529479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:30.643759Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:30.652983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:30.653028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:30.653096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:30.653111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:30.653151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400695015413666:4392]
2025-10-15T10:56:30.653317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:30.653644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:30.653719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:30.653673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:30.653674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400692215709193:4202]
2025-10-15T10:56:30.653726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:30.662617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 265 reason: error at write: Disconnected sessionId: src_id|814591d1-95595315-dfa2b3d3-c5a79000_0
2025-10-15T10:56:30.663005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 265 sessionId: src_id|814591d1-95595315-dfa2b3d3-c5a79000_0 is DEAD
2025-10-15T10:56:30.663483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814591d1-95595315-dfa2b3d3-c5a79000_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:30.663553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814591d1-95595315-dfa2b3d3-c5a79000_0] Write session will restart in 0.007749s
2025-10-15T10:56:30.663731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814591d1-95595315-dfa2b3d3-c5a79000_0] Write session: Do CDS request
2025-10-15T10:56:30.663779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814591d1-95595315-dfa2b3d3-c5a79000_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:30.676183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814591d1-95595315-dfa2b3d3-c5a79000_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:30.676234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:30.676260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 266
2025-10-15T10:56:30.676612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:30.676686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:30.676700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:30.676706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:30.677523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 266 sessionId:  describe result for acl check
2025-10-15T10:56:30.677602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:30.677609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:30.677614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:30.677625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400692215709228:4737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:30.679129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400692215709228:4737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:30.685264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400692215709228:4737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:30.691400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400692215709228:4737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:30.691439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400692215709228:4737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:30.691455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400692215709228:4737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:30.691483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:30.693381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:30.696431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:30.697207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:30.697231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:30.697269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:30.697498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:30.697676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400695015413767:4394]
2025-10-15T10:56:30.699146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:30.699853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:30.700015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:30.701174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:30.701483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:30.701502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:30.701509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:30.701515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:30.701522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:30.701528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:30.701534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:30.701540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:30.701546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:30.701552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:30.701558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:30.701564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.701570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.701577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.701618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:30.701709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:30.701750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:30.701795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:30.701835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:30.701879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:30.701929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:30.701975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:30.702022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:30.702069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:30.702119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:30.702165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.702214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.702259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.702303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:30.702365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:30.702423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:30.702478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:30.702529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:30.702584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:30.702627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:30.702675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:30.702717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:30.702769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:30.702816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:30.702872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:30.702920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:30.702973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:30.703014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:30.703053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:30.703085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:30.703123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:30.703155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:30.703193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:30.703224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:30.703259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:30.703299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.703341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.703393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.703446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.703490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.703550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.703949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:30.727008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:30.736512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:30.736563Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:30.736581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:30.736600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:30.736624Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 265 [2:7561400695015413767:4394]
2025-10-15T10:56:30.736673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:30.736727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:30.736741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:30.736752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:30.736762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:30.736808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:30.736837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:30.736856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:30.737935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.737961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.737977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.737988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:30.738273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:30.738299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:30.738433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:30.738491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 265
2025-10-15T10:56:30.738507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 265
2025-10-15T10:56:30.738618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:30.738851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:30.738937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400692215709213:2467], now have 1 active actors on pipe
2025-10-15T10:56:30.738965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400692215709297:4737], now have 1 active actors on pipe
2025-10-15T10:56:30.739026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:30.739051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:30.739087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400695015413762:4394]
2025-10-15T10:56:30.739100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400695015413762:4394]
2025-10-15T10:56:30.739112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400695015413762:4394]
2025-10-15T10:56:30.739147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:30.739215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:30.739212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:30.739230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:30.739243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:30.739408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:30.739431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:30.739495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48424563-ec019140-fe05325f-919abbd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:30.739541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:30.739564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:30.739574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:30.739607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:30.739643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:30.739758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400695015413762:4394]
2025-10-15T10:56:30.739790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:30.739826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:30.739840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:30.740318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:30.740347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:30.740420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:30.740649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 266 partition: 0 MaxSeqNo: 46 sessionId: src_id|48424563-ec019140-fe05325f-919abbd7_0
2025-10-15T10:56:30.741290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814591d1-95595315-dfa2b3d3-c5a79000_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|48424563-ec019140-fe05325f-919abbd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:30.754146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400692215709308:4202]
2025-10-15T10:56:30.754681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400692215709308:4202], now have 1 active actors on pipe
2025-10-15T10:56:30.754784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 265, pipe: [1:7561400692215709308:4202]
2025-10-15T10:56:30.762731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48424563-ec019140-fe05325f-919abbd7_0] Write session: try to update token
2025-10-15T10:56:30.762775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48424563-ec019140-fe05325f-919abbd7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:30.766456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:30.766489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:30.766525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400695015413762:4394]
2025-10-15T10:56:30.766638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:30.766650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:30.769118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:30.770530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:30.771911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:30.773444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:30.775340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:30.775877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:30.840867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:30.840896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:30.840908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:30.840917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:30.840959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400695015413762:4394]
2025-10-15T10:56:30.840985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400695015413762:4394]
2025-10-15T10:56:30.841005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400695015413762:4394]
2025-10-15T10:56:30.841179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:30.841180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:30.841209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:30.841221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:30.841226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:30.841256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:30.841266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:30.841285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:30.843954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:30.869204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId: src_id|48424563-ec019140-fe05325f-919abbd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:30.888523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:30.981366Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:30.983236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:30.983272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:30.983788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:30.983840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:30.983853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:30.983962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400692215709308:4202]
2025-10-15T10:56:30.984022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:31.008704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 266 reason: error at write: Disconnected sessionId: src_id|48424563-ec019140-fe05325f-919abbd7_0
2025-10-15T10:56:31.008982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 266 sessionId: src_id|48424563-ec019140-fe05325f-919abbd7_0 is DEAD
2025-10-15T10:56:31.009306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48424563-ec019140-fe05325f-919abbd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:31.009366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48424563-ec019140-fe05325f-919abbd7_0] Write session will restart in 0.007432s
2025-10-15T10:56:31.009494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48424563-ec019140-fe05325f-919abbd7_0] Write session: Do CDS request
2025-10-15T10:56:31.009533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48424563-ec019140-fe05325f-919abbd7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:31.021797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:31.021828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 267
2025-10-15T10:56:31.022054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48424563-ec019140-fe05325f-919abbd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:31.022459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:31.022568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:31.022586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:31.022593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:31.023430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 267 sessionId:  describe result for acl check
2025-10-15T10:56:31.023541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:31.023557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:31.023565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:31.023579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400696510676678:4743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:31.025130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400696510676678:4743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:31.028104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:31.031803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:31.032762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:31.032806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:31.032852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:31.033140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:31.033351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400699310381169:4398]
2025-10-15T10:56:31.034453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400696510676678:4743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:31.035683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:31.036817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:31.037098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:31.038575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:31.038909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.038932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.038938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.038946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.038954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.038960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.038967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.038975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.038981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.038989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.038997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.039004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.039010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.039018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.039069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.039181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.039245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.039302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.039378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.039434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.039490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.039560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.039609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.039666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.039728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.039785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.039839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.039894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.039948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.040033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.040106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.040111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400696510676678:4743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:31.040163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.040149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400696510676678:4743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:31.040163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400696510676678:4743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:31.040187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:31.040220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.040294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.040344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.040409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.040468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.040532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.040579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.040642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.040697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.040766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.040815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.040879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.040935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.040999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.041052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.041132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.041194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.041257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.041312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.041375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.041428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.041504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.041558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.041618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.042140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:31.058159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:31.067595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:31.067641Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:31.067657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:31.067677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:31.067701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 266 [2:7561400699310381169:4398]
2025-10-15T10:56:31.067752Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:31.067813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:31.067827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:31.067839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:31.067850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:31.067900Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:31.067928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:31.067951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:31.069663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.069686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.069696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.069704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:31.069941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:31.069968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.070124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.070242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 266
2025-10-15T10:56:31.070344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 266
2025-10-15T10:56:31.070339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.070600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:31.070694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400696510676708:4743], now have 1 active actors on pipe
2025-10-15T10:56:31.070725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400692215709323:2467], now have 1 active actors on pipe
2025-10-15T10:56:31.070784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:31.070813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:31.070870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400699310381164:4398]
2025-10-15T10:56:31.070891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400699310381164:4398]
2025-10-15T10:56:31.070904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400699310381164:4398]
2025-10-15T10:56:31.070945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:31.070996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:31.071021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:31.071025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:31.071036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:31.071202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:31.071227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:31.071294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5804f412-73094fb1-788455d2-d47e078e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:31.071329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:31.071371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:31.071382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:31.071423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:31.071470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:31.071630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400699310381164:4398]
2025-10-15T10:56:31.071664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:31.071690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:31.071712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:31.074695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:31.074722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:31.074778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:31.075068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 267 partition: 0 MaxSeqNo: 46 sessionId: src_id|5804f412-73094fb1-788455d2-d47e078e_0
2025-10-15T10:56:31.075765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48424563-ec019140-fe05325f-919abbd7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5804f412-73094fb1-788455d2-d47e078e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:31.084390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400696510676725:4202]
2025-10-15T10:56:31.084923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 266, pipe: [1:7561400696510676725:4202]
2025-10-15T10:56:31.084877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400696510676725:4202], now have 1 active actors on pipe
2025-10-15T10:56:31.095645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5804f412-73094fb1-788455d2-d47e078e_0] Write session: try to update token
2025-10-15T10:56:31.095698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5804f412-73094fb1-788455d2-d47e078e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:31.106048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:31.106081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:31.106111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400699310381164:4398]
2025-10-15T10:56:31.106215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:31.106218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:31.108139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:31.109532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:31.110868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:31.112173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:31.114125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:31.114623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:31.155267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:31.155305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:31.155318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:31.155329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:31.155610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400699310381164:4398]
2025-10-15T10:56:31.155659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400699310381164:4398]
2025-10-15T10:56:31.155691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400699310381164:4398]
2025-10-15T10:56:31.155854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:31.155897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:31.155917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:31.155930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:31.155959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:31.169398Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:31.204928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId: src_id|5804f412-73094fb1-788455d2-d47e078e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:31.225091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:31.319762Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:31.322142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:31.322188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:31.322760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:31.322792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:31.322900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:31.361957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:31.365570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400696510676725:4202]
2025-10-15T10:56:31.365666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:31.365798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 267 reason: error at write: Disconnected sessionId: src_id|5804f412-73094fb1-788455d2-d47e078e_0
2025-10-15T10:56:31.366156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 267 sessionId: src_id|5804f412-73094fb1-788455d2-d47e078e_0 is DEAD
2025-10-15T10:56:31.366543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804f412-73094fb1-788455d2-d47e078e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:31.366596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804f412-73094fb1-788455d2-d47e078e_0] Write session will restart in 0.009983s
2025-10-15T10:56:31.366742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804f412-73094fb1-788455d2-d47e078e_0] Write session: Do CDS request
2025-10-15T10:56:31.366791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804f412-73094fb1-788455d2-d47e078e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:31.367213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:31.368357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:31.368393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:31.368460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:31.368845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:31.369143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400699310381281:4406]
2025-10-15T10:56:31.371956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:31.372838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:31.373041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:31.374301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:31.375000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.375025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.375033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.375042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.375049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.375056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.375063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.375070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.375078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.375085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.375092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.375100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.375108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.375115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.375163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.375266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.375310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.375387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.375434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.375487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.375532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.375599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.375642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.375685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.375736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.375783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.375830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.375877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.375923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.376001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.376070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.376128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.376167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.376205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.376244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.376323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.376384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.376460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.376523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.376587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.376645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.376716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.376775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.376848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.376906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.376969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.377014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.377088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.377150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.377206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.377260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.377317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.377373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.377436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.377487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.377542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.378069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:31.384614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:31.384660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 268
2025-10-15T10:56:31.384852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5804f412-73094fb1-788455d2-d47e078e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:31.385414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:31.385568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:31.385591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:31.385604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:31.386893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 268 sessionId:  describe result for acl check
2025-10-15T10:56:31.387026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:31.387047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:31.387058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:31.387076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400696510676794:4752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:31.390337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400696510676794:4752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:31.399722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400696510676794:4752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:31.404334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:31.414749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400696510676794:4752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:31.414790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400696510676794:4752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:31.419409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400696510676794:4752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:31.419503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:31.429393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:31.429439Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:31.429454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:31.429472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:31.429494Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 267 [2:7561400699310381281:4406]
2025-10-15T10:56:31.429543Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:31.429599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:31.429613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:31.429625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:31.429636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:31.429681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:31.429703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:31.429724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:31.434331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.434364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.434378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.434389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:31.434611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:31.434630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.434769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.435204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 267
2025-10-15T10:56:31.435294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 267
2025-10-15T10:56:31.434962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.435192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:31.435277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400696510676833:4752], now have 1 active actors on pipe
2025-10-15T10:56:31.435303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400696510676786:2467], now have 1 active actors on pipe
2025-10-15T10:56:31.435327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400699310381275:4406]
2025-10-15T10:56:31.435342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400699310381275:4406]
2025-10-15T10:56:31.435515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400699310381275:4406]
2025-10-15T10:56:31.435569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:31.435649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:31.435828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:31.435852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:31.435972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400699310381275:4406]
2025-10-15T10:56:31.435997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:31.436376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:31.436404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:31.436414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:31.436438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:31.436682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:31.436712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:31.436819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e08d907-e806b348-236b8086-3c5a2f97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:31.436864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:31.436902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:31.436919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:31.436960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:31.437008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:31.437060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:31.438946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:31.438991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:31.439086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:31.440784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5804f412-73094fb1-788455d2-d47e078e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5e08d907-e806b348-236b8086-3c5a2f97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:31.439910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 268 partition: 0 MaxSeqNo: 46 sessionId: src_id|5e08d907-e806b348-236b8086-3c5a2f97_0
2025-10-15T10:56:31.464212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e08d907-e806b348-236b8086-3c5a2f97_0] Write session: try to update token
2025-10-15T10:56:31.464282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e08d907-e806b348-236b8086-3c5a2f97_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:31.467575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400696510676851:4202]
2025-10-15T10:56:31.468912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 267, pipe: [1:7561400696510676851:4202]
2025-10-15T10:56:31.470058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400696510676851:4202], now have 1 active actors on pipe
2025-10-15T10:56:31.610634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:31.610666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:31.610678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:31.610686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:31.610712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400699310381275:4406]
2025-10-15T10:56:31.610731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400699310381275:4406]
2025-10-15T10:56:31.610746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400699310381275:4406]
2025-10-15T10:56:31.610872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:31.610882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:31.610891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:31.610975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:31.610997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:31.611097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:31.611122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:31.611143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:31.620208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:31.630546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId: src_id|5e08d907-e806b348-236b8086-3c5a2f97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:31.653330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:31.767422Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:31.775877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:31.775926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:31.776006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:31.776023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:31.776061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400699310381275:4406]
2025-10-15T10:56:31.776264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:31.776497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400696510676851:4202]
2025-10-15T10:56:31.776525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:31.776592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:31.776539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:31.776592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:31.786447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 268 reason: error at write: Disconnected sessionId: src_id|5e08d907-e806b348-236b8086-3c5a2f97_0
2025-10-15T10:56:31.786764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 268 sessionId: src_id|5e08d907-e806b348-236b8086-3c5a2f97_0 is DEAD
2025-10-15T10:56:31.787233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e08d907-e806b348-236b8086-3c5a2f97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:31.787302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e08d907-e806b348-236b8086-3c5a2f97_0] Write session will restart in 0.008037s
2025-10-15T10:56:31.787473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e08d907-e806b348-236b8086-3c5a2f97_0] Write session: Do CDS request
2025-10-15T10:56:31.787521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e08d907-e806b348-236b8086-3c5a2f97_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:31.800472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e08d907-e806b348-236b8086-3c5a2f97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:31.800399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:31.800451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 269
2025-10-15T10:56:31.800983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:31.801096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:31.801116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:31.801125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:31.802305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 269 sessionId:  describe result for acl check
2025-10-15T10:56:31.802410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:31.802426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:31.802435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:31.802449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400696510676871:4760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:31.804698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400696510676871:4760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:31.813193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400696510676871:4760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:31.817830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:31.821405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:31.822015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400696510676871:4760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:31.822066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400696510676871:4760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:31.822083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400696510676871:4760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:31.822111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:31.822229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:31.822258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:31.822300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:31.822556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:31.822772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400699310381403:4415]
2025-10-15T10:56:31.827737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:31.829044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:31.829296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:31.830608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:31.831009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.831029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.831035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.831042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.831049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.831056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.831064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.831072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.831078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.831084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.831091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.831098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.831105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.831113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.831167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.831286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.831338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.831419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.831475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.831531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.831594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.831649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.831701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.831757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.831809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.831862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.831917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.831968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.832021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.832099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:31.832166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.832231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:31.832291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.832357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:31.832413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.832476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:31.832531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.832585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:31.832633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.832691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:31.832743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.832799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:31.832859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.832919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:31.832976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.833036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:31.833088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.833148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:31.833202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.833262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:31.833320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.833379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.833432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.833493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.833546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.833605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.834185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:31.858201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:31.867318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:31.867386Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:31.867405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:31.867427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:31.867454Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 268 [2:7561400699310381403:4415]
2025-10-15T10:56:31.867510Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:31.867596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:31.867613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:31.867628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:31.867641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:31.867694Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:31.867730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:31.867755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:31.868842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.868872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.868887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.868900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:31.869199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:31.869229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:31.869387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:31.869422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 268
2025-10-15T10:56:31.869425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 268
2025-10-15T10:56:31.869626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:31.869889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:31.869993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400696510676948:4760], now have 1 active actors on pipe
2025-10-15T10:56:31.870027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400696510676856:2467], now have 1 active actors on pipe
2025-10-15T10:56:31.870102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:31.870132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:31.870174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400699310381398:4415]
2025-10-15T10:56:31.870193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400699310381398:4415]
2025-10-15T10:56:31.870208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400699310381398:4415]
2025-10-15T10:56:31.870257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:31.870286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:31.870317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:31.870324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:31.870343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:31.870536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:31.870561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:31.870631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:31.870666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:31.870688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:31.870698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:31.870737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:31.870787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:31.870925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400699310381398:4415]
2025-10-15T10:56:31.870963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:31.871018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:31.871105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:31.871930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 269 partition: 0 MaxSeqNo: 46 sessionId: src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0
2025-10-15T10:56:31.872764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e08d907-e806b348-236b8086-3c5a2f97_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:31.871573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:31.871606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:31.871676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:31.876981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400696510676958:4202]
2025-10-15T10:56:31.877466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400696510676958:4202], now have 1 active actors on pipe
2025-10-15T10:56:31.877537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 268, pipe: [1:7561400696510676958:4202]
2025-10-15T10:56:31.893137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0] Write session: try to update token
2025-10-15T10:56:31.893203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:31.899761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:31.899791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:31.899824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400699310381398:4415]
2025-10-15T10:56:31.899938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:31.899954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:31.902018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:31.903341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:31.904646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:31.905696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:31.907194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:31.907780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:31.958582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:31.958617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:31.958631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:31.958642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:31.958684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400699310381398:4415]
2025-10-15T10:56:31.958710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400699310381398:4415]
2025-10-15T10:56:31.958733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400699310381398:4415]
2025-10-15T10:56:31.958874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:31.958916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:31.958932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:31.958939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:31.958957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:31.960156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:31.973160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId: src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:31.997783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:32.106009Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:32.113410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:32.113461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:32.114042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:32.114070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:32.114045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400696510676958:4202]
2025-10-15T10:56:32.114073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:32.114104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:32.133009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 269 reason: error at write: Disconnected sessionId: src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0
2025-10-15T10:56:32.133317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 269 sessionId: src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0 is DEAD
2025-10-15T10:56:32.133803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:32.133873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0] Write session will restart in 0.006980s
2025-10-15T10:56:32.134034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0] Write session: Do CDS request
2025-10-15T10:56:32.134084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:32.145563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:32.145674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:32.145612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 270
2025-10-15T10:56:32.146840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:32.146988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:32.147010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:32.147020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:32.148816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 270 sessionId:  describe result for acl check
2025-10-15T10:56:32.149032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:32.149060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:32.149071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:32.149101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400700805644325:4764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:32.153491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400700805644325:4764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:32.155398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:32.159624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:32.160221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400700805644325:4764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:32.160443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:32.160469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:32.160508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:32.160735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:32.160917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400703605348813:4419]
2025-10-15T10:56:32.163018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:32.164000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:32.164202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:32.165373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:32.165695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.165714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.165722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.165728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.165734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.165740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.165745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.165753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.165760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.165766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.165772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.165779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.165784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.165790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.165833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.165929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.165981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.166024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.166067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.166107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.166154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.166200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.166242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.166290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.166335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.166382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.166427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.166472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.166519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.166586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.166644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.166700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.166748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.166801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.166846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.166896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.166945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.167000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.167044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.167097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.167154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.167203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.167243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.167291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.167334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.167402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.167444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.167492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.167506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400700805644325:4764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:32.167541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.167605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.167560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400700805644325:4764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:32.167578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400700805644325:4764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:32.167647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.167608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:32.167703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.167749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.167800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.167846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.167899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.168345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:32.183744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:32.193048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:32.193089Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:32.193104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:32.193121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:32.193141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 269 [2:7561400703605348813:4419]
2025-10-15T10:56:32.193186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:32.193238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:32.193251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:32.193263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:32.193273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:32.193312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:32.193332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:32.193351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:32.202389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.202413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.202418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.202424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:32.202636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:32.202655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.202761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.202905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.203051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:32.203122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400700805644359:4764], now have 1 active actors on pipe
2025-10-15T10:56:32.203148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400700805644266:2467], now have 1 active actors on pipe
2025-10-15T10:56:32.203081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 269
2025-10-15T10:56:32.203168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400703605348808:4419]
2025-10-15T10:56:32.203184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400703605348808:4419]
2025-10-15T10:56:32.203192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 269
2025-10-15T10:56:32.203196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400703605348808:4419]
2025-10-15T10:56:32.203223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:32.203246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:32.203259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:32.203269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:32.203283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:32.203455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:32.203475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:32.203524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:32.203536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:32.203663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400703605348808:4419]
2025-10-15T10:56:32.203692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:32.203725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:32.203750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e432326e-60f16f3f-34a33e94-fbe17833_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:32.203775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:32.203789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:32.203798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:32.203829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:32.203868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:32.203975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:32.204487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:32.204514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:32.204583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:32.204911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 270 partition: 0 MaxSeqNo: 46 sessionId: src_id|e432326e-60f16f3f-34a33e94-fbe17833_0
2025-10-15T10:56:32.205688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59aa8de6-91dbb7a2-e3af4dda-b12be88f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e432326e-60f16f3f-34a33e94-fbe17833_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:32.214409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400700805644366:4202]
2025-10-15T10:56:32.215306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 269, pipe: [1:7561400700805644366:4202]
2025-10-15T10:56:32.216077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400700805644366:4202], now have 1 active actors on pipe
2025-10-15T10:56:32.227039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e432326e-60f16f3f-34a33e94-fbe17833_0] Write session: try to update token
2025-10-15T10:56:32.227095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e432326e-60f16f3f-34a33e94-fbe17833_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:32.260852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:32.260885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:32.260926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400703605348808:4419]
2025-10-15T10:56:32.261057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:32.261065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:32.263426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:32.264786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:32.266097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:32.267448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:32.269189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:32.269603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:32.315175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:32.315215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:32.315228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:32.315285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:32.315301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:32.315314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:32.315325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:32.315377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400703605348808:4419]
2025-10-15T10:56:32.315402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400703605348808:4419]
2025-10-15T10:56:32.315423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400703605348808:4419]
2025-10-15T10:56:32.315530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:32.315544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:32.315573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:32.315585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:32.315613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:32.316931Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:32.326522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId: src_id|e432326e-60f16f3f-34a33e94-fbe17833_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:32.348042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:32.454844Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:32.457331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:32.457373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:32.458018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:32.460868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:32.473569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:32.473821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400700805644366:4202]
2025-10-15T10:56:32.474347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 270 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e432326e-60f16f3f-34a33e94-fbe17833_0
2025-10-15T10:56:32.474739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 270 sessionId: src_id|e432326e-60f16f3f-34a33e94-fbe17833_0 is DEAD
2025-10-15T10:56:32.475278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432326e-60f16f3f-34a33e94-fbe17833_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:32.475329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432326e-60f16f3f-34a33e94-fbe17833_0] Write session will restart in 0.007241s
2025-10-15T10:56:32.475491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432326e-60f16f3f-34a33e94-fbe17833_0] Write session: Do CDS request
2025-10-15T10:56:32.475528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432326e-60f16f3f-34a33e94-fbe17833_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:32.487016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e432326e-60f16f3f-34a33e94-fbe17833_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:32.501636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:32.505533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:32.506298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:32.506324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:32.506364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:32.506625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:32.506799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400703605348924:4423]
2025-10-15T10:56:32.507481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:32.507514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 271
2025-10-15T10:56:32.507911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:32.508011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:32.508032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:32.508041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:32.508913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:32.509107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 271 sessionId:  describe result for acl check
2025-10-15T10:56:32.509202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:32.509220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:32.509228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:32.509243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400700805644458:4776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:32.509710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:32.509890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:32.510980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:32.511268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.511286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.511292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.511298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.511303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.511309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.511316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.511321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.511328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.511333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.511435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400700805644458:4776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:32.511338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.511344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.511369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.511374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.511413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.511498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.511539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.511589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.511628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.511670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.511717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.511760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.511805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.511857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.511895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.511941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.511984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.512031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.512073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.512130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.512200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.512254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.512302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.512352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.512394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.512444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.512492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.512543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.512586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.512637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.512683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.512733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.512776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.512827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.512872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.512926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.512971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.513024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.513068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.513119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.513164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.513214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.513269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.513316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.513361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.513412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.513859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:32.515874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400700805644458:4776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:32.522843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400700805644458:4776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:32.522881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400700805644458:4776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:32.522896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400700805644458:4776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:32.522922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:32.528877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:32.539404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:32.539444Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:32.539457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:32.539473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:32.539495Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 270 [2:7561400703605348924:4423]
2025-10-15T10:56:32.539538Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:32.539596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:32.539608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:32.539618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:32.539628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:32.539670Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:32.539691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:32.539708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:32.541548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.541572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.541584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.541595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:32.541840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:32.541864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.541982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.542118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 270
2025-10-15T10:56:32.542155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.542243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 270
2025-10-15T10:56:32.542385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:32.542465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400700805644386:2467], now have 1 active actors on pipe
2025-10-15T10:56:32.542493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400700805644490:4776], now have 1 active actors on pipe
2025-10-15T10:56:32.542554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:32.542577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:32.542611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400703605348919:4423]
2025-10-15T10:56:32.542627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400703605348919:4423]
2025-10-15T10:56:32.542639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400703605348919:4423]
2025-10-15T10:56:32.542682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:32.542728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:32.542752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:32.542753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:32.542764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:32.542913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:32.542938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:32.542998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:32.543035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:32.543051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:32.543060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:32.543088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:32.543119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:32.543223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400703605348919:4423]
2025-10-15T10:56:32.543253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:32.543286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:32.543292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:32.543742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:32.543783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:32.543838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:32.544069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 271 partition: 0 MaxSeqNo: 46 sessionId: src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0
2025-10-15T10:56:32.544750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e432326e-60f16f3f-34a33e94-fbe17833_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:32.567190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0] Write session: try to update token
2025-10-15T10:56:32.567241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:32.574445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400700805644500:4202]
2025-10-15T10:56:32.575129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 270, pipe: [1:7561400700805644500:4202]
2025-10-15T10:56:32.575784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:32.575810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:32.575840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400703605348919:4423]
2025-10-15T10:56:32.575939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:32.575947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400700805644500:4202], now have 1 active actors on pipe
2025-10-15T10:56:32.575981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:32.578046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:32.579725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:32.584574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:32.587333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:32.589801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:32.590354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:32.656346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:32.656388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:32.656399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:32.656462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:32.656475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:32.656486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:32.656495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:32.656528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400703605348919:4423]
2025-10-15T10:56:32.656571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400703605348919:4423]
2025-10-15T10:56:32.656604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400703605348919:4423]
2025-10-15T10:56:32.656698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:32.656735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:32.656746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:32.656758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:32.656762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:32.658941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:32.663054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId: src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:32.682967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:32.793942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:32.797798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:32.797839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:32.798254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:32.798300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:32.798490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:32.831036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:32.831160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400700805644500:4202]
2025-10-15T10:56:32.831231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 271 reason: error at write: Disconnected sessionId: src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0
2025-10-15T10:56:32.831643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 271 sessionId: src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0 is DEAD
2025-10-15T10:56:32.834164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:32.834203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0] Write session will restart in 0.005029s
2025-10-15T10:56:32.834334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0] Write session: Do CDS request
2025-10-15T10:56:32.834271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:32.834402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:32.840311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:32.841278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:32.841324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:32.841383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:32.841731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:32.841971Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400703605349026:4429]
2025-10-15T10:56:32.843400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:32.843428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:32.843459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 272
2025-10-15T10:56:32.844153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:32.844200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:32.844285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:32.844305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:32.844314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:32.845443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 272 sessionId:  describe result for acl check
2025-10-15T10:56:32.845459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:32.845537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:32.845556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:32.845564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:32.845578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400700805644573:4780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:32.845638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:32.846737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:32.847016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.847031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.847037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.847042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.847049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.847055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.847060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.847067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.847072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.847078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.847084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.847090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.847095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.847101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.847138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.847222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.847260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.847296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.847331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.847384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.847419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.847466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.847508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.847552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.847605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.847647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.847689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.847737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.847774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.847832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:32.847860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400700805644573:4780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:32.847882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.847931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:32.847971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.848015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:32.848052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.848095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:32.848133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.848176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:32.848211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.848269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:32.848312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.848365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:32.848409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.848460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:32.848509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.848569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:32.848624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.848677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:32.848724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.848777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:32.848833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.848880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.848928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.848982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.849019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.849071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.849542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:32.854556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400700805644573:4780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:32.860976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400700805644573:4780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:32.861015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400700805644573:4780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:32.861030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400700805644573:4780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:32.861053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:32.865828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:32.874738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:32.874773Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:32.874784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:32.874797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:32.874814Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 271 [2:7561400703605349026:4429]
2025-10-15T10:56:32.874858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:32.874902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:32.874912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:32.874923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:32.874934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:32.874977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:32.874997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:32.875018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:32.876068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.876094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.876107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.876117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:32.876358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:32.876383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:32.876510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:32.876620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 271
2025-10-15T10:56:32.876695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:32.876625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 271
2025-10-15T10:56:32.876915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:32.876989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400700805644610:4780], now have 1 active actors on pipe
2025-10-15T10:56:32.877015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400700805644559:2467], now have 1 active actors on pipe
2025-10-15T10:56:32.877071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:32.877100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:32.877131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400703605349019:4429]
2025-10-15T10:56:32.877144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400703605349019:4429]
2025-10-15T10:56:32.877156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400703605349019:4429]
2025-10-15T10:56:32.877191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:32.877230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:32.877243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:32.877252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:32.877254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:32.877416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:32.877438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:32.877493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74858d5-6973689e-b7153f05-25131eed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:32.877522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:32.877540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:32.877549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:32.877579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:32.877613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:32.877717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400703605349019:4429]
2025-10-15T10:56:32.877741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:32.877772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:32.877781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:32.878278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:32.878305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:32.878364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:32.878581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 272 partition: 0 MaxSeqNo: 46 sessionId: src_id|74858d5-6973689e-b7153f05-25131eed_0
2025-10-15T10:56:32.879274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eee7c122-9e13869f-682eeb72-a35b8a6a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|74858d5-6973689e-b7153f05-25131eed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:32.899710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74858d5-6973689e-b7153f05-25131eed_0] Write session: try to update token
2025-10-15T10:56:32.899764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74858d5-6973689e-b7153f05-25131eed_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:32.925504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:32.925525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:32.925546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400703605349019:4429]
2025-10-15T10:56:32.925621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:32.925646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:32.927306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:32.928541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:32.929718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:32.931019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:32.931215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400700805644618:4202]
2025-10-15T10:56:32.932034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 271, pipe: [1:7561400700805644618:4202]
2025-10-15T10:56:32.935712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:32.936344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400700805644618:4202], now have 1 active actors on pipe
2025-10-15T10:56:32.936412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:32.979209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:32.979246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:32.979260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:32.979272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:32.979312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400703605349019:4429]
2025-10-15T10:56:32.979338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400703605349019:4429]
2025-10-15T10:56:32.979378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400703605349019:4429]
2025-10-15T10:56:32.979500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:32.979521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:32.979533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:32.979542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:32.979544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:32.979594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:32.979597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:32.979616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:32.980668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:32.996807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId: src_id|74858d5-6973689e-b7153f05-25131eed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:33.024758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:33.121526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:33.122852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:33.122887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:33.123371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400700805644618:4202]
2025-10-15T10:56:33.123473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:33.123491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:33.123584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:33.123582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:33.131556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 272 reason: error at write: Disconnected sessionId: src_id|74858d5-6973689e-b7153f05-25131eed_0
2025-10-15T10:56:33.131866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 272 sessionId: src_id|74858d5-6973689e-b7153f05-25131eed_0 is DEAD
2025-10-15T10:56:33.132174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74858d5-6973689e-b7153f05-25131eed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:33.132207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74858d5-6973689e-b7153f05-25131eed_0] Write session will restart in 0.008146s
2025-10-15T10:56:33.132310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74858d5-6973689e-b7153f05-25131eed_0] Write session: Do CDS request
2025-10-15T10:56:33.132366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74858d5-6973689e-b7153f05-25131eed_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:33.143832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:33.143864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 273
2025-10-15T10:56:33.143927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74858d5-6973689e-b7153f05-25131eed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:33.144412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:33.144529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:33.144551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:33.144560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:33.145681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 273 sessionId:  describe result for acl check
2025-10-15T10:56:33.145787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:33.145805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:33.145814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:33.145828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400705100611931:4787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:33.147837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400705100611931:4787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:33.155933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400705100611931:4787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:33.161250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:33.164159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:33.164282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400705100611931:4787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:33.164325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400705100611931:4787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:33.164340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400705100611931:4787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:33.164369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:33.164806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:33.164849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:33.164890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:33.165098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:33.165250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400707900316462:4440]
2025-10-15T10:56:33.166959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:33.167674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:33.167865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:33.168634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:33.168819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.168828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.168831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.168835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.168838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.168842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.168846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.168849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.168853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.168857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.168861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.168865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.168868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.168872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.168897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.168955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.168979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.169002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.169024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.169047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.169069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.169091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.169113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.169136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.169158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.169180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.169202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.169224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.169244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.169278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.169307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.169338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.169378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.169409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.169434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.169466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.169493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.169519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.169544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.169572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.169610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.169646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.169672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.169698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.169725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.169752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.169777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.169804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.169837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.169870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.169896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.169927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.169954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.169982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.170006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.170033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.170290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:33.187316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:33.195022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:33.195050Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:33.195061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:33.195073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:33.195089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 272 [2:7561400707900316462:4440]
2025-10-15T10:56:33.195123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:33.195164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:33.195175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:33.195184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:33.195191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:33.195221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:33.195236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:33.195250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:33.196066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.196081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.196089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.196095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:33.196257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:33.196271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.196356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.196489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.196638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:33.196687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400705100611917:2467], now have 1 active actors on pipe
2025-10-15T10:56:33.196620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 272
2025-10-15T10:56:33.196701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400705100612008:4787], now have 1 active actors on pipe
2025-10-15T10:56:33.196631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 272
2025-10-15T10:56:33.196715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400707900316456:4440]
2025-10-15T10:56:33.196723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400707900316456:4440]
2025-10-15T10:56:33.196731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400707900316456:4440]
2025-10-15T10:56:33.196750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:33.196777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:33.196791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:33.196791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:33.196802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:33.196915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:33.196930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:33.196963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:33.196979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:33.197071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400707900316456:4440]
2025-10-15T10:56:33.197098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:33.197139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:33.197167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c59d892-9417fe95-d7727268-22d92373_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:33.197191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:33.197211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:33.197219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:33.197248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:33.197272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:33.197370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:33.197808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:33.197836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:33.197896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:33.198215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 273 partition: 0 MaxSeqNo: 46 sessionId: src_id|c59d892-9417fe95-d7727268-22d92373_0
2025-10-15T10:56:33.198887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74858d5-6973689e-b7153f05-25131eed_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c59d892-9417fe95-d7727268-22d92373_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:33.221242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d892-9417fe95-d7727268-22d92373_0] Write session: try to update token
2025-10-15T10:56:33.221300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d892-9417fe95-d7727268-22d92373_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:33.223497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400705100612021:4202]
2025-10-15T10:56:33.224391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 272, pipe: [1:7561400705100612021:4202]
2025-10-15T10:56:33.226743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:33.226767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:33.226790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400707900316456:4440]
2025-10-15T10:56:33.226886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400705100612021:4202], now have 1 active actors on pipe
2025-10-15T10:56:33.226898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:33.226931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:33.228768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:33.248446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:33.249432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:33.250453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:33.251955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:33.252372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:33.276973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:33.277002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:33.277016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:33.277027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:33.277062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400707900316456:4440]
2025-10-15T10:56:33.277088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400707900316456:4440]
2025-10-15T10:56:33.277109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400707900316456:4440]
2025-10-15T10:56:33.277212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:33.277237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:33.277257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:33.277261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:33.277286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:33.278348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:33.300587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId: src_id|c59d892-9417fe95-d7727268-22d92373_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:33.319864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:33.416638Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:33.417778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:33.417808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:33.418201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:33.418254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400705100612021:4202]
2025-10-15T10:56:33.418323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:33.418337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:33.418407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:33.440771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 273 reason: error at write: Disconnected sessionId: src_id|c59d892-9417fe95-d7727268-22d92373_0
2025-10-15T10:56:33.441046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 273 sessionId: src_id|c59d892-9417fe95-d7727268-22d92373_0 is DEAD
2025-10-15T10:56:33.441451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d892-9417fe95-d7727268-22d92373_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:33.441527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d892-9417fe95-d7727268-22d92373_0] Write session will restart in 0.008886s
2025-10-15T10:56:33.441704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d892-9417fe95-d7727268-22d92373_0] Write session: Do CDS request
2025-10-15T10:56:33.441766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d892-9417fe95-d7727268-22d92373_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:33.455380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:33.455434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 274
2025-10-15T10:56:33.455730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d892-9417fe95-d7727268-22d92373_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:33.456349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:33.456591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:33.456637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:33.456656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:33.458631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 274 sessionId:  describe result for acl check
2025-10-15T10:56:33.458735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:33.458748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:33.458754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:33.458773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400705100612086:4792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:33.460623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400705100612086:4792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:33.464586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:33.465493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400705100612086:4792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:33.468208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:33.468911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:33.468942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:33.468985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:33.469241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:33.469428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400707900316566:4442]
2025-10-15T10:56:33.471013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400705100612086:4792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:33.471056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400705100612086:4792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:33.471072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400705100612086:4792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:33.471099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:33.471204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:33.472063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:33.472242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:33.473294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:33.473623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.473637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.473643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.473650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.473656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.473662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.473669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.473675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.473681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.473688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.473695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.473702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.473708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.473714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.473755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.473857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.473912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.473953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.474004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.474050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.474096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.474143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.474190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.474239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.474288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.474335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.474381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.474430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.474474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.474536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.474593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.474649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.474701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.474757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.474804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.474859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.474909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.474963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.475013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.475067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.475120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.475170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.475218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.475273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.475325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.475397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.475444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.475501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.475546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.475606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.475653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.475707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.475757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.475814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.475865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.475912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.476386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:33.491003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:33.500321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:33.500361Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:33.500378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:33.500397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:33.500421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 273 [2:7561400707900316566:4442]
2025-10-15T10:56:33.500471Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:33.500517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:33.500529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:33.500540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:33.500550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:33.500593Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:33.500614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:33.500635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:33.501582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.501603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.501616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.501627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:33.501884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:33.501909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.502034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.502063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 273
2025-10-15T10:56:33.502073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 273
2025-10-15T10:56:33.502221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.502448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:33.502519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400705100612024:2467], now have 1 active actors on pipe
2025-10-15T10:56:33.502545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400705100612117:4792], now have 1 active actors on pipe
2025-10-15T10:56:33.502604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:33.502626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:33.502661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400707900316560:4442]
2025-10-15T10:56:33.502679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400707900316560:4442]
2025-10-15T10:56:33.502691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400707900316560:4442]
2025-10-15T10:56:33.502722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:33.502761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:33.502783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:33.502783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:33.502792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:33.502940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:33.502960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:33.503015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d99e6093-b41982da-5ed40976-d8773327_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:33.503043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:33.503057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:33.503067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:33.503094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:33.503124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:33.503224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400707900316560:4442]
2025-10-15T10:56:33.503255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:33.503297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:33.503299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:33.503687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:33.503711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:33.503772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:33.503971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 274 partition: 0 MaxSeqNo: 46 sessionId: src_id|d99e6093-b41982da-5ed40976-d8773327_0
2025-10-15T10:56:33.504611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d892-9417fe95-d7727268-22d92373_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d99e6093-b41982da-5ed40976-d8773327_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:33.518428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400705100612139:4202]
2025-10-15T10:56:33.518941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400705100612139:4202], now have 1 active actors on pipe
2025-10-15T10:56:33.519096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 273, pipe: [1:7561400705100612139:4202]
2025-10-15T10:56:33.528637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d99e6093-b41982da-5ed40976-d8773327_0] Write session: try to update token
2025-10-15T10:56:33.528737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d99e6093-b41982da-5ed40976-d8773327_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:33.532125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:33.532158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:33.532193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400707900316560:4442]
2025-10-15T10:56:33.532311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:33.532315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:33.534198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:33.535893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:33.537104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:33.538347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:33.540284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:33.540787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:33.606353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId: src_id|d99e6093-b41982da-5ed40976-d8773327_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:33.607793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:33.607819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:33.607832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:33.607840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:33.607876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400707900316560:4442]
2025-10-15T10:56:33.607901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400707900316560:4442]
2025-10-15T10:56:33.607924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400707900316560:4442]
2025-10-15T10:56:33.608045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:33.608053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:33.608064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:33.608077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:33.608086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:33.608118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:33.608122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:33.608137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:33.608974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:33.629576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:33.744708Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:33.749381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:33.749425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:33.750130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:33.750123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:33.750203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:33.750216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:33.750317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400705100612139:4202]
2025-10-15T10:56:33.759936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 274 reason: error at write: Disconnected sessionId: src_id|d99e6093-b41982da-5ed40976-d8773327_0
2025-10-15T10:56:33.760261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 274 sessionId: src_id|d99e6093-b41982da-5ed40976-d8773327_0 is DEAD
2025-10-15T10:56:33.760582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99e6093-b41982da-5ed40976-d8773327_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:33.760636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99e6093-b41982da-5ed40976-d8773327_0] Write session will restart in 0.005356s
2025-10-15T10:56:33.760765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99e6093-b41982da-5ed40976-d8773327_0] Write session: Do CDS request
2025-10-15T10:56:33.760811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99e6093-b41982da-5ed40976-d8773327_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:33.775952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:33.775986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 275
2025-10-15T10:56:33.777895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d99e6093-b41982da-5ed40976-d8773327_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:33.778662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:33.778817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:33.778845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:33.778854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:33.781022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 275 sessionId:  describe result for acl check
2025-10-15T10:56:33.781190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:33.781222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:33.781238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:33.781266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400705100612156:4797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:33.784847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400705100612156:4797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:33.790325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400705100612156:4797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:33.796662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400705100612156:4797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:33.796707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400705100612156:4797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:33.796722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400705100612156:4797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:33.796752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:33.798066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:33.801263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:33.801943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:33.801968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:33.802009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:33.802241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:33.802424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400707900316669:4444]
2025-10-15T10:56:33.804114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:33.805477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:33.805670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:33.806561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:33.806802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.806815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.806822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.806828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.806834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.806840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.806846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.806851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.806857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.806863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.806870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.806877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.806883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.806890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.806933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.807029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.807073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.807118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.807169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.807213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.807249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.807295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.807332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.807395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.807441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.807485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.807532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.807587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.807632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.807696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:33.807759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.807809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:33.807855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.807909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:33.807958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.808007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:33.808058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.808112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:33.808159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.808213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:33.808259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.808314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:33.808360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.808410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:33.808458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.808513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:33.808561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.808611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:33.808658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.808705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:33.808752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.808804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.808852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.808907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.808952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.809000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.809455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:33.824376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:33.838625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:33.838656Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:33.838667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:33.838679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:33.838696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 274 [2:7561400707900316669:4444]
2025-10-15T10:56:33.838732Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:33.838774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:33.838787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:33.838799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:33.838810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:33.838856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:33.838874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:33.838895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:33.839898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.839923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.839935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.839945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:33.840162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:33.840177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:33.840265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:33.840387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:33.840483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 274
2025-10-15T10:56:33.840542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:33.840505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 274
2025-10-15T10:56:33.840618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400705100612142:2467], now have 1 active actors on pipe
2025-10-15T10:56:33.840637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400705100612236:4797], now have 1 active actors on pipe
2025-10-15T10:56:33.840653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400707900316664:4444]
2025-10-15T10:56:33.840662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400707900316664:4444]
2025-10-15T10:56:33.840669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400707900316664:4444]
2025-10-15T10:56:33.840694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:33.840735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:33.840739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:33.840756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:33.840769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:33.840881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:33.840897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:33.840943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:33.840959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:33.841062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400707900316664:4444]
2025-10-15T10:56:33.841085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:33.841115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:33.841131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:33.841147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:33.841158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:33.841164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:33.841185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:33.841211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:33.841320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:33.841764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:33.841793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:33.841850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:33.842136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 275 partition: 0 MaxSeqNo: 46 sessionId: src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0
2025-10-15T10:56:33.842922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d99e6093-b41982da-5ed40976-d8773327_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:33.850716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400705100612249:4202]
2025-10-15T10:56:33.851202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400705100612249:4202], now have 1 active actors on pipe
2025-10-15T10:56:33.851264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 274, pipe: [1:7561400705100612249:4202]
2025-10-15T10:56:33.861599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0] Write session: try to update token
2025-10-15T10:56:33.861649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:33.903849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:33.903890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:33.903908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:33.903923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:33.903963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400707900316664:4444]
2025-10-15T10:56:33.903994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400707900316664:4444]
2025-10-15T10:56:33.904032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400707900316664:4444]
2025-10-15T10:56:33.904182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:33.904228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:33.904269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:33.904283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:33.904315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:33.906623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:33.939306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId: src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:33.960227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:34.044470Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:34.062833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:34.062876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:34.062938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:34.062952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:34.062989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400707900316664:4444]
2025-10-15T10:56:34.063187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:34.063446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:34.063620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400705100612249:4202]
2025-10-15T10:56:34.063561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:34.063708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:34.063726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:34.080029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 275 reason: error at write: Disconnected sessionId: src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0
2025-10-15T10:56:34.080357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 275 sessionId: src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0 is DEAD
2025-10-15T10:56:34.080770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:34.080842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0] Write session will restart in 0.005837s
2025-10-15T10:56:34.081002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0] Write session: Do CDS request
2025-10-15T10:56:34.081044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:34.091627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:34.101098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:34.101129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 276
2025-10-15T10:56:34.101682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:34.101785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:34.101803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:34.101811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:34.102868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 276 sessionId:  describe result for acl check
2025-10-15T10:56:34.102964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:34.102980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:34.102992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:34.103010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400709395579634:4809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:34.105177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400709395579634:4809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:34.106904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:34.109918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400709395579634:4809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:34.109955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:34.110625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:34.110650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:34.110687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:34.110924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:34.111084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400712195284094:4452]
2025-10-15T10:56:34.112608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:34.113324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:34.113469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:34.114415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:34.114637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.114647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.114651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.114656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.114660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.114664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.114667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.114670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.114673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.114678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.114681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.114685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.114689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.114693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.114720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.114797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.114828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.114856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.114880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.114907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.114932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.114960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.115001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.115032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.115058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.115084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.115110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.115139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.115161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.115200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.115232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.115270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.115311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.115265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400709395579634:4809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:34.115373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.115302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400709395579634:4809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:34.115316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400709395579634:4809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:34.115416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.115341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:34.115456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.115487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.115521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.115550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.115618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.115656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.115690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.115720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.115760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.115804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.115855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.115899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.115950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.115980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.116029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.116074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.116115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.116145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.116178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.116209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.116244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.116578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:34.134061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:34.151089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:34.151128Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:34.151141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:34.151155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:34.151174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 275 [2:7561400712195284094:4452]
2025-10-15T10:56:34.151214Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:34.151258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:34.151269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:34.151279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:34.151289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:34.151327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:34.151364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:34.151383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:34.153263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.153285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.153297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.153307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:34.153572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:34.153597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.153713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.153759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 275
2025-10-15T10:56:34.153877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 275
2025-10-15T10:56:34.153875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.154086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:34.154164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400709395579667:4809], now have 1 active actors on pipe
2025-10-15T10:56:34.154190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400709395579568:2467], now have 1 active actors on pipe
2025-10-15T10:56:34.154230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:34.154253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:34.154297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400712195284089:4452]
2025-10-15T10:56:34.154315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400712195284089:4452]
2025-10-15T10:56:34.154326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400712195284089:4452]
2025-10-15T10:56:34.154358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:34.154386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:34.154407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:34.154417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:34.154418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:34.154572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:34.154595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:34.154648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:34.154677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:34.154697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:34.154706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:34.154736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:34.154770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:34.154889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400712195284089:4452]
2025-10-15T10:56:34.154922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:34.154937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:34.154964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:34.155461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:34.155486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:34.155543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:34.155837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 276 partition: 0 MaxSeqNo: 46 sessionId: src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0
2025-10-15T10:56:34.156579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|effc13f9-22cc2ceb-72e2cef9-36a1107_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:34.164087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400709395579675:4202]
2025-10-15T10:56:34.164517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400709395579675:4202], now have 1 active actors on pipe
2025-10-15T10:56:34.164558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 275, pipe: [1:7561400709395579675:4202]
2025-10-15T10:56:34.178117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0] Write session: try to update token
2025-10-15T10:56:34.178182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:34.184957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:34.184989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:34.185019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400712195284089:4452]
2025-10-15T10:56:34.185112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:34.185128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:34.187544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:34.188911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:34.190549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:34.192192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:34.194323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:34.194858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:34.243152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:34.243181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:34.243193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:34.243203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:34.243237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400712195284089:4452]
2025-10-15T10:56:34.243260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400712195284089:4452]
2025-10-15T10:56:34.243281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400712195284089:4452]
2025-10-15T10:56:34.243412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:34.243419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:34.243438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:34.243462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:34.243486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:34.244902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:34.292015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId: src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:34.311507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:34.385649Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:34.386958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:34.386995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:34.387522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:34.387553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400709395579675:4202]
2025-10-15T10:56:34.387558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:34.387647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:34.387690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:34.421505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:34.425172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:34.426256Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:34.426283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:34.426318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:34.426537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:34.426707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400712195284225:4463]
2025-10-15T10:56:34.428373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:34.429057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:34.429193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:34.429927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:34.430128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.430138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.430143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.430147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.430151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.430154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.430158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.430162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.430165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.430170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.430176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.430182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.430188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.430193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.430229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.430289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.430313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.430348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.430382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.430419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.430454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.430489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.430513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.430561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.430606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.430643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.430667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.430700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.430742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.430796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.430844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.430887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.430917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.430959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.430988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.431015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.431042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.431080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.431128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.431172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.431206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.431248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.431281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.431325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.431379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.431419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.431452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.431506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.431548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.431603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.431656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.431704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.431748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.431802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.431844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.431889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.432236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:34.439238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 276 reason: error at write: Disconnected sessionId: src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0
2025-10-15T10:56:34.439535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 276 sessionId: src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0 is DEAD
2025-10-15T10:56:34.439987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:34.440045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0] Write session will restart in 0.008540s
2025-10-15T10:56:34.440237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0] Write session: Do CDS request
2025-10-15T10:56:34.440295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:34.454187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:34.454248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 277
2025-10-15T10:56:34.454646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:34.455023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:34.455302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:34.455441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:34.455464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:34.455473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:34.456889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 277 sessionId:  describe result for acl check
2025-10-15T10:56:34.456994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:34.457009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:34.457019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:34.457050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400709395579767:4817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:34.459623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400709395579767:4817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:34.464929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400709395579767:4817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:34.465505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:34.465538Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:34.465552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:34.465567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:34.465588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 276 [2:7561400712195284225:4463]
2025-10-15T10:56:34.465632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:34.465668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:34.465680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:34.465691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:34.465703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:34.465744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:34.465762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:34.465778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:34.467225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.467243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.467255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.467266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:34.467491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:34.467512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.467648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.467738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 276
2025-10-15T10:56:34.467818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.468057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:34.468136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400709395579695:2467], now have 1 active actors on pipe
2025-10-15T10:56:34.468181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400712195284220:4463]
2025-10-15T10:56:34.468201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400712195284220:4463]
2025-10-15T10:56:34.468214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400712195284220:4463]
2025-10-15T10:56:34.468247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:34.468286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:34.468307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:34.468308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:34.468319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:34.468470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:34.468495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:34.468611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400712195284220:4463]
2025-10-15T10:56:34.468647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:34.468681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:34.475950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400709395579767:4817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:34.475990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400709395579767:4817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:34.476005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400709395579767:4817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:34.476032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:34.476653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400709395579800:4817], now have 1 active actors on pipe
2025-10-15T10:56:34.476782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 276
2025-10-15T10:56:34.476928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:34.476956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:34.477020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:34.477056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:34.477074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:34.477084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:34.477115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:34.477154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:34.477203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:34.477562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:34.477599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:34.477663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:34.477847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 277 partition: 0 MaxSeqNo: 46 sessionId: src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0
2025-10-15T10:56:34.478507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e7a3f4-30ffc632-c1695338-cbc0b807_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:34.487634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400709395579803:4202]
2025-10-15T10:56:34.488157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 276, pipe: [1:7561400709395579803:4202]
2025-10-15T10:56:34.501173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0] Write session: try to update token
2025-10-15T10:56:34.501220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:34.525951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400709395579803:4202], now have 1 active actors on pipe
2025-10-15T10:56:34.525986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:34.525998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:34.526023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400712195284220:4463]
2025-10-15T10:56:34.526121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:34.526163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:34.527953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:34.529103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:34.530208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:34.531458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:34.533397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:34.568090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:34.568272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:34.568303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:34.568317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:34.568338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:34.568378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400712195284220:4463]
2025-10-15T10:56:34.568446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400712195284220:4463]
2025-10-15T10:56:34.568478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400712195284220:4463]
2025-10-15T10:56:34.568578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:34.568631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:34.568641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:34.568655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:34.568668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:34.568673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:34.568711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:34.568737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:34.571260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:34.594123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId: src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:34.615239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:34.709405Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:34.710599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:34.710650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:34.711094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400709395579803:4202]
2025-10-15T10:56:34.711098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:34.711204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:34.711216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:34.711321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:34.745793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 277 reason: error at write: Disconnected sessionId: src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0
2025-10-15T10:56:34.746110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 277 sessionId: src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0 is DEAD
2025-10-15T10:56:34.746597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:34.746683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0] Write session will restart in 0.006754s
2025-10-15T10:56:34.746905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0] Write session: Do CDS request
2025-10-15T10:56:34.746980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:34.751984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:34.755556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:34.756322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:34.756346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:34.756381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:34.756604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:34.756779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400712195284330:4465]
2025-10-15T10:56:34.759169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:34.759234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 278
2025-10-15T10:56:34.759368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:34.760138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:34.760362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:34.760417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:34.760441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:34.760519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:34.762540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 278 sessionId:  describe result for acl check
2025-10-15T10:56:34.762655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:34.762671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:34.762680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:34.762695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400709395579886:4822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:34.765210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400709395579886:4822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:34.765990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:34.766217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:34.767316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:34.769800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400709395579886:4822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:34.767672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.767693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.767700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.767706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.767712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.767718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.767724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.767730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.767737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.767742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.767748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.767754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.767760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.767766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.767808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.767901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.767942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.767984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.768021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.768062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.768101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.768154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.768201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.768242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.768283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.768321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.768361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.768400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.768446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.768506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:34.768554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.768603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:34.768647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.768697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:34.768738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.768785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:34.768825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.768875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:34.768915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.768965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:34.769006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.769052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:34.769092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.769141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:34.769183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.769231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:34.769272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.769321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:34.769364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.769412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:34.769453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.769499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.769540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.769583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.769620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.769664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.770111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:34.779320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400709395579886:4822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:34.779386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400709395579886:4822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:34.779404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400709395579886:4822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:34.779433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:34.783999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:34.794052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:34.794090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:34.794107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:34.794123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:34.794147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 277 [2:7561400712195284330:4465]
2025-10-15T10:56:34.794198Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:34.794251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:34.794265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:34.794277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:34.794287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:34.794331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:34.794351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:34.794379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:34.807048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.807072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.807083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.807093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:34.807363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:34.807382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:34.807497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:34.807667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:34.807858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:34.807925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400709395579817:2467], now have 1 active actors on pipe
2025-10-15T10:56:34.807945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400709395579919:4822], now have 1 active actors on pipe
2025-10-15T10:56:34.807999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:34.808013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:34.808035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400712195284325:4465]
2025-10-15T10:56:34.808043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400712195284325:4465]
2025-10-15T10:56:34.808050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400712195284325:4465]
2025-10-15T10:56:34.808075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:34.808097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:34.808110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:34.808120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:34.808136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:34.808296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:34.808311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:34.808366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6643367e-9f60700f-9a844647-291bbf2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:34.808388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:34.808398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:34.808405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:34.808428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:34.808455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:34.808541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400712195284325:4465]
2025-10-15T10:56:34.808570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:34.808590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:34.808608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:34.809013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:34.809032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:34.809099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:34.810097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a369a5f-500d4860-197e3d5-29b5c6e6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6643367e-9f60700f-9a844647-291bbf2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:34.807619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 277
2025-10-15T10:56:34.807631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 277
2025-10-15T10:56:34.809330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 278 partition: 0 MaxSeqNo: 46 sessionId: src_id|6643367e-9f60700f-9a844647-291bbf2c_0
2025-10-15T10:56:34.811179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400709395579925:4202]
2025-10-15T10:56:34.815393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400709395579925:4202], now have 1 active actors on pipe
2025-10-15T10:56:34.815515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 277, pipe: [1:7561400709395579925:4202]
2025-10-15T10:56:34.829732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6643367e-9f60700f-9a844647-291bbf2c_0] Write session: try to update token
2025-10-15T10:56:34.829786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6643367e-9f60700f-9a844647-291bbf2c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:34.835860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:34.835893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:34.835928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400712195284325:4465]
2025-10-15T10:56:34.836033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:34.836055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:34.838015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:34.839275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:34.840625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:34.842041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:34.844343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:34.844859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:34.895159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:34.895193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:34.895207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:34.895218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:34.895255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400712195284325:4465]
2025-10-15T10:56:34.895297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400712195284325:4465]
2025-10-15T10:56:34.895322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400712195284325:4465]
2025-10-15T10:56:34.895445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:34.895474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:34.895486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:34.895501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:34.895510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:34.895512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:34.895549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:34.895567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:34.896444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:34.908707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId: src_id|6643367e-9f60700f-9a844647-291bbf2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:34.927017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:35.031043Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:35.032498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:35.032536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:35.032997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400709395579925:4202]
2025-10-15T10:56:35.033089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:35.033109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:35.033120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:35.033197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:35.055927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 278 reason: error at write: Disconnected sessionId: src_id|6643367e-9f60700f-9a844647-291bbf2c_0
2025-10-15T10:56:35.056202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 278 sessionId: src_id|6643367e-9f60700f-9a844647-291bbf2c_0 is DEAD
2025-10-15T10:56:35.056589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6643367e-9f60700f-9a844647-291bbf2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:35.056661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6643367e-9f60700f-9a844647-291bbf2c_0] Write session will restart in 0.007215s
2025-10-15T10:56:35.056791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6643367e-9f60700f-9a844647-291bbf2c_0] Write session: Do CDS request
2025-10-15T10:56:35.056835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6643367e-9f60700f-9a844647-291bbf2c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:35.068458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6643367e-9f60700f-9a844647-291bbf2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:35.068416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:35.068449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 279
2025-10-15T10:56:35.069009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:35.069111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:35.069131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:35.069138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:35.071232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 279 sessionId:  describe result for acl check
2025-10-15T10:56:35.071408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:35.071432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:35.071442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:35.071464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400713690547291:4826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:35.074190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400713690547291:4826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:35.079013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400713690547291:4826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:35.080129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:35.081500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:35.082050Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:35.082070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:35.082095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:35.082245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:35.082365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400716490251736:4467]
2025-10-15T10:56:35.084191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:35.084965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:35.084961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400713690547291:4826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:35.084999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400713690547291:4826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:35.085014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400713690547291:4826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:35.085040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:35.085174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:35.086323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:35.086616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.086632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.086639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.086646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.086652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.086658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.086665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.086671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.086677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.086683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.086689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.086695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.086702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.086708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.086748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.086842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.086886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.086929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.086972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.087014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.087064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.087113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.087155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.087205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.087255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.087304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.087366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.087412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.087458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.087515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.087572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.087642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.087690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.087746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.087791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.087844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.087893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.087951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.087998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.088054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.088105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.088158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.088201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.088254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.088303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.088358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.088404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.088456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.088506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.088560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.088604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.088668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.088716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.088769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.088818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.088868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.089342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:35.102934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:35.112302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:35.112339Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:35.112354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:35.112370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:35.112389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 278 [2:7561400716490251736:4467]
2025-10-15T10:56:35.112433Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:35.112477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:35.112489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:35.112498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:35.112508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:35.112548Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:35.112566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:35.112583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:35.113594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.113612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.113620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.113626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:35.113856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:35.113879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.113976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.114129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.114130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 278
2025-10-15T10:56:35.114133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 278
2025-10-15T10:56:35.114281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:35.114333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400713690547331:4826], now have 1 active actors on pipe
2025-10-15T10:56:35.114350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400713690547233:2467], now have 1 active actors on pipe
2025-10-15T10:56:35.114390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:35.114407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:35.114430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400716490251731:4467]
2025-10-15T10:56:35.114438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400716490251731:4467]
2025-10-15T10:56:35.114445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400716490251731:4467]
2025-10-15T10:56:35.114468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:35.114503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:35.114513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:35.114524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:35.114535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:35.114627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:35.114642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:35.114677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:35.114697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:35.114707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:35.114712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:35.114734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:35.114757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:35.114837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400716490251731:4467]
2025-10-15T10:56:35.114856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:35.114881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:35.114880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:35.115274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:35.115300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:35.115372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:35.115630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 279 partition: 0 MaxSeqNo: 46 sessionId: src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0
2025-10-15T10:56:35.116251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6643367e-9f60700f-9a844647-291bbf2c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:35.133298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400713690547338:4202]
2025-10-15T10:56:35.133800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400713690547338:4202], now have 1 active actors on pipe
2025-10-15T10:56:35.133885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 278, pipe: [1:7561400713690547338:4202]
2025-10-15T10:56:35.135989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0] Write session: try to update token
2025-10-15T10:56:35.136035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:35.154855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:35.154888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:35.154918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400716490251731:4467]
2025-10-15T10:56:35.155024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:35.155024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:35.156908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:35.158219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:35.159570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:35.160939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:35.162800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:35.163234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:35.211981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:35.212012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:35.212024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:35.212034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:35.212071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400716490251731:4467]
2025-10-15T10:56:35.212096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400716490251731:4467]
2025-10-15T10:56:35.212120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400716490251731:4467]
2025-10-15T10:56:35.212240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:35.212255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:35.212276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:35.212294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:35.212328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:35.213320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:35.215694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId: src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:35.235935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:35.354724Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:35.356808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:35.356843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:35.357483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:35.357514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:35.357581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:35.368985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:35.369128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400713690547338:4202]
2025-10-15T10:56:35.369208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 279 reason: error at write: Disconnected sessionId: src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0
2025-10-15T10:56:35.369471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 279 sessionId: src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0 is DEAD
2025-10-15T10:56:35.371573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:35.371639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0] Write session will restart in 0.006051s
2025-10-15T10:56:35.371790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0] Write session: Do CDS request
2025-10-15T10:56:35.371824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:35.383419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:35.384033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:35.384064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 280
2025-10-15T10:56:35.384519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:35.384722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:35.384750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:35.384761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:35.386301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 280 sessionId:  describe result for acl check
2025-10-15T10:56:35.386468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:35.386492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:35.386502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:35.386521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400713690547369:4837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:35.389696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400713690547369:4837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:35.398304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400713690547369:4837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:35.408162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400713690547369:4837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:35.408207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400713690547369:4837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:35.408222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400713690547369:4837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:35.408249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:35.421104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:35.424228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:35.424983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:35.425014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:35.425054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:35.425285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:35.425465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400716490251869:4477]
2025-10-15T10:56:35.427646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:35.428740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:35.428937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:35.430085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:35.430384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.430391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.430397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.430404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.430411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.430418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.430425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.430432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.430438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.430444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.430451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.430457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.430463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.430469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.430510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.430607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.430651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.430697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.430738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.430781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.430838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.430884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.430931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.430980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.431028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.431075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.431121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.431169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.431211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.431277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.431339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.431417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.431473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.431523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.431573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.431646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.431699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.431752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.431802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.431854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.431898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.431947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.431990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.432040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.432083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.432133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.432177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.432227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.432271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.432321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.432365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.432415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.432459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.432546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.432587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.432639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.433112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:35.452608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:35.463896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:35.463939Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:35.463954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:35.463970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:35.463991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 279 [2:7561400716490251869:4477]
2025-10-15T10:56:35.464036Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:35.464083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:35.464094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:35.464106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:35.464115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:35.464158Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:35.464176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:35.464195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:35.466113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.466141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.466155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.466166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:35.466449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:35.466471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.466597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.466775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.466848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 279
2025-10-15T10:56:35.466963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 279
2025-10-15T10:56:35.467003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:35.467086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400713690547421:4837], now have 1 active actors on pipe
2025-10-15T10:56:35.467114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400713690547361:2467], now have 1 active actors on pipe
2025-10-15T10:56:35.467157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:35.467183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:35.467216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400716490251864:4477]
2025-10-15T10:56:35.467237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400716490251864:4477]
2025-10-15T10:56:35.467249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400716490251864:4477]
2025-10-15T10:56:35.467285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:35.467329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:35.467367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:35.467379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:35.467481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400713690547461:4202]
2025-10-15T10:56:35.467997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 279, pipe: [1:7561400713690547461:4202]
2025-10-15T10:56:35.468090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:35.468285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:35.468303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:35.468361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:35.468388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:35.468405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:35.468415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:35.468447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:35.468484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:35.468620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400713690547461:4202], now have 1 active actors on pipe
2025-10-15T10:56:35.468642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400716490251864:4477]
2025-10-15T10:56:35.468676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:35.468709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:35.468720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:35.469215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:35.469242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:35.469306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:35.469725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 280 partition: 0 MaxSeqNo: 46 sessionId: src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0
2025-10-15T10:56:35.470590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3ea60-93b76d71-48937aad-cf5ad6e7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:35.492861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0] Write session: try to update token
2025-10-15T10:56:35.492927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:35.525674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:35.525708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:35.525741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400716490251864:4477]
2025-10-15T10:56:35.525866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:35.525875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:35.527899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:35.529330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:35.530697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:35.532130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:35.534219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:35.534950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:35.586727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:35.586760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:35.586771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:35.586823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:35.586835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:35.586847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:35.586857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:35.586907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400716490251864:4477]
2025-10-15T10:56:35.586934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400716490251864:4477]
2025-10-15T10:56:35.586956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400716490251864:4477]
2025-10-15T10:56:35.587085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:35.587113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:35.587132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:35.587133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:35.587160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:35.598495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:35.611367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId: src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:35.645348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:35.741197Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:35.742396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:35.742438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:35.743007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400713690547461:4202]
2025-10-15T10:56:35.743099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:35.743116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:35.743127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:35.743105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:35.753155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 280 reason: error at write: Disconnected sessionId: src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0
2025-10-15T10:56:35.753473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 280 sessionId: src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0 is DEAD
2025-10-15T10:56:35.753780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:35.753833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0] Write session will restart in 0.006248s
2025-10-15T10:56:35.753976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0] Write session: Do CDS request
2025-10-15T10:56:35.754017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:35.766901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:35.766943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 281
2025-10-15T10:56:35.767203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:35.767766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:35.767909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:35.767936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:35.767947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:35.769203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 281 sessionId:  describe result for acl check
2025-10-15T10:56:35.769315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:35.769334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:35.769344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:35.769368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400713690547512:4845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:35.773729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400713690547512:4845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:35.782391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400713690547512:4845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:35.789407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400713690547512:4845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:35.789448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400713690547512:4845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:35.789461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400713690547512:4845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:35.789488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:35.792456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:35.796075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:35.796962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:35.796986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:35.797023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:35.797266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:35.797465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400716490252004:4486]
2025-10-15T10:56:35.799731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:35.800856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:35.801101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:35.802282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:35.802538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.802550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.802554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.802558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.802564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.802568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.802572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.802577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.802582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.802586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.802591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.802595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.802601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.802605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.802641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.802746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.802786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.802825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.802857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.802912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.802963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.803007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.803052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.803091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.803132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.803166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.803201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.803242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.803281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.803337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:35.803407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.803454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:35.803493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.803549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:35.803613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.803673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:35.803711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.803760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:35.803811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.803869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:35.803922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.803980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:35.804023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.804081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:35.804136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.804203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:35.804240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.804290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:35.804329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.804373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:35.804415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.804465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.804494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.804545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.804583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.804638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.805105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:35.821178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:35.843073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:35.843112Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:35.843123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:35.843139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:35.843158Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 280 [2:7561400716490252004:4486]
2025-10-15T10:56:35.843195Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:35.843252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:35.843262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:35.843274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:35.843282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:35.843320Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:35.843338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:35.843378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:35.843448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400713690547602:4202]
2025-10-15T10:56:35.844551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.844576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.844589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.844600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:35.844837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:35.844865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:35.844979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:35.845060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 280
2025-10-15T10:56:35.845115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:35.845081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 280, pipe: [1:7561400713690547602:4202]
2025-10-15T10:56:35.845165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 280
2025-10-15T10:56:35.845319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:35.845379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400713690547497:2467], now have 1 active actors on pipe
2025-10-15T10:56:35.845398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400713690547602:4202], now have 1 active actors on pipe
2025-10-15T10:56:35.845412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400713690547593:4845], now have 1 active actors on pipe
2025-10-15T10:56:35.845457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:35.845475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:35.845501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400716490251999:4486]
2025-10-15T10:56:35.845512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400716490251999:4486]
2025-10-15T10:56:35.845521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400716490251999:4486]
2025-10-15T10:56:35.845545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:35.845580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:35.845592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:35.845616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:35.845629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:35.845723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:35.845739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:35.845783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:35.845806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:35.845820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:35.845827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:35.845854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:35.845881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:35.845965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400716490251999:4486]
2025-10-15T10:56:35.845987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:35.846008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:35.846015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:35.846905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:35.846933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:35.846997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:35.847278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 281 partition: 0 MaxSeqNo: 46 sessionId: src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0
2025-10-15T10:56:35.848146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ac6b7c-4432f33-cbeab917-e1942b7c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:35.867665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0] Write session: try to update token
2025-10-15T10:56:35.867716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:35.872404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:35.872436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:35.872466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400716490251999:4486]
2025-10-15T10:56:35.872575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:35.872605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:35.874448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:35.875768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:35.877112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:35.878376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:35.879943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:35.880519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:35.932241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId: src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:35.950671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:35.950707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:35.950721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:35.950731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:35.950773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400716490251999:4486]
2025-10-15T10:56:35.950809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400716490251999:4486]
2025-10-15T10:56:35.950835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400716490251999:4486]
2025-10-15T10:56:35.951032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:35.951045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:35.951058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:35.951106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:35.951128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:35.951698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:35.951785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:35.951843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:35.954169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:35.966071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:36.094190Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:36.095663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:36.095705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:36.096310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400713690547602:4202]
2025-10-15T10:56:36.096314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:36.096424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:36.096411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:36.096438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:36.133074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:36.135992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:36.136645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:36.136671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:36.136703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:36.136877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:36.137044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400720785219424:4489]
2025-10-15T10:56:36.138390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:36.139172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:36.139338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:36.140330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:36.140589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.140601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.140607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.140614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.140620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.140625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.140631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.140637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.140642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.140648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.140654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.140660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.140666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.140672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.140712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.140812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.140857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.140900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.140943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.140982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.141026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.141063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.141101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.141144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.141186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.141228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.141269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.141310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.141348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.141411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.141467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.141518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.141561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.141610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.141651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.141700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.141742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.141793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.141830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.141879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.141922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.141970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.142011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.142060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.142102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.142149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.142191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.142239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.142280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.142324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.142359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.142401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.142443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.142491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.142530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.142577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.143006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:36.153887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 281 reason: error at write: Disconnected sessionId: src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0
2025-10-15T10:56:36.154167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 281 sessionId: src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0 is DEAD
2025-10-15T10:56:36.154677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:36.154718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0] Write session will restart in 0.009604s
2025-10-15T10:56:36.154853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0] Write session: Do CDS request
2025-10-15T10:56:36.154926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:36.167155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:36.169801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:36.169844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 282
2025-10-15T10:56:36.170116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:36.170870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:36.171125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:36.171172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:36.171193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:36.173168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 282 sessionId:  describe result for acl check
2025-10-15T10:56:36.173299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:36.173317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:36.173327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:36.173346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400717985514988:4849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:36.176411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400717985514988:4849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:36.181846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:36.181891Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:36.181907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:36.181926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:36.181950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 281 [2:7561400720785219424:4489]
2025-10-15T10:56:36.181997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:36.182068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:36.182087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:36.182098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:36.182111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:36.182159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:36.182186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:36.182206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:36.182579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400717985514988:4849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:36.190876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400717985514988:4849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:36.190926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400717985514988:4849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:36.190943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400717985514988:4849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:36.190973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:36.191220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.191251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.191266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.191279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:36.191585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:36.191629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.191786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.191894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 281
2025-10-15T10:56:36.191959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 281
2025-10-15T10:56:36.191993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.192244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:36.192337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400717985514913:2467], now have 1 active actors on pipe
2025-10-15T10:56:36.192365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400717985515018:4849], now have 1 active actors on pipe
2025-10-15T10:56:36.192428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:36.192455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:36.192494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400720785219418:4489]
2025-10-15T10:56:36.192513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400720785219418:4489]
2025-10-15T10:56:36.192526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400720785219418:4489]
2025-10-15T10:56:36.192564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:36.192608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:36.192642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:36.192641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:36.192658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:36.192828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:36.192854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:36.192928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:36.192965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:36.192983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:36.192994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:36.193032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:36.193083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:36.193206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400720785219418:4489]
2025-10-15T10:56:36.193242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:36.193291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:36.193299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:36.193859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:36.193896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:36.193974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:36.194378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 282 partition: 0 MaxSeqNo: 46 sessionId: src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0
2025-10-15T10:56:36.195114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|690ab3a8-f7a653fa-3dd88f7e-77353a7f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:36.196671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400717985515023:4202]
2025-10-15T10:56:36.197061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400717985515023:4202], now have 1 active actors on pipe
2025-10-15T10:56:36.197217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 281, pipe: [1:7561400717985515023:4202]
2025-10-15T10:56:36.219827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0] Write session: try to update token
2025-10-15T10:56:36.219891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:36.224846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:36.224891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:36.224937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400720785219418:4489]
2025-10-15T10:56:36.225077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:36.225089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:36.227128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:36.228810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:36.230243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:36.232116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:36.234371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:36.234863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:36.270274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:36.270306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:36.270317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:36.270325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:36.270374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400720785219418:4489]
2025-10-15T10:56:36.270410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400720785219418:4489]
2025-10-15T10:56:36.270430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400720785219418:4489]
2025-10-15T10:56:36.270544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:36.270549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:36.270564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:36.270601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:36.270639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:36.271884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:36.288555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId: src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:36.315663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:36.418456Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:36.420146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:36.420194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:36.421017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:36.421169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400717985515023:4202]
2025-10-15T10:56:36.421275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:36.421436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:36.421457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:36.446556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 282 reason: error at write: Disconnected sessionId: src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0
2025-10-15T10:56:36.446942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 282 sessionId: src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0 is DEAD
2025-10-15T10:56:36.451568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:36.451631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0] Write session will restart in 0.007403s
2025-10-15T10:56:36.451738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0] Write session: Do CDS request
2025-10-15T10:56:36.451778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:36.468865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:36.468916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 283
2025-10-15T10:56:36.470539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:36.471583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:36.471757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:36.471775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:36.471786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:36.473870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 283 sessionId:  describe result for acl check
2025-10-15T10:56:36.473998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:36.474017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:36.474028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:36.474051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400717985515078:4854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:36.476939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400717985515078:4854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:36.489456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400717985515078:4854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:36.498006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400717985515078:4854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:36.498059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400717985515078:4854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:36.498078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400717985515078:4854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:36.498115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:36.509117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:36.511679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:36.512421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:36.512436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:36.512466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:36.512705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:36.512847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400720785219537:4492]
2025-10-15T10:56:36.514565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:36.515589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:36.515851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:36.516894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:36.517153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.517159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.517165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.517170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.517176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.517182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.517187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.517193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.517198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.517203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.517207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.517212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.517217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.517222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.517261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.517355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.517398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.517441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.517487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.517536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.517595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.517634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.517685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.517737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.517784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.517832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.517885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.517937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.517976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.518030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.518077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.518121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.518161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.518204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.518240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.518283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.518321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.518362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.518405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.518452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.518489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.518540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.518578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.518621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.518658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.518702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.518736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.518776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.518809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.518851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.518888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.518948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.518998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.519059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.519106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.519165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.519645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:36.524725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400717985515144:4202]
2025-10-15T10:56:36.542076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:36.558860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:36.558914Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:36.558934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:36.558957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:36.558985Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 282 [2:7561400720785219537:4492]
2025-10-15T10:56:36.559043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:36.559111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:36.559127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:36.559140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:36.559153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:36.559206Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:36.559240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:36.559267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:36.568851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.568885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.568903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.568915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:36.569211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:36.569230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.569389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.569594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.569840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:36.569927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400717985515028:2467], now have 1 active actors on pipe
2025-10-15T10:56:36.569950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400717985515144:4202], now have 1 active actors on pipe
2025-10-15T10:56:36.569972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400717985515137:4854], now have 1 active actors on pipe
2025-10-15T10:56:36.569997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400720785219532:4492]
2025-10-15T10:56:36.570014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400720785219532:4492]
2025-10-15T10:56:36.570028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400720785219532:4492]
2025-10-15T10:56:36.570071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:36.570150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:36.570344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:36.570362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:36.570494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400720785219532:4492]
2025-10-15T10:56:36.570514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:36.570140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 282, pipe: [1:7561400717985515144:4202]
2025-10-15T10:56:36.570257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 282
2025-10-15T10:56:36.570331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 282
2025-10-15T10:56:36.570796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:36.570824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:36.570837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:36.570861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:36.572411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:36.572454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:36.572609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:36.572679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:36.572725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:36.572750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:36.572808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:36.572893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:36.572962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:36.576153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:36.576192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:36.576276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:36.576577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 283 partition: 0 MaxSeqNo: 46 sessionId: src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0
2025-10-15T10:56:36.579586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d99ad5e-5cb87c02-45226fff-a182d63_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:36.607865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0] Write session: try to update token
2025-10-15T10:56:36.607935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:36.657068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:56:36.657151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-15T10:56:36.658682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:36.658724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:36.658750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:36.658771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:36.658825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400720785219532:4492]
2025-10-15T10:56:36.658869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400720785219532:4492]
2025-10-15T10:56:36.658912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400720785219532:4492]
2025-10-15T10:56:36.659052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:36.659124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:36.659179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:36.659287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:36.659323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:36.663709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:36.691668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId: src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:36.711706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:36.808393Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:36.813005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:36.813044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:36.813657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:36.813756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-15T10:56:36.813926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400717985515144:4202]
2025-10-15T10:56:36.814051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:36.814075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:36.818155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:36.848445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 283 reason: error at write: Disconnected sessionId: src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0
2025-10-15T10:56:36.848809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 283 sessionId: src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0 is DEAD
2025-10-15T10:56:36.849289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:36.849351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0] Write session will restart in 0.009579s
2025-10-15T10:56:36.849487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0] Write session: Do CDS request
2025-10-15T10:56:36.849520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:36.863510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:36.863544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 284
2025-10-15T10:56:36.863653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:36.864135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:36.864290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:36.864311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:36.864322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:36.864601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:36.865615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 284 sessionId:  describe result for acl check
2025-10-15T10:56:36.865734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:36.865753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:36.865763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:36.865781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400717985515257:4865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:36.868504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:36.868571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400717985515257:4865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:36.869459Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:36.869487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:36.869530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:36.869788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:36.870006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400720785219663:4501]
2025-10-15T10:56:36.871855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:36.872697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:36.872894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:36.873967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:36.874272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.874294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.874300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.874309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.874317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.874324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.874384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400717985515257:4865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:36.874331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.874335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.874339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.874343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.874347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.874352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.874357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.874362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.874406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.874514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.874563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.874609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.874648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.874679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.874713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.874754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.874794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.874830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.874866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.874902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.874936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.874971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.875002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.875055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:36.875109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.875166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:36.875205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.875251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:36.875293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.875337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:36.875389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.875438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:36.875493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.875543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:36.875593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.875650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:36.875688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.875740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:36.875796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.875855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:36.875887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.875937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:36.875976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.876031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:36.876079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.876121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.876157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.876193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.876224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.876265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.876645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:36.886476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400717985515257:4865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:36.886525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400717985515257:4865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:36.886544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400717985515257:4865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:36.886580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:36.892940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:36.912475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:36.912520Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:36.912538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:36.912558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:36.912584Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 283 [2:7561400720785219663:4501]
2025-10-15T10:56:36.912637Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:36.912691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:36.912710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:36.912723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:36.912734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:36.912784Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:36.912809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:36.912834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:36.914075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400717985515292:4202]
2025-10-15T10:56:36.914957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.914983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.914998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.915009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:36.915283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:36.915309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:36.915486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:36.915645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 283
2025-10-15T10:56:36.915699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:36.915716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 283, pipe: [1:7561400717985515292:4202]
2025-10-15T10:56:36.915812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 283
2025-10-15T10:56:36.915940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:36.916028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400717985515289:4865], now have 1 active actors on pipe
2025-10-15T10:56:36.916056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400717985515292:4202], now have 1 active actors on pipe
2025-10-15T10:56:36.916080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400717985515178:2467], now have 1 active actors on pipe
2025-10-15T10:56:36.916132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:36.916161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:36.916218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400720785219658:4501]
2025-10-15T10:56:36.916234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400720785219658:4501]
2025-10-15T10:56:36.916246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400720785219658:4501]
2025-10-15T10:56:36.916285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:36.916335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:36.916355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:36.916369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:36.916389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:36.916570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:36.916595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:36.916663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:36.916700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:36.916722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:36.916734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:36.916772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:36.916815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:36.917043Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:56:36.917123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400720785219658:4501]
2025-10-15T10:56:36.917153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:36.917182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:36.917204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:36.917688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:36.917717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:36.917739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 5 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:56:36.917786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:36.917879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:56:36.918034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 284 partition: 0 MaxSeqNo: 46 sessionId: src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0
2025-10-15T10:56:36.918670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba4f7f99-a87311b7-d77daf24-190a35b0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:36.936808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0] Write session: try to update token
2025-10-15T10:56:36.936846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:37.007226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:37.007252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:37.007260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:37.007267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:37.007293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400720785219658:4501]
2025-10-15T10:56:37.007311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400720785219658:4501]
2025-10-15T10:56:37.007324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400720785219658:4501]
2025-10-15T10:56:37.007453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:37.007489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:37.007496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:37.007512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:37.007521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:37.008560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:37.027201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId: src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:37.048697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:37.141416Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:37.157573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:37.157617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:37.157670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:37.157681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:37.157705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400720785219658:4501]
2025-10-15T10:56:37.158086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:37.158081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:37.158126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:37.158139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:37.158141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-15T10:56:37.158310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400717985515292:4202]
2025-10-15T10:56:37.158323Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:37.165787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 284 reason: error at write: Disconnected sessionId: src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0
2025-10-15T10:56:37.166065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 284 sessionId: src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0 is DEAD
2025-10-15T10:56:37.166604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:37.166672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0] Write session will restart in 0.007628s
2025-10-15T10:56:37.166836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0] Write session: Do CDS request
2025-10-15T10:56:37.166874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:37.178967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:37.179128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:37.179017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 285
2025-10-15T10:56:37.179848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:37.180010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:37.180035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:37.180048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:37.181559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 285 sessionId:  describe result for acl check
2025-10-15T10:56:37.181663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:37.181673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:37.181680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:37.181694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400722280482632:4872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:37.183937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400722280482632:4872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:37.188211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400722280482632:4872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:37.195880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400722280482632:4872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:37.195922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400722280482632:4872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:37.195937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400722280482632:4872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:37.195970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:37.200412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:37.204551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:37.205670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:37.205696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:37.205736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:37.205968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:37.206136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400725080187113:4513]
2025-10-15T10:56:37.208125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:37.209133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:37.209471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:37.211163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:37.211468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.211481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.211487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.211493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.211499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.211505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.211512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.211519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.211526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.211533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.211539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.211546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.211553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.211560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.211594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.211705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.211742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.211773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.211803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.211833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.211863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.211900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.211950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.211980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.212011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.212057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.212103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.212143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.212189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.212251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.212306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.212364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.212420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.212469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.212518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.212569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.212618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.212672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.212715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.212751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.212780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.212816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.212847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.212882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.212923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.212968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.213005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.213044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.213091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.213130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.213173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.213219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.213263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.213315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.213356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.213393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.213807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:37.237072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:37.246551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:37.246609Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:37.246627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:37.246647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:37.246671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 284 [2:7561400725080187113:4513]
2025-10-15T10:56:37.246721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:37.246784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:37.246798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:37.246811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:37.246821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:37.246866Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:37.246885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:37.246907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:37.248385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.248406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.248419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.248430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:37.248681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:37.248703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.249079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 284
2025-10-15T10:56:37.249191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 284
2025-10-15T10:56:37.248828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.249009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.249234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:37.249308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400722280482717:4872], now have 1 active actors on pipe
2025-10-15T10:56:37.249331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400722280482619:2467], now have 1 active actors on pipe
2025-10-15T10:56:37.249354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400725080187108:4513]
2025-10-15T10:56:37.249366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400725080187108:4513]
2025-10-15T10:56:37.249378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400725080187108:4513]
2025-10-15T10:56:37.249406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:37.249440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:37.249454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:37.249474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:37.249474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:37.249637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:37.249653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:37.249704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:37.249724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:37.249882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400725080187108:4513]
2025-10-15T10:56:37.249910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:37.249974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:37.251182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 6 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:56:37.249999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:37.250015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:37.250025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:37.250056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:37.250093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:37.251319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:56:37.250224Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:56:37.250444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:37.250505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:37.252027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:37.252056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:37.252128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:37.252552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 285 partition: 0 MaxSeqNo: 46 sessionId: src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0
2025-10-15T10:56:37.253195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfe9f6e5-407f2aa9-895fe6a9-1837a2ff_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:37.259481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400722280482735:4202]
2025-10-15T10:56:37.259936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400722280482735:4202], now have 1 active actors on pipe
2025-10-15T10:56:37.260449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 284, pipe: [1:7561400722280482735:4202]
2025-10-15T10:56:37.271211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0] Write session: try to update token
2025-10-15T10:56:37.271264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:37.280289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:37.280314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:37.280351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400725080187108:4513]
2025-10-15T10:56:37.280466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:37.280474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:37.282601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:37.283965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:37.285501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:37.286835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:37.288745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:37.289381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:37.339686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId: src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:37.345348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:37.345371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:37.345379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:37.345398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:37.345436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400725080187108:4513]
2025-10-15T10:56:37.345492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400725080187108:4513]
2025-10-15T10:56:37.345510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400725080187108:4513]
2025-10-15T10:56:37.345624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:37.345683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:37.345700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:37.345724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:37.345749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:37.348299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:37.377883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:37.485871Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:37.487509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:37.487566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:37.488171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:37.488201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:37.488201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400722280482735:4202]
2025-10-15T10:56:37.488282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:37.488342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:37.527521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 285 reason: error at write: Disconnected sessionId: src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0
2025-10-15T10:56:37.527898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 285 sessionId: src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0 is DEAD
2025-10-15T10:56:37.528366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:37.528442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0] Write session will restart in 0.005529s
2025-10-15T10:56:37.528670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0] Write session: Do CDS request
2025-10-15T10:56:37.528744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:37.544672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:37.544739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 286
2025-10-15T10:56:37.545199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:37.546076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:37.546273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:37.546314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:37.546332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:37.547603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 286 sessionId:  describe result for acl check
2025-10-15T10:56:37.547719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:37.547735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:37.547743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:37.547759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400722280482817:4877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:37.549792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400722280482817:4877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:37.559055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:37.559394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400722280482817:4877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:37.563394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:37.564243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:37.564269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:37.564307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:37.564539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:37.564736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400725080187229:4516]
2025-10-15T10:56:37.566536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400722280482817:4877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:37.566579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400722280482817:4877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:37.566594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400722280482817:4877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:37.566618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:37.566745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:37.567464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:37.567688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:37.568884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:37.569200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.569221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.569227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.569233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.569239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.569246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.569254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.569260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.569267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.569273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.569280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.569287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.569293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.569299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.569344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.569442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.569486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.569534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.569576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.569624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.569675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.569721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.569771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.569824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.569876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.569923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.569967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.570014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.570054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.570113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.570177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.570234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.570289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.570343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.570393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.570446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.570491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.570540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.570585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.570656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.570706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.570759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.570808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.570865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.570915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.570966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.571014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.571071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.571118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.571175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.571224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.571273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.571316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.571382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.571430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.571483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.571972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:37.588113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:37.588328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400722280482867:4202]
2025-10-15T10:56:37.619276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:37.619312Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:37.619326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:37.619339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:37.619372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 285 [2:7561400725080187229:4516]
2025-10-15T10:56:37.619410Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:37.619458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:37.619469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:37.619480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:37.619490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:37.619528Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:37.619545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:37.619562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:37.620619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.620638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.620651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.620660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:37.620892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:37.620913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.621040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.621211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.621205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 285
2025-10-15T10:56:37.621219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 285
2025-10-15T10:56:37.621297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 285, pipe: [1:7561400722280482867:4202]
2025-10-15T10:56:37.621432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:37.621505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400722280482862:4877], now have 1 active actors on pipe
2025-10-15T10:56:37.621531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400722280482743:2467], now have 1 active actors on pipe
2025-10-15T10:56:37.621551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400722280482867:4202], now have 1 active actors on pipe
2025-10-15T10:56:37.621607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:37.621630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:37.621662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400725080187224:4516]
2025-10-15T10:56:37.621679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400725080187224:4516]
2025-10-15T10:56:37.621692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400725080187224:4516]
2025-10-15T10:56:37.621723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:37.621757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:37.621777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:37.621786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:37.621787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:37.621947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:37.621969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:37.622027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:37.622055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:37.622071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:37.622081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:37.622110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:37.622146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:37.622254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400725080187224:4516]
2025-10-15T10:56:37.622283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:37.622301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:37.622323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:37.622787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:37.622812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:37.622869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:37.623168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 286 partition: 0 MaxSeqNo: 46 sessionId: src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0
2025-10-15T10:56:37.623875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa4262b4-29b78dd7-19d552db-abf0aa10_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:37.642655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0] Write session: try to update token
2025-10-15T10:56:37.642702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:37.649837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:37.649869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:37.649904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400725080187224:4516]
2025-10-15T10:56:37.650015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:37.650081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:37.652051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:37.653467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:37.654820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:37.656410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:37.658232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:37.658729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:37.716138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:37.716178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:37.716195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:37.716207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:37.716259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400725080187224:4516]
2025-10-15T10:56:37.716290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400725080187224:4516]
2025-10-15T10:56:37.716318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400725080187224:4516]
2025-10-15T10:56:37.716461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:37.716491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:37.716507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:37.716519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:37.716543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:37.716587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId: src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:37.717670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:37.738595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:37.865214Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:37.871110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:37.871160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:37.871720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:37.871752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:37.871766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:37.871962Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:37.871969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400722280482867:4202]
2025-10-15T10:56:37.893720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:37.893792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0] Write session will restart in 0.009033s
2025-10-15T10:56:37.893932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0] Write session: Do CDS request
2025-10-15T10:56:37.893979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:37.893003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 286 reason: error at write: Disconnected sessionId: src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0
2025-10-15T10:56:37.893393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 286 sessionId: src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0 is DEAD
2025-10-15T10:56:37.907717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:37.907786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 287
2025-10-15T10:56:37.907977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:37.908520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:37.908723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:37.908757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:37.908775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:37.910771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 287 sessionId:  describe result for acl check
2025-10-15T10:56:37.910933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:37.910958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:37.910970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:37.910988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400722280482930:4882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:37.914941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400722280482930:4882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:37.921711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400722280482930:4882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:37.925008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:37.928657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:37.929456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400722280482930:4882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:37.929499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400722280482930:4882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:37.929489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:37.929525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400722280482930:4882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:37.929555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:37.929515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:37.929557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:37.929820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:37.930007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400725080187343:4518]
2025-10-15T10:56:37.932192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:37.933157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:37.933367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:37.934657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:37.935005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.935024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.935032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.935041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.935048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.935056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.935063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.935070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.935079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.935085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.935093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.935099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.935106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.935114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.935162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.935271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.935322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.935397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.935450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.935501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.935547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.935593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.935657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.935714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.935760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.935812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.935864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.935917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.935966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.936038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:37.936104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.936173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:37.936228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.936285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:37.936332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.936390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:37.936440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.936499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:37.936548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.936606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:37.936658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.936715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:37.936763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.936820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:37.936871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.936935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:37.936980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.937070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:37.937129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.937188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:37.937242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.937299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.937352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.937407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.937460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.937518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.938036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:37.963209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:37.970935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:37.970980Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:37.970998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:37.971018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:37.971046Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 286 [2:7561400725080187343:4518]
2025-10-15T10:56:37.971098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:37.971160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:37.971175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:37.971188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:37.971200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:37.971251Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:37.971281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:37.971306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:37.972160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.972183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.972196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.972207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:37.972418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:37.972346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400722280482993:4202]
2025-10-15T10:56:37.972440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:37.972582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:37.972719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 286
2025-10-15T10:56:37.972778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:37.972871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 286
2025-10-15T10:56:37.972998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 286, pipe: [1:7561400722280482993:4202]
2025-10-15T10:56:37.973020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:37.973103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400722280482878:2467], now have 1 active actors on pipe
2025-10-15T10:56:37.973146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400722280482987:4882], now have 1 active actors on pipe
2025-10-15T10:56:37.973187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400722280482993:4202], now have 1 active actors on pipe
2025-10-15T10:56:37.973231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:37.973258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:37.973293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400725080187338:4518]
2025-10-15T10:56:37.973311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400725080187338:4518]
2025-10-15T10:56:37.973324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400725080187338:4518]
2025-10-15T10:56:37.973355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:37.973384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:37.973403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:37.973416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:37.973429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:37.973613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:37.973634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:37.973697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:37.973727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:37.973748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:37.973759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:37.973796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:37.973841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:37.973962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400725080187338:4518]
2025-10-15T10:56:37.973993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:37.974014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:37.974037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:37.974535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:37.974559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:37.974620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:37.974830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 287 partition: 0 MaxSeqNo: 46 sessionId: src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0
2025-10-15T10:56:37.975492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38e5a76-3179e1a3-8ec3b9ff-d1951789_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:37.996618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0] Write session: try to update token
2025-10-15T10:56:37.996677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:38.003205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:38.003235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:38.003277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400725080187338:4518]
2025-10-15T10:56:38.003419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:38.003433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:38.005624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:38.006966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:38.008348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:38.009631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:38.011245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:38.011875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:38.066823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:38.066885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:38.066912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:38.066939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:38.067002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400725080187338:4518]
2025-10-15T10:56:38.067045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400725080187338:4518]
2025-10-15T10:56:38.067086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400725080187338:4518]
2025-10-15T10:56:38.067276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:38.067325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:38.067365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:38.067389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:38.067418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:38.069105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:38.076156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId: src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:38.098685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:38.223313Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:38.233892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:38.233946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:38.234624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:38.234668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:38.234818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400722280482993:4202]
2025-10-15T10:56:38.234891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:38.249833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 287 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0
2025-10-15T10:56:38.250689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:38.250749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0] Write session will restart in 0.008051s
2025-10-15T10:56:38.250867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0] Write session: Do CDS request
2025-10-15T10:56:38.250929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:38.250266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 287 sessionId: src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0 is DEAD
2025-10-15T10:56:38.263270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:38.271298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:38.271332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 288
2025-10-15T10:56:38.271743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:38.271882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:38.271906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:38.271916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:38.273251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 288 sessionId:  describe result for acl check
2025-10-15T10:56:38.273375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:38.273392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:38.273402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:38.273420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400726575450354:4893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:38.276323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400726575450354:4893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:38.283197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400726575450354:4893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:38.291333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:38.294839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400726575450354:4893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:38.294886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400726575450354:4893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:38.294903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400726575450354:4893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:38.294933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:38.294644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:38.295490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:38.295508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:38.295548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:38.295815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:38.295987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400729375154784:4528]
2025-10-15T10:56:38.298217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:38.299323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:38.299563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:38.301114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:38.301456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.301471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.301478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.301487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.301494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.301501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.301507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.301515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.301538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.301545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.301552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.301559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.301566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.301574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.301623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.301733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.301784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.301840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.301888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.301943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.301994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.302046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.302100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.302146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.302197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.302252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.302305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.302353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.302396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.302467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.302535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.302598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.302653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.302709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.302760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.302839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.302893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.302953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.303005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.303072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.303127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.303191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.303261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.303322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.303435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.303497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.303557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.303620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.303687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.303746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.303794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.303856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.303907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.303965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.304018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.304077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.304583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:38.321259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:38.334885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400726575450425:4202]
2025-10-15T10:56:38.339677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:38.339718Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:38.339735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:38.339756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:38.339781Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 287 [2:7561400729375154784:4528]
2025-10-15T10:56:38.339827Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:38.339883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:38.339898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:38.339911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:38.339924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:38.339977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:38.339999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:38.340022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:38.342048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.342078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.342091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.342103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:38.342377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:38.342402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.342539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.342737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.342794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 287
2025-10-15T10:56:38.342914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 287
2025-10-15T10:56:38.342979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:38.342975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 287, pipe: [1:7561400726575450425:4202]
2025-10-15T10:56:38.343072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400726575450425:4202], now have 1 active actors on pipe
2025-10-15T10:56:38.343101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400726575450313:2467], now have 1 active actors on pipe
2025-10-15T10:56:38.343122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400726575450419:4893], now have 1 active actors on pipe
2025-10-15T10:56:38.343171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400729375154778:4528]
2025-10-15T10:56:38.343190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400729375154778:4528]
2025-10-15T10:56:38.343203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400729375154778:4528]
2025-10-15T10:56:38.343241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:38.343278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:38.343293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:38.343305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:38.343331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:38.344194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:38.344279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:38.344465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:38.344491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:38.344657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:38.344695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:38.344719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:38.344729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:38.344768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:38.344816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:38.344859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400729375154778:4528]
2025-10-15T10:56:38.344904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:38.345001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:38.345038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:38.345640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:38.345671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:38.345798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:38.346093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 288 partition: 0 MaxSeqNo: 46 sessionId: src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0
2025-10-15T10:56:38.346896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37d233ab-6cdbbf95-4438a53c-f31605b0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:38.372949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0] Write session: try to update token
2025-10-15T10:56:38.373016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:38.438428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:38.438461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:38.438474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:38.438484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:38.438516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400729375154778:4528]
2025-10-15T10:56:38.438546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400729375154778:4528]
2025-10-15T10:56:38.438568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400729375154778:4528]
2025-10-15T10:56:38.438708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:38.438760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:38.438773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:38.438788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:38.438790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:38.441186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:38.468052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId: src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:38.490111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:38.581720Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:38.607682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:38.607723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:38.607778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:38.607789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:38.607822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400729375154778:4528]
2025-10-15T10:56:38.608028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:38.608304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:38.608593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400726575450425:4202]
2025-10-15T10:56:38.608600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:38.608714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:38.617760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 288 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0
2025-10-15T10:56:38.618111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 288 sessionId: src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0 is DEAD
2025-10-15T10:56:38.618497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:38.618559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0] Write session will restart in 0.005299s
2025-10-15T10:56:38.618725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0] Write session: Do CDS request
2025-10-15T10:56:38.618776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:38.629486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:38.629528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 289
2025-10-15T10:56:38.629681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:38.630135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:38.630265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:38.630284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:38.630292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:38.631211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 289 sessionId:  describe result for acl check
2025-10-15T10:56:38.631282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:38.631294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:38.631299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:38.631316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400726575450476:4901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:38.633641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400726575450476:4901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:38.647156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400726575450476:4901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:38.651962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:38.655887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:38.656705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:38.656733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:38.656726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400726575450476:4901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:38.656779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:38.656772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400726575450476:4901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:38.656791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400726575450476:4901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:38.656822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:38.656976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:38.657151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400729375154925:4537]
2025-10-15T10:56:38.658823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:38.659697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:38.659907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:38.660989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:38.661294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.661307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.661311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.661317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.661325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.661332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.661340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.661348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.661356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.661363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.661370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.661378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.661386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.661392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.661427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.661538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.661581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.661620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.661656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.661692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.661741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.661779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.661819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.661859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.661899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.661942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.661986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.662025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.662078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.662157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.662220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.662269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.662313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.662373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.662431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.662488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.662543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.662605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.662658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.662722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.662763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.662803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.662852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.662918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.662975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.663034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.663092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.663157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.663214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.663277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.663327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.663412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.663478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.663550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.663611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.663695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.664257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:38.703373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:38.709095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400726575450572:4202]
2025-10-15T10:56:38.711588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:38.711619Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:38.711629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:38.711642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:38.711670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 288 [2:7561400729375154925:4537]
2025-10-15T10:56:38.711724Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:38.711785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:38.711801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:38.711813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:38.711824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:38.711873Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:38.711895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:38.711916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:38.713110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.713128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.713136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.713143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:38.713346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:38.713367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.713480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.713638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.713791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:38.713766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 288, pipe: [1:7561400726575450572:4202]
2025-10-15T10:56:38.713783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 288
2025-10-15T10:56:38.713857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400726575450567:4901], now have 1 active actors on pipe
2025-10-15T10:56:38.713878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 288
2025-10-15T10:56:38.713878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400726575450572:4202], now have 1 active actors on pipe
2025-10-15T10:56:38.713893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400726575450461:2467], now have 1 active actors on pipe
2025-10-15T10:56:38.713926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400729375154920:4537]
2025-10-15T10:56:38.713941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400729375154920:4537]
2025-10-15T10:56:38.713952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400729375154920:4537]
2025-10-15T10:56:38.713973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:38.714005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:38.714023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:38.714032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:38.714057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:38.714178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:38.714195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:38.714238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:38.714250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:38.714366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400729375154920:4537]
2025-10-15T10:56:38.714389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:38.714416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:38.714431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:38.714449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:38.714460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:38.714467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:38.714492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:38.714527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:38.714635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:38.715110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:38.715167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:38.715249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:38.715580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 289 partition: 0 MaxSeqNo: 46 sessionId: src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0
2025-10-15T10:56:38.716472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2c2b87b-c88691f9-b56d2d24-df15ff3e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:38.736225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0] Write session: try to update token
2025-10-15T10:56:38.736281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:38.805168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:38.805191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:38.805199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:38.805206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:38.805226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400729375154920:4537]
2025-10-15T10:56:38.805240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400729375154920:4537]
2025-10-15T10:56:38.805252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400729375154920:4537]
2025-10-15T10:56:38.805366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:38.805390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:38.805395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:38.805403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:38.805419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:38.806373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:38.826137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId: src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:38.846673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:38.939841Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:38.948135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:38.948170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:38.948213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:38.948222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:38.948248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400729375154920:4537]
2025-10-15T10:56:38.948528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:38.948690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:38.948721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:38.948726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:38.948743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:38.948947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400726575450572:4202]
2025-10-15T10:56:38.986064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:38.988946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:38.989674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:38.989709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:38.989750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:38.989970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:38.990098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400729375155044:4539]
2025-10-15T10:56:38.991897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:38.992718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:38.992906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:38.994107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:38.994415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.994432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.994439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.994446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.994453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.994460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.994468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.994474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.994480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.994487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.994494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.994500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.994506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.994512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.994556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.994665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.994710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.994747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.994786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.994827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.994866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.994896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.994948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.994990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.995029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.995083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.995136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.995188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.995236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.995312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:38.995396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.995462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:38.995515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.995578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:38.995634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.995710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:38.995761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.995815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:38.995861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.995916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:38.995963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.996019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:38.996063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.996117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:38.996166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.996222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:38.996271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.996334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:38.996392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.996451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:38.996501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.996555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:38.996604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.996661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:38.996707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.996762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:38.997246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:39.004282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 289 reason: error at write: Disconnected sessionId: src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0
2025-10-15T10:56:39.004582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 289 sessionId: src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0 is DEAD
2025-10-15T10:56:39.004899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:39.004939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0] Write session will restart in 0.008217s
2025-10-15T10:56:39.005077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0] Write session: Do CDS request
2025-10-15T10:56:39.005109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:39.017295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:39.017228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:39.017268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 290
2025-10-15T10:56:39.017980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:39.018283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:39.018339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:39.018360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:39.021179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 290 sessionId:  describe result for acl check
2025-10-15T10:56:39.021388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:39.021424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:39.021448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:39.021478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400730870417971:4905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:39.022030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:39.024997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400730870417971:4905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:39.031665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400730870417971:4905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:39.033173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:39.033212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:39.033230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:39.033250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:39.033272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 289 [2:7561400729375155044:4539]
2025-10-15T10:56:39.033325Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:39.033388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:39.033411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:39.033422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:39.033434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:39.033483Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:39.033522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:39.033553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:39.039826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400730870417971:4905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:39.039875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400730870417971:4905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:39.039898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400730870417971:4905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:39.039936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:39.041809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.041839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.041854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.041866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:39.042138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:39.042163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.042339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 289
2025-10-15T10:56:39.042318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.042350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 289
2025-10-15T10:56:39.042522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.042767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:39.042857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400730870417997:4905], now have 1 active actors on pipe
2025-10-15T10:56:39.042888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400726575450586:2467], now have 1 active actors on pipe
2025-10-15T10:56:39.042956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:39.042984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:39.043027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400729375155039:4539]
2025-10-15T10:56:39.043046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400729375155039:4539]
2025-10-15T10:56:39.043060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400729375155039:4539]
2025-10-15T10:56:39.043097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:39.043133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:39.043153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:39.043166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:39.043171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:39.043377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:39.043405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:39.043474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8792518d-31918195-901bb6d9-51baf492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:39.043507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:39.043530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:39.043540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:39.043578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:39.043629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:39.043771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400729375155039:4539]
2025-10-15T10:56:39.043802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:39.043819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:39.043849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:39.044294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:39.044328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:39.044400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:39.044913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 290 partition: 0 MaxSeqNo: 46 sessionId: src_id|8792518d-31918195-901bb6d9-51baf492_0
2025-10-15T10:56:39.045679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b64e38d5-b0299f9c-c010f22e-daab237b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8792518d-31918195-901bb6d9-51baf492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:39.049005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400730870418002:4202]
2025-10-15T10:56:39.049467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400730870418002:4202], now have 1 active actors on pipe
2025-10-15T10:56:39.049535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 289, pipe: [1:7561400730870418002:4202]
2025-10-15T10:56:39.065391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8792518d-31918195-901bb6d9-51baf492_0] Write session: try to update token
2025-10-15T10:56:39.065439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8792518d-31918195-901bb6d9-51baf492_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:39.075617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:39.075660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:39.075699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400729375155039:4539]
2025-10-15T10:56:39.075834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:39.075849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:39.078412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:39.079790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:39.081278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:39.082650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:39.084726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:39.085227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:39.131110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:39.131141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:39.131153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:39.131165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:39.131202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400729375155039:4539]
2025-10-15T10:56:39.131219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400729375155039:4539]
2025-10-15T10:56:39.131234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400729375155039:4539]
2025-10-15T10:56:39.131366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:39.131378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:39.131391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:39.131409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:39.131430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:39.134923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:39.141362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId: src_id|8792518d-31918195-901bb6d9-51baf492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:39.162885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:39.271435Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:39.272864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:39.272901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:39.273328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:39.273405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400730870418002:4202]
2025-10-15T10:56:39.273434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:39.273441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:39.273609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:39.296817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 290 reason: error at write: Disconnected sessionId: src_id|8792518d-31918195-901bb6d9-51baf492_0
2025-10-15T10:56:39.297109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 290 sessionId: src_id|8792518d-31918195-901bb6d9-51baf492_0 is DEAD
2025-10-15T10:56:39.297615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8792518d-31918195-901bb6d9-51baf492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:39.297688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8792518d-31918195-901bb6d9-51baf492_0] Write session will restart in 0.009475s
2025-10-15T10:56:39.297893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8792518d-31918195-901bb6d9-51baf492_0] Write session: Do CDS request
2025-10-15T10:56:39.297961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8792518d-31918195-901bb6d9-51baf492_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:39.312948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8792518d-31918195-901bb6d9-51baf492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:39.314047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:39.314078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 291
2025-10-15T10:56:39.314498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:39.314724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:39.314774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:39.314794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:39.315985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 291 sessionId:  describe result for acl check
2025-10-15T10:56:39.316099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:39.316116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:39.316124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:39.316139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400730870418091:4912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:39.318279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400730870418091:4912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:39.319569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:39.323315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400730870418091:4912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:39.323395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:39.324107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:39.324125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:39.324156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:39.324328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:39.324471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400733670122473:4543]
2025-10-15T10:56:39.326438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:39.327235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:39.327503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:39.328675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:39.328987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:39.329004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:39.329012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:39.329018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:39.329025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:39.329032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:39.329038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:39.329045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:39.329052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:39.329058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:39.329064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:39.329071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.329077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.329083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.329124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:39.329222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:39.329267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:39.329311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:39.329353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:39.329403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:39.329451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:39.329498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:39.329472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400730870418091:4912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:39.329514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400730870418091:4912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:39.329530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400730870418091:4912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:39.329546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:39.329559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:39.329596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:39.329637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:39.329679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.329726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.329770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.329817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:39.329878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:39.329938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:39.329992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:39.330037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:39.330088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:39.330129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:39.330180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:39.330224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:39.330275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:39.330318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:39.330367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:39.330410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:39.330455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:39.330496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:39.330545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:39.330606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:39.330654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:39.330694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:39.330744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:39.330787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:39.330834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:39.330874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.330921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.330967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.331017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.331060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.331111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.331598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:39.353468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:39.364042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:39.364083Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:39.364099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:39.364116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:39.364140Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 290 [2:7561400733670122473:4543]
2025-10-15T10:56:39.364186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:39.364240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:39.364254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:39.364266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:39.364277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:39.364319Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:39.364340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:39.364361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:39.373702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400730870418127:4202]
2025-10-15T10:56:39.376617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.376644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.376656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.376668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:39.376922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:39.376946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.377066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.377140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 290, pipe: [1:7561400730870418127:4202]
2025-10-15T10:56:39.377230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 290
2025-10-15T10:56:39.377234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.377247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 290
2025-10-15T10:56:39.377436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:39.377517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400730870418127:4202], now have 1 active actors on pipe
2025-10-15T10:56:39.377543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400730870418124:4912], now have 1 active actors on pipe
2025-10-15T10:56:39.377562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400730870418011:2467], now have 1 active actors on pipe
2025-10-15T10:56:39.377604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:39.377630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:39.377679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400733670122468:4543]
2025-10-15T10:56:39.377691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400733670122468:4543]
2025-10-15T10:56:39.377702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400733670122468:4543]
2025-10-15T10:56:39.377735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:39.377776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:39.377797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:39.377799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:39.377806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:39.377954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:39.377977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:39.378043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:39.378075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:39.378093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:39.378102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:39.378132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:39.378174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:39.378299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400733670122468:4543]
2025-10-15T10:56:39.378332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:39.378357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:39.378371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:39.378766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:39.378793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:39.378854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:39.379171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 291 partition: 0 MaxSeqNo: 46 sessionId: src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0
2025-10-15T10:56:39.379912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8792518d-31918195-901bb6d9-51baf492_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:39.399175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0] Write session: try to update token
2025-10-15T10:56:39.399227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:39.408413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:39.408444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:39.408479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400733670122468:4543]
2025-10-15T10:56:39.408586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:39.408630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:39.410610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:39.412027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:39.413445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:39.414840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:39.416704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:39.417212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:39.467874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:39.467900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:39.467918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:39.467932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:39.467967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400733670122468:4543]
2025-10-15T10:56:39.468002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400733670122468:4543]
2025-10-15T10:56:39.468025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400733670122468:4543]
2025-10-15T10:56:39.468157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:39.468178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:39.468201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:39.468214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:39.468218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:39.468257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:39.468260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:39.468283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:39.469749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:39.484152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId: src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:39.504935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:39.609154Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:39.611202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:39.611241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:39.611754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400730870418127:4202]
2025-10-15T10:56:39.611872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:39.611921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:39.611889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:39.624804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:39.633651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 291 reason: error at write: Disconnected sessionId: src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0
2025-10-15T10:56:39.633930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 291 sessionId: src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0 is DEAD
2025-10-15T10:56:39.634436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:39.634517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0] Write session will restart in 0.006160s
2025-10-15T10:56:39.634704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0] Write session: Do CDS request
2025-10-15T10:56:39.634755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:39.645571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:39.653455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:39.653491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 292
2025-10-15T10:56:39.653819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:39.653920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:39.653948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:39.653960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:39.654842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:39.655083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 292 sessionId:  describe result for acl check
2025-10-15T10:56:39.655185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:39.655199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:39.655208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:39.655221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400730870418241:4923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:39.657423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400730870418241:4923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:39.658785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:39.659552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:39.659575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:39.659613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:39.659841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:39.661915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400730870418241:4923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:39.660006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400733670122607:4547]
2025-10-15T10:56:39.661941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:39.662653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:39.662855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:39.664008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:39.664281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:39.664294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:39.664301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:39.664307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:39.664313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:39.664319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:39.664325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:39.664331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:39.664337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:39.664342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:39.664349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:39.664354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.664361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.664366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.664406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:39.664498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:39.664543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:39.664621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:39.664669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:39.664712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:39.664756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:39.664803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:39.664849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:39.664896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:39.664942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:39.664987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.665032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.665074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.665103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:39.665159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:39.665215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:39.665259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:39.665290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:39.665342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:39.665389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:39.665437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:39.665485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:39.665538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:39.665599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:39.665656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:39.665705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:39.665757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:39.665803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:39.665854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:39.665903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:39.665956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:39.666003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:39.666057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:39.666112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:39.666167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:39.666215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.666267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.666321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.666374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.666420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.666480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.666990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:39.668820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400730870418241:4923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:39.668867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400730870418241:4923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:39.668884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400730870418241:4923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:39.668914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:39.686750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:39.697193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:39.697226Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:39.697239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:39.697254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:39.697274Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 291 [2:7561400733670122607:4547]
2025-10-15T10:56:39.697319Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:39.697364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:39.697376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:39.697386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:39.697396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:39.697439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:39.697457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:39.697475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:39.699122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.699139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.699147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.699156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:39.699426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:39.699458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:39.699570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:39.699628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 291
2025-10-15T10:56:39.699745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 291
2025-10-15T10:56:39.699740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:39.699942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:39.700009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400730870418157:2467], now have 1 active actors on pipe
2025-10-15T10:56:39.700034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400730870418274:4923], now have 1 active actors on pipe
2025-10-15T10:56:39.700089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:39.700111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:39.700145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400733670122602:4547]
2025-10-15T10:56:39.700160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400733670122602:4547]
2025-10-15T10:56:39.700172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400733670122602:4547]
2025-10-15T10:56:39.700204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:39.700229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:39.700239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:39.700247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:39.700263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:39.700408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:39.700431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:39.700483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eddee646-917070f5-849f6416-f17554ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:39.700503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:39.700518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:39.700524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:39.700544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:39.700567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:39.700671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400733670122602:4547]
2025-10-15T10:56:39.700699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:39.700741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:39.700739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:39.701161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:39.701187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:39.701247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:39.701563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 292 partition: 0 MaxSeqNo: 46 sessionId: src_id|eddee646-917070f5-849f6416-f17554ef_0
2025-10-15T10:56:39.702241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1242ada-b3b5cb9b-eb6804ac-d2002e03_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eddee646-917070f5-849f6416-f17554ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:39.712123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400730870418280:4202]
2025-10-15T10:56:39.712582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400730870418280:4202], now have 1 active actors on pipe
2025-10-15T10:56:39.712661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 291, pipe: [1:7561400730870418280:4202]
2025-10-15T10:56:39.721266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddee646-917070f5-849f6416-f17554ef_0] Write session: try to update token
2025-10-15T10:56:39.721322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddee646-917070f5-849f6416-f17554ef_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:39.730729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:39.730763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:39.730802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400733670122602:4547]
2025-10-15T10:56:39.730929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:39.730940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:39.733711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:39.735520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:39.736954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:39.738287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:39.740686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:39.741251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:39.797585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:39.797607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:39.797616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:39.816875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId: src_id|eddee646-917070f5-849f6416-f17554ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:39.837790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:39.837815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:39.837828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:39.837836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:39.837872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400733670122602:4547]
2025-10-15T10:56:39.837895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400733670122602:4547]
2025-10-15T10:56:39.837915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400733670122602:4547]
2025-10-15T10:56:39.838019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:39.838035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:39.838030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:39.838059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:39.838091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:39.839494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:39.847940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:39.980247Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:39.983065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:39.983104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:39.983539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:39.983715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:39.983733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:39.985926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400730870418280:4202]
2025-10-15T10:56:39.986036Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T10:56:39.986411Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_6895069221613495575_v1 is DEAD
2025-10-15T10:56:39.986653Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T10:56:39.986807Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400576251578695:4197] disconnected; active server actors: 1
2025-10-15T10:56:39.986831Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400576251578695:4197] client user disconnected session shared/user_1_3_6895069221613495575_v1
2025-10-15T10:56:39.987242Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:56:39.987280Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:56:39.987369Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.008019s
2025-10-15T10:56:39.987800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:39.996682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 292 reason: error at write: Disconnected sessionId: src_id|eddee646-917070f5-849f6416-f17554ef_0
2025-10-15T10:56:39.997038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 292 sessionId: src_id|eddee646-917070f5-849f6416-f17554ef_0 is DEAD
2025-10-15T10:56:39.997302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddee646-917070f5-849f6416-f17554ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:39.997335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddee646-917070f5-849f6416-f17554ef_0] Write session will restart in 0.007191s
2025-10-15T10:56:39.997435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddee646-917070f5-849f6416-f17554ef_0] Write session: Do CDS request
2025-10-15T10:56:39.997460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddee646-917070f5-849f6416-f17554ef_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:39.999900Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T10:56:40.000412Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:56:40.000433Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 4
2025-10-15T10:56:40.000919Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 4 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:56:40.001172Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:56:40.001795Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 auth for : user
2025-10-15T10:56:40.002456Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 Handle describe topics response
2025-10-15T10:56:40.002602Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 auth is DEAD
2025-10-15T10:56:40.002700Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:56:40.004858Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:56:40.005164Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_4_11144608197415373266_v1
2025-10-15T10:56:40.005220Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:56:40.005275Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400735165385614:4930] connected; active server actors: 1
2025-10-15T10:56:40.005336Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561400735165385614:4930] session shared/user_1_4_11144608197415373266_v1
2025-10-15T10:56:40.005396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:56:40.005477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:56:40.005542Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:56:40.005533Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_4_11144608197415373266_v1" (Sender=[1:7561400735165385609:4930], Pipe=[1:7561400735165385614:4930], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:56:40.005571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:56:40.005641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:56:40.005716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_4_11144608197415373266_v1" (Sender=[1:7561400735165385609:4930], Pipe=[1:7561400735165385614:4930], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:56:40.005792Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_4_11144608197415373266_v1" sender [1:7561400735165385609:4930] lock partition 0 for ReadingSession "shared/user_1_4_11144608197415373266_v1" (Sender=[1:7561400735165385609:4930], Pipe=[1:7561400735165385614:4930], Partitions=[], ActiveFamilyCount=1) generation 1 step 4
2025-10-15T10:56:40.005863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:56:40.005911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000233s
2025-10-15T10:56:40.006028Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:56:40.007219Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_4_11144608197415373266_v1" ClientId: "user" PipeClient { RawX1: 7561400735165385614 RawX2: 4503603922342722 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:56:40.007452Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 got read request: guid# 1177bdd9-2f3c33c0-981187a2-ac2fe2e1
2025-10-15T10:56:40.007636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:56:40.008391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:40.008440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 293
2025-10-15T10:56:40.008496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddee646-917070f5-849f6416-f17554ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:40.009140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:40.009375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:40.009411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:40.009422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:40.010931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 293 sessionId:  describe result for acl check
2025-10-15T10:56:40.011073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:40.011090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:40.011099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:40.011117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400735165385622:4934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:40.013895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400735165385622:4934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:40.024128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400735165385622:4934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:40.031969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:40.032099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400735165385622:4934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:40.032144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400735165385622:4934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:40.032171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400735165385622:4934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:40.032203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:40.034975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:40.035803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:40.035829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:40.035866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:40.036091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:40.036268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400737965090051:4555]
2025-10-15T10:56:40.038322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:40.039288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:40.039499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:40.040737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:40.041066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.041086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.041093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.041100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.041106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.041113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.041118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.041124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.041130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.041137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.041143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.041149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.041155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.041161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.041206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.041304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.041347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.041390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.041431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.041473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.041527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.041575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.041622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.041671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.041719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.041766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.041812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.041855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.041906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.041968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.042028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.042083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.042133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.042187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.042233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.042286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.042335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.042388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.042433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.042484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.042533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.042587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.042632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.042686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.042734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.042789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.042832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.042887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.042933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.042986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.043031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.043083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.043131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.043185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.043230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.043279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.043790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:40.063763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:40.072960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:40.072998Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:40.073015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:40.073033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:40.073054Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 292 [2:7561400737965090051:4555]
2025-10-15T10:56:40.073101Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:40.073154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:40.073173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:40.073184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:40.073193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:40.073235Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:40.073254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:40.073273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:40.093215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.093235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.093242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.093251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:40.093480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:40.093498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.093599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.093736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.093795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 292
2025-10-15T10:56:40.093900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 292
2025-10-15T10:56:40.093908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:40.093949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 292, pipe: [1:7561400735165385618:4933]
2025-10-15T10:56:40.093976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400730870418302:2467], now have 1 active actors on pipe
2025-10-15T10:56:40.093994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400735165385618:4933], now have 1 active actors on pipe
2025-10-15T10:56:40.094010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400735165385716:4934], now have 1 active actors on pipe
2025-10-15T10:56:40.094046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400737965090044:4555]
2025-10-15T10:56:40.094064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400737965090044:4555]
2025-10-15T10:56:40.094074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400737965090044:4555]
2025-10-15T10:56:40.094102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:40.094136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:40.094149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:40.094158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:40.094177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.094194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.094218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_4_11144608197415373266_v1 on pipe: [1:7561400735165385618:4933]
2025-10-15T10:56:40.094260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:40.094286Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_4_11144608197415373266_v1:1 with generation 292
2025-10-15T10:56:40.094397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:40.094415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:40.094451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.094461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.094576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:40.094601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:40.094609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:40.094662Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_4_11144608197415373266_v1
2025-10-15T10:56:40.094671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:40.094758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400737965090044:4555]
2025-10-15T10:56:40.094787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:40.094832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:40.094843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:40.094864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:56:40.094913Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:56:40.097987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:56:40.098061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:56:40.098089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:40.098107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:40.098116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:40.098144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:40.098186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:40.098208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:56:40.098240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:56:40.098300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:40.098553Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760525800092 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:56:40.098610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T10:56:40.098679Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 sending to client partition status
2025-10-15T10:56:40.098708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.098737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.098811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:40.099083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 293 partition: 0 MaxSeqNo: 46 sessionId: src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0
2025-10-15T10:56:40.099563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddee646-917070f5-849f6416-f17554ef_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:40.117706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0] Write session: try to update token
2025-10-15T10:56:40.117756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:40.148598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:40.148644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:40.148665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:40.148681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:40.148724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400737965090044:4555]
2025-10-15T10:56:40.148770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400737965090044:4555]
2025-10-15T10:56:40.148804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400737965090044:4555]
2025-10-15T10:56:40.148969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:40.149050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:40.149069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:40.149083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:40.149113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:40.154600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:40.209200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId: src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:40.228481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:40.287092Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:40.295559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.295598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.295652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:40.295661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:40.295701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400737965090044:4555]
2025-10-15T10:56:40.295794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:40.296120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_4_11144608197415373266_v1
2025-10-15T10:56:40.296159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:40.296212Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_4_11144608197415373266_v1
2025-10-15T10:56:40.296269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:40.296278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:40.296289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:40.296543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400735165385618:4933]
2025-10-15T10:56:40.306100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 293 reason: error at write: Disconnected sessionId: src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0
2025-10-15T10:56:40.306434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 293 sessionId: src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0 is DEAD
2025-10-15T10:56:40.306787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:40.306833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0] Write session will restart in 0.008501s
2025-10-15T10:56:40.306978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0] Write session: Do CDS request
2025-10-15T10:56:40.307005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:40.321761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:40.321822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 294
2025-10-15T10:56:40.321939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:40.322713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:40.322893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:40.322927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:40.322941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:40.324643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 294 sessionId:  describe result for acl check
2025-10-15T10:56:40.324819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:40.324855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:40.324868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:40.324895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400735165385756:4939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:40.328061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400735165385756:4939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:40.334416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400735165385756:4939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:40.340803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:40.341104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400735165385756:4939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:40.341150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400735165385756:4939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:40.341165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400735165385756:4939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:40.341193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:40.344221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:40.345107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:40.345134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:40.345176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:40.345408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:40.345580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400737965090190:4564]
2025-10-15T10:56:40.347839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:40.348861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:40.349169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:40.350463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:40.350727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.350741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.350748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.350754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.350761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.350767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.350774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.350781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.350788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.350794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.350799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.350806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.350812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.350818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.350882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.351080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.351178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.351230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.351273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.351331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.351395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.351444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.351492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.351540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.351584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.351632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.351690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.351742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.351786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.351855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.351920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.351996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.352104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.352241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.352312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.352372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.352432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.352490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.352549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.352602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.352660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.352716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.352765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.352823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.352875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.352918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.352955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.353006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.353055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.353152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.353202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.353269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.353322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.353382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.353431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.353482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.353940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:40.375093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:40.384777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:40.384811Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:40.384822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:40.384836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:40.384855Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 293 [2:7561400737965090190:4564]
2025-10-15T10:56:40.384890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:40.384941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:40.384956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:40.384966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:40.384974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:40.385008Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:40.385030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:40.385047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:40.386075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.386101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.386115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.386128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:40.386412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:40.386439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.386576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.386680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 293
2025-10-15T10:56:40.386721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 293
2025-10-15T10:56:40.386775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.387020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:40.387094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400735165385732:2467], now have 1 active actors on pipe
2025-10-15T10:56:40.387114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400735165385844:4939], now have 1 active actors on pipe
2025-10-15T10:56:40.387168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.387190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.387220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400737965090184:4564]
2025-10-15T10:56:40.387232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400737965090184:4564]
2025-10-15T10:56:40.387239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400737965090184:4564]
2025-10-15T10:56:40.387263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:40.387308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:40.387312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:40.387326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:40.387337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:40.387447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:40.387460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:40.387501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|567c29bc-e4464c54-254f598-53c85a20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:40.387522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:40.387538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:40.387548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:40.387579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:40.387610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:40.387713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400737965090184:4564]
2025-10-15T10:56:40.387734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:40.387764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:40.387771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:40.388342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.388371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.388441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:40.388794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 294 partition: 0 MaxSeqNo: 46 sessionId: src_id|567c29bc-e4464c54-254f598-53c85a20_0
2025-10-15T10:56:40.389530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a692e8e0-ec9bb7eb-cafc52bc-55f8d864_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|567c29bc-e4464c54-254f598-53c85a20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:40.396680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400735165385855:4933]
2025-10-15T10:56:40.397231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400735165385855:4933], now have 1 active actors on pipe
2025-10-15T10:56:40.397332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 293, pipe: [1:7561400735165385855:4933]
2025-10-15T10:56:40.410325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|567c29bc-e4464c54-254f598-53c85a20_0] Write session: try to update token
2025-10-15T10:56:40.410392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|567c29bc-e4464c54-254f598-53c85a20_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:40.427183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:40.427214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:40.427244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400737965090184:4564]
2025-10-15T10:56:40.427343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:40.427372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:40.429130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:40.430362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:40.431726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:40.433192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:40.435022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:40.435475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:40.480799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId: src_id|567c29bc-e4464c54-254f598-53c85a20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:40.489845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:40.489879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:40.489895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:40.489903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:40.489938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400737965090184:4564]
2025-10-15T10:56:40.489958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400737965090184:4564]
2025-10-15T10:56:40.489972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400737965090184:4564]
2025-10-15T10:56:40.490098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:40.490121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:40.490127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:40.490133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:40.490168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:40.490184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:40.490200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:40.490201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:40.491159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:40.503975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1015 10:56:40.612836920  833441 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:56:40.633101Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:40.634599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.634643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.635190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:40.635205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400735165385855:4933]
2025-10-15T10:56:40.635225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:40.635309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:40.635461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:40.645580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 294 reason: error at write: Disconnected sessionId: src_id|567c29bc-e4464c54-254f598-53c85a20_0
2025-10-15T10:56:40.645980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 294 sessionId: src_id|567c29bc-e4464c54-254f598-53c85a20_0 is DEAD
2025-10-15T10:56:40.646535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c29bc-e4464c54-254f598-53c85a20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:40.646598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c29bc-e4464c54-254f598-53c85a20_0] Write session will restart in 0.005811s
2025-10-15T10:56:40.646762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c29bc-e4464c54-254f598-53c85a20_0] Write session: Do CDS request
2025-10-15T10:56:40.646814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c29bc-e4464c54-254f598-53c85a20_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:40.665893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:40.665946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 295
2025-10-15T10:56:40.666126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|567c29bc-e4464c54-254f598-53c85a20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:40.666683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:40.666858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:40.666886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:40.666897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:40.668171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 295 sessionId:  describe result for acl check
2025-10-15T10:56:40.668289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:40.668313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:40.668329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:40.668357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400735165385887:4944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:40.672105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400735165385887:4944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:40.684617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400735165385887:4944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:40.693372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400735165385887:4944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:40.693421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400735165385887:4944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:40.693440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400735165385887:4944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:40.693472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:40.702716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:40.706845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:40.707563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:40.707590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:40.707626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:40.707839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:40.708026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400737965090313:4566]
2025-10-15T10:56:40.709451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:40.710392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:40.710633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:40.711747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:40.712064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.712082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.712089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.712096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.712103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.712111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.712118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.712125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.712133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.712141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.712149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.712156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.712164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.712172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.712216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.712332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.712378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.712436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.712482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.712530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.712580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.712618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.712667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.712745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.712799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.712852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.712903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.712953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.712998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.713059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:40.713106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.713148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:40.713185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.713238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:40.713281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.713341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:40.713397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.713469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:40.713506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.713555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:40.713607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.713658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:40.713696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.713756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:40.713808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.713867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:40.713915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.713972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:40.714009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.714060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:40.714097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.714137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.714174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.714220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.714258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.714319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.714711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:40.730935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:40.735623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400735165385991:4933]
2025-10-15T10:56:40.740575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:40.740625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:40.740645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:40.740668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:40.740696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 294 [2:7561400737965090313:4566]
2025-10-15T10:56:40.740755Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:40.740818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:40.740839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:40.740853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:40.740865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:40.740919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:40.740954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:40.740984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:40.742028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.742057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.742073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.742087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:40.742404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:40.742437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:40.742595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:40.742817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:40.743071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:40.743175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400735165385871:2467], now have 1 active actors on pipe
2025-10-15T10:56:40.743217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400735165385991:4933], now have 1 active actors on pipe
2025-10-15T10:56:40.743247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400735165385967:4944], now have 1 active actors on pipe
2025-10-15T10:56:40.743273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400737965090308:4566]
2025-10-15T10:56:40.743289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400737965090308:4566]
2025-10-15T10:56:40.743303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400737965090308:4566]
2025-10-15T10:56:40.743137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 294, pipe: [1:7561400735165385991:4933]
2025-10-15T10:56:40.743343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:40.743152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 294
2025-10-15T10:56:40.743273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 294
2025-10-15T10:56:40.743411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:40.743438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:40.743441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:40.743455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:40.743639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:40.743664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:40.743754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.743781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.743913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400737965090308:4566]
2025-10-15T10:56:40.743948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:40.743992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:40.744025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eba51636-2794c078-3bcb94f1-ae67c066_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:40.744063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:40.744086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:40.744097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:40.744135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:40.744180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:40.744322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:40.744803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.744830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.744927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:40.745235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 295 partition: 0 MaxSeqNo: 46 sessionId: src_id|eba51636-2794c078-3bcb94f1-ae67c066_0
2025-10-15T10:56:40.746087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567c29bc-e4464c54-254f598-53c85a20_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eba51636-2794c078-3bcb94f1-ae67c066_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:40.766047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eba51636-2794c078-3bcb94f1-ae67c066_0] Write session: try to update token
2025-10-15T10:56:40.766115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eba51636-2794c078-3bcb94f1-ae67c066_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:40.801786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:40.801846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:40.801869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:40.801888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:40.801941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400737965090308:4566]
2025-10-15T10:56:40.801994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400737965090308:4566]
2025-10-15T10:56:40.802029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400737965090308:4566]
2025-10-15T10:56:40.802192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:40.802241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:40.802271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:40.802271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:40.802328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:40.803552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:40.850576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId: src_id|eba51636-2794c078-3bcb94f1-ae67c066_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:40.871692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:40.951240Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:40.953370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:40.953414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:40.954418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400735165385991:4933]
2025-10-15T10:56:40.954670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:40.954694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:40.955363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:40.958172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:40.979869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 295 reason: error at write: Disconnected sessionId: src_id|eba51636-2794c078-3bcb94f1-ae67c066_0
2025-10-15T10:56:40.980217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 295 sessionId: src_id|eba51636-2794c078-3bcb94f1-ae67c066_0 is DEAD
2025-10-15T10:56:40.980578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba51636-2794c078-3bcb94f1-ae67c066_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:40.980633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba51636-2794c078-3bcb94f1-ae67c066_0] Write session will restart in 0.009769s
2025-10-15T10:56:40.980816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba51636-2794c078-3bcb94f1-ae67c066_0] Write session: Do CDS request
2025-10-15T10:56:40.980888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba51636-2794c078-3bcb94f1-ae67c066_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:40.995523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eba51636-2794c078-3bcb94f1-ae67c066_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:41.000376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:41.000418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 296
2025-10-15T10:56:41.000835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:41.000960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:41.000983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:41.000991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:41.002225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 296 sessionId:  describe result for acl check
2025-10-15T10:56:41.002344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:41.002361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:41.002371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:41.002388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400739460353392:4950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:41.005026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400739460353392:4950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:41.006670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:41.010429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:41.010659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400739460353392:4950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:41.011216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:41.011244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:41.011288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:41.011551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:41.011740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400742260057739:4568]
2025-10-15T10:56:41.013782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:41.014654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:41.014921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:41.016179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:41.016494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.016508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.016515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.016522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.016530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.016537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.016543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.016550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.016557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.016564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.016571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.016577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.016584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.016590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.016634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.016737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.016782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.016829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.016880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.016924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.016974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.017022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.017070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.017118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.017167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.017216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.017261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.017309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.017351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.017422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.017425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400739460353392:4950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:41.017481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.017466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400739460353392:4950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:41.017484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400739460353392:4950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:41.017512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:41.017539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.017592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.017644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.017693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.017748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.017796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.017852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.017900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.017956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.018007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.018062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.018114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.018171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.018221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.018278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.018328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.018384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.018433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.018487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.018533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.018589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.018639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.018693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.018737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.018791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.019277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:41.036907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:41.047342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:41.047409Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:41.047426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:41.047446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:41.047471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 295 [2:7561400742260057739:4568]
2025-10-15T10:56:41.047521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:41.047579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:41.047592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:41.047605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:41.047618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:41.047697Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:41.047721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:41.047747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:41.049723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.049750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.049764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.049776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:41.050048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:41.050077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.050220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.050256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 295
2025-10-15T10:56:41.050432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.050388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 295
2025-10-15T10:56:41.050674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:41.050766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400735165386007:2467], now have 1 active actors on pipe
2025-10-15T10:56:41.050793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400739460353420:4950], now have 1 active actors on pipe
2025-10-15T10:56:41.050856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:41.050883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:41.050919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400742260057729:4568]
2025-10-15T10:56:41.050932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400742260057729:4568]
2025-10-15T10:56:41.050944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400742260057729:4568]
2025-10-15T10:56:41.050982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:41.051014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:41.051029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:41.051040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:41.051059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:41.051238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:41.051261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:41.051325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:41.051413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:41.051436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:41.051446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:41.051481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:41.051527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:41.051654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400742260057729:4568]
2025-10-15T10:56:41.051694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:41.051707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:41.051740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:41.052247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:41.052276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:41.052351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:41.052767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 296 partition: 0 MaxSeqNo: 46 sessionId: src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0
2025-10-15T10:56:41.053515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba51636-2794c078-3bcb94f1-ae67c066_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:41.054538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400739460353437:4933]
2025-10-15T10:56:41.054933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400739460353437:4933], now have 1 active actors on pipe
2025-10-15T10:56:41.054994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 295, pipe: [1:7561400739460353437:4933]
2025-10-15T10:56:41.074731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0] Write session: try to update token
2025-10-15T10:56:41.074785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:41.088091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:41.088118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:41.088147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400742260057729:4568]
2025-10-15T10:56:41.088260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:41.088268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:41.089792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:41.091108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:41.092498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:41.093582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:41.095020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:41.095500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:41.152139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:41.152171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:41.152182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:41.152191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:41.152226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400742260057729:4568]
2025-10-15T10:56:41.152249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400742260057729:4568]
2025-10-15T10:56:41.152269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400742260057729:4568]
2025-10-15T10:56:41.152384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:41.152425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:41.152436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:41.152438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:41.152449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:41.152465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:41.152495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:41.152514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:41.153496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:41.162836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId: src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:41.184788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:41.295226Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:41.300145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:41.300190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:41.300848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:41.300941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:41.301012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:41.301030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:41.313311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400739460353437:4933]
2025-10-15T10:56:41.313438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 296 reason: error at write: Disconnected sessionId: src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0
2025-10-15T10:56:41.313763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 296 sessionId: src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0 is DEAD
2025-10-15T10:56:41.314217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:41.314263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0] Write session will restart in 0.006408s
2025-10-15T10:56:41.314411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0] Write session: Do CDS request
2025-10-15T10:56:41.314456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:41.326748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:41.329941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:41.329976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 297
2025-10-15T10:56:41.335524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:41.335674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:41.335701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:41.335713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:41.336957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 297 sessionId:  describe result for acl check
2025-10-15T10:56:41.337067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:41.337082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:41.337091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:41.337106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400739460353457:4959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:41.340546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400739460353457:4959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:41.346831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400739460353457:4959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:41.354569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400739460353457:4959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:41.354612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400739460353457:4959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:41.354630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400739460353457:4959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:41.354664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:41.378035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:41.381949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:41.382779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:41.382802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:41.382840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:41.383081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:41.383278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400742260057888:4578]
2025-10-15T10:56:41.385370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:41.386376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:41.386605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:41.387927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:41.388278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.388295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.388303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.388310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.388320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.388327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.388334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.388340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.388348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.388356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.388363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.388370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.388377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.388384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.388431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.388548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.388594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.388648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.388698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.388750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.388801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.388850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.388900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.388952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.389004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.389053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.389100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.389150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.389195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.389264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.389326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.389389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.389438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.389492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.389536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.389588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.389635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.389691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.389736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.389790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.389853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.389906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.389951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.390001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.390048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.390096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.390141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.390193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.390234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.390284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.390326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.390380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.390429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.390479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.390528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.390579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.390979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:41.407515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:41.413479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400739460353566:4933]
2025-10-15T10:56:41.425490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:41.425528Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:41.425542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:41.425559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:41.425580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 296 [2:7561400742260057888:4578]
2025-10-15T10:56:41.425627Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:41.425681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:41.425694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:41.425705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:41.425715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:41.425764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:41.425785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:41.425806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:41.428223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.428250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.428264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.428274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:41.428532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:41.428554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.428685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.428689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 296, pipe: [1:7561400739460353566:4933]
2025-10-15T10:56:41.428804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 296
2025-10-15T10:56:41.428861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.428880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 296
2025-10-15T10:56:41.429095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:41.429176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400739460353566:4933], now have 1 active actors on pipe
2025-10-15T10:56:41.429207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400739460353487:4959], now have 1 active actors on pipe
2025-10-15T10:56:41.429228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400739460353445:2467], now have 1 active actors on pipe
2025-10-15T10:56:41.429273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:41.429294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:41.429347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400742260057883:4578]
2025-10-15T10:56:41.429361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400742260057883:4578]
2025-10-15T10:56:41.429373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400742260057883:4578]
2025-10-15T10:56:41.429405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:41.429440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:41.429452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:41.429462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:41.429475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:41.429646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:41.429663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:41.429725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cff25109-de29101c-19aab63-7fdf6b0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:41.429754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:41.429766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:41.429773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:41.429800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:41.429841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:41.429940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400742260057883:4578]
2025-10-15T10:56:41.429974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:41.430005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:41.430022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:41.431292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:41.431313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:41.431908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:41.432174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 297 partition: 0 MaxSeqNo: 46 sessionId: src_id|cff25109-de29101c-19aab63-7fdf6b0a_0
2025-10-15T10:56:41.432917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f7fa8f-3e4f4465-eedb00c3-1473742_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cff25109-de29101c-19aab63-7fdf6b0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:41.455564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff25109-de29101c-19aab63-7fdf6b0a_0] Write session: try to update token
2025-10-15T10:56:41.455642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff25109-de29101c-19aab63-7fdf6b0a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:41.461585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:41.461613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:41.461643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400742260057883:4578]
2025-10-15T10:56:41.461766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:41.461779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:41.463860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:41.465238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:41.466530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:41.467933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:41.469691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:41.494758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:41.516554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:41.516599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:41.516616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:41.516630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:41.516678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400742260057883:4578]
2025-10-15T10:56:41.516723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400742260057883:4578]
2025-10-15T10:56:41.516761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400742260057883:4578]
2025-10-15T10:56:41.516951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:41.516977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:41.517005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:41.517012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:41.517047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:41.518734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:41.528974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId: src_id|cff25109-de29101c-19aab63-7fdf6b0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:41.553432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:41.663393Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:41.664959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:41.665000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:41.665525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:41.665558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400739460353566:4933]
2025-10-15T10:56:41.665559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:41.665642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:41.665717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:41.714245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:41.719394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 297 reason: error at write: Disconnected sessionId: src_id|cff25109-de29101c-19aab63-7fdf6b0a_0
2025-10-15T10:56:41.719719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 297 sessionId: src_id|cff25109-de29101c-19aab63-7fdf6b0a_0 is DEAD
2025-10-15T10:56:41.720155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff25109-de29101c-19aab63-7fdf6b0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:41.720212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff25109-de29101c-19aab63-7fdf6b0a_0] Write session will restart in 0.009047s
2025-10-15T10:56:41.720371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff25109-de29101c-19aab63-7fdf6b0a_0] Write session: Do CDS request
2025-10-15T10:56:41.720431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff25109-de29101c-19aab63-7fdf6b0a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:41.721752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:41.723410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:41.723457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:41.723533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:41.724118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:41.724466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400742260058040:4587]
2025-10-15T10:56:41.726932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:41.727906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:41.728088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:41.729065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:41.729282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.729293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.729299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.729305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.729311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.729319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.729325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.729331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.729336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.729341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.729345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.729349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.729352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.729356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.729391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.729482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.729516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.729543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.729569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.729596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.729619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.729643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.729665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.729696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.729731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.729755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.729778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.729806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.729829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.729869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:41.729913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.729967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:41.730004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.730033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:41.730060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.730086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:41.730108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.730143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:41.730169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.730197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:41.730232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.730263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:41.730295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.730333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:41.730361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.730406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:41.730431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.730464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:41.730505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.730544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:41.730570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.730601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.730626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.730656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.730680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.730710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.730973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:41.734263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff25109-de29101c-19aab63-7fdf6b0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:41.734376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:41.734428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 298
2025-10-15T10:56:41.734857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:41.735008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:41.735033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:41.735045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:41.736533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 298 sessionId:  describe result for acl check
2025-10-15T10:56:41.736657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:41.736673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:41.736684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:41.736703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400739460353692:4967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:41.739509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400739460353692:4967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:41.746131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400739460353692:4967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:41.749711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:41.754444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400739460353692:4967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:41.754491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400739460353692:4967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:41.754508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400739460353692:4967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:41.754541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:41.759268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:41.759320Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:41.759337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:41.759372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:41.759400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 297 [2:7561400742260058040:4587]
2025-10-15T10:56:41.759455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:41.759515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:41.759530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:41.759542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:41.759554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:41.759604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:41.759627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:41.759651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:41.760760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.760790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.760803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.760816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:41.761104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:41.761132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:41.761281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:41.761421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 297
2025-10-15T10:56:41.761452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 297
2025-10-15T10:56:41.761488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:41.761757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:41.761854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400739460353721:4967], now have 1 active actors on pipe
2025-10-15T10:56:41.761883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400739460353599:2467], now have 1 active actors on pipe
2025-10-15T10:56:41.761954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:41.761982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:41.762022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400742260058034:4587]
2025-10-15T10:56:41.762042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400742260058034:4587]
2025-10-15T10:56:41.762055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400742260058034:4587]
2025-10-15T10:56:41.762094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:41.762133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:41.762148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:41.762160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:41.762175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:41.762363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:41.762390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:41.762461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:41.762503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:41.762521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:41.762532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:41.762569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:41.762612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:41.762736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400742260058034:4587]
2025-10-15T10:56:41.762768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:41.762808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:41.762813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:41.763300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:41.763323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:41.763400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:41.763808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 298 partition: 0 MaxSeqNo: 46 sessionId: src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0
2025-10-15T10:56:41.764610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff25109-de29101c-19aab63-7fdf6b0a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:41.766078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400739460353726:4933]
2025-10-15T10:56:41.766642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400739460353726:4933], now have 1 active actors on pipe
2025-10-15T10:56:41.766836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 297, pipe: [1:7561400739460353726:4933]
2025-10-15T10:56:41.785994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0] Write session: try to update token
2025-10-15T10:56:41.786050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:41.824510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:41.824568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:41.824649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400742260058034:4587]
2025-10-15T10:56:41.824835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:41.824978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:41.827833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:41.829384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:41.830542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:41.831882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:41.833821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:41.855035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:41.855184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:41.855206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:41.855220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:41.855230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:41.855270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400742260058034:4587]
2025-10-15T10:56:41.855297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400742260058034:4587]
2025-10-15T10:56:41.855321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400742260058034:4587]
2025-10-15T10:56:41.855451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:41.855496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:41.855500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:41.855519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:41.855530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:41.856569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:41.869324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId: src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:41.896871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:42.005428Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:42.006974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:42.007018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:42.007799Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:42.007728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:42.007760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:42.007772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:42.007940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400739460353726:4933]
2025-10-15T10:56:42.014948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 298 reason: error at write: Disconnected sessionId: src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0
2025-10-15T10:56:42.015284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 298 sessionId: src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0 is DEAD
2025-10-15T10:56:42.015748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:42.015792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0] Write session will restart in 0.005856s
2025-10-15T10:56:42.015920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0] Write session: Do CDS request
2025-10-15T10:56:42.015971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:42.032053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:42.039571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:42.039607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 299
2025-10-15T10:56:42.040053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:42.040186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:42.040221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:42.040237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:42.041690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 299 sessionId:  describe result for acl check
2025-10-15T10:56:42.041809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:42.041827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:42.041836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:42.041854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400743755321053:4971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:42.045515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400743755321053:4971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:42.056073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400743755321053:4971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:42.062168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:42.066218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:42.066639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400743755321053:4971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:42.066696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400743755321053:4971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:42.066709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400743755321053:4971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:42.066732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:42.067059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:42.067098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:42.067144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:42.067428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:42.067631Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400746555025463:4589]
2025-10-15T10:56:42.069915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:42.070799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:42.071024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:42.072354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:42.072710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.072724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.072731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.072738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.072745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.072752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.072758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.072765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.072771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.072779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.072786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.072792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.072800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.072807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.072856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.072966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.073014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.073063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.073107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.073161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.073208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.073255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.073302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.073353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.073399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.073448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.073497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.073547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.073591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.073655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.073718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.073776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.073826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.073883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.073932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.073990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.074044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.074100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.074146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.074203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.074254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.074311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.074360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.074423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.074475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.074534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.074582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.074636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.074680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.074732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.074777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.074836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.074887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.074944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.074995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.075051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.075572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:42.090515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:42.099548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:42.099596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:42.099615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:42.099637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:42.099664Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 298 [2:7561400746555025463:4589]
2025-10-15T10:56:42.099731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:42.099797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:42.099820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:42.099834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:42.099847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:42.099902Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:42.099926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:42.099955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:42.107847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400743755321158:4933]
2025-10-15T10:56:42.112051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.112081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.112094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.112107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:42.112382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:42.112408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.112551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.112605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 298
2025-10-15T10:56:42.112614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 298
2025-10-15T10:56:42.112674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 298, pipe: [1:7561400743755321158:4933]
2025-10-15T10:56:42.112739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.112975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:42.113066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400743755321038:2467], now have 1 active actors on pipe
2025-10-15T10:56:42.113094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400743755321153:4971], now have 1 active actors on pipe
2025-10-15T10:56:42.113116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400743755321158:4933], now have 1 active actors on pipe
2025-10-15T10:56:42.113177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:42.113204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:42.113241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400746555025458:4589]
2025-10-15T10:56:42.113259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400746555025458:4589]
2025-10-15T10:56:42.113272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400746555025458:4589]
2025-10-15T10:56:42.113306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:42.113355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:42.113376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:42.113377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:42.113389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:42.113560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:42.113585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:42.113658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:42.113693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:42.113711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:42.113722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:42.113760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:42.113816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:42.113946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400746555025458:4589]
2025-10-15T10:56:42.113977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:42.114015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:42.114022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:42.114441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:42.114467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:42.114529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:42.114773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 299 partition: 0 MaxSeqNo: 46 sessionId: src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0
2025-10-15T10:56:42.115537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac16f1e6-ea41c250-50e313b4-da5ae541_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:42.135336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0] Write session: try to update token
2025-10-15T10:56:42.135416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:42.141223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:42.141259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:42.141309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400746555025458:4589]
2025-10-15T10:56:42.141431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:42.141452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:42.143610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:42.145630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:42.147066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:42.148466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:42.150210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:42.150747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:42.207998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:42.208034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:42.208050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:42.208061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:42.208111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400746555025458:4589]
2025-10-15T10:56:42.208140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400746555025458:4589]
2025-10-15T10:56:42.208162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400746555025458:4589]
2025-10-15T10:56:42.208303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:42.208337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:42.208350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:42.208356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:42.208361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:42.208387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:42.208409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:42.208431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:42.210918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:42.215620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId: src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:42.237378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:42.352890Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:42.359583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:42.359633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:42.360545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:42.360299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400743755321158:4933]
2025-10-15T10:56:42.360314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:42.360427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:42.360440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:42.371172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 299 reason: error at write: Disconnected sessionId: src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0
2025-10-15T10:56:42.371669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 299 sessionId: src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0 is DEAD
2025-10-15T10:56:42.372012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:42.372042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0] Write session will restart in 0.007710s
2025-10-15T10:56:42.372133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0] Write session: Do CDS request
2025-10-15T10:56:42.372159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:42.386740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:42.386798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 300
2025-10-15T10:56:42.386920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:42.387468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:42.387719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:42.387767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:42.387786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:42.389223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 300 sessionId:  describe result for acl check
2025-10-15T10:56:42.389326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:42.389343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:42.389352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:42.389368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400743755321184:4976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:42.392648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400743755321184:4976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:42.399536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400743755321184:4976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:42.409362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400743755321184:4976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:42.409407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400743755321184:4976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:42.409425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400743755321184:4976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:42.409455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:42.411768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:42.415470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:42.416380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:42.416411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:42.416448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:42.416740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:42.416957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400746555025607:4593]
2025-10-15T10:56:42.418564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:42.419340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:42.419536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:42.420359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:42.420577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.420588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.420592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.420597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.420601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.420605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.420610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.420614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.420618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.420624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.420628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.420632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.420636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.420640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.420672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.420754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.420789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.420821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.420853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.420884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.420915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.420957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.421001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.421053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.421098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.421136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.421179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.421223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.421256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.421307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.421353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.421394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.421433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.421477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.421526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.421577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.421630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.421691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.421743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.421801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.421853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.421914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.421965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.422024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.422079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.422138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.422189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.422251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.422303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.422360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.422409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.422467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.422516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.422575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.422624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.422682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.423077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:42.436873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:42.446586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:42.446625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:42.446642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:42.446661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:42.446684Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 299 [2:7561400746555025607:4593]
2025-10-15T10:56:42.446739Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:42.446794Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:42.446808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:42.446821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:42.446833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:42.446882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:42.446906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:42.446926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:42.453863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.453897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.453910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.453922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:42.454211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:42.454236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.454370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.454562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.454539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 299
2025-10-15T10:56:42.454654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 299
2025-10-15T10:56:42.454788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:42.454874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400743755321169:2467], now have 1 active actors on pipe
2025-10-15T10:56:42.454902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400743755321287:4976], now have 1 active actors on pipe
2025-10-15T10:56:42.454969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:42.454994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:42.455032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400746555025602:4593]
2025-10-15T10:56:42.455050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400746555025602:4593]
2025-10-15T10:56:42.455064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400746555025602:4593]
2025-10-15T10:56:42.455102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:42.455120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:42.455130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:42.455152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:42.455180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:42.455379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:42.455404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:42.455474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:42.455511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:42.455530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:42.455540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:42.455574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:42.455621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:42.455757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400746555025602:4593]
2025-10-15T10:56:42.455795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:42.455843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:42.455846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:42.456520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:42.456549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:42.456616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:42.456874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 300 partition: 0 MaxSeqNo: 46 sessionId: src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0
2025-10-15T10:56:42.457605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f6a7cf-e0816874-5eee1073-f448ff0e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:42.460513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400743755321302:4933]
2025-10-15T10:56:42.460957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400743755321302:4933], now have 1 active actors on pipe
2025-10-15T10:56:42.461003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 299, pipe: [1:7561400743755321302:4933]
2025-10-15T10:56:42.477560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0] Write session: try to update token
2025-10-15T10:56:42.477623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:42.486869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:42.486910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:42.486950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400746555025602:4593]
2025-10-15T10:56:42.487079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:42.487087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:42.489957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:42.491379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:42.492660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:42.494072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:42.496030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:42.496639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:42.553834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:42.553870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:42.553883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:42.553895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:42.553935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400746555025602:4593]
2025-10-15T10:56:42.553961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400746555025602:4593]
2025-10-15T10:56:42.553984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400746555025602:4593]
2025-10-15T10:56:42.554110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:42.554145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:42.554152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:42.554156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:42.554168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:42.554182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:42.554219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:42.554240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:42.558002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:42.567954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId: src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:42.591528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:42.704110Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:42.708008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:42.708058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:42.708604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400743755321302:4933]
2025-10-15T10:56:42.708707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:42.708724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:42.709696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:42.754283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 300 reason: error at write: Disconnected sessionId: src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0
2025-10-15T10:56:42.754640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 300 sessionId: src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0 is DEAD
2025-10-15T10:56:42.754997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:42.755040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0] Write session will restart in 0.006842s
2025-10-15T10:56:42.755190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0] Write session: Do CDS request
2025-10-15T10:56:42.755229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:42.767255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:42.771605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:42.774684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:42.776098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:42.776973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:42.777000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:42.777002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:42.777042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:42.777030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 301
2025-10-15T10:56:42.777301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:42.777468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:42.777495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400746555025746:4601]
2025-10-15T10:56:42.777594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:42.777616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:42.777624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:42.778822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 301 sessionId:  describe result for acl check
2025-10-15T10:56:42.778928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:42.778948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:42.778957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:42.778973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400743755321419:4987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:42.779674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:42.780644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:42.780845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:42.781499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400743755321419:4987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:42.782075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:42.782404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.782423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.782431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.782438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.782445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.782451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.782457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.782464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.782470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.782478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.782484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.782491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.782497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.782503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.782548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.782648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.782692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.782741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.782787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.782832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.782881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.782936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.782986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.783030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.783076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.783126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.783175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.783221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.783265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.783331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:42.783420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.783478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:42.783532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.783588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:42.783635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.783699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:42.783767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.783824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:42.783867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.783917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:42.783961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.784011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:42.784061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.784111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:42.784162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.784230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:42.784279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.784327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:42.784369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.784419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:42.784468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.784522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.784569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.784623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.784671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.784727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.785239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:42.787405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400743755321419:4987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:42.795160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400743755321419:4987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:42.795205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400743755321419:4987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:42.795233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400743755321419:4987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:42.795264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:42.801864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:42.808715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400743755321453:4933]
2025-10-15T10:56:42.813207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:42.813251Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:42.813267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:42.813285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:42.813311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 300 [2:7561400746555025746:4601]
2025-10-15T10:56:42.813358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:42.813413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:42.813431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:42.813443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:42.813454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:42.813503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:42.813528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:42.813559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:42.815597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.815621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.815634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.815646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:42.815940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:42.815966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:42.816099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:42.816248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 300
2025-10-15T10:56:42.816307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:42.816361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 300, pipe: [1:7561400743755321453:4933]
2025-10-15T10:56:42.816459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 300
2025-10-15T10:56:42.816533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:42.816632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400743755321451:4987], now have 1 active actors on pipe
2025-10-15T10:56:42.816675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400743755321414:2467], now have 1 active actors on pipe
2025-10-15T10:56:42.816695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400743755321453:4933], now have 1 active actors on pipe
2025-10-15T10:56:42.816739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400746555025741:4601]
2025-10-15T10:56:42.816759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400746555025741:4601]
2025-10-15T10:56:42.816771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400746555025741:4601]
2025-10-15T10:56:42.816812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:42.816852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:42.816868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:42.816876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:42.816924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:42.816945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:42.817002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:42.817204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:42.817228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:42.817381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:42.817419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:42.817436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:42.817447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:42.817483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:42.817522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:42.817563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400746555025741:4601]
2025-10-15T10:56:42.817588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:42.817619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:42.817675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:42.818034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:42.818057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:42.818112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:42.818342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 301 partition: 0 MaxSeqNo: 46 sessionId: src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0
2025-10-15T10:56:42.819180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a2b9e5a-7abe7539-fc41cc2c-1ff1f2aa_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:42.840359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0] Write session: try to update token
2025-10-15T10:56:42.840418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:42.892033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:42.892068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:42.892083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:42.892095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:42.892135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400746555025741:4601]
2025-10-15T10:56:42.892163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400746555025741:4601]
2025-10-15T10:56:42.892189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400746555025741:4601]
2025-10-15T10:56:42.892353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:42.892405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:42.892412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:42.892435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:42.892438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:42.894327Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:42.922920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId: src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:42.945346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:43.037495Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:43.061108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:43.061161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:43.061232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:43.061248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:43.061295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400746555025741:4601]
2025-10-15T10:56:43.061412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:43.061923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:43.061942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:43.061951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:43.061975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:43.062174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400743755321453:4933]
2025-10-15T10:56:43.075473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 301 reason: error at write: Disconnected sessionId: src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0
2025-10-15T10:56:43.075792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 301 sessionId: src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0 is DEAD
2025-10-15T10:56:43.076170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:43.076205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0] Write session will restart in 0.008679s
2025-10-15T10:56:43.076331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0] Write session: Do CDS request
2025-10-15T10:56:43.076369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:43.090830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:43.090872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 302
2025-10-15T10:56:43.091264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:43.092066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:43.092343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:43.092385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:43.092405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:43.093663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 302 sessionId:  describe result for acl check
2025-10-15T10:56:43.093748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:43.093764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:43.093774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:43.093792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400748050288793:4994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:43.096076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400748050288793:4994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:43.103179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400748050288793:4994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:43.110885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400748050288793:4994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:43.110933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400748050288793:4994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:43.110961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400748050288793:4994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:43.110996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:43.112981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:43.115925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:43.117157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:43.117219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:43.117311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:43.117854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:43.118076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400750849993202:4610]
2025-10-15T10:56:43.120392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:43.121159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:43.121323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:43.122239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:43.122500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.122515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.122520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.122525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.122530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.122535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.122539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.122543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.122547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.122552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.122556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.122561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.122566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.122571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.122615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.122711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.122747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.122781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.122819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.122856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.122893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.122931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.122967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.123000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.123036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.123072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.123113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.123160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.123202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.123275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.123339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.123414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.123454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.123498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.123531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.123580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.123631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.123672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.123709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.123758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.123792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.123834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.123868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.123917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.123972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.124017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.124052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.124095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.124130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.124183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.124223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.124279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.124320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.124361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.124401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.124457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.124837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:43.149367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:43.157545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:43.157591Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:43.157610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:43.157631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:43.157658Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 301 [2:7561400750849993202:4610]
2025-10-15T10:56:43.157716Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:43.157783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:43.157798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:43.157811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:43.157823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:43.157876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:43.157899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:43.157923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:43.158905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.158934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.158948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.158961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:43.159294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:43.159317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.159459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.159580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 301
2025-10-15T10:56:43.159582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 301
2025-10-15T10:56:43.159670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.159947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:43.160042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400748050288896:4994], now have 1 active actors on pipe
2025-10-15T10:56:43.160075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400748050288777:2467], now have 1 active actors on pipe
2025-10-15T10:56:43.160141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:43.160169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:43.160205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400750849993195:4610]
2025-10-15T10:56:43.160227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400750849993195:4610]
2025-10-15T10:56:43.160240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400750849993195:4610]
2025-10-15T10:56:43.160275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:43.160321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:43.160345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:43.160353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:43.160356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:43.160546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:43.160574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:43.160648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:43.160690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:43.160702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:43.160710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:43.160738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:43.160785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:43.160921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400750849993195:4610]
2025-10-15T10:56:43.160959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:43.160996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:43.161007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:43.161471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:43.161497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:43.161566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:43.161884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 302 partition: 0 MaxSeqNo: 46 sessionId: src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0
2025-10-15T10:56:43.162411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400748050288908:4933]
2025-10-15T10:56:43.162639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc40ecc-6bfb7777-ae4ce5a3-51a7d313_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:43.162774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400748050288908:4933], now have 1 active actors on pipe
2025-10-15T10:56:43.162883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 301, pipe: [1:7561400748050288908:4933]
2025-10-15T10:56:43.186319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0] Write session: try to update token
2025-10-15T10:56:43.186389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:43.193413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:43.193448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:43.193493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400750849993195:4610]
2025-10-15T10:56:43.193632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:43.193915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:43.195617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:43.197002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:43.198366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:43.199780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:43.201491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:43.201920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:43.291590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId: src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:43.331239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:43.335007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:43.335040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:43.335052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:43.335113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:43.335130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:43.335147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:43.335158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:43.335200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400750849993195:4610]
2025-10-15T10:56:43.335225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400750849993195:4610]
2025-10-15T10:56:43.335248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400750849993195:4610]
2025-10-15T10:56:43.335396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:43.335434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:43.335454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:43.335462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:43.335481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:43.335516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:43.335538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:43.336493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:43.480325Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:43.482416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400748050288908:4933]
2025-10-15T10:56:43.482437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:43.482452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:43.482512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:43.482700Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:43.491189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 302 reason: error at write: Disconnected sessionId: src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0
2025-10-15T10:56:43.491543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 302 sessionId: src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0 is DEAD
2025-10-15T10:56:43.491976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:43.492024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0] Write session will restart in 0.005702s
2025-10-15T10:56:43.492197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0] Write session: Do CDS request
2025-10-15T10:56:43.492244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:43.504764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:43.504805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 303
2025-10-15T10:56:43.505055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:43.506494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:43.506661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:43.506688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:43.506699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:43.508170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 303 sessionId:  describe result for acl check
2025-10-15T10:56:43.508269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:43.508286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:43.508294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:43.508306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400748050288930:4999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:43.510380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400748050288930:4999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:43.521411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400748050288930:4999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:43.529061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400748050288930:4999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:43.529105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400748050288930:4999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:43.529122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400748050288930:4999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:43.529150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:43.535526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:43.539417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:43.540346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:43.540378Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:43.540424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:43.540691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:43.540913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400750849993346:4614]
2025-10-15T10:56:43.543232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:43.544259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:43.544480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:43.545769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:43.546113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.546128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.546136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.546144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.546152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.546160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.546168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.546176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.546183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.546190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.546198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.546205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.546214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.546220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.546271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.546386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.546438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.546487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.546533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.546591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.546643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.546695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.546745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.546797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.546846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.546902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.546948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.546998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.547048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.547125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.547192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.547249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.547301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.547378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.547428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.547487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.547541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.547598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.547649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.547706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.547772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.547827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.547882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.547940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.547993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.548052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.548106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.548166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.548219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.548279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.548330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.548386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.548439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.548515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.548562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.548623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.549158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:43.566659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:43.578733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:43.578778Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:43.578796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:43.578816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:43.578842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 302 [2:7561400750849993346:4614]
2025-10-15T10:56:43.578892Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:43.578942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:43.578954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:43.578963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:43.578971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:43.579008Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:43.579025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:43.579041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:43.579950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.579977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.579991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.580003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:43.580277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:43.580301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.580418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.580613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.580502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 302
2025-10-15T10:56:43.580538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 302
2025-10-15T10:56:43.580857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:43.580953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400748050289037:4999], now have 1 active actors on pipe
2025-10-15T10:56:43.580985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400748050288916:2467], now have 1 active actors on pipe
2025-10-15T10:56:43.581043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:43.581067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:43.581122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400750849993341:4614]
2025-10-15T10:56:43.581147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400750849993341:4614]
2025-10-15T10:56:43.581162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400750849993341:4614]
2025-10-15T10:56:43.581200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:43.581252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:43.581277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:43.581278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:43.581290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:43.581468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:43.581491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:43.581557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:43.581588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:43.581606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:43.581618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:43.581653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:43.581691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:43.581828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400750849993341:4614]
2025-10-15T10:56:43.581860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:43.581888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:43.581903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:43.582431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:43.582454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:43.582514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:43.582786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400748050289046:4933]
2025-10-15T10:56:43.582938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 303 partition: 0 MaxSeqNo: 46 sessionId: src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0
2025-10-15T10:56:43.583556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400748050289046:4933], now have 1 active actors on pipe
2025-10-15T10:56:43.583609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 302, pipe: [1:7561400748050289046:4933]
2025-10-15T10:56:43.583732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96c5b642-40e33f70-5ee2a85d-d22098a5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:43.604393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0] Write session: try to update token
2025-10-15T10:56:43.604454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:43.611210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:43.611243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:43.611282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400750849993341:4614]
2025-10-15T10:56:43.611405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:43.611423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:43.613929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:43.615211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:43.616644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:43.617955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:43.619674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:43.620116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:43.669766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId: src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:43.675389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:43.675421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:43.675434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:43.675445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:43.675487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400750849993341:4614]
2025-10-15T10:56:43.675514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400750849993341:4614]
2025-10-15T10:56:43.675537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400750849993341:4614]
2025-10-15T10:56:43.675653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:43.675683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:43.675690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:43.675702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:43.675715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:43.678091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:43.692325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:43.822342Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:43.823527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:43.823558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:43.824088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:43.824122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:43.824152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400748050289046:4933]
2025-10-15T10:56:43.824221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:43.824266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:43.842146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 303 reason: error at write: Disconnected sessionId: src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0
2025-10-15T10:56:43.842488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 303 sessionId: src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0 is DEAD
2025-10-15T10:56:43.842839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:43.842892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0] Write session will restart in 0.009242s
2025-10-15T10:56:43.843047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0] Write session: Do CDS request
2025-10-15T10:56:43.843097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:43.857525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:43.857590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 304
2025-10-15T10:56:43.857850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:43.858604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:43.858781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:43.858815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:43.858832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:43.862437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 304 sessionId:  describe result for acl check
2025-10-15T10:56:43.862558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:43.862575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:43.862585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:43.862604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400748050289124:5004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:43.865408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400748050289124:5004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:43.871652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400748050289124:5004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:43.874188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:43.878335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:43.879179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:43.879188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400748050289124:5004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:43.879210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:43.879249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:43.879230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400748050289124:5004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:43.879248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400748050289124:5004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:43.879277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:43.879508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:43.879688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400750849993481:4616]
2025-10-15T10:56:43.881879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:43.882943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:43.883151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:43.884368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:43.884686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.884703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.884710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.884716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.884723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.884730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.884735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.884742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.884747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.884753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.884759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.884765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.884772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.884778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.884821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.884921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.884968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.885011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.885054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.885098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.885139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.885182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.885233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.885288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.885330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.885379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.885420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.885461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.885501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.885562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:43.885617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.885671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:43.885719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.885766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:43.885807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.885857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:43.885902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.885952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:43.885995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.886045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:43.886089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.886139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:43.886180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.886229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:43.886272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.886333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:43.886385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.886439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:43.886493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.886547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:43.886597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.886651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.886700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.886756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.886805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.886862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.887334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:43.910362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:43.920985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:43.921026Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:43.921042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:43.921060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:43.921084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 303 [2:7561400750849993481:4616]
2025-10-15T10:56:43.921132Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:43.921184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:43.921198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:43.921210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:43.921220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:43.921263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:43.921286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:43.921304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:43.922384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.922412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.922425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.922435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:43.922706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:43.922734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:43.922834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:43.922995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:43.923077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 303
2025-10-15T10:56:43.923084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 303
2025-10-15T10:56:43.923167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:43.923227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400748050289195:5004], now have 1 active actors on pipe
2025-10-15T10:56:43.923246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400748050289069:2467], now have 1 active actors on pipe
2025-10-15T10:56:43.923261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400750849993476:4616]
2025-10-15T10:56:43.923271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400750849993476:4616]
2025-10-15T10:56:43.923281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400750849993476:4616]
2025-10-15T10:56:43.923304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:43.923338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:43.923367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:43.923367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:43.923378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:43.923511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:43.923528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:43.923582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:43.923615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:43.923713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400750849993476:4616]
2025-10-15T10:56:43.923755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:43.923778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:43.923825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb1b8a21-99607218-20e67428-5945d72d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:43.923859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:43.923882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:43.923890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:43.923923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:43.923963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:43.924082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:43.924313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400748050289201:4933]
2025-10-15T10:56:43.924630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:43.924660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:43.924701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400748050289201:4933], now have 1 active actors on pipe
2025-10-15T10:56:43.924746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:43.924878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 303, pipe: [1:7561400748050289201:4933]
2025-10-15T10:56:43.925078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 304 partition: 0 MaxSeqNo: 46 sessionId: src_id|eb1b8a21-99607218-20e67428-5945d72d_0
2025-10-15T10:56:43.925894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d52da05-56cc30a8-456efc58-38e3fdc8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eb1b8a21-99607218-20e67428-5945d72d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:43.946759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1b8a21-99607218-20e67428-5945d72d_0] Write session: try to update token
2025-10-15T10:56:43.946814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1b8a21-99607218-20e67428-5945d72d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:43.990277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:43.990311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:43.990326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:43.990336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:43.990369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400750849993476:4616]
2025-10-15T10:56:43.990397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400750849993476:4616]
2025-10-15T10:56:43.990420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400750849993476:4616]
2025-10-15T10:56:43.990551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:43.990592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:43.990625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:44.037805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:44.037851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:44.039076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:44.060810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId: src_id|eb1b8a21-99607218-20e67428-5945d72d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:44.091705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:44.194356Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:44.197845Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:44.197876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:44.197917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400750849993476:4616]
2025-10-15T10:56:44.197999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:44.198063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:44.198094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:44.198493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400748050289201:4933]
2025-10-15T10:56:44.198592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:44.198611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:44.198875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:44.209452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 304 reason: error at write: Disconnected sessionId: src_id|eb1b8a21-99607218-20e67428-5945d72d_0
2025-10-15T10:56:44.209821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 304 sessionId: src_id|eb1b8a21-99607218-20e67428-5945d72d_0 is DEAD
2025-10-15T10:56:44.210252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1b8a21-99607218-20e67428-5945d72d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:44.210322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1b8a21-99607218-20e67428-5945d72d_0] Write session will restart in 0.009470s
2025-10-15T10:56:44.210474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1b8a21-99607218-20e67428-5945d72d_0] Write session: Do CDS request
2025-10-15T10:56:44.210521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1b8a21-99607218-20e67428-5945d72d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:44.222226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:44.224295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:44.224326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 305
2025-10-15T10:56:44.224538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1b8a21-99607218-20e67428-5945d72d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:44.225048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:44.225217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:44.225243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:44.225254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:44.226635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 305 sessionId:  describe result for acl check
2025-10-15T10:56:44.226758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:44.226776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:44.226786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:44.226802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400752345256536:5016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:44.230778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400752345256536:5016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:44.236926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400752345256536:5016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:44.244757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400752345256536:5016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:44.244793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400752345256536:5016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:44.244806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400752345256536:5016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:44.244839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:44.268256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:44.272789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:44.273596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:44.273624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:44.273665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:44.273907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:44.274129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400755144960928:4625]
2025-10-15T10:56:44.276294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:44.277286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:44.277500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:44.278652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:44.278991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.279011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.279018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.279027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.279033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.279039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.279045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.279053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.279060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.279067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.279074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.279083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.279091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.279098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.279144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.279247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.279294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.279341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.279449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.279496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.279548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.279599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.279652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.279705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.279764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.279814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.279863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.279914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.279963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.280032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.280101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.280155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.280210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.280269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.280316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.280376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.280437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.280490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.280543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.280600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.280653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.280709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.280760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.280817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.280868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.280927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.280976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.281035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.281088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.281147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.281198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.281255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.281308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.281367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.281419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.281474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.282012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:44.298369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:44.298567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400752345256654:4933]
2025-10-15T10:56:44.309107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:44.309155Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:44.309172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:44.309189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:44.309212Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 304 [2:7561400755144960928:4625]
2025-10-15T10:56:44.309262Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:44.309317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:44.309330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:44.309341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:44.309352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:44.309393Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:44.309412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:44.309430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:44.311466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.311490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.311504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.311515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:44.311784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:44.311811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.311944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.312150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.312112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 304, pipe: [1:7561400752345256654:4933]
2025-10-15T10:56:44.312244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 304
2025-10-15T10:56:44.312341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 304
2025-10-15T10:56:44.312393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:44.312482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400752345256654:4933], now have 1 active actors on pipe
2025-10-15T10:56:44.312512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400752345256532:2467], now have 1 active actors on pipe
2025-10-15T10:56:44.312534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400752345256570:5016], now have 1 active actors on pipe
2025-10-15T10:56:44.312564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400755144960923:4625]
2025-10-15T10:56:44.312583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400755144960923:4625]
2025-10-15T10:56:44.312595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400755144960923:4625]
2025-10-15T10:56:44.312632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:44.312671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:44.312697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:44.312709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:44.312737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:44.312757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:44.312804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:44.313001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:44.313023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:44.313170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:44.313205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:44.313220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:44.313230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:44.313262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:44.313294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:44.313333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400755144960923:4625]
2025-10-15T10:56:44.313368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:44.313407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:44.313444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:44.314032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:44.314062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:44.314140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:44.314480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 305 partition: 0 MaxSeqNo: 46 sessionId: src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0
2025-10-15T10:56:44.315290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1b8a21-99607218-20e67428-5945d72d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:44.336217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0] Write session: try to update token
2025-10-15T10:56:44.336273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:44.367090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:44.367118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:44.367152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400755144960923:4625]
2025-10-15T10:56:44.367271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:44.367284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:44.369510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:44.370985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:44.372478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:44.374189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:44.376231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:44.376957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:44.416127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:44.416159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:44.416173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:44.416183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:44.416222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400755144960923:4625]
2025-10-15T10:56:44.416247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400755144960923:4625]
2025-10-15T10:56:44.416271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400755144960923:4625]
2025-10-15T10:56:44.416390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:44.416430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:44.416434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:44.416446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:44.416457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:44.416465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:44.416502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:44.416522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:44.417631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:44.440580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId: src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:44.461433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:44.562452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:44.563830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:44.563868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:44.564386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:44.564423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400752345256654:4933]
2025-10-15T10:56:44.564512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:44.564525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:44.564655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:44.615454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 305 reason: error at write: Disconnected sessionId: src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0
2025-10-15T10:56:44.615777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 305 sessionId: src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0 is DEAD
2025-10-15T10:56:44.616130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:44.616178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0] Write session will restart in 0.009703s
2025-10-15T10:56:44.616299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0] Write session: Do CDS request
2025-10-15T10:56:44.616353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:44.622977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:44.626871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:44.627719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:44.627761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:44.627805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:44.628058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:44.628329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400755144961098:4635]
2025-10-15T10:56:44.630792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:44.630824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 306
2025-10-15T10:56:44.630974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:44.631466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:44.632394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:44.632611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:44.633856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:44.634198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.634219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.634226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.634234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.634242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.634249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.634256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.634264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.634271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.634278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.634286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.634292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.634298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.634304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.634355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.634476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.634527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.634576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.634621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.634680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.634723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.634776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.634828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.634881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.634934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.634984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.635036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.635087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.635142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.635211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.635281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.635380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.635439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.635505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.635552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.635612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.635670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.635729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.635793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.635851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.635903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.635957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.636009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.636063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.635897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:44.636050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:44.636066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:44.636114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.636077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:44.636176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.636228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.636291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.636343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.636402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.636447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.636503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.636557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.636617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.636660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.636718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.637243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:44.637427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 306 sessionId:  describe result for acl check
2025-10-15T10:56:44.637541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:44.637567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:44.637579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:44.637598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400752345256777:5024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:44.640371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400752345256777:5024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:44.645942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400752345256777:5024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:44.653167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400752345256777:5024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:44.653218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400752345256777:5024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:44.653236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400752345256777:5024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:44.653267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:44.653363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:44.662812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:44.662859Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:44.662879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:44.662900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:44.662926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 305 [2:7561400755144961098:4635]
2025-10-15T10:56:44.662984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:44.663053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:44.663072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:44.663087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:44.663099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:44.663152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:44.663180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:44.663204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:44.664035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.664064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.664078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.664086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:44.664285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:44.664310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.664443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.664666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 305
2025-10-15T10:56:44.664679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 305
2025-10-15T10:56:44.664758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400752345256809:4933]
2025-10-15T10:56:44.664631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.664892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:44.665045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400752345256808:5024], now have 1 active actors on pipe
2025-10-15T10:56:44.665072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400752345256676:2467], now have 1 active actors on pipe
2025-10-15T10:56:44.665099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400755144961093:4635]
2025-10-15T10:56:44.665114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400755144961093:4635]
2025-10-15T10:56:44.665127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400755144961093:4635]
2025-10-15T10:56:44.665157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 305, pipe: [1:7561400752345256809:4933]
2025-10-15T10:56:44.665166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:44.665196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:44.665212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:44.665225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:44.665249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:44.665272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:44.665334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:44.665499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:44.665522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:44.665545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400752345256809:4933], now have 1 active actors on pipe
2025-10-15T10:56:44.665669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:44.665695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:44.665707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:44.665714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:44.665741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:44.665780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:44.665817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400755144961093:4635]
2025-10-15T10:56:44.665845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:44.665879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:44.665932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:44.666628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:44.666651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:44.666720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:44.666968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 306 partition: 0 MaxSeqNo: 46 sessionId: src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0
2025-10-15T10:56:44.667774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a62d187a-a362e7bf-6a8cf16b-48b65f53_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:44.687309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0] Write session: try to update token
2025-10-15T10:56:44.687391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:44.719603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:44.719647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:44.719663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:44.719682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:44.719733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400755144961093:4635]
2025-10-15T10:56:44.719781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400755144961093:4635]
2025-10-15T10:56:44.719828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400755144961093:4635]
2025-10-15T10:56:44.720015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:44.720078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:44.720132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:44.720171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:44.720232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:44.722301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:44.785682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId: src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:44.805767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:44.872224Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:44.880768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:44.880823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:44.880891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:44.880907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:44.880952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400755144961093:4635]
2025-10-15T10:56:44.881152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:44.881265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:44.881268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400752345256809:4933]
2025-10-15T10:56:44.881449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:44.881473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:44.881608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:44.889573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 306 reason: error at write: Disconnected sessionId: src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0
2025-10-15T10:56:44.889912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 306 sessionId: src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0 is DEAD
2025-10-15T10:56:44.890266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:44.890308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0] Write session will restart in 0.007734s
2025-10-15T10:56:44.890431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0] Write session: Do CDS request
2025-10-15T10:56:44.890471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:44.902658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:44.903835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:44.903882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 307
2025-10-15T10:56:44.904234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:44.904408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:44.904434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:44.904443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:44.906214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 307 sessionId:  describe result for acl check
2025-10-15T10:56:44.906372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:44.906399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:44.906421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:44.906451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400752345256846:5029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:44.909747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400752345256846:5029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:44.916322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400752345256846:5029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:44.924374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400752345256846:5029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:44.924434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400752345256846:5029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:44.924450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400752345256846:5029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:44.924481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:44.930385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:44.934140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:44.935009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:44.935040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:44.935087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:44.935379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:44.935577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400755144961234:4637]
2025-10-15T10:56:44.937842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:44.938693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:44.938858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:44.939878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:44.940136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.940147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.940152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.940157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.940162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.940170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.940177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.940184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.940191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.940196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.940201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.940206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.940212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.940216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.940251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.940335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.940382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.940435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.940487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.940538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.940596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.940656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.940711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.940767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.940821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.940873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.940920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.940968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.941038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.941121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:44.941184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.941242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:44.941292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.941349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:44.941402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.941469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:44.941544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.941592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:44.941626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.941669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:44.941700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.941738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:44.941770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.941805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:44.941840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.941887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:44.941929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.941967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:44.942008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.942049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:44.942079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.942115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.942146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.942183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.942215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.942266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.942653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:44.967488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:44.976520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:44.976575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:44.976594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:44.976616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:44.976643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 306 [2:7561400755144961234:4637]
2025-10-15T10:56:44.976701Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:44.976765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:44.976788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:44.976801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:44.976814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:44.976864Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:44.976896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:44.976919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:44.977988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.978013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.978027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.978040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:44.978315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:44.978341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:44.978506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:44.978570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 306
2025-10-15T10:56:44.978611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 306
2025-10-15T10:56:44.978721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:44.978980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:44.979076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400752345256832:2467], now have 1 active actors on pipe
2025-10-15T10:56:44.979104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400752345256957:5029], now have 1 active actors on pipe
2025-10-15T10:56:44.979169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:44.979201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:44.979240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400755144961229:4637]
2025-10-15T10:56:44.979255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400755144961229:4637]
2025-10-15T10:56:44.979268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400755144961229:4637]
2025-10-15T10:56:44.979306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:44.979339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:44.979373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:44.979386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:44.979396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:44.979590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:44.979613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:44.979682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f86f13b8-5a46de27-fec500e2-c079667f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:44.979718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:44.979751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:44.979766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:44.979807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:44.979859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:44.979998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400755144961229:4637]
2025-10-15T10:56:44.980035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:44.980055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:44.980088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:44.980553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:44.980582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:44.980648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:44.980936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 307 partition: 0 MaxSeqNo: 46 sessionId: src_id|f86f13b8-5a46de27-fec500e2-c079667f_0
2025-10-15T10:56:44.981556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400752345256970:4933]
2025-10-15T10:56:44.981706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25a2e91-13c496e4-f03177b1-df8e3eb0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f86f13b8-5a46de27-fec500e2-c079667f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:44.981907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400752345256970:4933], now have 1 active actors on pipe
2025-10-15T10:56:44.982007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 306, pipe: [1:7561400752345256970:4933]
2025-10-15T10:56:44.999822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f86f13b8-5a46de27-fec500e2-c079667f_0] Write session: try to update token
2025-10-15T10:56:44.999893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f86f13b8-5a46de27-fec500e2-c079667f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:45.013938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:45.013970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:45.014010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400755144961229:4637]
2025-10-15T10:56:45.014139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:45.014141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:45.016062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:45.017392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:45.018721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:45.020220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:45.022184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:45.022787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:45.067223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId: src_id|f86f13b8-5a46de27-fec500e2-c079667f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:45.073264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:45.073305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:45.073323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:45.073335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:45.073385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400755144961229:4637]
2025-10-15T10:56:45.073416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400755144961229:4637]
2025-10-15T10:56:45.073441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400755144961229:4637]
2025-10-15T10:56:45.073584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:45.073625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:45.073645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:45.073654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:45.073675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:45.074763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:45.097458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:45.221411Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:45.229200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:45.229249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:45.229941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:45.230120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400752345256970:4933]
2025-10-15T10:56:45.230209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:45.230222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:45.229989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:45.244295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 307 reason: error at write: Disconnected sessionId: src_id|f86f13b8-5a46de27-fec500e2-c079667f_0
2025-10-15T10:56:45.244638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 307 sessionId: src_id|f86f13b8-5a46de27-fec500e2-c079667f_0 is DEAD
2025-10-15T10:56:45.245096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f86f13b8-5a46de27-fec500e2-c079667f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:45.245163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f86f13b8-5a46de27-fec500e2-c079667f_0] Write session will restart in 0.009695s
2025-10-15T10:56:45.245321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f86f13b8-5a46de27-fec500e2-c079667f_0] Write session: Do CDS request
2025-10-15T10:56:45.245384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f86f13b8-5a46de27-fec500e2-c079667f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:45.260664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:45.260703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 308
2025-10-15T10:56:45.260882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f86f13b8-5a46de27-fec500e2-c079667f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:45.261479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:45.261631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:45.261657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:45.261667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:45.263179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 308 sessionId:  describe result for acl check
2025-10-15T10:56:45.263298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:45.263319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:45.263329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:45.263362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400756640224289:5034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:45.266266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400756640224289:5034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:45.278139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400756640224289:5034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:45.286793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400756640224289:5034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:45.286841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400756640224289:5034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:45.286858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400756640224289:5034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:45.286889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:45.290104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:45.293969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:45.294798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:45.294834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:45.294873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:45.295091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:45.295281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400759439928669:4640]
2025-10-15T10:56:45.297604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:45.298464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:45.298644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:45.300024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:45.300384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:45.300403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:45.300410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:45.300418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:45.300425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:45.300433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:45.300440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:45.300447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:45.300455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:45.300462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:45.300469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:45.300477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.300484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.300492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.300541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:45.300663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:45.300716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:45.300769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:45.300820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:45.300879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:45.300944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:45.300994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:45.301047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:45.301110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:45.301161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:45.301213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.301266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.301320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.301376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:45.301454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:45.301523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:45.301588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:45.301641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:45.301704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:45.301743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:45.301794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:45.301864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:45.301924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:45.301975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:45.302033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:45.302089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:45.302155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:45.302201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:45.302263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:45.302313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:45.302367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:45.302415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:45.302469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:45.302517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:45.302571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:45.302618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.302673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.302722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.302793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.302841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.302895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.303775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:45.326241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:45.330267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400756640224406:4933]
2025-10-15T10:56:45.335213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:45.335254Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:45.335267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:45.335283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:45.335303Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 307 [2:7561400759439928669:4640]
2025-10-15T10:56:45.335343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:45.335426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:45.335442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:45.335454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:45.335463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:45.335500Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:45.335518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:45.335535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:45.336551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.336578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.336591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.336600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:45.336811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:45.336837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.336960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.337092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 307
2025-10-15T10:56:45.337115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 307
2025-10-15T10:56:45.337183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.337184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 307, pipe: [1:7561400756640224406:4933]
2025-10-15T10:56:45.337416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:45.337502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400756640224271:2467], now have 1 active actors on pipe
2025-10-15T10:56:45.337532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400756640224400:5034], now have 1 active actors on pipe
2025-10-15T10:56:45.337554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400756640224406:4933], now have 1 active actors on pipe
2025-10-15T10:56:45.337614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:45.337640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:45.337676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400759439928664:4640]
2025-10-15T10:56:45.337696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400759439928664:4640]
2025-10-15T10:56:45.337708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400759439928664:4640]
2025-10-15T10:56:45.337744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:45.337801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:45.337818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:45.337822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:45.337835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:45.337999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:45.338021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:45.338092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d6931a7-6fbdc518-545e874-5172760b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:45.338127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:45.338151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:45.338162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:45.338200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:45.338245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:45.338372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400759439928664:4640]
2025-10-15T10:56:45.338402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:45.338421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:45.338447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:45.338914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:45.338950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:45.339017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:45.339303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 308 partition: 0 MaxSeqNo: 46 sessionId: src_id|1d6931a7-6fbdc518-545e874-5172760b_0
2025-10-15T10:56:45.340260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f86f13b8-5a46de27-fec500e2-c079667f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1d6931a7-6fbdc518-545e874-5172760b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:45.366831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6931a7-6fbdc518-545e874-5172760b_0] Write session: try to update token
2025-10-15T10:56:45.366913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6931a7-6fbdc518-545e874-5172760b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:45.384034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:45.384067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:45.384103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400759439928664:4640]
2025-10-15T10:56:45.384234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:45.384237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:45.386232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:45.387814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:45.389353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:45.390591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:45.392402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:45.393003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:45.451285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId: src_id|1d6931a7-6fbdc518-545e874-5172760b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:45.454120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:45.454144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:45.454155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:45.454163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:45.454190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400759439928664:4640]
2025-10-15T10:56:45.454208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400759439928664:4640]
2025-10-15T10:56:45.454223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400759439928664:4640]
2025-10-15T10:56:45.454311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:45.454345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:45.454346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:45.454354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:45.454361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:45.454382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:45.454396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:45.454412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:45.460729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:45.478938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:45.613730Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:45.615843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:45.615882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:45.616553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:45.616483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:45.616514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:45.643295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400756640224406:4933]
2025-10-15T10:56:45.643402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:45.643527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 308 reason: error at write: Disconnected sessionId: src_id|1d6931a7-6fbdc518-545e874-5172760b_0
2025-10-15T10:56:45.643872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 308 sessionId: src_id|1d6931a7-6fbdc518-545e874-5172760b_0 is DEAD
2025-10-15T10:56:45.644240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6931a7-6fbdc518-545e874-5172760b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:45.644283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6931a7-6fbdc518-545e874-5172760b_0] Write session will restart in 0.008028s
2025-10-15T10:56:45.644404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6931a7-6fbdc518-545e874-5172760b_0] Write session: Do CDS request
2025-10-15T10:56:45.644433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6931a7-6fbdc518-545e874-5172760b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:45.657303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6931a7-6fbdc518-545e874-5172760b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:45.666116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:45.666149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 309
2025-10-15T10:56:45.666621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:45.666756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:45.666777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:45.666796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:45.668016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 309 sessionId:  describe result for acl check
2025-10-15T10:56:45.668120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:45.668134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:45.668143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:45.668159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400756640224524:5044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:45.670358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400756640224524:5044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:45.671450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:45.674986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:45.675816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:45.675844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:45.675886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:45.676127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:45.676304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400759439928832:4649]
2025-10-15T10:56:45.676366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400756640224524:5044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:45.678440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:45.679289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:45.679533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:45.680842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:45.681157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:45.681166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:45.681173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:45.681179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:45.681187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:45.681193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:45.681200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:45.681206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:45.681213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:45.681220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:45.681227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:45.681233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.681239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.681246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.681293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:45.681397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:45.681446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:45.681493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:45.681537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:45.681580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:45.681625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:45.681669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:45.681712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:45.681758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:45.681802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:45.681845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.681907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.681955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.681996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:45.682060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:45.682117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:45.682172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:45.682225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:45.682277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:45.682323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:45.682374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:45.682420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:45.682470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:45.682513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:45.682564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:45.682611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:45.682663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:45.682707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:45.682760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:45.682807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:45.682860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:45.682904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:45.682956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:45.683002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:45.683089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:45.683137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.683194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.683219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400756640224524:5044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:45.683248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.683300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.683261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400756640224524:5044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:45.683277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400756640224524:5044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:45.683304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:45.683357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.683416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.683923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:45.714678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:45.724486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:45.724530Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:45.724545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:45.724565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:45.724588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 308 [2:7561400759439928832:4649]
2025-10-15T10:56:45.724638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:45.724691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:45.724704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:45.724715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:45.724725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:45.724775Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:45.724797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:45.724818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:45.726552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.726578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.726592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.726602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:45.726875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:45.726899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:45.727180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 308
2025-10-15T10:56:45.727285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 308
2025-10-15T10:56:45.727035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:45.727212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:45.727440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:45.727520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400756640224437:2467], now have 1 active actors on pipe
2025-10-15T10:56:45.727543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400756640224555:5044], now have 1 active actors on pipe
2025-10-15T10:56:45.727591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:45.727612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:45.727663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400759439928827:4649]
2025-10-15T10:56:45.727677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400759439928827:4649]
2025-10-15T10:56:45.727689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400759439928827:4649]
2025-10-15T10:56:45.727729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:45.727772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:45.727793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:45.727805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:45.727811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:45.727984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:45.728009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:45.728069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:45.728106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:45.728123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:45.728133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:45.728169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:45.728214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:45.728354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400759439928827:4649]
2025-10-15T10:56:45.728388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:45.728407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:45.728436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:45.728844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:45.728867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:45.728934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:45.729179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 309 partition: 0 MaxSeqNo: 46 sessionId: src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0
2025-10-15T10:56:45.729989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d6931a7-6fbdc518-545e874-5172760b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:45.743483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400756640224563:4933]
2025-10-15T10:56:45.743976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400756640224563:4933], now have 1 active actors on pipe
2025-10-15T10:56:45.744084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 308, pipe: [1:7561400756640224563:4933]
2025-10-15T10:56:45.751984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0] Write session: try to update token
2025-10-15T10:56:45.752040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:45.758671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:45.758708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:45.758747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400759439928827:4649]
2025-10-15T10:56:45.758885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:45.758902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:45.761066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:45.763326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:45.764829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:45.766498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:45.768397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:45.769020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:45.829948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId: src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:45.830159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:45.830191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:45.830202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:45.830209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:45.830244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400759439928827:4649]
2025-10-15T10:56:45.830264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400759439928827:4649]
2025-10-15T10:56:45.830281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400759439928827:4649]
2025-10-15T10:56:45.830424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:45.830439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:45.830437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:45.830446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:45.830473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:45.830480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:45.830494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:45.830501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:45.831313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:45.851697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:45.980008Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:45.981446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:45.981490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:45.982012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:45.982020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400756640224563:4933]
2025-10-15T10:56:45.982117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:45.982130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:45.982177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:45.991623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 309 reason: error at write: Disconnected sessionId: src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0
2025-10-15T10:56:45.992077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 309 sessionId: src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0 is DEAD
2025-10-15T10:56:45.992507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:45.992573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0] Write session will restart in 0.008186s
2025-10-15T10:56:45.992735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0] Write session: Do CDS request
2025-10-15T10:56:45.992784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:46.007197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:46.007232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 310
2025-10-15T10:56:46.007417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:46.007874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:46.008010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:46.008044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:46.008054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:46.009188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 310 sessionId:  describe result for acl check
2025-10-15T10:56:46.009301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:46.009319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:46.009327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:46.009344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400760935191910:5052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:46.011854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400760935191910:5052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:46.021207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400760935191910:5052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:46.029888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400760935191910:5052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:46.029933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400760935191910:5052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:46.029950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400760935191910:5052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:46.029980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:46.034492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:46.038491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:46.039303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:46.039330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:46.039384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:46.039619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:46.039807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400763734896291:4658]
2025-10-15T10:56:46.041895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:46.042992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:46.043186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:46.044471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:46.044809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.044830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.044837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.044843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.044850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.044857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.044863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.044869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.044876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.044883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.044889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.044896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.044903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.044910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.044955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.045059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.045102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.045136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.045165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.045198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.045236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.045288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.045335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.045384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.045429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.045470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.045512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.045555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.045602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.045672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.045731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.045788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.045837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.045891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.045942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.046008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.046054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.046103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.046145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.046191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.046233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.046286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.046335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.046386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.046446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.046506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.046551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.046608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.046652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.046702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.046745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.046800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.046849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.046902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.046939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.046980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.047510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:46.076760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:46.082449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400760935192030:4933]
2025-10-15T10:56:46.086597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:46.086652Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:46.086670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:46.086692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:46.086720Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 309 [2:7561400763734896291:4658]
2025-10-15T10:56:46.086788Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:46.086862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:46.086879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:46.086894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:46.086908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:46.086964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:46.087004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:46.087033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:46.088362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.088389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.088403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.088416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:46.088695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:46.088721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.088877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.089084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.089197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 309
2025-10-15T10:56:46.089204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 309
2025-10-15T10:56:46.089312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:46.089297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 309, pipe: [1:7561400760935192030:4933]
2025-10-15T10:56:46.089406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400756640224598:2467], now have 1 active actors on pipe
2025-10-15T10:56:46.089438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400760935192022:5052], now have 1 active actors on pipe
2025-10-15T10:56:46.089454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400760935192030:4933], now have 1 active actors on pipe
2025-10-15T10:56:46.089511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:46.089537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:46.089581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400763734896286:4658]
2025-10-15T10:56:46.089600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400763734896286:4658]
2025-10-15T10:56:46.089613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400763734896286:4658]
2025-10-15T10:56:46.089650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:46.089675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:46.089689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:46.089709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:46.089711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:46.089855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:46.089873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:46.089920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c182bbe7-8fc948c2-78f98d64-1290923_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:46.089942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:46.089955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:46.089963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:46.089989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:46.090020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:46.090121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400763734896286:4658]
2025-10-15T10:56:46.090151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:46.090159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:46.090183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:46.090706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:46.090748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:46.090817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:46.091139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 310 partition: 0 MaxSeqNo: 46 sessionId: src_id|c182bbe7-8fc948c2-78f98d64-1290923_0
2025-10-15T10:56:46.091916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36ccb37-67d29b21-a89e4814-7c5311c6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c182bbe7-8fc948c2-78f98d64-1290923_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:46.111099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c182bbe7-8fc948c2-78f98d64-1290923_0] Write session: try to update token
2025-10-15T10:56:46.111159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c182bbe7-8fc948c2-78f98d64-1290923_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:46.121363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:46.121392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:46.121431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400763734896286:4658]
2025-10-15T10:56:46.121527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:46.121565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:46.123412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:46.124691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:46.125868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:46.127094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:46.128799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:46.129287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:46.173920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:46.173958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:46.173971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:46.173978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:46.174012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400763734896286:4658]
2025-10-15T10:56:46.174052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400763734896286:4658]
2025-10-15T10:56:46.174072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400763734896286:4658]
2025-10-15T10:56:46.174248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:46.174273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:46.174306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:46.174339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:46.174375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:46.175948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:46.180292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId: src_id|c182bbe7-8fc948c2-78f98d64-1290923_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:46.204389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:46.323947Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:46.325149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:46.325180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:46.325764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:46.325816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:46.325777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:46.325792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:46.326017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400760935192030:4933]
2025-10-15T10:56:46.334896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 310 reason: error at write: Disconnected sessionId: src_id|c182bbe7-8fc948c2-78f98d64-1290923_0
2025-10-15T10:56:46.335273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 310 sessionId: src_id|c182bbe7-8fc948c2-78f98d64-1290923_0 is DEAD
2025-10-15T10:56:46.335804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c182bbe7-8fc948c2-78f98d64-1290923_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:46.335868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c182bbe7-8fc948c2-78f98d64-1290923_0] Write session will restart in 0.009294s
2025-10-15T10:56:46.336045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c182bbe7-8fc948c2-78f98d64-1290923_0] Write session: Do CDS request
2025-10-15T10:56:46.336105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c182bbe7-8fc948c2-78f98d64-1290923_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:46.349344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:46.349442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c182bbe7-8fc948c2-78f98d64-1290923_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:46.349387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 311
2025-10-15T10:56:46.349899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:46.350023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:46.350054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:46.350063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:46.351283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 311 sessionId:  describe result for acl check
2025-10-15T10:56:46.351410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:46.351428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:46.351437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:46.351455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400760935192056:5057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:46.353910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400760935192056:5057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:46.362498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400760935192056:5057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:46.372286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400760935192056:5057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:46.372343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400760935192056:5057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:46.372361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400760935192056:5057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:46.372402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:46.376260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:46.380193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:46.381152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:46.381183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:46.381227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:46.381491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:46.381682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400763734896433:4661]
2025-10-15T10:56:46.383395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:46.384260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:46.384466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:46.385416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:46.385694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.385713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.385720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.385725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.385730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.385735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.385739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.385744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.385749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.385753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.385759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.385763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.385768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.385772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.385820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.385913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.385959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.386007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.386053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.386103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.386151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.386204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.386254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.386303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.386354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.386404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.386455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.386505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.386556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.386629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.386688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.386754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.386835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.386901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.386954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.387015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.387066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.387124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.387178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.387233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.387288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.387364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.387417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.387476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.387525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.387580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.387628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.387684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.387732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.387800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.387843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.387896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.387942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.387999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.388042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.388097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.388608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:46.404317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:46.413315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:46.413370Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:46.413388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:46.413410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:46.413436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 310 [2:7561400763734896433:4661]
2025-10-15T10:56:46.413493Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:46.413560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:46.413576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:46.413590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:46.413601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:46.413636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:46.413654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:46.413672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:46.414471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.414494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.414504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.414514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:46.414764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:46.414791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.414914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.415137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.415163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 310
2025-10-15T10:56:46.415165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 310
2025-10-15T10:56:46.415397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:46.415485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400760935192040:2467], now have 1 active actors on pipe
2025-10-15T10:56:46.415518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400760935192169:5057], now have 1 active actors on pipe
2025-10-15T10:56:46.415582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:46.415607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:46.415644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400763734896428:4661]
2025-10-15T10:56:46.415662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400763734896428:4661]
2025-10-15T10:56:46.415676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400763734896428:4661]
2025-10-15T10:56:46.415711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:46.415759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:46.415782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:46.415790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:46.415802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:46.415968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:46.415992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:46.416061Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:46.416094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:46.416118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:46.416128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:46.416166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:46.416208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:46.416329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400763734896428:4661]
2025-10-15T10:56:46.416360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:46.416397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:46.416407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:46.416828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:46.416855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:46.416914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:46.417231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 311 partition: 0 MaxSeqNo: 46 sessionId: src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0
2025-10-15T10:56:46.418023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c182bbe7-8fc948c2-78f98d64-1290923_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:46.426467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400760935192181:4933]
2025-10-15T10:56:46.427014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400760935192181:4933], now have 1 active actors on pipe
2025-10-15T10:56:46.427162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 310, pipe: [1:7561400760935192181:4933]
2025-10-15T10:56:46.437360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0] Write session: try to update token
2025-10-15T10:56:46.437420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:46.444842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:46.444880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:46.444919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400763734896428:4661]
2025-10-15T10:56:46.445052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:46.445054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:46.446806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:46.448017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:46.449464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:46.459946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:46.461778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:46.462258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:46.506507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:46.506538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:46.506549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:46.506558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:46.506590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400763734896428:4661]
2025-10-15T10:56:46.506609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400763734896428:4661]
2025-10-15T10:56:46.506625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400763734896428:4661]
2025-10-15T10:56:46.506750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:46.506775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:46.507778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:46.508450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:46.508503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:46.508534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:46.515524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId: src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:46.536791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:46.653728Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:46.654888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:46.654917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:46.655587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400760935192181:4933]
2025-10-15T10:56:46.655620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:46.655726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:46.655745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:46.655658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:46.680004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 311 reason: error at write: Disconnected sessionId: src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0
2025-10-15T10:56:46.680329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 311 sessionId: src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0 is DEAD
2025-10-15T10:56:46.680662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:46.680716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0] Write session will restart in 0.009368s
2025-10-15T10:56:46.680832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0] Write session: Do CDS request
2025-10-15T10:56:46.680880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:46.695077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:46.695138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 312
2025-10-15T10:56:46.695342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:46.695990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:46.696205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:46.696242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:46.696260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:46.697870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 312 sessionId:  describe result for acl check
2025-10-15T10:56:46.697995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:46.698010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:46.698018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:46.698033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400760935192259:5061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:46.700383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400760935192259:5061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:46.705468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400760935192259:5061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:46.710984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:46.711787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400760935192259:5061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:46.711832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400760935192259:5061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:46.711849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400760935192259:5061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:46.711883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:46.712316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:46.712835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:46.712855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:46.712878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:46.713033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:46.713139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400763734896585:4664]
2025-10-15T10:56:46.714396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:46.715030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:46.715152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:46.715925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:46.716128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.716139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.716144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.716148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.716152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.716157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.716161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.716165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.716170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.716174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.716179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.716183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.716188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.716192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.716219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.716297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.716327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.716357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.716385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.716415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.716442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.716469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.716496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.716524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.716552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.716580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.716608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.716636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.716658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.716697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:46.716737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.716775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:46.716811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.716847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:46.716877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.716914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:46.716946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.716982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:46.717013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.717043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:46.717075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.717111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:46.717143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.717178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:46.717210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.717245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:46.717277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.717313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:46.717343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.717379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:46.717408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.717440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.717474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.717509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.717549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.717584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.717879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:46.733084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:46.742745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:46.742786Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:46.742801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:46.742819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:46.742843Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 311 [2:7561400763734896585:4664]
2025-10-15T10:56:46.742886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:46.742926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:46.742936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:46.742945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:46.742953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:46.742998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:46.743016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:46.743032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:46.755746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400760935192322:4933]
2025-10-15T10:56:46.757423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.757451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.757462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.757473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:46.757694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:46.757711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:46.757829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:46.757992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:46.757996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 311
2025-10-15T10:56:46.758031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 311
2025-10-15T10:56:46.758204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:46.758078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 311, pipe: [1:7561400760935192322:4933]
2025-10-15T10:56:46.758278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400760935192317:5061], now have 1 active actors on pipe
2025-10-15T10:56:46.758304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400760935192185:2467], now have 1 active actors on pipe
2025-10-15T10:56:46.758323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400760935192322:4933], now have 1 active actors on pipe
2025-10-15T10:56:46.758379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:46.758406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:46.758440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400763734896579:4664]
2025-10-15T10:56:46.758452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400763734896579:4664]
2025-10-15T10:56:46.758463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400763734896579:4664]
2025-10-15T10:56:46.758495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:46.758524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:46.758537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:46.758547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:46.758556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:46.758682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:46.758697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:46.758738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cec00f98-796fd574-5ee25016-273a8e2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:46.758758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:46.758770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:46.758777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:46.758803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:46.758838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:46.758938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400763734896579:4664]
2025-10-15T10:56:46.758967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:46.758995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:46.759000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:46.759463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:46.759492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:46.759556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:46.759890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 312 partition: 0 MaxSeqNo: 46 sessionId: src_id|cec00f98-796fd574-5ee25016-273a8e2c_0
2025-10-15T10:56:46.760701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd50953-bcecc9bb-9cfecc11-3703c3d1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cec00f98-796fd574-5ee25016-273a8e2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:46.780510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cec00f98-796fd574-5ee25016-273a8e2c_0] Write session: try to update token
2025-10-15T10:56:46.780571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cec00f98-796fd574-5ee25016-273a8e2c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:46.787642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:46.787677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:46.787716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400763734896579:4664]
2025-10-15T10:56:46.787858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:46.787878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:46.789711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:46.790984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:46.792724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:46.794074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:46.795845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:46.796365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:46.842267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:46.842296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:46.842309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:46.842319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:46.842350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400763734896579:4664]
2025-10-15T10:56:46.842368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400763734896579:4664]
2025-10-15T10:56:46.842385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400763734896579:4664]
2025-10-15T10:56:46.842491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:46.842508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:46.842526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:46.842559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:46.842579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:46.843341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:46.857012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId: src_id|cec00f98-796fd574-5ee25016-273a8e2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:46.878664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:46.986709Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:46.988995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:46.989038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:46.989673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:46.989697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:46.989731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:47.001769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400760935192322:4933]
2025-10-15T10:56:47.001899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:47.002094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 312 reason: error at write: Disconnected sessionId: src_id|cec00f98-796fd574-5ee25016-273a8e2c_0
2025-10-15T10:56:47.002513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 312 sessionId: src_id|cec00f98-796fd574-5ee25016-273a8e2c_0 is DEAD
2025-10-15T10:56:47.002924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec00f98-796fd574-5ee25016-273a8e2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:47.002976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec00f98-796fd574-5ee25016-273a8e2c_0] Write session will restart in 0.008710s
2025-10-15T10:56:47.003128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec00f98-796fd574-5ee25016-273a8e2c_0] Write session: Do CDS request
2025-10-15T10:56:47.003168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec00f98-796fd574-5ee25016-273a8e2c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:47.016483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:47.016603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cec00f98-796fd574-5ee25016-273a8e2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:47.016534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 313
2025-10-15T10:56:47.017171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:47.017336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:47.017360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:47.017376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:47.018798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 313 sessionId:  describe result for acl check
2025-10-15T10:56:47.018934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:47.018953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:47.018963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:47.018981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400765230159671:5072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:47.021813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400765230159671:5072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:47.028295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400765230159671:5072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:47.036248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400765230159671:5072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:47.036298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400765230159671:5072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:47.036316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400765230159671:5072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:47.036350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:47.060387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:47.064626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:47.065400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:47.065427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:47.065465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:47.065691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:47.065863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400768029864036:4672]
2025-10-15T10:56:47.068110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:47.069022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:47.069195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:47.070162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:47.070380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.070390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.070394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.070399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.070403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.070407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.070411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.070415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.070419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.070423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.070428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.070433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.070437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.070441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.070471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.070549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.070589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.070621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.070651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.070681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.070711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.070739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.070770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.070812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.070848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.070891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.070923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.070955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.070982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.071023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.071071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.071118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.071171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.071206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.071254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.071288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.071332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.071397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.071440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.071492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.071542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.071591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.071640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.071692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.071745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.071808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.071856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.071910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.071959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.072006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.072052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.072104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.072150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.072204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.072247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.072297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.072745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:47.087977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:47.097747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:47.097782Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:47.097797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:47.097812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:47.097834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 312 [2:7561400768029864036:4672]
2025-10-15T10:56:47.097878Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:47.097924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:47.097936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:47.097947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:47.097957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:47.097998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:47.098018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:47.098036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:47.099865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.099887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.099901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.099911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:47.100174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:47.100204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.100335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.100522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.100531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 312
2025-10-15T10:56:47.100696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 312
2025-10-15T10:56:47.100747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:47.100817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400765230159663:2467], now have 1 active actors on pipe
2025-10-15T10:56:47.100837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400765230159707:5072], now have 1 active actors on pipe
2025-10-15T10:56:47.100878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400768029864031:4672]
2025-10-15T10:56:47.100896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400768029864031:4672]
2025-10-15T10:56:47.100908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400768029864031:4672]
2025-10-15T10:56:47.100942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:47.100977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:47.101000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:47.101010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:47.101013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:47.101033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:47.101072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:47.101224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:47.101251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:47.101386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:47.101417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:47.101432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:47.101441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:47.101473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:47.101511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:47.101549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400768029864031:4672]
2025-10-15T10:56:47.101580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:47.101607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:47.101655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:47.101804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400765230159795:4933]
2025-10-15T10:56:47.102161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:47.102189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:47.102254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400765230159795:4933], now have 1 active actors on pipe
2025-10-15T10:56:47.102290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:47.102369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 312, pipe: [1:7561400765230159795:4933]
2025-10-15T10:56:47.102578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 313 partition: 0 MaxSeqNo: 46 sessionId: src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0
2025-10-15T10:56:47.103379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec00f98-796fd574-5ee25016-273a8e2c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:47.124462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0] Write session: try to update token
2025-10-15T10:56:47.124520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:47.144671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:47.144701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:47.144728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400768029864031:4672]
2025-10-15T10:56:47.144832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:47.144845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:47.146821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:47.148273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:47.149645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:47.151190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:47.153505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:47.154160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:47.193583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:47.193624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:47.193640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:47.193653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:47.193688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400768029864031:4672]
2025-10-15T10:56:47.193713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400768029864031:4672]
2025-10-15T10:56:47.193749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400768029864031:4672]
2025-10-15T10:56:47.193866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:47.193926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:47.193942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:47.193954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:47.193995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:47.196143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:47.199055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId: src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:47.231458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:47.334884Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:47.336396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:47.336437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:47.336896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:47.336951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:47.336966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:47.337164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400765230159795:4933]
2025-10-15T10:56:47.337150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:47.382919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:47.387973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:47.388783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:47.388810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:47.388847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:47.389096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:47.389281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400768029864203:4682]
2025-10-15T10:56:47.391263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 313 reason: error at write: Disconnected sessionId: src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0
2025-10-15T10:56:47.391600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 313 sessionId: src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0 is DEAD
2025-10-15T10:56:47.392077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:47.392155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0] Write session will restart in 0.007124s
2025-10-15T10:56:47.392351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0] Write session: Do CDS request
2025-10-15T10:56:47.392420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:47.392742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:47.394652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:47.395192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:47.397595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:47.398325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.398364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.398390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.398411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.398425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.398445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.398465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.398498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.398519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.398550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.398578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.398603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.398630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.398647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.398695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.398800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.398849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.398903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.398953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.399003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.399051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.399100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.399150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.399199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.399248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.399296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.404084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:47.404133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 314
2025-10-15T10:56:47.404226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:47.404714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:47.404854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:47.404872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:47.404883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:47.406329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 314 sessionId:  describe result for acl check
2025-10-15T10:56:47.406436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:47.406452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:47.406462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:47.406480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400765230159924:5080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:47.406854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.406931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.406988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.407060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.407126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.407191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.407242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.407305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.407368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.407429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.407480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.407522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.407567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.407626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.407684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.407742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.407815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.407864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.407895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.407933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.407963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.408003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.408037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.408084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.408128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.408168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.408210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.408270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.408313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.408363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.408748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:47.409239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400765230159924:5080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:47.415201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400765230159924:5080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:47.421827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400765230159924:5080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:47.421868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400765230159924:5080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:47.421884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400765230159924:5080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:47.421912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:47.426098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:47.436280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:47.436311Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:47.436321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:47.436334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:47.436350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 313 [2:7561400768029864203:4682]
2025-10-15T10:56:47.436382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:47.436425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:47.436436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:47.436446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:47.436455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:47.436486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:47.436502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:47.436516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:47.437685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.437702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.437711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.437687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400765230159956:4933]
2025-10-15T10:56:47.437718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:47.437927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:47.437954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.438081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.438233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.438250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 313
2025-10-15T10:56:47.438265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 313
2025-10-15T10:56:47.438323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 313, pipe: [1:7561400765230159956:4933]
2025-10-15T10:56:47.438461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:47.438538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400765230159955:5080], now have 1 active actors on pipe
2025-10-15T10:56:47.438567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400765230159817:2467], now have 1 active actors on pipe
2025-10-15T10:56:47.438588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400765230159956:4933], now have 1 active actors on pipe
2025-10-15T10:56:47.438628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:47.438646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:47.438681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400768029864198:4682]
2025-10-15T10:56:47.438692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400768029864198:4682]
2025-10-15T10:56:47.438700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400768029864198:4682]
2025-10-15T10:56:47.438722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:47.438766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:47.438783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:47.438799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:47.438809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:47.438890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:47.438903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:47.438938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:47.438969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:47.438990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:47.439000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:47.439030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:47.439067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:47.439155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400768029864198:4682]
2025-10-15T10:56:47.439176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:47.439204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:47.439208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:47.439688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:47.439716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:47.439801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:47.440113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 314 partition: 0 MaxSeqNo: 46 sessionId: src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0
2025-10-15T10:56:47.440841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926cdcca-71068b2f-96280aa2-8b60a75f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:47.461852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0] Write session: try to update token
2025-10-15T10:56:47.461909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:47.471685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:47.471717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:47.471754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400768029864198:4682]
2025-10-15T10:56:47.471864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:47.471877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:47.474519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:47.476802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:47.478326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:47.479917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:47.481744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:47.482345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:47.570273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId: src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:47.571198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:47.571228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:47.571240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:47.571296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:47.571310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:47.571322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:47.571333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:47.571387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400768029864198:4682]
2025-10-15T10:56:47.571411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400768029864198:4682]
2025-10-15T10:56:47.571432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400768029864198:4682]
2025-10-15T10:56:47.571581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:47.571594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:47.571610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:47.571629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:47.571669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:47.572682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:47.592201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:47.713782Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:47.715123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:47.715158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:47.715723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:47.715741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:47.715756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:47.715915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:47.716004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400765230159956:4933]
2025-10-15T10:56:47.725005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 314 reason: error at write: Disconnected sessionId: src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0
2025-10-15T10:56:47.725325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 314 sessionId: src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0 is DEAD
2025-10-15T10:56:47.725740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:47.725793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0] Write session will restart in 0.007068s
2025-10-15T10:56:47.725942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0] Write session: Do CDS request
2025-10-15T10:56:47.725997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:47.738429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:47.738481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 315
2025-10-15T10:56:47.738605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:47.739190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:47.739382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:47.739414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:47.739433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:47.754360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 315 sessionId:  describe result for acl check
2025-10-15T10:56:47.754527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:47.754544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:47.754555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:47.754574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400765230159982:5084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:47.757035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400765230159982:5084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:47.763085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400765230159982:5084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:47.771289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400765230159982:5084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:47.771335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400765230159982:5084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:47.771371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400765230159982:5084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:47.771407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:47.781504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:47.785445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:47.786284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:47.786315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:47.786368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:47.786626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:47.786812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400768029864361:4685]
2025-10-15T10:56:47.789008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:47.790085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:47.790302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:47.791646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:47.791986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.792004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.792011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.792019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.792025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.792032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.792038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.792045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.792052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.792058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.792065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.792071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.792078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.792085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.792134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.792247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.792296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.792345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.792391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.792447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.792501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.792553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.792603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.792656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.792707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.792758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.792809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.792858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.792906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.792980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:47.793042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.793102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:47.793154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.793214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:47.793265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.793322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:47.793375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.793432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:47.793494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.793554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:47.793605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.793665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:47.793716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.793774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:47.793824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.793886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:47.793934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.793995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:47.794044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.794101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:47.794150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.794207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.794257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.794317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.794368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.794423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.794952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:47.810221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:47.816064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400765230160106:4933]
2025-10-15T10:56:47.831468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:47.831515Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:47.831533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:47.831551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:47.831577Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 314 [2:7561400768029864361:4685]
2025-10-15T10:56:47.831626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:47.831687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:47.831700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:47.831712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:47.831722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:47.831770Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:47.831805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:47.831827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:47.832909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.832931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.832941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.832950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:47.833197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:47.833218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:47.833360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:47.833481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 314, pipe: [1:7561400765230160106:4933]
2025-10-15T10:56:47.833525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 314
2025-10-15T10:56:47.833544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:47.833609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 314
2025-10-15T10:56:47.833781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:47.833854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400765230160106:4933], now have 1 active actors on pipe
2025-10-15T10:56:47.833881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400765230160091:5084], now have 1 active actors on pipe
2025-10-15T10:56:47.833902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400765230159966:2467], now have 1 active actors on pipe
2025-10-15T10:56:47.833954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:47.833978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:47.834028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400768029864355:4685]
2025-10-15T10:56:47.834050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400768029864355:4685]
2025-10-15T10:56:47.834062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400768029864355:4685]
2025-10-15T10:56:47.834099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:47.834161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:47.834177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:47.834178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:47.834191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:47.834339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:47.834359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:47.834411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:47.834439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:47.834455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:47.834464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:47.834495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:47.834534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:47.834659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400768029864355:4685]
2025-10-15T10:56:47.834687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:47.834725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:47.834733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:47.835219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:47.835271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:47.835367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:47.835638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 315 partition: 0 MaxSeqNo: 46 sessionId: src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0
2025-10-15T10:56:47.836398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca1417c-fdd9e3e3-68437804-891b5617_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:47.856436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0] Write session: try to update token
2025-10-15T10:56:47.856496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:47.862676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:47.862710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:47.862750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400768029864355:4685]
2025-10-15T10:56:47.862877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:47.862874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:47.864929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:47.866422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:47.867968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:47.869344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:47.871242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:47.871808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:47.907995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:47.908037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:47.908054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:47.908066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:47.908109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400768029864355:4685]
2025-10-15T10:56:47.908139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400768029864355:4685]
2025-10-15T10:56:47.908162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400768029864355:4685]
2025-10-15T10:56:47.908268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:47.908308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:47.908324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:47.908332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:47.908353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:47.909994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:47.931579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId: src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:47.951474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:48.054486Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:48.062325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:48.062377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:48.062900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400765230160106:4933]
2025-10-15T10:56:48.062936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:48.062950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:48.063004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:48.063135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:48.073182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 315 reason: error at write: Disconnected sessionId: src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0
2025-10-15T10:56:48.073554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 315 sessionId: src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0 is DEAD
2025-10-15T10:56:48.073911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:48.073974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0] Write session will restart in 0.009309s
2025-10-15T10:56:48.074117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0] Write session: Do CDS request
2025-10-15T10:56:48.074175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:48.087171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:48.087217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 316
2025-10-15T10:56:48.087328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:48.087828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:48.087941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:48.087959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:48.087973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:48.090363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 316 sessionId:  describe result for acl check
2025-10-15T10:56:48.090541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:48.090586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:48.090604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:48.090633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400769525127446:5089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:48.093194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400769525127446:5089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:48.104604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400769525127446:5089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:48.111636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400769525127446:5089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:48.111682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400769525127446:5089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:48.111699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400769525127446:5089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:48.111729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:48.112727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:48.116589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:48.117386Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:48.117422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:48.117466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:48.117722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:48.117903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400772324831801:4687]
2025-10-15T10:56:48.120043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:48.120870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:48.121060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:48.122216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:48.122525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.122545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.122551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.122558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.122565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.122571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.122577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.122585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.122592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.122598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.122604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.122610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.122617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.122623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.122663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.122766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.122813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.122859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.122903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.122959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.123008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.123060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.123108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.123160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.123224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.123271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.123321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.123386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.123435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.123505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.123569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.123627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.123678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.123738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.123782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.123850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.123905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.123964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.124015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.124076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.124127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.124181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.124232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.124289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.124341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.124401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.124454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.124522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.124574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.124629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.124680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.124737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.124789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.124847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.124898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.124956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.125441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:48.140028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:48.156235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:48.156281Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:48.156297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:48.156316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:48.156340Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 315 [2:7561400772324831801:4687]
2025-10-15T10:56:48.156387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:48.156446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:48.156461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:48.156472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:48.156482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:48.156526Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:48.156548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:48.156567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:48.157590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.157615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.157628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.157638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:48.157893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:48.157916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.158048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.158171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 315
2025-10-15T10:56:48.158235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.158180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 315
2025-10-15T10:56:48.158482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:48.158561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400769525127431:2467], now have 1 active actors on pipe
2025-10-15T10:56:48.158592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400769525127566:5089], now have 1 active actors on pipe
2025-10-15T10:56:48.158637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:48.158663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:48.158714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400772324831795:4687]
2025-10-15T10:56:48.158734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400772324831795:4687]
2025-10-15T10:56:48.158745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400772324831795:4687]
2025-10-15T10:56:48.158782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:48.158810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:48.158829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:48.158836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:48.158848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:48.159024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:48.159051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:48.159105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:48.159138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:48.159154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:48.159163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:48.159195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:48.159228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:48.159364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400772324831795:4687]
2025-10-15T10:56:48.159398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:48.159412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:48.159440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:48.159962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:48.159987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:48.160043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:48.160290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 316 partition: 0 MaxSeqNo: 46 sessionId: src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0
2025-10-15T10:56:48.161082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71ade543-42527d4e-40e1dfc-dfc04c6b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:48.163103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400769525127575:4933]
2025-10-15T10:56:48.163578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400769525127575:4933], now have 1 active actors on pipe
2025-10-15T10:56:48.163659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 315, pipe: [1:7561400769525127575:4933]
2025-10-15T10:56:48.181893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0] Write session: try to update token
2025-10-15T10:56:48.181955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:48.189622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:48.189655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:48.189692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400772324831795:4687]
2025-10-15T10:56:48.189803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:48.189848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:48.191997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:48.193373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:48.194710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:48.196113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:48.197987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:48.198591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:48.244888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:48.244929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:48.244969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:48.244989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:48.245031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400772324831795:4687]
2025-10-15T10:56:48.245084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400772324831795:4687]
2025-10-15T10:56:48.245123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400772324831795:4687]
2025-10-15T10:56:48.245282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:48.245318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:48.245318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:48.245374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:48.245419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:48.247642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:48.253323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId: src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:48.276307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:48.388177Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:48.398028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:48.398072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:48.398823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:48.399028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:48.399050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:48.398712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:48.411056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:48.411095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0] Write session will restart in 0.009377s
2025-10-15T10:56:48.411206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0] Write session: Do CDS request
2025-10-15T10:56:48.411232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:48.410287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 316 reason: error at write: Disconnected sessionId: src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0
2025-10-15T10:56:48.410686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 316 sessionId: src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0 is DEAD
2025-10-15T10:56:48.440574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:48.478762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:48.478793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 317
2025-10-15T10:56:48.478949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400769525127575:4933]
2025-10-15T10:56:48.483029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:48.483171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:48.483192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:48.483202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:48.490572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 317 sessionId:  describe result for acl check
2025-10-15T10:56:48.490702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:48.490712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:48.490721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:48.490738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400769525127629:5100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:48.512852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400769525127629:5100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:48.534894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400769525127629:5100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:48.551970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400769525127629:5100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:48.552016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400769525127629:5100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:48.552030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400769525127629:5100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:48.552057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:48.552207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:48.552944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:48.553728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:48.553746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:48.553793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:48.554016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:48.554190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400772324831973:4696]
2025-10-15T10:56:48.556739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:48.567998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:48.568252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:48.569528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:48.569870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.569878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.569885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.569892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.569898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.569905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.569911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.569917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.569925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.569931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.569938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.569944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.569951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.569959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.570006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.570103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.570148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.570189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.570243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.570289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.570328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.570368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.570408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.570452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.570493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.570534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.570574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.570617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.570656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.570720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.570771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.570820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.570864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.570912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.570954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.571004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.571046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.571094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.571135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.571184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.571226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.571271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.571309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.572210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.572275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.572331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.572376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.572426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.572470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.572520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.572561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.572612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.572651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.572700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.572741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.572791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.573255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:48.576960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400769525127738:4933]
2025-10-15T10:56:48.599429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:48.621043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:48.621090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:48.621107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:48.621123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:48.621146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 316 [2:7561400772324831973:4696]
2025-10-15T10:56:48.621189Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:48.621238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:48.621249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:48.621259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:48.621268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:48.621313Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:48.621330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:48.621349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:48.641436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.641467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.641478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.641487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:48.641720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:48.641749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.641861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.642025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.642217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:48.642285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400769525127594:2467], now have 1 active actors on pipe
2025-10-15T10:56:48.642304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400769525127738:4933], now have 1 active actors on pipe
2025-10-15T10:56:48.642323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400769525127731:5100], now have 1 active actors on pipe
2025-10-15T10:56:48.642344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400772324831968:4696]
2025-10-15T10:56:48.642356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400772324831968:4696]
2025-10-15T10:56:48.642367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400772324831968:4696]
2025-10-15T10:56:48.642400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:48.642433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:48.642446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:48.642464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:48.642466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:48.642610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:48.642624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:48.642723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400772324831968:4696]
2025-10-15T10:56:48.642747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:48.642763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:48.645708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 316
2025-10-15T10:56:48.645836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 316, pipe: [1:7561400769525127738:4933]
2025-10-15T10:56:48.645960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 316
2025-10-15T10:56:48.649296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 317 partition: 0 MaxSeqNo: 46 sessionId: src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0
2025-10-15T10:56:48.646403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:48.646450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:48.646531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:48.646558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:48.646587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:48.646596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:48.646630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:48.646670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:48.646710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:48.648834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:48.648859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:48.648954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:48.651101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51f914b-1c6d7ea7-ac702c7-3854b7de_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:48.684131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0] Write session: try to update token
2025-10-15T10:56:48.684189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:48.745454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:48.745495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:48.745508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:48.745519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:48.745564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400772324831968:4696]
2025-10-15T10:56:48.745599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400772324831968:4696]
2025-10-15T10:56:48.745624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400772324831968:4696]
2025-10-15T10:56:48.745756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:48.745823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:48.745840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:48.745853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:48.745863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:48.745864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:48.745917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:48.745938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:48.750615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:48.775234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId: src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:48.798739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1015 10:56:48.832378138  821271 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:56:48.833657Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:56:48.893868Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:48.923931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:48.923981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:48.924069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:48.924085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:48.924126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400772324831968:4696]
2025-10-15T10:56:48.924367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:48.924594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:48.924672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400769525127738:4933]
2025-10-15T10:56:48.924743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:48.924770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:48.924790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:48.933358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 317 reason: error at write: Disconnected sessionId: src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0
2025-10-15T10:56:48.933707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 317 sessionId: src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0 is DEAD
2025-10-15T10:56:48.934067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:48.934123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0] Write session will restart in 0.008975s
2025-10-15T10:56:48.934286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0] Write session: Do CDS request
2025-10-15T10:56:48.934334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:48.952157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:48.952069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:48.952113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 318
2025-10-15T10:56:48.952725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:48.952883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:48.952904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:48.952913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:48.954330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 318 sessionId:  describe result for acl check
2025-10-15T10:56:48.954457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:48.954476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:48.954486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:48.954501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400769525127797:5108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:48.956855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400769525127797:5108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:48.967244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400769525127797:5108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:48.974837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400769525127797:5108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:48.974881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400769525127797:5108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:48.974898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400769525127797:5108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:48.974929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:48.978070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:48.982101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:48.982907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:48.982941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:48.982980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:48.983231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:48.983445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400772324832145:4706]
2025-10-15T10:56:48.985638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:48.986625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:48.986832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:48.988170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:48.988532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.988548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.988556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.988564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.988571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.988578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.988586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.988593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.988600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.988608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.988616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.988625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.988632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.988640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.988692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.988814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.988867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.988916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.988964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.989018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.989072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.989128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.989180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.989233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.989286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.989339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.989390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.989441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.989491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.989568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:48.989638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.989701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:48.989762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.989827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:48.989881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.989942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:48.989999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.990058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:48.990111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.990172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:48.990224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.990288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:48.990342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.990397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:48.990452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.990510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:48.990560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.990619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:48.990674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.990734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:48.990787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.990845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:48.990899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.990960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:48.991012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.991070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:48.991620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:49.008559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:49.017557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:49.017605Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:49.017624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:49.017646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:49.017671Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 317 [2:7561400772324832145:4706]
2025-10-15T10:56:49.017726Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:49.017793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:49.017814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:49.017828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:49.017841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:49.017894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:49.017930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:49.017954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:49.024890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400773820095218:4933]
2025-10-15T10:56:49.042844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.042876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.042886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.042897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:49.043187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:49.043213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.043344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.043538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.043762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:49.043789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 317, pipe: [1:7561400773820095218:4933]
2025-10-15T10:56:49.043894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 317
2025-10-15T10:56:49.043918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 317
2025-10-15T10:56:49.043860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400769525127915:5108], now have 1 active actors on pipe
2025-10-15T10:56:49.043887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400773820095218:4933], now have 1 active actors on pipe
2025-10-15T10:56:49.043907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400769525127778:2467], now have 1 active actors on pipe
2025-10-15T10:56:49.043933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400772324832140:4706]
2025-10-15T10:56:49.043949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400772324832140:4706]
2025-10-15T10:56:49.043962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400772324832140:4706]
2025-10-15T10:56:49.043990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:49.044008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:49.044019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:49.044030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:49.044062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:49.044231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:49.044247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:49.044304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:49.044331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:49.044461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400772324832140:4706]
2025-10-15T10:56:49.044490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:49.044520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:49.044560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2de54e33-e861e31f-19dd35f5-afa99257_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:49.044603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:49.044624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:49.044635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:49.044673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:49.044723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:49.044848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:49.045356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:49.045381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:49.045447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:49.045701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 318 partition: 0 MaxSeqNo: 46 sessionId: src_id|2de54e33-e861e31f-19dd35f5-afa99257_0
2025-10-15T10:56:49.046466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69360fb1-bdd44a8-fc0c49ea-318a8f39_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2de54e33-e861e31f-19dd35f5-afa99257_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:49.066361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2de54e33-e861e31f-19dd35f5-afa99257_0] Write session: try to update token
2025-10-15T10:56:49.066421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2de54e33-e861e31f-19dd35f5-afa99257_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:49.075573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:49.075611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:49.075653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400772324832140:4706]
2025-10-15T10:56:49.075788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:49.075795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:49.077783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:49.079454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:49.080870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:49.082216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:49.084141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:49.084599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:49.131542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId: src_id|2de54e33-e861e31f-19dd35f5-afa99257_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:49.156985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:49.157015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:49.157028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:49.157040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:49.157070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400772324832140:4706]
2025-10-15T10:56:49.157086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400772324832140:4706]
2025-10-15T10:56:49.157106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400772324832140:4706]
2025-10-15T10:56:49.157245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:49.157246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:49.157256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:49.157267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:49.157309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:49.157322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:49.157338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:49.157339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:49.158863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:49.164354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:49.300641Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:49.301848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:49.301880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:49.302438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:49.302768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:49.302933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400773820095218:4933]
2025-10-15T10:56:49.302964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:49.311939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 318 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2de54e33-e861e31f-19dd35f5-afa99257_0
2025-10-15T10:56:49.312310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 318 sessionId: src_id|2de54e33-e861e31f-19dd35f5-afa99257_0 is DEAD
2025-10-15T10:56:49.312762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de54e33-e861e31f-19dd35f5-afa99257_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:49.312829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de54e33-e861e31f-19dd35f5-afa99257_0] Write session will restart in 0.007823s
2025-10-15T10:56:49.313020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de54e33-e861e31f-19dd35f5-afa99257_0] Write session: Do CDS request
2025-10-15T10:56:49.313067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de54e33-e861e31f-19dd35f5-afa99257_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:49.326939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:49.326987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 319
2025-10-15T10:56:49.327162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2de54e33-e861e31f-19dd35f5-afa99257_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:49.327959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:49.328205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:49.328242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:49.328259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:49.330266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 319 sessionId:  describe result for acl check
2025-10-15T10:56:49.330450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:49.330475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:49.330486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:49.330511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400773820095247:5115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:49.333417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400773820095247:5115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:49.340874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400773820095247:5115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:49.349862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400773820095247:5115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:49.349908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400773820095247:5115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:49.349926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400773820095247:5115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:49.349960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:49.368045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:49.372425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:49.373335Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:49.373370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:49.373414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:49.373697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:49.373900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400776619799592:4709]
2025-10-15T10:56:49.376351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:49.377434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:49.377699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:49.379091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:49.379461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:49.379470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:49.379479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:49.379487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:49.379497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:49.379504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:49.379512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:49.379518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:49.379525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:49.379532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:49.379540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:49.379548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.379555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.379563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.379617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:49.379742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:49.379800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:49.379868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:49.379922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:49.379976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:49.380028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:49.380077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:49.380127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:49.380181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:49.380232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:49.380299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.380349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.380395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.380447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:49.380526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:49.380595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:49.380662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:49.380717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:49.380779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:49.380833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:49.380890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:49.380944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:49.381005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:49.381057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:49.381115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:49.381168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:49.381232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:49.381281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:49.381341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:49.381397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:49.381455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:49.381502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:49.381564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:49.381615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:49.381672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:49.381726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.381783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.381833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.381891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.381945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.382005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.382592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:49.402932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:49.403245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400773820095376:4933]
2025-10-15T10:56:49.421029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:49.421087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:49.421109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:49.421130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:49.421158Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 318 [2:7561400776619799592:4709]
2025-10-15T10:56:49.421216Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:49.421286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:49.421316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:49.421330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:49.421348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:49.421403Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:49.421437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:49.421460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:49.422554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.422581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.422596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.422607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:49.422890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:49.422926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.423072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.423213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 318
2025-10-15T10:56:49.423273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.423367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 318, pipe: [1:7561400773820095376:4933]
2025-10-15T10:56:49.423412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 318
2025-10-15T10:56:49.423537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:49.423641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400773820095232:2467], now have 1 active actors on pipe
2025-10-15T10:56:49.423672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400773820095376:4933], now have 1 active actors on pipe
2025-10-15T10:56:49.423696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400773820095346:5115], now have 1 active actors on pipe
2025-10-15T10:56:49.423762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:49.423788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:49.423841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400776619799587:4709]
2025-10-15T10:56:49.423855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400776619799587:4709]
2025-10-15T10:56:49.423870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400776619799587:4709]
2025-10-15T10:56:49.423905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:49.423941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:49.423955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:49.423966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:49.423979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:49.424162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:49.424200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:49.424273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46aa4e37-f7f202ea-58850146-948be27a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:49.424308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:49.424328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:49.424339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:49.424377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:49.424418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:49.424541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400776619799587:4709]
2025-10-15T10:56:49.424572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:49.424595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:49.424622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:49.425118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:49.425152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:49.425225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:49.425547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 319 partition: 0 MaxSeqNo: 46 sessionId: src_id|46aa4e37-f7f202ea-58850146-948be27a_0
2025-10-15T10:56:49.426454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de54e33-e861e31f-19dd35f5-afa99257_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|46aa4e37-f7f202ea-58850146-948be27a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:49.447580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa4e37-f7f202ea-58850146-948be27a_0] Write session: try to update token
2025-10-15T10:56:49.447657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa4e37-f7f202ea-58850146-948be27a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:49.456938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:49.456975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:49.457016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400776619799587:4709]
2025-10-15T10:56:49.457149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:49.457149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:49.463533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:49.464820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:49.466107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:49.467396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:49.469349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:49.469892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:49.514521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:49.514569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:49.514586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:49.514598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:49.514663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400776619799587:4709]
2025-10-15T10:56:49.514706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400776619799587:4709]
2025-10-15T10:56:49.514733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400776619799587:4709]
2025-10-15T10:56:49.514887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:49.514895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:49.514924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:49.514941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:49.514973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:49.516177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:49.529284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId: src_id|46aa4e37-f7f202ea-58850146-948be27a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:49.550528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:49.661246Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:49.662587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:49.662623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:49.663133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:49.663180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400773820095376:4933]
2025-10-15T10:56:49.663277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:49.663299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:49.663403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:49.672110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 319 reason: error at write: Disconnected sessionId: src_id|46aa4e37-f7f202ea-58850146-948be27a_0
2025-10-15T10:56:49.672445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 319 sessionId: src_id|46aa4e37-f7f202ea-58850146-948be27a_0 is DEAD
2025-10-15T10:56:49.672866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa4e37-f7f202ea-58850146-948be27a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:49.672916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa4e37-f7f202ea-58850146-948be27a_0] Write session will restart in 0.005416s
2025-10-15T10:56:49.673067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa4e37-f7f202ea-58850146-948be27a_0] Write session: Do CDS request
2025-10-15T10:56:49.673101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa4e37-f7f202ea-58850146-948be27a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:49.688689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa4e37-f7f202ea-58850146-948be27a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:49.688486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:49.688521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 320
2025-10-15T10:56:49.689202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:49.689340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:49.689373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:49.689386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:49.690603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 320 sessionId:  describe result for acl check
2025-10-15T10:56:49.690728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:49.690749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:49.690759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:49.690783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400773820095402:5119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:49.694725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400773820095402:5119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:49.705865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400773820095402:5119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:49.716580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400773820095402:5119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:49.716622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400773820095402:5119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:49.716639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400773820095402:5119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:49.716669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:49.722595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:49.724361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:49.725084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:49.725111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:49.725157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:49.725384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:49.725585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400776619799751:4712]
2025-10-15T10:56:49.727411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:49.728544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:49.728783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:49.730091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:49.730432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:49.730448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:49.730456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:49.730464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:49.730472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:49.730479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:49.730485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:49.730493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:49.730500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:49.730507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:49.730516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:49.730523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.730530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.730538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.730589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:49.730704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:49.730755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:49.730802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:49.730856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:49.730912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:49.730968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:49.731020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:49.731071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:49.731124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:49.731177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:49.731228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.731278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.731334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.731602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:49.731682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:49.731749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:49.731823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:49.731880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:49.731937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:49.731990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:49.732055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:49.732106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:49.732162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:49.732209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:49.732262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:49.732312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:49.732369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:49.732426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:49.732478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:49.732527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:49.732581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:49.732628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:49.732683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:49.732731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:49.732783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:49.732829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.732886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.732934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.732992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.733037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.733089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.733609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:49.750726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:49.761847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:49.761916Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:49.761938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:49.761960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:49.761988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 319 [2:7561400776619799751:4712]
2025-10-15T10:56:49.762048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:49.762116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:49.762150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:49.762164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:49.762176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:49.762233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:49.762260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:49.762284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:49.764730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400773820095537:4933]
2025-10-15T10:56:49.765857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.765890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.765904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.765915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:49.766247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:49.766280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:49.766358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 319
2025-10-15T10:56:49.766453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 319
2025-10-15T10:56:49.766432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:49.766511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 319, pipe: [1:7561400773820095537:4933]
2025-10-15T10:56:49.766636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:49.766931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:49.767046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400773820095525:5119], now have 1 active actors on pipe
2025-10-15T10:56:49.767081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400773820095384:2467], now have 1 active actors on pipe
2025-10-15T10:56:49.767102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400773820095537:4933], now have 1 active actors on pipe
2025-10-15T10:56:49.767159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:49.767189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:49.767247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400776619799746:4712]
2025-10-15T10:56:49.767268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400776619799746:4712]
2025-10-15T10:56:49.767284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400776619799746:4712]
2025-10-15T10:56:49.767329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:49.767380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:49.767406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:49.767420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:49.767435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:49.767621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:49.767648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:49.767713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:49.767743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:49.767762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:49.767772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:49.767808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:49.767866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:49.768022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400776619799746:4712]
2025-10-15T10:56:49.768057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:49.768092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:49.768112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:49.768625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:49.768651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:49.768735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:49.769033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 320 partition: 0 MaxSeqNo: 46 sessionId: src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0
2025-10-15T10:56:49.771520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46aa4e37-f7f202ea-58850146-948be27a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:49.799020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0] Write session: try to update token
2025-10-15T10:56:49.799079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:49.835941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:49.835974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:49.836011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400776619799746:4712]
2025-10-15T10:56:49.836137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:49.836144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:49.838768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:49.840849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:49.842792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:49.844873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:49.848020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:49.851093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:49.878165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId: src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:49.903008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:49.903039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:49.903051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:49.903128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:49.903144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:49.903157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:49.903168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:49.903210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400776619799746:4712]
2025-10-15T10:56:49.903235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400776619799746:4712]
2025-10-15T10:56:49.903261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400776619799746:4712]
2025-10-15T10:56:49.903423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:49.903469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:49.903470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:49.903491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:49.903497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:49.904764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:49.913150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:50.048437Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:50.051780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:50.051836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:50.052533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:50.053408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:56:50.079842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 320 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0
2025-10-15T10:56:50.080227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 320 sessionId: src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0 is DEAD
2025-10-15T10:56:50.080779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:56:50.080832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0] Write session will restart in 0.008277s
2025-10-15T10:56:50.080945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0] Write session: Do CDS request
2025-10-15T10:56:50.080995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:50.095044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:50.096694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:50.096868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400773820095537:4933]
2025-10-15T10:56:50.097068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:50.097088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 321
2025-10-15T10:56:50.097416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:50.097531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:50.097547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:50.097553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:50.098532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 321 sessionId:  describe result for acl check
2025-10-15T10:56:50.098633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:50.098650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:50.098659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:50.098676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400778115062897:5130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:50.100990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400778115062897:5130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:50.109731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400778115062897:5130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:50.118353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400778115062897:5130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:50.118396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400778115062897:5130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:50.118413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400778115062897:5130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:50.118442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:50.124449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:50.126400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:50.127157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:50.127189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:50.127230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:50.127514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:50.127699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400780914767235:4720]
2025-10-15T10:56:50.129839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:50.130784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:50.130996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:50.132240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:50.132579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.132598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.132605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.132613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.132619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.132626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.132632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.132639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.132644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.132650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.132657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.132664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.132670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.132678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.132723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.132828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.132872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.132914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.132954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.133009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.133062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.133104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.133151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.133202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.133246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.133297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.133343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.133386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.133429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.133499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.133562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.133619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.133668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.133720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.133768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.133824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.133874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.133926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.133972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.134027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.134074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.134164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.134215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.134269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.134318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.134371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.134415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.134468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.134511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.134564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.134612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.134660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.134705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.134755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.134801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.134852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.135367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:50.160472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:50.169023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:50.169064Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:50.169076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:50.169092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:50.169112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 320 [2:7561400780914767235:4720]
2025-10-15T10:56:50.169153Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:50.169207Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:50.169219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:50.169230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:50.169241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:50.169286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:50.169304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:50.169321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:50.170169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.170195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.170212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.170224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:50.170511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:50.170536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.170686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.170817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 320
2025-10-15T10:56:50.170819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 320
2025-10-15T10:56:50.170893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.171121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:50.171208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400778115063032:5130], now have 1 active actors on pipe
2025-10-15T10:56:50.171236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400778115062893:2467], now have 1 active actors on pipe
2025-10-15T10:56:50.171303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:50.171329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:50.171388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400780914767230:4720]
2025-10-15T10:56:50.171406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400780914767230:4720]
2025-10-15T10:56:50.171420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400780914767230:4720]
2025-10-15T10:56:50.171461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:50.171497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:50.171519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:50.171530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:50.171536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:50.171722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:50.171744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:50.171814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:50.171856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:50.171874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:50.171886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:50.171925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:50.171968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:50.172093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400780914767230:4720]
2025-10-15T10:56:50.172124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:50.172158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:50.172168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:50.172622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:50.172645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:50.172710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:50.172996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 321 partition: 0 MaxSeqNo: 46 sessionId: src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0
2025-10-15T10:56:50.173773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dc9820-8b5f743b-d2725430-607cd93f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:50.193332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0] Write session: try to update token
2025-10-15T10:56:50.193389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:50.197348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400778115063046:4933]
2025-10-15T10:56:50.198072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 320, pipe: [1:7561400778115063046:4933]
2025-10-15T10:56:50.201535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:50.201571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:50.201615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400780914767230:4720]
2025-10-15T10:56:50.201728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:50.201744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400778115063046:4933], now have 1 active actors on pipe
2025-10-15T10:56:50.201789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:50.203870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:50.205295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:50.206616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:50.207942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:50.209835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:50.210317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:50.278911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId: src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:50.276659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:50.276697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:50.276712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:50.276722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:50.276765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400780914767230:4720]
2025-10-15T10:56:50.276792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400780914767230:4720]
2025-10-15T10:56:50.276816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400780914767230:4720]
2025-10-15T10:56:50.276950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:50.276991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:50.276997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:50.277005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:50.277018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:50.277022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:50.277063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:50.277083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:50.278947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:50.300244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:50.423281Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:50.424786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:50.424830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:50.425374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:50.425393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:50.425408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:50.425589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400778115063046:4933]
2025-10-15T10:56:50.425583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:50.437256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 321 reason: error at write: Disconnected sessionId: src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0
2025-10-15T10:56:50.437539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 321 sessionId: src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0 is DEAD
2025-10-15T10:56:50.437924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:50.437975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0] Write session will restart in 0.006835s
2025-10-15T10:56:50.438114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0] Write session: Do CDS request
2025-10-15T10:56:50.438158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:50.449187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:50.449169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:50.449203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 322
2025-10-15T10:56:50.449697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:50.449831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:50.449852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:50.449860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:50.451190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 322 sessionId:  describe result for acl check
2025-10-15T10:56:50.451300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:50.451322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:50.451332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:50.451363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400778115063076:5138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:50.454187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400778115063076:5138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:50.464017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400778115063076:5138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:50.474382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400778115063076:5138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:50.474428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400778115063076:5138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:50.474446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400778115063076:5138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:50.474477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:50.481163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:50.483035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:50.483803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:50.483841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:50.483883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:50.484113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:50.484301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400780914767389:4730]
2025-10-15T10:56:50.486142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:50.487083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:50.487298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:50.488590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:50.488912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.488929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.488936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.488943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.488950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.488956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.488962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.488968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.488974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.488981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.488987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.488994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.489000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.489004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.489036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.489128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.489175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.489215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.489250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.489287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.489320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.489357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.489416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.489450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.489494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.489537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.489580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.489623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.489675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.489736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.489795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.489847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.489892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.489945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.489991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.490040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.490088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.490142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.490189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.490239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.490288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.490345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.490384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.490434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.490493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.490549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.490596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.490643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.490689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.490736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.490782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.490838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.490886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.490941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.490987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.491042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.491589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:50.513171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:50.523061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:50.523108Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:50.523123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:50.523141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:50.523164Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 321 [2:7561400780914767389:4730]
2025-10-15T10:56:50.523211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:50.523272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:50.523286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:50.523297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:50.523308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:50.523393Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:50.523414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:50.523432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:50.524546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.524572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.524584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.524595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:50.524834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:50.524858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.524982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.525152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.525125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 321
2025-10-15T10:56:50.525135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 321
2025-10-15T10:56:50.525367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:50.525440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400778115063199:5138], now have 1 active actors on pipe
2025-10-15T10:56:50.525466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400778115063050:2467], now have 1 active actors on pipe
2025-10-15T10:56:50.525504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:50.525529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:50.525573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400780914767384:4730]
2025-10-15T10:56:50.525593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400780914767384:4730]
2025-10-15T10:56:50.525603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400780914767384:4730]
2025-10-15T10:56:50.525636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:50.525666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:50.525688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:50.525699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:50.525700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:50.525859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:50.525879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:50.525933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:50.525963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:50.525982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:50.525990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:50.526022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:50.526022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400778115063206:4933]
2025-10-15T10:56:50.526056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:50.526178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400780914767384:4730]
2025-10-15T10:56:50.526206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:50.526233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:50.526245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:50.526339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400778115063206:4933], now have 1 active actors on pipe
2025-10-15T10:56:50.526589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 321, pipe: [1:7561400778115063206:4933]
2025-10-15T10:56:50.526844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:50.526894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:50.526987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:50.527289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 322 partition: 0 MaxSeqNo: 46 sessionId: src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0
2025-10-15T10:56:50.527993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7bdeab7-36aadaed-5a26b9f6-133602ad_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:50.549222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0] Write session: try to update token
2025-10-15T10:56:50.549275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:50.587985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:50.588013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:50.588045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400780914767384:4730]
2025-10-15T10:56:50.588150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:50.588212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:50.590418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:50.607040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:50.609456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:50.613710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:50.615359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:50.628143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId: src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:50.640416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:50.640542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:50.640555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:50.640561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:50.640598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:50.640607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:50.640615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:50.640622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:50.640646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400780914767384:4730]
2025-10-15T10:56:50.640662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400780914767384:4730]
2025-10-15T10:56:50.640676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400780914767384:4730]
2025-10-15T10:56:50.640770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:50.640789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:50.640799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:50.640839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:50.640884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:50.641647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:50.652429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:50.774052Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:50.775403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:50.775442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:50.775892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:50.775909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:50.775923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:50.776093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400778115063206:4933]
2025-10-15T10:56:50.776232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:50.793764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 322 reason: error at write: Disconnected sessionId: src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0
2025-10-15T10:56:50.794082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 322 sessionId: src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0 is DEAD
2025-10-15T10:56:50.794398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:50.794440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0] Write session will restart in 0.007415s
2025-10-15T10:56:50.794573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0] Write session: Do CDS request
2025-10-15T10:56:50.794612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:50.806222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:50.806278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 323
2025-10-15T10:56:50.806316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:50.806939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:50.807119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:50.807157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:50.807174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:50.809015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 323 sessionId:  describe result for acl check
2025-10-15T10:56:50.809165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:50.809192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:50.809208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:50.809231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400778115063241:5142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:50.811498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400778115063241:5142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:50.818209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400778115063241:5142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:50.824749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400778115063241:5142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:50.824788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400778115063241:5142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:50.824803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400778115063241:5142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:50.824830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:50.830130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:50.831937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:50.832752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:50.832784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:50.832826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:50.833078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:50.833270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400780914767551:4733]
2025-10-15T10:56:50.835414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:50.836289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:50.836510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:50.837562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:50.837836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.837848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.837854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.837860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.837865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.837870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.837876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.837882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.837887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.837893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.837899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.837904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.837910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.837915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.837957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.838051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.838093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.838133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.838171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.838211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.838249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.838294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.838332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.838383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.838425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.838469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.838512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.838550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.838587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.838642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:50.838696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.838747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:50.838792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.838839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:50.838869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.838900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:50.838932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.839000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:50.839059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.839113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:50.839163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.839211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:50.839257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.839304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:50.839363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.839421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:50.839468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.839507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:50.839551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.839603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:50.839651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.839704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.839753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.839806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.839861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.839912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.840348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:50.854755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:50.863740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:50.863785Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:50.863804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:50.863824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:50.863858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 322 [2:7561400780914767551:4733]
2025-10-15T10:56:50.863912Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:50.863970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:50.863994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:50.864006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:50.864016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:50.864062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:50.864092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:50.864114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:50.865193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.865209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.865217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.865224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:50.865415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:50.865448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:50.865577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:50.865672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 322
2025-10-15T10:56:50.865695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 322
2025-10-15T10:56:50.865754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:50.865930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:50.865982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400778115063360:5142], now have 1 active actors on pipe
2025-10-15T10:56:50.866001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400778115063216:2467], now have 1 active actors on pipe
2025-10-15T10:56:50.866031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:50.866046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:50.866083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400780914767546:4733]
2025-10-15T10:56:50.866102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400780914767546:4733]
2025-10-15T10:56:50.866114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400780914767546:4733]
2025-10-15T10:56:50.866146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:50.866187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:50.866185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:50.866200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:50.866212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:50.866305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:50.866317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:50.866361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:50.866384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:50.866397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:50.866406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:50.866436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:50.866466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:50.866576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400780914767546:4733]
2025-10-15T10:56:50.866605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:50.866631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:50.866640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:50.867056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:50.867081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:50.867150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:50.867450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 323 partition: 0 MaxSeqNo: 46 sessionId: src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0
2025-10-15T10:56:50.868129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|deb7e1c-d0a83f4d-87c19d55-9f0e90d2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:50.876248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400778115063372:4933]
2025-10-15T10:56:50.876734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400778115063372:4933], now have 1 active actors on pipe
2025-10-15T10:56:50.876808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 322, pipe: [1:7561400778115063372:4933]
2025-10-15T10:56:50.887826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0] Write session: try to update token
2025-10-15T10:56:50.887889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:50.895033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:50.895064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:50.895101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400780914767546:4733]
2025-10-15T10:56:50.895217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:50.895217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:50.897616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:50.900353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:50.902123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:50.903494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:50.905391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:50.905868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:50.964007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId: src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:50.982727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:50.982757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:50.982769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:50.982821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:50.982835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:50.982847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:50.982858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:50.982894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400780914767546:4733]
2025-10-15T10:56:50.982918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400780914767546:4733]
2025-10-15T10:56:50.982942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400780914767546:4733]
2025-10-15T10:56:50.983072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:50.983064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:50.983101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:50.983103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:50.983125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:50.984166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:50.990399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:51.122224Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:51.123861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:51.123896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:51.124393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:51.124425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:51.124615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:51.127471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:51.127740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400778115063372:4933]
2025-10-15T10:56:51.161537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:51.161583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0] Write session will restart in 0.009568s
2025-10-15T10:56:51.161689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0] Write session: Do CDS request
2025-10-15T10:56:51.161729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:51.160874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 323 reason: error at write: Disconnected sessionId: src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0
2025-10-15T10:56:51.161204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 323 sessionId: src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0 is DEAD
2025-10-15T10:56:51.175290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:51.177569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:51.181061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:51.181095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 324
2025-10-15T10:56:51.181378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:51.181468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:51.181488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:51.181496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:51.182434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 324 sessionId:  describe result for acl check
2025-10-15T10:56:51.182524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:51.182539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:51.182548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:51.182562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400782410030819:5153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:51.182590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:51.183290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:51.183313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:51.183344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:51.183576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:51.183738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400785209735012:4737]
2025-10-15T10:56:51.184305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400782410030819:5153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:51.185371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:51.186439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:51.186631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:51.188003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:51.188322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.188337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.188340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.188344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.188348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.188352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.188355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.188359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.188363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.188366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.188371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.188374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.188378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.188382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.188409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.188476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.188503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.188531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.188558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.188586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.188612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.188637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.188662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.188689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.188715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.188741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.188767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.188810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.188783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400782410030819:5153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:51.188839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.188891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.188938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.188972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.188999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.189033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.189062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.189104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.189146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.189192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.189233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.189281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.189327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.189365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.189395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.189430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.189459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.189493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.189522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.189557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.189589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.189625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.189654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.189689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.189718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.189754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.189788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.189827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.190153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:51.199874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400782410030819:5153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:51.199920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400782410030819:5153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:51.199936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400782410030819:5153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:51.199964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:51.205209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:51.215214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:51.215248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:51.215261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:51.215275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:51.215296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 323 [2:7561400785209735012:4737]
2025-10-15T10:56:51.215336Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:51.215393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:51.215405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:51.215416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:51.215427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:51.215464Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:51.215486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:51.215503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:51.217216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.217237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.217248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.217258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:51.217498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:51.217521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.217642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.217749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 323
2025-10-15T10:56:51.217814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.217858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 323
2025-10-15T10:56:51.218026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:51.218099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400782410030695:2467], now have 1 active actors on pipe
2025-10-15T10:56:51.218124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400782410030851:5153], now have 1 active actors on pipe
2025-10-15T10:56:51.218174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:51.218195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:51.218225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400785209735007:4737]
2025-10-15T10:56:51.218243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400785209735007:4737]
2025-10-15T10:56:51.218254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400785209735007:4737]
2025-10-15T10:56:51.218283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:51.218317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:51.218336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:51.218344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:51.218347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:51.218488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:51.218508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:51.218560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:51.218592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:51.218607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:51.218616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:51.218643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:51.218673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:51.218771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400785209735007:4737]
2025-10-15T10:56:51.218797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:51.218818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:51.218833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:51.219181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:51.219205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:51.219265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:51.219540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 324 partition: 0 MaxSeqNo: 46 sessionId: src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0
2025-10-15T10:56:51.220296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d95aec-5530d250-31ddbf01-ff8c6dc3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:51.227479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400782410030857:4933]
2025-10-15T10:56:51.228008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400782410030857:4933], now have 1 active actors on pipe
2025-10-15T10:56:51.228248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 323, pipe: [1:7561400782410030857:4933]
2025-10-15T10:56:51.240639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0] Write session: try to update token
2025-10-15T10:56:51.240684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:51.254174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:51.254206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:51.254236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400785209735007:4737]
2025-10-15T10:56:51.254339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:51.254347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:51.256422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:51.257912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:51.259169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:51.260538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:51.262337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:51.262809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:51.297795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:51.297824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:51.297834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:51.297841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:51.297873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400785209735007:4737]
2025-10-15T10:56:51.297895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400785209735007:4737]
2025-10-15T10:56:51.297914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400785209735007:4737]
2025-10-15T10:56:51.298026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:51.298057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:51.298058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:51.298076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:51.298081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:51.301447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:51.322272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId: src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:51.348531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:51.444843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:51.447230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:51.447268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:51.447781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400782410030857:4933]
2025-10-15T10:56:51.447892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:51.447907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:51.447942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:51.459131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:51.459263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 324 reason: error at write: Disconnected sessionId: src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0
2025-10-15T10:56:51.459575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 324 sessionId: src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0 is DEAD
2025-10-15T10:56:51.460050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:51.460134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0] Write session will restart in 0.005923s
2025-10-15T10:56:51.460316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0] Write session: Do CDS request
2025-10-15T10:56:51.460378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:51.471747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:51.486448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:51.486479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 325
2025-10-15T10:56:51.486848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:51.486952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:51.486971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:51.486980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:51.488077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 325 sessionId:  describe result for acl check
2025-10-15T10:56:51.488197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:51.488207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:51.488217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:51.488233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400782410030879:5158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:51.490277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400782410030879:5158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:51.497300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400782410030879:5158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:51.506147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400782410030879:5158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:51.506187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400782410030879:5158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:51.506201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400782410030879:5158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:51.506227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:51.516506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:51.518067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:51.518759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:51.518791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:51.518831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:51.519049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:51.519240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400785209735204:4744]
2025-10-15T10:56:51.521291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:51.522063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:51.522234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:51.523298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:51.523620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.523635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.523642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.523648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.523653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.523659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.523665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.523671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.523678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.523684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.523690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.523696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.523704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.523711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.523750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.523864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.523907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.523948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.523994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.524035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.524076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.524120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.524166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.524211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.524255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.524300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.524345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.524405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.524449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.524513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.524569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.524625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.524672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.524723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.524768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.524821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.524869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.524921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.524970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.525018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.525065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.525116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.525159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.525212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.525262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.525314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.525360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.525414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.525463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.525523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.525571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.525624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.525669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.525719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.525762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.525812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.526266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:51.548025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400782410031025:4933]
2025-10-15T10:56:51.559681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:51.570427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:51.570494Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:51.570528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:51.570556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:51.570579Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 324 [2:7561400785209735204:4744]
2025-10-15T10:56:51.570628Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:51.570695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:51.570714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:51.570727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:51.570736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:51.570780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:51.570804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:51.570823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:51.572425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.572453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.572466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.572477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:51.572752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:51.572777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.572959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.573254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.573252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 324
2025-10-15T10:56:51.573336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 324
2025-10-15T10:56:51.573345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 324, pipe: [1:7561400782410031025:4933]
2025-10-15T10:56:51.573486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:51.573571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400782410031015:5158], now have 1 active actors on pipe
2025-10-15T10:56:51.573599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400782410030866:2467], now have 1 active actors on pipe
2025-10-15T10:56:51.573620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400782410031025:4933], now have 1 active actors on pipe
2025-10-15T10:56:51.573685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:51.573709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:51.573741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400785209735195:4744]
2025-10-15T10:56:51.573759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400785209735195:4744]
2025-10-15T10:56:51.573773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400785209735195:4744]
2025-10-15T10:56:51.573807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:51.573825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:51.573834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:51.573840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:51.573879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:51.574043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:51.574067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:51.574129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:51.574160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:51.574181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:51.574192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:51.574223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:51.574262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:51.574375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400785209735195:4744]
2025-10-15T10:56:51.574405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:51.574450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:51.574453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:51.574882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:51.574906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:51.574974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:51.575313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 325 partition: 0 MaxSeqNo: 46 sessionId: src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0
2025-10-15T10:56:51.576103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b1e503-b6a0d819-90d9ff69-7175efb4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:51.597463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0] Write session: try to update token
2025-10-15T10:56:51.597526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:51.628200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:51.628228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:51.628257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400785209735195:4744]
2025-10-15T10:56:51.628366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:51.628445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:51.631114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:51.633077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:51.634812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:51.657114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:51.658743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:51.673237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId: src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:51.686488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:51.686616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:51.686628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:51.686635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:51.686690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:51.686705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:51.686714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:51.686721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:51.686744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400785209735195:4744]
2025-10-15T10:56:51.686760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400785209735195:4744]
2025-10-15T10:56:51.686773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400785209735195:4744]
2025-10-15T10:56:51.686880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:51.686893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:51.686916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:51.686924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:51.686964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:51.687766Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:51.697965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:51.823084Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:51.824549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:51.824587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:51.825266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:51.825363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:51.825371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:51.825389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:51.825591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400782410031025:4933]
2025-10-15T10:56:51.879411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:51.883805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:51.884516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:51.884547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:51.884581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:51.884793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:51.884949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400785209735359:4754]
2025-10-15T10:56:51.886792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:51.887725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:51.887911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:51.889719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:51.890347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.890380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.890397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.890413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.890428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.890444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.890457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.890476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.890488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.890504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.890517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.890537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.890551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.890563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.890663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.890881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.890971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.891068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.891189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.891313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.891449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.891550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.891671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.891792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.891943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.892028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.892123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.892168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.892213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.892275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:51.892332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.892383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:51.892429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.892229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 325 reason: error at write: Disconnected sessionId: src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0
2025-10-15T10:56:51.892457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 325 sessionId: src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0 is DEAD
2025-10-15T10:56:51.892479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:51.892524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.892574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:51.892639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.892734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:51.892764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:51.892845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0] Write session will restart in 0.008950s
2025-10-15T10:56:51.892826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.892925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:51.892997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0] Write session: Do CDS request
2025-10-15T10:56:51.893035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:51.893022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.893114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:51.893197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.893287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:51.893381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.893494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:51.893583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.893677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:51.893760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.893839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:51.893925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.894021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.894128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.894254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.894367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.894512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.895613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:51.907159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:51.907193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 326
2025-10-15T10:56:51.907456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:51.907891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:51.908006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:51.908021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:51.908027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:51.908944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 326 sessionId:  describe result for acl check
2025-10-15T10:56:51.909040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:51.909056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:51.909066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:51.909081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400782410031158:5165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:51.910965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400782410031158:5165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:51.916948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:51.917783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400782410031158:5165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:51.924833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400782410031158:5165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:51.924876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400782410031158:5165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:51.924892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400782410031158:5165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:51.924924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:51.925815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400782410031190:4933]
2025-10-15T10:56:51.926953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:51.926990Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:51.927004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:51.927020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:51.927040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 325 [2:7561400785209735359:4754]
2025-10-15T10:56:51.927082Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:51.927130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:51.927141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:51.927150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:51.927159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:51.927199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:51.927217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:51.927235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:51.929144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.929166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.929178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.929703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 325, pipe: [1:7561400782410031190:4933]
2025-10-15T10:56:51.929707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 325
2025-10-15T10:56:51.929802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 325
2025-10-15T10:56:51.931563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 326 partition: 0 MaxSeqNo: 46 sessionId: src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0
2025-10-15T10:56:51.932203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4273a4be-d8222b26-8a21a5c4-410094e8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:51.929188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:51.929431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:51.929448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:51.929588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:51.929768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:51.929977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:51.930048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400782410031035:2467], now have 1 active actors on pipe
2025-10-15T10:56:51.930068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400782410031190:4933], now have 1 active actors on pipe
2025-10-15T10:56:51.930086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400782410031189:5165], now have 1 active actors on pipe
2025-10-15T10:56:51.930148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:51.930167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:51.930198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400785209735354:4754]
2025-10-15T10:56:51.930210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400785209735354:4754]
2025-10-15T10:56:51.930221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400785209735354:4754]
2025-10-15T10:56:51.930255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:51.930302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:51.930316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:51.930324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:51.930327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:51.930474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:51.930488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:51.930548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:51.930574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:51.930589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:51.930597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:51.930626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:51.930657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:51.930766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400785209735354:4754]
2025-10-15T10:56:51.930794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:51.930824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:51.930835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:51.931245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:51.931261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:51.931312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:51.953095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0] Write session: try to update token
2025-10-15T10:56:51.953134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:51.958997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:51.959033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:51.959068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400785209735354:4754]
2025-10-15T10:56:51.959178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:51.959182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:51.961025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:51.962307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:51.963689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:51.964964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:51.966795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:51.967259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:52.024026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:52.024055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:52.024067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:52.024077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:52.024110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400785209735354:4754]
2025-10-15T10:56:52.024132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400785209735354:4754]
2025-10-15T10:56:52.024154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400785209735354:4754]
2025-10-15T10:56:52.024267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:52.024276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:52.024296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:52.024312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:52.024355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:52.025269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:52.043567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId: src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:52.065668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:52.166949Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:52.168418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:52.168452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:52.169043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400782410031190:4933]
2025-10-15T10:56:52.169072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:52.169081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:52.169104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:52.169203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:52.192471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 326 reason: error at write: Disconnected sessionId: src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0
2025-10-15T10:56:52.192759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 326 sessionId: src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0 is DEAD
2025-10-15T10:56:52.193113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:52.193166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0] Write session will restart in 0.006240s
2025-10-15T10:56:52.193340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0] Write session: Do CDS request
2025-10-15T10:56:52.193386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:52.202999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:52.203031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 327
2025-10-15T10:56:52.203185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:52.203786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:52.203903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:52.203922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:52.203929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:52.205236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 327 sessionId:  describe result for acl check
2025-10-15T10:56:52.205342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:52.205360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:52.205367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:52.205382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400786704998533:5170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:52.208284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400786704998533:5170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:52.219053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400786704998533:5170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:52.226449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400786704998533:5170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:52.226494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400786704998533:5170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:52.226511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400786704998533:5170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:52.226541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:52.234391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:52.236152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:52.236933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:52.236960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:52.236999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:52.237227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:52.237411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400789504702810:4756]
2025-10-15T10:56:52.239659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:52.240543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:52.240732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:52.241948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:52.242270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.242286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.242293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.242300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.242308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.242315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.242322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.242330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.242336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.242344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.242350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.242357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.242365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.242372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.242419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.242547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.242595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.242645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.242697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.242755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.242804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.242853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.242904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.242962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.243016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.243069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.243121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.243176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.243224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.243297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.243381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.243443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.243502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.243564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.243616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.243677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.243731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.243790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.243839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.243909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.243962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.244026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.244077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.244132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.244183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.244242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.244296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.244350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.244400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.244459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.244509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.244567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.244620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.244678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.244729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.244787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.245352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:52.260802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:52.269437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400786704998664:4933]
2025-10-15T10:56:52.281299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:52.281353Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:52.281371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:52.281389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:52.281429Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 326 [2:7561400789504702810:4756]
2025-10-15T10:56:52.281482Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:52.281547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:52.281560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:52.281573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:52.281584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:52.281634Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:52.281658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:52.281681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:52.282692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.282716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.282728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.282740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:52.283022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:52.283051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.283190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.283270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 326, pipe: [1:7561400786704998664:4933]
2025-10-15T10:56:52.283386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 326
2025-10-15T10:56:52.283387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.283417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 326
2025-10-15T10:56:52.283624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:52.283719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400786704998664:4933], now have 1 active actors on pipe
2025-10-15T10:56:52.283747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400786704998654:5170], now have 1 active actors on pipe
2025-10-15T10:56:52.283770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400786704998510:2467], now have 1 active actors on pipe
2025-10-15T10:56:52.283829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:52.283870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:52.283928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400789504702805:4756]
2025-10-15T10:56:52.283942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400789504702805:4756]
2025-10-15T10:56:52.283954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400789504702805:4756]
2025-10-15T10:56:52.283994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:52.284030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:52.284047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:52.284067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:52.284068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:52.284247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:52.284263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:52.284330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32cdb636-e6994ef3-66d898c8-9226849c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:52.284374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:52.284394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:52.284405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:52.284442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:52.284483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:52.284620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400789504702805:4756]
2025-10-15T10:56:52.284652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:52.284680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:52.284697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:52.285121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:52.285149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:52.285212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:52.285484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 327 partition: 0 MaxSeqNo: 46 sessionId: src_id|32cdb636-e6994ef3-66d898c8-9226849c_0
2025-10-15T10:56:52.286288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e6835a6-8682a9-4ea59d56-c2ede449_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|32cdb636-e6994ef3-66d898c8-9226849c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:52.304981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32cdb636-e6994ef3-66d898c8-9226849c_0] Write session: try to update token
2025-10-15T10:56:52.305020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32cdb636-e6994ef3-66d898c8-9226849c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:52.314622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:52.314658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:52.314702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400789504702805:4756]
2025-10-15T10:56:52.314804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:52.314833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:52.317044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:52.318242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:52.319438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:52.320920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:52.322800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:52.323333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:52.363524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:52.363560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:52.363574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:52.363586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:52.363626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400789504702805:4756]
2025-10-15T10:56:52.363662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400789504702805:4756]
2025-10-15T10:56:52.363689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400789504702805:4756]
2025-10-15T10:56:52.363815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:52.363847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:52.363866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:52.363874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:52.363894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:52.366180Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:52.394083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId: src_id|32cdb636-e6994ef3-66d898c8-9226849c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:52.415022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:52.510195Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:52.511334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:52.511373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:52.511964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:52.511907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400786704998664:4933]
2025-10-15T10:56:52.511996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:52.512012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:52.512022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:52.522481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 327 reason: error at write: Disconnected sessionId: src_id|32cdb636-e6994ef3-66d898c8-9226849c_0
2025-10-15T10:56:52.522791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 327 sessionId: src_id|32cdb636-e6994ef3-66d898c8-9226849c_0 is DEAD
2025-10-15T10:56:52.523078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cdb636-e6994ef3-66d898c8-9226849c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:52.523127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cdb636-e6994ef3-66d898c8-9226849c_0] Write session will restart in 0.009109s
2025-10-15T10:56:52.523217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cdb636-e6994ef3-66d898c8-9226849c_0] Write session: Do CDS request
2025-10-15T10:56:52.523260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cdb636-e6994ef3-66d898c8-9226849c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:52.536816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:52.536852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 328
2025-10-15T10:56:52.537153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32cdb636-e6994ef3-66d898c8-9226849c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:52.537684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:52.537780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:52.537795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:52.537803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:52.538992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 328 sessionId:  describe result for acl check
2025-10-15T10:56:52.539093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:52.539114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:52.539121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:52.539133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400786704998689:5177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:52.541048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400786704998689:5177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:52.548582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400786704998689:5177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:52.555435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400786704998689:5177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:52.555489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400786704998689:5177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:52.555516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400786704998689:5177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:52.555546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:52.593148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:52.597232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:52.598100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:52.598127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:52.598171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:52.598423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:52.598613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400789504702994:4759]
2025-10-15T10:56:52.600628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:52.601506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:52.601710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:52.602882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:52.603215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.603234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.603242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.603249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.603255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.603262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.603269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.603275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.603282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.603288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.603294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.603302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.603308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.603316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.603377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.603485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.603529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.603575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.603619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.603664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.603752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.603805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.603865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.603917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.603962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.604007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.604048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.604091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.604132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.604199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.604255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.604311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.604358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.604413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.604458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.604509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.604556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.604607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.604649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.604702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.604746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.604796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.604841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.604890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.604935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.604988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.605031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.605084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.605129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.605181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.605220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.605270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.605313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.605364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.605406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.605459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.605921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:52.611960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400786704998840:4933]
2025-10-15T10:56:52.622756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:52.632861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:52.632896Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:52.632907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:52.632921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:52.632938Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 327 [2:7561400789504702994:4759]
2025-10-15T10:56:52.632984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:52.633032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:52.633041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:52.633051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:52.633060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:52.633097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:52.633114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:52.633130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:52.634838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.634857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.634866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.634874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:52.635058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:52.635075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.635165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.635309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.635481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:52.635463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 327
2025-10-15T10:56:52.635540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400786704998672:2467], now have 1 active actors on pipe
2025-10-15T10:56:52.635566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400786704998840:4933], now have 1 active actors on pipe
2025-10-15T10:56:52.635561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 327, pipe: [1:7561400786704998840:4933]
2025-10-15T10:56:52.635581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400786704998728:5177], now have 1 active actors on pipe
2025-10-15T10:56:52.635598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400789504702989:4759]
2025-10-15T10:56:52.635606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400789504702989:4759]
2025-10-15T10:56:52.635616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400789504702989:4759]
2025-10-15T10:56:52.635646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:52.635650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 327
2025-10-15T10:56:52.635690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:52.635711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:52.635717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:52.635728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:52.635869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:52.635887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:52.636012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:52.636031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:52.636054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400789504702989:4759]
2025-10-15T10:56:52.636072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:52.636098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:52.636152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:52.636173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:52.636184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:52.636190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:52.636216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:52.636244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:52.636299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:52.636743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:52.636763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:52.636804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:52.637112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 328 partition: 0 MaxSeqNo: 46 sessionId: src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0
2025-10-15T10:56:52.637823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32cdb636-e6994ef3-66d898c8-9226849c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:52.658771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0] Write session: try to update token
2025-10-15T10:56:52.658824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:52.738631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:52.738672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:52.738687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:52.738700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:52.738731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400789504702989:4759]
2025-10-15T10:56:52.738771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400789504702989:4759]
2025-10-15T10:56:52.738795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400789504702989:4759]
2025-10-15T10:56:52.738948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:52.738995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:52.738996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:52.739010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:52.739021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:52.739027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:52.739060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:52.739081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:52.740143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:52.745685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId: src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:52.766506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:52.879889Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:52.898856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:52.898907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:52.898978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:52.898991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:52.899031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400789504702989:4759]
2025-10-15T10:56:52.899250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:52.899536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:52.899653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:52.899714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400786704998840:4933]
2025-10-15T10:56:52.899803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:52.899826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:52.910534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 328 reason: error at write: Disconnected sessionId: src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0
2025-10-15T10:56:52.910832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 328 sessionId: src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0 is DEAD
2025-10-15T10:56:52.911221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:52.911288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0] Write session will restart in 0.007122s
2025-10-15T10:56:52.911469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0] Write session: Do CDS request
2025-10-15T10:56:52.911508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:52.926403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:52.926446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 329
2025-10-15T10:56:52.926729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:52.927261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:52.927416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:52.927449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:52.927461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:52.928933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 329 sessionId:  describe result for acl check
2025-10-15T10:56:52.929057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:52.929082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:52.929096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:52.929115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400786704998866:5185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:52.932062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400786704998866:5185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:52.939431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400786704998866:5185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:52.949873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400786704998866:5185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:52.949918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400786704998866:5185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:52.949937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400786704998866:5185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:52.949977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:52.979036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:52.983595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:52.984293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:52.984315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:52.984343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:52.984538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:52.984659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400789504703163:4768]
2025-10-15T10:56:52.986648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:52.987655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:52.987870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:52.989048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:52.989377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.989392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.989398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.989405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.989412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.989420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.989426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.989433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.989439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.989444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.989451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.989458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.989464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.989470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.989506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.989589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.989627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.989666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.989698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.989730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.989759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.989812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.989845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.989886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.989928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.989968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.990031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.990075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.990119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.990182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:52.990233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.990286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:52.990331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.990383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:52.990425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.990475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:52.990513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.990567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:52.990609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.990658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:52.990703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.990759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:52.990803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.990854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:52.990902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.990954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:52.990998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.991066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:52.991114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.991163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:52.991205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.991256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:52.991298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.991338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:52.991381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.991424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:52.991749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:53.000057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400786704999018:4933]
2025-10-15T10:56:53.006358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:53.030309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:53.030357Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:53.030374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:53.030395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:53.030420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 328 [2:7561400789504703163:4768]
2025-10-15T10:56:53.030472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:53.030533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:53.030556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:53.030569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:53.030581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:53.030635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:53.030661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:53.030684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:53.031789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.031813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.031825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.031837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:53.032126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:53.032150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.032304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.032394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 328
2025-10-15T10:56:53.032399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 328
2025-10-15T10:56:53.032508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 328, pipe: [1:7561400786704999018:4933]
2025-10-15T10:56:53.032514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.032770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:53.032858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400786704998897:5185], now have 1 active actors on pipe
2025-10-15T10:56:53.032888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400786704998853:2467], now have 1 active actors on pipe
2025-10-15T10:56:53.032913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400786704999018:4933], now have 1 active actors on pipe
2025-10-15T10:56:53.032978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:53.033007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:53.033047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400789504703153:4768]
2025-10-15T10:56:53.033062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400789504703153:4768]
2025-10-15T10:56:53.033075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400789504703153:4768]
2025-10-15T10:56:53.033114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:53.033153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:53.033178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:53.033189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:53.033191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:53.033375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:53.033406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:53.033477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:53.033509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:53.033530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:53.033540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:53.033578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:53.033620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:53.033751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400789504703153:4768]
2025-10-15T10:56:53.033789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:53.033809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:53.033836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:53.034331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:53.034359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:53.034424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:53.034702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 329 partition: 0 MaxSeqNo: 46 sessionId: src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0
2025-10-15T10:56:53.035539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|666b63f0-a9ea3b21-977eff8c-5624a38_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:53.055925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0] Write session: try to update token
2025-10-15T10:56:53.055974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:53.063772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:53.063809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:53.063851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400789504703153:4768]
2025-10-15T10:56:53.064000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:53.064000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:53.066011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:53.067385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:53.068875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:53.070428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:53.072082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:53.072688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:53.132585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId: src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:53.139137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:53.139179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:53.139194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:53.139206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:53.139248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400789504703153:4768]
2025-10-15T10:56:53.139276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400789504703153:4768]
2025-10-15T10:56:53.139310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400789504703153:4768]
2025-10-15T10:56:53.139456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:53.139497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:53.139528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:53.139547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:53.139549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:53.139560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:53.139608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:53.139628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:53.140693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:53.155978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:53.284902Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:53.286336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:53.286377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:53.286947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400786704999018:4933]
2025-10-15T10:56:53.286959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:53.286987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:53.287020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:53.287110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:53.334853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:53.339907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:53.340661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:53.340689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:53.340724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:53.340940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:53.341116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400793799670633:4778]
2025-10-15T10:56:53.345222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:53.346667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:53.347110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:53.347761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 329 reason: error at write: Disconnected sessionId: src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0
2025-10-15T10:56:53.348126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 329 sessionId: src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0 is DEAD
2025-10-15T10:56:53.348546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:53.348607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0] Write session will restart in 0.007584s
2025-10-15T10:56:53.348723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0] Write session: Do CDS request
2025-10-15T10:56:53.348755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:53.348939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:53.349581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:53.349609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:53.349630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:53.349644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:53.349656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:53.349665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:53.349672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:53.349685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:53.349699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:53.349713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:53.349727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:53.349740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.349754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.349764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.349841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:53.350043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:53.350137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:53.350225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:53.350329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:53.350429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:53.350526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:53.350577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:53.350625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:53.350664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:53.350704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:53.350748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.350793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.350835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.350880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:53.350945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:53.350999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:53.351051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:53.351099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:53.351151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:53.351197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:53.351250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:53.351293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:53.351363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:53.351413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:53.351461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:53.351509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:53.351562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:53.351607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:53.351657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:53.351705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:53.351757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:53.351803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:53.351849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:53.351907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:53.351958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:53.352002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.352050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.352093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.352141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.352183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.352227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.352666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:53.360391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:53.360427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 330
2025-10-15T10:56:53.360578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:53.361137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:53.361295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:53.361326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:53.361337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:53.362522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 330 sessionId:  describe result for acl check
2025-10-15T10:56:53.362628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:53.362642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:53.362651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:53.362669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400790999966462:5194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:53.365964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400790999966462:5194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:53.372740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400790999966462:5194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:53.372959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:53.380757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400790999966462:5194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:53.380811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400790999966462:5194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:53.380831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400790999966462:5194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:53.380871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:53.382713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:53.382751Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:53.382765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:53.382782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:53.382804Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 329 [2:7561400793799670633:4778]
2025-10-15T10:56:53.382848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:53.382898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:53.382910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:53.382921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:53.382929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:53.382971Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:53.382989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:53.383006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:53.387100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400790999966492:4933]
2025-10-15T10:56:53.392347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.392370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.392378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.392386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:53.392626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:53.392646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.392747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.392886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.392956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 329
2025-10-15T10:56:53.392981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 329
2025-10-15T10:56:53.393046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 329, pipe: [1:7561400790999966492:4933]
2025-10-15T10:56:53.393056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:53.393130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400790999966337:2467], now have 1 active actors on pipe
2025-10-15T10:56:53.393154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400790999966491:5194], now have 1 active actors on pipe
2025-10-15T10:56:53.393170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400790999966492:4933], now have 1 active actors on pipe
2025-10-15T10:56:53.393192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400793799670628:4778]
2025-10-15T10:56:53.393202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400793799670628:4778]
2025-10-15T10:56:53.393212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400793799670628:4778]
2025-10-15T10:56:53.393241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:53.393271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:53.393290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:53.393302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:53.393314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:53.393331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:53.393385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:53.393538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:53.393557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:53.393683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:53.393713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:53.393728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:53.393736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:53.393766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:53.393800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:53.393831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400793799670628:4778]
2025-10-15T10:56:53.393859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:53.393902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:53.393931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:53.394378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:53.394399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:53.394451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:53.394782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 330 partition: 0 MaxSeqNo: 46 sessionId: src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0
2025-10-15T10:56:53.395552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|831cad84-48cbeb40-684b6ec1-c44e0fb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:53.415308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0] Write session: try to update token
2025-10-15T10:56:53.415382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:53.422891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:53.422927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:53.422964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400793799670628:4778]
2025-10-15T10:56:53.423082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:53.423099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:53.426043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:53.428031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:53.429995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:53.431613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:53.434025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:53.434505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:53.498523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:53.498551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:53.498563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:53.498617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:53.498630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:53.498643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:53.498653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:53.498688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400793799670628:4778]
2025-10-15T10:56:53.498713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400793799670628:4778]
2025-10-15T10:56:53.498735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400793799670628:4778]
2025-10-15T10:56:53.498854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:53.498868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:53.498888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:53.498901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:53.498927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:53.501445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:53.503134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId: src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:53.524523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:53.637088Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:53.638318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:53.638350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:53.638884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:53.638895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:53.638964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:53.638990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:53.639088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400790999966492:4933]
2025-10-15T10:56:53.649331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 330 reason: error at write: Disconnected sessionId: src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0
2025-10-15T10:56:53.649819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 330 sessionId: src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0 is DEAD
2025-10-15T10:56:53.650191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:53.650240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0] Write session will restart in 0.005767s
2025-10-15T10:56:53.650355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0] Write session: Do CDS request
2025-10-15T10:56:53.650419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:53.660038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:53.660088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 331
2025-10-15T10:56:53.660233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:53.660894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:53.661065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:53.661109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:53.661119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:53.662781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 331 sessionId:  describe result for acl check
2025-10-15T10:56:53.662925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:53.662951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:53.662964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:53.662988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400790999966516:5198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:53.665854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400790999966516:5198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:53.673172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400790999966516:5198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:53.681994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400790999966516:5198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:53.682037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400790999966516:5198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:53.682052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400790999966516:5198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:53.682082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:53.693540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:53.697304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:53.698103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:53.698129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:53.698165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:53.698383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:53.698565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400793799670805:4781]
2025-10-15T10:56:53.700626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:53.701345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:53.701513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:53.702582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:53.702867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:53.702883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:53.702890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:53.702896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:53.702903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:53.702908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:53.702915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:53.702922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:53.702928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:53.702934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:53.702940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:53.702947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.702952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.702958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.702999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:53.703087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:53.703128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:53.703168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:53.703208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:53.703245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:53.703290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:53.703335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:53.703394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:53.703436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:53.703477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:53.703526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.703566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.703609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.703648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:53.703708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:53.703760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:53.703810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:53.703855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:53.703915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:53.703954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:53.704009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:53.704054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:53.704105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:53.704145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:53.704197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:53.704241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:53.704292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:53.704336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:53.704384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:53.704430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:53.704476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:53.704517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:53.704565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:53.704607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:53.704655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:53.704696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.704747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.704791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.704837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.704881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.704927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.705366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:53.719895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:53.729155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:53.729183Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:53.729197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:53.729215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:53.729238Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 330 [2:7561400793799670805:4781]
2025-10-15T10:56:53.729288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:53.729341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:53.729354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:53.729366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:53.729377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:53.729416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:53.729436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:53.729456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:53.730428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.730445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.730455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.730465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:53.730707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:53.730732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:53.730857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:53.731043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:53.731072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 330
2025-10-15T10:56:53.731122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 330
2025-10-15T10:56:53.731274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:53.731369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400790999966502:2467], now have 1 active actors on pipe
2025-10-15T10:56:53.731400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400790999966598:5198], now have 1 active actors on pipe
2025-10-15T10:56:53.731442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:53.731461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:53.731511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400793799670799:4781]
2025-10-15T10:56:53.731530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400793799670799:4781]
2025-10-15T10:56:53.731542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400793799670799:4781]
2025-10-15T10:56:53.731603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:53.731624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:53.731636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:53.731646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:53.731675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:53.731844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:53.731864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:53.731928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:53.731953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:53.731964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:53.731970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:53.731991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:53.732017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:53.732108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400793799670799:4781]
2025-10-15T10:56:53.732135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:53.732159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:53.732175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:53.732629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:53.732651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:53.732691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:53.732984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 331 partition: 0 MaxSeqNo: 46 sessionId: src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0
2025-10-15T10:56:53.733900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e84f45f6-fb0b3539-2abd377c-c42bcc45_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:53.739393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400790999966661:4933]
2025-10-15T10:56:53.740001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400790999966661:4933], now have 1 active actors on pipe
2025-10-15T10:56:53.740122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 330, pipe: [1:7561400790999966661:4933]
2025-10-15T10:56:53.755188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0] Write session: try to update token
2025-10-15T10:56:53.755258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:53.774119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:53.774151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:53.774180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400793799670799:4781]
2025-10-15T10:56:53.774294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:53.774310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:53.776361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:53.777717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:53.779192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:53.780754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:53.782521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:53.783171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:53.821956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:53.821984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:53.821997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:53.822008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:53.822042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400793799670799:4781]
2025-10-15T10:56:53.822067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400793799670799:4781]
2025-10-15T10:56:53.822088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400793799670799:4781]
2025-10-15T10:56:53.822197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:53.822222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:53.822235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:53.822283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:53.822312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:53.825666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:53.836130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId: src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:53.858009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:53.968335Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:53.970193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:53.970238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:53.970845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:53.970857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400790999966661:4933]
2025-10-15T10:56:53.970982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:53.970995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:53.970981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:53.983302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 331 reason: error at write: Disconnected sessionId: src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0
2025-10-15T10:56:53.983681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 331 sessionId: src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0 is DEAD
2025-10-15T10:56:53.983962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:53.984014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0] Write session will restart in 0.009675s
2025-10-15T10:56:53.984138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0] Write session: Do CDS request
2025-10-15T10:56:53.984166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:53.998347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:54.007677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:54.007715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 332
2025-10-15T10:56:54.008191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:54.008314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:54.008329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:54.008339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:54.009716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 332 sessionId:  describe result for acl check
2025-10-15T10:56:54.009808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:54.009824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:54.009833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:54.009850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400795294934020:5204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:54.011802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400795294934020:5204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:54.018531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400795294934020:5204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:54.025063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400795294934020:5204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:54.025115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400795294934020:5204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:54.025132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400795294934020:5204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:54.025161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:54.026364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:54.031139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:54.032040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:54.032073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:54.032119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:54.032397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:54.032607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400798094638276:4783]
2025-10-15T10:56:54.034895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:54.035851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:54.036076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:54.037065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:54.037305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.037316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.037321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.037325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.037330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.037334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.037339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.037343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.037348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.037353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.037357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.037362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.037365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.037369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.037402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.037483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.037520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.037567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.037607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.037666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.037704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.037749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.037784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.037819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.037860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.037911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.037949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.037997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.038045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.038107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.038153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.038189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.038221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.038261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.038305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.038348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.038384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.038425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.038460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.038498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.038532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.038571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.038604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.038645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.038686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.038721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.038754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.038793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.038830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.038869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.038904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.038942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.038977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.039016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.039049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.039088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.039465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:54.054154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:54.063381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:54.063428Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:54.063446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:54.063465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:54.063491Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 331 [2:7561400798094638276:4783]
2025-10-15T10:56:54.063543Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:54.063596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:54.063611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:54.063623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:54.063634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:54.063685Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:54.063709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:54.063729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:54.065660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.065680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.065689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.065698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:54.065879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:54.065895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.065991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.066167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.066259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 331
2025-10-15T10:56:54.066361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 331
2025-10-15T10:56:54.066387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:54.066472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400795294934129:5204], now have 1 active actors on pipe
2025-10-15T10:56:54.066504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400790999966673:2467], now have 1 active actors on pipe
2025-10-15T10:56:54.066549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:54.066577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:54.066620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400798094638270:4783]
2025-10-15T10:56:54.066640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400798094638270:4783]
2025-10-15T10:56:54.066654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400798094638270:4783]
2025-10-15T10:56:54.066691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:54.066723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:54.066737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:54.066749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:54.066781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:54.066962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:54.066985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:54.067045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf76340b-5e80691a-33ae8246-51b6b733_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:54.067079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:54.067103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:54.067113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:54.067151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:54.067188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:54.067323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400798094638270:4783]
2025-10-15T10:56:54.067369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:54.067394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:54.067414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:54.067921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:54.067946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:54.068006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:54.068378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 332 partition: 0 MaxSeqNo: 46 sessionId: src_id|bf76340b-5e80691a-33ae8246-51b6b733_0
2025-10-15T10:56:54.069057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbfb1fbc-ec6484cd-9a155e3a-3a123345_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bf76340b-5e80691a-33ae8246-51b6b733_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:54.071107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400795294934140:4933]
2025-10-15T10:56:54.071532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400795294934140:4933], now have 1 active actors on pipe
2025-10-15T10:56:54.071593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 331, pipe: [1:7561400795294934140:4933]
2025-10-15T10:56:54.091941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf76340b-5e80691a-33ae8246-51b6b733_0] Write session: try to update token
2025-10-15T10:56:54.091985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf76340b-5e80691a-33ae8246-51b6b733_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:54.112142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:54.112180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:54.112209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400798094638270:4783]
2025-10-15T10:56:54.112327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:54.112326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:54.114214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:54.115528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:54.116822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:54.118140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:54.119826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:54.120447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:54.159667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:54.159709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:54.159725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:54.159736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:54.159770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400798094638270:4783]
2025-10-15T10:56:54.159794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400798094638270:4783]
2025-10-15T10:56:54.159816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400798094638270:4783]
2025-10-15T10:56:54.159959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:54.159975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:54.159974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:54.160025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:54.160065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:54.162088Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:54.179835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId: src_id|bf76340b-5e80691a-33ae8246-51b6b733_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:54.202090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:54.299822Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:54.302616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:54.302661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:54.303281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:54.303315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:54.303396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:54.315910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:54.316101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400795294934140:4933]
2025-10-15T10:56:54.316172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 332 reason: error at write: Disconnected sessionId: src_id|bf76340b-5e80691a-33ae8246-51b6b733_0
2025-10-15T10:56:54.316952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf76340b-5e80691a-33ae8246-51b6b733_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:54.317004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf76340b-5e80691a-33ae8246-51b6b733_0] Write session will restart in 0.007684s
2025-10-15T10:56:54.316506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 332 sessionId: src_id|bf76340b-5e80691a-33ae8246-51b6b733_0 is DEAD
2025-10-15T10:56:54.317140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf76340b-5e80691a-33ae8246-51b6b733_0] Write session: Do CDS request
2025-10-15T10:56:54.317185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf76340b-5e80691a-33ae8246-51b6b733_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:54.329392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf76340b-5e80691a-33ae8246-51b6b733_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:54.340086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:54.340119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 333
2025-10-15T10:56:54.340507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:54.340630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:54.340652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:54.340663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:54.341749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 333 sessionId:  describe result for acl check
2025-10-15T10:56:54.341849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:54.341870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:54.341879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:54.341905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400795294934184:5216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:54.344394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400795294934184:5216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:54.351440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400795294934184:5216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:54.360865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400795294934184:5216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:54.360909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400795294934184:5216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:54.360926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400795294934184:5216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:54.360956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:54.373184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:54.377578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:54.378405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:54.378438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:54.378480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:54.378730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:54.378916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400798094638438:4792]
2025-10-15T10:56:54.381040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:54.381975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:54.382237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:54.383521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:54.383908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.383934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.383942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.383949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.383957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.383963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.383970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.383977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.383985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.383992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.383999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.384007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.384015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.384021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.384071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.384182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.384234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.384280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.384332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.384382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.384424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.384469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.384513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.384559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.384605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.384648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.384692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.384736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.384767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.384823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.384869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.384906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.384939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.384976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.385019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.385061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.385103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.385139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.385170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.385206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.385237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.385277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.385319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.385382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.385427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.385477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.385525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.385585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.385632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.385683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.385722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.385775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.385815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.385874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.385906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.385942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.386392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:54.403294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:54.412794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:54.412845Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:54.412862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:54.412880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:54.412905Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 332 [2:7561400798094638438:4792]
2025-10-15T10:56:54.412955Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:54.413010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:54.413023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:54.413036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:54.413046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:54.413095Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:54.413125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:54.413151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:54.414044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.414060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.414068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.414075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:54.414268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:54.414285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.414413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.414525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 332
2025-10-15T10:56:54.414630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 332
2025-10-15T10:56:54.414565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.414800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:54.414883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400795294934280:5216], now have 1 active actors on pipe
2025-10-15T10:56:54.414906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400795294934165:2467], now have 1 active actors on pipe
2025-10-15T10:56:54.414952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:54.414972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:54.415028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400798094638433:4792]
2025-10-15T10:56:54.415042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400798094638433:4792]
2025-10-15T10:56:54.415054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400798094638433:4792]
2025-10-15T10:56:54.415095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:54.415134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:54.415150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:54.415162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:54.415167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:54.415339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:54.415511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:54.415608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:54.415657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:54.415675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:54.415686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:54.415725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:54.415768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:54.415930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400798094638433:4792]
2025-10-15T10:56:54.415984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:54.416010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:54.416051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:54.416197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400795294934331:4933]
2025-10-15T10:56:54.416579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:54.416611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:54.416660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400795294934331:4933], now have 1 active actors on pipe
2025-10-15T10:56:54.416653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 332, pipe: [1:7561400795294934331:4933]
2025-10-15T10:56:54.416715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:54.416973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 333 partition: 0 MaxSeqNo: 46 sessionId: src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0
2025-10-15T10:56:54.417650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf76340b-5e80691a-33ae8246-51b6b733_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:54.440450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0] Write session: try to update token
2025-10-15T10:56:54.440515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:54.468834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:54.468869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:54.468904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400798094638433:4792]
2025-10-15T10:56:54.469027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:54.469028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:54.471151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:54.472683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:54.474994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:54.478566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:54.480638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:54.481221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:54.511314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId: src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:54.534899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:54.534927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:54.534935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:54.534981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:54.534991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:54.535004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:54.535012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:54.535043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400798094638433:4792]
2025-10-15T10:56:54.535067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400798094638433:4792]
2025-10-15T10:56:54.535096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400798094638433:4792]
2025-10-15T10:56:54.535230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:54.535246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:54.535270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:54.535272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:54.535317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:54.536312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:54.541689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:54.679424Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:54.681607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:54.681663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:54.682113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400795294934331:4933]
2025-10-15T10:56:54.682113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:54.682132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:54.682226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:54.682455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:54.741663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 333 reason: error at write: Disconnected sessionId: src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0
2025-10-15T10:56:54.742005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 333 sessionId: src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0 is DEAD
2025-10-15T10:56:54.742216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:54.742350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:54.742400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0] Write session will restart in 0.006299s
2025-10-15T10:56:54.742582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0] Write session: Do CDS request
2025-10-15T10:56:54.742627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:54.745104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:54.746977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:54.747034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:54.747123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:54.747758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:54.748166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400798094638638:4802]
2025-10-15T10:56:54.751025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:54.752071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:54.752306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:54.753541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:54.753867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.753883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.753891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.753898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.753905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.753913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.753922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.753929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.753936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.753943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.753950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.753957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.753964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.753971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.754021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.754138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.754187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.754237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.754283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.754338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.754391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.754439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.754391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:54.754428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 334
2025-10-15T10:56:54.754489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.754541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.754550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:54.754593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.754661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.754711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.754760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.754808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.754882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:54.754947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.755007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:54.755059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.755037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:54.755119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:54.755156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:54.755179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:54.755171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.755189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:54.755233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:54.755287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.755365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:54.755416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.755479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:54.755534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.755593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:54.755646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.755703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:54.755754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.755814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:54.755866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.755936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:54.755984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.756039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:54.756086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.756147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.756199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.756256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.756308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.756362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.756574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 334 sessionId:  describe result for acl check
2025-10-15T10:56:54.756685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:54.756701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:54.756712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:54.756729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400795294934464:5223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:54.756891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:54.759362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400795294934464:5223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:54.764920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400795294934464:5223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:54.772223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400795294934464:5223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:54.772280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400795294934464:5223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:54.772298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400795294934464:5223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:54.772332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:54.782295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400795294934496:4933]
2025-10-15T10:56:54.788545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:54.797903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:54.797952Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:54.797970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:54.797991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:54.798020Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 333 [2:7561400798094638638:4802]
2025-10-15T10:56:54.798074Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:54.798138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:54.798154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:54.798167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:54.798179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:54.798230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:54.798253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:54.798277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:54.799256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.799281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.799295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.799307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:54.799579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:54.799604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:54.799758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:54.799896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 333, pipe: [1:7561400795294934496:4933]
2025-10-15T10:56:54.799976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:54.799990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 333
2025-10-15T10:56:54.799994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 333
2025-10-15T10:56:54.800218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:54.800305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400795294934496:4933], now have 1 active actors on pipe
2025-10-15T10:56:54.800334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400795294934495:5223], now have 1 active actors on pipe
2025-10-15T10:56:54.800357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400795294934338:2467], now have 1 active actors on pipe
2025-10-15T10:56:54.800414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:54.800439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:54.800494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400798094638632:4802]
2025-10-15T10:56:54.800514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400798094638632:4802]
2025-10-15T10:56:54.800528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400798094638632:4802]
2025-10-15T10:56:54.800564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:54.800603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:54.800625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:54.800638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:54.800642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:54.800829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:54.800854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:54.800919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12cada77-631713b0-9320c484-60e47aa6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:54.800954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:54.800977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:54.800988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:54.801025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:54.801063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:54.801194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400798094638632:4802]
2025-10-15T10:56:54.801232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:54.801265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:54.801277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:54.801765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:54.801792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:54.801855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:54.802160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 334 partition: 0 MaxSeqNo: 46 sessionId: src_id|12cada77-631713b0-9320c484-60e47aa6_0
2025-10-15T10:56:54.802832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1a7955-4e778664-ee1820c0-91d870fe_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|12cada77-631713b0-9320c484-60e47aa6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:54.820379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12cada77-631713b0-9320c484-60e47aa6_0] Write session: try to update token
2025-10-15T10:56:54.820421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12cada77-631713b0-9320c484-60e47aa6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:54.834486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:54.834521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:54.834561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400798094638632:4802]
2025-10-15T10:56:54.834695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:54.834706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:54.836906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:54.838451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:54.840273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:54.841689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:54.843649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:54.844148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:54.898959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:54.899018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:54.899043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:54.899056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:54.899115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400798094638632:4802]
2025-10-15T10:56:54.899162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400798094638632:4802]
2025-10-15T10:56:54.899210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400798094638632:4802]
2025-10-15T10:56:54.899449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:54.899450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:54.899473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:54.899496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:54.899528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:54.899570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:54.899587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:54.899592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:54.900617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:54.901690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId: src_id|12cada77-631713b0-9320c484-60e47aa6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:54.921583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:55.034198Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:55.044039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:55.044083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:55.044795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400795294934496:4933]
2025-10-15T10:56:55.044836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:55.044832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:55.044847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:55.044887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:55.069457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 334 reason: error at write: Disconnected sessionId: src_id|12cada77-631713b0-9320c484-60e47aa6_0
2025-10-15T10:56:55.069743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 334 sessionId: src_id|12cada77-631713b0-9320c484-60e47aa6_0 is DEAD
2025-10-15T10:56:55.070209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cada77-631713b0-9320c484-60e47aa6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:55.070292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cada77-631713b0-9320c484-60e47aa6_0] Write session will restart in 0.009059s
2025-10-15T10:56:55.070456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cada77-631713b0-9320c484-60e47aa6_0] Write session: Do CDS request
2025-10-15T10:56:55.070499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cada77-631713b0-9320c484-60e47aa6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:55.084104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12cada77-631713b0-9320c484-60e47aa6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:55.085724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:55.085790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 335
2025-10-15T10:56:55.086315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:55.086560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:55.086603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:55.086618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:55.089390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 335 sessionId:  describe result for acl check
2025-10-15T10:56:55.089519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:55.089538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:55.089547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:55.089566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400799589901900:5228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:55.092383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400799589901900:5228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:55.098891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400799589901900:5228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:55.101380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:55.105481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:55.106212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400799589901900:5228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:55.106274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400799589901900:5228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:55.106293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400799589901900:5228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:55.106328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:55.106555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:55.106584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:55.106628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:55.106870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:55.107059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400802389606098:4804]
2025-10-15T10:56:55.109300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:55.110221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:55.110457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:55.111829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:55.112180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.112200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.112207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.112214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.112221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.112228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.112235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.112242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.112250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.112257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.112264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.112272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.112278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.112285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.112334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.112453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.112513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.112570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.112628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.112688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.112738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.112792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.112836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.112883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.112931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.112977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.113025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.113068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.113120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.113192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.113257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.113317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.113366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.113422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.113471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.113535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.113594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.113650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.113703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.113765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.113818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.113886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.113937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.113996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.114051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.114113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.114165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.114228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.114283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.114341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.114396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.114453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.114519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.114575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.114622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.114676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.115206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:55.130927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:55.139320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:55.139373Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:55.139385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:55.139399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:55.139420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 334 [2:7561400802389606098:4804]
2025-10-15T10:56:55.139465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:55.139527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:55.139539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:55.139550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:55.139562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:55.139605Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:55.139622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:55.139640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:55.144829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400799589901983:4933]
2025-10-15T10:56:55.151116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.151142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.151153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.151165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:55.151432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:55.151453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.151580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.151729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.151777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 334, pipe: [1:7561400799589901983:4933]
2025-10-15T10:56:55.151824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 334
2025-10-15T10:56:55.151884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:55.151900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 334
2025-10-15T10:56:55.151951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400799589901983:4933], now have 1 active actors on pipe
2025-10-15T10:56:55.151977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400799589901978:5228], now have 1 active actors on pipe
2025-10-15T10:56:55.151995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400799589901811:2467], now have 1 active actors on pipe
2025-10-15T10:56:55.152013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400802389606093:4804]
2025-10-15T10:56:55.152032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400802389606093:4804]
2025-10-15T10:56:55.152044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400802389606093:4804]
2025-10-15T10:56:55.152077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:55.152108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:55.152127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:55.152128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:55.152140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:55.152300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:55.152323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:55.152378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:55.152404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:55.152538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400802389606093:4804]
2025-10-15T10:56:55.152569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:55.152596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:55.152629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:55.152660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:55.152681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:55.152692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:55.152730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:55.152777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:55.152916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:55.153458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:55.153488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:55.153555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:55.153843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 335 partition: 0 MaxSeqNo: 46 sessionId: src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0
2025-10-15T10:56:55.154480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12cada77-631713b0-9320c484-60e47aa6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:55.175267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0] Write session: try to update token
2025-10-15T10:56:55.175320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:55.182838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:55.182869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:55.182917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400802389606093:4804]
2025-10-15T10:56:55.183041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:55.183053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:55.185206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:55.186556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:55.188043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:55.189368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:55.191231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:55.191721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:55.234195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:55.234222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:55.234236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:55.234247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:55.234283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400802389606093:4804]
2025-10-15T10:56:55.234312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400802389606093:4804]
2025-10-15T10:56:55.234335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400802389606093:4804]
2025-10-15T10:56:55.234476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:55.234478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:55.234509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:55.234512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:55.234545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:55.236385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:55.255790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId: src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:55.276387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:55.374892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:55.376292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:55.376328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:55.377078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:55.377099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400799589901983:4933]
2025-10-15T10:56:55.377152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:55.377211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:55.377224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:55.403649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 335 reason: error at write: Disconnected sessionId: src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0
2025-10-15T10:56:55.403977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 335 sessionId: src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0 is DEAD
2025-10-15T10:56:55.404301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:55.404351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0] Write session will restart in 0.005271s
2025-10-15T10:56:55.404478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0] Write session: Do CDS request
2025-10-15T10:56:55.404518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:55.413817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:55.426212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:55.426252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 336
2025-10-15T10:56:55.426690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:55.426846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:55.426881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:55.426900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:55.428556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 336 sessionId:  describe result for acl check
2025-10-15T10:56:55.428679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:55.428699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:55.428709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:55.428726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400799589902120:5235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:55.431468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400799589902120:5235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:55.436907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400799589902120:5235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:55.442258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:55.443973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400799589902120:5235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:55.444027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400799589902120:5235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:55.444045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400799589902120:5235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:55.444076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:55.443957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:55.444753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:55.444769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:55.444806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:55.445021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:55.445183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400802389606277:4807]
2025-10-15T10:56:55.447237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:55.448050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:55.448282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:55.449428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:55.449725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.449742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.449748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.449755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.449761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.449767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.449773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.449779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.449784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.449790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.449796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.449802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.449809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.449815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.449857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.449962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.450004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.450046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.450085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.450131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.450174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.450218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.450258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.450306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.450345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.450387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.450429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.450476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.450513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.450570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.450623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.450672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.450715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.450766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.450807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.450857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.450901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.450952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.450993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.451040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.451084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.451134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.451175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.451224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.451269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.451318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.451402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.451457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.451499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.451542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.451586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.451651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.451695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.451744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.451787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.451836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.452280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:55.473409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:55.477119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400799589902169:4933]
2025-10-15T10:56:55.483541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:55.483575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:55.483589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:55.483605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:55.483627Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 335 [2:7561400802389606277:4807]
2025-10-15T10:56:55.483672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:55.483719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:55.483730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:55.483742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:55.483751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:55.483791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:55.483809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:55.483826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:55.485741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.485767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.485779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.485790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:55.486029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:55.486053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.486178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.486279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 335, pipe: [1:7561400799589902169:4933]
2025-10-15T10:56:55.486353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.486386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 335
2025-10-15T10:56:55.486452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 335
2025-10-15T10:56:55.486565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:55.486636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400799589902169:4933], now have 1 active actors on pipe
2025-10-15T10:56:55.486661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400799589902163:5235], now have 1 active actors on pipe
2025-10-15T10:56:55.486680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400799589901994:2467], now have 1 active actors on pipe
2025-10-15T10:56:55.486737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:55.486758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:55.486790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400802389606272:4807]
2025-10-15T10:56:55.486803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400802389606272:4807]
2025-10-15T10:56:55.486815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400802389606272:4807]
2025-10-15T10:56:55.486848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:55.486906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:55.486919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:55.486934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:55.486956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:55.487067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:55.487086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:55.487142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:55.487172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:55.487193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:55.487202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:55.487233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:55.487270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:55.487412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400802389606272:4807]
2025-10-15T10:56:55.487445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:55.487483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:55.487485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:55.487920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:55.487945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:55.488010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:55.488212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 336 partition: 0 MaxSeqNo: 46 sessionId: src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0
2025-10-15T10:56:55.488966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1620ddef-e5d9ce1-854ec64e-99ec42f2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:55.510089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0] Write session: try to update token
2025-10-15T10:56:55.510141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:55.516060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:55.516094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:55.516126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400802389606272:4807]
2025-10-15T10:56:55.516235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:55.516239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:55.518126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:55.544582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:55.545921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:55.547256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:55.548954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:55.549577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:55.591837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:55.591874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:55.591888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:55.591910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:55.591951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400802389606272:4807]
2025-10-15T10:56:55.591978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400802389606272:4807]
2025-10-15T10:56:55.592011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400802389606272:4807]
2025-10-15T10:56:55.592139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:55.592184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:55.592192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:55.592205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:55.592232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:55.592238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:55.592291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:55.592312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:55.596130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:55.620044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId: src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:55.642300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:55.741628Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:55.743951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:55.743991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:55.748739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:55.745079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400799589902169:4933]
2025-10-15T10:56:55.745199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:55.745211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:55.780369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:55.780441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0] Write session will restart in 0.008293s
2025-10-15T10:56:55.780601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0] Write session: Do CDS request
2025-10-15T10:56:55.780652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:55.779467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:55.779612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 336 reason: error at write: Disconnected sessionId: src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0
2025-10-15T10:56:55.779962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 336 sessionId: src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0 is DEAD
2025-10-15T10:56:55.795286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:55.795324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 337
2025-10-15T10:56:55.795629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:55.796212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:55.796340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:55.796358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:55.796369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:55.797832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 337 sessionId:  describe result for acl check
2025-10-15T10:56:55.797961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:55.797972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:55.797982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:55.798000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400799589902214:5243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:55.800731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400799589902214:5243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:55.812488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400799589902214:5243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:55.832131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:55.831678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400799589902214:5243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:55.831735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400799589902214:5243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:55.831754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400799589902214:5243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:55.831787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:55.836423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:55.837296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:55.837315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:55.837358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:55.837598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:55.837810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400802389606465:4816]
2025-10-15T10:56:55.840488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:55.841843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:55.842124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:55.843464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:55.843845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.843863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.843871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.843878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.843885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.843893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.843901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.843920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.843926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.843933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.843940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.843949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.843957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.843964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.844015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.844124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.844172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.844223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.844268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.844324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.844370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.844413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.844458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.844505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.844549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.844594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.844640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.844692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.844744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.844816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:55.844879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.844941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:55.845002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.845059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:55.845107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.845165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:55.845219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.845278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:55.845327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.845387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:55.845436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.845497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:55.845543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.845603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:55.845651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.845705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:55.845973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.846038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:55.846086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.846137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:55.846183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.846236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.846281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.846335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.846381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.846432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.846972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:55.847556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400799589902339:4933]
2025-10-15T10:56:55.868237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:55.877728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:55.878234Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:55.878268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:55.878289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:55.878316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 336 [2:7561400802389606465:4816]
2025-10-15T10:56:55.878370Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:55.878433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:55.878452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:55.878466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:55.878478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:55.878529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:55.878556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:55.878583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:55.879603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.879634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.879654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.879668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:55.880020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:55.880049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:55.880220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:55.880437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:55.880741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:55.880829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400802389606453:4816]
2025-10-15T10:56:55.880846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400802389606453:4816]
2025-10-15T10:56:55.880862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400802389606453:4816]
2025-10-15T10:56:55.880917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:55.880970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:55.880988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:55.881003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:55.881007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:55.881234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:55.881257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:55.881420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400802389606453:4816]
2025-10-15T10:56:55.881456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:55.881493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:55.881518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400799589902339:4933], now have 1 active actors on pipe
2025-10-15T10:56:55.881547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400799589902187:2467], now have 1 active actors on pipe
2025-10-15T10:56:55.881573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400799589902333:5243], now have 1 active actors on pipe
2025-10-15T10:56:55.884154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 336, pipe: [1:7561400799589902339:4933]
2025-10-15T10:56:55.884270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 336
2025-10-15T10:56:55.884351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 336
2025-10-15T10:56:55.884984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:55.885025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:55.885107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23704494-f7269028-2a783fb9-2ec62f7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:55.885142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:55.885168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:55.885180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:55.885235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:55.885298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:55.885349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:55.886643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:55.886678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:55.886759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:55.887145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 337 partition: 0 MaxSeqNo: 46 sessionId: src_id|23704494-f7269028-2a783fb9-2ec62f7b_0
2025-10-15T10:56:55.888002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee642e-109aa917-845a28b8-b0a4b25f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|23704494-f7269028-2a783fb9-2ec62f7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:55.919067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23704494-f7269028-2a783fb9-2ec62f7b_0] Write session: try to update token
2025-10-15T10:56:55.919131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23704494-f7269028-2a783fb9-2ec62f7b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:55.980168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:55.980224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:55.980280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400802389606453:4816]
2025-10-15T10:56:55.980429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:55.980551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:55.980576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:55.980600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:55.980713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:55.983427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:55.991763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:55.993146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:55.994536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:56.002310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:56.034407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:56.034570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:56.034594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:56.034609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:56.034622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:56.034665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400802389606453:4816]
2025-10-15T10:56:56.034693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400802389606453:4816]
2025-10-15T10:56:56.034722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400802389606453:4816]
2025-10-15T10:56:56.034867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:56.034875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:56.034899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:56.034916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:56.034949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:56.040186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:56.061063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId: src_id|23704494-f7269028-2a783fb9-2ec62f7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:56.094232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:56.187375Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:56.188906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:56.188954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:56.189588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:56.189477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400799589902339:4933]
2025-10-15T10:56:56.189500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:56.189575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:56.189588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:56.201185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23704494-f7269028-2a783fb9-2ec62f7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:56.201260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23704494-f7269028-2a783fb9-2ec62f7b_0] Write session will restart in 0.005588s
2025-10-15T10:56:56.201435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23704494-f7269028-2a783fb9-2ec62f7b_0] Write session: Do CDS request
2025-10-15T10:56:56.201486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23704494-f7269028-2a783fb9-2ec62f7b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:56.200213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 337 reason: error at write: Disconnected sessionId: src_id|23704494-f7269028-2a783fb9-2ec62f7b_0
2025-10-15T10:56:56.200605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 337 sessionId: src_id|23704494-f7269028-2a783fb9-2ec62f7b_0 is DEAD
2025-10-15T10:56:56.211403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:56.211438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 338
2025-10-15T10:56:56.211527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23704494-f7269028-2a783fb9-2ec62f7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:56.212232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:56.212388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:56.212405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:56.212415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:56.213828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 338 sessionId:  describe result for acl check
2025-10-15T10:56:56.213950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:56.213969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:56.213991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:56.214009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400803884869689:5251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:56.216564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400803884869689:5251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:56.222188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400803884869689:5251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:56.239501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400803884869689:5251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:56.239561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400803884869689:5251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:56.239588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400803884869689:5251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:56.239631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:56.257016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:56.262602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:56.263517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:56.263548Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:56.263596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:56.263893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:56.264096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400806684573942:4825]
2025-10-15T10:56:56.266403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:56.267512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:56.267768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:56.269141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:56.269506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:56.269526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:56.269535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:56.269541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:56.269550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:56.269559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:56.269566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:56.269575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:56.269583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:56.269590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:56.269598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:56.269606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.269614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.269623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.269675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:56.269797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:56.269851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:56.269905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:56.269954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:56.270013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:56.270064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:56.270112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:56.270172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:56.270231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:56.270282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:56.270335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.270389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.270444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.270500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:56.270576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:56.270647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:56.270709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:56.270767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:56.270829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:56.270883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:56.270946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:56.271003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:56.271062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:56.271115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:56.271176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:56.271229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:56.271292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:56.271364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:56.271427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:56.271483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:56.271547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:56.271606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:56.271671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:56.271729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:56.271790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:56.271838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.271901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.271970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.272035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.272090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.272154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.272743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:56.289753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400803884869840:4933]
2025-10-15T10:56:56.293721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:56.303509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:56.303557Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:56.303577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:56.303596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:56.303624Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 337 [2:7561400806684573942:4825]
2025-10-15T10:56:56.303705Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:56.306093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 337
2025-10-15T10:56:56.306172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 337, pipe: [1:7561400803884869840:4933]
2025-10-15T10:56:56.306255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 337
2025-10-15T10:56:56.303775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:56.303799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:56.303812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:56.303825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:56.303880Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:56.303904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:56.303939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:56.305412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.305430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.305444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.305456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:56.305722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:56.305740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.305889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.306101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.306377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:56.306469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400803884869675:2467], now have 1 active actors on pipe
2025-10-15T10:56:56.306492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400803884869784:5251], now have 1 active actors on pipe
2025-10-15T10:56:56.306516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400803884869840:4933], now have 1 active actors on pipe
2025-10-15T10:56:56.306583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:56.306605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:56.306643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400806684573937:4825]
2025-10-15T10:56:56.306657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400806684573937:4825]
2025-10-15T10:56:56.306670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400806684573937:4825]
2025-10-15T10:56:56.306713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:56.306748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:56.306764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:56.306777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:56.306787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:56.306981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:56.306999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:56.307071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:56.307104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:56.307124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:56.307134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:56.307172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:56.307214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:56.308114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400806684573937:4825]
2025-10-15T10:56:56.308167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:56.308216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:56.308227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:56.308827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:56.308878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:56.308951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:56.309564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 338 partition: 0 MaxSeqNo: 46 sessionId: src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0
2025-10-15T10:56:56.310353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23704494-f7269028-2a783fb9-2ec62f7b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:56.331774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0] Write session: try to update token
2025-10-15T10:56:56.331829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:56.368469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:56.368499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:56.368527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400806684573937:4825]
2025-10-15T10:56:56.368639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:56.368694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:56.370332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:56.379634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:56.382176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:56.384843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:56.395813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:56.396807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:56.422611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:56.422643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:56.422654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:56.422705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:56.422719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:56.422739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:56.422755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:56.422801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400806684573937:4825]
2025-10-15T10:56:56.422837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400806684573937:4825]
2025-10-15T10:56:56.422860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400806684573937:4825]
2025-10-15T10:56:56.422997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:56.423016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:56.423495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:56.423550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:56.423581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:56.424096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:56.456048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId: src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:56.483027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:56.571305Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:56.576741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:56.576784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:56.577327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:56.577415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400803884869840:4933]
2025-10-15T10:56:56.577491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:56.577509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:56.577528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:56.600382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 338 reason: error at write: Disconnected sessionId: src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0
2025-10-15T10:56:56.600673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 338 sessionId: src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0 is DEAD
2025-10-15T10:56:56.603626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:56.603671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0] Write session will restart in 0.008268s
2025-10-15T10:56:56.603782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0] Write session: Do CDS request
2025-10-15T10:56:56.603817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:56.622281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:56.622319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 339
2025-10-15T10:56:56.622431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:56.623433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:56.623589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:56.623613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:56.623623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:56.626607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 339 sessionId:  describe result for acl check
2025-10-15T10:56:56.626738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:56.626757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:56.626767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:56.626784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400803884869888:5256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:56.629699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400803884869888:5256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:56.639569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400803884869888:5256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:56.646721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400803884869888:5256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:56.646777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400803884869888:5256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:56.646794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400803884869888:5256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:56.646826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:56.650234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:56.651865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:56.652676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:56.652706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:56.652748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:56.652998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:56.653189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400806684574112:4828]
2025-10-15T10:56:56.655493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:56.657344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:56.657589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:56.658956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:56.659286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:56.659299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:56.659304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:56.659309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:56.659314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:56.659321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:56.659327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:56.659335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:56.659343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:56.659369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:56.659377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:56.659384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.659392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.659398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.659449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:56.659570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:56.659619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:56.659674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:56.659730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:56.659785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:56.659840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:56.659888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:56.659945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:56.659994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:56.660042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:56.660091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.660142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.660194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.660241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:56.660315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:56.660382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:56.660443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:56.660495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:56.660555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:56.660605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:56.660680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:56.660738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:56.660808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:56.660864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:56.660931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:56.660988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:56.661053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:56.661114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:56.661177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:56.661235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:56.661303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:56.661360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:56.661426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:56.661485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:56.661547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:56.661597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.661657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.661724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.661793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.661850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.661930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.662472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:56.677829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400803884870016:4933]
2025-10-15T10:56:56.682732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:56.696482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:56.696529Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:56.696549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:56.696570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:56.696596Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 338 [2:7561400806684574112:4828]
2025-10-15T10:56:56.696649Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:56.696713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:56.696730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:56.696743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:56.696755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:56.696804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:56.696827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:56.696849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:56.697756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.697779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.697793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.697808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:56.698043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:56.698069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:56.698219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:56.698421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:56.698544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 338, pipe: [1:7561400803884870016:4933]
2025-10-15T10:56:56.698672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:56.698673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 338
2025-10-15T10:56:56.698766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 338
2025-10-15T10:56:56.698762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400803884870016:4933], now have 1 active actors on pipe
2025-10-15T10:56:56.698793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400803884869849:2467], now have 1 active actors on pipe
2025-10-15T10:56:56.698818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400803884870010:5256], now have 1 active actors on pipe
2025-10-15T10:56:56.698849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400806684574107:4828]
2025-10-15T10:56:56.698870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400806684574107:4828]
2025-10-15T10:56:56.698883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400806684574107:4828]
2025-10-15T10:56:56.698918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:56.698950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:56.698983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:56.698997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:56.699041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:56.699234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:56.699258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:56.699314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:56.699327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:56.699451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400806684574107:4828]
2025-10-15T10:56:56.699475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:56.699506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:56.699529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f13240b-f0eabc74-2d623b6d-d716221_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:56.699556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:56.699575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:56.699584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:56.699613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:56.699654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:56.699764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:56.700697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:56.700735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:56.700794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:56.701082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 339 partition: 0 MaxSeqNo: 46 sessionId: src_id|1f13240b-f0eabc74-2d623b6d-d716221_0
2025-10-15T10:56:56.701853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee18d04-bc877edf-6a31a83d-49c05efb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1f13240b-f0eabc74-2d623b6d-d716221_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:56.723333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f13240b-f0eabc74-2d623b6d-d716221_0] Write session: try to update token
2025-10-15T10:56:56.723419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f13240b-f0eabc74-2d623b6d-d716221_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:56.732339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:56.732391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:56.732434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400806684574107:4828]
2025-10-15T10:56:56.732576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:56.733377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:56.734722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:56.736168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:56.737717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:56.753548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:56.755729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:56.756456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:56.801888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:56.801933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:56.801949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:56.801966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:56.802014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400806684574107:4828]
2025-10-15T10:56:56.802050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400806684574107:4828]
2025-10-15T10:56:56.802078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400806684574107:4828]
2025-10-15T10:56:56.802213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:56.802258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:56.802287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:56.802292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:56.802299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:56.802309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:56.802359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:56.802381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:56.803836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:56.821466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId: src_id|1f13240b-f0eabc74-2d623b6d-d716221_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:56.848200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:56.942099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:56.947083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:56.947129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:56.947640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400803884870016:4933]
2025-10-15T10:56:56.947719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:56.947751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:56.947888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:56.947909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:56.977903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 339 reason: error at write: Disconnected sessionId: src_id|1f13240b-f0eabc74-2d623b6d-d716221_0
2025-10-15T10:56:56.978198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 339 sessionId: src_id|1f13240b-f0eabc74-2d623b6d-d716221_0 is DEAD
2025-10-15T10:56:56.978728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f13240b-f0eabc74-2d623b6d-d716221_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:56.978801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f13240b-f0eabc74-2d623b6d-d716221_0] Write session will restart in 0.008712s
2025-10-15T10:56:56.978976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f13240b-f0eabc74-2d623b6d-d716221_0] Write session: Do CDS request
2025-10-15T10:56:56.979024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f13240b-f0eabc74-2d623b6d-d716221_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:56.992570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f13240b-f0eabc74-2d623b6d-d716221_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:56.995271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:56.995305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 340
2025-10-15T10:56:56.995724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:56.995843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:56.995858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:56.995868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:56.997171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 340 sessionId:  describe result for acl check
2025-10-15T10:56:56.997278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:56.997289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:56.997298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:56.997314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400803884870083:5266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:57.000271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400803884870083:5266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:57.006695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400803884870083:5266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:57.017669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400803884870083:5266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:57.017718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400803884870083:5266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:57.017735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400803884870083:5266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:57.017763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:57.028069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:57.032565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:57.033329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:57.033355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:57.033388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:57.033601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:57.033814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400810979541600:4837]
2025-10-15T10:56:57.035685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:57.036612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:57.036808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:57.037876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:57.038168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.038183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.038188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.038194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.038200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.038206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.038212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.038217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.038223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.038229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.038234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.038241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.038246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.038253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.038290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.038378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.038420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.038461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.038497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.038534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.038569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.038621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.038659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.038697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.038737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.038774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.038813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.038852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.038887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.038943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.038992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.039040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.039078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.039120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.039158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.039203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.039246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.039290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.039326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.039422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.039466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.039513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.039553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.039599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.039642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.039688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.039726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.039771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.039811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.039858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.039898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.039959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.039999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.040043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.040080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.040125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.040535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:57.048098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400808179837503:4933]
2025-10-15T10:56:57.066269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:57.075892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:57.075942Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:57.075955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:57.075969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:57.075989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 339 [2:7561400810979541600:4837]
2025-10-15T10:56:57.076029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:57.076073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:57.076085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:57.076094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:57.076103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:57.076142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:57.076160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:57.076177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:57.078088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.078114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.078126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.078135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:57.078395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:57.078418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.078527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.078680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.078872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:57.078942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400808179837478:5266], now have 1 active actors on pipe
2025-10-15T10:56:57.078962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400808179837503:4933], now have 1 active actors on pipe
2025-10-15T10:56:57.079112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 339
2025-10-15T10:56:57.078980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400803884870042:2467], now have 1 active actors on pipe
2025-10-15T10:56:57.079000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400810979541595:4837]
2025-10-15T10:56:57.079190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 339, pipe: [1:7561400808179837503:4933]
2025-10-15T10:56:57.079014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400810979541595:4837]
2025-10-15T10:56:57.079025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400810979541595:4837]
2025-10-15T10:56:57.079252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 339
2025-10-15T10:56:57.079055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:57.079094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:57.079107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:57.079116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:57.079118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:57.079254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:57.079270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:57.079392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400810979541595:4837]
2025-10-15T10:56:57.079414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:57.079455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:57.079532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:57.079548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:57.079614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:57.079646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:57.079666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:57.079674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:57.079704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:57.079739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:57.079776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:57.080352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:57.080389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:57.080452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:57.080740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 340 partition: 0 MaxSeqNo: 46 sessionId: src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0
2025-10-15T10:56:57.081563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f13240b-f0eabc74-2d623b6d-d716221_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:57.103763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0] Write session: try to update token
2025-10-15T10:56:57.103821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:57.121431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:57.121464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:57.121496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400810979541595:4837]
2025-10-15T10:56:57.121603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:57.121603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:57.123469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:57.124951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:57.126394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:57.128239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:57.130130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:57.130689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:57.180879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:57.180915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:57.180928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:57.180937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:57.180970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400810979541595:4837]
2025-10-15T10:56:57.180991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400810979541595:4837]
2025-10-15T10:56:57.181011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400810979541595:4837]
2025-10-15T10:56:57.181152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:57.181163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:57.181172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:57.181206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:57.181222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:57.182260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:57.187777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:57.187812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:57.187836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:57.221871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId: src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:57.245373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:57.323164Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:57.330129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:57.330170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:57.330734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:57.330764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:57.330940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:57.331001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400808179837503:4933]
2025-10-15T10:56:57.331202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:57.339769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 340 reason: error at write: Disconnected sessionId: src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0
2025-10-15T10:56:57.340065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 340 sessionId: src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0 is DEAD
2025-10-15T10:56:57.340464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:57.340532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0] Write session will restart in 0.009104s
2025-10-15T10:56:57.340704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0] Write session: Do CDS request
2025-10-15T10:56:57.340767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:57.354058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:57.354169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:57.354098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 341
2025-10-15T10:56:57.354700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:57.354843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:57.354873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:57.354883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:57.356509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 341 sessionId:  describe result for acl check
2025-10-15T10:56:57.356666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:57.356695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:57.356712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:57.356737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400808179837553:5275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:57.359232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400808179837553:5275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:57.368361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400808179837553:5275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:57.375700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400808179837553:5275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:57.375743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400808179837553:5275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:57.375758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400808179837553:5275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:57.375785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:57.400724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:57.405004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:57.405817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:57.405843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:57.405880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:57.406102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:57.406269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400810979541797:4847]
2025-10-15T10:56:57.408608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:57.409531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:57.409797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:57.411001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:57.411338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.411405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.411418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.411424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.411430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.411435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.411443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.411450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.411456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.411462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.411469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.411476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.411482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.411488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.411535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.411635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.411679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.411730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.411778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.411829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.411877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.411946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.412005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.412061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.412111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.412164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.412213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.412260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.412309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.412383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.412460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.412527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.412576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.412629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.412681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.412742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.412801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.412861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.412911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.412967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.413017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.413073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.413118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.413191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.413243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.413300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.413349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.413402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.413456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.413504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.413555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.413609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.413657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.413710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.413757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.413808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.414242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:57.431409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400808179837702:4933]
2025-10-15T10:56:57.441272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:57.452184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:57.452227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:57.452245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:57.452264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:57.452289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 340 [2:7561400810979541797:4847]
2025-10-15T10:56:57.452339Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:57.452392Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:57.452413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:57.452425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:57.452436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:57.452481Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:57.452508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:57.452528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:57.453547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.453571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.453584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.453595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:57.453880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:57.453908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.454043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.454131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 340, pipe: [1:7561400808179837702:4933]
2025-10-15T10:56:57.454147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 340
2025-10-15T10:56:57.454243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.454259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 340
2025-10-15T10:56:57.454493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:57.454572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400808179837539:2467], now have 1 active actors on pipe
2025-10-15T10:56:57.454600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400808179837702:4933], now have 1 active actors on pipe
2025-10-15T10:56:57.454621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400808179837611:5275], now have 1 active actors on pipe
2025-10-15T10:56:57.454685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:57.454709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:57.454741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400810979541792:4847]
2025-10-15T10:56:57.454761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400810979541792:4847]
2025-10-15T10:56:57.454775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400810979541792:4847]
2025-10-15T10:56:57.454813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:57.454856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:57.454877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:57.454884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:57.454888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:57.455053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:57.455074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:57.455132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:57.455163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:57.455184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:57.455195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:57.455226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:57.455264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:57.455398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400810979541792:4847]
2025-10-15T10:56:57.455429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:57.455472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:57.455476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:57.455973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:57.456000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:57.456056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:57.456285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 341 partition: 0 MaxSeqNo: 46 sessionId: src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0
2025-10-15T10:56:57.456953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2360dc5-3e7eafce-639e083c-f8ec352c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:57.476965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0] Write session: try to update token
2025-10-15T10:56:57.477015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:57.484606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:57.484642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:57.484677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400810979541792:4847]
2025-10-15T10:56:57.484786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:57.485859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:57.487414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:57.491971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:57.493439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:57.494823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:57.496974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:57.497451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:57.544932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId: src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:57.552695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:57.552723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:57.552734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:57.582582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:57.592547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:57.592583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:57.592597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:57.592608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:57.592646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400810979541792:4847]
2025-10-15T10:56:57.592673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400810979541792:4847]
2025-10-15T10:56:57.592697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400810979541792:4847]
2025-10-15T10:56:57.592886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:57.592921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:57.592960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:57.592985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:57.593972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:57.595466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:57.595513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:57.595543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:57.737020Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:57.739295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:57.739003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:57.739031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400808179837702:4933]
2025-10-15T10:56:57.739117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:57.739130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:57.796122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 341 reason: error at write: Disconnected sessionId: src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0
2025-10-15T10:56:57.796473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 341 sessionId: src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0 is DEAD
2025-10-15T10:56:57.802411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:57.802450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0] Write session will restart in 0.005974s
2025-10-15T10:56:57.802541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0] Write session: Do CDS request
2025-10-15T10:56:57.802567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:57.813401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:57.815595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:57.815630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 342
2025-10-15T10:56:57.816037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:57.816152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:57.816167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:57.816175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:57.824720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 342 sessionId:  describe result for acl check
2025-10-15T10:56:57.824858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:57.824830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:57.824878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:57.824889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:57.824908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400808179837845:5279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:57.825858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:57.826558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:57.826586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:57.826619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:57.826824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:57.826999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400810979541979:4849]
2025-10-15T10:56:57.828118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400808179837845:5279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:57.829148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:57.829944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:57.830122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:57.831273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:57.831597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.831605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.831610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.831618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.831624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.831630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.831636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.831641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.831649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.831656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.831662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.831669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.831676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.831682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.831723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.831819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.831874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.831921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.831974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.832017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.832058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.832104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.832144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.832188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.832235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.832278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.832319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.832361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.832400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.832458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:57.832509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.832566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:57.832616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.832668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:57.832711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.832762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:57.832805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.832855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:57.832898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.832946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:57.832989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.833039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:57.833083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.833130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:57.833172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.833221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:57.833262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.833308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:57.833349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.833398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:57.833441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.833502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.833552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.833598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.833639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.833687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.834158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:57.834249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400808179837845:5279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:57.838923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400808179837875:4933]
2025-10-15T10:56:57.847341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400808179837845:5279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:57.847407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400808179837845:5279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:57.847427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400808179837845:5279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:57.847464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:57.851680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:57.868763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:57.868805Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:57.868822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:57.868839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:57.868864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 341 [2:7561400810979541979:4849]
2025-10-15T10:56:57.868909Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:57.868959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:57.868972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:57.868982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:57.868995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:57.869039Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:57.869059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:57.869077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:57.870104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.870127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.870140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.870151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:57.870398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:57.870420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:57.870551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:57.870730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:57.870957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:57.871018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400808179837881:5279], now have 1 active actors on pipe
2025-10-15T10:56:57.871032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400808179837711:2467], now have 1 active actors on pipe
2025-10-15T10:56:57.871046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400808179837875:4933], now have 1 active actors on pipe
2025-10-15T10:56:57.871064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400810979541974:4849]
2025-10-15T10:56:57.871073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400810979541974:4849]
2025-10-15T10:56:57.871081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400810979541974:4849]
2025-10-15T10:56:57.871107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:57.871151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:57.871282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:57.871293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:57.871400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 341
2025-10-15T10:56:57.871500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 341
2025-10-15T10:56:57.871572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 341, pipe: [1:7561400808179837875:4933]
2025-10-15T10:56:57.871425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:57.871438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:57.871448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:57.871733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400810979541974:4849]
2025-10-15T10:56:57.871754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:57.871795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:57.871848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:57.871869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:57.872035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:57.872086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:57.872102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:57.872111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:57.872143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:57.872177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:57.872267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:57.872834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:57.872865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:57.872924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:57.873256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 342 partition: 0 MaxSeqNo: 46 sessionId: src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0
2025-10-15T10:56:57.877657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0f4e55e-8226394e-4a851ce1-982f7434_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:57.917119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0] Write session: try to update token
2025-10-15T10:56:57.917175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:57.969578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:57.969616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:57.969632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:57.969645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:57.969683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400810979541974:4849]
2025-10-15T10:56:57.969711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400810979541974:4849]
2025-10-15T10:56:57.969737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400810979541974:4849]
2025-10-15T10:56:57.969890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:57.969946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:57.969991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:57.987549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:57.987592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:57.992129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:58.010670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId: src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:58.037212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:58.155554Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:58.165054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:58.165104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:58.165172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:58.165187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:58.165230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400810979541974:4849]
2025-10-15T10:56:58.165404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:58.165688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:58.165709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:58.165723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:58.165866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:58.165929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400808179837875:4933]
2025-10-15T10:56:58.194908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 342 reason: error at write: Disconnected sessionId: src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0
2025-10-15T10:56:58.195286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 342 sessionId: src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0 is DEAD
2025-10-15T10:56:58.195706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:58.195757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0] Write session will restart in 0.006866s
2025-10-15T10:56:58.195850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0] Write session: Do CDS request
2025-10-15T10:56:58.195878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:58.207450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:58.207492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 343
2025-10-15T10:56:58.207729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:58.208206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:58.208350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:58.208366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:58.208375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:58.210479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 343 sessionId:  describe result for acl check
2025-10-15T10:56:58.210668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:58.210695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:58.210714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:58.210744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400812474805271:5284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:58.214179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400812474805271:5284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:58.221072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400812474805271:5284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:58.232347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:58.232555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400812474805271:5284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:58.232601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400812474805271:5284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:58.232618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400812474805271:5284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:58.232651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:58.234209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:58.235130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:58.235150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:58.235186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:58.235424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:58.235592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400815274509446:4852]
2025-10-15T10:56:58.237793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:58.238702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:58.238925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:58.239974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:58.240240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:58.240260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:58.240268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:58.240277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:58.240283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:58.240291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:58.240298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:58.240303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:58.240308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:58.240313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:58.240317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:58.240321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.240328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.240336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.240386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:58.240498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:58.240537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:58.240586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:58.240638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:58.240693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:58.240735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:58.240774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:58.240813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:58.240850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:58.240886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:58.240930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.240970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.241003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.241043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:58.241107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:58.241157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:58.241200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:58.241239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:58.241283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:58.241317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:58.241364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:58.241416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:58.241461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:58.241496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:58.241543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:58.241595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:58.241641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:58.241687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:58.241740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:58.241778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:58.241820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:58.241855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:58.241896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:58.241931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:58.241972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:58.242023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.242064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.242111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.242153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.242190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.242231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.242663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:58.258503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:58.266480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400812474805376:4933]
2025-10-15T10:56:58.268523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:58.268564Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:58.268579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:58.268603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:58.268629Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 342 [2:7561400815274509446:4852]
2025-10-15T10:56:58.268677Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:58.268730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:58.268751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:58.268762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:58.268772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:58.268821Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:58.268852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:58.268873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:58.270573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.270596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.270611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.270622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:58.270847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:58.270865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.270966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.271147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.271159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 342, pipe: [1:7561400812474805376:4933]
2025-10-15T10:56:58.271274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 342
2025-10-15T10:56:58.271370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:58.271391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 342
2025-10-15T10:56:58.271470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400812474805376:4933], now have 1 active actors on pipe
2025-10-15T10:56:58.271500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400812474805202:2467], now have 1 active actors on pipe
2025-10-15T10:56:58.271521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400812474805364:5284], now have 1 active actors on pipe
2025-10-15T10:56:58.271546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400815274509440:4852]
2025-10-15T10:56:58.271567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400815274509440:4852]
2025-10-15T10:56:58.271578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400815274509440:4852]
2025-10-15T10:56:58.271615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:58.271646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:58.271668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:58.271679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:58.271701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:58.271882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:58.271905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:58.271973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:58.271999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:58.272123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400815274509440:4852]
2025-10-15T10:56:58.272164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:58.272204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:58.272239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:58.272274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:58.272296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:58.272308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:58.272341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:58.272388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:58.272527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:58.272992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:58.273021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:58.273103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:58.273443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 343 partition: 0 MaxSeqNo: 46 sessionId: src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0
2025-10-15T10:56:58.274247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd76fc-d750d02e-c1fd0ed5-42a8c0f1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:58.296494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0] Write session: try to update token
2025-10-15T10:56:58.296545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:58.325192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:58.325224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:58.325255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400815274509440:4852]
2025-10-15T10:56:58.325352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:58.325435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:58.327580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:58.329148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:58.330724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:58.332428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:58.334580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:58.335251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:58.414037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:58.414071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:58.414084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:58.414137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:58.414150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:58.414161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:58.414172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:58.414208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400815274509440:4852]
2025-10-15T10:56:58.414234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400815274509440:4852]
2025-10-15T10:56:58.414258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400815274509440:4852]
2025-10-15T10:56:58.414404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:58.414427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:58.414433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:58.415748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:58.415808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:58.424786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:58.466677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId: src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:58.489507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:58.573666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:58.576634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:58.576671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:58.577604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:58.577643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:58.577372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:58.591170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 343 reason: error at write: Disconnected sessionId: src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0
2025-10-15T10:56:58.591581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 343 sessionId: src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0 is DEAD
2025-10-15T10:56:58.592054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:58.592117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0] Write session will restart in 0.008827s
2025-10-15T10:56:58.592260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0] Write session: Do CDS request
2025-10-15T10:56:58.592321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:58.608682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:58.614522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400812474805376:4933]
2025-10-15T10:56:58.614618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:58.614735Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:58.614757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 344
2025-10-15T10:56:58.615106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:58.615222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:58.615243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:58.615252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:58.616611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 344 sessionId:  describe result for acl check
2025-10-15T10:56:58.616724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:58.616734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:58.616743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:58.616760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400812474805405:5295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:58.619123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400812474805405:5295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:58.629820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400812474805405:5295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:58.641218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400812474805405:5295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:58.641264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400812474805405:5295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:58.641282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400812474805405:5295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:58.641315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:58.679983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:58.682164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:58.683161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:58.683190Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:58.683233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:58.683515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:58.683696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400815274509636:4861]
2025-10-15T10:56:58.685767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:58.686905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:58.687108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:58.688325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:58.688666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:58.688685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:58.688692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:58.688699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:58.688706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:58.688712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:58.688719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:58.688725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:58.688731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:58.688737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:58.688744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:58.688750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.688756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.688763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.688809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:58.688908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:58.688953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:58.688994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:58.689038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:58.689090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:58.689133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:58.689176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:58.689222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:58.689272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:58.689316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:58.689372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.689418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.689464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.689507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:58.689571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:58.689628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:58.689676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:58.689719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:58.689771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:58.689817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:58.689871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:58.689918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:58.689970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:58.690016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:58.690069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:58.690114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:58.690169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:58.690216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:58.690271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:58.690321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:58.690373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:58.690419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:58.690466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:58.690513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:58.690565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:58.690612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.690662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.690705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.690759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.690806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.690898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.691390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:58.708617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:58.714111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400812474805564:4933]
2025-10-15T10:56:58.719377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:58.719424Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:58.719440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:58.719460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:58.719486Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 343 [2:7561400815274509636:4861]
2025-10-15T10:56:58.719535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:58.719590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:58.719604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:58.719616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:58.719627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:58.719674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:58.719697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:58.719719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:58.721262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.721290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.721304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.721315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:58.721595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:58.721628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:58.721778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:58.721847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 343
2025-10-15T10:56:58.721851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 343
2025-10-15T10:56:58.721941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 343, pipe: [1:7561400812474805564:4933]
2025-10-15T10:56:58.721980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:58.722222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:58.722319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400812474805441:5295], now have 1 active actors on pipe
2025-10-15T10:56:58.722343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400812474805401:2467], now have 1 active actors on pipe
2025-10-15T10:56:58.722365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400812474805564:4933], now have 1 active actors on pipe
2025-10-15T10:56:58.722429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:58.722451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:58.722489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400815274509631:4861]
2025-10-15T10:56:58.722503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400815274509631:4861]
2025-10-15T10:56:58.722516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400815274509631:4861]
2025-10-15T10:56:58.722556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:58.722594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:58.722608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:58.722619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:58.722631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:58.722806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:58.722825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:58.722893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:58.722928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:58.722946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:58.722958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:58.722996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:58.723041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:58.723184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400815274509631:4861]
2025-10-15T10:56:58.723213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:58.723246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:58.723261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:58.723958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:58.723991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:58.724086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:58.724475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 344 partition: 0 MaxSeqNo: 46 sessionId: src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0
2025-10-15T10:56:58.725213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcc371e-48e72b62-d4d16ecb-7118dd56_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:58.764083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0] Write session: try to update token
2025-10-15T10:56:58.764148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:58.827975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:58.828011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:58.828023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:58.828090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:58.828104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:58.828117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:58.828128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:58.828165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400815274509631:4861]
2025-10-15T10:56:58.828200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400815274509631:4861]
2025-10-15T10:56:58.828223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400815274509631:4861]
2025-10-15T10:56:58.828359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:58.828387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:58.828408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:58.828437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:58.828457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:58.830020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:58.860445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId: src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:58.885707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:58.969497Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:58.988525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:58.988577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:58.988644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:58.988658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:58.988696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400815274509631:4861]
2025-10-15T10:56:58.988919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:58.989288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:58.989358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400812474805564:4933]
2025-10-15T10:56:58.989360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:58.989376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:58.989475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:58.998877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 344 reason: error at write: Disconnected sessionId: src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0
2025-10-15T10:56:58.999237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 344 sessionId: src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0 is DEAD
2025-10-15T10:56:58.999664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:58.999708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0] Write session will restart in 0.007357s
2025-10-15T10:56:58.999849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0] Write session: Do CDS request
2025-10-15T10:56:58.999891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:59.011078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:59.011119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 345
2025-10-15T10:56:59.011388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:59.011930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:59.012078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:59.012102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:59.012112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:59.013343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 345 sessionId:  describe result for acl check
2025-10-15T10:56:59.013459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:59.013477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:59.013486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:59.013503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400816769772905:5302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:59.016109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400816769772905:5302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:59.022236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400816769772905:5302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:59.035212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400816769772905:5302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:59.035260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400816769772905:5302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:59.035277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400816769772905:5302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:59.035309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:59.058755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:59.065489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:59.066423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:59.066444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:59.066491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:59.066794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:59.067002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400819569477141:4871]
2025-10-15T10:56:59.069340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:59.070544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:59.070780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:59.072151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:59.072523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.072544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.072552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.072559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.072567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.072576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.072583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.072591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.072599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.072607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.072614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.072622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.072629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.072637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.072691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.072813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.072867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.072918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.072973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.073023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.073073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.073122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.073173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.073224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.073271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.073319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.073366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.073416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.073465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.073534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.073600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.073662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.073713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.073770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.075075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.075185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.075254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.075313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.075378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.075436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.075487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.075547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.075597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.075657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.075710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.075772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.075822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.075881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.075931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.076000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.076049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.076105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.076156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.076214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.076262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.076322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.076885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:59.089765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400816769773059:4933]
2025-10-15T10:56:59.104523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:59.113688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:59.113723Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:59.113736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:59.113751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:59.113772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 344 [2:7561400819569477141:4871]
2025-10-15T10:56:59.113811Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:59.113862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:59.113874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:59.113885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:59.113895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:59.113942Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:59.113961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:59.113980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:59.114810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.114829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.114838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.114845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:59.115045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:59.115073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.115215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.115397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.115500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 344, pipe: [1:7561400816769773059:4933]
2025-10-15T10:56:59.115622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 344
2025-10-15T10:56:59.115624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 344
2025-10-15T10:56:59.115653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:59.115744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400816769773059:4933], now have 1 active actors on pipe
2025-10-15T10:56:59.115774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400816769773005:5302], now have 1 active actors on pipe
2025-10-15T10:56:59.115797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400812474805595:2467], now have 1 active actors on pipe
2025-10-15T10:56:59.115821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400819569477136:4871]
2025-10-15T10:56:59.115830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400819569477136:4871]
2025-10-15T10:56:59.115839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400819569477136:4871]
2025-10-15T10:56:59.115877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:59.115908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:59.115929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:59.115941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:59.115950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:59.116148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:59.116173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:59.116231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:59.116253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:59.116386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400819569477136:4871]
2025-10-15T10:56:59.116416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:59.116433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:59.116488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cc81c6e-173c202f-f939014-dca8cc24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:59.116523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:59.116546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:59.116557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:59.116592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:59.116632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:59.116773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:59.117425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:59.117465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:59.117555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:59.117804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 345 partition: 0 MaxSeqNo: 46 sessionId: src_id|8cc81c6e-173c202f-f939014-dca8cc24_0
2025-10-15T10:56:59.118548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b658cdce-86dadb79-5a77e00b-aa0d7f83_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8cc81c6e-173c202f-f939014-dca8cc24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:59.141294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc81c6e-173c202f-f939014-dca8cc24_0] Write session: try to update token
2025-10-15T10:56:59.141357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc81c6e-173c202f-f939014-dca8cc24_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:59.171691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:59.171727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:59.171763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400819569477136:4871]
2025-10-15T10:56:59.171900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:59.171900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:59.173939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:59.175296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:59.176798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:59.179604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:59.182592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:59.183175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:59.212692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:59.212729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:59.212743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:59.212753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:59.212796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400819569477136:4871]
2025-10-15T10:56:59.212823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400819569477136:4871]
2025-10-15T10:56:59.212847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400819569477136:4871]
2025-10-15T10:56:59.212974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:59.213008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:59.213018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:59.213031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:59.213049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:59.214610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:59.252340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId: src_id|8cc81c6e-173c202f-f939014-dca8cc24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:59.275004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:59.354670Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:59.356145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:59.356184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:59.356626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:59.356642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:59.356657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:59.356880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400816769773059:4933]
2025-10-15T10:56:59.356903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:59.367117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 345 reason: error at write: Disconnected sessionId: src_id|8cc81c6e-173c202f-f939014-dca8cc24_0
2025-10-15T10:56:59.367521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 345 sessionId: src_id|8cc81c6e-173c202f-f939014-dca8cc24_0 is DEAD
2025-10-15T10:56:59.367842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc81c6e-173c202f-f939014-dca8cc24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:59.367903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc81c6e-173c202f-f939014-dca8cc24_0] Write session will restart in 0.006092s
2025-10-15T10:56:59.368010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc81c6e-173c202f-f939014-dca8cc24_0] Write session: Do CDS request
2025-10-15T10:56:59.368047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc81c6e-173c202f-f939014-dca8cc24_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:59.380590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:59.380640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 346
2025-10-15T10:56:59.380952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc81c6e-173c202f-f939014-dca8cc24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:59.381665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:59.381842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:59.381866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:59.381878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:59.383469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 346 sessionId:  describe result for acl check
2025-10-15T10:56:59.383594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:59.383612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:59.383621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:59.383640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400816769773100:5310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:59.386664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400816769773100:5310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:59.393798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400816769773100:5310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:59.403910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400816769773100:5310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:59.403970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400816769773100:5310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:59.403989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400816769773100:5310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:59.404020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:59.424801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:59.426650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:59.427473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:59.427498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:59.427537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:59.427786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:59.427988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400819569477319:4874]
2025-10-15T10:56:59.430238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:59.431276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:59.431500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:59.432714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:59.433051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.433068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.433075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.433082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.433089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.433095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.433103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.433110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.433117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.433125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.433131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.433139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.433146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.433169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.433215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.433333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.433384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.433436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.433494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.433546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.433596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.433650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.433701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.433754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.433804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.433856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.433907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.433959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.434008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.434097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.434161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.434219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.434273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.434333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.434385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.434445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.434498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.434558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.434609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.434680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.434732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.434791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.434842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.434897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.434948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.435007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.435055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.435113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.435163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.435218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.435269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.435324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.435400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.435457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.435507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.435562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.436086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:59.456931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400816769773257:4933]
2025-10-15T10:56:59.458525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:59.467155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:59.467196Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:59.467207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:59.467223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:59.467242Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 345 [2:7561400819569477319:4874]
2025-10-15T10:56:59.467283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:59.467362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:59.467377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:59.467390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:59.467400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:59.467437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:59.467456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:59.467477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:59.468353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.468372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.468382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.468391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:59.468601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:59.468619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.468744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.468900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.469069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:59.469113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 345
2025-10-15T10:56:59.469120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 345
2025-10-15T10:56:59.469128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400816769773184:5310], now have 1 active actors on pipe
2025-10-15T10:56:59.469148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400816769773086:2467], now have 1 active actors on pipe
2025-10-15T10:56:59.469166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400816769773257:4933], now have 1 active actors on pipe
2025-10-15T10:56:59.469209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 345, pipe: [1:7561400816769773257:4933]
2025-10-15T10:56:59.469188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400819569477314:4874]
2025-10-15T10:56:59.469199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400819569477314:4874]
2025-10-15T10:56:59.469209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400819569477314:4874]
2025-10-15T10:56:59.469233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:59.469291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:59.469305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:59.469306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:59.469319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:59.469448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:59.469464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:59.469595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:59.469614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:59.469635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400819569477314:4874]
2025-10-15T10:56:59.469655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:59.469683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:59.469740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:59.469771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:59.469788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:59.469795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:59.469829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:59.469862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:59.469921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:59.470353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:59.470391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:59.470468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:59.470802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 346 partition: 0 MaxSeqNo: 46 sessionId: src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0
2025-10-15T10:56:59.471611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc81c6e-173c202f-f939014-dca8cc24_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:59.490440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0] Write session: try to update token
2025-10-15T10:56:59.490504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:59.522326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:59.522363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:59.522378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:59.522391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:59.522433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400819569477314:4874]
2025-10-15T10:56:59.522461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400819569477314:4874]
2025-10-15T10:56:59.522487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400819569477314:4874]
2025-10-15T10:56:59.522619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:59.522664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:59.522699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:59.522734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:59.522764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:59.523834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:59.568522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId: src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:59.595688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:56:59.671592Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:56:59.681348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:59.681398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:59.681475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:59.681490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:59.681535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400819569477314:4874]
2025-10-15T10:56:59.681657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:59.681997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:56:59.681968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:56:59.682001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400816769773257:4933]
2025-10-15T10:56:59.682005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:56:59.682107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:56:59.714678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 346 reason: error at write: Disconnected sessionId: src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0
2025-10-15T10:56:59.715041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 346 sessionId: src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0 is DEAD
2025-10-15T10:56:59.715465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:56:59.715524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0] Write session will restart in 0.008483s
2025-10-15T10:56:59.715682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0] Write session: Do CDS request
2025-10-15T10:56:59.715722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:56:59.728318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:59.728292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:56:59.728332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 347
2025-10-15T10:56:59.728892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:56:59.729032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:56:59.729056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:56:59.729065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:56:59.730722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 347 sessionId:  describe result for acl check
2025-10-15T10:56:59.730891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:56:59.730921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:56:59.730937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:56:59.730960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400816769773334:5314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:56:59.733838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400816769773334:5314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:56:59.742424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400816769773334:5314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:56:59.748230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400816769773334:5314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:56:59.748273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400816769773334:5314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:56:59.748287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400816769773334:5314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:56:59.748311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:56:59.750531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:56:59.753889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:56:59.754613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:56:59.754637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:56:59.754673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:56:59.754888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:56:59.755077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400819569477493:4876]
2025-10-15T10:56:59.757104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:56:59.758109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:56:59.758310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:56:59.759336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:56:59.759608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.759621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.759625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.759629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.759634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.759637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.759643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.759649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.759655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.759661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.759667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.759675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.759681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.759687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.759731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.759823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.759866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.759909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.759941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.759988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.760021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.760055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.760083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.760116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.760156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.760202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.760252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.760289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.760318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.760364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:56:59.760406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.760456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:56:59.760503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.760548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:56:59.760594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.760644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:56:59.760693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.760740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:56:59.760780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.760832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:56:59.760875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.760912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:56:59.760944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.760982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:56:59.761017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.761049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:56:59.761076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.761107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:56:59.761135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.761180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:56:59.761212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.761251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.761282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.761318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.761348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.761382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.761753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:56:59.778762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:56:59.781967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400816769773453:4933]
2025-10-15T10:56:59.788366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:56:59.788407Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:56:59.788421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:56:59.788437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:56:59.788458Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 346 [2:7561400819569477493:4876]
2025-10-15T10:56:59.788507Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:56:59.788559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:56:59.788580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:59.788591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:59.788600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:59.788643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:56:59.788669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:56:59.788693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:56:59.790167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.790186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.790194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.790200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:56:59.790386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:56:59.790403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:56:59.790489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:56:59.790600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:56:59.790630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 346
2025-10-15T10:56:59.790725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 346, pipe: [1:7561400816769773453:4933]
2025-10-15T10:56:59.790737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:56:59.790791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 346
2025-10-15T10:56:59.790794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400816769773267:2467], now have 1 active actors on pipe
2025-10-15T10:56:59.790813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400816769773453:4933], now have 1 active actors on pipe
2025-10-15T10:56:59.790827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400816769773437:5314], now have 1 active actors on pipe
2025-10-15T10:56:59.790860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400819569477488:4876]
2025-10-15T10:56:59.790873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400819569477488:4876]
2025-10-15T10:56:59.790883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400819569477488:4876]
2025-10-15T10:56:59.790906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:56:59.790942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:56:59.790947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:56:59.790968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:56:59.790979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:56:59.791057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:56:59.791067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:56:59.791099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:59.791111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:59.791184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400819569477488:4876]
2025-10-15T10:56:59.791204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:56:59.791222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:56:59.791241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:56:59.791258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:59.791268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:59.791274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:56:59.791296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:59.791319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:56:59.791436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:59.791878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:56:59.791908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:56:59.791959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:56:59.792256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 347 partition: 0 MaxSeqNo: 46 sessionId: src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0
2025-10-15T10:56:59.792884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5c404c-778e7e1a-6ede2622-3ab121d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:56:59.814413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0] Write session: try to update token
2025-10-15T10:56:59.814463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:56:59.834811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:56:59.834839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:59.834861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400819569477488:4876]
2025-10-15T10:56:59.834962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:56:59.834965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:56:59.837125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:56:59.838620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:59.840332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:59.841474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:56:59.843312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:56:59.843849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:56:59.899655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:56:59.899700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:56:59.899714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:56:59.899727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:56:59.899768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400819569477488:4876]
2025-10-15T10:56:59.899796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400819569477488:4876]
2025-10-15T10:56:59.899821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400819569477488:4876]
2025-10-15T10:56:59.899952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:56:59.900014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:56:59.900018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:56:59.900038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:56:59.900045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:56:59.900049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:56:59.900099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:56:59.900122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:56:59.901627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:56:59.913380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId: src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:56:59.937597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:00.046526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:00.052791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:00.052841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:00.053599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:00.053741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:00.053912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:00.053935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:00.085622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 347 reason: error at write: Disconnected sessionId: src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0
2025-10-15T10:57:00.085991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 347 sessionId: src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0 is DEAD
2025-10-15T10:57:00.092148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:00.092202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0] Write session will restart in 0.005895s
2025-10-15T10:57:00.092331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0] Write session: Do CDS request
2025-10-15T10:57:00.092362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:00.104359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400816769773453:4933]
2025-10-15T10:57:00.106102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:00.106129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 348
2025-10-15T10:57:00.106270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:00.106820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:00.106983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:00.107000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:00.107011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:00.108689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 348 sessionId:  describe result for acl check
2025-10-15T10:57:00.108799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:00.108817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:00.108827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:00.108844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400821064740853:5324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:00.111295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400821064740853:5324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:00.118166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400821064740853:5324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:00.127572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400821064740853:5324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:00.127619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400821064740853:5324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:00.127636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400821064740853:5324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:00.127669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:00.133263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:00.135462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:00.136241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:00.136275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:00.136313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:00.136539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:00.136714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400823864444998:4885]
2025-10-15T10:57:00.139034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:00.139959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:00.140189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:00.141504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:00.141840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.141857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.141865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.141873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.141879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.141886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.141894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.141901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.141907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.141914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.141922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.141929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.141938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.141945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.141993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.142122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.142172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.142222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.142281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.142338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.142392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.142449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.142508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.142561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.142616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.142671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.142725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.142781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.142832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.142907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.142973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.143036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.143094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.143159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.143211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.143270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.143325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.143412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.143468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.143531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.143585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.143647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.143699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.143760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.143819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.143882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.143936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.144014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.144074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.144138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.144193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.144257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.144318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.144382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.144435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.144499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.145103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:00.161911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:00.181432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:00.181478Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:00.181497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:00.181515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:00.181539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 347 [2:7561400823864444998:4885]
2025-10-15T10:57:00.181591Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:00.181652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:00.181666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:00.181679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:00.181692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:00.181743Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:00.181766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:00.181790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:00.183551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.183580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.183596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.183608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:00.184296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 347
2025-10-15T10:57:00.184297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 347
2025-10-15T10:57:00.183859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:00.183885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.184039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.184231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.184466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:00.184554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400821064740942:5324], now have 1 active actors on pipe
2025-10-15T10:57:00.184577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400821064740766:2467], now have 1 active actors on pipe
2025-10-15T10:57:00.184640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:00.184662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:00.184700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400823864444993:4885]
2025-10-15T10:57:00.184716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400823864444993:4885]
2025-10-15T10:57:00.184728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400823864444993:4885]
2025-10-15T10:57:00.184772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:00.184800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:00.184813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:00.184825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:00.184845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:00.185028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:00.185046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:00.185142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|803a5b39-1107f238-ce629577-5cb28795_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:00.185179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:00.186433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 348 partition: 0 MaxSeqNo: 46 sessionId: src_id|803a5b39-1107f238-ce629577-5cb28795_0
2025-10-15T10:57:00.185198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:00.185209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:00.185243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:00.185288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:00.185414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400823864444993:4885]
2025-10-15T10:57:00.185442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:00.185464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:00.185486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:00.185995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:00.186056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:00.186118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:00.187255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5ce746-8663ddfb-e49eee1c-a3eb2b34_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|803a5b39-1107f238-ce629577-5cb28795_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:00.204996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400821064740966:4933], now have 1 active actors on pipe
2025-10-15T10:57:00.204415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400821064740966:4933]
2025-10-15T10:57:00.205069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 347, pipe: [1:7561400821064740966:4933]
2025-10-15T10:57:00.210285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|803a5b39-1107f238-ce629577-5cb28795_0] Write session: try to update token
2025-10-15T10:57:00.210340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|803a5b39-1107f238-ce629577-5cb28795_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:00.218748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:00.218789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:00.218835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400823864444993:4885]
2025-10-15T10:57:00.218953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:00.218970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:00.220942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:00.222210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:00.223669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:00.225451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:00.227704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:00.228260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:00.270920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:00.270957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:00.270971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:00.270984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:00.271021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400823864444993:4885]
2025-10-15T10:57:00.271049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400823864444993:4885]
2025-10-15T10:57:00.271072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400823864444993:4885]
2025-10-15T10:57:00.271227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:00.271252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:00.271268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:00.271294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:00.271335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:00.272556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:00.302270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId: src_id|803a5b39-1107f238-ce629577-5cb28795_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:00.326854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1015 10:57:00.330979059  821865 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:57:00.333166Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:57:00.414156Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:00.419298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:00.419364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:00.419886Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:00.419857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400821064740966:4933]
2025-10-15T10:57:00.419948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:00.420027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:00.420061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:00.429788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 348 reason: error at write: Disconnected sessionId: src_id|803a5b39-1107f238-ce629577-5cb28795_0
2025-10-15T10:57:00.430152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 348 sessionId: src_id|803a5b39-1107f238-ce629577-5cb28795_0 is DEAD
2025-10-15T10:57:00.430510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803a5b39-1107f238-ce629577-5cb28795_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:00.430575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803a5b39-1107f238-ce629577-5cb28795_0] Write session will restart in 0.005593s
2025-10-15T10:57:00.430724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803a5b39-1107f238-ce629577-5cb28795_0] Write session: Do CDS request
2025-10-15T10:57:00.430777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803a5b39-1107f238-ce629577-5cb28795_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:00.444036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:00.444076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 349
2025-10-15T10:57:00.444198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|803a5b39-1107f238-ce629577-5cb28795_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:00.444702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:00.444831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:00.444865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:00.444875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:00.446095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 349 sessionId:  describe result for acl check
2025-10-15T10:57:00.446209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:00.446226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:00.446234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:00.446251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400821064740986:5333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:00.448619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400821064740986:5333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:00.455296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400821064740986:5333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:00.465412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400821064740986:5333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:00.465460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400821064740986:5333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:00.465477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400821064740986:5333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:00.465509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:00.489915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:00.493717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:00.494578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:00.494608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:00.494654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:00.494918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:00.495109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400823864445194:4895]
2025-10-15T10:57:00.497437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:00.500317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:00.500577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:00.501950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:00.502305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.502323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.502331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.502339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.502347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.502355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.502363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.502371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.502379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.502386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.502395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.502401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.502409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.502416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.502468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.502584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.502642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.502698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.502753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.502808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.502863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.502918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.502973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.503029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.503084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.503139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.503193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.503246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.503296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.503423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.503494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.503560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.503616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.503679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.503736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.503793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.503851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.503914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.503970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.504046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.504103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.504163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.504218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.504280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.504332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.504398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.504452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.504517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.504572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.504635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.504687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.504753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.504802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.504862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.504916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.504978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.505517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:00.520315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400821064741147:4933]
2025-10-15T10:57:00.529923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:00.539317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:00.539380Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:00.539399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:00.539422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:00.539448Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 348 [2:7561400823864445194:4895]
2025-10-15T10:57:00.539505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:00.539567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:00.539583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:00.539596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:00.539608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:00.539666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:00.539698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:00.539722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:00.540807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.540835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.540851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.540864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:00.541138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:00.541165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.541317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.541524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.541418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 348
2025-10-15T10:57:00.541532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 348, pipe: [1:7561400821064741147:4933]
2025-10-15T10:57:00.541554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 348
2025-10-15T10:57:00.541775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:00.541867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400821064740971:2467], now have 1 active actors on pipe
2025-10-15T10:57:00.541900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400821064741147:4933], now have 1 active actors on pipe
2025-10-15T10:57:00.541923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400821064741059:5333], now have 1 active actors on pipe
2025-10-15T10:57:00.541991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:00.542020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:00.542058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400823864445189:4895]
2025-10-15T10:57:00.542079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400823864445189:4895]
2025-10-15T10:57:00.542094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400823864445189:4895]
2025-10-15T10:57:00.542133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:00.542166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:00.542193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:00.542205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:00.542214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:00.542405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:00.542432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:00.542504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:00.542541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:00.542571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:00.542581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:00.542620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:00.542663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:00.542832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400823864445189:4895]
2025-10-15T10:57:00.542870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:00.542901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:00.542919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:00.543409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:00.543441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:00.543532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:00.543760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 349 partition: 0 MaxSeqNo: 46 sessionId: src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0
2025-10-15T10:57:00.544490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|803a5b39-1107f238-ce629577-5cb28795_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:00.566232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0] Write session: try to update token
2025-10-15T10:57:00.566302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:00.570439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:00.570482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:00.570523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400823864445189:4895]
2025-10-15T10:57:00.570656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:00.570678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:00.573115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:00.619336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:00.620581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:00.622095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:00.627123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:00.627772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:00.641797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId: src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:00.657194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:00.657235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:00.657248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:00.657308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:00.657324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:00.657340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:00.657352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:00.657396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400823864445189:4895]
2025-10-15T10:57:00.657429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400823864445189:4895]
2025-10-15T10:57:00.657455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400823864445189:4895]
2025-10-15T10:57:00.657560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:00.657599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:00.657601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:00.657619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:00.657625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:00.658857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:00.667752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:00.804387Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:00.805820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:00.805862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:00.806389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:00.806459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400821064741147:4933]
2025-10-15T10:57:00.806558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:00.806571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:00.806582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:00.842411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 349 reason: error at write: Disconnected sessionId: src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0
2025-10-15T10:57:00.842753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 349 sessionId: src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0 is DEAD
2025-10-15T10:57:00.843152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:00.843220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0] Write session will restart in 0.009803s
2025-10-15T10:57:00.843364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0] Write session: Do CDS request
2025-10-15T10:57:00.843392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:00.857174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:00.857237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:00.857277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 350
2025-10-15T10:57:00.857724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:00.857872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:00.857890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:00.857900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:00.859689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 350 sessionId:  describe result for acl check
2025-10-15T10:57:00.859870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:00.859890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:00.859908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:00.859938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400821064741295:5337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:00.864602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400821064741295:5337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:00.867932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:00.870707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400821064741295:5337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:00.872672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:00.873548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:00.873587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:00.873625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:00.873872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:00.874073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400823864445386:4898]
2025-10-15T10:57:00.876479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:00.877370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:00.877579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:00.878739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:00.879079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.879100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.879108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.879116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.879124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.879132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.879140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.879147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.879153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.879160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.879167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.879175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.879181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.879187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.879235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.879337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.879408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.878921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400821064741295:5337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:00.879473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.878968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400821064741295:5337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:00.879538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.878986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400821064741295:5337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:00.879016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:00.879594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.879634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.879671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.879706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.879740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.879788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.879838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.879884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.879931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.879994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.880047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:00.880090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.880131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:00.880190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.880228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:00.880264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.880303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:00.880337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.880379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:00.880413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.880452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:00.880486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.880524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:00.880561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.880595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:00.880624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.880675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:00.880718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.880780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:00.880817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.880858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:00.880897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.880948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.880981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.881016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.881059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.881108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.881577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:00.895841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:00.905592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:00.905644Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:00.905661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:00.905680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:00.905702Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 349 [2:7561400823864445386:4898]
2025-10-15T10:57:00.905751Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:00.905802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:00.905816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:00.905827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:00.905836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:00.905878Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:00.905901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:00.905920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:00.906840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400821064741334:4933]
2025-10-15T10:57:00.906940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.906966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.906980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.906990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:00.907250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:00.907275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:00.907422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:00.907543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 349
2025-10-15T10:57:00.907554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 349
2025-10-15T10:57:00.907598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:00.907631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 349, pipe: [1:7561400821064741334:4933]
2025-10-15T10:57:00.907841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:00.907916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400821064741331:5337], now have 1 active actors on pipe
2025-10-15T10:57:00.907943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400821064741155:2467], now have 1 active actors on pipe
2025-10-15T10:57:00.907963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400821064741334:4933], now have 1 active actors on pipe
2025-10-15T10:57:00.908032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:00.908055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:00.908086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400823864445380:4898]
2025-10-15T10:57:00.908103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400823864445380:4898]
2025-10-15T10:57:00.908115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400823864445380:4898]
2025-10-15T10:57:00.908149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:00.908186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:00.908209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:00.908213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:00.908220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:00.908369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:00.908392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:00.908440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fc00e82-5680e52f-ac161622-686b317a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:00.908468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:00.908484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:00.908492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:00.908522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:00.908558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:00.908719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400823864445380:4898]
2025-10-15T10:57:00.908756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:00.908780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:00.908800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:00.909206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:00.909237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:00.909301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:00.909629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 350 partition: 0 MaxSeqNo: 46 sessionId: src_id|3fc00e82-5680e52f-ac161622-686b317a_0
2025-10-15T10:57:00.910301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d15867ef-d87c78ab-5473aee1-60e0d1a3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3fc00e82-5680e52f-ac161622-686b317a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:00.930847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc00e82-5680e52f-ac161622-686b317a_0] Write session: try to update token
2025-10-15T10:57:00.930897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc00e82-5680e52f-ac161622-686b317a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:00.940439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:00.940475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:00.940507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400823864445380:4898]
2025-10-15T10:57:00.940626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:00.940630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:00.942755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:00.948348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:00.949607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:00.950910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:00.952674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:00.953127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:01.012587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId: src_id|3fc00e82-5680e52f-ac161622-686b317a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:01.028590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:01.028634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:01.028642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:01.028687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:01.028697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:01.028705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:01.028713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:01.028739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400823864445380:4898]
2025-10-15T10:57:01.028763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400823864445380:4898]
2025-10-15T10:57:01.028777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400823864445380:4898]
2025-10-15T10:57:01.028885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:01.028906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:01.028923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:01.028962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:01.029022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:01.030109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:01.038085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:01.165051Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:01.166991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:01.167029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:01.167519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400821064741334:4933]
2025-10-15T10:57:01.167625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:01.167635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:01.167920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:01.184033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 350 reason: error at write: Disconnected sessionId: src_id|3fc00e82-5680e52f-ac161622-686b317a_0
2025-10-15T10:57:01.184346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 350 sessionId: src_id|3fc00e82-5680e52f-ac161622-686b317a_0 is DEAD
2025-10-15T10:57:01.184863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc00e82-5680e52f-ac161622-686b317a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:01.184921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc00e82-5680e52f-ac161622-686b317a_0] Write session will restart in 0.006678s
2025-10-15T10:57:01.185086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc00e82-5680e52f-ac161622-686b317a_0] Write session: Do CDS request
2025-10-15T10:57:01.185124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc00e82-5680e52f-ac161622-686b317a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:01.196953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc00e82-5680e52f-ac161622-686b317a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:01.204146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:01.204324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:01.204339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 351
2025-10-15T10:57:01.204702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:01.204846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:01.204875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:01.204884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:01.205984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 351 sessionId:  describe result for acl check
2025-10-15T10:57:01.206076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:01.206090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:01.206099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:01.206115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400825359708694:5348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:01.207738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400825359708694:5348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:01.216702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400825359708694:5348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:01.223088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400825359708694:5348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:01.223129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400825359708694:5348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:01.223143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400825359708694:5348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:01.223167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:01.229751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:01.231187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:01.231797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:01.231817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:01.231842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:01.232040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:01.232149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400828159412874:4900]
2025-10-15T10:57:01.233487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:01.234172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:01.234308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:01.235282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:01.235589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.235605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.235612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.235619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.235625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.235631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.235637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.235643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.235649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.235668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.235675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.235681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.235689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.235695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.235734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.235827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.235870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.235911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.235957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.236016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.236063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.236106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.236152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.236199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.236243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.236283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.236323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.236367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.236407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.236466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.236519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.236573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.236621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.236675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.236715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.236764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.236812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.236864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.236910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.236961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.237008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.237059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.237104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.237156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.237202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.237253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.237298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.237347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.237392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.237446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.237489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.237540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.237587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.237638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.237679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.237730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.238175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:01.253042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:01.263560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:01.263607Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:01.263624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:01.263640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:01.263662Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 350 [2:7561400828159412874:4900]
2025-10-15T10:57:01.263707Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:01.263755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:01.263767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:01.263778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:01.263788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:01.263830Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:01.263851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:01.263880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:01.265721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.265751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.265764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.265773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:01.266058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:01.266093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.266233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.266302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 350
2025-10-15T10:57:01.266395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 350
2025-10-15T10:57:01.266423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.266669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:01.266753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400825359708834:5348], now have 1 active actors on pipe
2025-10-15T10:57:01.266782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400825359708680:2467], now have 1 active actors on pipe
2025-10-15T10:57:01.266825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:01.266847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:01.266893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400828159412869:4900]
2025-10-15T10:57:01.266914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400828159412869:4900]
2025-10-15T10:57:01.266926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400828159412869:4900]
2025-10-15T10:57:01.266961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:01.266997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:01.267019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:01.267029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:01.267034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:01.267192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:01.267219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:01.267276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:01.267312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:01.267327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:01.267336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:01.267398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:01.267441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:01.267568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400828159412869:4900]
2025-10-15T10:57:01.267600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:01.267628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:01.267647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:01.267778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400825359708847:4933]
2025-10-15T10:57:01.268125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:01.268157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:01.268197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400825359708847:4933], now have 1 active actors on pipe
2025-10-15T10:57:01.268232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 350, pipe: [1:7561400825359708847:4933]
2025-10-15T10:57:01.268242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:01.268546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 351 partition: 0 MaxSeqNo: 46 sessionId: src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0
2025-10-15T10:57:01.269185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fc00e82-5680e52f-ac161622-686b317a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:01.305008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0] Write session: try to update token
2025-10-15T10:57:01.305049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:01.321347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:01.321379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:01.321412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400828159412869:4900]
2025-10-15T10:57:01.321529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:01.321576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:01.323519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:01.324978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:01.326411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:01.328127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:01.329918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:01.330673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:01.383205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:01.383233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:01.383243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:01.383292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:01.383305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:01.383318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:01.383328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:01.383384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400828159412869:4900]
2025-10-15T10:57:01.383411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400828159412869:4900]
2025-10-15T10:57:01.383433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400828159412869:4900]
2025-10-15T10:57:01.383557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:01.383581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:01.383588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:01.383645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:01.383678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:01.384667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:01.396693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId: src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:01.417358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:01.524357Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:01.526351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:01.526390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:01.526996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400825359708847:4933]
2025-10-15T10:57:01.527039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:01.527068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:01.527086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:01.527731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:01.550924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 351 reason: error at write: Disconnected sessionId: src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0
2025-10-15T10:57:01.551178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 351 sessionId: src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0 is DEAD
2025-10-15T10:57:01.551534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:01.551581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0] Write session will restart in 0.005902s
2025-10-15T10:57:01.551698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0] Write session: Do CDS request
2025-10-15T10:57:01.551750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:01.561682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:01.561798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:01.561732Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 352
2025-10-15T10:57:01.562362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:01.562518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:01.562556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:01.562570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:01.564244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 352 sessionId:  describe result for acl check
2025-10-15T10:57:01.564394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:01.564421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:01.564432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:01.564454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400825359708887:5356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:01.568368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400825359708887:5356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:01.576731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400825359708887:5356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:01.586157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400825359708887:5356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:01.586198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400825359708887:5356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:01.586214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400825359708887:5356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:01.586238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:01.596008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:01.597736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:01.598437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:01.598455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:01.598484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:01.598649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:01.598790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400828159413066:4911]
2025-10-15T10:57:01.600586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:01.601565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:01.601775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:01.602936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:01.603224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.603239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.603245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.603251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.603257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.603263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.603270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.603276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.603282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.603288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.603294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.603300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.603307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.603314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.603375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.603478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.603536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.603581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.603630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.603683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.603725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.603770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.603816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.603867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.603908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.603958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.604013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.604063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.604102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.604167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.604226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.604277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.604325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.604379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.604427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.604482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.604531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.604588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.604637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.604692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.604735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.604789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.604836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.604888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.604935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.604989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.605040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.605087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.605137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.605188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.605233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.605284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.605332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.605385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.605430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.605480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.605933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:01.625251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:01.627283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400825359709040:4933]
2025-10-15T10:57:01.667890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:01.667935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:01.667949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:01.667968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:01.668008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 351 [2:7561400828159413066:4911]
2025-10-15T10:57:01.668054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:01.668108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:01.668120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:01.668131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:01.668141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:01.668185Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:01.668205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:01.668225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:01.669239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.669261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.669274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.669286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:01.669540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:01.669562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.669694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.669895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.669990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 351
2025-10-15T10:57:01.669994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 351
2025-10-15T10:57:01.670107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 351, pipe: [1:7561400825359709040:4933]
2025-10-15T10:57:01.670138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:01.670229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400825359708865:2467], now have 1 active actors on pipe
2025-10-15T10:57:01.670258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400825359709033:5356], now have 1 active actors on pipe
2025-10-15T10:57:01.670281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400825359709040:4933], now have 1 active actors on pipe
2025-10-15T10:57:01.670348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:01.670373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:01.670408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400828159413060:4911]
2025-10-15T10:57:01.670426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400828159413060:4911]
2025-10-15T10:57:01.670437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400828159413060:4911]
2025-10-15T10:57:01.670476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:01.670522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:01.670549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:01.670550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:01.670564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:01.670718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:01.670741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:01.670801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb117135-f137e412-d4fd234c-26278f4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:01.670833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:01.670853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:01.670864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:01.670896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:01.670931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:01.671048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400828159413060:4911]
2025-10-15T10:57:01.671082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:01.671110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:01.671128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:01.671655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:01.671695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:01.671788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:01.672093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 352 partition: 0 MaxSeqNo: 46 sessionId: src_id|bb117135-f137e412-d4fd234c-26278f4a_0
2025-10-15T10:57:01.672862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e6f0edd-9ceef1f1-40eb8bdc-608d7a25_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bb117135-f137e412-d4fd234c-26278f4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:01.693489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb117135-f137e412-d4fd234c-26278f4a_0] Write session: try to update token
2025-10-15T10:57:01.693543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb117135-f137e412-d4fd234c-26278f4a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:01.701077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:01.701103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:01.701138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400828159413060:4911]
2025-10-15T10:57:01.701251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:01.701311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:01.703073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:01.704207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:01.705450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:01.706516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:01.707980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:01.708499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:01.767615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId: src_id|bb117135-f137e412-d4fd234c-26278f4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:01.770651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:01.770677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:01.770690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:01.770701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:01.770737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400828159413060:4911]
2025-10-15T10:57:01.770760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400828159413060:4911]
2025-10-15T10:57:01.770779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400828159413060:4911]
2025-10-15T10:57:01.770910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:01.770922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:01.770929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:01.770962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:01.770959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:01.770975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:01.771024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:01.771063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:01.771955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:01.789722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:01.906535Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:01.909614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:01.909652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:01.910198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:01.910258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:01.910273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:01.910340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400825359709040:4933]
2025-10-15T10:57:01.910394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:01.918401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 352 reason: error at write: Disconnected sessionId: src_id|bb117135-f137e412-d4fd234c-26278f4a_0
2025-10-15T10:57:01.918683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 352 sessionId: src_id|bb117135-f137e412-d4fd234c-26278f4a_0 is DEAD
2025-10-15T10:57:01.919056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb117135-f137e412-d4fd234c-26278f4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:01.919102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb117135-f137e412-d4fd234c-26278f4a_0] Write session will restart in 0.006481s
2025-10-15T10:57:01.919232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb117135-f137e412-d4fd234c-26278f4a_0] Write session: Do CDS request
2025-10-15T10:57:01.919275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb117135-f137e412-d4fd234c-26278f4a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:01.929714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb117135-f137e412-d4fd234c-26278f4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:01.929669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:01.929701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 353
2025-10-15T10:57:01.930156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:01.930280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:01.930300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:01.930308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:01.931408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 353 sessionId:  describe result for acl check
2025-10-15T10:57:01.931512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:01.931522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:01.931530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:01.931547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400825359709069:5360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:01.934384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400825359709069:5360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:01.938820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400825359709069:5360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:01.946747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400825359709069:5360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:01.946789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400825359709069:5360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:01.946804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400825359709069:5360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:01.946831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:01.972408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:01.974170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:01.974951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:01.974977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:01.975016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:01.975232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:01.975425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400828159413277:4919]
2025-10-15T10:57:01.977166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:01.977864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:01.977999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:01.978956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:01.979227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.979242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.979250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.979256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.979263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.979269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.979277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.979284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.979290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.979296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.979303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.979310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.979316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.979324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.979385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.979485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.979529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.979574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.979617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.979667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.979710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.979758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.979802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.979850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.979895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.979940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.979987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.980040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.980084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.980149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:01.980206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.980262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:01.980306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.980358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:01.980403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.980458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:01.980509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.980563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:01.980610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.980662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:01.980709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.980760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:01.980804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.980855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:01.980903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.980956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:01.980999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.981051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:01.981098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.981153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:01.981193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.981245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:01.981291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.981346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:01.981391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.981440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:01.981883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:01.997480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:02.010856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400829654676533:4933]
2025-10-15T10:57:02.012203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:02.012236Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:02.012251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:02.012268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:02.012289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 352 [2:7561400828159413277:4919]
2025-10-15T10:57:02.012336Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:02.012388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:02.012408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:02.012419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:02.012430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:02.012471Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:02.012491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:02.012509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:02.013319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.013337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.013350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.013360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:02.013544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:02.013565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.013667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.013825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.013872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 352, pipe: [1:7561400829654676533:4933]
2025-10-15T10:57:02.013936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 352
2025-10-15T10:57:02.013988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 352
2025-10-15T10:57:02.014032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:02.014106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400829654676533:4933], now have 1 active actors on pipe
2025-10-15T10:57:02.014133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400825359709054:2467], now have 1 active actors on pipe
2025-10-15T10:57:02.014153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400825359709141:5360], now have 1 active actors on pipe
2025-10-15T10:57:02.014193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400828159413272:4919]
2025-10-15T10:57:02.014210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400828159413272:4919]
2025-10-15T10:57:02.014222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400828159413272:4919]
2025-10-15T10:57:02.014258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:02.014289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:02.014322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:02.014324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:02.014337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:02.014486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:02.014506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:02.014553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:02.014575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:02.014682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400828159413272:4919]
2025-10-15T10:57:02.014713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:02.014745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:02.014770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:02.014794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:02.014810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:02.014818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:02.014850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:02.014879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:02.014993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:02.015511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:02.015536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:02.015594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:02.015977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 353 partition: 0 MaxSeqNo: 46 sessionId: src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0
2025-10-15T10:57:02.016670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb117135-f137e412-d4fd234c-26278f4a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:02.035676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0] Write session: try to update token
2025-10-15T10:57:02.035727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:02.097189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:02.097211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:02.097219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:02.097225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:02.097246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400828159413272:4919]
2025-10-15T10:57:02.097261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400828159413272:4919]
2025-10-15T10:57:02.097275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400828159413272:4919]
2025-10-15T10:57:02.097430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:02.097467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:02.097487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:02.097490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:02.097529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:02.098463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:02.120452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId: src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:02.141877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:02.232030Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:02.242370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:02.242411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:02.242467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:02.242480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:02.242516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400828159413272:4919]
2025-10-15T10:57:02.242769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:02.242996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400829654676533:4933]
2025-10-15T10:57:02.243072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:02.243004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:02.243095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:02.243104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:02.275548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 353 reason: error at write: Disconnected sessionId: src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0
2025-10-15T10:57:02.275844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 353 sessionId: src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0 is DEAD
2025-10-15T10:57:02.276269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:02.276326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0] Write session will restart in 0.005338s
2025-10-15T10:57:02.276479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0] Write session: Do CDS request
2025-10-15T10:57:02.276522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:02.286258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:02.286375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:02.286296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 354
2025-10-15T10:57:02.286891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:02.287044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:02.287068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:02.287077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:02.288325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 354 sessionId:  describe result for acl check
2025-10-15T10:57:02.288426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:02.288444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:02.288453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:02.288468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400829654676634:5366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:02.290611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400829654676634:5366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:02.298811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400829654676634:5366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:02.304813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400829654676634:5366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:02.304856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400829654676634:5366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:02.304870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400829654676634:5366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:02.304898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:02.311208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:02.313020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:02.313785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:02.313819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:02.313861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:02.314116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:02.314305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400832454380756:4921]
2025-10-15T10:57:02.316634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:02.317650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:02.317860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:02.319202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:02.319575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:02.319591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:02.319599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:02.319607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:02.319614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:02.319621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:02.319629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:02.319637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:02.319645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:02.319653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:02.319660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:02.319668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.319675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.319682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.319735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:02.319855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:02.319911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:02.319964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:02.320031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:02.320093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:02.320153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:02.320205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:02.320257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:02.320317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:02.320362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:02.320421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.320474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.320529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.320582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:02.320658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:02.320729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:02.320792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:02.320850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:02.320912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:02.320966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:02.321024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:02.321077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:02.321146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:02.321198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:02.321260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:02.321317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:02.321372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:02.321430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:02.321493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:02.321551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:02.321614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:02.321668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:02.321732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:02.321785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:02.321846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:02.321902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.321965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.322018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.322081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.322132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.322192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.322749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:02.337848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:02.343020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400829654676736:4933]
2025-10-15T10:57:02.347245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:02.347295Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:02.347319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:02.347340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:02.347381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 353 [2:7561400832454380756:4921]
2025-10-15T10:57:02.347439Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:02.347502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:02.347517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:02.347531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:02.347544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:02.347595Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:02.347625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:02.347650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:02.358734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 353
2025-10-15T10:57:02.358734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 353
2025-10-15T10:57:02.358816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 353, pipe: [1:7561400829654676736:4933]
2025-10-15T10:57:02.357983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.358013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.358028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.358041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:02.358322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:02.358340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.358494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.358694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.358952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:02.359038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400829654676554:2467], now have 1 active actors on pipe
2025-10-15T10:57:02.359062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400829654676729:5366], now have 1 active actors on pipe
2025-10-15T10:57:02.359084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400829654676736:4933], now have 1 active actors on pipe
2025-10-15T10:57:02.359152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:02.359174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:02.359212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400832454380751:4921]
2025-10-15T10:57:02.359227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400832454380751:4921]
2025-10-15T10:57:02.359240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400832454380751:4921]
2025-10-15T10:57:02.359283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:02.359318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:02.359333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:02.359360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:02.361591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 354 partition: 0 MaxSeqNo: 46 sessionId: src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0
2025-10-15T10:57:02.359870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:02.360097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:02.360116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:02.360193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:02.360225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:02.360245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:02.360256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:02.360296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:02.360345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:02.360479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400832454380751:4921]
2025-10-15T10:57:02.360511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:02.360555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:02.360562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:02.361187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:02.361210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:02.361303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:02.362297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a537347-fc0b5057-7dca1b90-45cea2da_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:02.381778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0] Write session: try to update token
2025-10-15T10:57:02.381831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:02.442610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:02.442666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:02.442691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:02.442705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:02.442761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400832454380751:4921]
2025-10-15T10:57:02.442804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400832454380751:4921]
2025-10-15T10:57:02.442843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400832454380751:4921]
2025-10-15T10:57:02.443080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:02.443142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:02.443153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:02.443183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:02.443198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:02.445141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:02.465475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId: src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:02.489115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:02.590270Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:02.607808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:02.607849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:02.607903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:02.607916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:02.607947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400832454380751:4921]
2025-10-15T10:57:02.608149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:02.608501Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:02.608500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:02.608669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:02.608693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:02.618076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 354 reason: error at write: Disconnected sessionId: src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0
2025-10-15T10:57:02.618423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 354 sessionId: src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0 is DEAD
2025-10-15T10:57:02.618793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:02.618843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0] Write session will restart in 0.008672s
2025-10-15T10:57:02.619003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0] Write session: Do CDS request
2025-10-15T10:57:02.619040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:02.634278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:02.644428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400829654676736:4933]
2025-10-15T10:57:02.644618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:02.644638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 355
2025-10-15T10:57:02.644997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:02.645112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:02.645132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:02.645142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:02.647084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 355 sessionId:  describe result for acl check
2025-10-15T10:57:02.647194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:02.647210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:02.647219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:02.647236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400829654676794:5376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:02.649796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400829654676794:5376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:02.657095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400829654676794:5376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:02.665692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400829654676794:5376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:02.665742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400829654676794:5376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:02.665761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400829654676794:5376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:02.665794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:02.674706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:02.677146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:02.678057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:02.678084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:02.678131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:02.678390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:02.678583Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400832454380950:4924]
2025-10-15T10:57:02.680840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:02.681900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:02.682124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:02.683364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:02.683702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:02.683720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:02.683727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:02.683734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:02.683741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:02.683748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:02.683755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:02.683762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:02.683769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:02.683776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:02.683783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:02.683791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.683798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.683805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.683853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:02.683963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:02.684027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:02.684087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:02.684133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:02.684186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:02.684235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:02.684285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:02.684334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:02.684383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:02.684426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:02.684471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.684519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.684564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.684610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:02.684678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:02.684740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:02.684796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:02.684845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:02.684901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:02.684946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:02.685000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:02.685050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:02.685106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:02.685153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:02.685210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:02.685260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:02.685314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:02.685361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:02.685417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:02.685474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:02.685528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:02.685575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:02.685629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:02.685679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:02.685733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:02.685781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.685830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.685879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.685933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.685978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.686026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.686507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:02.706033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:02.715527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:02.715561Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:02.715571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:02.715585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:02.715608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 354 [2:7561400832454380950:4924]
2025-10-15T10:57:02.715657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:02.715709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:02.715723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:02.715734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:02.715744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:02.715791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:02.715807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:02.715822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:02.717322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.717340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.717350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.717357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:02.717609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:02.717626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:02.717715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:02.717829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:02.718000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:02.718074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400829654676759:2467], now have 1 active actors on pipe
2025-10-15T10:57:02.718094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400829654676931:5376], now have 1 active actors on pipe
2025-10-15T10:57:02.718041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 354
2025-10-15T10:57:02.718117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400832454380939:4924]
2025-10-15T10:57:02.718133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400832454380939:4924]
2025-10-15T10:57:02.718146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400832454380939:4924]
2025-10-15T10:57:02.718158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 354
2025-10-15T10:57:02.718180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:02.718213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:02.718233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:02.718247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:02.718250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:02.718416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:02.718442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:02.718512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:02.718535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:02.718648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400832454380939:4924]
2025-10-15T10:57:02.718677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:02.718700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:02.718746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|505b893-6658208b-5533d1d2-b4a5d026_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:02.718780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:02.718802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:02.718812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:02.718848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:02.718891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:02.719011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:02.719621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:02.719649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:02.719694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:02.719983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 355 partition: 0 MaxSeqNo: 46 sessionId: src_id|505b893-6658208b-5533d1d2-b4a5d026_0
2025-10-15T10:57:02.720758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dbb7ba5-800372b5-7fa336a3-948f356_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|505b893-6658208b-5533d1d2-b4a5d026_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:02.739531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505b893-6658208b-5533d1d2-b4a5d026_0] Write session: try to update token
2025-10-15T10:57:02.739588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505b893-6658208b-5533d1d2-b4a5d026_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:02.744924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400829654676944:4933]
2025-10-15T10:57:02.745431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400829654676944:4933], now have 1 active actors on pipe
2025-10-15T10:57:02.745513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 354, pipe: [1:7561400829654676944:4933]
2025-10-15T10:57:02.776807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:02.776840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:02.776853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:02.776864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:02.776906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400832454380939:4924]
2025-10-15T10:57:02.776935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400832454380939:4924]
2025-10-15T10:57:02.776960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400832454380939:4924]
2025-10-15T10:57:02.777074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:02.777110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:02.777129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:02.777238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:02.777277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:02.781437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:02.821837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId: src_id|505b893-6658208b-5533d1d2-b4a5d026_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:02.842271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:02.926654Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:02.939184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:02.939231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:02.939394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:02.939415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:02.939454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400832454380939:4924]
2025-10-15T10:57:02.939657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:02.939735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:02.939924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400829654676944:4933]
2025-10-15T10:57:02.940029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:02.940053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:02.940123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:02.952214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 355 reason: error at write: Disconnected sessionId: src_id|505b893-6658208b-5533d1d2-b4a5d026_0
2025-10-15T10:57:02.952516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 355 sessionId: src_id|505b893-6658208b-5533d1d2-b4a5d026_0 is DEAD
2025-10-15T10:57:02.952851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505b893-6658208b-5533d1d2-b4a5d026_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:02.952919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505b893-6658208b-5533d1d2-b4a5d026_0] Write session will restart in 0.009474s
2025-10-15T10:57:02.953055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505b893-6658208b-5533d1d2-b4a5d026_0] Write session: Do CDS request
2025-10-15T10:57:02.953091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505b893-6658208b-5533d1d2-b4a5d026_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:02.969507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505b893-6658208b-5533d1d2-b4a5d026_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:02.977544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:02.977582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 356
2025-10-15T10:57:02.977975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:02.978103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:02.978128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:02.978137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:02.979077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 356 sessionId:  describe result for acl check
2025-10-15T10:57:02.979177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:02.979194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:02.979204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:02.979221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400829654676968:5380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:02.981226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400829654676968:5380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:02.986913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400829654676968:5380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:02.993455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400829654676968:5380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:02.993502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400829654676968:5380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:02.993519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400829654676968:5380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:02.993547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:03.018325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:03.022938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:03.023786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:03.023817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:03.023860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:03.024096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:03.024288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400836749348454:4932]
2025-10-15T10:57:03.025999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:03.026948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:03.027168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:03.028137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:03.028400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.028411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.028415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.028420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.028424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.028428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.028432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.028438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.028442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.028448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.028452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.028456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.028460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.028465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.028501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.028579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.028614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.028646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.028693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.028739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.028777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.028808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.028840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.028877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.028912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.028949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.028991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.029032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.029063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.029113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.029156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.029208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.029265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.029312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.029345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.029395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.029445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.029497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.029531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.029572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.029605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.029645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.029681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.029726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.029781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.029823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.029858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.029903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.029936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.029974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.030008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.030049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.030097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.030151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.030185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.030238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.030675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:03.040387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400833949644438:4933]
2025-10-15T10:57:03.045936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:03.055188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:03.055229Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:03.055245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:03.055264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:03.055288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 355 [2:7561400836749348454:4932]
2025-10-15T10:57:03.055343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:03.055412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:03.055426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:03.055438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:03.055451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:03.055501Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:03.055528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:03.055549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:03.060158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.060191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.060208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.060219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:03.060533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:03.060561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.060697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.060811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 355
2025-10-15T10:57:03.060815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 355, pipe: [1:7561400833949644438:4933]
2025-10-15T10:57:03.060958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 355
2025-10-15T10:57:03.060958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.061193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:03.061289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400829654676952:2467], now have 1 active actors on pipe
2025-10-15T10:57:03.061316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400833949644438:4933], now have 1 active actors on pipe
2025-10-15T10:57:03.061337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400829654677004:5380], now have 1 active actors on pipe
2025-10-15T10:57:03.061399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:03.061424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:03.061470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400836749348448:4932]
2025-10-15T10:57:03.061488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400836749348448:4932]
2025-10-15T10:57:03.061501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400836749348448:4932]
2025-10-15T10:57:03.061539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:03.061598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:03.061612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:03.061619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:03.061632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:03.061770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:03.061787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:03.061844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33bef242-df9511ef-9a967079-985351c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:03.061879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:03.061897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:03.061907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:03.061972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:03.062016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:03.062127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400836749348448:4932]
2025-10-15T10:57:03.062165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:03.062186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:03.062211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:03.062663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:03.062688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:03.062749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:03.063058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 356 partition: 0 MaxSeqNo: 46 sessionId: src_id|33bef242-df9511ef-9a967079-985351c5_0
2025-10-15T10:57:03.063897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505b893-6658208b-5533d1d2-b4a5d026_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|33bef242-df9511ef-9a967079-985351c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:03.085021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33bef242-df9511ef-9a967079-985351c5_0] Write session: try to update token
2025-10-15T10:57:03.085078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33bef242-df9511ef-9a967079-985351c5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:03.138710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:03.138742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:03.138772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400836749348448:4932]
2025-10-15T10:57:03.138917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:03.138958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:03.142509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:03.143830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:03.145080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:03.146371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:03.148135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:03.152267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId: src_id|33bef242-df9511ef-9a967079-985351c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:03.179886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:03.181107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:03.189077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:03.189110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:03.189121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:03.189171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:03.189183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:03.189195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:03.189204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:03.189233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400836749348448:4932]
2025-10-15T10:57:03.189249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400836749348448:4932]
2025-10-15T10:57:03.189268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400836749348448:4932]
2025-10-15T10:57:03.189387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:03.189398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:03.189414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:03.189426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:03.189433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:03.189447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:03.189452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:03.190216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:03.317986Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:03.319765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400833949644438:4933]
2025-10-15T10:57:03.319773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:03.319787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:03.319880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:03.320007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:03.368164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 356 reason: error at write: Disconnected sessionId: src_id|33bef242-df9511ef-9a967079-985351c5_0
2025-10-15T10:57:03.368475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 356 sessionId: src_id|33bef242-df9511ef-9a967079-985351c5_0 is DEAD
2025-10-15T10:57:03.368813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33bef242-df9511ef-9a967079-985351c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:03.368866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33bef242-df9511ef-9a967079-985351c5_0] Write session will restart in 0.007902s
2025-10-15T10:57:03.369003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33bef242-df9511ef-9a967079-985351c5_0] Write session: Do CDS request
2025-10-15T10:57:03.369042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33bef242-df9511ef-9a967079-985351c5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:03.375680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:03.381067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:03.381563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33bef242-df9511ef-9a967079-985351c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:03.382007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:03.382044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:03.382091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:03.382147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:03.382201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 357
2025-10-15T10:57:03.382326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:03.382468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:03.382473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400836749348658:4942]
2025-10-15T10:57:03.382586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:03.382609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:03.382618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:03.383781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 357 sessionId:  describe result for acl check
2025-10-15T10:57:03.383889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:03.383909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:03.383917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:03.383933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400833949644608:5388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:03.383963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:03.384810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:03.385070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:03.386492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400833949644608:5388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:03.386535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:03.386921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.386943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.386950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.386956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.386962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.386968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.386974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.386980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.386986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.386992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.386999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.387005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.387012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.387020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.387063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.387158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.387200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.387243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.387286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.387331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.387409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.387451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.387503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.387547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.387593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.387638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.387684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.387729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.387771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.387838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.387890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.387946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.387996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.388066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.388110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.388175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.388236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.388286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.388332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.388383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.388429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.388490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.388537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.388588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.388641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.388697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.388739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.388790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.388834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.388885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.388938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.388989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.389042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.389095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.389139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.389190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.389641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:03.392787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400833949644608:5388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:03.399553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400833949644608:5388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:03.399599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400833949644608:5388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:03.399617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400833949644608:5388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:03.399643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:03.406006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:03.415663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:03.415712Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:03.415729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:03.415748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:03.415772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 356 [2:7561400836749348658:4942]
2025-10-15T10:57:03.415824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:03.415881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:03.415895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:03.415907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:03.415918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:03.415973Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:03.415993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:03.416013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:03.417036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.417061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.417075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.417087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:03.417385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:03.417415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.417570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.417563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 356
2025-10-15T10:57:03.417638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 356
2025-10-15T10:57:03.417774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.418025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:03.418114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400833949644461:2467], now have 1 active actors on pipe
2025-10-15T10:57:03.418146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400833949644641:5388], now have 1 active actors on pipe
2025-10-15T10:57:03.418215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:03.418240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:03.418276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400836749348653:4942]
2025-10-15T10:57:03.418296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400836749348653:4942]
2025-10-15T10:57:03.418310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400836749348653:4942]
2025-10-15T10:57:03.418350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:03.418385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:03.418403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:03.418411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:03.418428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:03.418612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:03.418639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:03.418704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16154a9c-b0004ef8-75a65727-d0db9911_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:03.418738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:03.418759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:03.418768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:03.418797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:03.418832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:03.418950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400836749348653:4942]
2025-10-15T10:57:03.418987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:03.419016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:03.419043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:03.419542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:03.419572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:03.419638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:03.420278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 357 partition: 0 MaxSeqNo: 46 sessionId: src_id|16154a9c-b0004ef8-75a65727-d0db9911_0
2025-10-15T10:57:03.420621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400833949644646:4933]
2025-10-15T10:57:03.420957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33bef242-df9511ef-9a967079-985351c5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|16154a9c-b0004ef8-75a65727-d0db9911_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:03.420981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400833949644646:4933], now have 1 active actors on pipe
2025-10-15T10:57:03.421053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 356, pipe: [1:7561400833949644646:4933]
2025-10-15T10:57:03.438256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16154a9c-b0004ef8-75a65727-d0db9911_0] Write session: try to update token
2025-10-15T10:57:03.438297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16154a9c-b0004ef8-75a65727-d0db9911_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:03.481777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:03.481815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:03.481860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400836749348653:4942]
2025-10-15T10:57:03.481975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:03.481983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:03.484478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:03.486074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:03.487721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:03.488749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:03.490298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:03.490722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:03.520079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId: src_id|16154a9c-b0004ef8-75a65727-d0db9911_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:03.522567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:03.522628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:03.522655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:03.522679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:03.522749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400836749348653:4942]
2025-10-15T10:57:03.522807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400836749348653:4942]
2025-10-15T10:57:03.522858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400836749348653:4942]
2025-10-15T10:57:03.522986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:03.523022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:03.523027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:03.523033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:03.523044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:03.523058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:03.523085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:03.523104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:03.524160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:03.541709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:03.666877Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:03.675065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:03.675107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:03.675643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400833949644646:4933]
2025-10-15T10:57:03.675680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:03.675692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:03.675738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:03.675830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:03.703139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 357 reason: error at write: Disconnected sessionId: src_id|16154a9c-b0004ef8-75a65727-d0db9911_0
2025-10-15T10:57:03.703511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 357 sessionId: src_id|16154a9c-b0004ef8-75a65727-d0db9911_0 is DEAD
2025-10-15T10:57:03.703819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16154a9c-b0004ef8-75a65727-d0db9911_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:03.703851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16154a9c-b0004ef8-75a65727-d0db9911_0] Write session will restart in 0.005316s
2025-10-15T10:57:03.703983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16154a9c-b0004ef8-75a65727-d0db9911_0] Write session: Do CDS request
2025-10-15T10:57:03.704016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16154a9c-b0004ef8-75a65727-d0db9911_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:03.712615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16154a9c-b0004ef8-75a65727-d0db9911_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:03.712664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:03.712708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 358
2025-10-15T10:57:03.713108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:03.713235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:03.713258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:03.713269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:03.714556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 358 sessionId:  describe result for acl check
2025-10-15T10:57:03.714685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:03.714704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:03.714713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:03.714732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400833949644720:5392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:03.717463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400833949644720:5392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:03.726465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400833949644720:5392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:03.733846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:03.734400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400833949644720:5392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:03.734436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400833949644720:5392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:03.734450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400833949644720:5392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:03.734479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:03.735144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:03.735838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:03.735867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:03.735902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:03.736119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:03.736286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400836749348846:4945]
2025-10-15T10:57:03.738330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:03.739056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:03.739230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:03.740444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:03.740741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.740756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.740763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.740770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.740776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.740784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.740791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.740797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.740804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.740810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.740816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.740823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.740829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.740835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.740879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.740981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.741031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.741083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.741133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.741183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.741233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.741281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.741330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.741380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.741428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.741479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.741526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.741577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.741619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.741687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:03.741744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.741801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:03.741851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.741906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:03.741954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.742013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:03.742065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.742121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:03.742169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.742225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:03.742274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.742328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:03.742378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.742433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:03.742484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.742544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:03.742590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.742647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:03.742698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.742755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:03.742803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.742859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.742909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.742966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.743012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.743068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.743584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:03.758531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:03.776131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400833949644833:4933]
2025-10-15T10:57:03.778909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:03.778945Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:03.778960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:03.778978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:03.778999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 357 [2:7561400836749348846:4945]
2025-10-15T10:57:03.779046Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:03.779098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:03.779110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:03.779121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:03.779132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:03.779173Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:03.779194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:03.779212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:03.780246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.780270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.780283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.780293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:03.780539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:03.780561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:03.780688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:03.780868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:03.780844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 357, pipe: [1:7561400833949644833:4933]
2025-10-15T10:57:03.780880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 357
2025-10-15T10:57:03.780956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 357
2025-10-15T10:57:03.781112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:03.781191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400833949644833:4933], now have 1 active actors on pipe
2025-10-15T10:57:03.781218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400833949644828:5392], now have 1 active actors on pipe
2025-10-15T10:57:03.781239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400833949644650:2467], now have 1 active actors on pipe
2025-10-15T10:57:03.781287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:03.781315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:03.781363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400836749348840:4945]
2025-10-15T10:57:03.781378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400836749348840:4945]
2025-10-15T10:57:03.781391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400836749348840:4945]
2025-10-15T10:57:03.781426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:03.781488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:03.781502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:03.781515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:03.781525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:03.781657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:03.781676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:03.781732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:03.781761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:03.781782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:03.781792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:03.781823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:03.781859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:03.782001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400836749348840:4945]
2025-10-15T10:57:03.782037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:03.782049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:03.782079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:03.782505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:03.782529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:03.782582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:03.782923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 358 partition: 0 MaxSeqNo: 46 sessionId: src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0
2025-10-15T10:57:03.783667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16154a9c-b0004ef8-75a65727-d0db9911_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:03.804337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0] Write session: try to update token
2025-10-15T10:57:03.804388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:03.809815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:03.809846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:03.809881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400836749348840:4945]
2025-10-15T10:57:03.809991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:03.809997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:03.812005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:03.813553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:03.814861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:03.816228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:03.818089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:03.818564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:03.854790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:03.854815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:03.854828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:03.854838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:03.854876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400836749348840:4945]
2025-10-15T10:57:03.854901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400836749348840:4945]
2025-10-15T10:57:03.854923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400836749348840:4945]
2025-10-15T10:57:03.855057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:03.855053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:03.855082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:03.855092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:03.855131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:03.856573Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:03.869016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId: src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:03.901199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:03.999541Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:04.001010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:04.001044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:04.001493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:04.001647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400833949644833:4933]
2025-10-15T10:57:04.001688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:04.001723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:04.001743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:04.029472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 358 reason: error at write: Disconnected sessionId: src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0
2025-10-15T10:57:04.029703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 358 sessionId: src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0 is DEAD
2025-10-15T10:57:04.030058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:04.030110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0] Write session will restart in 0.006672s
2025-10-15T10:57:04.030233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0] Write session: Do CDS request
2025-10-15T10:57:04.030275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:04.042182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:04.047446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:04.047480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 359
2025-10-15T10:57:04.047810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:04.047891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:04.047906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:04.047913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:04.049017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 359 sessionId:  describe result for acl check
2025-10-15T10:57:04.049121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:04.049139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:04.049148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:04.049162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400838244612234:5402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:04.051054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400838244612234:5402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:04.057804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400838244612234:5402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:04.064981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400838244612234:5402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:04.065032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400838244612234:5402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:04.065048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400838244612234:5402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:04.065088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:04.071166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:04.073066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:04.073757Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:04.073777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:04.073810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:04.074049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:04.074173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400841044316340:4948]
2025-10-15T10:57:04.076079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:04.076877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:04.077039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:04.078019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:04.078285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.078301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.078305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.078310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.078315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.078321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.078325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.078330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.078334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.078341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.078348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.078356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.078363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.078369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.078415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.078500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.078545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.078591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.078635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.078688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.078738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.078788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.078820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.078858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.078909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.078950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.078999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.079044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.079085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.079154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.079216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.079280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.079333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.079398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.079444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.079495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.079532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.079578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.079620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.079666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.079717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.079764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.079813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.079862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.079901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.079972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.080041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.080105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.080163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.080226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.080283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.080344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.080400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.080472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.080556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.080618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.081143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:04.098407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:04.101736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400838244612343:4933]
2025-10-15T10:57:04.115448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:04.115488Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:04.115503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:04.115520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:04.115543Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 358 [2:7561400841044316340:4948]
2025-10-15T10:57:04.115587Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:04.115632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:04.115643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:04.115655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:04.115664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:04.115715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:04.115736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:04.115753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:04.117172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.117193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.117201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.117209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:04.117382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:04.117400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.117492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.117622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.117705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 358, pipe: [1:7561400838244612343:4933]
2025-10-15T10:57:04.117820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:04.117835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 358
2025-10-15T10:57:04.117930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400838244612343:4933], now have 1 active actors on pipe
2025-10-15T10:57:04.117949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 358
2025-10-15T10:57:04.117965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400838244612145:2467], now have 1 active actors on pipe
2025-10-15T10:57:04.117995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400838244612332:5402], now have 1 active actors on pipe
2025-10-15T10:57:04.118028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400841044316335:4948]
2025-10-15T10:57:04.118044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400841044316335:4948]
2025-10-15T10:57:04.118060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400841044316335:4948]
2025-10-15T10:57:04.118099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:04.118128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:04.118142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:04.118154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:04.118188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:04.118361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:04.118390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:04.118470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:04.118498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:04.118635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400841044316335:4948]
2025-10-15T10:57:04.118675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:04.118702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:04.118757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:04.118795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:04.118820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:04.118829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:04.118856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:04.118885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:04.118984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:04.119374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:04.119400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:04.119468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:04.119682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 359 partition: 0 MaxSeqNo: 46 sessionId: src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0
2025-10-15T10:57:04.120417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177233cb-73f1a3fb-9d4d3965-c51a9d6a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:04.139168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0] Write session: try to update token
2025-10-15T10:57:04.139214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:04.147967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:04.147999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:04.148050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400841044316335:4948]
2025-10-15T10:57:04.148178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:04.148481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:04.149951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:04.151090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:04.152209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:04.153470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:04.155298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:04.155787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:04.213780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:04.213811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:04.213823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:04.213833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:04.213869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400841044316335:4948]
2025-10-15T10:57:04.213896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400841044316335:4948]
2025-10-15T10:57:04.213919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400841044316335:4948]
2025-10-15T10:57:04.214044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:04.214061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:04.214084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:04.214096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:04.214139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:04.215162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:04.226205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId: src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:04.246243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:04.358525Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:04.361273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:04.361309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:04.362042Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:04.361777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400838244612343:4933]
2025-10-15T10:57:04.361871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:04.361985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:04.361997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:04.375446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 359 reason: error at write: Disconnected sessionId: src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0
2025-10-15T10:57:04.375796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 359 sessionId: src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0 is DEAD
2025-10-15T10:57:04.376287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:04.376334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0] Write session will restart in 0.006193s
2025-10-15T10:57:04.376434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0] Write session: Do CDS request
2025-10-15T10:57:04.376465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:04.388836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:04.400399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:04.400439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 360
2025-10-15T10:57:04.400898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:04.401024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:04.401050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:04.401060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:04.403244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 360 sessionId:  describe result for acl check
2025-10-15T10:57:04.403516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:04.403556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:04.403569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:04.403598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400838244612378:5410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:04.408789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400838244612378:5410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:04.416559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400838244612378:5410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:04.425888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400838244612378:5410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:04.425934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400838244612378:5410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:04.425952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400838244612378:5410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:04.425982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:04.454538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:04.456367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:04.457259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:04.457294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:04.457345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:04.457630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:04.457861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400841044316551:4957]
2025-10-15T10:57:04.460509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:04.461555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:04.461642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400838244612559:4933]
2025-10-15T10:57:04.461794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:04.463084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:04.463511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.463535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.463543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.463551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.463558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.463564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.463572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.463579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.463586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.463594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.463601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.463609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.463617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.463624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.463674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.463789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.463844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.463912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.463965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.464024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.464091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.464142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.464196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.464247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.464314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.464373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.464424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.464470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.464524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.464595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.464662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.464728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.464782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.464841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.464890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.464947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.465000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.465058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.465109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.465171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.465224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.465285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.465337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.465395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.465450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.465507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.465555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.465613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.465664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.465721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.465772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.465833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.465885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.465944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.465996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.466059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.466599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:04.483509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:04.519891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:04.519929Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:04.519943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:04.519961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:04.519983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 359 [2:7561400841044316551:4957]
2025-10-15T10:57:04.520026Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:04.520089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:04.520101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:04.520112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:04.520127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:04.520174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:04.520195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:04.520216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:04.521097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.521111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.521119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.521126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:04.521323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:04.521339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.521428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.521545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.521695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:04.521667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 359
2025-10-15T10:57:04.521692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 359
2025-10-15T10:57:04.521753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400838244612366:2467], now have 1 active actors on pipe
2025-10-15T10:57:04.521781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400838244612431:5410], now have 1 active actors on pipe
2025-10-15T10:57:04.521773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 359, pipe: [1:7561400838244612559:4933]
2025-10-15T10:57:04.521799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400838244612559:4933], now have 1 active actors on pipe
2025-10-15T10:57:04.521818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400841044316546:4957]
2025-10-15T10:57:04.521828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400841044316546:4957]
2025-10-15T10:57:04.521836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400841044316546:4957]
2025-10-15T10:57:04.521861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:04.521899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:04.521908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:04.521912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:04.521924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:04.522045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:04.522062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:04.522098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:04.522111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:04.522210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400841044316546:4957]
2025-10-15T10:57:04.522230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:04.522264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:04.522288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fe6c193-8c241053-eb327690-7f7091a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:04.522309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:04.522321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:04.522328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:04.522355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:04.522384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:04.522473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:04.522935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:04.522965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:04.523025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:04.523317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 360 partition: 0 MaxSeqNo: 46 sessionId: src_id|3fe6c193-8c241053-eb327690-7f7091a9_0
2025-10-15T10:57:04.524151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65b5556-4e324cdf-e034b6cd-1cc48848_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3fe6c193-8c241053-eb327690-7f7091a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:04.546770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6c193-8c241053-eb327690-7f7091a9_0] Write session: try to update token
2025-10-15T10:57:04.546836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6c193-8c241053-eb327690-7f7091a9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:04.584400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:04.584444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:04.584465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:04.584487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:04.584535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400841044316546:4957]
2025-10-15T10:57:04.584572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400841044316546:4957]
2025-10-15T10:57:04.584603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400841044316546:4957]
2025-10-15T10:57:04.584793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:04.584832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:04.584871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:04.584881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:04.584934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:04.595980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:04.644683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId: src_id|3fe6c193-8c241053-eb327690-7f7091a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:04.668869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:04.743661Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:04.745211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:04.745250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:04.746077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:04.746112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:04.746132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:04.746320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400838244612559:4933]
2025-10-15T10:57:04.749550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:04.803974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:04.805258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:04.806029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:04.806092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:04.806146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:04.806433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:04.806566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400841044316756:4966]
2025-10-15T10:57:04.808223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:04.808926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:04.809207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:04.811042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:04.811603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.811620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.811629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.811640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.811649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.811662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.811678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.811698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.811712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.811723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.811733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.811743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.811753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.811765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.811833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.812024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.812105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.812163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.812218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.812296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.812385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.812459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.812517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.812572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.812630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.812684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.812757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.812828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.812889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.812988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:04.813058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.813126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:04.813183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.813244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:04.813303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.813385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:04.813442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.813504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:04.813570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.813646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:04.813716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.813793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:04.813861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.813946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:04.814010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.814081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:04.814142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.814218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:04.814283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.814344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:04.814410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.814480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.814545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.814610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.814671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.814745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.814951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 360 reason: error at write: Disconnected sessionId: src_id|3fe6c193-8c241053-eb327690-7f7091a9_0
2025-10-15T10:57:04.815191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:04.815291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 360 sessionId: src_id|3fe6c193-8c241053-eb327690-7f7091a9_0 is DEAD
2025-10-15T10:57:04.815713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6c193-8c241053-eb327690-7f7091a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:04.815763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6c193-8c241053-eb327690-7f7091a9_0] Write session will restart in 0.007114s
2025-10-15T10:57:04.815904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6c193-8c241053-eb327690-7f7091a9_0] Write session: Do CDS request
2025-10-15T10:57:04.815954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6c193-8c241053-eb327690-7f7091a9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:04.831409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:04.831449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 361
2025-10-15T10:57:04.831569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6c193-8c241053-eb327690-7f7091a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:04.832029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:04.832152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:04.832177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:04.832188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:04.833581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 361 sessionId:  describe result for acl check
2025-10-15T10:57:04.833705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:04.833724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:04.833734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:04.833752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400838244612727:5417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:04.836977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:04.837281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400838244612727:5417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:04.844146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400838244612727:5417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:04.846709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400838244612752:4933]
2025-10-15T10:57:04.856830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400838244612727:5417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:04.856877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400838244612727:5417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:04.856893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400838244612727:5417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:04.856923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:04.858889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:04.858930Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:04.858943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:04.858959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:04.858979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 360 [2:7561400841044316756:4966]
2025-10-15T10:57:04.859024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:04.859073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:04.859087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:04.859098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:04.859108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:04.859150Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:04.859176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:04.859195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:04.860225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.860250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.860261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.860272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:04.860519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:04.860545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:04.860665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:04.860781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:04.860839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 360, pipe: [1:7561400838244612752:4933]
2025-10-15T10:57:04.860862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 360
2025-10-15T10:57:04.860937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:04.860946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 360
2025-10-15T10:57:04.860990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400838244612752:4933], now have 1 active actors on pipe
2025-10-15T10:57:04.861007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400838244612758:5417], now have 1 active actors on pipe
2025-10-15T10:57:04.861020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400838244612570:2467], now have 1 active actors on pipe
2025-10-15T10:57:04.861034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400841044316751:4966]
2025-10-15T10:57:04.861043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400841044316751:4966]
2025-10-15T10:57:04.861051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400841044316751:4966]
2025-10-15T10:57:04.861075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:04.861119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:04.861124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:04.861146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:04.861158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:04.861258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:04.861274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:04.861353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400841044316751:4966]
2025-10-15T10:57:04.861382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:04.861412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:04.861519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:04.861542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:04.861635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:04.861680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:04.861702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:04.861716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:04.861748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:04.861783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:04.861835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:04.862401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:04.862432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:04.862518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:04.862827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 361 partition: 0 MaxSeqNo: 46 sessionId: src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0
2025-10-15T10:57:04.863768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe6c193-8c241053-eb327690-7f7091a9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:04.883610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0] Write session: try to update token
2025-10-15T10:57:04.883670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:04.895581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:04.895612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:04.895650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400841044316751:4966]
2025-10-15T10:57:04.895777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:04.895775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:04.898001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:04.899668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:04.900996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:04.902324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:04.904390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:04.904885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:04.960624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId: src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:04.976871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:04.976903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:04.976916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:04.976925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:04.976964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400841044316751:4966]
2025-10-15T10:57:04.976996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400841044316751:4966]
2025-10-15T10:57:04.977022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400841044316751:4966]
2025-10-15T10:57:04.977160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:04.977184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:04.977196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:04.977201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:04.977207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:04.977249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:04.977256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:04.977276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:04.980078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:04.998300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:05.120305Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:05.121478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:05.121512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:05.122054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:05.122063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400838244612752:4933]
2025-10-15T10:57:05.122160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:05.122166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:05.122185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:05.144234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 361 reason: error at write: Disconnected sessionId: src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0
2025-10-15T10:57:05.144481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 361 sessionId: src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0 is DEAD
2025-10-15T10:57:05.144893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:05.144951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0] Write session will restart in 0.009502s
2025-10-15T10:57:05.145093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0] Write session: Do CDS request
2025-10-15T10:57:05.145149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:05.159827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:05.159894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 362
2025-10-15T10:57:05.159993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:05.160595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:05.160744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:05.160768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:05.160775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:05.161835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 362 sessionId:  describe result for acl check
2025-10-15T10:57:05.161916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:05.161928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:05.161934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:05.161944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400842539580116:5421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:05.163737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400842539580116:5421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:05.171061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400842539580116:5421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:05.177645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400842539580116:5421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:05.177682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400842539580116:5421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:05.177693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400842539580116:5421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:05.177711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:05.184485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:05.185678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:05.186338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:05.186361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:05.186398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:05.186602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:05.186728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400845339284257:4969]
2025-10-15T10:57:05.188465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:05.189248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:05.189385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:05.190144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:05.190355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.190365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.190370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.190373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.190378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.190382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.190386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.190390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.190394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.190398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.190403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.190407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.190411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.190415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.190442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.190514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.190547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.190579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.190606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.190648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.190689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.190719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.190752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.190789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.190823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.190856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.190889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.190921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.190951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.190999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.191041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.191080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.191113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.191149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.191188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.191231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.191265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.191303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.191334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.191388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.191429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.191474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.191507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.191545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.191577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.191616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.191649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.191699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.191734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.191774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.191809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.191843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.191872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.191908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.191947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.191987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.192379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:05.206359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:05.214469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:05.214501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:05.214512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:05.214531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:05.214555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 361 [2:7561400845339284257:4969]
2025-10-15T10:57:05.214598Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:05.214646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:05.214658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:05.214668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:05.214677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:05.214708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:05.214723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:05.214741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:05.222572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400842539580265:4933]
2025-10-15T10:57:05.229922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.229952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.229962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.229971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:05.230239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:05.230264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.230387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.230431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 361, pipe: [1:7561400842539580265:4933]
2025-10-15T10:57:05.230507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 361
2025-10-15T10:57:05.230543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.230523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 361
2025-10-15T10:57:05.230727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:05.230804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400842539580265:4933], now have 1 active actors on pipe
2025-10-15T10:57:05.230828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400842539580250:5421], now have 1 active actors on pipe
2025-10-15T10:57:05.230847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400842539580066:2467], now have 1 active actors on pipe
2025-10-15T10:57:05.230889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:05.230911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:05.230956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400845339284251:4969]
2025-10-15T10:57:05.230972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400845339284251:4969]
2025-10-15T10:57:05.230982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400845339284251:4969]
2025-10-15T10:57:05.231014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:05.231046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:05.231061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:05.231069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:05.231077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:05.231229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:05.231251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:05.231302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:05.231336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:05.231373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:05.231383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:05.231413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:05.231456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:05.231579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400845339284251:4969]
2025-10-15T10:57:05.231610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:05.231649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:05.231660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:05.232098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:05.232122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:05.232184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:05.232466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 362 partition: 0 MaxSeqNo: 46 sessionId: src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0
2025-10-15T10:57:05.233077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306fb71f-a8b71b47-a21ea97d-51a79956_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:05.250421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0] Write session: try to update token
2025-10-15T10:57:05.250463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:05.262034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:05.262070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:05.262105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400845339284251:4969]
2025-10-15T10:57:05.262226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:05.262227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:05.264165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:05.265609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:05.267086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:05.268477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:05.270290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:05.270858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:05.315282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:05.315308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:05.315318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:05.315326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:05.315371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400845339284251:4969]
2025-10-15T10:57:05.315399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400845339284251:4969]
2025-10-15T10:57:05.315422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400845339284251:4969]
2025-10-15T10:57:05.315555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:05.315573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:05.315584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:05.315585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:05.315623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:05.315627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:05.315640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:05.315660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:05.316657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:05.317914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId: src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:05.343126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:05.460204Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:05.461886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:05.461921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:05.462484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400842539580265:4933]
2025-10-15T10:57:05.462581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:05.462597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:05.462580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:05.483122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 362 reason: error at write: Disconnected sessionId: src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0
2025-10-15T10:57:05.483408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 362 sessionId: src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0 is DEAD
2025-10-15T10:57:05.483802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:05.483856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0] Write session will restart in 0.007574s
2025-10-15T10:57:05.484026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0] Write session: Do CDS request
2025-10-15T10:57:05.484088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:05.496490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:05.497287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:05.497313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 363
2025-10-15T10:57:05.497422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:05.497980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:05.498121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:05.498144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:05.498154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:05.499341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 363 sessionId:  describe result for acl check
2025-10-15T10:57:05.499456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:05.499467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:05.499473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:05.499483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400842539580300:5433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:05.501664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400842539580300:5433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:05.510280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400842539580300:5433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:05.518823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400842539580300:5433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:05.518873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400842539580300:5433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:05.518888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400842539580300:5433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:05.518916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:05.526114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:05.531560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:05.532433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:05.532463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:05.532502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:05.532763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:05.532950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400845339284454:4972]
2025-10-15T10:57:05.535147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:05.536176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:05.536402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:05.537470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:05.537739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.537751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.537756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.537762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.537767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.537771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.537775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.537780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.537785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.537790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.537795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.537799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.537803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.537808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.537846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.537930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.537964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.538002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.538047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.538082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.538115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.538149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.538200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.538257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.538302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.538343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.538377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.538414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.538462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.538530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.538598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.538648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.538702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.538764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.538817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.538864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.538902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.538956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.539001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.539050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.539099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.539142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.539191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.539244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.539285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.539328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.539385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.539445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.539495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.539558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.539611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.539692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.539748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.539815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.539872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.539945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.540546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:05.557424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:05.563003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400842539580474:4933]
2025-10-15T10:57:05.568098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:05.568145Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:05.568163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:05.568183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:05.568209Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 362 [2:7561400845339284454:4972]
2025-10-15T10:57:05.568261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:05.568325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:05.568341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:05.568354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:05.568364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:05.568413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:05.568444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:05.568467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:05.570487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.570520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.570535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.570548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:05.570819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:05.570848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.571009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.571180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 362, pipe: [1:7561400842539580474:4933]
2025-10-15T10:57:05.571233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.571307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 362
2025-10-15T10:57:05.571396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 362
2025-10-15T10:57:05.571504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:05.571607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400842539580474:4933], now have 1 active actors on pipe
2025-10-15T10:57:05.571633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400842539580465:5433], now have 1 active actors on pipe
2025-10-15T10:57:05.571657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400842539580296:2467], now have 1 active actors on pipe
2025-10-15T10:57:05.571683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400845339284449:4972]
2025-10-15T10:57:05.571697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400845339284449:4972]
2025-10-15T10:57:05.571711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400845339284449:4972]
2025-10-15T10:57:05.571758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:05.571804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:05.571828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:05.571858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:05.571863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:05.572198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:05.572218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:05.572384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:05.572409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:05.572461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400845339284449:4972]
2025-10-15T10:57:05.572496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:05.572539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:05.572615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:05.572647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:05.572666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:05.572676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:05.572714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:05.572761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:05.572849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:05.573593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:05.573629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:05.573713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:05.574020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 363 partition: 0 MaxSeqNo: 46 sessionId: src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0
2025-10-15T10:57:05.575040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31f27b8-207a37bc-6636bf4e-d932d1f3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:05.596787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0] Write session: try to update token
2025-10-15T10:57:05.596854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:05.633443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:05.633499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:05.633517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:05.633534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:05.633600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400845339284449:4972]
2025-10-15T10:57:05.633643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400845339284449:4972]
2025-10-15T10:57:05.633683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400845339284449:4972]
2025-10-15T10:57:05.633837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:05.633903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:05.633949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:05.633974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:05.634019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:05.638750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:05.678647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId: src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:05.700786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:05.788205Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:05.805390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:05.805432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:05.805495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:05.805507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:05.805544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400845339284449:4972]
2025-10-15T10:57:05.805730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:05.805929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400842539580474:4933]
2025-10-15T10:57:05.806042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:05.806063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:05.806139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:05.817147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:05.817285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 363 reason: error at write: Disconnected sessionId: src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0
2025-10-15T10:57:05.817563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 363 sessionId: src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0 is DEAD
2025-10-15T10:57:05.817978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:05.818058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0] Write session will restart in 0.008609s
2025-10-15T10:57:05.818189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0] Write session: Do CDS request
2025-10-15T10:57:05.818234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:05.831757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:05.833337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:05.833371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 364
2025-10-15T10:57:05.833724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:05.833827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:05.833846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:05.833854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:05.835533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 364 sessionId:  describe result for acl check
2025-10-15T10:57:05.835635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:05.835645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:05.835654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:05.835668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400842539580505:5437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:05.838847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400842539580505:5437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:05.844556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400842539580505:5437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:05.851621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400842539580505:5437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:05.851664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400842539580505:5437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:05.851678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400842539580505:5437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:05.851702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:05.889547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:05.891009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:05.891722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:05.891749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:05.891790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:05.891973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:05.892154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400845339284663:4980]
2025-10-15T10:57:05.893821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:05.894647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:05.894854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:05.895819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:05.896119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.896129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.896134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.896139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.896143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.896148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.896153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.896157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.896161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.896165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.896170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.896174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.896177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.896182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.896211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.896280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.896311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.896342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.896377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.896410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.896443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.896477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.896517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.896564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.896592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.896621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.896654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.896685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.896712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.896757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:05.896804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.896854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:05.896891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.896924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:05.896981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.897025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:05.897059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.897095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:05.897127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.897175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:05.897223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.897266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:05.897298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.897335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:05.897367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.897404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:05.897433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.897465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:05.897496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.897530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:05.897561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.897597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.897629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.897664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.897704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.897744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.898057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:05.906025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400842539580685:4933]
2025-10-15T10:57:05.914643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:05.951887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:05.951925Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:05.951939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:05.951955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:05.951976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 363 [2:7561400845339284663:4980]
2025-10-15T10:57:05.952018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:05.952078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:05.952089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:05.952100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:05.952110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:05.952152Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:05.952171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:05.952198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:05.953412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.953432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.953442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.953453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:05.953700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:05.953722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:05.953859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:05.953990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 363
2025-10-15T10:57:05.954026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 363, pipe: [1:7561400842539580685:4933]
2025-10-15T10:57:05.954051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:05.954094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 363
2025-10-15T10:57:05.954283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:05.954358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400842539580486:2467], now have 1 active actors on pipe
2025-10-15T10:57:05.954384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400842539580685:4933], now have 1 active actors on pipe
2025-10-15T10:57:05.954403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400842539580536:5437], now have 1 active actors on pipe
2025-10-15T10:57:05.954468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:05.954494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:05.954527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400845339284658:4980]
2025-10-15T10:57:05.954540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400845339284658:4980]
2025-10-15T10:57:05.954552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400845339284658:4980]
2025-10-15T10:57:05.954585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:05.954631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:05.954653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:05.954655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:05.954667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:05.954817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:05.954840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:05.954896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:05.954923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:05.954939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:05.954949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:05.954978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:05.955010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:05.955120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400845339284658:4980]
2025-10-15T10:57:05.955153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:05.955190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:05.955200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:05.955701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:05.955725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:05.955793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:05.956187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 364 partition: 0 MaxSeqNo: 46 sessionId: src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0
2025-10-15T10:57:05.956904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9f3645e-e5fbe002-212662f8-30e755ab_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:05.978231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0] Write session: try to update token
2025-10-15T10:57:05.978301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:05.988206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:05.988236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:05.988273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400845339284658:4980]
2025-10-15T10:57:05.988391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:05.988405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:05.991989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:05.993692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:05.995229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:05.996670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:05.998590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:05.999142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:06.063159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:06.063191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:06.063203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:06.063214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:06.063250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400845339284658:4980]
2025-10-15T10:57:06.063283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400845339284658:4980]
2025-10-15T10:57:06.063308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400845339284658:4980]
2025-10-15T10:57:06.063481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:06.063492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:06.063504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:06.063515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:06.063537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:06.063556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:06.063570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:06.063576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:06.067271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:06.074220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId: src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:06.098199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:06.214653Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:06.216008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:06.216046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:06.216647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:06.216699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400842539580685:4933]
2025-10-15T10:57:06.216767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:06.216787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:06.216821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:06.273234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:06.273254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 364 reason: error at write: Disconnected sessionId: src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0
2025-10-15T10:57:06.273504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 364 sessionId: src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0 is DEAD
2025-10-15T10:57:06.274040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:06.274128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0] Write session will restart in 0.005831s
2025-10-15T10:57:06.274324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0] Write session: Do CDS request
2025-10-15T10:57:06.274376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:06.278522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:06.279313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:06.279345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:06.279407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:06.279634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:06.279863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400849634252180:4990]
2025-10-15T10:57:06.281779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:06.282634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:06.282880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:06.283850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:06.284094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:06.284104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:06.284108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:06.284112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:06.284118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:06.284122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:06.284126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:06.284131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:06.284135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:06.284139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:06.284144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:06.284152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.284160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.284168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.284230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:06.284349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:06.284394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:06.284438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:06.284489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:06.284537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:06.284584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:06.284629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:06.284674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:06.284720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:06.284768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:06.284814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.284854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.284899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.284962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:06.285030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:06.285099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:06.285203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:06.285135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:06.285174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:06.285194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 365
2025-10-15T10:57:06.285228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:06.285301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:06.285367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:06.285466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:06.285545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:06.285607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:06.285674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:06.285777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:06.285857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:06.285934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:06.285990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:06.286049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:06.286033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:06.286113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:06.286201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:06.286225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:06.286251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:06.286261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:06.286280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:06.286321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:06.286400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:06.286490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:06.286559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.286619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.286675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.286741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.286795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.286861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.287487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:06.288345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 365 sessionId:  describe result for acl check
2025-10-15T10:57:06.288505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:06.288535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:06.288552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:06.288579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400846834548165:5446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:06.292188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400846834548165:5446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:06.296150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400846834548165:5446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:06.301384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400846834548165:5446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:06.301441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400846834548165:5446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:06.301457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400846834548165:5446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:06.301497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:06.303767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:06.313255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:06.313294Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:06.313309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:06.313329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:06.313354Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 364 [2:7561400849634252180:4990]
2025-10-15T10:57:06.313409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:06.313474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:06.313488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:06.313500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:06.313512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:06.313559Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:06.313581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:06.313614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:06.317143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400846834548197:4933]
2025-10-15T10:57:06.324794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.324817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.324826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.324836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:06.325069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:06.325088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.325196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.325262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 364, pipe: [1:7561400846834548197:4933]
2025-10-15T10:57:06.325319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 364
2025-10-15T10:57:06.325382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 364
2025-10-15T10:57:06.325337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.325533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:06.325607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400846834548197:4933], now have 1 active actors on pipe
2025-10-15T10:57:06.325632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400846834548196:5446], now have 1 active actors on pipe
2025-10-15T10:57:06.325648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400846834548005:2467], now have 1 active actors on pipe
2025-10-15T10:57:06.325689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:06.325715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:06.325768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400849634252175:4990]
2025-10-15T10:57:06.325787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400849634252175:4990]
2025-10-15T10:57:06.325797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400849634252175:4990]
2025-10-15T10:57:06.325829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:06.325849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:06.325859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:06.325865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:06.325888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:06.326048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:06.326070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:06.326122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee2eddec-67318c50-54a03042-85c513fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:06.326151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:06.326166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:06.326176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:06.326206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:06.326242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:06.326356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400849634252175:4990]
2025-10-15T10:57:06.326385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:06.326395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:06.326423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:06.326843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:06.326865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:06.326917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:06.327104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 365 partition: 0 MaxSeqNo: 46 sessionId: src_id|ee2eddec-67318c50-54a03042-85c513fd_0
2025-10-15T10:57:06.327805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf30f7e5-ac7df03d-384c327d-c6cfa9db_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ee2eddec-67318c50-54a03042-85c513fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:06.350777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2eddec-67318c50-54a03042-85c513fd_0] Write session: try to update token
2025-10-15T10:57:06.350848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2eddec-67318c50-54a03042-85c513fd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:06.355107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:06.355137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:06.355173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400849634252175:4990]
2025-10-15T10:57:06.355284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:06.355288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:06.357732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:06.361537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:06.363033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:06.364689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:06.366507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:06.366994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:06.418546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:06.418577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:06.418590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:06.418602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:06.418637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400849634252175:4990]
2025-10-15T10:57:06.418660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400849634252175:4990]
2025-10-15T10:57:06.418681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400849634252175:4990]
2025-10-15T10:57:06.418797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:06.418821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:06.418833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:06.418834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:06.418843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:06.418861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:06.418879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:06.418896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:06.419970Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:06.439714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId: src_id|ee2eddec-67318c50-54a03042-85c513fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:06.462327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:06.565376Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:06.566777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:06.566809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:06.567253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400846834548197:4933]
2025-10-15T10:57:06.567282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:06.567296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:06.567362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:06.567570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:06.600026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 365 reason: error at write: Disconnected sessionId: src_id|ee2eddec-67318c50-54a03042-85c513fd_0
2025-10-15T10:57:06.600390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 365 sessionId: src_id|ee2eddec-67318c50-54a03042-85c513fd_0 is DEAD
2025-10-15T10:57:06.600713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2eddec-67318c50-54a03042-85c513fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:06.600777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2eddec-67318c50-54a03042-85c513fd_0] Write session will restart in 0.008405s
2025-10-15T10:57:06.600896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2eddec-67318c50-54a03042-85c513fd_0] Write session: Do CDS request
2025-10-15T10:57:06.600937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2eddec-67318c50-54a03042-85c513fd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:06.613493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2eddec-67318c50-54a03042-85c513fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:06.613363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:06.613399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 366
2025-10-15T10:57:06.614004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:06.614135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:06.614170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:06.614179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:06.615598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 366 sessionId:  describe result for acl check
2025-10-15T10:57:06.615702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:06.615719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:06.615728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:06.615742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400846834548306:5450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:06.618098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400846834548306:5450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:06.624927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400846834548306:5450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:06.633620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:06.634184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400846834548306:5450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:06.634234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400846834548306:5450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:06.634253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400846834548306:5450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:06.634285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:06.634928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:06.635641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:06.635672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:06.635708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:06.635921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:06.636118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400849634252378:4993]
2025-10-15T10:57:06.638166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:06.638919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:06.639102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:06.640262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:06.640566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:06.640583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:06.640590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:06.640596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:06.640602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:06.640608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:06.640615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:06.640621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:06.640628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:06.640634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:06.640641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:06.640649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.640655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.640661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.640702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:06.640807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:06.640851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:06.640895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:06.640937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:06.640991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:06.641036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:06.641084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:06.641132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:06.641183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:06.641228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:06.641278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.641325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.641370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.641413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:06.641480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:06.641536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:06.641593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:06.641645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:06.641711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:06.641755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:06.641801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:06.641846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:06.641893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:06.641932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:06.641981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:06.642028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:06.642078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:06.642119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:06.642167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:06.642212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:06.642266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:06.642306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:06.642356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:06.642400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:06.642450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:06.642491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.642539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.642583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.642633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.642678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.642725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.643198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:06.657296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:06.657581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:57:06.657633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-10-15T10:57:06.667078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:06.667109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:06.667120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:06.667133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:06.667150Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 365 [2:7561400849634252378:4993]
2025-10-15T10:57:06.667199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:06.667255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:06.667266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:06.667275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:06.667284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:06.667318Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:06.667332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:06.667368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:06.667368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400846834548399:4933]
2025-10-15T10:57:06.668850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.668870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.668879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.668887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:06.669148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:06.669173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:06.669315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:06.669326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 365
2025-10-15T10:57:06.669339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 365, pipe: [1:7561400846834548399:4933]
2025-10-15T10:57:06.669444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 365
2025-10-15T10:57:06.669520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:06.669729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:06.669789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400846834548208:2467], now have 1 active actors on pipe
2025-10-15T10:57:06.669809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400846834548399:4933], now have 1 active actors on pipe
2025-10-15T10:57:06.669822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400846834548394:5450], now have 1 active actors on pipe
2025-10-15T10:57:06.669911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:06.669931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:06.669955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400849634252372:4993]
2025-10-15T10:57:06.669964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400849634252372:4993]
2025-10-15T10:57:06.669972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400849634252372:4993]
2025-10-15T10:57:06.669994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:06.670028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:06.670043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:06.670048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:06.670054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:06.670195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:06.670211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:06.670303Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:57:06.670407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:06.670437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:06.670453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:06.670464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:06.670494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:06.670543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:06.670659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400849634252372:4993]
2025-10-15T10:57:06.670693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:06.670715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:06.670736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:06.670773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 7 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:57:06.670916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:57:06.671170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:06.671199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:06.671273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:06.671565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 366 partition: 0 MaxSeqNo: 46 sessionId: src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0
2025-10-15T10:57:06.672324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee2eddec-67318c50-54a03042-85c513fd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:06.696747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0] Write session: try to update token
2025-10-15T10:57:06.696814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:06.704473Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:06.704501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:06.704545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400849634252372:4993]
2025-10-15T10:57:06.704659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:06.704665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:06.706805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:06.708085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:06.709336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:06.710880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:06.712940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:06.713465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:06.761389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:06.761420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:06.761435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:06.761446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:06.761495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400849634252372:4993]
2025-10-15T10:57:06.761522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400849634252372:4993]
2025-10-15T10:57:06.761545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400849634252372:4993]
2025-10-15T10:57:06.761644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:06.761678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:06.761683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:06.761710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:06.761710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:06.765210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:06.779374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId: src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:06.804029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:06.901081Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:06.908140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:06.908183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:06.908667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:06.908700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:06.908927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:06.919330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 366 reason: error at write: Disconnected sessionId: src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0
2025-10-15T10:57:06.920003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:06.920045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0] Write session will restart in 0.009118s
2025-10-15T10:57:06.920185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0] Write session: Do CDS request
2025-10-15T10:57:06.920219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:06.919642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 366 sessionId: src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0 is DEAD
2025-10-15T10:57:06.938258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:06.938437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400846834548399:4933]
2025-10-15T10:57:06.938507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:06.938525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 367
2025-10-15T10:57:06.938876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:06.939453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:06.939575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:06.939596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:06.939606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:06.940840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 367 sessionId:  describe result for acl check
2025-10-15T10:57:06.940953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:06.940969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:06.940978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:06.940994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400846834548443:5460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:06.944165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400846834548443:5460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:06.950169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400846834548443:5460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:06.958204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400846834548443:5460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:06.958250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400846834548443:5460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:06.958266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400846834548443:5460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:06.958296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:06.995488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:06.997102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:06.997783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:06.997811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:06.997844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:06.998054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:06.998217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400849634252586:4996]
2025-10-15T10:57:07.000139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:07.001012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:07.001225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:07.002250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:07.002521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.002529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.002536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.002542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.002548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.002553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.002559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.002566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.002571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.002575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.002580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.002585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.002591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.002596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.002631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.002716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.002755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.002792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.002827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.002864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.002898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.002932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.002976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.003016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.003056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.003095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.003133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.003173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.003212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.003267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.003316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.003383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.003428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.003475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.003514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.003559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.003601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.003648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.003689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.003737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.003777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.003822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.003860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.003904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.003960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.004011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.004051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.004115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.004151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.004199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.004239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.004281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.004321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.004367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.004405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.004450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.004850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:07.020890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:07.037028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:07.037066Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:07.037079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:07.037096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:07.037117Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 366 [2:7561400849634252586:4996]
2025-10-15T10:57:07.037158Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:07.037205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:07.037217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:07.037228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:07.037238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:07.037282Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:07.037301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:07.037318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:07.038578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400851129515920:4933]
2025-10-15T10:57:07.039233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.039257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.039269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.039279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:07.039547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:07.039578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.039709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.039759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 366, pipe: [1:7561400851129515920:4933]
2025-10-15T10:57:07.039869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 366
2025-10-15T10:57:07.039882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.039963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 366
2025-10-15T10:57:07.040131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:07.040209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400851129515920:4933], now have 1 active actors on pipe
2025-10-15T10:57:07.040236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400846834548483:5460], now have 1 active actors on pipe
2025-10-15T10:57:07.040255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400846834548439:2467], now have 1 active actors on pipe
2025-10-15T10:57:07.040300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:07.040324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:07.040369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400849634252581:4996]
2025-10-15T10:57:07.040382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400849634252581:4996]
2025-10-15T10:57:07.040396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400849634252581:4996]
2025-10-15T10:57:07.040432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:07.040477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:07.040490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:07.040493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:07.040500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:07.040652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:07.040672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:07.040723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:07.040752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:07.040768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:07.040777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:07.040805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:07.040840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:07.040957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400849634252581:4996]
2025-10-15T10:57:07.040984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:07.041010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:07.041025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:07.041505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:07.041531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:07.041587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:07.041873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 367 partition: 0 MaxSeqNo: 46 sessionId: src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0
2025-10-15T10:57:07.042779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa53d39c-bb8bbe12-9d5468a1-1387d9b8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:07.063366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0] Write session: try to update token
2025-10-15T10:57:07.063417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:07.073890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:07.073924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:07.073956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400849634252581:4996]
2025-10-15T10:57:07.074072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:07.074084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:07.076418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:07.077783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:07.079768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:07.081100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:07.083433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:07.084226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:07.149343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:07.149365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:07.149375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:07.149383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:07.149423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400849634252581:4996]
2025-10-15T10:57:07.149449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400849634252581:4996]
2025-10-15T10:57:07.149471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400849634252581:4996]
2025-10-15T10:57:07.149557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:07.149587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:07.149598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:07.149608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:07.149612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:07.149618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:07.149655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:07.149671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:07.150674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:07.158920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId: src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:07.180585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:07.288819Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:07.290965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:07.291000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:07.291379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:07.291408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:07.291675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400851129515920:4933]
2025-10-15T10:57:07.291777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:07.291979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:07.312284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 367 reason: error at write: Disconnected sessionId: src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0
2025-10-15T10:57:07.312531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 367 sessionId: src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0 is DEAD
2025-10-15T10:57:07.313041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:07.313103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0] Write session will restart in 0.008114s
2025-10-15T10:57:07.313276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0] Write session: Do CDS request
2025-10-15T10:57:07.313332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:07.329097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:07.329134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 368
2025-10-15T10:57:07.329417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:07.330074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:07.330288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:07.330328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:07.330343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:07.331923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 368 sessionId:  describe result for acl check
2025-10-15T10:57:07.332041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:07.332058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:07.332068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:07.332100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400851129515981:5469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:07.334753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400851129515981:5469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:07.343848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400851129515981:5469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:07.353970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400851129515981:5469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:07.354022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400851129515981:5469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:07.354041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400851129515981:5469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:07.354076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:07.358567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:07.363342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:07.363991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:07.364016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:07.364051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:07.364276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:07.364418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400853929220119:5010]
2025-10-15T10:57:07.365824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:07.366573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:07.366716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:07.367777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:07.368019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.368031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.368036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.368040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.368044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.368048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.368053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.368058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.368062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.368067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.368071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.368088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.368093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.368097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.368135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.368218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.368250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.368281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.368311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.368342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.368372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.368400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.368428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.368475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.368524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.368573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.368619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.368661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.368707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.368754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.368795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.368839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.368872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.368908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.368939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.368984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.369025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.369064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.369093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.369128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.369163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.369214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.369261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.369315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.369352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.369389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.369421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.369459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.369502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.369550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.369583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.369618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.369649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.369693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.369723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.369767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.370094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:07.386098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:07.391878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400851129516144:4933]
2025-10-15T10:57:07.394916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:07.394962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:07.394977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:07.394996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:07.395017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 367 [2:7561400853929220119:5010]
2025-10-15T10:57:07.395064Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:07.395119Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:07.395132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:07.395143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:07.395154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:07.395210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:07.395232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:07.395250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:07.431861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.431884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.431895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.431905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:07.432165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:07.432187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.432297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.432450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.432527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 367
2025-10-15T10:57:07.432555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 367
2025-10-15T10:57:07.432641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:07.432602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 367, pipe: [1:7561400851129516144:4933]
2025-10-15T10:57:07.432714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400851129516138:5469], now have 1 active actors on pipe
2025-10-15T10:57:07.432739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400851129515955:2467], now have 1 active actors on pipe
2025-10-15T10:57:07.432757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400851129516144:4933], now have 1 active actors on pipe
2025-10-15T10:57:07.432779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400853929220113:5010]
2025-10-15T10:57:07.432791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400853929220113:5010]
2025-10-15T10:57:07.432801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400853929220113:5010]
2025-10-15T10:57:07.432833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:07.432870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:07.432890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:07.432899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:07.432900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:07.433048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:07.433069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:07.433133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:07.433155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:07.433264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400853929220113:5010]
2025-10-15T10:57:07.433315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:07.433329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:07.433380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|721cb6c0-340b075a-dbfba672-ce77a085_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:07.433406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:07.433424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:07.433434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:07.433463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:07.433503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:07.433612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:07.434095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:07.434117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:07.434168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:07.434566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 368 partition: 0 MaxSeqNo: 46 sessionId: src_id|721cb6c0-340b075a-dbfba672-ce77a085_0
2025-10-15T10:57:07.435200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd071a5f-b43c63b1-3ab5602d-fce971e2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|721cb6c0-340b075a-dbfba672-ce77a085_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:07.456180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721cb6c0-340b075a-dbfba672-ce77a085_0] Write session: try to update token
2025-10-15T10:57:07.456244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721cb6c0-340b075a-dbfba672-ce77a085_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:07.465466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:07.465499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:07.465537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400853929220113:5010]
2025-10-15T10:57:07.465654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:07.465662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:07.467728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:07.469119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:07.470545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:07.471939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:07.473854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:07.474312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:07.536198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId: src_id|721cb6c0-340b075a-dbfba672-ce77a085_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:07.547412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:07.547446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:07.547458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:07.547507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:07.547520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:07.547533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:07.547543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:07.547582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400853929220113:5010]
2025-10-15T10:57:07.547609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400853929220113:5010]
2025-10-15T10:57:07.547632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400853929220113:5010]
2025-10-15T10:57:07.547772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:07.547799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:07.547794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:07.547843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:07.547896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:07.548884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:07.559636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:07.684195Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:07.685827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:07.685868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:07.686408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:07.686408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:07.686423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:07.686607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400851129516144:4933]
2025-10-15T10:57:07.686744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:07.695406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 368 reason: error at write: Disconnected sessionId: src_id|721cb6c0-340b075a-dbfba672-ce77a085_0
2025-10-15T10:57:07.695729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 368 sessionId: src_id|721cb6c0-340b075a-dbfba672-ce77a085_0 is DEAD
2025-10-15T10:57:07.696079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721cb6c0-340b075a-dbfba672-ce77a085_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:07.696145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721cb6c0-340b075a-dbfba672-ce77a085_0] Write session will restart in 0.009945s
2025-10-15T10:57:07.696300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721cb6c0-340b075a-dbfba672-ce77a085_0] Write session: Do CDS request
2025-10-15T10:57:07.696357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721cb6c0-340b075a-dbfba672-ce77a085_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:07.710544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:07.710585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 369
2025-10-15T10:57:07.710731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721cb6c0-340b075a-dbfba672-ce77a085_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:07.711344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:07.711568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:07.711609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:07.711625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:07.713509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 369 sessionId:  describe result for acl check
2025-10-15T10:57:07.713631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:07.713646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:07.713655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:07.713671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400851129516170:5473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:07.716267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400851129516170:5473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:07.722418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400851129516170:5473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:07.733732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400851129516170:5473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:07.733781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400851129516170:5473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:07.733798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400851129516170:5473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:07.733830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:07.755746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:07.757654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:07.758479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:07.758509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:07.758553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:07.758804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:07.758992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400853929220317:5015]
2025-10-15T10:57:07.761202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:07.762234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:07.762423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:07.763660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:07.764020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.764042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.764049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.764055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.764062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.764070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.764077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.764112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.764122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.764129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.764136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.764143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.764149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.764156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.764205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.764332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.764390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.764443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.764494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.764551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.764596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.764640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.764678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.764725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.764762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.764806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.764859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.764909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.764956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.765013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:07.765075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.765125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:07.765163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.765201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:07.765235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.765275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:07.765310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.765357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:07.765398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.765432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:07.765462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.765497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:07.765528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.765567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:07.765602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.765655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:07.765695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.765734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:07.765768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.765807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:07.765843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.765892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.765927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.765988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.766024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.766060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.766439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:07.786578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400851129516349:4933]
2025-10-15T10:57:07.787785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:07.796350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:07.796395Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:07.796412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:07.796430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:07.796454Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 368 [2:7561400853929220317:5015]
2025-10-15T10:57:07.796505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:07.796558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:07.796572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:07.796582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:07.796592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:07.796634Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:07.796654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:07.796674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:07.797829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.797861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.797878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.797893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:07.798213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:07.798245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:07.798406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:07.798401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 368, pipe: [1:7561400851129516349:4933]
2025-10-15T10:57:07.798470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 368
2025-10-15T10:57:07.798533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 368
2025-10-15T10:57:07.798638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:07.798887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:07.798981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400851129516349:4933], now have 1 active actors on pipe
2025-10-15T10:57:07.799010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400851129516276:5473], now have 1 active actors on pipe
2025-10-15T10:57:07.799041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400851129516155:2467], now have 1 active actors on pipe
2025-10-15T10:57:07.799082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:07.799107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:07.799163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400853929220312:5015]
2025-10-15T10:57:07.799179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400853929220312:5015]
2025-10-15T10:57:07.799188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400853929220312:5015]
2025-10-15T10:57:07.799215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:07.799268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:07.799268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:07.799284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:07.799297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:07.799448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:07.799475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:07.799545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:07.799586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:07.799611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:07.799633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:07.799674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:07.799723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:07.799860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400853929220312:5015]
2025-10-15T10:57:07.799891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:07.799921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:07.799941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:07.800407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:07.800430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:07.800511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:07.800768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 369 partition: 0 MaxSeqNo: 46 sessionId: src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0
2025-10-15T10:57:07.801446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721cb6c0-340b075a-dbfba672-ce77a085_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:07.823369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0] Write session: try to update token
2025-10-15T10:57:07.823433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:07.829376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:07.829410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:07.829446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400853929220312:5015]
2025-10-15T10:57:07.829582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:07.829595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:07.831615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:07.833017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:07.834357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:07.854367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:07.856934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:07.857709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:07.898332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:07.898378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:07.898393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:07.898404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:07.898442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400853929220312:5015]
2025-10-15T10:57:07.898469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400853929220312:5015]
2025-10-15T10:57:07.898491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400853929220312:5015]
2025-10-15T10:57:07.898633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:07.898659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:07.898670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:07.898688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:07.898710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:07.898730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:07.898734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:07.898765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:07.899796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:07.906552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId: src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:07.927612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:08.033623Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:08.035008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:08.035046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:08.036199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:08.036215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400851129516349:4933]
2025-10-15T10:57:08.036236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:08.036286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:08.036438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:08.051919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 369 reason: error at write: Disconnected sessionId: src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0
2025-10-15T10:57:08.052275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 369 sessionId: src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0 is DEAD
2025-10-15T10:57:08.052715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:08.052785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0] Write session will restart in 0.008045s
2025-10-15T10:57:08.052968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0] Write session: Do CDS request
2025-10-15T10:57:08.053031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:08.065696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:08.065838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:08.065759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 370
2025-10-15T10:57:08.066574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:08.066901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:08.066956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:08.066983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:08.069266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 370 sessionId:  describe result for acl check
2025-10-15T10:57:08.069451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:08.069491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:08.069508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:08.069539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400855424483679:5477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:08.072994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400855424483679:5477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:08.078063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400855424483679:5477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:08.086965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400855424483679:5477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:08.087014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400855424483679:5477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:08.087043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400855424483679:5477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:08.087075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:08.104908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:08.106398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:08.107118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:08.107148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:08.107187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:08.107439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:08.107640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400858224187824:5018]
2025-10-15T10:57:08.109767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:08.110581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:08.110781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:08.112014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:08.112346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.112363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.112371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.112377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.112385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.112391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.112398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.112404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.112411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.112417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.112424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.112432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.112439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.112445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.112489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.112597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.112654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.112703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.112753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.112804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.112847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.112897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.112943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.112993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.113040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.113093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.113140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.113194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.113237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.113310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.113375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.113432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.113486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.113541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.113590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.113648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.113700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.113757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.113806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.113865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.113921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.113977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.114026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.114087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.114138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.114196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.114245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.114305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.114358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.114415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.114467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.114524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.114571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.114628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.114675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.114732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.115236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:08.130154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:08.136282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400855424483855:4933]
2025-10-15T10:57:08.145790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:08.145838Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:08.145857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:08.145877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:08.145903Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 369 [2:7561400858224187824:5018]
2025-10-15T10:57:08.145956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:08.146018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:08.146039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:08.146053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:08.146065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:08.146114Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:08.146142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:08.146165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:08.147061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.147089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.147104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.147115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:08.147389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:08.147415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.147561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.147691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 369
2025-10-15T10:57:08.147717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 369
2025-10-15T10:57:08.147759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.147788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 369, pipe: [1:7561400855424483855:4933]
2025-10-15T10:57:08.147999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:08.148083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400855424483794:5477], now have 1 active actors on pipe
2025-10-15T10:57:08.148118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400855424483663:2467], now have 1 active actors on pipe
2025-10-15T10:57:08.148139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400855424483855:4933], now have 1 active actors on pipe
2025-10-15T10:57:08.148208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:08.148234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:08.148269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400858224187819:5018]
2025-10-15T10:57:08.148288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400858224187819:5018]
2025-10-15T10:57:08.148301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400858224187819:5018]
2025-10-15T10:57:08.148337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:08.148377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:08.148399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:08.148410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:08.148412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:08.148594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:08.148618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:08.148681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:08.148714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:08.148735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:08.148746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:08.148778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:08.148817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:08.148937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400858224187819:5018]
2025-10-15T10:57:08.148969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:08.149015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:08.149015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:08.149423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:08.149449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:08.149505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:08.149764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 370 partition: 0 MaxSeqNo: 46 sessionId: src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0
2025-10-15T10:57:08.150470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4bed89a-6b846623-5c67ff67-1e6aa2f3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:08.169951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0] Write session: try to update token
2025-10-15T10:57:08.170010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:08.177008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:08.177043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:08.177084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400858224187819:5018]
2025-10-15T10:57:08.177212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:08.177216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:08.179243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:08.180595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:08.181981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:08.183274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:08.184958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:08.185412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:08.244486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId: src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:08.249690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:08.249719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:08.249732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:08.249742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:08.249776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400858224187819:5018]
2025-10-15T10:57:08.249792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400858224187819:5018]
2025-10-15T10:57:08.249809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400858224187819:5018]
2025-10-15T10:57:08.249920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:08.249960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:08.249968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:08.249980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:08.249991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:08.249996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:08.250031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:08.250047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:08.250964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:08.267493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:08.395246Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:08.397829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:08.397875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:08.398404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:08.398439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:08.398509Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:08.410543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 370 reason: error at write: Disconnected sessionId: src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0
2025-10-15T10:57:08.411073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 370 sessionId: src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0 is DEAD
2025-10-15T10:57:08.411592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:08.411649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0] Write session will restart in 0.007497s
2025-10-15T10:57:08.411788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0] Write session: Do CDS request
2025-10-15T10:57:08.411831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:08.423529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:08.423702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400855424483855:4933]
2025-10-15T10:57:08.424313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:08.424361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 371
2025-10-15T10:57:08.424485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:08.424973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:08.425116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:08.425142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:08.425152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:08.426445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 371 sessionId:  describe result for acl check
2025-10-15T10:57:08.426557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:08.426578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:08.426594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:08.426612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400855424483902:5489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:08.429315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400855424483902:5489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:08.435083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400855424483902:5489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:08.441465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400855424483902:5489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:08.441509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400855424483902:5489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:08.441525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400855424483902:5489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:08.441552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:08.482291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:08.484235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:08.485036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:08.485069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:08.485108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:08.485330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:08.485507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400858224188039:5026]
2025-10-15T10:57:08.487813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:08.488838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:08.489122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:08.490705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:08.491042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.491058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.491065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.491071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.491078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.491084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.491090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.491096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.491102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.491109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.491116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.491122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.491129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.491136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.491179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.491305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.491408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.491491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.491560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.491618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.491676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.491733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.491792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.491852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.491916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.491964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.492013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.492060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.492118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.492187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.492242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.492308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.492384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.492491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.492576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.492689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.492747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.492817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.492873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.492939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.492997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.493069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.493120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.493174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.493228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.493290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.493340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.493395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.493445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.493499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.493559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.493682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.493785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.493872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.493934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.493999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.494546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:08.509299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:08.518974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:08.519020Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:08.519034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:08.519051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:08.519075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 370 [2:7561400858224188039:5026]
2025-10-15T10:57:08.519126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:08.519183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:08.519196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:08.519209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:08.519221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:08.519284Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:08.519316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:08.519337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:08.521138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.521162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.521176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.521187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:08.521439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:08.521463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.521599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.521785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.521765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 370
2025-10-15T10:57:08.521890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 370
2025-10-15T10:57:08.522014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:08.522101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400855424483932:5489], now have 1 active actors on pipe
2025-10-15T10:57:08.522141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400855424483898:2467], now have 1 active actors on pipe
2025-10-15T10:57:08.522190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:08.522218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:08.522270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400858224188032:5026]
2025-10-15T10:57:08.522285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400858224188032:5026]
2025-10-15T10:57:08.522298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400858224188032:5026]
2025-10-15T10:57:08.522332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:08.522367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:08.522401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:08.522405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:08.522414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:08.522576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:08.522601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:08.522662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:08.522697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:08.522720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:08.522731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:08.522766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:08.522805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:08.522932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400858224188032:5026]
2025-10-15T10:57:08.522961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:08.522981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:08.523006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:08.523441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:08.523464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:08.523535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:08.523794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 371 partition: 0 MaxSeqNo: 46 sessionId: src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0
2025-10-15T10:57:08.524259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400855424484090:4933]
2025-10-15T10:57:08.524635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400855424484090:4933], now have 1 active actors on pipe
2025-10-15T10:57:08.524678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 370, pipe: [1:7561400855424484090:4933]
2025-10-15T10:57:08.524745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4df6ae80-8154cdd9-993b3495-825bbd7d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:08.545768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0] Write session: try to update token
2025-10-15T10:57:08.545823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:08.567714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:08.567744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:08.567770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400858224188032:5026]
2025-10-15T10:57:08.567886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:08.567906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:08.569743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:08.571090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:08.572658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:08.574393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:08.577712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:08.578407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:08.621897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId: src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:08.644089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:08.644126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:08.644137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:08.644182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:08.644191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:08.644201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:08.644208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:08.644234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400858224188032:5026]
2025-10-15T10:57:08.644250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400858224188032:5026]
2025-10-15T10:57:08.644265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400858224188032:5026]
2025-10-15T10:57:08.644354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:08.644367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:08.644420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:08.644463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:08.644507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:08.645191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:08.659705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:08.784587Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:08.785942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:08.785976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:08.786550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:08.786610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400855424484090:4933]
2025-10-15T10:57:08.786693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:08.786722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:08.786748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:08.796385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 371 reason: error at write: Disconnected sessionId: src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0
2025-10-15T10:57:08.796728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 371 sessionId: src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0 is DEAD
2025-10-15T10:57:08.797171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:08.797229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0] Write session will restart in 0.005365s
2025-10-15T10:57:08.797375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0] Write session: Do CDS request
2025-10-15T10:57:08.797418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:08.807251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:08.807279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 372
2025-10-15T10:57:08.809491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:08.810282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:08.810483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:08.810514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:08.810530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:08.811932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 372 sessionId:  describe result for acl check
2025-10-15T10:57:08.812026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:08.812037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:08.812044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:08.812055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400855424484124:5496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:08.814147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400855424484124:5496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:08.819780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400855424484124:5496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:08.830333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400855424484124:5496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:08.830380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400855424484124:5496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:08.830397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400855424484124:5496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:08.830426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:08.859789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:08.861422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:08.862254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:08.862281Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:08.862327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:08.862581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:08.862759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400858224188263:5036]
2025-10-15T10:57:08.864861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:08.865789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:08.865985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:08.867180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:08.867514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.867530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.867537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.867543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.867548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.867554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.867560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.867566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.867572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.867578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.867586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.867591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.867597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.867603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.867647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.867750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.867793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.867836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.867877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.867923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.867969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.868010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.868055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.868115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.868160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.868204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.868253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.868297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.868338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.868409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:08.868475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.868525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:08.868574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.868645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:08.868696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.868759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:08.868816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.868876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:08.868924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.868986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:08.869033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.869082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:08.869134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.869197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:08.869256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.869320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:08.869376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.869427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:08.869462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.869500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:08.869534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.869572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.869609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.869670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.869726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.869786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.870305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:08.884611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:08.886903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400855424484307:4933]
2025-10-15T10:57:08.892866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:08.892903Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:08.892916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:08.892932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:08.892952Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 371 [2:7561400858224188263:5036]
2025-10-15T10:57:08.892998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:08.893055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:08.893071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:08.893083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:08.893092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:08.893143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:08.893167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:08.893189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:08.894202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.894219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.894229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.894236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:08.894500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:08.894525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:08.894688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:08.894773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 371, pipe: [1:7561400855424484307:4933]
2025-10-15T10:57:08.894820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 371
2025-10-15T10:57:08.894887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:08.894890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 371
2025-10-15T10:57:08.895121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:08.895208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400855424484307:4933], now have 1 active actors on pipe
2025-10-15T10:57:08.895240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400855424484195:5496], now have 1 active actors on pipe
2025-10-15T10:57:08.895262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400855424484109:2467], now have 1 active actors on pipe
2025-10-15T10:57:08.895314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:08.895339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:08.895413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400858224188258:5036]
2025-10-15T10:57:08.895432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400858224188258:5036]
2025-10-15T10:57:08.895445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400858224188258:5036]
2025-10-15T10:57:08.895481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:08.895540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:08.895559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:08.895565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:08.895578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:08.895729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:08.895751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:08.895819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a001913-23dec6eb-29cbe730-b16615d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:08.895846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:08.895859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:08.895865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:08.895892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:08.895926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:08.896052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400858224188258:5036]
2025-10-15T10:57:08.896088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:08.896140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:08.896146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:08.896612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:08.896641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:08.896710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:08.896974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 372 partition: 0 MaxSeqNo: 46 sessionId: src_id|3a001913-23dec6eb-29cbe730-b16615d5_0
2025-10-15T10:57:08.897811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac4db28b-bffb2de6-68293a83-b9a196ea_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3a001913-23dec6eb-29cbe730-b16615d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:08.917644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a001913-23dec6eb-29cbe730-b16615d5_0] Write session: try to update token
2025-10-15T10:57:08.917707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a001913-23dec6eb-29cbe730-b16615d5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:08.951180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:08.951214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:08.951251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400858224188258:5036]
2025-10-15T10:57:08.951400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:08.951509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:08.953196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:08.954310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:08.955519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:08.957267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:08.960052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:08.960698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:08.984740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:08.984767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:08.984778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:08.984785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:08.984813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400858224188258:5036]
2025-10-15T10:57:08.984841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400858224188258:5036]
2025-10-15T10:57:08.984855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400858224188258:5036]
2025-10-15T10:57:08.984956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:08.984976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:08.984982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:08.985024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:08.985051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:08.986364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:08.994312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId: src_id|3a001913-23dec6eb-29cbe730-b16615d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:09.020553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:09.128486Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:09.130183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:09.130230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:09.130968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:09.130743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:09.130748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400855424484307:4933]
2025-10-15T10:57:09.130774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:09.130813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:09.171709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 372 reason: error at write: Disconnected sessionId: src_id|3a001913-23dec6eb-29cbe730-b16615d5_0
2025-10-15T10:57:09.172461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a001913-23dec6eb-29cbe730-b16615d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:09.172522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a001913-23dec6eb-29cbe730-b16615d5_0] Write session will restart in 0.009533s
2025-10-15T10:57:09.172655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a001913-23dec6eb-29cbe730-b16615d5_0] Write session: Do CDS request
2025-10-15T10:57:09.172698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a001913-23dec6eb-29cbe730-b16615d5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:09.172062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 372 sessionId: src_id|3a001913-23dec6eb-29cbe730-b16615d5_0 is DEAD
2025-10-15T10:57:09.186208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:09.186243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 373
2025-10-15T10:57:09.186331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a001913-23dec6eb-29cbe730-b16615d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:09.186760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:09.186886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:09.186907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:09.186917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:09.188192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 373 sessionId:  describe result for acl check
2025-10-15T10:57:09.188303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:09.188324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:09.188332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:09.188349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400859719451782:5502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:09.191159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400859719451782:5502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:09.199097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:09.199628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400859719451782:5502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:09.201041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:09.201857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:09.201880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:09.201914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:09.202144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:09.202305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400862519155772:5039]
2025-10-15T10:57:09.204363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:09.205287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:09.205477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:09.206067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400859719451782:5502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:09.206112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400859719451782:5502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:09.206124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400859719451782:5502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:09.206147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:09.206595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:09.206877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.206893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.206900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.206906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.206912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.206919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.206925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.206931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.206936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.206942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.206947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.206953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.206958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.206964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.207004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.207101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.207143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.207186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.207226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.207268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.207316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.207380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.207419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.207461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.207503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.207547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.207593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.207641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.207683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.207745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.207801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.207852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.207900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.207954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.208000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.208052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.208102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.208167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.208212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.208263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.208312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.208363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.208411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.208460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.208509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.208560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.208605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.208657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.208696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.208745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.208796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.208850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.208896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.208950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.208998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.209050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.209516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:09.230939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400859719451818:4933]
2025-10-15T10:57:09.231525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:09.241387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:09.241442Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:09.241459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:09.241477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:09.241509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 372 [2:7561400862519155772:5039]
2025-10-15T10:57:09.241557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:09.241608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:09.241621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:09.241632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:09.241642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:09.241684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:09.241701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:09.241720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:09.242696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.242720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.242734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.242744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:09.242981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:09.243005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.243132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.243317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.243308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 372
2025-10-15T10:57:09.243314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 372, pipe: [1:7561400859719451818:4933]
2025-10-15T10:57:09.243434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 372
2025-10-15T10:57:09.243653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:09.243736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400859719451619:2467], now have 1 active actors on pipe
2025-10-15T10:57:09.243765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400859719451818:4933], now have 1 active actors on pipe
2025-10-15T10:57:09.243791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400859719451815:5502], now have 1 active actors on pipe
2025-10-15T10:57:09.243856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:09.243881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:09.243915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400862519155767:5039]
2025-10-15T10:57:09.243928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400862519155767:5039]
2025-10-15T10:57:09.243941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400862519155767:5039]
2025-10-15T10:57:09.243972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:09.244017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:09.244035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:09.244055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:09.244068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:09.244207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:09.244230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:09.244286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:09.244320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:09.244335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:09.244344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:09.244374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:09.244405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:09.244505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400862519155767:5039]
2025-10-15T10:57:09.244543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:09.244580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:09.244639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:09.245070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:09.245094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:09.245147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:09.245483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 373 partition: 0 MaxSeqNo: 46 sessionId: src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0
2025-10-15T10:57:09.247309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a001913-23dec6eb-29cbe730-b16615d5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:09.272272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0] Write session: try to update token
2025-10-15T10:57:09.272326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:09.281124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:09.281155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:09.281194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400862519155767:5039]
2025-10-15T10:57:09.281301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:09.281565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:09.283021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:09.284627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:09.286407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:09.287853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:09.289559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:09.290137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:09.341558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:09.341584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:09.341593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:09.341601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:09.341628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400862519155767:5039]
2025-10-15T10:57:09.341644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400862519155767:5039]
2025-10-15T10:57:09.341664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400862519155767:5039]
2025-10-15T10:57:09.341770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:09.341792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:09.341828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:09.341887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:09.341943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:09.342774Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:09.354286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId: src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:09.376697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:09.478621Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:09.480042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:09.480080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:09.480534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400859719451818:4933]
2025-10-15T10:57:09.480587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:09.480600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:09.480634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:09.480827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:09.494426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 373 reason: error at write: Disconnected sessionId: src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0
2025-10-15T10:57:09.494931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 373 sessionId: src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0 is DEAD
2025-10-15T10:57:09.495259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 247 BytesWritten: 103628882 MessagesWritten: 46 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-15T10:57:09.495427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:09.495484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0] Write session will restart in 0.006543s
2025-10-15T10:57:09.495638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0] Write session: Do CDS request
2025-10-15T10:57:09.495683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:09.506207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:09.506171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:09.506230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 374
2025-10-15T10:57:09.506854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:09.507004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:09.507026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:09.507036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:09.508343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 374 sessionId:  describe result for acl check
2025-10-15T10:57:09.508533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:09.508565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:09.508586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:09.508614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400859719451862:5513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:09.513573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400859719451862:5513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:09.521502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400859719451862:5513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:09.529888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400859719451862:5513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:09.529945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400859719451862:5513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:09.529963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400859719451862:5513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:09.529996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:09.559758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:09.561187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:09.561960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:09.561990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:09.562032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:09.562272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:09.562469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400862519155976:5042]
2025-10-15T10:57:09.564761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:09.565535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:09.565734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:09.566998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:09.567319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.567337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.567368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.567376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.567383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.567390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.567398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.567406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.567413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.567420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.567427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.567435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.567442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.567450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.567497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.567611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.567670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.567733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.567786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.567842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.567894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.567953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.568011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.568057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.568121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.568175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.568228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.568278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.568327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.568395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.568464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.568519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.568577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.568634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.568685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.568746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.568802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.568862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.568913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.568975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.569032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.569090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.569143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.569204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.569254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.569316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.569366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.569423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.569481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.569543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.569597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.569659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.569713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.569771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.569823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.569885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.570412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:09.580670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400859719452046:4933]
2025-10-15T10:57:09.587827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:09.596791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:09.596830Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:09.596845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:09.596862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:09.596882Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 373 [2:7561400862519155976:5042]
2025-10-15T10:57:09.596935Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:09.596986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:09.596999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:09.597008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:09.597018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:09.597063Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:09.597082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:09.597100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:09.610743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.610768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.610780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.610790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:09.611043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:09.611064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.611177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.611360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.611418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 373
2025-10-15T10:57:09.611418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 373
2025-10-15T10:57:09.611504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 373, pipe: [1:7561400859719452046:4933]
2025-10-15T10:57:09.611564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:09.611647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400859719451846:2467], now have 1 active actors on pipe
2025-10-15T10:57:09.611674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400859719452046:4933], now have 1 active actors on pipe
2025-10-15T10:57:09.611695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400859719451935:5513], now have 1 active actors on pipe
2025-10-15T10:57:09.611740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:09.611760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:09.611811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400862519155971:5042]
2025-10-15T10:57:09.611829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400862519155971:5042]
2025-10-15T10:57:09.611840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400862519155971:5042]
2025-10-15T10:57:09.611869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:09.611902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:09.611921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:09.611931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:09.611932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:09.612088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:09.612118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:09.612171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:09.612199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:09.612215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:09.612226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:09.612258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:09.612292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:09.612411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400862519155971:5042]
2025-10-15T10:57:09.612446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:09.612488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:09.612498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:09.612980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:09.613022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:09.613080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:09.613424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 374 partition: 0 MaxSeqNo: 46 sessionId: src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0
2025-10-15T10:57:09.614242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec337cc-5dbc3d4e-8f89a6d-91e7f6c9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:09.633791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0] Write session: try to update token
2025-10-15T10:57:09.633833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:09.642672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:09.642712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:09.642755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400862519155971:5042]
2025-10-15T10:57:09.642886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:09.642905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:09.644800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:09.646077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:09.647376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:09.648610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:09.650460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:09.650926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:09.701516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:09.701553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:09.701568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:09.701579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:09.701638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400862519155971:5042]
2025-10-15T10:57:09.701676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400862519155971:5042]
2025-10-15T10:57:09.701702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400862519155971:5042]
2025-10-15T10:57:09.701816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:09.701864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:09.701886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:09.701901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:09.701916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:09.701928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:09.701980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:09.702014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:09.703165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:09.713636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId: src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:09.733305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:09.844700Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:09.847015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:09.847045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:09.847599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:09.847562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:09.847696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:09.847724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:09.863769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 374 reason: error at write: Disconnected sessionId: src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0
2025-10-15T10:57:09.864146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 374 sessionId: src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0 is DEAD
2025-10-15T10:57:09.864472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:09.864551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0] Write session will restart in 0.007715s
2025-10-15T10:57:09.864718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0] Write session: Do CDS request
2025-10-15T10:57:09.864758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:09.876543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:09.892895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400859719452046:4933]
2025-10-15T10:57:09.893019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:09.893039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 375
2025-10-15T10:57:09.893438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:09.893564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:09.893588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:09.893598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:09.894871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 375 sessionId:  describe result for acl check
2025-10-15T10:57:09.894992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:09.895010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:09.895020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:09.895038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400859719452087:5523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:09.897780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400859719452087:5523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:09.904276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400859719452087:5523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:09.914508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400859719452087:5523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:09.914554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400859719452087:5523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:09.914570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400859719452087:5523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:09.914600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:09.940738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:09.942267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:09.942903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:09.942928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:09.942960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:09.943158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:09.943319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400862519156193:5050]
2025-10-15T10:57:09.945102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:09.945859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:09.946017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:09.947006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:09.947291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.947304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.947310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.947316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.947321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.947326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.947331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.947336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.947341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.947363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.947370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.947376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.947381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.947387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.947424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.947506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.947546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.947583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.947620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.947656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.947691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.947734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.947773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.947816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.947851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.947887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.947923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.947966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.948008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.948068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:09.948135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.948186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:09.948232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.948280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:09.948320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.948367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:09.948408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.948453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:09.948494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.948542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:09.948585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.948629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:09.948673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.948715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:09.948752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.948796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:09.948830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.948873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:09.948917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.948966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:09.949008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.949052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.949090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.949132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.949169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.949218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.949623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:09.968968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:09.989048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:09.989091Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:09.989106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:09.989123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:09.989144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 374 [2:7561400862519156193:5050]
2025-10-15T10:57:09.989187Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:09.989234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:09.989248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:09.989259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:09.989269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:09.989310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:09.989331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:09.989351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:09.991123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.991147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.991161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.991173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:09.991424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:09.991448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:09.991575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:09.991750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:09.991698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 374
2025-10-15T10:57:09.991814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 374
2025-10-15T10:57:09.991973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:09.992048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400859719452184:5523], now have 1 active actors on pipe
2025-10-15T10:57:09.992075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400859719452069:2467], now have 1 active actors on pipe
2025-10-15T10:57:09.992098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400862519156188:5050]
2025-10-15T10:57:09.992111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400862519156188:5050]
2025-10-15T10:57:09.992134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400862519156188:5050]
2025-10-15T10:57:09.992169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:09.992219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:09.992231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:09.992233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:09.992244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:09.992391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:09.992413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:09.992539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:09.992562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:09.992605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400862519156188:5050]
2025-10-15T10:57:09.992636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:09.992672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:09.992735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:09.992769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:09.992785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:09.992796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:09.992826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:09.992859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:09.993318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400859719452276:4933]
2025-10-15T10:57:09.994011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 375 partition: 0 MaxSeqNo: 46 sessionId: src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0
2025-10-15T10:57:09.994437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 374, pipe: [1:7561400859719452276:4933]
2025-10-15T10:57:09.994770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|554b24ae-9ad2da3b-ad5ce876-69c8cd40_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:09.992930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:09.993588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:09.993606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:09.993666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:09.993799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400859719452276:4933], now have 1 active actors on pipe
2025-10-15T10:57:10.015861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0] Write session: try to update token
2025-10-15T10:57:10.015908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:10.097697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:10.097732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:10.097743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:10.097753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:10.097781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400862519156188:5050]
2025-10-15T10:57:10.097803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400862519156188:5050]
2025-10-15T10:57:10.097822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400862519156188:5050]
2025-10-15T10:57:10.097971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:10.098010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:10.098018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:10.098022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:10.098031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:10.098057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:10.098070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:10.098087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:10.099135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:10.113125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId: src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:10.133924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:10.233677Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:10.250563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:10.250614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:10.250689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:10.250702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:10.250728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400862519156188:5050]
2025-10-15T10:57:10.251091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:10.251336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:10.252148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:10.252172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:10.252184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:10.252339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400859719452276:4933]
2025-10-15T10:57:10.275966Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 3 CurrentSessionLifetimeMs: 181568 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:57:10.286769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 375 reason: error at write: Disconnected sessionId: src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0
2025-10-15T10:57:10.287153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 375 sessionId: src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0 is DEAD
2025-10-15T10:57:10.287604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:10.287663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0] Write session will restart in 0.005807s
2025-10-15T10:57:10.287825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0] Write session: Do CDS request
2025-10-15T10:57:10.287872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:10.298501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:10.298569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:10.298621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 376
2025-10-15T10:57:10.299214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:10.299392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:10.299410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:10.299421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:10.303133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 376 sessionId:  describe result for acl check
2025-10-15T10:57:10.303338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:10.303390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:10.303419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:10.303452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400864014419661:5531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:10.307188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400864014419661:5531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:10.316896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400864014419661:5531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:10.330075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400864014419661:5531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:10.330124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400864014419661:5531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:10.330139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400864014419661:5531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:10.330170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:10.338095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:10.342988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:10.343878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:10.343910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:10.343955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:10.344237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:10.344440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400866814123729:5060]
2025-10-15T10:57:10.346724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:10.347738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:10.347898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:10.349175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:10.349558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:10.349576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:10.349584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:10.349591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:10.349599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:10.349607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:10.349614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:10.349621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:10.349629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:10.349636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:10.349644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:10.349652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.349659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.349667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.349718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:10.349834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:10.349888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:10.349930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:10.349987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:10.350045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:10.350096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:10.350138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:10.350176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:10.350224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:10.350263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:10.350300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.350338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.350375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.350408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:10.350469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:10.350522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:10.350565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:10.350613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:10.350685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:10.350744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:10.350804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:10.350879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:10.350945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:10.350993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:10.351056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:10.351112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:10.351174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:10.351226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:10.351291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:10.351364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:10.351446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:10.351501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:10.351563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:10.351615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:10.351679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:10.351731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.351795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.351851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.351915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.351965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.352029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.352609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:10.352742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400864014419806:4933]
2025-10-15T10:57:10.385234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:10.394459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:10.394514Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:10.394535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:10.394557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:10.394585Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 375 [2:7561400866814123729:5060]
2025-10-15T10:57:10.394642Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:10.394710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:10.394732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:10.394744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:10.394757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:10.394806Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:10.394834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:10.394868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:10.395936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.395963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.395976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.395989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:10.396270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:10.396296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.396446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.396569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 375, pipe: [1:7561400864014419806:4933]
2025-10-15T10:57:10.396694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 375
2025-10-15T10:57:10.396783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 375
2025-10-15T10:57:10.396661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.396915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:10.397006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400864014419806:4933], now have 1 active actors on pipe
2025-10-15T10:57:10.397030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400864014419800:5531], now have 1 active actors on pipe
2025-10-15T10:57:10.397051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400864014419594:2467], now have 1 active actors on pipe
2025-10-15T10:57:10.397105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:10.397128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:10.397166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400866814123724:5060]
2025-10-15T10:57:10.397182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400866814123724:5060]
2025-10-15T10:57:10.397196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400866814123724:5060]
2025-10-15T10:57:10.397234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:10.397276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:10.397293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:10.397305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:10.397326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:10.397510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:10.397529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:10.397595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:10.397626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:10.397645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:10.397656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:10.397694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:10.397737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:10.397871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400866814123724:5060]
2025-10-15T10:57:10.397914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:10.397951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:10.397969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:10.398496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:10.398529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:10.398620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:10.398933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 376 partition: 0 MaxSeqNo: 46 sessionId: src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0
2025-10-15T10:57:10.399778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a1f8ad-50546a00-27f9adad-f37ab8f8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:10.420615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0] Write session: try to update token
2025-10-15T10:57:10.420678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:10.427828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:10.427865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:10.427909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400866814123724:5060]
2025-10-15T10:57:10.428055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:10.428099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:10.430095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:10.431429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:10.432770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:10.434069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:10.435818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:10.436338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:10.492389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:10.492427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:10.492441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:10.492451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:10.492492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400866814123724:5060]
2025-10-15T10:57:10.492517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400866814123724:5060]
2025-10-15T10:57:10.492547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400866814123724:5060]
2025-10-15T10:57:10.492717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:10.492748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:10.508776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:10.511261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:10.511367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:10.511430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:10.551537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId: src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:10.573423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:10.647954Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:10.649390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:10.649427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:10.649946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:10.649952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:10.649980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:10.650104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400864014419806:4933]
2025-10-15T10:57:10.650265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:10.686243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 376 reason: error at write: Disconnected sessionId: src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0
2025-10-15T10:57:10.686635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 376 sessionId: src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0 is DEAD
2025-10-15T10:57:10.687008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:10.687051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0] Write session will restart in 0.008268s
2025-10-15T10:57:10.687167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0] Write session: Do CDS request
2025-10-15T10:57:10.687218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:10.700233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:10.700349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:10.700292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 377
2025-10-15T10:57:10.701038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:10.701247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:10.701280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:10.701297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:10.704354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 377 sessionId:  describe result for acl check
2025-10-15T10:57:10.704476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:10.704492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:10.704501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:10.704517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400864014419864:5536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:10.706745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400864014419864:5536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:10.715541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400864014419864:5536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:10.723830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400864014419864:5536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:10.723872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400864014419864:5536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:10.723891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400864014419864:5536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:10.723917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:10.739595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:10.741060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:10.741843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:10.741865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:10.741899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:10.742086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:10.742212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400866814123937:5063]
2025-10-15T10:57:10.744102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:10.745011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:10.745247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:10.746589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:10.746939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:10.746959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:10.746967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:10.746974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:10.746980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:10.746988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:10.746995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:10.747003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:10.747011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:10.747018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:10.747025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:10.747032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.747040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.747047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.747095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:10.747217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:10.747265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:10.747314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:10.747392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:10.747445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:10.747499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:10.747551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:10.747602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:10.747656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:10.747713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:10.747766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.747822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.747873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.747929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:10.748008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:10.748076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:10.748158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:10.748221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:10.748282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:10.748340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:10.748406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:10.748469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:10.748532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:10.748588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:10.748652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:10.748711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:10.748777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:10.748833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:10.748896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:10.748957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:10.749023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:10.749078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:10.749141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:10.749202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:10.749281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:10.749336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.749398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.749451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.749512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.749565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.749629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.750169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:10.750568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400864014420017:4933]
2025-10-15T10:57:10.765370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:10.791293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:10.791360Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:10.791382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:10.791402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:10.791428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 376 [2:7561400866814123937:5063]
2025-10-15T10:57:10.791483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:10.791547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:10.791563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:10.791576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:10.791589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:10.791645Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:10.791682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:10.791711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:10.792871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.792900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.792912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.792923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:10.793209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:10.793243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:10.793397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:10.793500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 376
2025-10-15T10:57:10.793505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 376, pipe: [1:7561400864014420017:4933]
2025-10-15T10:57:10.793613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:10.793609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 376
2025-10-15T10:57:10.793871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:10.793968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400864014419977:5536], now have 1 active actors on pipe
2025-10-15T10:57:10.794001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400864014420017:4933], now have 1 active actors on pipe
2025-10-15T10:57:10.794029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400864014419817:2467], now have 1 active actors on pipe
2025-10-15T10:57:10.794083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:10.794112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:10.794168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400866814123932:5063]
2025-10-15T10:57:10.794189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400866814123932:5063]
2025-10-15T10:57:10.794203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400866814123932:5063]
2025-10-15T10:57:10.794241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:10.794300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:10.794326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:10.794330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:10.794342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:10.794535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:10.794562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:10.794632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bf80d97-831a065e-b9be98b-884636c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:10.794671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:10.794695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:10.794704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:10.794742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:10.794790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:10.794932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400866814123932:5063]
2025-10-15T10:57:10.794969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:10.795009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:10.795025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:10.795514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:10.795547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:10.795614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:10.795977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 377 partition: 0 MaxSeqNo: 46 sessionId: src_id|4bf80d97-831a065e-b9be98b-884636c5_0
2025-10-15T10:57:10.796748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832d84d5-73c2286a-9d0e83b1-51fefd27_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4bf80d97-831a065e-b9be98b-884636c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:10.819747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf80d97-831a065e-b9be98b-884636c5_0] Write session: try to update token
2025-10-15T10:57:10.819814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf80d97-831a065e-b9be98b-884636c5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:10.826292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:10.826328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:10.826369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400866814123932:5063]
2025-10-15T10:57:10.826489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:10.826507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:10.828709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:10.830045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:10.831565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:10.832843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:10.834514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:10.834972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:10.880809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:10.880844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:10.880858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:10.880870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:10.880909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400866814123932:5063]
2025-10-15T10:57:10.880933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400866814123932:5063]
2025-10-15T10:57:10.880954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400866814123932:5063]
2025-10-15T10:57:10.881048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:10.881094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:10.881118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:10.881127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:10.881138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:10.883756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:10.904920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId: src_id|4bf80d97-831a065e-b9be98b-884636c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:10.925435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:11.021193Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:11.022638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:11.022677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:11.023165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:11.023193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:11.023212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400864014420017:4933]
2025-10-15T10:57:11.023375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:11.023431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:11.050362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 377 reason: error at write: Disconnected sessionId: src_id|4bf80d97-831a065e-b9be98b-884636c5_0
2025-10-15T10:57:11.050660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 377 sessionId: src_id|4bf80d97-831a065e-b9be98b-884636c5_0 is DEAD
2025-10-15T10:57:11.050944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf80d97-831a065e-b9be98b-884636c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:11.050979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf80d97-831a065e-b9be98b-884636c5_0] Write session will restart in 0.006050s
2025-10-15T10:57:11.051069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf80d97-831a065e-b9be98b-884636c5_0] Write session: Do CDS request
2025-10-15T10:57:11.051102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf80d97-831a065e-b9be98b-884636c5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:11.061212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:11.061247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 378
2025-10-15T10:57:11.061519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf80d97-831a065e-b9be98b-884636c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:11.062103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:11.062243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:11.062266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:11.062277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:11.063715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 378 sessionId:  describe result for acl check
2025-10-15T10:57:11.063889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:11.063920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:11.063940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:11.063970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400868309387356:5540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:11.067551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400868309387356:5540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:11.074304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400868309387356:5540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:11.083107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400868309387356:5540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:11.083149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400868309387356:5540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:11.083159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400868309387356:5540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:11.083183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:11.096359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:11.098062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:11.098771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:11.098802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:11.098847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:11.099069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:11.099236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400871109091450:5065]
2025-10-15T10:57:11.101352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:11.102256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:11.102431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:11.103497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:11.103775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.103790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.103796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.103803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.103808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.103814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.103820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.103828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.103836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.103841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.103847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.103853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.103860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.103865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.103904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.103996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.104046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.104094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.104152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.104198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.104242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.104287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.104330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.104375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.104418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.104468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.104509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.104557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.104605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.104668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.104727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.104785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.104834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.104891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.104942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.104994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.105045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.105098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.105144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.105193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.105238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.105291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.105335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.105384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.105437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.105494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.105538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.105590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.105641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.105692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.105738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.105790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.105838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.105888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.105931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.105984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.106458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:11.122040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:11.123302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400868309387533:4933]
2025-10-15T10:57:11.131758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:11.131801Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:11.131815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:11.131833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:11.131855Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 377 [2:7561400871109091450:5065]
2025-10-15T10:57:11.131903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:11.131955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:11.131967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:11.131977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:11.131986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:11.132027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:11.132054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:11.132072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:11.141514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.141540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.141549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.141557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:11.141780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:11.141799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.141898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.142049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.142239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:11.142216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 377, pipe: [1:7561400868309387533:4933]
2025-10-15T10:57:11.142222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 377
2025-10-15T10:57:11.142334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 377
2025-10-15T10:57:11.142306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400868309387533:4933], now have 1 active actors on pipe
2025-10-15T10:57:11.142332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400868309387331:2467], now have 1 active actors on pipe
2025-10-15T10:57:11.142348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400868309387507:5540], now have 1 active actors on pipe
2025-10-15T10:57:11.142368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400871109091445:5065]
2025-10-15T10:57:11.142381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400871109091445:5065]
2025-10-15T10:57:11.142391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400871109091445:5065]
2025-10-15T10:57:11.142414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:11.142453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:11.142469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:11.142471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:11.142479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:11.142615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:11.142634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:11.142688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:11.142709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:11.142805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400871109091445:5065]
2025-10-15T10:57:11.142831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:11.142871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:11.142886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:11.142910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:11.142923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:11.142931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:11.142957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:11.142989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:11.143086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:11.143565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:11.143588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:11.143642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:11.143863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 378 partition: 0 MaxSeqNo: 46 sessionId: src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0
2025-10-15T10:57:11.144551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf80d97-831a065e-b9be98b-884636c5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:11.166813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0] Write session: try to update token
2025-10-15T10:57:11.166878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:11.204343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:11.204390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:11.204408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:11.204426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:11.204473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400871109091445:5065]
2025-10-15T10:57:11.204510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400871109091445:5065]
2025-10-15T10:57:11.204540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400871109091445:5065]
2025-10-15T10:57:11.204634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:11.204661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:11.204682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:11.217605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:11.217651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:11.218780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:11.232220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId: src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:11.261742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:11.364838Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:11.367186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:11.367211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:11.367251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400871109091445:5065]
2025-10-15T10:57:11.367411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:11.367433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:11.367458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:11.367935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400868309387533:4933]
2025-10-15T10:57:11.368023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:11.368155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:11.368186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:11.369437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:11.385530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 378 reason: error at write: Disconnected sessionId: src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0
2025-10-15T10:57:11.385952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 378 sessionId: src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0 is DEAD
2025-10-15T10:57:11.387903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:11.387969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0] Write session will restart in 0.009633s
2025-10-15T10:57:11.388094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0] Write session: Do CDS request
2025-10-15T10:57:11.388135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:11.402781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:11.402818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 379
2025-10-15T10:57:11.402941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:11.403476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:11.403614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:11.403631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:11.403641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:11.405060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 379 sessionId:  describe result for acl check
2025-10-15T10:57:11.405178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:11.405196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:11.405206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:11.405225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400868309387581:5552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:11.407930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400868309387581:5552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:11.414112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400868309387581:5552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:11.430423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400868309387581:5552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:11.430473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400868309387581:5552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:11.430488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400868309387581:5552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:11.430516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:11.460057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:11.461955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:11.462776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:11.462803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:11.462843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:11.463075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:11.463289Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400871109091674:5074]
2025-10-15T10:57:11.465565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:11.466538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:11.466759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:11.468049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:11.468361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400868309387770:4933]
2025-10-15T10:57:11.468423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.468443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.468451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.468459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.468466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.468473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.468481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.468489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.468497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.468503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.468512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.468519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.468525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.468531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.468580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.468695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.468747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.468794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.468844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.468900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.468955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.469007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.469057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.469112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.469166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.469216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.469262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.469308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.469370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.469442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.469509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.469571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.469624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.469679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.469730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.469793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.469843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.469906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.469959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.470018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.470069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.470128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.470175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.470236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.470292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.470350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.470403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.470469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.470526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.470585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.470639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.470699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.470755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.470816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.470869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.470929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.471519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:11.499327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:11.510359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:11.510400Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:11.510419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:11.510439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:11.510462Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 378 [2:7561400871109091674:5074]
2025-10-15T10:57:11.510514Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:11.510568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:11.510583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:11.510594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:11.510606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:11.510656Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:11.510686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:11.510707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:11.511809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.511834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.511850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.511860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:11.512106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:11.512130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.512285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.512404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 378
2025-10-15T10:57:11.512404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 378
2025-10-15T10:57:11.512511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 378, pipe: [1:7561400868309387770:4933]
2025-10-15T10:57:11.512481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.512724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:11.512808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400868309387568:2467], now have 1 active actors on pipe
2025-10-15T10:57:11.512835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400868309387649:5552], now have 1 active actors on pipe
2025-10-15T10:57:11.512858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400868309387770:4933], now have 1 active actors on pipe
2025-10-15T10:57:11.512924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:11.512949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:11.512985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400871109091669:5074]
2025-10-15T10:57:11.513007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400871109091669:5074]
2025-10-15T10:57:11.513021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400871109091669:5074]
2025-10-15T10:57:11.513059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:11.513099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:11.513130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:11.513135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:11.513147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:11.513318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:11.513343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:11.513411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:11.513446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:11.513470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:11.513481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:11.513519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:11.513564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:11.513690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400871109091669:5074]
2025-10-15T10:57:11.513720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:11.513740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:11.513764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:11.514336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:11.514364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:11.514440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:11.514688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 379 partition: 0 MaxSeqNo: 46 sessionId: src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0
2025-10-15T10:57:11.515415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a258d15e-bea409d9-bad9d595-b66a8a31_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:11.534422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0] Write session: try to update token
2025-10-15T10:57:11.534486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:11.562899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:11.562925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:11.562956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400871109091669:5074]
2025-10-15T10:57:11.563080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:11.563091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:11.564667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:11.565637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:11.566871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:11.568470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:11.571115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:11.572049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:11.606602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:11.606640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:11.606656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:11.606669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:11.606716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400871109091669:5074]
2025-10-15T10:57:11.606750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400871109091669:5074]
2025-10-15T10:57:11.606778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400871109091669:5074]
2025-10-15T10:57:11.606902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:11.606959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:11.606959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:11.606985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:11.606989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:11.608071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:11.637960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId: src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:11.660827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:11.750822Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:11.752412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:11.752459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:11.752999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400868309387770:4933]
2025-10-15T10:57:11.753002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:11.753107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:11.753118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:11.753230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:11.799913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 379 reason: error at write: Disconnected sessionId: src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0
2025-10-15T10:57:11.800266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 379 sessionId: src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0 is DEAD
2025-10-15T10:57:11.800644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:11.800702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0] Write session will restart in 0.006309s
2025-10-15T10:57:11.800863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0] Write session: Do CDS request
2025-10-15T10:57:11.800908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:11.811588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:11.811733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:11.811636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 380
2025-10-15T10:57:11.812396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:11.812595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:11.812634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:11.812650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:11.814316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 380 sessionId:  describe result for acl check
2025-10-15T10:57:11.814454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:11.814475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:11.814482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:11.814498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400868309387892:5559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:11.817129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400868309387892:5559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:11.824798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400868309387892:5559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:11.831287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400868309387892:5559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:11.831341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400868309387892:5559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:11.831380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400868309387892:5559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:11.831414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:11.838297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:11.839924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:11.840551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:11.840578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:11.840627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:11.840844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:11.841070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400871109091906:5084]
2025-10-15T10:57:11.842615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:11.843460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:11.843676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:11.844916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:11.845261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.845285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.845293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.845300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.845307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.845313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.845322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.845328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.845334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.845342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.845349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.845355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.845361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.845367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.845414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.845517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.845565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.845614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.845659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.845727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.845779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.845827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.845877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.845935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.845978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.846017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.846073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.846131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.846179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.846246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:11.846321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.846376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:11.846435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.846492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:11.846536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.846585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:11.846647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.846708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:11.846751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.846824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:11.846875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.846947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:11.846996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.847053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:11.847111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.847169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:11.847219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.847277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:11.847325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.847403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:11.847458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.847528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.847585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.847640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.847687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.847739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.848217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:11.853461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400868309388002:4933]
2025-10-15T10:57:11.863540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:11.874588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:11.874638Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:11.874657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:11.874673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:11.874704Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 379 [2:7561400871109091906:5084]
2025-10-15T10:57:11.874777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:11.874830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:11.874843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:11.874854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:11.874865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:11.874908Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:11.874928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:11.874946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:11.920085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.920109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.920119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.920129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:11.920383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:11.920403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:11.920508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:11.920664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:11.920855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:11.920945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400868309388002:4933], now have 1 active actors on pipe
2025-10-15T10:57:11.920975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400868309387994:5559], now have 1 active actors on pipe
2025-10-15T10:57:11.920993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400868309387794:2467], now have 1 active actors on pipe
2025-10-15T10:57:11.921023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400871109091901:5084]
2025-10-15T10:57:11.921036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400871109091901:5084]
2025-10-15T10:57:11.921047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400871109091901:5084]
2025-10-15T10:57:11.921086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:11.921141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:11.921150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:11.921163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:11.920836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 379, pipe: [1:7561400868309388002:4933]
2025-10-15T10:57:11.921174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:11.920976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 379
2025-10-15T10:57:11.921064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 379
2025-10-15T10:57:11.921268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:11.921283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:11.921396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:11.921414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:11.921454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400871109091901:5084]
2025-10-15T10:57:11.921472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:11.921503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:11.921566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:11.921591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:11.921603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:11.921610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:11.921633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:11.921659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:11.921721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:11.922182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:11.922207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:11.922257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:11.922716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 380 partition: 0 MaxSeqNo: 46 sessionId: src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0
2025-10-15T10:57:11.923642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd842cef-3f21d1a2-c653181c-5a285a71_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:11.955159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0] Write session: try to update token
2025-10-15T10:57:11.955225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:11.981237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:11.981282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:11.981299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:11.981314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:11.981355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400871109091901:5084]
2025-10-15T10:57:11.981388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400871109091901:5084]
2025-10-15T10:57:11.981419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400871109091901:5084]
2025-10-15T10:57:11.981505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:11.981532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:11.981553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:11.981617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:11.981649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:11.981663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:11.981782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:11.981821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:11.983071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:12.030980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId: src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:12.051546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:12.130274Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:12.145868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:12.145915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:12.145977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:12.145994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:12.146027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400871109091901:5084]
2025-10-15T10:57:12.146184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:12.146523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:12.146571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400868309388002:4933]
2025-10-15T10:57:12.146577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:12.146681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:12.156314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 380 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0
2025-10-15T10:57:12.156698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 380 sessionId: src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0 is DEAD
2025-10-15T10:57:12.157150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:12.157193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0] Write session will restart in 0.006542s
2025-10-15T10:57:12.157327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0] Write session: Do CDS request
2025-10-15T10:57:12.157361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:12.168656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:12.168452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:12.168524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 381
2025-10-15T10:57:12.169550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:12.169796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:12.169846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:12.169864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:12.172604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 381 sessionId:  describe result for acl check
2025-10-15T10:57:12.172839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:12.172869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:12.172897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:12.172939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400872604355330:5563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:12.176879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400872604355330:5563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:12.185639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400872604355330:5563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:12.194213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400872604355330:5563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:12.194267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400872604355330:5563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:12.194284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400872604355330:5563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:12.194316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:12.228553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:12.230571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:12.231403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:12.231430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:12.231470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:12.231700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:12.231883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400875404059425:5087]
2025-10-15T10:57:12.233818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:12.234583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:12.234759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:12.235934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:12.236317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:12.236336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:12.236343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:12.236351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:12.236358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:12.236366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:12.236373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:12.236382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:12.236389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:12.236397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:12.236404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:12.236412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.236419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.236427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.236475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:12.236608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:12.236659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:12.236706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:12.236760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:12.236816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:12.236880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:12.236924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:12.236970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:12.237023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:12.237065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:12.237110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.237170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.237231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.237269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:12.237338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:12.237390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:12.237448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:12.237484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:12.237519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:12.237573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:12.237625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:12.237674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:12.237716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:12.237754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:12.237795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:12.237829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:12.237870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:12.237907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:12.237949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:12.237993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:12.238059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:12.238113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:12.238176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:12.238231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:12.238314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:12.238364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.238457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.238510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.238578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.238652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.238722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.239154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:12.246653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400872604355521:4933]
2025-10-15T10:57:12.253834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:12.263210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:12.263251Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:12.263270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:12.263291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:12.263318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 380 [2:7561400875404059425:5087]
2025-10-15T10:57:12.263387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:12.263444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:12.263461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:12.263473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:12.263486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:12.263539Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:12.263568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:12.263609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:12.264687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.264712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.264728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.264741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:12.265029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:12.265055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.265206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.265330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 380
2025-10-15T10:57:12.265363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 380
2025-10-15T10:57:12.265430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 380, pipe: [1:7561400872604355521:4933]
2025-10-15T10:57:12.265438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.265704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:12.265799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400872604355315:2467], now have 1 active actors on pipe
2025-10-15T10:57:12.265835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400872604355413:5563], now have 1 active actors on pipe
2025-10-15T10:57:12.265862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400872604355521:4933], now have 1 active actors on pipe
2025-10-15T10:57:12.265937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:12.265965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:12.266004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400875404059420:5087]
2025-10-15T10:57:12.266024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400875404059420:5087]
2025-10-15T10:57:12.266038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400875404059420:5087]
2025-10-15T10:57:12.266092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:12.266160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:12.266183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:12.266192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:12.266204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:12.266388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:12.266414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:12.266485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:12.266524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:12.266548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:12.266562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:12.266605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:12.266649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:12.266798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400875404059420:5087]
2025-10-15T10:57:12.266834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:12.266879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:12.266882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:12.267324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:12.267376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:12.267445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:12.267716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 381 partition: 0 MaxSeqNo: 46 sessionId: src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0
2025-10-15T10:57:12.268522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13e3d24-2b01caf2-cffb76ed-d4b48813_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:12.289865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0] Write session: try to update token
2025-10-15T10:57:12.289909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:12.310197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:12.310222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:12.310252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400875404059420:5087]
2025-10-15T10:57:12.310346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:12.310380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:12.312307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:12.313735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:12.315139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:12.316345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:12.318064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:12.318522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:12.370525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:12.370565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:12.370581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:12.370593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:12.370632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400875404059420:5087]
2025-10-15T10:57:12.370660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400875404059420:5087]
2025-10-15T10:57:12.370683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400875404059420:5087]
2025-10-15T10:57:12.370795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:12.370838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:12.370850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:12.370852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:12.370863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:12.370881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:12.370902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:12.370922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:12.372062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:12.383484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId: src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:12.404687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:12.516245Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:12.518519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:12.518556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:12.519096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:12.519129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:12.519367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:12.539793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:12.540121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400872604355521:4933]
2025-10-15T10:57:12.545738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 381 reason: error at write: Disconnected sessionId: src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0
2025-10-15T10:57:12.546060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 381 sessionId: src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0 is DEAD
2025-10-15T10:57:12.549391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:12.549447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0] Write session will restart in 0.009894s
2025-10-15T10:57:12.549569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0] Write session: Do CDS request
2025-10-15T10:57:12.549607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:12.565995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:12.572877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:12.572920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 382
2025-10-15T10:57:12.575599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:12.575748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:12.575792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:12.575812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:12.578834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 382 sessionId:  describe result for acl check
2025-10-15T10:57:12.578952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:12.578962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:12.578970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:12.578986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400872604355627:5575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:12.581807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400872604355627:5575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:12.588063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400872604355627:5575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:12.598638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400872604355627:5575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:12.598687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400872604355627:5575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:12.598703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400872604355627:5575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:12.598735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:12.610973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:12.612916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:12.613817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:12.613849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:12.613893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:12.614162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:12.614390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400875404059651:5092]
2025-10-15T10:57:12.616729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:12.619210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:12.619462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:12.620805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:12.621149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:12.621166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:12.621174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:12.621181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:12.621188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:12.621195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:12.621202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:12.621209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:12.621216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:12.621223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:12.621230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:12.621236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.621242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.621249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.621296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:12.621405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:12.621465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:12.621518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:12.621573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:12.621627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:12.621677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:12.621729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:12.621780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:12.621831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:12.621882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:12.621937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.621990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.622043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.622092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:12.622162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:12.622226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:12.622286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:12.622350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:12.622414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:12.622468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:12.622539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:12.622599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:12.622661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:12.622710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:12.622771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:12.622823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:12.622891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:12.622944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:12.623004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:12.623054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:12.623114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:12.623161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:12.623220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:12.623273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:12.623336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:12.623412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.623475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.623530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.623584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.623634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.623693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.624228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:12.638829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400872604355762:4933]
E1015 10:57:12.649864064  821272 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:57:12.651173Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:57:12.655055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:12.665664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:12.665714Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:12.665730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:12.665751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:12.665774Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 381 [2:7561400875404059651:5092]
2025-10-15T10:57:12.665824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:12.665881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:12.665893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:12.665906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:12.665916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:12.665965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:12.665987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:12.666009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:12.668343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.668374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.668386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.668398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:12.668678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:12.668705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:12.668851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:12.669043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:12.669271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:12.669356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400872604355753:5575], now have 1 active actors on pipe
2025-10-15T10:57:12.669388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400872604355762:4933], now have 1 active actors on pipe
2025-10-15T10:57:12.669412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400872604355557:2467], now have 1 active actors on pipe
2025-10-15T10:57:12.669181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 381
2025-10-15T10:57:12.669446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400875404059646:5092]
2025-10-15T10:57:12.669274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 381, pipe: [1:7561400872604355762:4933]
2025-10-15T10:57:12.669475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400875404059646:5092]
2025-10-15T10:57:12.669358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 381
2025-10-15T10:57:12.669489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400875404059646:5092]
2025-10-15T10:57:12.669521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:12.669545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:12.669560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:12.669572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:12.669617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:12.669651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:12.669699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:12.669876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:12.669898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:12.670068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:12.670105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:12.670123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:12.670134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:12.670174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:12.670218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:12.670257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400875404059646:5092]
2025-10-15T10:57:12.670285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:12.670340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:12.670383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:12.670925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:12.670953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:12.671021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:12.671319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 382 partition: 0 MaxSeqNo: 46 sessionId: src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0
2025-10-15T10:57:12.672196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a11d958-14113202-6f6a17c5-d228a8b1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:12.697335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0] Write session: try to update token
2025-10-15T10:57:12.697391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:12.725337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:12.725372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:12.725407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400875404059646:5092]
2025-10-15T10:57:12.725532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:12.725536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:12.727433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:12.728766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:12.730739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:12.732184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:12.733848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:12.734464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:12.786745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId: src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:12.796069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:12.796107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:12.796117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:12.796188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:12.796202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:12.796216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:12.796228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:12.796267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400875404059646:5092]
2025-10-15T10:57:12.796293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400875404059646:5092]
2025-10-15T10:57:12.796316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400875404059646:5092]
2025-10-15T10:57:12.796446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:12.796482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:12.796488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:12.796504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:12.796516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:12.797545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:12.813590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:12.946075Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:12.948690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:12.948736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:12.949157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:12.949332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:12.949349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:12.949495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:12.954220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400872604355762:4933]
2025-10-15T10:57:12.958930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 382 reason: error at write: Disconnected sessionId: src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0
2025-10-15T10:57:12.959232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 382 sessionId: src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0 is DEAD
2025-10-15T10:57:12.959748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:12.959825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0] Write session will restart in 0.009562s
2025-10-15T10:57:12.960001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0] Write session: Do CDS request
2025-10-15T10:57:12.960061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:12.974895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:12.974842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:12.974873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 383
2025-10-15T10:57:12.975432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:12.975565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:12.975586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:12.975595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:12.980382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 383 sessionId:  describe result for acl check
2025-10-15T10:57:12.980553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:12.980569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:12.980575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:12.980607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400872604355805:5582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:12.983568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400872604355805:5582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:12.990860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400872604355805:5582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:13.002828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400872604355805:5582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:13.002874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400872604355805:5582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:13.002889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400872604355805:5582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:13.002916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:13.042024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:13.043945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:13.044816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:13.044848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:13.044891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:13.045170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:13.045397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400879699027182:5098]
2025-10-15T10:57:13.047729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:13.048535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:13.048759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:13.050004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:13.050363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.050379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.050387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.050395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.050402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.050410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.050417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.050424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.050433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.050441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.050448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.050455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.050463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.050470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.050519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.050640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.050705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.050759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.050821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.050883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.050934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.050984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.051037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.051088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.051141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.051201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.051251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.051303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.051373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.051450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.051520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.051587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.051524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400876899323293:4933]
2025-10-15T10:57:13.051639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.051700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.051750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.051809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.051860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.051918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.051969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.052037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.052095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.052153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.052218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.052287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.052341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.052408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.052463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.052518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.052571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.052643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.052698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.052765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.052818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.052877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.052921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.052977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.053517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:13.070492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:13.080326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:13.080375Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:13.080395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:13.080418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:13.080444Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 382 [2:7561400879699027182:5098]
2025-10-15T10:57:13.080502Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:13.080567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:13.080587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:13.080602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:13.080618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:13.080673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:13.080707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:13.080735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:13.081964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.081990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.082004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.082016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:13.082287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:13.082313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.082465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.082593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 382, pipe: [1:7561400876899323293:4933]
2025-10-15T10:57:13.082672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.082617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 382
2025-10-15T10:57:13.082723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 382
2025-10-15T10:57:13.082924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:13.083014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400876899323293:4933], now have 1 active actors on pipe
2025-10-15T10:57:13.083044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400876899323139:5582], now have 1 active actors on pipe
2025-10-15T10:57:13.083068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400872604355783:2467], now have 1 active actors on pipe
2025-10-15T10:57:13.083122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:13.083150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:13.083214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400879699027177:5098]
2025-10-15T10:57:13.083240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400879699027177:5098]
2025-10-15T10:57:13.083254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400879699027177:5098]
2025-10-15T10:57:13.083300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:13.083340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:13.083380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:13.083394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:13.083397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:13.083599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:13.083628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:13.083699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|424b7175-bba784d8-ee4355b3-a054ccea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:13.083733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:13.083756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:13.083766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:13.083802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:13.083846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:13.083975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400879699027177:5098]
2025-10-15T10:57:13.084008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:13.084056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:13.084056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:13.084506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:13.084538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:13.084618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:13.084929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 383 partition: 0 MaxSeqNo: 46 sessionId: src_id|424b7175-bba784d8-ee4355b3-a054ccea_0
2025-10-15T10:57:13.085635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a938a7c0-1e8632e6-3a576270-51b75ab7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|424b7175-bba784d8-ee4355b3-a054ccea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:13.107260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424b7175-bba784d8-ee4355b3-a054ccea_0] Write session: try to update token
2025-10-15T10:57:13.107315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424b7175-bba784d8-ee4355b3-a054ccea_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:13.155572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:13.155615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:13.155653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400879699027177:5098]
2025-10-15T10:57:13.155797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:13.155849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:13.157464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:13.158706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:13.159800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:13.160923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:13.163913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:13.175543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId: src_id|424b7175-bba784d8-ee4355b3-a054ccea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:13.198092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:13.198314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:13.198340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:13.198363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:13.198376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:13.198431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400879699027177:5098]
2025-10-15T10:57:13.198473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400879699027177:5098]
2025-10-15T10:57:13.198513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400879699027177:5098]
2025-10-15T10:57:13.198691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:13.198747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:13.198760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:13.198766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:13.198788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:13.198809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:13.198865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:13.198900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:13.200523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:13.214834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:13.355590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:13.357016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:13.357049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:13.357601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400876899323293:4933]
2025-10-15T10:57:13.357626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:13.357641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:13.357684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:13.357896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:13.369463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 383 reason: error at write: Disconnected sessionId: src_id|424b7175-bba784d8-ee4355b3-a054ccea_0
2025-10-15T10:57:13.369849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 383 sessionId: src_id|424b7175-bba784d8-ee4355b3-a054ccea_0 is DEAD
2025-10-15T10:57:13.370264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424b7175-bba784d8-ee4355b3-a054ccea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:13.370325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424b7175-bba784d8-ee4355b3-a054ccea_0] Write session will restart in 0.005521s
2025-10-15T10:57:13.370486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424b7175-bba784d8-ee4355b3-a054ccea_0] Write session: Do CDS request
2025-10-15T10:57:13.370558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424b7175-bba784d8-ee4355b3-a054ccea_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:13.388609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424b7175-bba784d8-ee4355b3-a054ccea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:13.388842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:13.388885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 384
2025-10-15T10:57:13.389490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:13.389735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:13.389770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:13.389785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:13.391832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 384 sessionId:  describe result for acl check
2025-10-15T10:57:13.392046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:13.392084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:13.392106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:13.392134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400876899323321:5587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:13.395295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400876899323321:5587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:13.415499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400876899323321:5587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:13.429805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400876899323321:5587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:13.429887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400876899323321:5587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:13.429918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400876899323321:5587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:13.429973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:13.448909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:13.450899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:13.451796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:13.451829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:13.451879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:13.452157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:13.452394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400879699027409:5108]
2025-10-15T10:57:13.454772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:13.455759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:13.456004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:13.457448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:13.457818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.457837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.457846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.457853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.457861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.457869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.457876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.457884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.457893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.457901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.457908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.457916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.457924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.458025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400876899323525:4933]
2025-10-15T10:57:13.457931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.457984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.458104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.458157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.458219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.458276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.458331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.458385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.458438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.458490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.458546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.458599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.458654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.458707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.458760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.458813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.458892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.458978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.459051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.459120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.459193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.459249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.459310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.459390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.459454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.459511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.459574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.459634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.459697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.459752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.459815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.459888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.459961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.460014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.460072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.460127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.460202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.460256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.460321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.460380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.460450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.460518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.460587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.461161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:13.477581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:13.488196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:13.488245Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:13.488265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:13.488290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:13.488317Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 383 [2:7561400879699027409:5108]
2025-10-15T10:57:13.488376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:13.488441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:13.488461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:13.488476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:13.488490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:13.488546Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:13.488576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:13.488601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:13.489614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.489644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.489662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.489675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:13.489970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:13.490009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.490169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.490193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 383, pipe: [1:7561400876899323525:4933]
2025-10-15T10:57:13.490220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 383
2025-10-15T10:57:13.490308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 383
2025-10-15T10:57:13.490405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.490665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:13.490764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400876899323497:5587], now have 1 active actors on pipe
2025-10-15T10:57:13.490795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400876899323525:4933], now have 1 active actors on pipe
2025-10-15T10:57:13.490823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400876899323306:2467], now have 1 active actors on pipe
2025-10-15T10:57:13.490892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:13.490922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:13.490961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400879699027404:5108]
2025-10-15T10:57:13.490977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400879699027404:5108]
2025-10-15T10:57:13.490992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400879699027404:5108]
2025-10-15T10:57:13.491030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:13.491067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:13.491084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:13.491097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:13.491113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:13.491315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:13.491342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:13.491434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:13.491473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:13.491497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:13.491511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:13.491549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:13.491593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:13.491732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400879699027404:5108]
2025-10-15T10:57:13.491767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:13.491809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:13.491815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:13.492289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:13.492320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:13.492384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:13.492728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 384 partition: 0 MaxSeqNo: 46 sessionId: src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0
2025-10-15T10:57:13.493562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424b7175-bba784d8-ee4355b3-a054ccea_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:13.519999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0] Write session: try to update token
2025-10-15T10:57:13.520070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:13.533467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:13.533507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:13.533550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400879699027404:5108]
2025-10-15T10:57:13.533681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:13.533687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:13.538044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:13.539443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:13.540753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:13.542288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:13.544052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:13.544524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:13.612397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:13.612441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:13.612455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:13.612532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:13.612549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:13.612565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:13.612576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:13.612621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400879699027404:5108]
2025-10-15T10:57:13.612658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400879699027404:5108]
2025-10-15T10:57:13.612689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400879699027404:5108]
2025-10-15T10:57:13.612827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:13.612829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:13.612858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:13.612884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:13.612924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:13.613836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:13.618309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId: src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:13.637035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:13.757603Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:13.758994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:13.759037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:13.759595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:13.759614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:13.759638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:13.759835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400876899323525:4933]
2025-10-15T10:57:13.759901Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:13.767925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 384 reason: error at write: Disconnected sessionId: src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0
2025-10-15T10:57:13.768745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:13.768800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0] Write session will restart in 0.005032s
2025-10-15T10:57:13.768903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0] Write session: Do CDS request
2025-10-15T10:57:13.768937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:13.771501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 384 sessionId: src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0 is DEAD
2025-10-15T10:57:13.778561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:13.778400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:13.778441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 385
2025-10-15T10:57:13.779080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:13.779222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:13.779239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:13.779249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:13.781405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 385 sessionId:  describe result for acl check
2025-10-15T10:57:13.781594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:13.781634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:13.781657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:13.781688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400876899323552:5592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:13.785400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400876899323552:5592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:13.793368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400876899323552:5592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:13.802639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400876899323552:5592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:13.802692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400876899323552:5592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:13.802710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400876899323552:5592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:13.802743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:13.836527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:13.838391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:13.839188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:13.839214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:13.839254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:13.839502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:13.839690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400879699027624:5111]
2025-10-15T10:57:13.841808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:13.842680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:13.842876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:13.844047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:13.844345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.844353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.844359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.844366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.844372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.844378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.844384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.844391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.844397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.844403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.844409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.844415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.844422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.844428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.844470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.844567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.844613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.844656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.844697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.844743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.844785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.844827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.844873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.844917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.844963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.845004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.845048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.845091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.845129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.845188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:13.845240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.845290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:13.845335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.845385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:13.845427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.845477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:13.845520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.845566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:13.845606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.845657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:13.845700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.845749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:13.845793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.845860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:13.845911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.845963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:13.846004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.846064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:13.846109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.846171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:13.846216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.846272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.846317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.846364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.846404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.846454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.846921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:13.859930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400876899323759:4933]
2025-10-15T10:57:13.863144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:13.881996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:13.882032Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:13.882042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:13.882054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:13.882073Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 384 [2:7561400879699027624:5111]
2025-10-15T10:57:13.882119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:13.882161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:13.882170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:13.882178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:13.882185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:13.882215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:13.882230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:13.882245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:13.883090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.883106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.883114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.883121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:13.883320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:13.883344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:13.883512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:13.883687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 384
2025-10-15T10:57:13.883699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 384, pipe: [1:7561400876899323759:4933]
2025-10-15T10:57:13.883786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 384
2025-10-15T10:57:13.883680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:13.883912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:13.883962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400876899323759:4933], now have 1 active actors on pipe
2025-10-15T10:57:13.883976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400876899323603:5592], now have 1 active actors on pipe
2025-10-15T10:57:13.883988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400876899323538:2467], now have 1 active actors on pipe
2025-10-15T10:57:13.884015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:13.884028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:13.884070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400879699027619:5111]
2025-10-15T10:57:13.884081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400879699027619:5111]
2025-10-15T10:57:13.884092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400879699027619:5111]
2025-10-15T10:57:13.884127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:13.884163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:13.884184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:13.884195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:13.884201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:13.884344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:13.884358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:13.884399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:13.884419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:13.884436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:13.884445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:13.884472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:13.884498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:13.884578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400879699027619:5111]
2025-10-15T10:57:13.884599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:13.884626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:13.884637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:13.885039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:13.885059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:13.885100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:13.885474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 385 partition: 0 MaxSeqNo: 46 sessionId: src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0
2025-10-15T10:57:13.886264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45fb7dd4-bd90b0af-8ade687a-de436cfe_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:13.908262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0] Write session: try to update token
2025-10-15T10:57:13.908329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:13.914852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:13.914885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:13.914924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400879699027619:5111]
2025-10-15T10:57:13.915034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:13.915034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:13.917433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:13.918941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:13.920320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:13.921773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:13.924042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:13.924561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:13.980428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:13.980508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:13.980539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:13.980562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:13.980635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400879699027619:5111]
2025-10-15T10:57:13.980676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400879699027619:5111]
2025-10-15T10:57:13.980703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400879699027619:5111]
2025-10-15T10:57:13.980948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:13.981004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:13.983506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:13.983574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:13.983624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:13.986933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:13.995529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId: src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:14.016403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:14.132460Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:14.138026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:14.138064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:14.138568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400876899323759:4933]
2025-10-15T10:57:14.138674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:14.138693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:14.142219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:14.150321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 385 reason: error at write: Disconnected sessionId: src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0
2025-10-15T10:57:14.150631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 385 sessionId: src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0 is DEAD
2025-10-15T10:57:14.150964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:14.151016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0] Write session will restart in 0.008937s
2025-10-15T10:57:14.151150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0] Write session: Do CDS request
2025-10-15T10:57:14.151190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:14.161772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:14.164311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:14.164341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 386
2025-10-15T10:57:14.164638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:14.165125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:14.165289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:14.165317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:14.165329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:14.166454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 386 sessionId:  describe result for acl check
2025-10-15T10:57:14.166555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:14.166567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:14.166573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:14.166585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400881194291097:5607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:14.168597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400881194291097:5607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:14.174149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400881194291097:5607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:14.182660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400881194291097:5607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:14.182708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400881194291097:5607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:14.182724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400881194291097:5607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:14.182754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:14.238840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400881194291291:4933]
2025-10-15T10:57:14.239508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:14.241308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:14.242119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:14.242149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:14.242195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:14.242484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:14.242686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400883993995163:5120]
2025-10-15T10:57:14.245005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:14.245950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:14.246162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:14.247464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:14.247815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:14.247834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:14.247841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:14.247848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:14.247855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:14.247861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:14.247867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:14.247875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:14.247881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:14.247887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:14.247900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:14.247908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.247916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.247922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.247969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:14.248072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:14.248128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:14.248175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:14.248254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:14.248310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:14.248357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:14.248416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:14.248468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:14.248514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:14.248571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:14.248627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.248672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.248713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.248753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:14.248823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:14.248885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:14.248941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:14.248990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:14.249049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:14.249097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:14.249167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:14.249223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:14.249279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:14.249328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:14.249383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:14.249434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:14.249498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:14.249552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:14.249643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:14.249697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:14.249763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:14.249815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:14.249871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:14.249920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:14.249974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:14.250021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.250078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.250125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.250180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.250238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.250298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.250770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:14.266588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:14.277206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:14.277257Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:14.277273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:14.277290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:14.277315Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 385 [2:7561400883993995163:5120]
2025-10-15T10:57:14.277365Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:14.277420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:14.277434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:14.277445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:14.277456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:14.277507Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:14.277530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:14.277554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:14.279578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.279612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.279625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.279636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:14.279906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:14.279930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.280068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.280096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 385
2025-10-15T10:57:14.280204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 385, pipe: [1:7561400881194291291:4933]
2025-10-15T10:57:14.280275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.280287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 385
2025-10-15T10:57:14.280519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:14.280612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400881194291127:5607], now have 1 active actors on pipe
2025-10-15T10:57:14.280641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400881194291291:4933], now have 1 active actors on pipe
2025-10-15T10:57:14.280660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400881194291092:2467], now have 1 active actors on pipe
2025-10-15T10:57:14.280706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:14.280731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:14.280790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400883993995156:5120]
2025-10-15T10:57:14.280814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400883993995156:5120]
2025-10-15T10:57:14.280827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400883993995156:5120]
2025-10-15T10:57:14.280865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:14.280904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:14.280925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:14.280936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:14.280946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:14.281121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:14.281144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:14.281217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:14.281265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:14.281284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:14.281294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:14.281333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:14.281381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:14.281517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400883993995156:5120]
2025-10-15T10:57:14.281547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:14.281590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:14.281593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:14.282231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:14.282272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:14.282336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:14.282614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 386 partition: 0 MaxSeqNo: 46 sessionId: src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0
2025-10-15T10:57:14.283578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c630cf-d52ad23b-c2910253-bb4ba11f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:14.312157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0] Write session: try to update token
2025-10-15T10:57:14.312234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:14.346960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:14.346993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:14.347025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400883993995156:5120]
2025-10-15T10:57:14.347164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:14.347188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:14.349242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:14.351729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:14.354078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:14.358738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:14.369234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:14.370316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:14.408030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:14.408067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:14.408079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:14.408135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:14.408157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:14.408170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:14.408195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:14.408235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400883993995156:5120]
2025-10-15T10:57:14.408261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400883993995156:5120]
2025-10-15T10:57:14.408287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400883993995156:5120]
2025-10-15T10:57:14.408433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:14.408463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:14.409513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:14.409557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:14.409586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:14.409610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:14.418711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId: src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:14.443841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:14.553351Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:14.554567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:14.554600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:14.555147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:14.555158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:14.555172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:14.555384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400881194291291:4933]
2025-10-15T10:57:14.555467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:14.563344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 386 reason: error at write: Disconnected sessionId: src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0
2025-10-15T10:57:14.563734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 386 sessionId: src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0 is DEAD
2025-10-15T10:57:14.564216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:14.564280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0] Write session will restart in 0.007011s
2025-10-15T10:57:14.564427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0] Write session: Do CDS request
2025-10-15T10:57:14.564489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:14.578089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:14.578125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 387
2025-10-15T10:57:14.578388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:14.579053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:14.579203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:14.579232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:14.579243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:14.581410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 387 sessionId:  describe result for acl check
2025-10-15T10:57:14.581546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:14.581567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:14.581577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:14.581595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400881194291349:5616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:14.584232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400881194291349:5616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:14.591016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400881194291349:5616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:14.598388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400881194291349:5616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:14.598422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400881194291349:5616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:14.598432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400881194291349:5616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:14.598451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:14.655982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:14.658009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:14.658888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:14.658919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:14.658958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:14.659235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:14.656251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400881194291548:4933]
2025-10-15T10:57:14.659466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400883993995405:5130]
2025-10-15T10:57:14.661896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:14.662961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:14.663175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:14.664538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:14.664891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:14.664906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:14.664912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:14.664920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:14.664927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:14.664935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:14.664942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:14.664949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:14.664957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:14.664963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:14.664970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:14.664976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.664984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.664992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.665041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:14.665177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:14.665238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:14.665308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:14.665356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:14.665422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:14.665479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:14.665544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:14.665601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:14.665665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:14.665723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:14.665781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.665836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.665891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.665944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:14.666022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:14.666090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:14.666154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:14.666209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:14.666268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:14.666321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:14.666383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:14.666440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:14.666500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:14.666553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:14.666616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:14.666669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:14.666744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:14.666804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:14.666872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:14.666932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:14.666992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:14.667054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:14.667121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:14.667177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:14.667235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:14.667290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.667365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.667420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.667486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.667553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.667630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.668184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:14.687183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:14.695937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:14.695988Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:14.696011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:14.696032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:14.696057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 386 [2:7561400883993995405:5130]
2025-10-15T10:57:14.696108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:14.696165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:14.696184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:14.696209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:14.696222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:14.696262Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:14.696286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:14.696305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:14.697110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.697127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.697136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.697144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:14.697331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:14.697349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:14.697455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:14.697598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:14.697769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:14.697845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400883993995399:5130]
2025-10-15T10:57:14.697871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400883993995399:5130]
2025-10-15T10:57:14.697882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400883993995399:5130]
2025-10-15T10:57:14.697911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:14.697965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:14.698128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:14.698144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:14.698242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400883993995399:5130]
2025-10-15T10:57:14.698258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:14.698487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:14.698503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:14.698510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:14.698526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:14.698972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400881194291331:2467], now have 1 active actors on pipe
2025-10-15T10:57:14.699010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400881194291384:5616], now have 1 active actors on pipe
2025-10-15T10:57:14.699039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400881194291548:4933], now have 1 active actors on pipe
2025-10-15T10:57:14.699276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 386, pipe: [1:7561400881194291548:4933]
2025-10-15T10:57:14.699433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 386
2025-10-15T10:57:14.699527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 386
2025-10-15T10:57:14.699825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:14.699860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:14.699949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:14.699988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:14.700011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:14.700022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:14.700059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:14.700102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:14.700156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:14.700663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:14.700690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:14.700758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:14.701218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 387 partition: 0 MaxSeqNo: 46 sessionId: src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0
2025-10-15T10:57:14.701971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ec7134f-678ce98c-91af1aa1-3b804140_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:14.723043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0] Write session: try to update token
2025-10-15T10:57:14.723095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:14.788163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:14.788206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:14.788242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400883993995399:5130]
2025-10-15T10:57:14.788351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:14.788420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:14.797265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:14.798624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:14.805062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:14.807938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:14.816139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId: src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:14.820915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:14.822612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:14.822633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:14.822645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:14.822718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:14.845022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:14.876250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:14.876303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:14.876352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:14.876367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:14.876380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:14.876390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:14.876427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400883993995399:5130]
2025-10-15T10:57:14.876451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400883993995399:5130]
2025-10-15T10:57:14.876474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400883993995399:5130]
2025-10-15T10:57:14.876650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:14.876682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:14.877742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:14.879472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:14.879508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:14.879537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:15.018674Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:15.019877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:57:15.020358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:15.020460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:15.020701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400881194291548:4933]
2025-10-15T10:57:15.071588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:15.071634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:15.071754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 387 reason: error at write: Disconnected sessionId: src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0
2025-10-15T10:57:15.071969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 387 sessionId: src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0 is DEAD
2025-10-15T10:57:15.072394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:15.072451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0] Write session will restart in 0.007846s
2025-10-15T10:57:15.072585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0] Write session: Do CDS request
2025-10-15T10:57:15.072648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:15.084886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:15.084811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:15.084871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 388
2025-10-15T10:57:15.085397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:15.085562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:15.085588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:15.085597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:15.086894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 388 sessionId:  describe result for acl check
2025-10-15T10:57:15.087014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:15.087035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:15.087044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:15.087059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400885489259043:5620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:15.090517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400885489259043:5620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:15.093490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:15.096052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400885489259043:5620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:15.099564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:15.100493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:15.100525Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:15.100570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:15.100849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:15.101054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400888288962916:5132]
2025-10-15T10:57:15.102595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400885489259043:5620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:15.102639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400885489259043:5620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:15.102669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400885489259043:5620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:15.102697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:15.103525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:15.104417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:15.104632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:15.105953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:15.106310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.106335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.106344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.106352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.106360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.106367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.106375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.106382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.106389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.106395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.106404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.106412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.106420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.106427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.106479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.106599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.106649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.106696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.106749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.106806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.106859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.106913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.106967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.107034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.107088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.107140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.107188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.107238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.107289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.107380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.107461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.107528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.107580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.107643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.107696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.107754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.107809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.107869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.107921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.107989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.108048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.108114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.108179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.108253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.108311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.108381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.108438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.108502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.108555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.108618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.108671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.108732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.108786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.108847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.108897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.108957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.109504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:15.121006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400885489259080:4933]
2025-10-15T10:57:15.125486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:15.134844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:15.134895Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:15.134916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:15.134940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:15.134968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 387 [2:7561400888288962916:5132]
2025-10-15T10:57:15.135025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:15.135092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:15.135108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:15.135121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:15.135133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:15.135185Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:15.135218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:15.135247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:15.137925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.137962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.137978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.137991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:15.138294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:15.138323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.138479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.138691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.138555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 387, pipe: [1:7561400885489259080:4933]
2025-10-15T10:57:15.138613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 387
2025-10-15T10:57:15.138692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 387
2025-10-15T10:57:15.138940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:15.139029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400885489259075:5620], now have 1 active actors on pipe
2025-10-15T10:57:15.139060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400885489259080:4933], now have 1 active actors on pipe
2025-10-15T10:57:15.139086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400885489258866:2467], now have 1 active actors on pipe
2025-10-15T10:57:15.139118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400888288962911:5132]
2025-10-15T10:57:15.139138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400888288962911:5132]
2025-10-15T10:57:15.139151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400888288962911:5132]
2025-10-15T10:57:15.139189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:15.139282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:15.139309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:15.139325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:15.139337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:15.139507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:15.139532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:15.139689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:15.139717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:15.139766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400888288962911:5132]
2025-10-15T10:57:15.139798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:15.139825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:15.139921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:15.139960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:15.139983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:15.139995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:15.140031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:15.140073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:15.140173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:15.141031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:15.141058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:15.141135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:15.141437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 388 partition: 0 MaxSeqNo: 46 sessionId: src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0
2025-10-15T10:57:15.142252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4beb40c7-857f9f6f-d2ec76b5-f97e5fb1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:15.162321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0] Write session: try to update token
2025-10-15T10:57:15.162379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:15.220376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:15.220406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:15.220418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:15.220428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:15.220452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400888288962911:5132]
2025-10-15T10:57:15.220470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400888288962911:5132]
2025-10-15T10:57:15.220484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400888288962911:5132]
2025-10-15T10:57:15.220636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:15.220634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:15.220651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:15.220674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:15.220734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:15.221764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:15.240529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId: src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:15.261516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:15.363790Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:15.380140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:15.380192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:15.380270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:15.380285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:15.380328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400888288962911:5132]
2025-10-15T10:57:15.380621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:15.380917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:15.381193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:15.381210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400885489259080:4933]
2025-10-15T10:57:15.381228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:15.381297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:15.390836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 388 reason: error at write: Disconnected sessionId: src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0
2025-10-15T10:57:15.391148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 388 sessionId: src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0 is DEAD
2025-10-15T10:57:15.391543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:15.391583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0] Write session will restart in 0.008473s
2025-10-15T10:57:15.391684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0] Write session: Do CDS request
2025-10-15T10:57:15.391710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:15.412416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:15.412861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:15.412897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 389
2025-10-15T10:57:15.413185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:15.413302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:15.413332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:15.413344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:15.415407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 389 sessionId:  describe result for acl check
2025-10-15T10:57:15.415573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:15.415607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:15.415630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:15.415658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400885489259105:5625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:15.417827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400885489259105:5625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:15.422969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400885489259105:5625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:15.431004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400885489259105:5625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:15.431056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400885489259105:5625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:15.431072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400885489259105:5625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:15.431101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:15.468182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:15.477370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:15.478182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:15.478211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:15.478249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:15.478498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:15.478684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400888288963145:5135]
2025-10-15T10:57:15.480816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:15.481792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:15.481749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400885489259302:4933]
2025-10-15T10:57:15.481994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:15.483150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:15.483476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.483492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.483500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.483508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.483515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.483522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.483528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.483539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.483545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.483552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.483558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.483565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.483571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.483578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.483623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.483737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.483783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.483828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.483871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.483921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.483963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.484011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.484057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.484108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.484155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.484207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.484255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.484304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.484349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.484412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.484472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.484528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.484579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.484647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.484699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.484759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.484810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.484867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.484914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.484969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.485018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.485076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.485134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.485191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.485242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.485299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.485344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.485402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.485448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.485499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.485541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.485594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.485640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.485690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.485732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.485779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.486260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:15.510525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:15.521135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:15.521179Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:15.521196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:15.521214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:15.521238Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 388 [2:7561400888288963145:5135]
2025-10-15T10:57:15.521287Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:15.521343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:15.521356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:15.521368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:15.521377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:15.521421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:15.521443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:15.521470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:15.523103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.523127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.523141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.523151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:15.523374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:15.523396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.523531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.523732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.523803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 388, pipe: [1:7561400885489259302:4933]
2025-10-15T10:57:15.523984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:15.523948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 388
2025-10-15T10:57:15.524032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 388
2025-10-15T10:57:15.524071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400885489259302:4933], now have 1 active actors on pipe
2025-10-15T10:57:15.524104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400885489259172:5625], now have 1 active actors on pipe
2025-10-15T10:57:15.524126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400885489259090:2467], now have 1 active actors on pipe
2025-10-15T10:57:15.524148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400888288963140:5135]
2025-10-15T10:57:15.524161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400888288963140:5135]
2025-10-15T10:57:15.524173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400888288963140:5135]
2025-10-15T10:57:15.524218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:15.524262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:15.524269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:15.524289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:15.524310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:15.524425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:15.524449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:15.524570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:15.524589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:15.524610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400888288963140:5135]
2025-10-15T10:57:15.524640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:15.524692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:15.524735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:15.524762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:15.524778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:15.524787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:15.524820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:15.524854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:15.524931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:15.525917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:15.525959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:15.526043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:15.526526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 389 partition: 0 MaxSeqNo: 46 sessionId: src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0
2025-10-15T10:57:15.527156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee1f1fe5-e932c36-26c7b9fa-d81a2007_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:15.552397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0] Write session: try to update token
2025-10-15T10:57:15.552438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:15.644552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:15.644578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:15.644587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:15.644594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:15.644615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400888288963140:5135]
2025-10-15T10:57:15.644631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400888288963140:5135]
2025-10-15T10:57:15.644644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400888288963140:5135]
2025-10-15T10:57:15.644745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:15.644752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:15.644759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:15.644823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:15.644836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:15.645170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:15.645210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:15.645235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:15.646473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:15.670849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId: src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:15.697463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:15.786456Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:15.801713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:15.801760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:15.801863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:15.801877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:15.801925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400888288963140:5135]
2025-10-15T10:57:15.802586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:15.802698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:15.802802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:15.802925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:15.813927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 389 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0
2025-10-15T10:57:15.814244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 389 sessionId: src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0 is DEAD
2025-10-15T10:57:15.814547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:15.814580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0] Write session will restart in 0.005094s
2025-10-15T10:57:15.814697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0] Write session: Do CDS request
2025-10-15T10:57:15.814733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:15.832986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:15.834364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400885489259302:4933]
2025-10-15T10:57:15.834766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:15.834787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 390
2025-10-15T10:57:15.835184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:15.835295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:15.835317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:15.835326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:15.836600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 390 sessionId:  describe result for acl check
2025-10-15T10:57:15.836697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:15.836712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:15.836720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:15.836735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400885489259353:5636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:15.838998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400885489259353:5636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:15.847235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400885489259353:5636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:15.854259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400885489259353:5636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:15.854294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400885489259353:5636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:15.854304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400885489259353:5636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:15.854323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:15.907852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:15.911720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:15.912369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:15.912388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:15.912417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:15.912633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:15.912824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400888288963379:5144]
2025-10-15T10:57:15.914764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:15.915860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:15.916056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:15.916998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:15.917306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.917323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.917330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.917336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.917343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.917349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.917355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.917362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.917368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.917374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.917382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.917388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.917394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.917401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.917444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.917541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.917585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.917629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.917678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.917729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.917773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.917814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.917864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.917914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.917951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.917983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.918022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.918065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.918107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.918154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:15.918203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.918253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:15.918290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.918324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:15.918353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.918392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:15.918427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.918478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:15.918525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.918586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:15.918633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.918673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:15.918705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.918751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:15.918801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.918854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:15.918898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.918948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:15.918995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.919049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:15.919098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.919155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.919203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.919257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.919308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.919374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.919850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:15.934822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400885489259557:4933]
2025-10-15T10:57:15.936845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:15.946920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:15.946967Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:15.946985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:15.947015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:15.947032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 389 [2:7561400888288963379:5144]
2025-10-15T10:57:15.947066Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:15.947111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:15.947122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:15.947131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:15.947141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:15.947183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:15.947198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:15.947213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:15.949329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.949353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.949361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.949367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:15.949641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:15.949666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:15.949763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:15.949918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:15.950142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:15.950018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 389
2025-10-15T10:57:15.950239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400885489259384:5636], now have 1 active actors on pipe
2025-10-15T10:57:15.950259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400885489259339:2467], now have 1 active actors on pipe
2025-10-15T10:57:15.950116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 389
2025-10-15T10:57:15.950277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400885489259557:4933], now have 1 active actors on pipe
2025-10-15T10:57:15.950178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 389, pipe: [1:7561400885489259557:4933]
2025-10-15T10:57:15.950301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400888288963374:5144]
2025-10-15T10:57:15.950314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400888288963374:5144]
2025-10-15T10:57:15.950324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400888288963374:5144]
2025-10-15T10:57:15.950359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:15.950426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:15.950637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:15.950654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:15.950794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400888288963374:5144]
2025-10-15T10:57:15.950815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:15.951583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:15.951594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:15.951605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:15.951627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:15.952035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:15.952069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:15.952147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:15.952174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:15.952189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:15.952197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:15.952243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:15.952277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:15.952320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:15.955134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:15.955181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:15.955258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:15.955947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 390 partition: 0 MaxSeqNo: 46 sessionId: src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0
2025-10-15T10:57:15.956636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43cc792a-cf171a8d-97a7fd3c-80f2f8ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:15.986830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0] Write session: try to update token
2025-10-15T10:57:15.986882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:16.006640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:16.006673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:16.006706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400888288963374:5144]
2025-10-15T10:57:16.006815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:16.006819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:16.009743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:16.011565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:16.013073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:16.014238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:16.016159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:16.016664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:16.069688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:16.069728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:16.069741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:16.069809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:16.069858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:16.069884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:16.069904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:16.069985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400888288963374:5144]
2025-10-15T10:57:16.070020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400888288963374:5144]
2025-10-15T10:57:16.070047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400888288963374:5144]
2025-10-15T10:57:16.070179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:16.070212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:16.070266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:16.070329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:16.070386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:16.071326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:16.081924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId: src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:16.115260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:16.207637Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:16.217903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:16.217938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:16.218443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:16.218467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:16.218484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:16.218510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:16.218699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400885489259557:4933]
2025-10-15T10:57:16.228251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 390 reason: error at write: Disconnected sessionId: src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0
2025-10-15T10:57:16.228647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 390 sessionId: src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0 is DEAD
2025-10-15T10:57:16.229082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:16.229141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0] Write session will restart in 0.005863s
2025-10-15T10:57:16.229316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0] Write session: Do CDS request
2025-10-15T10:57:16.229376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:16.239672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:16.239710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 391
2025-10-15T10:57:16.239800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:16.240419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:16.240589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:16.240613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:16.240624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:16.241966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 391 sessionId:  describe result for acl check
2025-10-15T10:57:16.242086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:16.242104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:16.242114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:16.242132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400889784226892:5643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:16.244912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400889784226892:5643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:16.252222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400889784226892:5643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:16.262347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400889784226892:5643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:16.262407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400889784226892:5643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:16.262425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400889784226892:5643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:16.262456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:16.293525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:16.298333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:16.299124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:16.299153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:16.299191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:16.299448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:16.299645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400892583930931:5154]
2025-10-15T10:57:16.301647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:16.302491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:16.302618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:16.303421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:16.303647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:16.303659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:16.303664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:16.303668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:16.303672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:16.303677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:16.303681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:16.303685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:16.303689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:16.303693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:16.303696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:16.303700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.303704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.303708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.303737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:16.303807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:16.303838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:16.303870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:16.303910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:16.303943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:16.303973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:16.304005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:16.304045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:16.304099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:16.304135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:16.304169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.304204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.304252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.304296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:16.304355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:16.304400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:16.304442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:16.304475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:16.304513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:16.304561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:16.304614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:16.304661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:16.304716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:16.304768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:16.304819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:16.304881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:16.304934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:16.304980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:16.305025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:16.305060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:16.305099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:16.305129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:16.305161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:16.305191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:16.305224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:16.305252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.305285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.305318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.305366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.305401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.305438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.305771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:16.319130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400889784227096:4933]
2025-10-15T10:57:16.333841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:16.341772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:16.341812Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:16.341828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:16.341846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:16.341869Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 390 [2:7561400892583930931:5154]
2025-10-15T10:57:16.341919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:16.341970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:16.341984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:16.341996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:16.342007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:16.342050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:16.342068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:16.342082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:16.343090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.343108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.343116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.343122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:16.343323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:16.343340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.343470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.343616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.343791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:16.343754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 390, pipe: [1:7561400889784227096:4933]
2025-10-15T10:57:16.343781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 390
2025-10-15T10:57:16.343863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400889784227096:4933], now have 1 active actors on pipe
2025-10-15T10:57:16.343884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 390
2025-10-15T10:57:16.343886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400889784226878:2467], now have 1 active actors on pipe
2025-10-15T10:57:16.343909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400889784226932:5643], now have 1 active actors on pipe
2025-10-15T10:57:16.343927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400892583930926:5154]
2025-10-15T10:57:16.343941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400892583930926:5154]
2025-10-15T10:57:16.343955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400892583930926:5154]
2025-10-15T10:57:16.343987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:16.344031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:16.344061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:16.344063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:16.344084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:16.344189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:16.344209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:16.344284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:16.344304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:16.344424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400892583930926:5154]
2025-10-15T10:57:16.344456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:16.344508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:16.344523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:16.344549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:16.344564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:16.344574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:16.344596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:16.344619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:16.344702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:16.345152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:16.345179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:16.345239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:16.345706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 391 partition: 0 MaxSeqNo: 46 sessionId: src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0
2025-10-15T10:57:16.346517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd46900-3ac7ef00-ccd8bd33-74874492_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:16.367760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0] Write session: try to update token
2025-10-15T10:57:16.367824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:16.430874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId: src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:16.461752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:16.461789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:16.461803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:16.461814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:16.461840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400892583930926:5154]
2025-10-15T10:57:16.461856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400892583930926:5154]
2025-10-15T10:57:16.461871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400892583930926:5154]
2025-10-15T10:57:16.462013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:16.462028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:16.462036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:16.462045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:16.462069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:16.462086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:16.462102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:16.462105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:16.462007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:16.463084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:16.597384Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:16.619064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:16.619109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:16.619181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:16.619194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:16.619231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400892583930926:5154]
2025-10-15T10:57:16.619473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:16.619794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:16.619809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400889784227096:4933]
2025-10-15T10:57:16.619902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:16.619874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:16.619913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:16.627776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 391 reason: error at write: Disconnected sessionId: src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0
2025-10-15T10:57:16.628087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 391 sessionId: src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0 is DEAD
2025-10-15T10:57:16.628646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:16.628727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0] Write session will restart in 0.008302s
2025-10-15T10:57:16.628924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0] Write session: Do CDS request
2025-10-15T10:57:16.628987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:16.641619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:16.641664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 392
2025-10-15T10:57:16.641783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:16.642349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:16.642512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:16.642539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:16.642555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:16.644058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 392 sessionId:  describe result for acl check
2025-10-15T10:57:16.644279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:16.644325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:16.644347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:16.644383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400889784227132:5649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:16.648564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400889784227132:5649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:16.654383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400889784227132:5649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:16.662290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400889784227132:5649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:16.662350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400889784227132:5649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:16.662368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400889784227132:5649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:16.662403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:16.691686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:16.693135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:16.693844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:16.693877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:16.693914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:16.694135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:16.694319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400892583931153:5157]
2025-10-15T10:57:16.696498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:16.697367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:16.697555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:16.698732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:16.699032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:16.699047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:16.699054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:16.699061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:16.699068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:16.699076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:16.699082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:16.699089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:16.699095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:16.699101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:16.699109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:16.699116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.699122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.699130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.699173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:16.699278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:16.699325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:16.699390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:16.699436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:16.699491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:16.699537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:16.699591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:16.699638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:16.699693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:16.699745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:16.699788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.699833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.699878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.699916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:16.699980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:16.700035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:16.700096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:16.700152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:16.700214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:16.700267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:16.700331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:16.700386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:16.700444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:16.700498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:16.700562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:16.700618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:16.700678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:16.700727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:16.700785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:16.700839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:16.700898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:16.700947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:16.701008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:16.701059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:16.701116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:16.701169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.701227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.701282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.701333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.701380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.701437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.701917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:16.720024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400889784227336:4933]
2025-10-15T10:57:16.726353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:16.735396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:16.735437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:16.735452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:16.735470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:16.735492Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 391 [2:7561400892583931153:5157]
2025-10-15T10:57:16.735542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:16.735596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:16.735609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:16.735621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:16.735631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:16.735670Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:16.735690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:16.735710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:16.736708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.736736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.736749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.736759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:16.737016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:16.737040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:16.737177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:16.737387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:16.737615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:16.737502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 391
2025-10-15T10:57:16.737696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400889784227180:5649], now have 1 active actors on pipe
2025-10-15T10:57:16.737504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 391, pipe: [1:7561400889784227336:4933]
2025-10-15T10:57:16.737723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400889784227336:4933], now have 1 active actors on pipe
2025-10-15T10:57:16.737619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 391
2025-10-15T10:57:16.737743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400889784227119:2467], now have 1 active actors on pipe
2025-10-15T10:57:16.737765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400892583931148:5157]
2025-10-15T10:57:16.737777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400892583931148:5157]
2025-10-15T10:57:16.737788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400892583931148:5157]
2025-10-15T10:57:16.737827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:16.737849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:16.737864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:16.737875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:16.737903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:16.738076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:16.738100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:16.738239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:16.738265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:16.738311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400892583931148:5157]
2025-10-15T10:57:16.738340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:16.738366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:16.738440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:16.738472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:16.738488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:16.738497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:16.738527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:16.738561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:16.738643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:16.739163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:16.739189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:16.739247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:16.739581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 392 partition: 0 MaxSeqNo: 46 sessionId: src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0
2025-10-15T10:57:16.740465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47038cdc-c0a7b238-4daecf71-5ee38030_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:16.760917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0] Write session: try to update token
2025-10-15T10:57:16.760983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:16.795530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:16.795592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:16.795612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:16.795625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:16.795682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400892583931148:5157]
2025-10-15T10:57:16.795724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400892583931148:5157]
2025-10-15T10:57:16.795758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400892583931148:5157]
2025-10-15T10:57:16.795922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:16.795987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:16.796018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:16.796032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:16.796042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:16.797920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:16.827217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId: src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:16.852906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:16.942201Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:16.953669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:16.953714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:16.953766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:16.953780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:16.953817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400892583931148:5157]
2025-10-15T10:57:16.954021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:16.954039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:16.954064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:16.954180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:16.954448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400889784227336:4933]
2025-10-15T10:57:16.954509Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:16.954533Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T10:57:16.955087Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 4 consumer shared/user session shared/user_1_4_11144608197415373266_v1 is DEAD
2025-10-15T10:57:16.955363Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T10:57:16.955567Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400735165385614:4930] disconnected; active server actors: 1
2025-10-15T10:57:16.955593Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400735165385614:4930] client user disconnected session shared/user_1_4_11144608197415373266_v1
2025-10-15T10:57:16.955930Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:57:16.955976Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:57:16.956025Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.005577s
2025-10-15T10:57:16.966953Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T10:57:16.967279Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:57:16.967311Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 5
2025-10-15T10:57:16.967837Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 5 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:57:16.968132Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:57:16.968688Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 auth for : user
2025-10-15T10:57:16.969269Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 Handle describe topics response
2025-10-15T10:57:16.969401Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 auth is DEAD
2025-10-15T10:57:16.969483Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:57:16.971111Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:57:16.971496Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400889784227365:5653] connected; active server actors: 1
2025-10-15T10:57:16.971563Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561400889784227365:5653] session shared/user_1_5_15539774547917866340_v1
2025-10-15T10:57:16.971623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:57:16.971687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:57:16.971744Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_5_15539774547917866340_v1" (Sender=[1:7561400889784227359:5653], Pipe=[1:7561400889784227365:5653], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:57:16.971779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:57:16.971833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:57:16.971898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_5_15539774547917866340_v1" (Sender=[1:7561400889784227359:5653], Pipe=[1:7561400889784227365:5653], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:57:16.971976Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_5_15539774547917866340_v1" sender [1:7561400889784227359:5653] lock partition 0 for ReadingSession "shared/user_1_5_15539774547917866340_v1" (Sender=[1:7561400889784227359:5653], Pipe=[1:7561400889784227365:5653], Partitions=[], ActiveFamilyCount=1) generation 1 step 5
2025-10-15T10:57:16.972029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:57:16.972069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000199s
2025-10-15T10:57:16.972730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 392 reason: error at write: Disconnected sessionId: src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0
2025-10-15T10:57:16.972891Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_5_15539774547917866340_v1" ClientId: "user" PipeClient { RawX1: 7561400889784227365 RawX2: 4503603922343445 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:57:16.972963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 392 sessionId: src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0 is DEAD
2025-10-15T10:57:16.972978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:57:16.973025Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_5_15539774547917866340_v1
2025-10-15T10:57:16.973061Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:57:16.973260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:16.973284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0] Write session will restart in 0.008668s
2025-10-15T10:57:16.973297Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:57:16.973378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0] Write session: Do CDS request
2025-10-15T10:57:16.973398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:16.973525Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:57:16.973637Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 got read request: guid# d150d77c-34e4e667-4791ca29-eb62b986
2025-10-15T10:57:16.993929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:16.993968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 393
2025-10-15T10:57:16.994176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:16.994804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:16.994996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:16.995042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:16.995057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:16.996425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 393 sessionId:  describe result for acl check
2025-10-15T10:57:16.996530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:16.996546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:16.996555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:16.996570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400889784227373:5657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:16.998925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400889784227373:5657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:17.003855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400889784227373:5657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:17.010449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400889784227373:5657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:17.010494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400889784227373:5657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:17.010508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400889784227373:5657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:17.010535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:17.040880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:17.042255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:17.042857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:17.042878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:17.042907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:17.043069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:17.043185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400896878898684:5159]
2025-10-15T10:57:17.045057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:17.045907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:17.046066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:17.046941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:17.047236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.047252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.047259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.047265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.047271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.047277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.047284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.047290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.047297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.047303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.047309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.047316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.047321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.047327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.047402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.047499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.047544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.047581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.047615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.047662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.047714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.047764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.047811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.047861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.047920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.047966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.048010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.048054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.048095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.048143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.048181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.048216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.048261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.048296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.048323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.048357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.048389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.048421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.048450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.048485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.048514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.048554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.048585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.048624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.048676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.048725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.048758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.048799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.048834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.048873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.048905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.048943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.048985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.049037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.049082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.049128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.049486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:17.065000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:17.075471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:17.075514Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:17.075529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:17.075545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:17.075566Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 392 [2:7561400896878898684:5159]
2025-10-15T10:57:17.075611Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:17.075660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:17.075672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:17.075684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:17.075694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:17.075739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:17.075757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:17.075777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:17.084865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.084898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.084911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.084921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:17.085174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:17.085198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.085316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.085477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.085458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 392
2025-10-15T10:57:17.085594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 392, pipe: [1:7561400889784227369:5656]
2025-10-15T10:57:17.085662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 392
2025-10-15T10:57:17.085683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:17.085761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400889784227351:2467], now have 1 active actors on pipe
2025-10-15T10:57:17.085785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400889784227369:5656], now have 1 active actors on pipe
2025-10-15T10:57:17.085806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400894079194719:5657], now have 1 active actors on pipe
2025-10-15T10:57:17.085870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:17.085898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:17.085924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_5_15539774547917866340_v1 on pipe: [1:7561400889784227369:5656]
2025-10-15T10:57:17.085964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400896878898679:5159]
2025-10-15T10:57:17.085983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400896878898679:5159]
2025-10-15T10:57:17.085995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400896878898679:5159]
2025-10-15T10:57:17.086026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:17.086051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:17.086072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:17.086083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:17.086087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:17.086100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:17.086139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:17.086302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:17.086322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:17.086357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:17.086385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:17.086394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:17.086463Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_5_15539774547917866340_v1
2025-10-15T10:57:17.086477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:17.086680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:17.086707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:57:17.086725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400896878898679:5159]
2025-10-15T10:57:17.086748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:17.086774Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:57:17.086791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:17.087160Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_5_15539774547917866340_v1:1 with generation 392
2025-10-15T10:57:17.092713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:57:17.092785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:57:17.092807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:17.092827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:17.092836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:17.092878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:17.092917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:17.092947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:57:17.092978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:57:17.093023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:17.093281Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760525837084 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:57:17.093336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T10:57:17.093505Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 sending to client partition status
2025-10-15T10:57:17.093649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:17.093681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:17.093747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:17.093961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 393 partition: 0 MaxSeqNo: 46 sessionId: src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0
2025-10-15T10:57:17.094485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9a432f8-3f3897db-f58a9dc9-1dcc7565_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:17.115393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:17.115426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:17.115462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400896878898679:5159]
2025-10-15T10:57:17.115567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:17.115584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:17.117369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0] Write session: try to update token
2025-10-15T10:57:17.117428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:17.117710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:17.119182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:17.120622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:17.122097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:17.124092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:17.124621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:17.185626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:17.185661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:17.185674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:17.185684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:17.185725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400896878898679:5159]
2025-10-15T10:57:17.185751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400896878898679:5159]
2025-10-15T10:57:17.185772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400896878898679:5159]
2025-10-15T10:57:17.185879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:17.185925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:17.185929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:17.185936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:17.185947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:17.185958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:17.185993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:17.186013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:17.187072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:17.203172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId: src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:17.224576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:17.332392Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:17.337917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:17.337970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:17.338699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400889784227369:5656]
2025-10-15T10:57:17.338813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:17.338825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:17.338792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_5_15539774547917866340_v1
2025-10-15T10:57:17.338832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:17.351136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:17.351302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 393 reason: error at write: Disconnected sessionId: src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0
2025-10-15T10:57:17.351704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 393 sessionId: src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0 is DEAD
2025-10-15T10:57:17.352111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:17.352174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0] Write session will restart in 0.008948s
2025-10-15T10:57:17.352333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0] Write session: Do CDS request
2025-10-15T10:57:17.352380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:17.365440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:17.365478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 394
2025-10-15T10:57:17.365676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:17.366145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:17.366287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:17.366311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:17.366321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:17.367583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 394 sessionId:  describe result for acl check
2025-10-15T10:57:17.367693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:17.367709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:17.367719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:17.367737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400894079194906:5668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:17.373688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400894079194906:5668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:17.375077Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_5_15539774547917866340_v1
2025-10-15T10:57:17.384107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400894079194906:5668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:17.390850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400894079194906:5668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:17.390912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400894079194906:5668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:17.390929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400894079194906:5668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:17.390966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:17.438810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400894079195118:5656]
2025-10-15T10:57:17.440182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:17.441843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:17.442705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:17.442736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:17.442778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:17.443008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:17.443192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400896878898946:5168]
2025-10-15T10:57:17.445412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:17.446275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:17.446475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:17.447747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:17.448059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.448078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.448086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.448094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.448102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.448108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.448115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.448122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.448129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.448136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.448144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.448152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.448159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.448166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.448221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.448348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.448404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.448454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.448505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.448556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.448606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.448655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.448731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.448810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.448866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.448911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.448961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.449023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.449063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.449136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.449200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.449256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.449306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.449361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.449406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.449459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.449514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.449569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.449615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.449664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.449712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.449765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.449811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.449862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.449911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.449966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.450009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.450065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.450114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.450171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.450240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.450307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.450357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.450412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.450457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.450507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.451033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:17.466443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:17.475271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:17.475327Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:17.475357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:17.475378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:17.475407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 393 [2:7561400896878898946:5168]
2025-10-15T10:57:17.475462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:17.475524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:17.475555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:17.475568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:17.475580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:17.475630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:17.475660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:17.475684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:17.476730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.476755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.476770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.476781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:17.477053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:17.477078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.477248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.477285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 393, pipe: [1:7561400894079195118:5656]
2025-10-15T10:57:17.477378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 393
2025-10-15T10:57:17.477419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 393
2025-10-15T10:57:17.477442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.477656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:17.477747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400894079195118:5656], now have 1 active actors on pipe
2025-10-15T10:57:17.477775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400894079194898:2467], now have 1 active actors on pipe
2025-10-15T10:57:17.477794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400894079194945:5668], now have 1 active actors on pipe
2025-10-15T10:57:17.477859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:17.477882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:17.477919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400896878898941:5168]
2025-10-15T10:57:17.477936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400896878898941:5168]
2025-10-15T10:57:17.477949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400896878898941:5168]
2025-10-15T10:57:17.477984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:17.478021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:17.478043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:17.478053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:17.478054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:17.478262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:17.478285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:17.478354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:17.478389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:17.478410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:17.478420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:17.478455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:17.478494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:17.478621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400896878898941:5168]
2025-10-15T10:57:17.478651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:17.478686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:17.478690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:17.479139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:17.479170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:17.479228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:17.479607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 394 partition: 0 MaxSeqNo: 46 sessionId: src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0
2025-10-15T10:57:17.480326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de4f797-8d953970-cbff7e2a-1ae0e5d6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:17.500768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0] Write session: try to update token
2025-10-15T10:57:17.500823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:17.555067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:17.555104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:17.555139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400896878898941:5168]
2025-10-15T10:57:17.555302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:17.555339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:17.558232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:17.559479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:17.562221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:17.563809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:17.565408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:17.570925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId: src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:17.590685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:17.590875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:17.590890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:17.590902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:17.590955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:17.590970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:17.590984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:17.590996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:17.591034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400896878898941:5168]
2025-10-15T10:57:17.591063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400896878898941:5168]
2025-10-15T10:57:17.591086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400896878898941:5168]
2025-10-15T10:57:17.591193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:17.591231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:17.591232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:17.591252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:17.591262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:17.592291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:17.601313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:17.726878Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:17.747755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:17.747792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:17.748254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:17.748326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:17.748338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:17.748434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400894079195118:5656]
2025-10-15T10:57:17.748424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:17.777415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 394 reason: error at write: Disconnected sessionId: src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0
2025-10-15T10:57:17.777793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 394 sessionId: src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0 is DEAD
2025-10-15T10:57:17.777935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:17.777961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0] Write session will restart in 0.006830s
2025-10-15T10:57:17.778052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0] Write session: Do CDS request
2025-10-15T10:57:17.778087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:17.788722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:17.788780Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 395
2025-10-15T10:57:17.788974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:17.789688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:17.789888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:17.789935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:17.789952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:17.792724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 395 sessionId:  describe result for acl check
2025-10-15T10:57:17.792902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:17.792921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:17.792946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:17.792971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400894079195197:5676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:17.797375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400894079195197:5676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:17.805083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400894079195197:5676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:17.812618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400894079195197:5676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:17.812663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400894079195197:5676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:17.812680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400894079195197:5676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:17.812708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:17.822714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:17.824375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:17.825174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:17.825202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:17.825244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:17.825483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:17.825671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400896878899171:5178]
2025-10-15T10:57:17.827935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:17.828836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:17.829071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:17.830380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:17.830718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.830736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.830743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.830750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.830758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.830766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.830773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.830780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.830787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.830796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.830804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.830809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.830816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.830822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.830871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.830987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.831040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.831100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.831151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.831209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.831268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.831323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.831409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.831471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.831523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.831580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.831633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.831683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.831738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.831811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:17.831879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.831943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:17.831994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.832055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:17.832108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.832171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:17.832226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.832297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:17.832350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.832409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:17.832463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.832524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:17.832575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.832636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:17.832694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.832761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:17.832812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.832874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:17.832925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.832983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:17.833036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.833096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.833148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.833208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.833259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.833319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.833873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:17.848446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400894079195367:5656]
2025-10-15T10:57:17.869684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:17.877752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:17.877795Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:17.877807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:17.877822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:17.877842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 394 [2:7561400896878899171:5178]
2025-10-15T10:57:17.877895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:17.877953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:17.877971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:17.877981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:17.877990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:17.878025Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:17.878046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:17.878064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:17.878851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.878867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.878876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.878884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:17.879086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:17.879103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:17.879204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:17.879361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:17.879408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 394, pipe: [1:7561400894079195367:5656]
2025-10-15T10:57:17.879529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 394
2025-10-15T10:57:17.879548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 394
2025-10-15T10:57:17.879557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:17.879650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400894079195367:5656], now have 1 active actors on pipe
2025-10-15T10:57:17.879679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400894079195144:2467], now have 1 active actors on pipe
2025-10-15T10:57:17.879699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400894079195356:5676], now have 1 active actors on pipe
2025-10-15T10:57:17.879721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400896878899166:5178]
2025-10-15T10:57:17.879742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400896878899166:5178]
2025-10-15T10:57:17.879755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400896878899166:5178]
2025-10-15T10:57:17.879792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:17.879813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:17.879823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:17.879831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:17.879874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:17.880058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:17.880081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:17.880154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:17.880180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:17.880308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400896878899166:5178]
2025-10-15T10:57:17.880340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:17.880355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:17.880414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:17.880447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:17.880469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:17.880481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:17.880519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:17.880561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:17.880686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:17.881046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:17.881069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:17.881140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:17.881342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 395 partition: 0 MaxSeqNo: 46 sessionId: src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0
2025-10-15T10:57:17.882068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a872101-d28732d7-a8ae6632-8cbc30a7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:17.903533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0] Write session: try to update token
2025-10-15T10:57:17.903588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:17.972008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:17.972046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:17.972060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:17.972069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:17.972111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400896878899166:5178]
2025-10-15T10:57:17.972135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400896878899166:5178]
2025-10-15T10:57:17.972155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400896878899166:5178]
2025-10-15T10:57:17.972332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:17.972402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:17.972411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:17.972433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:17.972434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:17.974835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:17.980423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId: src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:18.001303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:18.117236Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:18.125862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:18.125918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:18.125989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:18.126004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:18.126048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400896878899166:5178]
2025-10-15T10:57:18.126196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:18.126506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:18.126540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400894079195367:5656]
2025-10-15T10:57:18.126603Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:18.126544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:18.126631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:18.145180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 395 reason: error at write: Disconnected sessionId: src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0
2025-10-15T10:57:18.145520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 395 sessionId: src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0 is DEAD
2025-10-15T10:57:18.145846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:18.145903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0] Write session will restart in 0.008218s
2025-10-15T10:57:18.146037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0] Write session: Do CDS request
2025-10-15T10:57:18.146065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:18.158453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:18.158491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 396
2025-10-15T10:57:18.158612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:18.159069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:18.159216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:18.159243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:18.159254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:18.160544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 396 sessionId:  describe result for acl check
2025-10-15T10:57:18.160669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:18.160688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:18.160697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:18.160718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400898374162692:5680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:18.163669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400898374162692:5680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:18.170370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400898374162692:5680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:18.180898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400898374162692:5680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:18.180947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400898374162692:5680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:18.180968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400898374162692:5680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:18.180997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:18.203114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:18.204917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:18.205760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:18.205789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:18.205833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:18.206083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:18.206271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400901173866691:5180]
2025-10-15T10:57:18.208483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:18.209394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:18.209625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:18.210964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:18.211305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:18.211323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:18.211331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:18.211339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:18.211364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:18.211373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:18.211380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:18.211388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:18.211396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:18.211403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:18.211411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:18.211417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.211424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.211431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.211485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:18.211599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:18.211650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:18.211697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:18.211745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:18.211802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:18.211855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:18.211909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:18.211960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:18.212017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:18.212072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:18.212126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.212181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.212235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.212293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:18.212371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:18.212438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:18.212499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:18.212557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:18.212621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:18.212672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:18.212732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:18.212784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:18.212841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:18.212892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:18.212952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:18.213007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:18.213066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:18.213124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:18.213185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:18.213240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:18.213305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:18.213357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:18.213419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:18.213470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:18.213529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:18.213594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.213654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.213705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.213766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.213817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.213874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.214387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:18.226786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400898374162899:5656]
2025-10-15T10:57:18.230626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:18.239708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:18.239764Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:18.239784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:18.239805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:18.239832Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 395 [2:7561400901173866691:5180]
2025-10-15T10:57:18.239889Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:18.239958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:18.239974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:18.239989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:18.240001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:18.240053Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:18.240085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:18.240109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:18.248127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.248179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.248193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.248205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:18.248513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:18.248540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.248689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.248841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 395, pipe: [1:7561400898374162899:5656]
2025-10-15T10:57:18.248897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.248845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 395
2025-10-15T10:57:18.248915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 395
2025-10-15T10:57:18.249122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:18.249209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400898374162899:5656], now have 1 active actors on pipe
2025-10-15T10:57:18.249238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400898374162804:5680], now have 1 active actors on pipe
2025-10-15T10:57:18.249263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400898374162677:2467], now have 1 active actors on pipe
2025-10-15T10:57:18.249310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:18.249335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:18.249384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400901173866686:5180]
2025-10-15T10:57:18.249405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400901173866686:5180]
2025-10-15T10:57:18.249416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400901173866686:5180]
2025-10-15T10:57:18.249453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:18.249492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:18.249508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:18.249518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:18.249520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:18.249682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:18.249703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:18.249756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75a115b1-913058cc-c8b6211e-3fbd266_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:18.249791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:18.249807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:18.249816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:18.249847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:18.249886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:18.250006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400901173866686:5180]
2025-10-15T10:57:18.250043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:18.250080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:18.250088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:18.250583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:18.250613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:18.250671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:18.250998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 396 partition: 0 MaxSeqNo: 46 sessionId: src_id|75a115b1-913058cc-c8b6211e-3fbd266_0
2025-10-15T10:57:18.251675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d45e36e-f03bf207-fd787840-d8f650a0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|75a115b1-913058cc-c8b6211e-3fbd266_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:18.273003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a115b1-913058cc-c8b6211e-3fbd266_0] Write session: try to update token
2025-10-15T10:57:18.273065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a115b1-913058cc-c8b6211e-3fbd266_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:18.278533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:18.278569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:18.278605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400901173866686:5180]
2025-10-15T10:57:18.278730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:18.278737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:18.281137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:18.282585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:18.284013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:18.285360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:18.287120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:18.287637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:18.329691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:18.329724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:18.329737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:18.329747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:18.329781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400901173866686:5180]
2025-10-15T10:57:18.329805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400901173866686:5180]
2025-10-15T10:57:18.329828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400901173866686:5180]
2025-10-15T10:57:18.329952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:18.329963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:18.329986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:18.329996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:18.330022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:18.331215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:18.338550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId: src_id|75a115b1-913058cc-c8b6211e-3fbd266_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:18.369974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:18.470618Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:18.472717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:18.472752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:18.473655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400898374162899:5656]
2025-10-15T10:57:18.473769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:18.473346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:18.536009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:18.538932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 396 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75a115b1-913058cc-c8b6211e-3fbd266_0
2025-10-15T10:57:18.539294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 396 sessionId: src_id|75a115b1-913058cc-c8b6211e-3fbd266_0 is DEAD
2025-10-15T10:57:18.543446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a115b1-913058cc-c8b6211e-3fbd266_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:18.543483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a115b1-913058cc-c8b6211e-3fbd266_0] Write session will restart in 0.008520s
2025-10-15T10:57:18.543578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a115b1-913058cc-c8b6211e-3fbd266_0] Write session: Do CDS request
2025-10-15T10:57:18.543603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a115b1-913058cc-c8b6211e-3fbd266_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:18.558433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a115b1-913058cc-c8b6211e-3fbd266_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:18.558682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:18.558717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 397
2025-10-15T10:57:18.559107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:18.559227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:18.559242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:18.559253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:18.560864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 397 sessionId:  describe result for acl check
2025-10-15T10:57:18.560982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:18.561002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:18.561012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:18.561028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400898374163001:5692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:18.565719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400898374163001:5692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:18.574274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400898374163001:5692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:18.574521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400898374163092:5656]
2025-10-15T10:57:18.591607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400898374163001:5692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:18.591664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400898374163001:5692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:18.591686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400898374163001:5692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:18.591721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:18.603975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:18.608367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:18.609396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:18.609428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:18.609472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:18.609725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:18.609914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400901173866944:5189]
2025-10-15T10:57:18.612162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:18.616989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:18.617249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:18.618587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:18.618900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:18.618908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:18.618913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:18.618920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:18.618928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:18.618935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:18.618941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:18.618948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:18.618956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:18.618962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:18.618970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:18.618976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.618982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.618990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.619035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:18.619140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:18.619196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:18.619240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:18.619282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:18.619325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:18.619389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:18.619436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:18.619478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:18.619524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:18.619567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:18.619608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.619652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.619691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.619731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:18.619794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:18.619850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:18.619901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:18.619946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:18.619997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:18.620037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:18.620087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:18.620128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:18.620177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:18.620220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:18.620306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:18.620354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:18.620405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:18.620447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:18.620493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:18.620534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:18.620586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:18.620632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:18.620681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:18.620742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:18.620798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:18.620840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.620891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.620936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.620985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.621024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.621074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.621552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:18.645187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:18.655425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:18.655475Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:18.655493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:18.655523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:18.655547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 396 [2:7561400901173866944:5189]
2025-10-15T10:57:18.655616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:18.655672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:18.655685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:18.655698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:18.655709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:18.655762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:18.655792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:18.655815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:18.675883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.675913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.675924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.675934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:18.676195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:18.676211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:18.676349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:18.676474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:18.676618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:18.676672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400898374162933:2467], now have 1 active actors on pipe
2025-10-15T10:57:18.676687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400898374163147:5692], now have 1 active actors on pipe
2025-10-15T10:57:18.676700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400898374163092:5656], now have 1 active actors on pipe
2025-10-15T10:57:18.676719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400901173866939:5189]
2025-10-15T10:57:18.676730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400901173866939:5189]
2025-10-15T10:57:18.676738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400901173866939:5189]
2025-10-15T10:57:18.676765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:18.676833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:18.676972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:18.676982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:18.677075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400901173866939:5189]
2025-10-15T10:57:18.677086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:18.677275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:18.677291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:18.677303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:18.677331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:18.679571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 396
2025-10-15T10:57:18.679705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 396
2025-10-15T10:57:18.679780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 396, pipe: [1:7561400898374163092:5656]
2025-10-15T10:57:18.683521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:18.683565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:18.683654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:18.683693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:18.683715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:18.683724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:18.683765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:18.683817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:18.683866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:18.691469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:18.691517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:18.691604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:18.695874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 397 partition: 0 MaxSeqNo: 46 sessionId: src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0
2025-10-15T10:57:18.696627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a115b1-913058cc-c8b6211e-3fbd266_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:18.736085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:18.736126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:18.736161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400901173866939:5189]
2025-10-15T10:57:18.736303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:18.737304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:18.738283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:18.739860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:18.741220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:18.742569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:18.744299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:18.744893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:18.746728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0] Write session: try to update token
2025-10-15T10:57:18.746779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:18.755691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:18.755725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:18.755737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:18.791769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:18.791821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:18.791842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:18.791854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:18.791894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400901173866939:5189]
2025-10-15T10:57:18.791923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400901173866939:5189]
2025-10-15T10:57:18.791947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400901173866939:5189]
2025-10-15T10:57:18.792101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:18.792127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:18.795509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:18.795568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:18.795599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:18.802067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:18.842000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId: src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:18.865813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:18.951205Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:18.954924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:18.954119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:18.954944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400898374163092:5656]
2025-10-15T10:57:18.954162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:18.954961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:18.955008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:18.956899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:18.985238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 397 reason: error at write: Disconnected sessionId: src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0
2025-10-15T10:57:18.985604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 397 sessionId: src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0 is DEAD
2025-10-15T10:57:18.985984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:18.986061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0] Write session will restart in 0.005666s
2025-10-15T10:57:18.986231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0] Write session: Do CDS request
2025-10-15T10:57:18.986311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:18.998454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:18.998361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:18.998414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 398
2025-10-15T10:57:19.000373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:19.000532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:19.000556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:19.000565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:19.001906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 398 sessionId:  describe result for acl check
2025-10-15T10:57:19.002023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:19.002039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:19.002048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:19.002063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400902669130505:5699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:19.005194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400902669130505:5699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:19.017376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400902669130505:5699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:19.026104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400902669130505:5699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:19.026163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400902669130505:5699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:19.026183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400902669130505:5699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:19.026221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:19.047482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:19.049322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:19.050079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:19.050092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:19.050145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:19.050357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:19.050518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400905468834490:5194]
2025-10-15T10:57:19.052607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:19.053603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:19.053832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:19.054719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400902669130700:5656]
2025-10-15T10:57:19.055172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:19.055538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.055556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.055564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.055572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.055578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.055586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.055593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.055601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.055608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.055615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.055625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.055634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.055641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.055649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.055695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.055817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.055869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.055919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.055967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.056025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.056076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.056129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.056189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.056271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.056334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.056386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.056440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.056493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.056545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.056616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.056682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.056748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.056802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.056868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.056922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.056986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.057039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.057097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.057148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.057211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.057263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.057323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.057375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.057433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.057500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.057565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.057616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.057678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.057723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.057773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.057826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.057881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.057934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.057993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.058052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.058092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.058526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:19.076718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:19.085554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:19.085783Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:19.085808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:19.085828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:19.085854Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 397 [2:7561400905468834490:5194]
2025-10-15T10:57:19.085938Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:19.086001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:19.086020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:19.086031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:19.086042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:19.086085Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:19.086110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:19.086130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:19.087496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.087520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.087533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.087544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:19.087801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:19.087818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.089360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 397, pipe: [1:7561400902669130700:5656]
2025-10-15T10:57:19.087949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.088152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.089363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 397
2025-10-15T10:57:19.088407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:19.089458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 397
2025-10-15T10:57:19.088475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400905468834485:5194]
2025-10-15T10:57:19.088489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400905468834485:5194]
2025-10-15T10:57:19.088500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400905468834485:5194]
2025-10-15T10:57:19.088547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:19.088623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:19.088774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:19.088775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:19.088793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:19.088798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:19.088810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:19.088893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400905468834485:5194]
2025-10-15T10:57:19.088916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:19.089024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:19.089310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400902669130700:5656], now have 1 active actors on pipe
2025-10-15T10:57:19.089323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400902669130662:5699], now have 1 active actors on pipe
2025-10-15T10:57:19.089338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400898374163183:2467], now have 1 active actors on pipe
2025-10-15T10:57:19.089597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:19.089610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:19.089664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:19.089683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:19.089693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:19.089699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:19.089721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:19.089747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:19.089775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:19.090304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:19.090331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:19.090388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:19.090791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 398 partition: 0 MaxSeqNo: 46 sessionId: src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0
2025-10-15T10:57:19.091918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9be3557a-9a4b1ed7-6f5b526f-a658c857_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:19.112267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0] Write session: try to update token
2025-10-15T10:57:19.112325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:19.196990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:19.197024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:19.197059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400905468834485:5194]
2025-10-15T10:57:19.197235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:19.197247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:19.197258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:19.197315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:19.199483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:19.199737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:19.200971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:19.202097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:19.203261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:19.212759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:19.232696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:19.232830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:19.232844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:19.232856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:19.232865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:19.232897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400905468834485:5194]
2025-10-15T10:57:19.232919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400905468834485:5194]
2025-10-15T10:57:19.232940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400905468834485:5194]
2025-10-15T10:57:19.233052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:19.233070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:19.234848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:19.239452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:19.239493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:19.239517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:19.256888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId: src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:19.279272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:19.370072Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:19.371829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:19.371868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:19.372570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:19.372425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400902669130700:5656]
2025-10-15T10:57:19.372544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:19.372556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:19.373160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:19.393606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 398 reason: error at write: Disconnected sessionId: src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0
2025-10-15T10:57:19.393846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 398 sessionId: src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0 is DEAD
2025-10-15T10:57:19.395916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:19.395956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0] Write session will restart in 0.007268s
2025-10-15T10:57:19.396062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0] Write session: Do CDS request
2025-10-15T10:57:19.396106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:19.418427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:19.418473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 399
2025-10-15T10:57:19.418612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:19.419248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:19.419510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:19.419548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:19.419562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:19.424103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 399 sessionId:  describe result for acl check
2025-10-15T10:57:19.424226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:19.424243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:19.424253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:19.424283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400902669130749:5706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:19.426703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400902669130749:5706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:19.435841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400902669130749:5706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:19.446449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400902669130749:5706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:19.446494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400902669130749:5706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:19.446510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400902669130749:5706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:19.446558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:19.461878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:19.463965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:19.464805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:19.464841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:19.464885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:19.465146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:19.465339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400905468834730:5201]
2025-10-15T10:57:19.467668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:19.468614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:19.468845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:19.469882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:19.470158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.470177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.470184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.470191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.470197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.470203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.470211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.470217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.470224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.470230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.470236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.470243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.470249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.470256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.470301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.470402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.470448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.470493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.470536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.470598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.470643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.470687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.470729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.470773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.470817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.470860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.470904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.470950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.470992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.471037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.471077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.471115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.471161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.471214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.471260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.471298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.472472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400902669130938:5656]
2025-10-15T10:57:19.471332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.471396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.471441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.471492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.471551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.471599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.471642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.471699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.471748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.471797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.471837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.471873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.471907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.471951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.471993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.472041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.472071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.472107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.472137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.472181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.472625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:19.491002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:19.501309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:19.501375Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:19.501397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:19.501419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:19.501447Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 398 [2:7561400905468834730:5201]
2025-10-15T10:57:19.501509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:19.501574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:19.501605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:19.501618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:19.501631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:19.501685Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:19.501711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:19.501736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:19.514063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.514105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.514120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.514134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:19.514531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:19.514598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.514790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.514941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 398, pipe: [1:7561400902669130938:5656]
2025-10-15T10:57:19.514963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 398
2025-10-15T10:57:19.515011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.515055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 398
2025-10-15T10:57:19.515276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:19.515398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400902669130938:5656], now have 1 active actors on pipe
2025-10-15T10:57:19.515463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400902669130919:5706], now have 1 active actors on pipe
2025-10-15T10:57:19.515506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400902669130716:2467], now have 1 active actors on pipe
2025-10-15T10:57:19.515596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:19.515641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:19.515720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400905468834725:5201]
2025-10-15T10:57:19.515742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400905468834725:5201]
2025-10-15T10:57:19.515756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400905468834725:5201]
2025-10-15T10:57:19.515809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:19.515845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:19.515856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:19.515872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:19.515909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:19.516102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:19.516128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:19.516197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:19.516236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:19.516255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:19.516281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:19.516321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:19.516369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:19.516580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400905468834725:5201]
2025-10-15T10:57:19.516650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:19.516752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:19.516966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:19.517712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:19.517747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:19.517825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:19.518138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 399 partition: 0 MaxSeqNo: 46 sessionId: src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0
2025-10-15T10:57:19.519134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b36459f9-d58f5bdb-963d9ceb-52c2acd7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:19.538642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0] Write session: try to update token
2025-10-15T10:57:19.538710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:19.613393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:19.613432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:19.613449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:19.613460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:19.613499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400905468834725:5201]
2025-10-15T10:57:19.613525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400905468834725:5201]
2025-10-15T10:57:19.613550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400905468834725:5201]
2025-10-15T10:57:19.613685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:19.613719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:19.613749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:19.613777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:19.613790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:19.613801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:19.613845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:19.613864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:19.615001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:19.629841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId: src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:19.653741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:19.754383Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:19.768154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:19.768197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:19.768260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:19.768281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:19.768318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400905468834725:5201]
2025-10-15T10:57:19.768566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:19.768876Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:19.768971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400902669130938:5656]
2025-10-15T10:57:19.769049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:19.769066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:19.769068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:19.778465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 399 reason: error at write: Disconnected sessionId: src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0
2025-10-15T10:57:19.778839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 399 sessionId: src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0 is DEAD
2025-10-15T10:57:19.779283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:19.779408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0] Write session will restart in 0.007654s
2025-10-15T10:57:19.779522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0] Write session: Do CDS request
2025-10-15T10:57:19.779557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:19.792617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:19.792674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 400
2025-10-15T10:57:19.792897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:19.793608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:19.793810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:19.793851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:19.793870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:19.795187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 400 sessionId:  describe result for acl check
2025-10-15T10:57:19.795299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:19.795313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:19.795323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:19.795339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400902669130976:5711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:19.797692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400902669130976:5711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:19.804769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400902669130976:5711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:19.814043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400902669130976:5711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:19.814091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400902669130976:5711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:19.814108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400902669130976:5711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:19.814140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:19.840851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:19.842337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:19.842991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:19.843012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:19.843038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:19.843212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:19.843334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400905468834961:5205]
2025-10-15T10:57:19.845094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:19.845757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:19.845899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:19.846813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:19.847047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.847065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.847072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.847078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.847084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.847091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.847097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.847104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.847110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.847116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.847123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.847129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.847135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.847141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.847182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.847278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.847322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.847384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.847429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.847481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.847530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.847590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.847638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.847685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.847733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.847781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.847829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.847874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.847918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.847982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:19.848039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.848094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:19.848144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.848195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:19.848244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.848310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:19.848362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.848412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:19.848458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.848512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:19.848558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.848600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:19.848632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.848687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:19.848748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.848807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:19.848855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.848910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:19.848959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.849014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:19.849059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.849107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.849152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.849199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.849242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.849298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.849751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:19.865427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:19.869332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400902669131189:5656]
2025-10-15T10:57:19.875602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:19.875650Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:19.875667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:19.875684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:19.875706Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 399 [2:7561400905468834961:5205]
2025-10-15T10:57:19.875754Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:19.875810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:19.875826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:19.875836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:19.875847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:19.875892Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:19.875911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:19.875930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:19.888248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 399, pipe: [1:7561400902669131189:5656]
2025-10-15T10:57:19.888262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 399
2025-10-15T10:57:19.888373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 399
2025-10-15T10:57:19.887682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.887712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.887723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.887733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:19.887977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:19.887991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:19.888104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:19.888253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:19.888471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:19.888543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400902669131047:5711], now have 1 active actors on pipe
2025-10-15T10:57:19.888564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400902669131189:5656], now have 1 active actors on pipe
2025-10-15T10:57:19.888580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400902669130961:2467], now have 1 active actors on pipe
2025-10-15T10:57:19.888603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400905468834956:5205]
2025-10-15T10:57:19.888617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400905468834956:5205]
2025-10-15T10:57:19.888628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400905468834956:5205]
2025-10-15T10:57:19.888654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:19.888706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:19.888721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:19.888721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:19.888731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:19.888884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:19.888899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:19.888950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:19.888969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:19.889093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400905468834956:5205]
2025-10-15T10:57:19.889123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:19.889177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:19.889181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:19.889207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:19.889221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:19.889230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:19.889261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:19.889294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:19.889407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:19.890164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:19.890195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:19.890252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:19.890620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 400 partition: 0 MaxSeqNo: 46 sessionId: src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0
2025-10-15T10:57:19.891445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95c64c7b-b9d314e9-8bedc040-704dfaa0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:19.924256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0] Write session: try to update token
2025-10-15T10:57:19.924323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:19.950892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:19.950929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:19.950943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:19.950953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:19.950986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400905468834956:5205]
2025-10-15T10:57:19.951016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400905468834956:5205]
2025-10-15T10:57:19.951040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400905468834956:5205]
2025-10-15T10:57:19.951147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:19.951177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:19.951199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:19.951202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:19.951231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:19.952309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:20.007870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId: src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:20.030861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:20.094758Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:20.097556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:20.097600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:20.098222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400902669131189:5656]
2025-10-15T10:57:20.098326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:20.098474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:20.098527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:20.111123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 400 reason: error at write: Disconnected sessionId: src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0
2025-10-15T10:57:20.111539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 400 sessionId: src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0 is DEAD
2025-10-15T10:57:20.111904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:20.111956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0] Write session will restart in 0.008213s
2025-10-15T10:57:20.112102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0] Write session: Do CDS request
2025-10-15T10:57:20.112161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:20.123474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:20.124768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:20.133218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:20.133262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 401
2025-10-15T10:57:20.133687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:20.133820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:20.133841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:20.133851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:20.135076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 401 sessionId:  describe result for acl check
2025-10-15T10:57:20.135173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:20.135188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:20.135197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:20.135212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400906964098526:5721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:20.137522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400906964098526:5721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:20.143473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400906964098526:5721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:20.149496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400906964098526:5721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:20.149536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400906964098526:5721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:20.149552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400906964098526:5721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:20.149576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:20.190140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:20.194589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:20.195316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:20.195359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:20.195395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:20.195611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:20.195800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400909763802498:5213]
2025-10-15T10:57:20.197800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:20.198476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400906964098736:5656]
2025-10-15T10:57:20.198547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:20.198718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:20.199786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:20.200064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:20.200078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:20.200084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:20.200091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:20.200097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:20.200102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:20.200108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:20.200113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:20.200118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:20.200125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:20.200131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:20.200136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.200142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.200148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.200188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:20.200292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:20.200335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:20.200376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:20.200415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:20.200463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:20.200503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:20.200547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:20.200594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:20.200642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:20.200688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:20.200734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.200781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.200823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.200860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:20.200907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:20.200946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:20.200997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:20.201039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:20.201082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:20.201136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:20.201178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:20.201225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:20.201274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:20.201313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:20.201361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:20.201399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:20.201446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:20.201486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:20.201533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:20.201576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:20.201638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:20.201695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:20.201749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:20.201790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:20.201836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:20.201877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.201920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.201959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.202008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.202052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.202102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.202550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:20.222927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:20.235820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:20.235863Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:20.235877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:20.235893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:20.235913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 400 [2:7561400909763802498:5213]
2025-10-15T10:57:20.235956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:20.236001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:20.236012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:20.236022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:20.236032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:20.236074Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:20.236091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:20.236109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:20.237868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.237893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.237904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.237915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:20.238157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:20.238179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.238294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.238360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 400, pipe: [1:7561400906964098736:5656]
2025-10-15T10:57:20.238465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.238467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 400
2025-10-15T10:57:20.238540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 400
2025-10-15T10:57:20.238695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:20.238775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400906964098736:5656], now have 1 active actors on pipe
2025-10-15T10:57:20.238805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400906964098555:5721], now have 1 active actors on pipe
2025-10-15T10:57:20.238826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400906964098513:2467], now have 1 active actors on pipe
2025-10-15T10:57:20.238889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:20.238913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:20.238947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400909763802493:5213]
2025-10-15T10:57:20.238965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400909763802493:5213]
2025-10-15T10:57:20.238976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400909763802493:5213]
2025-10-15T10:57:20.239009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:20.239048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:20.239068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:20.239074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:20.239078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:20.239224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:20.239247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:20.239306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:20.239338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:20.239373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:20.239383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:20.239412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:20.239450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:20.239572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400909763802493:5213]
2025-10-15T10:57:20.239602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:20.239645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:20.239649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:20.240060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:20.240098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:20.240153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:20.240382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 401 partition: 0 MaxSeqNo: 46 sessionId: src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0
2025-10-15T10:57:20.241051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4eea97c7-53ead268-bb6d0592-60b42c25_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:20.263749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0] Write session: try to update token
2025-10-15T10:57:20.263802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:20.271094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:20.271138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:20.271170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400909763802493:5213]
2025-10-15T10:57:20.271275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:20.271286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:20.273339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:20.274952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:20.276570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:20.278111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:20.280134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:20.280792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:20.350656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId: src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:20.357742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:20.357775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:20.357788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:20.357799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:20.357834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400909763802493:5213]
2025-10-15T10:57:20.357858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400909763802493:5213]
2025-10-15T10:57:20.357879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400909763802493:5213]
2025-10-15T10:57:20.358015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:20.358026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:20.358037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:20.358077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:20.358195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:20.358383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:20.358414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:20.358439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:20.359274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:20.381356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:20.501880Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:20.503532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:20.503572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:20.504168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400906964098736:5656]
2025-10-15T10:57:20.504739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:20.504308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:20.504330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:20.504840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:20.515035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 401 reason: error at write: Disconnected sessionId: src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0
2025-10-15T10:57:20.515677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 401 sessionId: src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0 is DEAD
2025-10-15T10:57:20.519993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:20.520060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0] Write session will restart in 0.006681s
2025-10-15T10:57:20.520214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0] Write session: Do CDS request
2025-10-15T10:57:20.520271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:20.533900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:20.533936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 402
2025-10-15T10:57:20.534307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:20.534912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:20.535035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:20.535049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:20.535058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:20.536293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 402 sessionId:  describe result for acl check
2025-10-15T10:57:20.536403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:20.536423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:20.536433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:20.536447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400906964098775:5729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:20.538642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400906964098775:5729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:20.547795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400906964098775:5729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:20.555871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400906964098775:5729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:20.555904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400906964098775:5729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:20.555915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400906964098775:5729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:20.555934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:20.607634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400906964098997:5656]
2025-10-15T10:57:20.622248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:20.624410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:20.625279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:20.625314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:20.625358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:20.625620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:20.625829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400909763802769:5223]
2025-10-15T10:57:20.628247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:20.629319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:20.629534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:20.630830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:20.631179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:20.631199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:20.631207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:20.631214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:20.631222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:20.631230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:20.631239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:20.631246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:20.631254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:20.631261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:20.631269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:20.631277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.631284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.631292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.631376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:20.631500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:20.631560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:20.631616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:20.631674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:20.631730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:20.631786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:20.631838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:20.631886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:20.631942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:20.631995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:20.632049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.632098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.632147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.632200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:20.632290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:20.632360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:20.632426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:20.632485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:20.632550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:20.632604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:20.632662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:20.632718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:20.632780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:20.632831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:20.632891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:20.632947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:20.633010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:20.633068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:20.633126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:20.633182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:20.633243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:20.633294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:20.633357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:20.633407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:20.633480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:20.633535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.633598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.633668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.633749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.633802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.633863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.634411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:20.658484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:20.668666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:20.668729Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:20.668749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:20.668772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:20.668800Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 401 [2:7561400909763802769:5223]
2025-10-15T10:57:20.668858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:20.668932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:20.668950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:20.668963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:20.668976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:20.670811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 401, pipe: [1:7561400906964098997:5656]
2025-10-15T10:57:20.670918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 401
2025-10-15T10:57:20.670986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 401
2025-10-15T10:57:20.669032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:20.669065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:20.669090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:20.670159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.670178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.670192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.670204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:20.670490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:20.670510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:20.670673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:20.670908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:20.671169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:20.671260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400906964098997:5656], now have 1 active actors on pipe
2025-10-15T10:57:20.671287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400906964098807:5729], now have 1 active actors on pipe
2025-10-15T10:57:20.671310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400906964098762:2467], now have 1 active actors on pipe
2025-10-15T10:57:20.671335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400909763802764:5223]
2025-10-15T10:57:20.671783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400909763802764:5223]
2025-10-15T10:57:20.671809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400909763802764:5223]
2025-10-15T10:57:20.671853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:20.671936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:20.672144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:20.672162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:20.672228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:20.672253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:20.672418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400909763802764:5223]
2025-10-15T10:57:20.672454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:20.672531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:20.672565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:20.672586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:20.672597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:20.672639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:20.672685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:20.672822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:20.672820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:20.672836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:20.672847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:20.672871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:20.674362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:20.674398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:20.674474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:20.674910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 402 partition: 0 MaxSeqNo: 46 sessionId: src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0
2025-10-15T10:57:20.675729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50372249-ce9d7481-6fa5fe52-e9edfeab_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:20.704586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0] Write session: try to update token
2025-10-15T10:57:20.704661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:20.789779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:20.789815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:20.789826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:20.789878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:20.789890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:20.789900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:20.789907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:20.789935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400909763802764:5223]
2025-10-15T10:57:20.789958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400909763802764:5223]
2025-10-15T10:57:20.789979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400909763802764:5223]
2025-10-15T10:57:20.790112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:20.790138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:20.790413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:20.790450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:20.790473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:20.794157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:20.842518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId: src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:20.866396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:20.934044Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:20.936378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400906964098997:5656]
2025-10-15T10:57:20.936534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:20.936742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:20.936779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:20.935475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:20.935511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:20.939198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:20.965971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 402 reason: error at write: Disconnected sessionId: src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0
2025-10-15T10:57:20.966262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 402 sessionId: src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0 is DEAD
2025-10-15T10:57:20.967973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:20.968016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0] Write session will restart in 0.007002s
2025-10-15T10:57:20.968123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0] Write session: Do CDS request
2025-10-15T10:57:20.968153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:20.989251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:20.991605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:20.991653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 403
2025-10-15T10:57:20.994362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:20.994455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:20.994465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:20.994473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:20.999243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 403 sessionId:  describe result for acl check
2025-10-15T10:57:20.999378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:20.999394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:20.999404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:20.999421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400906964099106:5734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:21.001680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400906964099106:5734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:21.012212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400906964099106:5734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:21.018798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400906964099106:5734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:21.018837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400906964099106:5734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:21.018852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400906964099106:5734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:21.018877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:21.031243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:21.033143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:21.033945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:21.033971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:21.034008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:21.034229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:21.034393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400914058770295:5226]
2025-10-15T10:57:21.038781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400911259066539:5656]
2025-10-15T10:57:21.045564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:21.046639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:21.046829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:21.048042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:21.048349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.048364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.048370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.048377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.048383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.048389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.048395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.048401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.048407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.048414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.048420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.048426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.048432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.048438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.048478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.048575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.048618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.048659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.048701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.048745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.048790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.048834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.048874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.048925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.048966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.049007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.049045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.049086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.049126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.049186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.049237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.049289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.049334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.049385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.049428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.049475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.049521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.049570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.049614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.049664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.049706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.049756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.049798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.049847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.049890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.049941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.049984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.050034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.050079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.050131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.050173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.050222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.050268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.050319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.050365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.050413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.050885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:21.069255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:21.080092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:21.080142Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:21.080158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:21.080175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:21.080200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 402 [2:7561400914058770295:5226]
2025-10-15T10:57:21.080249Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:21.080318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:21.080331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:21.080343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:21.080354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:21.080401Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:21.080421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:21.080441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:21.081541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.081557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.081569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.081581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:21.081848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:21.083439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 402, pipe: [1:7561400911259066539:5656]
2025-10-15T10:57:21.081866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.082005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.083454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 402
2025-10-15T10:57:21.082187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.083554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 402
2025-10-15T10:57:21.082414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:21.082481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400914058770290:5226]
2025-10-15T10:57:21.082495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400914058770290:5226]
2025-10-15T10:57:21.082509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400914058770290:5226]
2025-10-15T10:57:21.082552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:21.082626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:21.082740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:21.082773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:21.082789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:21.082802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:21.082819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:21.082931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400914058770290:5226]
2025-10-15T10:57:21.082952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:21.083047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:21.083675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400911259066539:5656], now have 1 active actors on pipe
2025-10-15T10:57:21.083704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400906964099016:2467], now have 1 active actors on pipe
2025-10-15T10:57:21.083725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400911259066534:5734], now have 1 active actors on pipe
2025-10-15T10:57:21.083801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:21.083823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:21.083884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5124075a-b0351387-8eec2e15-1cc76456_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:21.083911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:21.083927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:21.083938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:21.083969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:21.084003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:21.084042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:21.084843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:21.084873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:21.084934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:21.085258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 403 partition: 0 MaxSeqNo: 46 sessionId: src_id|5124075a-b0351387-8eec2e15-1cc76456_0
2025-10-15T10:57:21.086012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ce83142-92ea52a1-626730d6-6dfc8e5a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5124075a-b0351387-8eec2e15-1cc76456_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:21.104695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5124075a-b0351387-8eec2e15-1cc76456_0] Write session: try to update token
2025-10-15T10:57:21.104760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5124075a-b0351387-8eec2e15-1cc76456_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:21.204140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:21.204179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:21.204194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:21.204266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:21.204293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:21.204316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:21.204330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:21.204376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400914058770290:5226]
2025-10-15T10:57:21.204405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400914058770290:5226]
2025-10-15T10:57:21.204432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400914058770290:5226]
2025-10-15T10:57:21.204585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:21.204609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:21.204767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:21.204818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:21.204848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:21.208030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:21.245030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId: src_id|5124075a-b0351387-8eec2e15-1cc76456_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:21.266742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:21.362215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400911259066539:5656]
2025-10-15T10:57:21.362378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:21.362585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:21.362611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:21.359598Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:21.361293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:21.361325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:21.375157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5124075a-b0351387-8eec2e15-1cc76456_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:21.375215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5124075a-b0351387-8eec2e15-1cc76456_0] Write session will restart in 0.008636s
2025-10-15T10:57:21.375380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5124075a-b0351387-8eec2e15-1cc76456_0] Write session: Do CDS request
2025-10-15T10:57:21.375416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5124075a-b0351387-8eec2e15-1cc76456_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:21.372802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 403 reason: error at write: Disconnected sessionId: src_id|5124075a-b0351387-8eec2e15-1cc76456_0
2025-10-15T10:57:21.373133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 403 sessionId: src_id|5124075a-b0351387-8eec2e15-1cc76456_0 is DEAD
2025-10-15T10:57:21.381140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:21.393520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5124075a-b0351387-8eec2e15-1cc76456_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:21.395461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:21.395493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 404
2025-10-15T10:57:21.402645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:21.402831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:21.402848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:21.402859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:21.404143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 404 sessionId:  describe result for acl check
2025-10-15T10:57:21.404239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:21.404250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:21.404259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:21.404274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400911259066570:5739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:21.406763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400911259066570:5739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:21.431489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400911259066570:5739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:21.454566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400911259066570:5739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:21.454613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400911259066570:5739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:21.454628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400911259066570:5739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:21.454656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:21.461594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400911259066743:5656]
2025-10-15T10:57:21.484133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:21.491794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:21.492747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:21.492786Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:21.492828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:21.493093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:21.493280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400914058770554:5228]
2025-10-15T10:57:21.495561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:21.497402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:21.497625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:21.498952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:21.499269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.499277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.499285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.499292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.499299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.499305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.499312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.499318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.499325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.499332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.499339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.499366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.499374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.499380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.499430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.499547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.499599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.499648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.499694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.499739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.499785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.499831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.499878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.499926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.499974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.500033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.500080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.500125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.500170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.500235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.500307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.500373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.500434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.500494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.500547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.500601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.500650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.500704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.500748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.500799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.500847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.500900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.500953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.501006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.501057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.501117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.501167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.501225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.501277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.501338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.501386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.501444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.501493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.501547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.501596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.501654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.502165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:21.547850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:21.559404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:21.559457Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:21.563450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 403
2025-10-15T10:57:21.559473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:21.559492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:21.559517Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 403 [2:7561400914058770554:5228]
2025-10-15T10:57:21.559566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:21.559624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:21.559638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:21.559652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:21.559663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:21.559711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:21.559734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:21.559757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:21.561891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.561908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.561923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.561934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:21.562205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:21.562223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.562368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.563834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 403
2025-10-15T10:57:21.562567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.563899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 403, pipe: [1:7561400911259066743:5656]
2025-10-15T10:57:21.562817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:21.562886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400914058770549:5228]
2025-10-15T10:57:21.562902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400914058770549:5228]
2025-10-15T10:57:21.562915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400914058770549:5228]
2025-10-15T10:57:21.563148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:21.563160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:21.563173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:21.563478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:21.563577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:21.563765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:21.563783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:21.563831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400911259066555:2467], now have 1 active actors on pipe
2025-10-15T10:57:21.563854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400911259066711:5739], now have 1 active actors on pipe
2025-10-15T10:57:21.563874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400911259066743:5656], now have 1 active actors on pipe
2025-10-15T10:57:21.563993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400914058770549:5228]
2025-10-15T10:57:21.564016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:21.564086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:21.564169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:21.564189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:21.564281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:21.564326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:21.564344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:21.564355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:21.564394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:21.564437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:21.564503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:21.565712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:21.565744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:21.565815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:21.566109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 404 partition: 0 MaxSeqNo: 46 sessionId: src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0
2025-10-15T10:57:21.566805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5124075a-b0351387-8eec2e15-1cc76456_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:21.633898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0] Write session: try to update token
2025-10-15T10:57:21.633963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:21.677042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:21.677078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:21.677089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:21.677145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:21.677161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:21.677175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:21.677186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:21.677221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400914058770549:5228]
2025-10-15T10:57:21.677249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400914058770549:5228]
2025-10-15T10:57:21.677281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400914058770549:5228]
2025-10-15T10:57:21.677411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:21.677435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:21.677452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:21.677456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:21.677481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:21.678640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:21.770721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId: src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:21.793132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:21.835611Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:21.837784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:21.837829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:21.838994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:21.839034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:21.839997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400911259066743:5656]
2025-10-15T10:57:21.840117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:21.850806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 404 reason: error at write: Disconnected sessionId: src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0
2025-10-15T10:57:21.851100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 404 sessionId: src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0 is DEAD
2025-10-15T10:57:21.856516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:21.856574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0] Write session will restart in 0.008153s
2025-10-15T10:57:21.856708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0] Write session: Do CDS request
2025-10-15T10:57:21.856755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:21.873275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:21.873147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:21.873184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 405
2025-10-15T10:57:21.873940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:21.874060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:21.874077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:21.874086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:21.875453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 405 sessionId:  describe result for acl check
2025-10-15T10:57:21.875561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:21.875571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:21.875581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:21.875598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400911259066849:5753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:21.878755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400911259066849:5753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:21.876650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:21.887512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400911259066849:5753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:21.902258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400911259066849:5753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:21.902313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400911259066849:5753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:21.902333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400911259066849:5753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:21.902368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:21.940575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400911259066986:5656]
2025-10-15T10:57:21.980167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:21.985788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:21.986742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:21.986763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:21.986810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:21.987073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:21.987288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400914058770815:5238]
2025-10-15T10:57:21.989457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:21.990591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:21.990840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:21.992182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:21.992509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.992517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.992525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.992533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.992542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.992550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.992557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.992564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.992573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.992579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.992602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.992612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.992619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.992625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.992677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.992794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.992844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.992904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.992953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.993000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.993044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.993109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.993153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.993196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.993237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.993278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.993317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.993361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.993400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.995175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:21.995262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.995321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:21.995386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.995441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:21.995484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.995535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:21.995582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.995630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:21.995673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.995721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:21.995761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.995811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:21.995848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.995896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:21.995940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.995990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:21.996029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.996077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:21.996117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.996164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:21.996203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.996260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:21.996315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.996362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:21.996410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.996460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:21.997584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:22.020945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:22.030374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:22.030424Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:22.030442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:22.030463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:22.030490Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 404 [2:7561400914058770815:5238]
2025-10-15T10:57:22.030551Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:22.030612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:22.030625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:22.030638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:22.030650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:22.030702Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:22.030726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:22.030761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:22.031732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.031761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.031774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.031786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:22.032096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:22.032129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.032267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.032369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 404, pipe: [1:7561400911259066986:5656]
2025-10-15T10:57:22.032484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 404
2025-10-15T10:57:22.032510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.032523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 404
2025-10-15T10:57:22.032774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:22.032873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400911259066986:5656], now have 1 active actors on pipe
2025-10-15T10:57:22.032902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400911259066835:2467], now have 1 active actors on pipe
2025-10-15T10:57:22.032922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400911259066878:5753], now have 1 active actors on pipe
2025-10-15T10:57:22.032969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:22.032995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:22.033058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400914058770810:5238]
2025-10-15T10:57:22.033077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400914058770810:5238]
2025-10-15T10:57:22.033090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400914058770810:5238]
2025-10-15T10:57:22.033127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:22.033157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:22.033178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:22.033188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:22.033200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:22.033384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:22.033407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:22.033474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc0d7044-274cef3a-418456f7-79539128_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:22.033511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:22.033535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:22.033545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:22.033582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:22.033628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:22.033791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400914058770810:5238]
2025-10-15T10:57:22.033827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:22.033874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:22.033916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:22.034446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:22.034477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:22.034539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:22.035211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 405 partition: 0 MaxSeqNo: 46 sessionId: src_id|fc0d7044-274cef3a-418456f7-79539128_0
2025-10-15T10:57:22.040793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672db99-75581034-a1f8e8c0-a9838d9d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fc0d7044-274cef3a-418456f7-79539128_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:22.092045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d7044-274cef3a-418456f7-79539128_0] Write session: try to update token
2025-10-15T10:57:22.092103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d7044-274cef3a-418456f7-79539128_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:22.176594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:22.176635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:22.176669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400914058770810:5238]
2025-10-15T10:57:22.176789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:22.176811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:22.176823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:22.176943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:22.177226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:22.181350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:22.182928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:22.184123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:22.185570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:22.188224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:22.234124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:22.234277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:22.234292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:22.234305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:22.234314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:22.234351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400914058770810:5238]
2025-10-15T10:57:22.234375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400914058770810:5238]
2025-10-15T10:57:22.234398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400914058770810:5238]
2025-10-15T10:57:22.234524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:22.234553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:22.235460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:22.235509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:22.235533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:22.235648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:22.291315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId: src_id|fc0d7044-274cef3a-418456f7-79539128_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:22.313015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:22.377738Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:22.379132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:22.379172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:22.379804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:22.379902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:22.379904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400911259066986:5656]
2025-10-15T10:57:22.379915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:22.379836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:22.388722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 405 reason: error at write: Disconnected sessionId: src_id|fc0d7044-274cef3a-418456f7-79539128_0
2025-10-15T10:57:22.389026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 405 sessionId: src_id|fc0d7044-274cef3a-418456f7-79539128_0 is DEAD
2025-10-15T10:57:22.389279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d7044-274cef3a-418456f7-79539128_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:22.389307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d7044-274cef3a-418456f7-79539128_0] Write session will restart in 0.006126s
2025-10-15T10:57:22.389382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d7044-274cef3a-418456f7-79539128_0] Write session: Do CDS request
2025-10-15T10:57:22.389410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d7044-274cef3a-418456f7-79539128_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:22.400221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:22.400249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 406
2025-10-15T10:57:22.400497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d7044-274cef3a-418456f7-79539128_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:22.401121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:22.401232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:22.401247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:22.401258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:22.402640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 406 sessionId:  describe result for acl check
2025-10-15T10:57:22.402757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:22.402776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:22.402785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:22.402802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400915554034390:5758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:22.405564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400915554034390:5758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:22.412839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400915554034390:5758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:22.429280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400915554034390:5758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:22.429318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400915554034390:5758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:22.429340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400915554034390:5758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:22.429373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:22.477448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:22.479495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:22.480300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:22.480347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:22.480387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:22.480637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:22.480820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400918353738356:5247]
2025-10-15T10:57:22.483007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:22.483775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400915554034610:5656]
2025-10-15T10:57:22.484014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:22.484237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:22.485503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:22.485807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:22.485816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:22.485824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:22.485831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:22.485840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:22.485847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:22.485854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:22.485861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:22.485868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:22.485875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:22.485882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:22.485890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.485896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.485903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.485951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:22.486070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:22.486124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:22.486177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:22.486253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:22.486304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:22.486354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:22.486400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:22.486447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:22.486499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:22.486547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:22.486595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.486644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.486692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.486737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:22.486808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:22.486869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:22.486929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:22.486980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:22.487037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:22.487086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:22.487143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:22.487192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:22.487247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:22.487297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:22.487373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:22.487423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:22.487481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:22.487529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:22.487581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:22.487632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:22.487690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:22.487736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:22.487792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:22.487843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:22.487896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:22.487942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.487994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.488040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.488094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.488140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.488196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.488744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:22.508152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:22.521236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:22.521286Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:22.521307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:22.521330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:22.521355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 405 [2:7561400918353738356:5247]
2025-10-15T10:57:22.521415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:22.521493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:22.521519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:22.521533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:22.521543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:22.521597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:22.521624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:22.521646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:22.542369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.542396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.542402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.542411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:22.542609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:22.542631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.542730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.542841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.542960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:22.543017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400915554034433:5758], now have 1 active actors on pipe
2025-10-15T10:57:22.543033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 405
2025-10-15T10:57:22.543039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400915554034610:5656], now have 1 active actors on pipe
2025-10-15T10:57:22.543121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 405, pipe: [1:7561400915554034610:5656]
2025-10-15T10:57:22.543052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400915554034381:2467], now have 1 active actors on pipe
2025-10-15T10:57:22.543175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 405
2025-10-15T10:57:22.543071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400918353738351:5247]
2025-10-15T10:57:22.543080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400918353738351:5247]
2025-10-15T10:57:22.543089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400918353738351:5247]
2025-10-15T10:57:22.543110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:22.543160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:22.543169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:22.543186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:22.543198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:22.543304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:22.543315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:22.543562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:22.543584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:22.543631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400918353738351:5247]
2025-10-15T10:57:22.543656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:22.543694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:22.543758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:22.543781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:22.543793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:22.543800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:22.543829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:22.543864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:22.543925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:22.544424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:22.544454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:22.544512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:22.544725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 406 partition: 0 MaxSeqNo: 46 sessionId: src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0
2025-10-15T10:57:22.545335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d7044-274cef3a-418456f7-79539128_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:22.568455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0] Write session: try to update token
2025-10-15T10:57:22.568516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:22.626728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:22.626763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:22.626776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:22.626787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:22.626821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400918353738351:5247]
2025-10-15T10:57:22.626849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400918353738351:5247]
2025-10-15T10:57:22.626873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400918353738351:5247]
2025-10-15T10:57:22.627026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:22.627052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:22.627062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:22.627113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:22.627146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:22.627165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:22.680226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:22.680283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:22.681362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:22.683554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId: src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:22.711488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:22.834473Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:22.841746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:22.841791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:22.841844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400918353738351:5247]
2025-10-15T10:57:22.842021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:22.842062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:22.842084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:22.842725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:22.843146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:22.843186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:22.847616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400915554034610:5656]
2025-10-15T10:57:22.847758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:22.862038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 406 reason: error at write: Disconnected sessionId: src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0
2025-10-15T10:57:22.862419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 406 sessionId: src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0 is DEAD
2025-10-15T10:57:22.867857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:22.867909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0] Write session will restart in 0.008998s
2025-10-15T10:57:22.868028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0] Write session: Do CDS request
2025-10-15T10:57:22.868060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:22.883502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:22.883317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:22.883360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 407
2025-10-15T10:57:22.887852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:22.888006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:22.888023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:22.888034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:22.892624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 407 sessionId:  describe result for acl check
2025-10-15T10:57:22.892746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:22.892762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:22.892771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:22.892788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400915554034657:5763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:22.895517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400915554034657:5763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:22.908925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400915554034657:5763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:22.925747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400915554034657:5763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:22.925793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400915554034657:5763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:22.925808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400915554034657:5763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:22.925839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:22.947447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400915554034872:5656]
2025-10-15T10:57:22.958283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:22.962046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:22.962967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:22.963002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:22.963048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:22.963316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:22.963541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400918353738598:5251]
2025-10-15T10:57:22.965564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:22.966602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:22.966848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:22.968159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:22.968550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:22.968557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:22.968564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:22.968570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:22.968576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:22.968583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:22.968588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:22.968594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:22.968613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:22.968619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:22.968625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:22.968630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.968635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.968641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.968688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:22.968797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:22.968840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:22.968881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:22.968922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:22.968963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:22.968998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:22.969040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:22.969080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:22.969121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:22.969160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:22.969201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.969242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.969271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.969306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:22.969364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:22.969402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:22.969440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:22.969481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:22.969523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:22.969583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:22.969633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:22.969698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:22.969748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:22.969787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:22.969832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:22.969873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:22.969913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:22.969940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:22.969973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:22.970001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:22.970037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:22.970078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:22.970120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:22.970147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:22.970188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:22.970227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.970273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:22.970311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.970356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:22.970389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.970432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:22.970812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:23.002808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:23.013700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:23.013755Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:23.013771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:23.013790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:23.013814Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 406 [2:7561400918353738598:5251]
2025-10-15T10:57:23.013865Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:23.013925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:23.013941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:23.013952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:23.013961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:23.014005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:23.014027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:23.014052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:23.015876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.015903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.015912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.015919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:23.016155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:23.016167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.016261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.016466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.016709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:23.016795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400915554034872:5656], now have 1 active actors on pipe
2025-10-15T10:57:23.016829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400915554034795:5763], now have 1 active actors on pipe
2025-10-15T10:57:23.016858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400915554034642:2467], now have 1 active actors on pipe
2025-10-15T10:57:23.016882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400918353738593:5251]
2025-10-15T10:57:23.016902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400918353738593:5251]
2025-10-15T10:57:23.016910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400918353738593:5251]
2025-10-15T10:57:23.016940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:23.016990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:23.016995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:23.017015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:23.017028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:23.017092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 406, pipe: [1:7561400915554034872:5656]
2025-10-15T10:57:23.017199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 406
2025-10-15T10:57:23.017284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 406
2025-10-15T10:57:23.017146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:23.017171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:23.017299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400918353738593:5251]
2025-10-15T10:57:23.017328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:23.017348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:23.017690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:23.017720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:23.017798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39466312-9cea6b87-5436245b-79347771_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:23.017841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:23.017859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:23.017871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:23.017912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:23.017956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:23.018004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:23.018701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:23.018738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:23.018807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:23.019234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 407 partition: 0 MaxSeqNo: 46 sessionId: src_id|39466312-9cea6b87-5436245b-79347771_0
2025-10-15T10:57:23.020015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b96c4bd-9811834-c0a9adaf-85bf24b7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|39466312-9cea6b87-5436245b-79347771_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:23.047373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39466312-9cea6b87-5436245b-79347771_0] Write session: try to update token
2025-10-15T10:57:23.047434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39466312-9cea6b87-5436245b-79347771_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:23.053678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:23.053723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:23.053764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400918353738593:5251]
2025-10-15T10:57:23.053900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:23.053901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:23.056366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:23.057770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:23.059487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:23.060837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:23.064809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:23.088399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:23.137546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:23.137586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:23.137598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:23.137655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:23.137670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:23.137684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:23.137696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:23.137736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400918353738593:5251]
2025-10-15T10:57:23.137763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400918353738593:5251]
2025-10-15T10:57:23.137787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400918353738593:5251]
2025-10-15T10:57:23.137915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:23.137937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:23.137958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:23.137964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:23.138000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:23.138974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:23.180437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId: src_id|39466312-9cea6b87-5436245b-79347771_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:23.202067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:23.287123Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:23.293656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:23.293709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:23.294450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:23.295233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400915554034872:5656]
2025-10-15T10:57:23.295326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:23.303057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 407 reason: status is not ok: tablet will be restarted right now sessionId: src_id|39466312-9cea6b87-5436245b-79347771_0
2025-10-15T10:57:23.303489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 407 sessionId: src_id|39466312-9cea6b87-5436245b-79347771_0 is DEAD
2025-10-15T10:57:23.303855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39466312-9cea6b87-5436245b-79347771_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:23.303919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39466312-9cea6b87-5436245b-79347771_0] Write session will restart in 0.009151s
2025-10-15T10:57:23.304080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39466312-9cea6b87-5436245b-79347771_0] Write session: Do CDS request
2025-10-15T10:57:23.304114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39466312-9cea6b87-5436245b-79347771_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:23.320896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39466312-9cea6b87-5436245b-79347771_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:23.356984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:23.357160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:23.357185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 408
2025-10-15T10:57:23.358896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:23.359022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:23.359044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:23.359054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:23.360367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 408 sessionId:  describe result for acl check
2025-10-15T10:57:23.360476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:23.360492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:23.360500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:23.360518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400919849002210:5774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:23.363042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400919849002210:5774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:23.373284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400919849002210:5774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:23.393384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400919849002210:5774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:23.393439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400919849002210:5774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:23.393457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400919849002210:5774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:23.393494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:23.395403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400919849002356:5656]
2025-10-15T10:57:23.421907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:23.424301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:23.425071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:23.425099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:23.425135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:23.425349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:23.425529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400922648706147:5259]
2025-10-15T10:57:23.427743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:23.429137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:23.429270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:23.430040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:23.430267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:23.430282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:23.430286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:23.430291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:23.430295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:23.430299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:23.430303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:23.430307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:23.430311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:23.430316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:23.430320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:23.430324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.430328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.430332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.430362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:23.430430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:23.430460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:23.430489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:23.430518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:23.430546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:23.430573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:23.430602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:23.430642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:23.430681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:23.430711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:23.430739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.430766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.430796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.430827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:23.430869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:23.430904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:23.430937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:23.430966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:23.430997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:23.431039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:23.431071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:23.431100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:23.431145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:23.431173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:23.431207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:23.431243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:23.431275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:23.431301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:23.431339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:23.431384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:23.431425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:23.431460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:23.431499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:23.431539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:23.431581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:23.431613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.431661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.431695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.431728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.431755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.431791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.432128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:23.452242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:23.461935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:23.461977Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:23.461989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:23.462002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:23.462020Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 407 [2:7561400922648706147:5259]
2025-10-15T10:57:23.462054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:23.462098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:23.462109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:23.462118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:23.462129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:23.462169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:23.462188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:23.462208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:23.482566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.482595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.482606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.482616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:23.482841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:23.482862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.482968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.483096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.483256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:23.483327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400919849002356:5656], now have 1 active actors on pipe
2025-10-15T10:57:23.483434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400919849002347:5774], now have 1 active actors on pipe
2025-10-15T10:57:23.483461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400919849002206:2467], now have 1 active actors on pipe
2025-10-15T10:57:23.483482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400922648706142:5259]
2025-10-15T10:57:23.483493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400922648706142:5259]
2025-10-15T10:57:23.483504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400922648706142:5259]
2025-10-15T10:57:23.483534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:23.483582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:23.483596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:23.483614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:23.483625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:23.483756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:23.483776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:23.483878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400922648706142:5259]
2025-10-15T10:57:23.483904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:23.483936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:23.484729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 407, pipe: [1:7561400919849002356:5656]
2025-10-15T10:57:23.484797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 407
2025-10-15T10:57:23.484839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 407
2025-10-15T10:57:23.485102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:23.485131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:23.485199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cefe196-bfd93741-c92401e0-325eada9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:23.485242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:23.485257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:23.485264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:23.485287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:23.485315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:23.485344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:23.486624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:23.486646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:23.486704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:23.487011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 408 partition: 0 MaxSeqNo: 46 sessionId: src_id|3cefe196-bfd93741-c92401e0-325eada9_0
2025-10-15T10:57:23.487785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39466312-9cea6b87-5436245b-79347771_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3cefe196-bfd93741-c92401e0-325eada9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:23.529566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:23.529600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:23.529644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400922648706142:5259]
2025-10-15T10:57:23.529768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:23.529808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:23.532225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cefe196-bfd93741-c92401e0-325eada9_0] Write session: try to update token
2025-10-15T10:57:23.532302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cefe196-bfd93741-c92401e0-325eada9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:23.532850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:23.534912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:23.536759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:23.540196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:23.542233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:23.542908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:23.562339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:23.562373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:23.562386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:23.631220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:23.631251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:23.631264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:23.631274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:23.631308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400922648706142:5259]
2025-10-15T10:57:23.631332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400922648706142:5259]
2025-10-15T10:57:23.631367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400922648706142:5259]
2025-10-15T10:57:23.631496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:23.631500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:23.631521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:23.631526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:23.631555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:23.632578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:23.702087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId: src_id|3cefe196-bfd93741-c92401e0-325eada9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:23.724216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:23.797231Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:23.798682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:23.798710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:23.799451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:23.799496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400919849002356:5656]
2025-10-15T10:57:23.799594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:23.799605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:23.803469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:23.813698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 408 reason: error at write: Disconnected sessionId: src_id|3cefe196-bfd93741-c92401e0-325eada9_0
2025-10-15T10:57:23.813993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 408 sessionId: src_id|3cefe196-bfd93741-c92401e0-325eada9_0 is DEAD
2025-10-15T10:57:23.815774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cefe196-bfd93741-c92401e0-325eada9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:23.815848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cefe196-bfd93741-c92401e0-325eada9_0] Write session will restart in 0.007638s
2025-10-15T10:57:23.816048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cefe196-bfd93741-c92401e0-325eada9_0] Write session: Do CDS request
2025-10-15T10:57:23.816104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cefe196-bfd93741-c92401e0-325eada9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:23.829911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cefe196-bfd93741-c92401e0-325eada9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:23.833180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:23.833210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 409
2025-10-15T10:57:23.833636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:23.833730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:23.833743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:23.833753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:23.834988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 409 sessionId:  describe result for acl check
2025-10-15T10:57:23.835083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:23.835093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:23.835101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:23.835115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400919849002478:5782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:23.837330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400919849002478:5782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:23.847767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400919849002478:5782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:23.868340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400919849002478:5782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:23.868383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400919849002478:5782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:23.868400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400919849002478:5782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:23.868432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:23.900204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400919849002693:5656]
2025-10-15T10:57:23.900961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:23.908089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:23.909083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:23.909106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:23.909152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:23.909420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:23.909597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400922648706416:5270]
2025-10-15T10:57:23.911935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:23.915508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:23.915780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:23.917231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:23.917589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:23.917605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:23.917613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:23.917620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:23.917628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:23.917635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:23.917643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:23.917651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:23.917658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:23.917667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:23.917675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:23.917684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.917691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.917699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.917750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:23.917877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:23.917929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:23.917984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:23.918035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:23.918082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:23.918139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:23.918189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:23.918241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:23.918297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:23.918355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:23.918409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.918460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.918513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.918568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:23.918639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:23.918707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:23.918773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:23.918830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:23.918892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:23.918947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:23.919014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:23.919069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:23.919127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:23.919180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:23.919240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:23.919296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:23.919616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:23.919674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:23.919734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:23.919785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:23.919843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:23.919908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:23.919968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:23.920018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:23.920076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:23.920122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.920179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.920228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.920285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.920340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.920398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.920954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:23.936810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:23.945820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:23.945869Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:23.945890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:23.945912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:23.945943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 408 [2:7561400922648706416:5270]
2025-10-15T10:57:23.945999Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:23.946066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:23.946082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:23.946095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:23.946107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:23.946151Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:23.946169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:23.946187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:23.947035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.947046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.947057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.947065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:23.947305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:23.947322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:23.947897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:23.948097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:23.948315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:23.948389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400919849002693:5656], now have 1 active actors on pipe
2025-10-15T10:57:23.948416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400919849002462:2467], now have 1 active actors on pipe
2025-10-15T10:57:23.948436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400919849002584:5782], now have 1 active actors on pipe
2025-10-15T10:57:23.948488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:23.948510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:23.948563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400922648706410:5270]
2025-10-15T10:57:23.948577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400922648706410:5270]
2025-10-15T10:57:23.948590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400922648706410:5270]
2025-10-15T10:57:23.948630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:23.948672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:23.948689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:23.948701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:23.948707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:23.948892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:23.948910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:23.948975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e71c1eda-82907984-13f80b3a-b0962442_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:23.949004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:23.949022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:23.949033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:23.949067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:23.949110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:23.949240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400922648706410:5270]
2025-10-15T10:57:23.949270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:23.949300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:23.949318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:23.949850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:23.949870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:23.949938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:23.947609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 408
2025-10-15T10:57:23.947615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 408, pipe: [1:7561400919849002693:5656]
2025-10-15T10:57:23.947723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 408
2025-10-15T10:57:23.950424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 409 partition: 0 MaxSeqNo: 46 sessionId: src_id|e71c1eda-82907984-13f80b3a-b0962442_0
2025-10-15T10:57:23.951338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cefe196-bfd93741-c92401e0-325eada9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e71c1eda-82907984-13f80b3a-b0962442_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:23.973448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e71c1eda-82907984-13f80b3a-b0962442_0] Write session: try to update token
2025-10-15T10:57:23.973514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e71c1eda-82907984-13f80b3a-b0962442_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:24.057734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId: src_id|e71c1eda-82907984-13f80b3a-b0962442_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:24.062385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:24.062420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:24.062436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:24.062450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:24.062488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400922648706410:5270]
2025-10-15T10:57:24.062519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400922648706410:5270]
2025-10-15T10:57:24.062544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400922648706410:5270]
2025-10-15T10:57:24.062777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:24.062798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:24.062810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:24.062863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:24.062908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:24.063267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:24.063308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:24.063362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:24.064051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:24.087027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:24.208228Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:24.225082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:24.225142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:24.225223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:24.225238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:24.225286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400922648706410:5270]
2025-10-15T10:57:24.225814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:24.225887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:24.225948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:24.225977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:24.226164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400919849002693:5656]
2025-10-15T10:57:24.226319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:24.237260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 409 reason: error at write: Disconnected sessionId: src_id|e71c1eda-82907984-13f80b3a-b0962442_0
2025-10-15T10:57:24.237607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 409 sessionId: src_id|e71c1eda-82907984-13f80b3a-b0962442_0 is DEAD
2025-10-15T10:57:24.237871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71c1eda-82907984-13f80b3a-b0962442_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:24.237908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71c1eda-82907984-13f80b3a-b0962442_0] Write session will restart in 0.005256s
2025-10-15T10:57:24.238000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71c1eda-82907984-13f80b3a-b0962442_0] Write session: Do CDS request
2025-10-15T10:57:24.238033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71c1eda-82907984-13f80b3a-b0962442_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:24.253000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e71c1eda-82907984-13f80b3a-b0962442_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:24.253545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:24.253575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 410
2025-10-15T10:57:24.253826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:24.253969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:24.253992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:24.254003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:24.255222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 410 sessionId:  describe result for acl check
2025-10-15T10:57:24.255306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:24.255313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:24.255321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:24.255333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400924143970023:5788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:24.258258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400924143970023:5788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:24.266634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400924143970023:5788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:24.275259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400924143970023:5788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:24.275297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400924143970023:5788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:24.275314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400924143970023:5788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:24.275341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:24.320508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:24.326227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400924143970242:5656]
2025-10-15T10:57:24.326275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:24.327089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:24.327120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:24.327161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:24.327430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:24.327636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400926943673951:5272]
2025-10-15T10:57:24.329771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:24.330599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:24.330802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:24.332030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:24.332354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:24.332387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:24.332396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:24.332404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:24.332410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:24.332417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:24.332424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:24.332430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:24.332436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:24.332442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:24.332449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:24.332456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.332463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.332470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.332517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:24.332622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:24.332667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:24.332712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:24.332754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:24.332804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:24.332856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:24.332904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:24.332952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:24.333001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:24.333053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:24.333099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.333150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.333199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.333248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:24.333320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:24.333378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:24.333436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:24.333485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:24.333539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:24.333587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:24.333642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:24.333690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:24.333745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:24.333795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:24.333849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:24.333902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:24.333963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:24.334013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:24.334071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:24.334122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:24.334179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:24.334227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:24.334286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:24.334340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:24.334397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:24.334449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.334507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.334558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.334615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.334667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.334720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.335211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:24.351206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:24.361211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:24.361252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:24.361269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:24.361286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:24.361309Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 409 [2:7561400926943673951:5272]
2025-10-15T10:57:24.361359Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:24.361412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:24.361427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:24.361439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:24.361450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:24.361494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:24.363498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 409, pipe: [1:7561400924143970242:5656]
2025-10-15T10:57:24.361514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:24.363591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 409
2025-10-15T10:57:24.361535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:24.362922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.363596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 409
2025-10-15T10:57:24.362937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.362950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.362961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:24.363222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:24.363238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.363391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.363575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.363797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:24.363869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400924143970242:5656], now have 1 active actors on pipe
2025-10-15T10:57:24.363904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400924143970062:5788], now have 1 active actors on pipe
2025-10-15T10:57:24.363923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400924143970009:2467], now have 1 active actors on pipe
2025-10-15T10:57:24.363968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:24.363994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:24.364046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400926943673945:5272]
2025-10-15T10:57:24.364066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400926943673945:5272]
2025-10-15T10:57:24.364078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400926943673945:5272]
2025-10-15T10:57:24.364111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:24.364148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:24.364169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:24.364179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:24.364182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:24.364353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:24.364374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:24.364446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97ac3691-8437805e-4d057102-266457f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:24.364479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:24.364498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:24.364508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:24.364540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:24.364591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:24.364709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400926943673945:5272]
2025-10-15T10:57:24.364738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:24.364780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:24.364836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:24.365213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:24.365237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:24.365291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:24.365507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 410 partition: 0 MaxSeqNo: 46 sessionId: src_id|97ac3691-8437805e-4d057102-266457f0_0
2025-10-15T10:57:24.366282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e71c1eda-82907984-13f80b3a-b0962442_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|97ac3691-8437805e-4d057102-266457f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:24.387073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac3691-8437805e-4d057102-266457f0_0] Write session: try to update token
2025-10-15T10:57:24.387137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac3691-8437805e-4d057102-266457f0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:24.426291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:24.426327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:24.426366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400926943673945:5272]
2025-10-15T10:57:24.426507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:24.426511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:24.428347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:24.431808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:24.438225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:24.447055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:24.453295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:24.453824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:24.463769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:24.463803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:24.463823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:24.538491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:24.538520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:24.538533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:24.538545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:24.538586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400926943673945:5272]
2025-10-15T10:57:24.538612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400926943673945:5272]
2025-10-15T10:57:24.538641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400926943673945:5272]
2025-10-15T10:57:24.538821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:24.538856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:24.540045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:24.540373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:24.540438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:24.540484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:24.550042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId: src_id|97ac3691-8437805e-4d057102-266457f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:24.570265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:24.688978Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:24.692361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:24.692400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:24.693202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:24.696835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400924143970242:5656]
2025-10-15T10:57:24.696999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:24.711515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 410 reason: status is not ok: tablet will be restarted right now sessionId: src_id|97ac3691-8437805e-4d057102-266457f0_0
2025-10-15T10:57:24.711798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 410 sessionId: src_id|97ac3691-8437805e-4d057102-266457f0_0 is DEAD
2025-10-15T10:57:24.716128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac3691-8437805e-4d057102-266457f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:24.716190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac3691-8437805e-4d057102-266457f0_0] Write session will restart in 0.005780s
2025-10-15T10:57:24.716326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac3691-8437805e-4d057102-266457f0_0] Write session: Do CDS request
2025-10-15T10:57:24.716372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac3691-8437805e-4d057102-266457f0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:24.732453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:24.733605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:24.733636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 411
2025-10-15T10:57:24.733867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac3691-8437805e-4d057102-266457f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:24.734518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:24.734643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:24.734666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:24.734677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:24.736097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 411 sessionId:  describe result for acl check
2025-10-15T10:57:24.736210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:24.736226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:24.736234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:24.736251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400924143970292:5800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:24.740111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400924143970292:5800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:24.747164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400924143970292:5800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:24.756440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400924143970292:5800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:24.756477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400924143970292:5800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:24.756493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400924143970292:5800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:24.756521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:24.799054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400924143970444:5656]
2025-10-15T10:57:24.827220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:24.829939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:24.830666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:24.830697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:24.830736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:24.830961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:24.831140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400926943674217:5282]
2025-10-15T10:57:24.833399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:24.834439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:24.834684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:24.835888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:24.836194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:24.836202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:24.836209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:24.836216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:24.836222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:24.836229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:24.836236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:24.836244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:24.836258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:24.836269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:24.836276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:24.836283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.836290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.836297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.836357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:24.836458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:24.836504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:24.836549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:24.836591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:24.836633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:24.836679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:24.836722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:24.836763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:24.836811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:24.836855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:24.836900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.836943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.836987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.837031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:24.837101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:24.837155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:24.837211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:24.837256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:24.837309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:24.837362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:24.837421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:24.837477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:24.837533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:24.837582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:24.837633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:24.837679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:24.837728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:24.837771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:24.837824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:24.837871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:24.837921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:24.837968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:24.838020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:24.838063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:24.838113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:24.839284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.839363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.839410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.839463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.839505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.839553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.840033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:24.860742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:24.871386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:24.871428Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:24.871445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:24.871462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:24.871485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 410 [2:7561400926943674217:5282]
2025-10-15T10:57:24.871533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:24.871587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:24.871601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:24.871613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:24.871623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:24.871668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:24.871688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:24.871709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:24.887975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.888003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.888015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.888025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:24.888281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:24.888296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:24.888437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:24.888605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:24.888812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:24.888874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400926943674212:5282]
2025-10-15T10:57:24.888889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400926943674212:5282]
2025-10-15T10:57:24.888900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400926943674212:5282]
2025-10-15T10:57:24.888939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:24.889003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:24.889170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:24.889185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:24.889288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400926943674212:5282]
2025-10-15T10:57:24.889306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:24.889610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:24.889623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:24.889633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:24.889655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:24.890031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400924143970322:5800], now have 1 active actors on pipe
2025-10-15T10:57:24.890061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400924143970288:2467], now have 1 active actors on pipe
2025-10-15T10:57:24.890689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400924143970444:5656], now have 1 active actors on pipe
2025-10-15T10:57:24.890555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 410
2025-10-15T10:57:24.890640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 410
2025-10-15T10:57:24.890710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 410, pipe: [1:7561400924143970444:5656]
2025-10-15T10:57:24.891932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:24.891962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:24.892044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:24.892080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:24.892097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:24.892107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:24.892140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:24.892193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:24.892239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:24.893590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:24.893623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:24.893687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:24.893985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 411 partition: 0 MaxSeqNo: 46 sessionId: src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0
2025-10-15T10:57:24.895030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ac3691-8437805e-4d057102-266457f0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:24.926141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0] Write session: try to update token
2025-10-15T10:57:24.926188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:25.014236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:25.014299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:25.014332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:25.014355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:25.014422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400926943674212:5282]
2025-10-15T10:57:25.014471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400926943674212:5282]
2025-10-15T10:57:25.014524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400926943674212:5282]
2025-10-15T10:57:25.014915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:25.014964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:25.014991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:25.015090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:25.015114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:25.016860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:25.016905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:25.016935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:25.018102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:25.027200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId: src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:25.052368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:25.161008Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:25.177085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:25.177132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:25.177206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:25.177222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:25.177265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400926943674212:5282]
2025-10-15T10:57:25.177694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:25.178323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400924143970444:5656]
2025-10-15T10:57:25.178459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:25.178485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:25.178777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:25.178346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:25.187425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 411 reason: error at write: Disconnected sessionId: src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0
2025-10-15T10:57:25.187810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 411 sessionId: src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0 is DEAD
2025-10-15T10:57:25.191059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:25.191150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0] Write session will restart in 0.006749s
2025-10-15T10:57:25.191393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0] Write session: Do CDS request
2025-10-15T10:57:25.191454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:25.206645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:25.206681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 412
2025-10-15T10:57:25.207059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:25.207687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:25.207812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:25.207828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:25.207836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:25.213776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 412 sessionId:  describe result for acl check
2025-10-15T10:57:25.213881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:25.213891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:25.213900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:25.213917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400928438937857:5807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:25.216313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400928438937857:5807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:25.226305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400928438937857:5807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:25.234345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400928438937857:5807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:25.234400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400928438937857:5807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:25.234434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400928438937857:5807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:25.234480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:25.278231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400928438938067:5656]
2025-10-15T10:57:25.296189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:25.297982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:25.299490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:25.299514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:25.299554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:25.299809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:25.299998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400931238641778:5291]
2025-10-15T10:57:25.302287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:25.303084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:25.303245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:25.304514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:25.304795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:25.304810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:25.304817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:25.304823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:25.304830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:25.304836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:25.304842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:25.304848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:25.304855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:25.304861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:25.304866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:25.304872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.304878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.304884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.304926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:25.305028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:25.305074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:25.305118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:25.305164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:25.305208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:25.305253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:25.305295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:25.305338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:25.305383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:25.305427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:25.305468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.305512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.305593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.305628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:25.305690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:25.305743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:25.305796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:25.305840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:25.305890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:25.305934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:25.305985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:25.306030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:25.306079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:25.306118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:25.306167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:25.306211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:25.306261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:25.306310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:25.306359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:25.306407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:25.306457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:25.306500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:25.306553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:25.306594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:25.306644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:25.306688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.306739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.306786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.306834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.306872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.306919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.307412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:25.326404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:25.337687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 411, pipe: [1:7561400928438938067:5656]
2025-10-15T10:57:25.337768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 411
2025-10-15T10:57:25.337832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 411
2025-10-15T10:57:25.335803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:25.335836Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:25.335852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:25.335871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:25.335893Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 411 [2:7561400931238641778:5291]
2025-10-15T10:57:25.335942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:25.335995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:25.336008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:25.336019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:25.336032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:25.336073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:25.336094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:25.336114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:25.337069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.337085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.337100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.337111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:25.337361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:25.337376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.337504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.337679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.337901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:25.337964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400928438938067:5656], now have 1 active actors on pipe
2025-10-15T10:57:25.337985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400928438937895:5807], now have 1 active actors on pipe
2025-10-15T10:57:25.338008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400928438937842:2467], now have 1 active actors on pipe
2025-10-15T10:57:25.338028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400931238641773:5291]
2025-10-15T10:57:25.338041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400931238641773:5291]
2025-10-15T10:57:25.338054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400931238641773:5291]
2025-10-15T10:57:25.338089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:25.338115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:25.338129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:25.338139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:25.338151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:25.338309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:25.338324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:25.338460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:25.338478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:25.338503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400931238641773:5291]
2025-10-15T10:57:25.338527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:25.338546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:25.338616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|809a3e7-da804879-e15f1855-edb22f3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:25.338642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:25.338659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:25.338667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:25.338697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:25.338726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:25.338790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:25.343379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:25.343417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:25.343487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:25.344484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 412 partition: 0 MaxSeqNo: 46 sessionId: src_id|809a3e7-da804879-e15f1855-edb22f3a_0
2025-10-15T10:57:25.345244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1eab23f1-d909a34f-e6f193a9-8dc2bdea_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|809a3e7-da804879-e15f1855-edb22f3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:25.370802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|809a3e7-da804879-e15f1855-edb22f3a_0] Write session: try to update token
2025-10-15T10:57:25.370869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|809a3e7-da804879-e15f1855-edb22f3a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:25.428219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:25.428270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:25.428289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:25.428318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:25.428378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400931238641773:5291]
2025-10-15T10:57:25.428422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400931238641773:5291]
2025-10-15T10:57:25.428461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400931238641773:5291]
2025-10-15T10:57:25.428618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:25.428674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:25.428709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:25.474464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:25.474504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:25.474797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId: src_id|809a3e7-da804879-e15f1855-edb22f3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:25.475738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:25.499386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:25.615064Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:25.619918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:25.619948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:25.619988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400931238641773:5291]
2025-10-15T10:57:25.620141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:25.620166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:25.620388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:25.620956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:25.625667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400928438938067:5656]
2025-10-15T10:57:25.625850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:25.626750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:25.635365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|809a3e7-da804879-e15f1855-edb22f3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:25.635402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|809a3e7-da804879-e15f1855-edb22f3a_0] Write session will restart in 0.006041s
2025-10-15T10:57:25.634568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 412 reason: status is not ok: tablet will be restarted right now sessionId: src_id|809a3e7-da804879-e15f1855-edb22f3a_0
2025-10-15T10:57:25.634919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 412 sessionId: src_id|809a3e7-da804879-e15f1855-edb22f3a_0 is DEAD
2025-10-15T10:57:25.635516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|809a3e7-da804879-e15f1855-edb22f3a_0] Write session: Do CDS request
2025-10-15T10:57:25.635567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|809a3e7-da804879-e15f1855-edb22f3a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:25.647137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|809a3e7-da804879-e15f1855-edb22f3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:25.647140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:25.647173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 413
2025-10-15T10:57:25.647786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:25.647923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:25.647946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:25.647961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:25.649532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 413 sessionId:  describe result for acl check
2025-10-15T10:57:25.649630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:25.649641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:25.649651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:25.649669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400928438938101:5812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:25.654976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400928438938101:5812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:25.661391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400928438938101:5812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:25.668978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400928438938101:5812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:25.669017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400928438938101:5812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:25.669035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400928438938101:5812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:25.669067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:25.726577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400928438938333:5656]
2025-10-15T10:57:25.738477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:25.747979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:25.748929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:25.748955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:25.748998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:25.749270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:25.749488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400931238642035:5294]
2025-10-15T10:57:25.751849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:25.752878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:25.753120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:25.754458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:25.754816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:25.754832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:25.754840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:25.754848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:25.754855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:25.754863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:25.754871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:25.754878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:25.754885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:25.754892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:25.754898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:25.754907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.754914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.754922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.754973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:25.755094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:25.755145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:25.755198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:25.755239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:25.755288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:25.755328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:25.755393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:25.755446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:25.755509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:25.755559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:25.755604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.755658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.755711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.755760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:25.755837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:25.755904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:25.755965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:25.756021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:25.756085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:25.756141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:25.756198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:25.756260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:25.756316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:25.756379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:25.756435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:25.756494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:25.756551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:25.756605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:25.756661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:25.756718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:25.756783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:25.756834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:25.756896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:25.756946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:25.757034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:25.757085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.757148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.757199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.757256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.757303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.757358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.757858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:25.776530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:25.786159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:25.786202Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:25.786215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:25.786247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:25.786276Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 412 [2:7561400931238642035:5294]
2025-10-15T10:57:25.786334Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:25.786403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:25.786419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:25.786432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:25.786444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:25.786499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:25.786522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:25.786546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:25.787563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.787591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.787607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.787618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:25.787901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:25.787926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:25.788319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 412
2025-10-15T10:57:25.788423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 412
2025-10-15T10:57:25.788497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 412, pipe: [1:7561400928438938333:5656]
2025-10-15T10:57:25.788072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:25.788281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:25.788541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:25.788625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400928438938135:5812], now have 1 active actors on pipe
2025-10-15T10:57:25.788647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400928438938092:2467], now have 1 active actors on pipe
2025-10-15T10:57:25.788671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400928438938333:5656], now have 1 active actors on pipe
2025-10-15T10:57:25.788696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400931238642028:5294]
2025-10-15T10:57:25.788711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400931238642028:5294]
2025-10-15T10:57:25.788727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400931238642028:5294]
2025-10-15T10:57:25.788767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:25.788845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:25.788845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:25.788864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:25.788878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:25.789030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:25.789047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:25.789201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:25.789220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:25.789265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400931238642028:5294]
2025-10-15T10:57:25.789292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:25.789333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:25.789401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91b518e4-3b31774b-aea663a2-87918b9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:25.789433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:25.789450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:25.789460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:25.789498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:25.789536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:25.789623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:25.790002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:25.790023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:25.790101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:25.790761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 413 partition: 0 MaxSeqNo: 46 sessionId: src_id|91b518e4-3b31774b-aea663a2-87918b9a_0
2025-10-15T10:57:25.791560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|809a3e7-da804879-e15f1855-edb22f3a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|91b518e4-3b31774b-aea663a2-87918b9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:25.813092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91b518e4-3b31774b-aea663a2-87918b9a_0] Write session: try to update token
2025-10-15T10:57:25.813151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91b518e4-3b31774b-aea663a2-87918b9a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:25.850922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:25.850944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:25.850953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:25.850962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:25.850985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400931238642028:5294]
2025-10-15T10:57:25.851002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400931238642028:5294]
2025-10-15T10:57:25.851017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400931238642028:5294]
2025-10-15T10:57:25.851205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:25.851227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:25.851221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:25.851285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:25.851317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:25.861036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:25.901652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId: src_id|91b518e4-3b31774b-aea663a2-87918b9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:25.921924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:26.011927Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:26.030923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:26.030967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:26.031025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:26.031039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:26.031079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400931238642028:5294]
2025-10-15T10:57:26.031421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:26.032045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:26.034149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:26.058729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 413 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91b518e4-3b31774b-aea663a2-87918b9a_0
2025-10-15T10:57:26.059034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 413 sessionId: src_id|91b518e4-3b31774b-aea663a2-87918b9a_0 is DEAD
2025-10-15T10:57:26.067581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b518e4-3b31774b-aea663a2-87918b9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:26.067627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b518e4-3b31774b-aea663a2-87918b9a_0] Write session will restart in 0.007589s
2025-10-15T10:57:26.067742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b518e4-3b31774b-aea663a2-87918b9a_0] Write session: Do CDS request
2025-10-15T10:57:26.067773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b518e4-3b31774b-aea663a2-87918b9a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:26.082489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:26.082630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400928438938333:5656]
2025-10-15T10:57:26.084387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:26.084406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 414
2025-10-15T10:57:26.085052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91b518e4-3b31774b-aea663a2-87918b9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:26.087760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:26.087890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:26.087904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:26.087914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:26.089313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 414 sessionId:  describe result for acl check
2025-10-15T10:57:26.089401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:26.089411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:26.089428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:26.089443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400932733905680:5823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:26.091519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400932733905680:5823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:26.100724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400932733905680:5823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:26.122146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400932733905680:5823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:26.122183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400932733905680:5823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:26.122199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400932733905680:5823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:26.122228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:26.166355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:26.169042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:26.169882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:26.169896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:26.169928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:26.170389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:26.170532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400935533609585:5303]
2025-10-15T10:57:26.172178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:26.173040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:26.173237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:26.174363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:26.174650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:26.174659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:26.174666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:26.174675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:26.174683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:26.174689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:26.174696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:26.174702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:26.174709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:26.174716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:26.174723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:26.174730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.174736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.174743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.174789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:26.174886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:26.174922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:26.174969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:26.175008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:26.175043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:26.175076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:26.175112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:26.175144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:26.175177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:26.175217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:26.175250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.175282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.175320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.175375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:26.175442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:26.175500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:26.175555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:26.175606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:26.175659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:26.175707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:26.175761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:26.175809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:26.175865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:26.175909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:26.175963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:26.176011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:26.176063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:26.176106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:26.176157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:26.176204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:26.176269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:26.176314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:26.176353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:26.176418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:26.176475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:26.176529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.176574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.176612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.176654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.176691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.176732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.177207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:26.183229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400932733905905:5656]
2025-10-15T10:57:26.206479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:26.215915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:26.215949Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:26.215960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:26.215974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:26.215992Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 413 [2:7561400935533609585:5303]
2025-10-15T10:57:26.216027Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:26.216071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:26.216083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:26.216092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:26.216100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:26.216136Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:26.216154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:26.216173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:26.217756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.217775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.217785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.217792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:26.217982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:26.217999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.218092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.218212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.218362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:26.218410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400935533609580:5303]
2025-10-15T10:57:26.218423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400935533609580:5303]
2025-10-15T10:57:26.218432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400935533609580:5303]
2025-10-15T10:57:26.218458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:26.218507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:26.218627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:26.218642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:26.218734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400935533609580:5303]
2025-10-15T10:57:26.218750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:26.218923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:26.218935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:26.218943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:26.218957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:26.219563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400932733905905:5656], now have 1 active actors on pipe
2025-10-15T10:57:26.219596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400932733905676:2467], now have 1 active actors on pipe
2025-10-15T10:57:26.219619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400932733905781:5823], now have 1 active actors on pipe
2025-10-15T10:57:26.220406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 413
2025-10-15T10:57:26.220482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 413, pipe: [1:7561400932733905905:5656]
2025-10-15T10:57:26.220555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 413
2025-10-15T10:57:26.221209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:26.221239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:26.221310Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:26.221349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:26.221365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:26.221373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:26.221406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:26.221444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:26.221497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:26.222981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 414 partition: 0 MaxSeqNo: 46 sessionId: src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0
2025-10-15T10:57:26.224589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91b518e4-3b31774b-aea663a2-87918b9a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:26.222643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:26.222674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:26.222733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:26.246656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0] Write session: try to update token
2025-10-15T10:57:26.246710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:26.252486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:26.252515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:26.252555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400935533609580:5303]
2025-10-15T10:57:26.252669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:26.252794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:26.265795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:26.268106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:26.269525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:26.270842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:26.272868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:26.273387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:26.341054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:26.341081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:26.341092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:26.341143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:26.341156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:26.341170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:26.341180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:26.341218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400935533609580:5303]
2025-10-15T10:57:26.341245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400935533609580:5303]
2025-10-15T10:57:26.341266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400935533609580:5303]
2025-10-15T10:57:26.341401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:26.341429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:26.342466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:26.344261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:26.344308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:26.344340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:26.364735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId: src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:26.393211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:26.483266Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:26.484826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:26.484867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:26.485972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:26.487304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:26.487672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400932733905905:5656]
2025-10-15T10:57:26.487733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:26.487759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:26.496804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 414 reason: error at write: Disconnected sessionId: src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0
2025-10-15T10:57:26.497108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 414 sessionId: src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0 is DEAD
2025-10-15T10:57:26.499578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:26.499624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0] Write session will restart in 0.006708s
2025-10-15T10:57:26.499731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0] Write session: Do CDS request
2025-10-15T10:57:26.499765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:26.511633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:26.511480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:26.511510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 415
2025-10-15T10:57:26.512222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:26.512346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:26.512362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:26.512383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:26.513665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 415 sessionId:  describe result for acl check
2025-10-15T10:57:26.513775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:26.513785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:26.513794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:26.513809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400932733905942:5831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:26.516074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400932733905942:5831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:26.541566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400932733905942:5831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:26.567893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400932733905942:5831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:26.567935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400932733905942:5831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:26.567950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400932733905942:5831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:26.567977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:26.587782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400932733906093:5656]
2025-10-15T10:57:26.619647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:26.632676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:26.633623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:26.633646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:26.633756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:26.633997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:26.634132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400935533609866:5312]
2025-10-15T10:57:26.636064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:26.641420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:26.641735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:26.643278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:26.643681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:26.643699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:26.643706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:26.643714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:26.643722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:26.643729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:26.643735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:26.643742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:26.643751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:26.643759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:26.643765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:26.643772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.643779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.643787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.643842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:26.643968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:26.644025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:26.644077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:26.644136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:26.644194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:26.644247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:26.644301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:26.644357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:26.644432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:26.644487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:26.644634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.644704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.644760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.644817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:26.644900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:26.644973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:26.645036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:26.645095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:26.645159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:26.645208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:26.645274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:26.645333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:26.645397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:26.645449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:26.645516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:26.645573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:26.645634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:26.645703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:26.645763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:26.645820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:26.645883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:26.645931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:26.645994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:26.646045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:26.646104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:26.646157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.646213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.646263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.646320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.646369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.646421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.646974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:26.721884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:26.733338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:26.733392Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:26.733413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:26.733434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:26.733462Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 414 [2:7561400935533609866:5312]
2025-10-15T10:57:26.733519Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:26.733586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:26.733602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:26.733616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:26.733629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:26.733682Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:26.733707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:26.733749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:26.734816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.734840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.734856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.734868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:26.735144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:26.735171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:26.735530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 414
2025-10-15T10:57:26.735618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 414, pipe: [1:7561400932733906093:5656]
2025-10-15T10:57:26.735701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 414
2025-10-15T10:57:26.735330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:26.735561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:26.735810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:26.735900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400932733906043:5831], now have 1 active actors on pipe
2025-10-15T10:57:26.735927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400932733905928:2467], now have 1 active actors on pipe
2025-10-15T10:57:26.735951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400932733906093:5656], now have 1 active actors on pipe
2025-10-15T10:57:26.736002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:26.736024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:26.736062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400935533609861:5312]
2025-10-15T10:57:26.736078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400935533609861:5312]
2025-10-15T10:57:26.736093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400935533609861:5312]
2025-10-15T10:57:26.736162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:26.736204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:26.736221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:26.736234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:26.736265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:26.736470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:26.736487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:26.736553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:26.736584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:26.736601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:26.736613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:26.736650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:26.736697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:26.736835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400935533609861:5312]
2025-10-15T10:57:26.736868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:26.736912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:26.736928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:26.737550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:26.737576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:26.737646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:26.737917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 415 partition: 0 MaxSeqNo: 46 sessionId: src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0
2025-10-15T10:57:26.738690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8912354f-323b04e1-9aac7dd7-9166d3db_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:26.770479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0] Write session: try to update token
2025-10-15T10:57:26.770534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:26.851478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:26.851512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:26.851558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400935533609861:5312]
2025-10-15T10:57:26.851665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:26.851677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:26.851690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:26.851751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:26.853682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:26.855458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:26.856466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:26.858139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:26.859365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:26.860943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:26.883986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:26.918557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:26.918588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:26.918604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:26.918616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:26.918658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400935533609861:5312]
2025-10-15T10:57:26.918687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400935533609861:5312]
2025-10-15T10:57:26.918713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400935533609861:5312]
2025-10-15T10:57:26.918852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:26.918883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:26.919483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:26.919545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:26.919608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:26.922746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:26.961876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId: src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:26.983629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:27.079307Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:27.081422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:27.081462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:27.084105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:27.085523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:27.085847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400932733906093:5656]
2025-10-15T10:57:27.086162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:27.096894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 415 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0
2025-10-15T10:57:27.097259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 415 sessionId: src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0 is DEAD
2025-10-15T10:57:27.099802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:27.099845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0] Write session will restart in 0.007635s
2025-10-15T10:57:27.099960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0] Write session: Do CDS request
2025-10-15T10:57:27.099995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:27.116271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:27.116300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 416
2025-10-15T10:57:27.119783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:27.123684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:27.123975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:27.124012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:27.124039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:27.125916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 416 sessionId:  describe result for acl check
2025-10-15T10:57:27.126036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:27.126052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:27.126062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:27.126080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400937028873512:5836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:27.130435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400937028873512:5836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:27.149261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400937028873512:5836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:27.173749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400937028873512:5836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:27.173780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400937028873512:5836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:27.173792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400937028873512:5836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:27.173816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:27.184247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400937028873651:5656]
2025-10-15T10:57:27.219465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:27.228223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:27.229090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:27.229108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:27.229147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:27.229387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:27.229565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400939828577409:5316]
2025-10-15T10:57:27.231792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:27.232811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:27.233006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:27.234223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:27.234544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:27.234570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:27.234577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:27.234584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:27.234591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:27.234597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:27.234604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:27.234610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:27.234617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:27.234624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:27.234629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:27.234636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.234643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.234651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.234697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:27.234800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:27.234848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:27.234894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:27.234938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:27.234984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:27.235026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:27.235070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:27.235115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:27.235161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:27.235204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:27.235247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.235288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.235329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.235391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:27.235455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:27.235510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:27.235562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:27.235610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:27.235661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:27.235705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:27.235757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:27.235805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:27.235857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:27.235901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:27.235953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:27.235999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:27.236053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:27.236096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:27.236148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:27.236194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:27.236243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:27.236285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:27.236337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:27.236398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:27.236448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:27.236493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.236544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.236588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.236645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.236690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.236740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.237219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:27.260633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:27.282242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 415
2025-10-15T10:57:27.282242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 415
2025-10-15T10:57:27.282326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 415, pipe: [1:7561400937028873651:5656]
2025-10-15T10:57:27.280180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:27.280221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:27.280238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:27.280257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:27.280281Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 415 [2:7561400939828577409:5316]
2025-10-15T10:57:27.280332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:27.280402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:27.280418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:27.280428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:27.280439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:27.280484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:27.280504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:27.280524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:27.281560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.281576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.281589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.281600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:27.281864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:27.281882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.282021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.282202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.282436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:27.282522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400937028873613:5836], now have 1 active actors on pipe
2025-10-15T10:57:27.282547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400937028873497:2467], now have 1 active actors on pipe
2025-10-15T10:57:27.282567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400937028873651:5656], now have 1 active actors on pipe
2025-10-15T10:57:27.282620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:27.282640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:27.282693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400939828577404:5316]
2025-10-15T10:57:27.282709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400939828577404:5316]
2025-10-15T10:57:27.282721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400939828577404:5316]
2025-10-15T10:57:27.282765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:27.282803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:27.282819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:27.282832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:27.282842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:27.283003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:27.283021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:27.283080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:27.283107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:27.283123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:27.283133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:27.283165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:27.283201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:27.283322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400939828577404:5316]
2025-10-15T10:57:27.283387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:27.287659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:27.287766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:27.290955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:27.290994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:27.291074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:27.291663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 416 partition: 0 MaxSeqNo: 46 sessionId: src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0
2025-10-15T10:57:27.292500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42f79e7f-e03df6d8-dc7afdcf-a401dd9e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:27.322276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0] Write session: try to update token
2025-10-15T10:57:27.322331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:27.361472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:27.361508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:27.361524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:27.361535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:27.361574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400939828577404:5316]
2025-10-15T10:57:27.361603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400939828577404:5316]
2025-10-15T10:57:27.361631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400939828577404:5316]
2025-10-15T10:57:27.361843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:27.361866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:27.362944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:27.366649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:27.366710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:27.366743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:27.438901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId: src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:27.459101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:27.536979Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:27.569141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:27.569184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:27.569248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:27.569262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:27.569301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400939828577404:5316]
2025-10-15T10:57:27.569526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:27.569877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:27.570528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:27.570565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:27.579803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 416 reason: error at write: Disconnected sessionId: src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0
2025-10-15T10:57:27.580144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 416 sessionId: src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0 is DEAD
2025-10-15T10:57:27.581268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:27.581331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0] Write session will restart in 0.009885s
2025-10-15T10:57:27.581519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0] Write session: Do CDS request
2025-10-15T10:57:27.581578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:27.600010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:27.600186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400937028873651:5656]
2025-10-15T10:57:27.600980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:27.601005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 417
2025-10-15T10:57:27.601287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:27.602032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:27.602167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:27.602185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:27.602195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:27.604840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 417 sessionId:  describe result for acl check
2025-10-15T10:57:27.604989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:27.605002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:27.605015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:27.605042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400937028873771:5847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:27.609304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400937028873771:5847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:27.617743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400937028873771:5847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:27.638988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400937028873771:5847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:27.639026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400937028873771:5847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:27.639043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400937028873771:5847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:27.639075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:27.703063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400937028873984:5656]
2025-10-15T10:57:27.719662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:27.726790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:27.727718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:27.727738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:27.727787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:27.728055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:27.728236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400939828577680:5325]
2025-10-15T10:57:27.730378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:27.731641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:27.731899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:27.733129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:27.733455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:27.733462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:27.733469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:27.733476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:27.733483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:27.733489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:27.733497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:27.733504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:27.733511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:27.733517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:27.733524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:27.733531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.733538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.733545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.733590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:27.733695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:27.733744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:27.733788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:27.733831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:27.733874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:27.733917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:27.733963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:27.734006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:27.734050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:27.734095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:27.734138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.734180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.734225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.734269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:27.734344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:27.734402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:27.734456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:27.734504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:27.734556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:27.734601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:27.734654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:27.734700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:27.734751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:27.734796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:27.734850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:27.734898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:27.734950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:27.734995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:27.735049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:27.735096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:27.735147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:27.735192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:27.735244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:27.735287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:27.735343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:27.736440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.736510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.736559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.736612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.736656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.736707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.737231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:27.758356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:27.768922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:27.768964Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:27.768980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:27.768999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:27.769022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 416 [2:7561400939828577680:5325]
2025-10-15T10:57:27.769073Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:27.769128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:27.769142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:27.769155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:27.769165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:27.769214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:27.769235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:27.769256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:27.807137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.807169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.807181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.807192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:27.807957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 416
2025-10-15T10:57:27.808033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 416, pipe: [1:7561400937028873984:5656]
2025-10-15T10:57:27.808109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 416
2025-10-15T10:57:27.807654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:27.807676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:27.807808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:27.807975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:27.808179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:27.808263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400937028873816:5847], now have 1 active actors on pipe
2025-10-15T10:57:27.808284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400937028873984:5656], now have 1 active actors on pipe
2025-10-15T10:57:27.808305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400937028873766:2467], now have 1 active actors on pipe
2025-10-15T10:57:27.808353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:27.808374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:27.808445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400939828577674:5325]
2025-10-15T10:57:27.808459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400939828577674:5325]
2025-10-15T10:57:27.808472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400939828577674:5325]
2025-10-15T10:57:27.808510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:27.808556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:27.808574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:27.808582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:27.808586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:27.808751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:27.808767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:27.808832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:27.808863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:27.808880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:27.808890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:27.808929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:27.808974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:27.809094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400939828577674:5325]
2025-10-15T10:57:27.809119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:27.809156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:27.809161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:27.810450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:27.810473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:27.810537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:27.811323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 417 partition: 0 MaxSeqNo: 46 sessionId: src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0
2025-10-15T10:57:27.812166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf170f7-9d3e0356-7501c578-2e8be72d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:27.837094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0] Write session: try to update token
2025-10-15T10:57:27.837142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:27.928831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:27.928859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:27.928870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:27.928929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:27.928943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:27.928954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:27.928965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:27.928999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400939828577674:5325]
2025-10-15T10:57:27.929024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400939828577674:5325]
2025-10-15T10:57:27.929047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400939828577674:5325]
2025-10-15T10:57:27.929148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:27.929177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:27.929204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:27.929236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:27.929259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:27.930314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:27.954471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId: src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:27.976004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:28.085543Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:28.118972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:28.119024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:28.119099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:28.119113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:28.119157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400939828577674:5325]
2025-10-15T10:57:28.119742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:28.120370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
E1015 10:57:28.126490192  844041 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:57:28.121908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:28.122163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:28.123549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400937028873984:5656]
2025-10-15T10:57:28.128373Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:57:28.133401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 417 reason: status is not ok: tablet will be restarted right now sessionId: src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0
2025-10-15T10:57:28.133949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:28.133918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 417 sessionId: src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0 is DEAD
2025-10-15T10:57:28.133994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0] Write session will restart in 0.008287s
2025-10-15T10:57:28.134101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0] Write session: Do CDS request
2025-10-15T10:57:28.134160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:28.160427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:28.160461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 418
2025-10-15T10:57:28.160650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:28.163835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:28.163984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:28.164001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:28.164012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:28.165106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 418 sessionId:  describe result for acl check
2025-10-15T10:57:28.165185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:28.165195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:28.165203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:28.165215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400941323841353:5855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:28.167189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400941323841353:5855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:28.173917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400941323841353:5855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:28.185070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400941323841353:5855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:28.185111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400941323841353:5855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:28.185125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400941323841353:5855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:28.185148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:28.225424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400941323841542:5656]
2025-10-15T10:57:28.242610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:28.260277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:28.260999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:28.261012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:28.261041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:28.261224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:28.261342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400944123545249:5335]
2025-10-15T10:57:28.262889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:28.264035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:28.264255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:28.265624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:28.265988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:28.265998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:28.266004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:28.266013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:28.266021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:28.266028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:28.266034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:28.266042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:28.266049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:28.266056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:28.266064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:28.266071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.266078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.266085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.266137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:28.266255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:28.266308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:28.266359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:28.266412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:28.266465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:28.266504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:28.266550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:28.266603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:28.266645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:28.266684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:28.266737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.266787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.266834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.266884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:28.266961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:28.267027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:28.267090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:28.267143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:28.267208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:28.267260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:28.267318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:28.268340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:28.268437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:28.268494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:28.268557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:28.268618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:28.268680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:28.268733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:28.268796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:28.268856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:28.268920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:28.268976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:28.269038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:28.269088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:28.269146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:28.269195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.269260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.269315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.269373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.269424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.269484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.270101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:28.289529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:28.298700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:28.298749Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:28.298769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:28.298789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:28.298815Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 417 [2:7561400944123545249:5335]
2025-10-15T10:57:28.298872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:28.298939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:28.298955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:28.298968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:28.298982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:28.299036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:28.299067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:28.299091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:28.323930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.323966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.323978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.323989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:28.324555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 417, pipe: [1:7561400941323841542:5656]
2025-10-15T10:57:28.324567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 417
2025-10-15T10:57:28.324685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 417
2025-10-15T10:57:28.324287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:28.324319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.324483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.324658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.324866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:28.324955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400941323841339:2467], now have 1 active actors on pipe
2025-10-15T10:57:28.324980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400941323841542:5656], now have 1 active actors on pipe
2025-10-15T10:57:28.325003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400941323841398:5855], now have 1 active actors on pipe
2025-10-15T10:57:28.325031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400944123545244:5335]
2025-10-15T10:57:28.325047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400944123545244:5335]
2025-10-15T10:57:28.325060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400944123545244:5335]
2025-10-15T10:57:28.325107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:28.325187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:28.325214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:28.325229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:28.325241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:28.325383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:28.325402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:28.325588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:28.325611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:28.325646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400944123545244:5335]
2025-10-15T10:57:28.325677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:28.325707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:28.325801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|961f4e78-7491051b-cc628868-f9a45d71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:28.325834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:28.325854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:28.325866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:28.325904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:28.325952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:28.326045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:28.326920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:28.326951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:28.327036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:28.327429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 418 partition: 0 MaxSeqNo: 46 sessionId: src_id|961f4e78-7491051b-cc628868-f9a45d71_0
2025-10-15T10:57:28.328140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928204ae-28e5cf47-d53f0db1-6d99629c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|961f4e78-7491051b-cc628868-f9a45d71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:28.366449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|961f4e78-7491051b-cc628868-f9a45d71_0] Write session: try to update token
2025-10-15T10:57:28.366516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|961f4e78-7491051b-cc628868-f9a45d71_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:28.458095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId: src_id|961f4e78-7491051b-cc628868-f9a45d71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:28.461879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:28.461908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:28.461920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:28.461975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:28.461988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:28.462000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:28.462010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:28.462045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400944123545244:5335]
2025-10-15T10:57:28.462068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400944123545244:5335]
2025-10-15T10:57:28.462087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400944123545244:5335]
2025-10-15T10:57:28.462239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:28.462277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:28.462294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:28.462302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:28.462314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:28.463331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:28.482727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:28.609962Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:28.640625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:28.640668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:28.640742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:28.640756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:28.640796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400944123545244:5335]
2025-10-15T10:57:28.641423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:28.642910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:28.647499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:28.647556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400941323841542:5656]
2025-10-15T10:57:28.647718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:28.655521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961f4e78-7491051b-cc628868-f9a45d71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:28.655571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961f4e78-7491051b-cc628868-f9a45d71_0] Write session will restart in 0.005449s
2025-10-15T10:57:28.654202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 418 reason: status is not ok: tablet will be restarted right now sessionId: src_id|961f4e78-7491051b-cc628868-f9a45d71_0
2025-10-15T10:57:28.654538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 418 sessionId: src_id|961f4e78-7491051b-cc628868-f9a45d71_0 is DEAD
2025-10-15T10:57:28.655715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961f4e78-7491051b-cc628868-f9a45d71_0] Write session: Do CDS request
2025-10-15T10:57:28.655745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961f4e78-7491051b-cc628868-f9a45d71_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:28.666377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|961f4e78-7491051b-cc628868-f9a45d71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:28.667547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:28.667604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 419
2025-10-15T10:57:28.668152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:28.668417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:28.668441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:28.668471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:28.670477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 419 sessionId:  describe result for acl check
2025-10-15T10:57:28.670566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:28.670573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:28.670579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:28.670592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400941323841606:5860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:28.673979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400941323841606:5860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:28.681934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400941323841606:5860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:28.689986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400941323841606:5860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:28.690030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400941323841606:5860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:28.690049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400941323841606:5860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:28.690083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:28.747864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400941323841847:5656]
2025-10-15T10:57:28.757230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:28.759281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:28.760275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:28.760298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:28.760352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:28.760638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:28.760769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400944123545512:5338]
2025-10-15T10:57:28.762779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:28.763663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:28.763851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:28.765043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:28.765320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:28.765337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:28.765345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:28.765352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:28.765359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:28.765367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:28.765374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:28.765383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:28.765390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:28.765399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:28.765407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:28.765415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.765423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.765428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.765477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:28.765593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:28.765644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:28.765699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:28.765753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:28.765808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:28.765858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:28.765931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:28.765985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:28.766036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:28.766087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:28.766142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.766191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.766243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.766294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:28.766364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:28.766432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:28.766494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:28.766549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:28.766608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:28.766658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:28.766718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:28.766771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:28.766829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:28.766883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:28.766938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:28.766985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:28.767040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:28.767088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:28.767145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:28.767195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:28.767332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:28.767404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:28.767464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:28.767519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:28.767576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:28.767627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.767686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.767742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.767796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.767848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.767902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.768466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:28.785599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:28.795218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:28.795260Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:28.795278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:28.795299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:28.795324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 418 [2:7561400944123545512:5338]
2025-10-15T10:57:28.795390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:28.795452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:28.795467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:28.795480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:28.795491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:28.795541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:28.795565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:28.795587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:28.796586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.796609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.796625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.796636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:28.796897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:28.796920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:28.797064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:28.797337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 418
2025-10-15T10:57:28.797425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 418, pipe: [1:7561400941323841847:5656]
2025-10-15T10:57:28.797524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 418
2025-10-15T10:57:28.797270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:28.797523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:28.797606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400941323841597:2467], now have 1 active actors on pipe
2025-10-15T10:57:28.797629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400941323841847:5656], now have 1 active actors on pipe
2025-10-15T10:57:28.797653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400941323841649:5860], now have 1 active actors on pipe
2025-10-15T10:57:28.797679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400944123545507:5338]
2025-10-15T10:57:28.797693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400944123545507:5338]
2025-10-15T10:57:28.797707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400944123545507:5338]
2025-10-15T10:57:28.797740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:28.797758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:28.797773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:28.797786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:28.797814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:28.798000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:28.798019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:28.798089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:28.798109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:28.798227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400944123545507:5338]
2025-10-15T10:57:28.798259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:28.798279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:28.798335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:28.798366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:28.798383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:28.798394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:28.798432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:28.798474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:28.798597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:28.799228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:28.799256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:28.799320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:28.799624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 419 partition: 0 MaxSeqNo: 46 sessionId: src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0
2025-10-15T10:57:28.800396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|961f4e78-7491051b-cc628868-f9a45d71_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:28.819795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0] Write session: try to update token
2025-10-15T10:57:28.819859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:28.862075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:28.862115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:28.862158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400944123545507:5338]
2025-10-15T10:57:28.862296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:28.862298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:28.864140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:28.865482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:28.866865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:28.888424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:28.890062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:28.890593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:28.908145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId: src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:28.913135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:28.913163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:28.913176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:28.913239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:28.913254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:28.913268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:28.913279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:28.913320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400944123545507:5338]
2025-10-15T10:57:28.913347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400944123545507:5338]
2025-10-15T10:57:28.913371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400944123545507:5338]
2025-10-15T10:57:28.913520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:28.913511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:28.913547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:28.913559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:28.913599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:28.914453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:28.931211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:29.058424Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:29.061205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:29.061247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:29.063206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:29.063358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400941323841847:5656]
2025-10-15T10:57:29.063440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:29.063452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:29.062551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:29.089810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 419 reason: error at write: Disconnected sessionId: src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0
2025-10-15T10:57:29.090121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 419 sessionId: src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0 is DEAD
2025-10-15T10:57:29.090688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:29.090723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0] Write session will restart in 0.006760s
2025-10-15T10:57:29.090835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0] Write session: Do CDS request
2025-10-15T10:57:29.090868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:29.111586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:29.126431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:29.126455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 420
2025-10-15T10:57:29.126777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:29.126896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:29.126913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:29.126922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:29.128459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 420 sessionId:  describe result for acl check
2025-10-15T10:57:29.128559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:29.128574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:29.128586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:29.128604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400945618809194:5871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:29.131194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400945618809194:5871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:29.141850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400945618809194:5871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:29.154135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400945618809194:5871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:29.154201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400945618809194:5871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:29.154219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400945618809194:5871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:29.154269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:29.163960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400945618809228:5656]
2025-10-15T10:57:29.231073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:29.237227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:29.237953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:29.237969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:29.237999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:29.238199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:29.238359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400948418513071:5347]
2025-10-15T10:57:29.240642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:29.241528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:29.241707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:29.242867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:29.243138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:29.243144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:29.243151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:29.243158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:29.243165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:29.243171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:29.243178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:29.243183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:29.243190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:29.243196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:29.243201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:29.243208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.243214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.243220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.243261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:29.243379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:29.243429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:29.243472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:29.243515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:29.243559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:29.243598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:29.243651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:29.243695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:29.243737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:29.243779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:29.243823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.243867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.243908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.243945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:29.244004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:29.244055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:29.244106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:29.244152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:29.244203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:29.244246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:29.244297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:29.244345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:29.244392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:29.244447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:29.244497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:29.244540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:29.244601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:29.244642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:29.244691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:29.244734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:29.244782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:29.244826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:29.244875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:29.244925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:29.244990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:29.245033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.245082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.245130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.245193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.245236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.245290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.245757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:29.269862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:29.280844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:29.280886Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:29.280900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:29.280918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:29.280939Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 419 [2:7561400948418513071:5347]
2025-10-15T10:57:29.280986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:29.281034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:29.281047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:29.281058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:29.281068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:29.281108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:29.281127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:29.281146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:29.283386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.283405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.283419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.283430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:29.283684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:29.283701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.283823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.283989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.284195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:29.284259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400948418513066:5347]
2025-10-15T10:57:29.284273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400948418513066:5347]
2025-10-15T10:57:29.284283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400948418513066:5347]
2025-10-15T10:57:29.284322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:29.284387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:29.284565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:29.284580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:29.284682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400948418513066:5347]
2025-10-15T10:57:29.284701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:29.284812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400945618809182:2467], now have 1 active actors on pipe
2025-10-15T10:57:29.284833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400945618809225:5871], now have 1 active actors on pipe
2025-10-15T10:57:29.285023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:29.285035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:29.285045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:29.285064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:29.285229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 419
2025-10-15T10:57:29.285335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 419
2025-10-15T10:57:29.285529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 419, pipe: [1:7561400945618809228:5656]
2025-10-15T10:57:29.285571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400945618809228:5656], now have 1 active actors on pipe
2025-10-15T10:57:29.285646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:29.285681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:29.285750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1674775b-2b676b6-817fa57c-692d4f4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:29.285778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:29.285796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:29.285806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:29.285839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:29.285885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:29.285943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:29.286351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:29.286379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:29.286432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:29.286897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 420 partition: 0 MaxSeqNo: 46 sessionId: src_id|1674775b-2b676b6-817fa57c-692d4f4c_0
2025-10-15T10:57:29.287634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c29af21-b7b0f33c-7bd2c849-1e1c4521_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1674775b-2b676b6-817fa57c-692d4f4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:29.330393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1674775b-2b676b6-817fa57c-692d4f4c_0] Write session: try to update token
2025-10-15T10:57:29.330454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1674775b-2b676b6-817fa57c-692d4f4c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:29.378740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:29.378791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:29.378849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400948418513066:5347]
2025-10-15T10:57:29.379046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:29.379686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:29.384795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:29.386115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:29.393005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:29.416944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:29.418233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:29.418589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:29.418598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:29.418606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:29.418650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:29.455123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId: src_id|1674775b-2b676b6-817fa57c-692d4f4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:29.486381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:29.486413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:29.486427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:29.486437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:29.486477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400948418513066:5347]
2025-10-15T10:57:29.486506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400948418513066:5347]
2025-10-15T10:57:29.486529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400948418513066:5347]
2025-10-15T10:57:29.486679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:29.486709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:29.487274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:29.487317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:29.487359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:29.487609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:29.494705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:29.630728Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:29.632261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:29.632300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:29.632926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400945618809228:5656]
2025-10-15T10:57:29.633025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:29.633148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:29.633168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:29.633271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:29.714672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 420 reason: error at write: Disconnected sessionId: src_id|1674775b-2b676b6-817fa57c-692d4f4c_0
2025-10-15T10:57:29.714976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 420 sessionId: src_id|1674775b-2b676b6-817fa57c-692d4f4c_0 is DEAD
2025-10-15T10:57:29.716010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674775b-2b676b6-817fa57c-692d4f4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:29.716066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674775b-2b676b6-817fa57c-692d4f4c_0] Write session will restart in 0.007084s
2025-10-15T10:57:29.716231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674775b-2b676b6-817fa57c-692d4f4c_0] Write session: Do CDS request
2025-10-15T10:57:29.716283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674775b-2b676b6-817fa57c-692d4f4c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:29.728950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:29.728979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 421
2025-10-15T10:57:29.729514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1674775b-2b676b6-817fa57c-692d4f4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:29.731726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:29.731878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:29.731896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:29.731906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:29.732334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400945618809649:5656]
2025-10-15T10:57:29.733407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 421 sessionId:  describe result for acl check
2025-10-15T10:57:29.733494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:29.733505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:29.733513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:29.733529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400945618809656:5881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:29.736575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400945618809656:5881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:29.741806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400945618809656:5881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:29.748425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:29.756834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:29.757591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:29.757615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:29.757648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:29.757835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:29.757978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400948418513358:5356]
2025-10-15T10:57:29.759967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:29.757641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400945618809656:5881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:29.757682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400945618809656:5881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:29.757701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400945618809656:5881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:29.757735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:29.761083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:29.761332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:29.762711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:29.763073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:29.763101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:29.763108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:29.763116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:29.763122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:29.763129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:29.763135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:29.763146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:29.763153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:29.763161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:29.763170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:29.763176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.763184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.763193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.763244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:29.763379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:29.763431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:29.763478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:29.763533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:29.763587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:29.763642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:29.763693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:29.763748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:29.763801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:29.763859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:29.763910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.763963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.764014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.764074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:29.764160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:29.764229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:29.764290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:29.764347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:29.764397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:29.764444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:29.764487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:29.764527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:29.764572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:29.764621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:29.764683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:29.764735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:29.764787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:29.764826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:29.764878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:29.764931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:29.764991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:29.765026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:29.765068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:29.765105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:29.765143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:29.765175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.765214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.765247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.765283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.765315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.765351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.765894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:29.786715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:29.797564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:29.797619Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:29.797638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:29.797660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:29.797689Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 420 [2:7561400948418513358:5356]
2025-10-15T10:57:29.797746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:29.797816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:29.797833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:29.797847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:29.797859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:29.797915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:29.797938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:29.797961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:29.851817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.852069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.852094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.852106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:29.852401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:29.852440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:29.852576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:29.852754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:29.852966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:29.853047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400948418513351:5356]
2025-10-15T10:57:29.853069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400948418513351:5356]
2025-10-15T10:57:29.853082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400948418513351:5356]
2025-10-15T10:57:29.853123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:29.853200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:29.853252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:29.853275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:29.853286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:29.853376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:29.853396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:29.853514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400948418513351:5356]
2025-10-15T10:57:29.853535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:29.853557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:29.853628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400945618809649:5656], now have 1 active actors on pipe
2025-10-15T10:57:29.853652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400945618809456:2467], now have 1 active actors on pipe
2025-10-15T10:57:29.853674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400945618809702:5881], now have 1 active actors on pipe
2025-10-15T10:57:29.854333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 420, pipe: [1:7561400945618809649:5656]
2025-10-15T10:57:29.854430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 420
2025-10-15T10:57:29.854515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 420
2025-10-15T10:57:29.855253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:29.855284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:29.855373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:29.855423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:29.855443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:29.855454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:29.855490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:29.855537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:29.855597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:29.856152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:29.856174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:29.856241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:29.856808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 421 partition: 0 MaxSeqNo: 46 sessionId: src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0
2025-10-15T10:57:29.859881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1674775b-2b676b6-817fa57c-692d4f4c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:29.898372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:29.898408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:29.898421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:29.902671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0] Write session: try to update token
2025-10-15T10:57:29.902727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:29.939343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:29.939410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:29.939428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:29.939441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:29.939482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400948418513351:5356]
2025-10-15T10:57:29.939511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400948418513351:5356]
2025-10-15T10:57:29.939540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400948418513351:5356]
2025-10-15T10:57:29.939701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:29.939727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:29.939870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:29.939905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:29.939937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:29.945102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:30.012627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId: src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:30.042955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:30.104365Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:30.108702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:30.108747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:30.110895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:30.111108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400945618809649:5656]
2025-10-15T10:57:30.111201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:30.111318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:30.111330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:30.170193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:30.170276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0] Write session will restart in 0.006625s
2025-10-15T10:57:30.170439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0] Write session: Do CDS request
2025-10-15T10:57:30.170497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:30.169340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 421 reason: error at write: Disconnected sessionId: src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0
2025-10-15T10:57:30.169696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 421 sessionId: src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0 is DEAD
2025-10-15T10:57:30.185309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:30.185357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 422
2025-10-15T10:57:30.185959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:30.186895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:30.187113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:30.187140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:30.187156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:30.191319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 422 sessionId:  describe result for acl check
2025-10-15T10:57:30.191463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:30.191483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:30.191493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:30.191512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400949913777128:5886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:30.194442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400949913777128:5886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:30.207717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400949913777128:5886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:30.212100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400949913777245:5656]
2025-10-15T10:57:30.221464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400949913777128:5886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:30.221505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400949913777128:5886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:30.221524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400949913777128:5886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:30.221559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:30.246440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:30.258022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:30.258901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:30.258932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:30.258976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:30.259242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:30.259472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400952713480906:5360]
2025-10-15T10:57:30.261788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:30.264344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:30.264654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:30.266138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:30.266543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:30.266561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:30.266568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:30.266578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:30.266585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:30.266592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:30.266599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:30.266608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:30.266616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:30.266624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:30.266632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:30.266639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.266646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.266653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.266712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:30.266841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:30.266902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:30.266955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:30.267006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:30.267059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:30.267111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:30.267163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:30.267213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:30.267269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:30.267320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:30.268064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.268134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.268190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.268253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:30.268336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:30.268406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:30.268487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:30.268549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:30.268612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:30.268669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:30.268727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:30.268783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:30.268842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:30.268895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:30.268953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:30.269010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:30.269076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:30.269125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:30.269181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:30.269700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:30.269783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:30.269844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:30.269909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:30.269962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:30.270021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:30.270075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.270142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.270197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.270257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.270310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.270368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.270980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:30.299550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:30.311068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:30.311116Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:30.311134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:30.311155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:30.311182Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 421 [2:7561400952713480906:5360]
2025-10-15T10:57:30.311242Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:30.311309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:30.311328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:30.311341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:30.311368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:30.311422Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:30.311449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:30.311475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:30.312515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.312533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.312548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.312561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:30.312829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:30.312848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.313005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.313209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.313463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:30.313535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400952713480901:5360]
2025-10-15T10:57:30.313550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400952713480901:5360]
2025-10-15T10:57:30.313564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400952713480901:5360]
2025-10-15T10:57:30.313606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:30.313687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:30.313888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:30.313907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:30.314032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400952713480901:5360]
2025-10-15T10:57:30.314053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:30.314731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:30.314747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:30.314760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:30.314787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:30.314844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400949913777029:2467], now have 1 active actors on pipe
2025-10-15T10:57:30.314879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400949913777245:5656], now have 1 active actors on pipe
2025-10-15T10:57:30.314903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400949913777268:5886], now have 1 active actors on pipe
2025-10-15T10:57:30.315527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 421
2025-10-15T10:57:30.315528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 421, pipe: [1:7561400949913777245:5656]
2025-10-15T10:57:30.315616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 421
2025-10-15T10:57:30.316047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:30.316083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:30.316163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33530699-17cb9434-8df56492-1f463d41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:30.316199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:30.316217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:30.316228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:30.316265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:30.316309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:30.316355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:30.317212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:30.317245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:30.317320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:30.317653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 422 partition: 0 MaxSeqNo: 46 sessionId: src_id|33530699-17cb9434-8df56492-1f463d41_0
2025-10-15T10:57:30.320139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f422fa17-8175aa52-6e25d4e2-effbad32_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|33530699-17cb9434-8df56492-1f463d41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:30.354507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:30.354544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:30.354586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400952713480901:5360]
2025-10-15T10:57:30.354716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:30.356629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:30.357807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:30.358780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:30.360854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33530699-17cb9434-8df56492-1f463d41_0] Write session: try to update token
2025-10-15T10:57:30.360914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33530699-17cb9434-8df56492-1f463d41_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:30.372042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:30.373203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:30.376340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:30.390363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:30.446885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:30.446918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:30.446931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:30.446998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:30.447015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:30.447031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:30.447044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:30.447085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400952713480901:5360]
2025-10-15T10:57:30.447114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400952713480901:5360]
2025-10-15T10:57:30.447137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400952713480901:5360]
2025-10-15T10:57:30.447279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:30.447300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:30.447364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:30.447412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:30.447441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:30.448320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:30.486284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId: src_id|33530699-17cb9434-8df56492-1f463d41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:30.508317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:30.601179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:30.606753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:30.606828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:30.612246Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:30.612252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:30.612466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400949913777245:5656]
2025-10-15T10:57:30.612569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:30.612589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:30.627954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 422 reason: error at write: Disconnected sessionId: src_id|33530699-17cb9434-8df56492-1f463d41_0
2025-10-15T10:57:30.629111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33530699-17cb9434-8df56492-1f463d41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:30.629149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33530699-17cb9434-8df56492-1f463d41_0] Write session will restart in 0.005771s
2025-10-15T10:57:30.628321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 422 sessionId: src_id|33530699-17cb9434-8df56492-1f463d41_0 is DEAD
2025-10-15T10:57:30.629252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33530699-17cb9434-8df56492-1f463d41_0] Write session: Do CDS request
2025-10-15T10:57:30.629283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33530699-17cb9434-8df56492-1f463d41_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:30.649260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33530699-17cb9434-8df56492-1f463d41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:30.660753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:30.660813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 423
2025-10-15T10:57:30.661948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:30.662200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:30.662237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:30.662279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:30.664401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 423 sessionId:  describe result for acl check
2025-10-15T10:57:30.664540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:30.664559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:30.664569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:30.664588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400949913777313:5897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:30.669481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400949913777313:5897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:30.677522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400949913777313:5897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:30.687251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400949913777313:5897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:30.687283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400949913777313:5897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:30.687294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400949913777313:5897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:30.687314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:30.714639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400949913777373:5656]
2025-10-15T10:57:30.781984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:30.793743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:30.794761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:30.794794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:30.794841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:30.795139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:30.795336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400952713481185:5368]
2025-10-15T10:57:30.797660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:30.807679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:30.807993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:30.809291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:30.809646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:30.809662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:30.809668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:30.809675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:30.809682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:30.809689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:30.809695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:30.809702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:30.809709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:30.809715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:30.809723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:30.809731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.809739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.809746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.809794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:30.809902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:30.809946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:30.809992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:30.810036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:30.810088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:30.810151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:30.810203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:30.810251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:30.810301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:30.810347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:30.810394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.810440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.810487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.810535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:30.810602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:30.810662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:30.810718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:30.810767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:30.810820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:30.810867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:30.810928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:30.810989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:30.811044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:30.811090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:30.811146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:30.811197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:30.811253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:30.811303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:30.812576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:30.812648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:30.812713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:30.812756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:30.812812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:30.812859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:30.812909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:30.812954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.813023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.813070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.813140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.813188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.813241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.814955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:30.839300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:30.851315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:30.851464Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:30.851480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:30.851498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:30.851521Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 422 [2:7561400952713481185:5368]
2025-10-15T10:57:30.851571Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:30.851625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:30.851640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:30.851654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:30.851666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:30.851714Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:30.851737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:30.851759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:30.880608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.880646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.880660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.880671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:30.881293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:30.881320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:30.881462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:30.881646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:30.881879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:30.881971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400949913777373:5656], now have 1 active actors on pipe
2025-10-15T10:57:30.882003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400949913777344:5897], now have 1 active actors on pipe
2025-10-15T10:57:30.882031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400949913777301:2467], now have 1 active actors on pipe
2025-10-15T10:57:30.882054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400952713481180:5368]
2025-10-15T10:57:30.882070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400952713481180:5368]
2025-10-15T10:57:30.882083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400952713481180:5368]
2025-10-15T10:57:30.882071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 422, pipe: [1:7561400949913777373:5656]
2025-10-15T10:57:30.882170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 422
2025-10-15T10:57:30.882237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 422
2025-10-15T10:57:30.882120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:30.882201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:30.882378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:30.882396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:30.882516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400952713481180:5368]
2025-10-15T10:57:30.882523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:30.882533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:30.882537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:30.882550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:30.882574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:30.882814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:30.882838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:30.882925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:30.882957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:30.882978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:30.882988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:30.883026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:30.883070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:30.883119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:30.884756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:30.884790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:30.884857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:30.885448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 423 partition: 0 MaxSeqNo: 46 sessionId: src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0
2025-10-15T10:57:30.887020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33530699-17cb9434-8df56492-1f463d41_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:30.918441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0] Write session: try to update token
2025-10-15T10:57:30.918500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:31.004093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:31.004134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:31.004148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:31.004207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:31.004220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:31.004234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:31.004246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:31.004280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400952713481180:5368]
2025-10-15T10:57:31.004308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400952713481180:5368]
2025-10-15T10:57:31.004331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400952713481180:5368]
2025-10-15T10:57:31.004491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:31.004515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:31.004844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:31.004875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:31.004904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:31.005647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:31.029253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId: src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:31.051759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:31.152109Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:31.153698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:31.153741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:31.155324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400949913777373:5656]
2025-10-15T10:57:31.155462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:31.155733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:31.155781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:31.164310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 423 reason: error at write: Disconnected sessionId: src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0
2025-10-15T10:57:31.164675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 423 sessionId: src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0 is DEAD
2025-10-15T10:57:31.167644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:31.167707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0] Write session will restart in 0.006596s
2025-10-15T10:57:31.167877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0] Write session: Do CDS request
2025-10-15T10:57:31.167921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:31.178670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:31.178702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 424
2025-10-15T10:57:31.184272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:31.185197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:31.185353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:31.185370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:31.185381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:31.187386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 424 sessionId:  describe result for acl check
2025-10-15T10:57:31.187560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:31.187589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:31.187614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:31.187649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400954208744899:5905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:31.192091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400954208744899:5905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:31.193181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:31.202531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400954208744899:5905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:31.208687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400954208744899:5905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:31.208727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400954208744899:5905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:31.208745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400954208744899:5905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:31.208773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:31.255482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400954208745044:5656]
2025-10-15T10:57:31.287530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:31.296496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:31.297451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:31.297485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:31.297553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:31.297876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:31.298089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400957008448759:5379]
2025-10-15T10:57:31.300682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:31.302036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:31.302289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:31.303713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:31.304085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:31.304103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:31.304110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:31.304117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:31.304125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:31.304134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:31.304142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:31.304150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:31.304158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:31.304165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:31.304172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:31.304179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.304186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.304194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.304246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:31.304368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:31.304422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:31.304489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:31.304556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:31.304608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:31.304663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:31.304709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:31.304764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:31.304822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:31.304875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:31.304930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.304978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.305029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.305084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:31.305162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:31.305226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:31.305290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:31.305347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:31.305407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:31.305455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:31.305512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:31.305567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:31.305627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:31.305677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:31.305735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:31.305793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:31.305857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:31.305915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:31.305970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:31.306029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:31.306090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:31.306140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:31.306201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:31.306250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:31.306302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:31.306350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.306406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.306788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.306860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.306917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.306986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.307589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:31.327156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:31.337228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:31.337279Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:31.337297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:31.337317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:31.337343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 423 [2:7561400957008448759:5379]
2025-10-15T10:57:31.337398Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:31.337463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:31.337479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:31.337491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:31.337502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:31.337552Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:31.337574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:31.337596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:31.338782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.338809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.338823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.338836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:31.339101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:31.339133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.339278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.339537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.339645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 423, pipe: [1:7561400954208745044:5656]
2025-10-15T10:57:31.339776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:31.339788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 423
2025-10-15T10:57:31.339870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400954208745044:5656], now have 1 active actors on pipe
2025-10-15T10:57:31.339899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400954208744888:2467], now have 1 active actors on pipe
2025-10-15T10:57:31.339898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 423
2025-10-15T10:57:31.339921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400954208744933:5905], now have 1 active actors on pipe
2025-10-15T10:57:31.339950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400957008448753:5379]
2025-10-15T10:57:31.339968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400957008448753:5379]
2025-10-15T10:57:31.339980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400957008448753:5379]
2025-10-15T10:57:31.340021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:31.340086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:31.340101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:31.340114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:31.340125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:31.340297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:31.340324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:31.340502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:31.340529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:31.340559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400957008448753:5379]
2025-10-15T10:57:31.340588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:31.340620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:31.340706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c89e80a2-f07183df-47999bcb-7800c323_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:31.340753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:31.340788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:31.340801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:31.340838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:31.340881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:31.340970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:31.341495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:31.341523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:31.341593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:31.341917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 424 partition: 0 MaxSeqNo: 46 sessionId: src_id|c89e80a2-f07183df-47999bcb-7800c323_0
2025-10-15T10:57:31.342691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2784a7-edc6aaad-6d55045c-e37b91eb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c89e80a2-f07183df-47999bcb-7800c323_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:31.367591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c89e80a2-f07183df-47999bcb-7800c323_0] Write session: try to update token
2025-10-15T10:57:31.367660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c89e80a2-f07183df-47999bcb-7800c323_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:31.463167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId: src_id|c89e80a2-f07183df-47999bcb-7800c323_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:31.485087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:31.493905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:31.493938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:31.493950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:31.494011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:31.494026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:31.494038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:31.494049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:31.494082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400957008448753:5379]
2025-10-15T10:57:31.494106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400957008448753:5379]
2025-10-15T10:57:31.494128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400957008448753:5379]
2025-10-15T10:57:31.494310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:31.494360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:31.494388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:31.494394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:31.494411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:31.494449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:31.494470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:31.495669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:31.645213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:31.660995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:31.661025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:31.661072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400957008448753:5379]
2025-10-15T10:57:31.661542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:31.662009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:31.662035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:31.662070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400954208745044:5656]
2025-10-15T10:57:31.662172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:31.661788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:31.685354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 424 reason: error at write: Disconnected sessionId: src_id|c89e80a2-f07183df-47999bcb-7800c323_0
2025-10-15T10:57:31.685716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 424 sessionId: src_id|c89e80a2-f07183df-47999bcb-7800c323_0 is DEAD
2025-10-15T10:57:31.686112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89e80a2-f07183df-47999bcb-7800c323_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:31.686169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89e80a2-f07183df-47999bcb-7800c323_0] Write session will restart in 0.006345s
2025-10-15T10:57:31.686363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89e80a2-f07183df-47999bcb-7800c323_0] Write session: Do CDS request
2025-10-15T10:57:31.686418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89e80a2-f07183df-47999bcb-7800c323_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:31.701700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:31.701731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 425
2025-10-15T10:57:31.702716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c89e80a2-f07183df-47999bcb-7800c323_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:31.703390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:31.703543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:31.703560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:31.703572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:31.705160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 425 sessionId:  describe result for acl check
2025-10-15T10:57:31.705281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:31.705299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:31.705310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:31.705329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400954208745165:5910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:31.708556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400954208745165:5910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:31.715098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400954208745165:5910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:31.729309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400954208745165:5910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:31.729354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400954208745165:5910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:31.729373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400954208745165:5910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:31.729410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:31.763574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400954208745319:5656]
2025-10-15T10:57:31.784196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:31.790105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:31.790959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:31.790985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:31.791022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:31.791256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:31.791474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400957008449027:5381]
2025-10-15T10:57:31.793770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:31.794709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:31.794944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:31.795956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:31.796310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:31.796325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:31.796330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:31.796336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:31.796340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:31.796344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:31.796349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:31.796354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:31.796359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:31.796366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:31.796374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:31.796381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.796389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.796407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.796474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:31.796583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:31.796637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:31.796687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:31.796739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:31.796803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:31.796858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:31.796915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:31.796969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:31.797029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:31.797084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:31.797140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.797193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.797247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.797305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:31.797382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:31.797449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:31.797511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:31.797571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:31.797632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:31.797690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:31.797755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:31.797815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:31.797872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:31.797919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:31.797974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:31.798025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:31.798081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:31.798130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:31.798188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:31.798239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:31.798296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:31.798347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:31.798404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:31.798455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:31.798512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:31.798561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.798618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.798669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.798727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.798775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.798835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.800254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:31.830548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:31.839714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:31.839763Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:31.839782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:31.839804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:31.839833Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 424 [2:7561400957008449027:5381]
2025-10-15T10:57:31.839895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:31.839965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:31.839987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:31.840001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:31.840013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:31.840065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:31.840094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:31.840118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:31.841365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.841390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.841404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.841416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:31.841737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:31.841771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:31.841974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:31.842236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:31.842509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:31.842592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400957008449022:5381]
2025-10-15T10:57:31.842608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400957008449022:5381]
2025-10-15T10:57:31.842623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400957008449022:5381]
2025-10-15T10:57:31.842675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:31.842763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:31.842974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:31.843004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:31.843147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400957008449022:5381]
2025-10-15T10:57:31.843169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:31.843486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:31.843509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:31.843521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:31.843555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:31.844288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400954208745150:2467], now have 1 active actors on pipe
2025-10-15T10:57:31.844319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400954208745319:5656], now have 1 active actors on pipe
2025-10-15T10:57:31.844343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400954208745212:5910], now have 1 active actors on pipe
2025-10-15T10:57:31.844749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:31.844783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:31.844868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abf83318-feb372c6-920d97ea-222c68bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:31.844912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:31.844935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:31.844946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:31.844987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:31.845035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:31.845094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:31.844352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 424
2025-10-15T10:57:31.844481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 424, pipe: [1:7561400954208745319:5656]
2025-10-15T10:57:31.844584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 424
2025-10-15T10:57:31.848664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:31.848698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:31.848777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:31.849099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 425 partition: 0 MaxSeqNo: 46 sessionId: src_id|abf83318-feb372c6-920d97ea-222c68bc_0
2025-10-15T10:57:31.851889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c89e80a2-f07183df-47999bcb-7800c323_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|abf83318-feb372c6-920d97ea-222c68bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:31.901133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:31.901166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:31.901201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400957008449022:5381]
2025-10-15T10:57:31.901311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:31.902818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:31.909462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:31.911127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:31.916173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:31.917498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:31.919152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:31.921483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abf83318-feb372c6-920d97ea-222c68bc_0] Write session: try to update token
2025-10-15T10:57:31.921530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abf83318-feb372c6-920d97ea-222c68bc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:31.923672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:31.939509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:31.939538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:31.939549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:32.028489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:32.028542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:32.028567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:32.028587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:32.028648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400957008449022:5381]
2025-10-15T10:57:32.028696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400957008449022:5381]
2025-10-15T10:57:32.028738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400957008449022:5381]
2025-10-15T10:57:32.028950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:32.028995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:32.031480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:32.031546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:32.031589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:32.043965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:32.061099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId: src_id|abf83318-feb372c6-920d97ea-222c68bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:32.086667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:32.189575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:32.192151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:32.192186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:32.195789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:32.196031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400954208745319:5656]
2025-10-15T10:57:32.196165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:32.192948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:32.233056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 425 reason: status is not ok: tablet will be restarted right now sessionId: src_id|abf83318-feb372c6-920d97ea-222c68bc_0
2025-10-15T10:57:32.233372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 425 sessionId: src_id|abf83318-feb372c6-920d97ea-222c68bc_0 is DEAD
2025-10-15T10:57:32.233927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf83318-feb372c6-920d97ea-222c68bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:32.233995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf83318-feb372c6-920d97ea-222c68bc_0] Write session will restart in 0.008796s
2025-10-15T10:57:32.234177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf83318-feb372c6-920d97ea-222c68bc_0] Write session: Do CDS request
2025-10-15T10:57:32.234228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf83318-feb372c6-920d97ea-222c68bc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:32.247510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:32.247537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 426
2025-10-15T10:57:32.247863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abf83318-feb372c6-920d97ea-222c68bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:32.248399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:32.248564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:32.248583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:32.248594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:32.250086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 426 sessionId:  describe result for acl check
2025-10-15T10:57:32.250209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:32.250227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:32.250238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:32.250257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400958503712765:5921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:32.252993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400958503712765:5921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:32.269031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400958503712765:5921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:32.285698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400958503712765:5921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:32.285744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400958503712765:5921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:32.285760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400958503712765:5921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:32.285789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:32.295333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400958503712988:5656]
2025-10-15T10:57:32.306938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:32.309054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:32.309665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:32.309689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:32.309724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:32.309930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:32.310133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400961303416591:5391]
2025-10-15T10:57:32.313382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:32.314647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:32.315156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:32.316398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:32.316828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:32.316850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:32.316857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:32.316863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:32.316870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:32.316877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:32.316883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:32.316890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:32.316898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:32.316905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:32.316913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:32.316920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.316927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.316934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.316971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:32.317040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:32.317071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:32.317128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:32.317157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:32.317186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:32.317215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:32.317242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:32.317271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:32.317301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:32.317331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:32.317360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.317389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.317417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.317441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:32.317485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:32.317528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:32.317561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:32.317591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:32.317624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:32.317651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:32.317684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:32.317711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:32.317746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:32.317779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:32.317827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:32.317862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:32.318034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:32.318069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:32.318105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:32.318134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:32.318168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:32.318196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:32.318231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:32.318260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:32.318293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:32.318321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.318354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.318382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.318417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.318446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.318480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.318796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:32.340225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:32.350356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:32.350397Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:32.350411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:32.350427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:32.350450Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 425 [2:7561400961303416591:5391]
2025-10-15T10:57:32.350525Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:32.350575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:32.350587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:32.350597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:32.350606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:32.350652Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:32.350672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:32.350693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:32.352656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.352681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.352694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.352705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:32.352991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:32.353015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.353145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.353373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.353280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 425
2025-10-15T10:57:32.353358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 425, pipe: [1:7561400958503712988:5656]
2025-10-15T10:57:32.353427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 425
2025-10-15T10:57:32.353588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:32.353673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400958503712741:2467], now have 1 active actors on pipe
2025-10-15T10:57:32.353699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400958503712988:5656], now have 1 active actors on pipe
2025-10-15T10:57:32.353719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400958503712955:5921], now have 1 active actors on pipe
2025-10-15T10:57:32.353773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:32.353799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:32.353831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400961303416586:5391]
2025-10-15T10:57:32.353845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400961303416586:5391]
2025-10-15T10:57:32.353857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400961303416586:5391]
2025-10-15T10:57:32.353890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:32.353936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:32.353954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:32.353957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:32.353967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:32.354124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:32.354148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:32.354207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:32.354278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:32.354303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:32.354312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:32.354342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:32.354376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:32.354492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400961303416586:5391]
2025-10-15T10:57:32.354522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:32.354564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:32.354572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:32.354996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:32.355026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:32.355108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:32.355457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 426 partition: 0 MaxSeqNo: 46 sessionId: src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0
2025-10-15T10:57:32.356248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf83318-feb372c6-920d97ea-222c68bc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:32.393410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0] Write session: try to update token
2025-10-15T10:57:32.393457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:32.431130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:32.431163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:32.431200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400961303416586:5391]
2025-10-15T10:57:32.431331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:32.431504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:32.438377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:32.440507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:32.444752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:32.448122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:32.451163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:32.451670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:32.451684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:32.451695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:32.451749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:32.540405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:32.540438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:32.540453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:32.540479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:32.540517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400961303416586:5391]
2025-10-15T10:57:32.540544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400961303416586:5391]
2025-10-15T10:57:32.540568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400961303416586:5391]
2025-10-15T10:57:32.540709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:32.540731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:32.540872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:32.540913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:32.540943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:32.542017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:32.549752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId: src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:32.572042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:32.686045Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:32.688210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:32.688260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:32.688832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:32.688861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400958503712988:5656]
2025-10-15T10:57:32.688958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:32.688973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:32.689457Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:32.699402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 426 reason: error at write: Disconnected sessionId: src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0
2025-10-15T10:57:32.699835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 426 sessionId: src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0 is DEAD
2025-10-15T10:57:32.704401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:32.704438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0] Write session will restart in 0.008445s
2025-10-15T10:57:32.704559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0] Write session: Do CDS request
2025-10-15T10:57:32.704596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:32.719901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:32.719934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 427
2025-10-15T10:57:32.721324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:32.721949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:32.722091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:32.722108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:32.722119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:32.723393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 427 sessionId:  describe result for acl check
2025-10-15T10:57:32.723496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:32.723507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:32.723516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:32.723534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400958503713028:5929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:32.725969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400958503713028:5929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:32.734323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400958503713028:5929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:32.758960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400958503713028:5929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:32.759024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400958503713028:5929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:32.759050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400958503713028:5929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:32.759105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:32.791502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400958503713276:5656]
2025-10-15T10:57:32.792492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:32.807611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:32.808534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:32.808567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:32.808612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:32.808879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:32.809073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400961303416887:5401]
2025-10-15T10:57:32.811361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:32.819963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:32.820271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:32.821710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:32.822088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:32.822097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:32.822105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:32.822112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:32.822121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:32.822127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:32.822134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:32.822142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:32.822150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:32.822158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:32.822167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:32.822174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.822182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.822190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.822240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:32.822370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:32.822424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:32.822480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:32.822531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:32.822584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:32.822635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:32.822686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:32.822735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:32.822784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:32.822835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:32.822908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.822960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.823011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.823062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:32.823137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:32.823208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:32.823268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:32.823318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:32.823423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:32.823475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:32.823532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:32.823583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:32.823640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:32.823691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:32.823749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:32.823799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:32.823856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:32.823902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:32.823959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:32.824013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:32.824068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:32.824115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:32.824169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:32.824219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:32.824274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:32.824323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.824379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.824452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.824531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.824580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.824641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.825193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:32.850085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:32.859800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:32.859848Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:32.859868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:32.859890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:32.859919Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 426 [2:7561400961303416887:5401]
2025-10-15T10:57:32.859975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:32.860039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:32.860055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:32.860068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:32.860081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:32.860134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:32.860158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:32.860183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:32.861150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.861169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.861185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.861198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:32.861501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:32.861521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:32.861683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:32.861895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:32.862162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:32.862240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400961303416882:5401]
2025-10-15T10:57:32.862257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400961303416882:5401]
2025-10-15T10:57:32.862273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400961303416882:5401]
2025-10-15T10:57:32.862319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:32.862400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:32.862604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:32.862624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:32.862755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400961303416882:5401]
2025-10-15T10:57:32.862776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:32.862809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:32.862825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:32.862836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:32.862862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:32.863398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400958503713120:5929], now have 1 active actors on pipe
2025-10-15T10:57:32.863432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400958503713276:5656], now have 1 active actors on pipe
2025-10-15T10:57:32.863457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400958503713018:2467], now have 1 active actors on pipe
2025-10-15T10:57:32.863676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 426, pipe: [1:7561400958503713276:5656]
2025-10-15T10:57:32.863678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 426
2025-10-15T10:57:32.863765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 426
2025-10-15T10:57:32.864119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:32.864165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:32.864273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fbfd44f-d567f86e-3444d667-2723a676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:32.864314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:32.864337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:32.864349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:32.864388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:32.864457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:32.864521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:32.864988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:32.865013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:32.865089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:32.865358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 427 partition: 0 MaxSeqNo: 46 sessionId: src_id|1fbfd44f-d567f86e-3444d667-2723a676_0
2025-10-15T10:57:32.866285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d53b03f-3055bb96-d91f9842-eb694a73_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1fbfd44f-d567f86e-3444d667-2723a676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:32.887444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbfd44f-d567f86e-3444d667-2723a676_0] Write session: try to update token
2025-10-15T10:57:32.887508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbfd44f-d567f86e-3444d667-2723a676_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:32.981796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:32.981832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:32.981867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400961303416882:5401]
2025-10-15T10:57:32.981982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:32.982053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:32.982065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:32.982076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:32.982136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:32.985540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:32.988726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:32.989178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId: src_id|1fbfd44f-d567f86e-3444d667-2723a676_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:32.990413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:32.991996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:32.993709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:33.030362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:33.037752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:33.037906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:33.037923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:33.037936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:33.037946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:33.037986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400961303416882:5401]
2025-10-15T10:57:33.038014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400961303416882:5401]
2025-10-15T10:57:33.038047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400961303416882:5401]
2025-10-15T10:57:33.038168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:33.038212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:33.038224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:33.038238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:33.038246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:33.038280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:33.038305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:33.039270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:33.180029Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:33.181747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:33.181772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:33.181938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400958503713276:5656]
2025-10-15T10:57:33.182092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:33.182283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:33.189888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 427 reason: error at write: Disconnected sessionId: src_id|1fbfd44f-d567f86e-3444d667-2723a676_0
2025-10-15T10:57:33.190177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 427 sessionId: src_id|1fbfd44f-d567f86e-3444d667-2723a676_0 is DEAD
2025-10-15T10:57:33.190854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbfd44f-d567f86e-3444d667-2723a676_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:33.190916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbfd44f-d567f86e-3444d667-2723a676_0] Write session will restart in 0.005693s
2025-10-15T10:57:33.191041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbfd44f-d567f86e-3444d667-2723a676_0] Write session: Do CDS request
2025-10-15T10:57:33.191073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbfd44f-d567f86e-3444d667-2723a676_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:33.202857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbfd44f-d567f86e-3444d667-2723a676_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:33.203923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:33.203993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 428
2025-10-15T10:57:33.204579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:33.204780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:33.204798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:33.204809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:33.206378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 428 sessionId:  describe result for acl check
2025-10-15T10:57:33.206489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:33.206650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:33.206664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:33.206682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400962798680608:5934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:33.209552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400962798680608:5934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:33.217923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400962798680608:5934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:33.229354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400962798680608:5934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:33.229392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400962798680608:5934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:33.229410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400962798680608:5934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:33.229439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:33.282168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400962798680844:5656]
2025-10-15T10:57:33.282865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:33.284996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:33.285824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:33.285855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:33.285897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:33.286152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:33.286341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400965598384439:5404]
2025-10-15T10:57:33.288640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:33.289598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:33.289812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:33.291129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:33.291488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:33.291504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:33.291511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:33.291518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:33.291524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:33.291532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:33.291538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:33.291546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:33.291553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:33.291562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:33.291570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:33.291576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.291583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.291589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.291637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:33.291757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:33.291807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:33.291859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:33.291915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:33.291964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:33.292018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:33.292068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:33.292120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:33.292172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:33.292221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:33.292270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.292325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.292378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.292428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:33.292515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:33.292584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:33.292645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:33.292698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:33.292755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:33.292807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:33.292863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:33.292915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:33.292975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:33.293023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:33.293084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:33.293134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:33.293194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:33.293241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:33.293301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:33.293357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:33.293417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:33.293466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:33.293535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:33.293590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:33.293644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:33.293695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.293757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.293812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.293874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.293926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.293987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.294522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:33.317841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:33.327229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:33.327280Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:33.327299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:33.327322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:33.327363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 427 [2:7561400965598384439:5404]
2025-10-15T10:57:33.327424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:33.327491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:33.327508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:33.327521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:33.327533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:33.327586Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:33.327611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:33.327636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:33.328631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.328657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.328673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.328685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:33.328958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:33.328985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.329136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.329354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.329614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:33.329697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400965598384433:5404]
2025-10-15T10:57:33.329719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400965598384433:5404]
2025-10-15T10:57:33.329735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400965598384433:5404]
2025-10-15T10:57:33.329776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:33.329853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:33.329932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:33.329955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:33.329968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:33.330051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:33.330073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:33.330199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400965598384433:5404]
2025-10-15T10:57:33.330225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:33.330286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:33.330318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400962798680639:5934], now have 1 active actors on pipe
2025-10-15T10:57:33.330348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400962798680844:5656], now have 1 active actors on pipe
2025-10-15T10:57:33.330404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400962798680595:2467], now have 1 active actors on pipe
2025-10-15T10:57:33.331273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 427, pipe: [1:7561400962798680844:5656]
2025-10-15T10:57:33.331318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 427
2025-10-15T10:57:33.331395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 427
2025-10-15T10:57:33.332077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:33.332110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:33.332205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa445029-313becae-50decfac-b0d55aff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:33.332256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:33.332276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:33.332288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:33.332328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:33.332393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:33.332451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:33.332981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:33.333001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:33.333069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:33.333397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 428 partition: 0 MaxSeqNo: 46 sessionId: src_id|aa445029-313becae-50decfac-b0d55aff_0
2025-10-15T10:57:33.334176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fbfd44f-d567f86e-3444d667-2723a676_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|aa445029-313becae-50decfac-b0d55aff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:33.382508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa445029-313becae-50decfac-b0d55aff_0] Write session: try to update token
2025-10-15T10:57:33.382574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa445029-313becae-50decfac-b0d55aff_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:33.452618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:33.452650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:33.452663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:33.452673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:33.452713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400965598384433:5404]
2025-10-15T10:57:33.452739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400965598384433:5404]
2025-10-15T10:57:33.452761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400965598384433:5404]
2025-10-15T10:57:33.452939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:33.452952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:33.452963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:33.453051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:33.453073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:33.453803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:33.453836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:33.453866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:33.455724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:33.516830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId: src_id|aa445029-313becae-50decfac-b0d55aff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:33.541250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:33.599394Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:33.643321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:33.643338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:33.641821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:33.641862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:33.641930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:33.641945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:33.641985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400965598384433:5404]
2025-10-15T10:57:33.642168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:33.642597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:33.656342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400962798680844:5656]
2025-10-15T10:57:33.656427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:33.656554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 428 reason: error at write: Disconnected sessionId: src_id|aa445029-313becae-50decfac-b0d55aff_0
2025-10-15T10:57:33.656828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 428 sessionId: src_id|aa445029-313becae-50decfac-b0d55aff_0 is DEAD
2025-10-15T10:57:33.667926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa445029-313becae-50decfac-b0d55aff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:33.668002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa445029-313becae-50decfac-b0d55aff_0] Write session will restart in 0.005826s
2025-10-15T10:57:33.668160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa445029-313becae-50decfac-b0d55aff_0] Write session: Do CDS request
2025-10-15T10:57:33.668205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa445029-313becae-50decfac-b0d55aff_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:33.690674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa445029-313becae-50decfac-b0d55aff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:33.692255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:33.692288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 429
2025-10-15T10:57:33.692642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:33.692746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:33.692768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:33.692777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:33.704624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 429 sessionId:  describe result for acl check
2025-10-15T10:57:33.704785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:33.704796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:33.704806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:33.704823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400962798680884:5945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:33.707906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400962798680884:5945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:33.720131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400962798680884:5945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:33.732470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400962798680884:5945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:33.732520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400962798680884:5945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:33.732535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400962798680884:5945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:33.732566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:33.757186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400962798680963:5656]
2025-10-15T10:57:33.815912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:33.829633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:33.830609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:33.830639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:33.830690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:33.830968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:33.831162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400965598384723:5412]
2025-10-15T10:57:33.833386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:33.834546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:33.834813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:33.836120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:33.836461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:33.836492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:33.836499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:33.836505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:33.836512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:33.836517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:33.836524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:33.836530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:33.836536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:33.836544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:33.836550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:33.836557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.836563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.836569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.836615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:33.836714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:33.836759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:33.836802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:33.836844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:33.836929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:33.836986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:33.837033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:33.837081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:33.837127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:33.837183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:33.837236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.837278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.837322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.837365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:33.837426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:33.837485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:33.837542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:33.837593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:33.837648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:33.837694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:33.837753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:33.837795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:33.837842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:33.837884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:33.837934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:33.837985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:33.838037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:33.838087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:33.838140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:33.838187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:33.838239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:33.838294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:33.838356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:33.838420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:33.838472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:33.838516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.838590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.838642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.838690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.838752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.838806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.839310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:33.904705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:33.916091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:33.916129Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:33.916143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:33.916162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:33.916182Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 428 [2:7561400965598384723:5412]
2025-10-15T10:57:33.916225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:33.916273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:33.916287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:33.916299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:33.916308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:33.916352Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:33.916373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:33.916393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:33.918748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.918772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.918785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.918795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:33.919057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:33.919079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:33.919198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:33.919390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:33.919611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:33.919676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400965598384718:5412]
2025-10-15T10:57:33.919690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400965598384718:5412]
2025-10-15T10:57:33.919701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400965598384718:5412]
2025-10-15T10:57:33.919729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:33.919793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:33.919956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:33.919971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:33.920074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400965598384718:5412]
2025-10-15T10:57:33.920090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:33.920318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:33.920330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:33.920341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:33.920360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:33.921107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400962798680914:5945], now have 1 active actors on pipe
2025-10-15T10:57:33.921130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400962798680963:5656], now have 1 active actors on pipe
2025-10-15T10:57:33.921147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400962798680876:2467], now have 1 active actors on pipe
2025-10-15T10:57:33.926185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 428
2025-10-15T10:57:33.926264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 428, pipe: [1:7561400962798680963:5656]
2025-10-15T10:57:33.926351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 428
2025-10-15T10:57:33.926474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:33.926507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:33.926586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|116cf052-a3774133-d184d0d6-36701513_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:33.926614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:33.926629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:33.926640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:33.926669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:33.926707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:33.926749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:33.927088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:33.927107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:33.927158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:33.927495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 429 partition: 0 MaxSeqNo: 46 sessionId: src_id|116cf052-a3774133-d184d0d6-36701513_0
2025-10-15T10:57:33.928252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa445029-313becae-50decfac-b0d55aff_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|116cf052-a3774133-d184d0d6-36701513_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:33.950577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116cf052-a3774133-d184d0d6-36701513_0] Write session: try to update token
2025-10-15T10:57:33.950635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116cf052-a3774133-d184d0d6-36701513_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:34.035598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:34.035633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:34.035647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:34.035711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:34.035729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:34.035745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:34.035759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:34.035799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400965598384718:5412]
2025-10-15T10:57:34.035828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400965598384718:5412]
2025-10-15T10:57:34.035855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400965598384718:5412]
2025-10-15T10:57:34.036011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:34.036035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:34.036530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:34.036567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:34.036607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:34.048095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:34.089232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId: src_id|116cf052-a3774133-d184d0d6-36701513_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:34.113009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:34.201445Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:34.203659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:34.203701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:34.206407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:34.206441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400962798680963:5656]
2025-10-15T10:57:34.206459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:34.206564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:34.207762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:34.226886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 429 reason: error at write: Disconnected sessionId: src_id|116cf052-a3774133-d184d0d6-36701513_0
2025-10-15T10:57:34.227178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 429 sessionId: src_id|116cf052-a3774133-d184d0d6-36701513_0 is DEAD
2025-10-15T10:57:34.227619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116cf052-a3774133-d184d0d6-36701513_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:34.227693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116cf052-a3774133-d184d0d6-36701513_0] Write session will restart in 0.009089s
2025-10-15T10:57:34.227882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116cf052-a3774133-d184d0d6-36701513_0] Write session: Do CDS request
2025-10-15T10:57:34.227947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116cf052-a3774133-d184d0d6-36701513_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:34.243933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:34.243977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 430
2025-10-15T10:57:34.244725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|116cf052-a3774133-d184d0d6-36701513_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:34.245982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:34.246224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:34.246266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:34.246283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:34.248104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 430 sessionId:  describe result for acl check
2025-10-15T10:57:34.248213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:34.248223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:34.248233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:34.248249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400967093648484:5955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:34.250918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400967093648484:5955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:34.256851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400967093648484:5955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:34.269233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400967093648484:5955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:34.269278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400967093648484:5955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:34.269293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400967093648484:5955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:34.269324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:34.306724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400967093648718:5656]
2025-10-15T10:57:34.350077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:34.353944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:34.354790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:34.354817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:34.354858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:34.355100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:34.355278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400969893352303:5423]
2025-10-15T10:57:34.357286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:34.358103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:34.358323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:34.359271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:34.359527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:34.359538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:34.359542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:34.359546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:34.359550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:34.359555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:34.359558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:34.359562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:34.359566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:34.359570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:34.359574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:34.359579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.359583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.359587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.359618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:34.359694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:34.359725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:34.359769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:34.359817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:34.359861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:34.359901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:34.359931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:34.359962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:34.360003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:34.360038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:34.360074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.360110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.360144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.360175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:34.360224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:34.360265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:34.360304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:34.360338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:34.360376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:34.360409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:34.360447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:34.360482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:34.360533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:34.360571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:34.360640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:34.360686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:34.360726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:34.360759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:34.360796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:34.360831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:34.360882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:34.360930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:34.360985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:34.361036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:34.361090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:34.361139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.361193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.361243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.361305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.361356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.361406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.361874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:34.421459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:34.431221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:34.431259Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:34.431276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:34.431293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:34.431313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 429 [2:7561400969893352303:5423]
2025-10-15T10:57:34.431378Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:34.431432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:34.431452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:34.431464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:34.431475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:34.431516Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:34.431530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:34.431544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:34.432372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.432381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.432389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.432396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:34.432606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:34.432616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.432731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.432900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.433116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:34.433189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400967093648467:2467], now have 1 active actors on pipe
2025-10-15T10:57:34.433209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400967093648718:5656], now have 1 active actors on pipe
2025-10-15T10:57:34.433230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400967093648533:5955], now have 1 active actors on pipe
2025-10-15T10:57:34.433252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400969893352298:5423]
2025-10-15T10:57:34.433267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400969893352298:5423]
2025-10-15T10:57:34.433279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400969893352298:5423]
2025-10-15T10:57:34.433316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:34.433373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:34.433383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:34.433390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:34.433402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:34.433536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:34.433554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:34.433660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400969893352298:5423]
2025-10-15T10:57:34.433687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:34.433717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:34.435491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 429, pipe: [1:7561400967093648718:5656]
2025-10-15T10:57:34.435509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 429
2025-10-15T10:57:34.435605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 429
2025-10-15T10:57:34.435786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:34.435819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:34.435898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95946818-b192ec70-f01f0410-fc66bb71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:34.435925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:34.435942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:34.435952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:34.435983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:34.436020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:34.436064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:34.440697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:34.440743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:34.440818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:34.442455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 430 partition: 0 MaxSeqNo: 46 sessionId: src_id|95946818-b192ec70-f01f0410-fc66bb71_0
2025-10-15T10:57:34.443261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|116cf052-a3774133-d184d0d6-36701513_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|95946818-b192ec70-f01f0410-fc66bb71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:34.471558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95946818-b192ec70-f01f0410-fc66bb71_0] Write session: try to update token
2025-10-15T10:57:34.471618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95946818-b192ec70-f01f0410-fc66bb71_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:34.520225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:34.520280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:34.520311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:34.520337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:34.520402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400969893352298:5423]
2025-10-15T10:57:34.520449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400969893352298:5423]
2025-10-15T10:57:34.520512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400969893352298:5423]
2025-10-15T10:57:34.520670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:34.520730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:34.520775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:34.520836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:34.520897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:34.529599Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:34.557872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId: src_id|95946818-b192ec70-f01f0410-fc66bb71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:34.580967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:34.668935Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:34.680056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:34.680103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:34.680167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:34.680180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:34.680219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400969893352298:5423]
2025-10-15T10:57:34.680564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:34.681065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:34.681248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400967093648718:5656]
2025-10-15T10:57:34.681345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:34.681357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:34.681265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:34.694254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 430 reason: error at write: Disconnected sessionId: src_id|95946818-b192ec70-f01f0410-fc66bb71_0
2025-10-15T10:57:34.694614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 430 sessionId: src_id|95946818-b192ec70-f01f0410-fc66bb71_0 is DEAD
2025-10-15T10:57:34.694934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95946818-b192ec70-f01f0410-fc66bb71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:34.694972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95946818-b192ec70-f01f0410-fc66bb71_0] Write session will restart in 0.009857s
2025-10-15T10:57:34.695095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95946818-b192ec70-f01f0410-fc66bb71_0] Write session: Do CDS request
2025-10-15T10:57:34.695134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95946818-b192ec70-f01f0410-fc66bb71_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:34.725221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95946818-b192ec70-f01f0410-fc66bb71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:34.727646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:34.727678Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 431
2025-10-15T10:57:34.728098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:34.728233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:34.728260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:34.728272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:34.729667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 431 sessionId:  describe result for acl check
2025-10-15T10:57:34.729786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:34.729797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:34.729807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:34.729826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400967093648930:5960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:34.733751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400967093648930:5960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:34.743394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400967093648930:5960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:34.751961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400967093648930:5960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:34.752000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400967093648930:5960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:34.752018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400967093648930:5960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:34.752054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:34.781565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400967093649052:5656]
2025-10-15T10:57:34.841963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:34.844174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:34.845002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:34.845030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:34.845076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:34.845290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:34.845468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400969893352577:5425]
2025-10-15T10:57:34.848277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:34.849291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:34.849543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:34.850938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:34.851297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:34.851317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:34.851326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:34.851333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:34.851340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:34.851366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:34.851372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:34.851379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:34.851387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:34.851395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:34.851403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:34.851411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.851419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.851426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.851477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:34.851602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:34.851654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:34.851707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:34.851768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:34.851820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:34.851881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:34.851935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:34.851989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:34.852042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:34.852097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:34.852154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.852211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.852266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.852318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:34.852397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:34.852468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:34.852545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:34.852605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:34.852673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:34.852732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:34.852791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:34.852846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:34.852910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:34.852963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:34.853026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:34.853082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:34.853144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:34.853198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:34.853262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:34.853319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:34.853379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:34.853431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:34.853498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:34.853548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:34.853610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:34.853658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.853720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.853778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.853840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.853901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.853966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.854528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:34.884171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:34.894200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:34.894252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:34.894271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:34.894293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:34.894322Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 430 [2:7561400969893352577:5425]
2025-10-15T10:57:34.894382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:34.894453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:34.894470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:34.894484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:34.894497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:34.894551Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:34.894577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:34.894602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:34.895718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.895746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.895763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.895776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:34.896074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:34.896103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:34.896264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:34.896491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:34.896771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:34.896856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400969893352572:5425]
2025-10-15T10:57:34.896876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400969893352572:5425]
2025-10-15T10:57:34.896889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400969893352572:5425]
2025-10-15T10:57:34.896932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:34.897015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:34.897076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:34.897100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:34.897115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:34.897220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:34.897247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:34.897922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 430
2025-10-15T10:57:34.898004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 430, pipe: [1:7561400967093649052:5656]
2025-10-15T10:57:34.898076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 430
2025-10-15T10:57:34.897375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400969893352572:5425]
2025-10-15T10:57:34.897403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:34.897445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:34.897502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400967093648960:5960], now have 1 active actors on pipe
2025-10-15T10:57:34.897527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400967093649052:5656], now have 1 active actors on pipe
2025-10-15T10:57:34.897551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400967093648914:2467], now have 1 active actors on pipe
2025-10-15T10:57:34.898072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:34.898098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:34.898177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:34.898211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:34.898229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:34.898241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:34.898278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:34.898339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:34.898405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:34.899017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:34.899044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:34.899106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:34.899656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 431 partition: 0 MaxSeqNo: 46 sessionId: src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0
2025-10-15T10:57:34.900453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95946818-b192ec70-f01f0410-fc66bb71_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:34.924173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0] Write session: try to update token
2025-10-15T10:57:34.924237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:34.988940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:34.988971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:34.988984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:34.988998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:34.989034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400969893352572:5425]
2025-10-15T10:57:34.989062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400969893352572:5425]
2025-10-15T10:57:34.989085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400969893352572:5425]
2025-10-15T10:57:34.989314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:34.989347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:34.989454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:34.989483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:34.989510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:34.991727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:35.033147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId: src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:35.054480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:35.135289Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:35.153083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:35.153129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:35.153190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:35.153203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:35.153239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400969893352572:5425]
2025-10-15T10:57:35.153522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:35.153775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:35.155587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:35.165381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0
2025-10-15T10:57:35.167148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 431 sessionId: src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0 is DEAD
2025-10-15T10:57:35.176374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:35.176451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0] Write session will restart in 0.006800s
2025-10-15T10:57:35.176623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0] Write session: Do CDS request
2025-10-15T10:57:35.176672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:35.200265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400967093649052:5656]
2025-10-15T10:57:35.200355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:35.205964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:35.205179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:35.205200Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 432
2025-10-15T10:57:35.209007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:35.209163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:35.209182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:35.209194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:35.210457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 432 sessionId:  describe result for acl check
2025-10-15T10:57:35.210565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:35.210576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:35.210587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:35.210606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400971388616737:5971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:35.213353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400971388616737:5971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:35.235777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400971388616737:5971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:35.250297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400971388616737:5971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:35.250337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400971388616737:5971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:35.250355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400971388616737:5971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:35.250387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:35.303465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400971388617056:5656]
2025-10-15T10:57:35.332249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:35.336453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:35.337327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:35.337340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:35.337373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:35.337578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:35.337769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400974188320146:5435]
2025-10-15T10:57:35.339333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:35.340146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:35.340339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:35.341349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:35.341593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:35.341598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:35.341602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:35.341613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:35.341617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:35.341621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:35.341625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:35.341630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:35.341633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:35.341637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:35.341641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:35.341645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.341649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.341653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.341686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:35.341768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:35.341815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:35.341859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:35.341897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:35.341932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:35.341963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:35.342014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:35.342060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:35.342103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:35.342136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:35.342169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.342201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.342235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.342262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:35.342318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:35.342358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:35.342410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:35.342446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:35.342485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:35.342517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:35.342566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:35.342605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:35.342642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:35.342692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:35.342736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:35.342780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:35.342829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:35.342861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:35.342908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:35.342950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:35.342986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:35.343019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:35.343065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:35.343110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:35.343150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:35.343180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.343218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.343247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.343284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.343319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.344330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.344749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:35.364147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:35.374018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:35.374059Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:35.374074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:35.374092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:35.374116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 431 [2:7561400974188320146:5435]
2025-10-15T10:57:35.374167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:35.374221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:35.374235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:35.374269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:35.374287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:35.374336Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:35.374366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:35.374383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:35.400124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.400153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.400167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.400178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:35.400437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:35.400461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.400612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.400784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.401016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:35.401095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400974188320141:5435]
2025-10-15T10:57:35.401117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400974188320141:5435]
2025-10-15T10:57:35.401130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400974188320141:5435]
2025-10-15T10:57:35.401162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:35.401250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:35.401453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:35.401479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:35.401625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400974188320141:5435]
2025-10-15T10:57:35.401649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:35.401820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:35.401838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:35.401849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:35.401871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:35.403030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400971388617056:5656], now have 1 active actors on pipe
2025-10-15T10:57:35.403066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400971388616730:2467], now have 1 active actors on pipe
2025-10-15T10:57:35.403086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400971388616802:5971], now have 1 active actors on pipe
2025-10-15T10:57:35.406704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 431
2025-10-15T10:57:35.407178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 431, pipe: [1:7561400971388617056:5656]
2025-10-15T10:57:35.407270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 431
2025-10-15T10:57:35.411018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:35.411060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:35.411160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:35.411200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:35.411219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:35.411230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:35.411269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:35.411316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:35.411385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:35.412716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:35.412748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:35.412818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:35.414024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 432 partition: 0 MaxSeqNo: 46 sessionId: src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0
2025-10-15T10:57:35.415941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c46caead-8e470db-7f921bb3-7a6aac6b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:35.462005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0] Write session: try to update token
2025-10-15T10:57:35.462087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:35.481407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:35.481444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:35.481460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:35.481471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:35.481512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400974188320141:5435]
2025-10-15T10:57:35.481539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400974188320141:5435]
2025-10-15T10:57:35.481567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400974188320141:5435]
2025-10-15T10:57:35.481693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:35.481738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:35.481768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:35.481794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:35.481807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:35.481822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:35.481872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:35.481894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:35.482875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:35.585093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId: src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:35.616433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:35.633790Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:35.645539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:35.645605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:35.645692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:35.645707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:35.645755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400974188320141:5435]
2025-10-15T10:57:35.645952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:35.646293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:35.646401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400971388617056:5656]
2025-10-15T10:57:35.646489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:35.646613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:35.646626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:35.678113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 432 reason: error at write: Disconnected sessionId: src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0
2025-10-15T10:57:35.678473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 432 sessionId: src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0 is DEAD
2025-10-15T10:57:35.687584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:35.687633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0] Write session will restart in 0.008567s
2025-10-15T10:57:35.687742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0] Write session: Do CDS request
2025-10-15T10:57:35.687772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:35.701534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:35.707470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:35.707507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 433
2025-10-15T10:57:35.708845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:35.709047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:35.709065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:35.709076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:35.711013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 433 sessionId:  describe result for acl check
2025-10-15T10:57:35.711149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:35.711171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:35.711185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:35.711211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400971388617241:5979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:35.714474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400971388617241:5979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:35.725105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400971388617241:5979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:35.741939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400971388617241:5979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:35.741987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400971388617241:5979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:35.742003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400971388617241:5979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:35.742033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:35.746647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400971388617348:5656]
2025-10-15T10:57:35.823303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:35.824888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:35.825721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:35.825750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:35.825793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:35.826039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:35.826214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400974188320446:5444]
2025-10-15T10:57:35.828672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:35.829771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:35.829963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:35.831301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:35.831647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:35.831656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:35.831664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:35.831671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:35.831678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:35.831684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:35.831692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:35.831699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:35.831706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:35.831712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:35.831719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:35.831726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.831732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.831740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.831786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:35.831898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:35.831950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:35.831998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:35.832042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:35.832092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:35.832138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:35.832188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:35.832233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:35.832283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:35.832328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:35.832375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.832421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.832468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.832525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:35.832597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:35.832658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:35.832711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:35.832760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:35.832812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:35.832858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:35.832913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:35.832960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:35.833012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:35.833054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:35.833105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:35.833151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:35.833206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:35.833251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:35.833302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:35.833350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:35.833404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:35.833450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:35.833503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:35.833550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:35.833603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:35.833671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.833736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.833783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.833836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.833881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.833933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.834438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:35.853238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:35.862719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:35.862766Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:35.862785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:35.862807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:35.862834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 432 [2:7561400974188320446:5444]
2025-10-15T10:57:35.862890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:35.862954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:35.862969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:35.862983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:35.862996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:35.863054Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:35.863078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:35.863104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:35.926185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 432
2025-10-15T10:57:35.926276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 432
2025-10-15T10:57:35.926347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 432, pipe: [1:7561400971388617348:5656]
2025-10-15T10:57:35.925492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.925519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.925530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.925542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:35.925813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:35.925829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:35.925967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:35.926160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:35.926378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:35.926456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400971388617326:5979], now have 1 active actors on pipe
2025-10-15T10:57:35.926479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400971388617207:2467], now have 1 active actors on pipe
2025-10-15T10:57:35.926501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400971388617348:5656], now have 1 active actors on pipe
2025-10-15T10:57:35.926531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400974188320441:5444]
2025-10-15T10:57:35.926546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400974188320441:5444]
2025-10-15T10:57:35.926559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400974188320441:5444]
2025-10-15T10:57:35.926595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:35.926630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:35.926645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:35.926656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:35.926668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:35.926850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:35.926869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:35.926926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:35.926946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:35.927079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400974188320441:5444]
2025-10-15T10:57:35.927105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:35.927149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:35.927172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:35.927202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:35.927220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:35.927229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:35.927266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:35.927307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:35.928093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:35.928811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:35.928847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:35.928928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:35.929965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cfeddef-f8bb49-4ec67c95-cef68a2c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:35.929189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 433 partition: 0 MaxSeqNo: 46 sessionId: src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0
2025-10-15T10:57:35.954697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0] Write session: try to update token
2025-10-15T10:57:35.954759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:35.962981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:35.963014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:35.963022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:36.004187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:36.004221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:36.004234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:36.004245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:36.004278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400974188320441:5444]
2025-10-15T10:57:36.004304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400974188320441:5444]
2025-10-15T10:57:36.004326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400974188320441:5444]
2025-10-15T10:57:36.004468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:36.004490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:36.004528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:36.004539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:36.004561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:36.008782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:36.038434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId: src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:36.096506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:36.157012Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:36.158441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:36.158477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:36.160375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400971388617348:5656]
2025-10-15T10:57:36.160563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:36.160611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:36.161471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:36.161720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:36.177847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 433 reason: error at write: Disconnected sessionId: src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0
2025-10-15T10:57:36.179052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:36.179088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0] Write session will restart in 0.009163s
2025-10-15T10:57:36.179191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0] Write session: Do CDS request
2025-10-15T10:57:36.179222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:36.178231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 433 sessionId: src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0 is DEAD
2025-10-15T10:57:36.194045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:36.194074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 434
2025-10-15T10:57:36.194682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:36.195322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:36.195498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:36.195521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:36.195531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:36.197064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 434 sessionId:  describe result for acl check
2025-10-15T10:57:36.197176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:36.197192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:36.197202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:36.197221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400975683585010:5984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:36.200102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400975683585010:5984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:36.206940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400975683585010:5984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:36.222216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400975683585010:5984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:36.222260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400975683585010:5984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:36.222281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400975683585010:5984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:36.222313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:36.263895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400975683585227:5656]
2025-10-15T10:57:36.333426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:36.335628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:36.336554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:36.336771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:36.336822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:36.337097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:36.337292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400978483288006:5448]
2025-10-15T10:57:36.339676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:36.344443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:36.344700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:36.346171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:36.346520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:36.346528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:36.346536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:36.346544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:36.346552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:36.346560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:36.346568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:36.346574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:36.346581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:36.346588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:36.346596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:36.346604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.346612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.346619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.346669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:36.346791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:36.346845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:36.346894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:36.346943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:36.346994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:36.347040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:36.347087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:36.347134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:36.347188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:36.347238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:36.347286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.347336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.348073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.348135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:36.348209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:36.348274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:36.348331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:36.348386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:36.348454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:36.348504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:36.348580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:36.348637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:36.348695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:36.348742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:36.348800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:36.348852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:36.348913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:36.348961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:36.349024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:36.349075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:36.349134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:36.349604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:36.349672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:36.349724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:36.349786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:36.349835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.349893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.349941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.349998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.350048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.350107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.350911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:36.370813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:36.383956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 433, pipe: [1:7561400975683585227:5656]
2025-10-15T10:57:36.384082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 433
2025-10-15T10:57:36.384162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 433
2025-10-15T10:57:36.381563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:36.381618Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:36.381637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:36.381660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:36.381687Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 433 [2:7561400978483288006:5448]
2025-10-15T10:57:36.381746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:36.381831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:36.381848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:36.381862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:36.381876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:36.381929Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:36.381970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:36.381993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:36.383041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.383061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.383076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.383088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:36.383367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:36.383388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.383547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.383771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.384031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:36.384116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400975683585227:5656], now have 1 active actors on pipe
2025-10-15T10:57:36.384143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400975683585064:5984], now have 1 active actors on pipe
2025-10-15T10:57:36.384167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400975683584994:2467], now have 1 active actors on pipe
2025-10-15T10:57:36.384193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400978483288001:5448]
2025-10-15T10:57:36.384209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400978483288001:5448]
2025-10-15T10:57:36.384222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400978483288001:5448]
2025-10-15T10:57:36.384262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:36.384339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:36.384551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:36.384571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:36.384693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400978483288001:5448]
2025-10-15T10:57:36.384711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:36.384723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:36.384738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:36.384750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:36.384775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:36.384775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:36.384798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:36.384962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:36.384994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:36.385013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:36.385025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:36.385065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:36.385116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:36.385207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:36.386243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:36.386284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:36.386368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:36.386794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 434 partition: 0 MaxSeqNo: 46 sessionId: src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0
2025-10-15T10:57:36.391833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e15bf1-8a290ed0-59926156-67cccd49_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:36.441587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0] Write session: try to update token
2025-10-15T10:57:36.441658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:36.555573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:36.555611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:36.555623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:36.555632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:36.555665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400978483288001:5448]
2025-10-15T10:57:36.555688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400978483288001:5448]
2025-10-15T10:57:36.555710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400978483288001:5448]
2025-10-15T10:57:36.555868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:36.555878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:36.555887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:36.555983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:36.556003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:36.556927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:36.556976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:36.557008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:36.557081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:36.569049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId: src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:36.612909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:36.659191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:57:36.659244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 7
2025-10-15T10:57:36.712747Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:36.728570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:36.728619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:36.728740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:36.728754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:36.728793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400978483288001:5448]
2025-10-15T10:57:36.735205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400975683585227:5656]
2025-10-15T10:57:36.735391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:36.730648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:36.731029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:36.746388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:36.746451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 7
2025-10-15T10:57:36.746555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 434 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0
2025-10-15T10:57:36.746918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 434 sessionId: src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0 is DEAD
2025-10-15T10:57:36.749982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:36.750045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0] Write session will restart in 0.009225s
2025-10-15T10:57:36.750195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0] Write session: Do CDS request
2025-10-15T10:57:36.750244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:36.777231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:36.782062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:36.782107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 435
2025-10-15T10:57:36.784145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:36.784316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:36.784335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:36.784346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:36.785753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 435 sessionId:  describe result for acl check
2025-10-15T10:57:36.785871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:36.785880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:36.785889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:36.785905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400975683585494:5995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:36.788361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400975683585494:5995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:36.795743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400975683585494:5995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:36.804722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400975683585494:5995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:36.804778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400975683585494:5995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:36.804794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400975683585494:5995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:36.804821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:36.834906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400975683585699:5656]
2025-10-15T10:57:36.877533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:36.881919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:36.882619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:36.882636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:36.882679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:36.882899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:36.883065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400978483288298:5457]
2025-10-15T10:57:36.884782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:36.885711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:36.885871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:36.886707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:36.886959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:36.886973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:36.886980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:36.886987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:36.886993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:36.886998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:36.887021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:36.887027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:36.887032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:36.887039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:36.887046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:36.887052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.887061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.887068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.887111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:36.887215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:36.887260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:36.887310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:36.887394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:36.887448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:36.887497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:36.887544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:36.887602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:36.887659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:36.887718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:36.887758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.887801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.887850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.887915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:36.887981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:36.888041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:36.888098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:36.888148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:36.888219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:36.888273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:36.888330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:36.888382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:36.888449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:36.888495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:36.888579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:36.888639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:36.888694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:36.888740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:36.888804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:36.888858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:36.888910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:36.888957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:36.889013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:36.889065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:36.889119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:36.889167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.889221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.889266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.889322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.889373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.889429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.889942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:36.913772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:36.922718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:36.922753Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:36.922768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:36.922785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:36.922807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 434 [2:7561400978483288298:5457]
2025-10-15T10:57:36.922849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:36.922890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:36.922899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:36.922907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:36.922916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:36.922954Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:36.922970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:36.922990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:36.940846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.940876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.940887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.940898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:36.941218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:36.941254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:36.941392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:36.941573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:36.941836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:36.941945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400975683585485:2467], now have 1 active actors on pipe
2025-10-15T10:57:36.941980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400975683585699:5656], now have 1 active actors on pipe
2025-10-15T10:57:36.942001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400975683585543:5995], now have 1 active actors on pipe
2025-10-15T10:57:36.942151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:36.942186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:36.942224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400978483288293:5457]
2025-10-15T10:57:36.942245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400978483288293:5457]
2025-10-15T10:57:36.942260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400978483288293:5457]
2025-10-15T10:57:36.942303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:36.942354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:36.942382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:36.942385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:36.942396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:36.942589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:36.942624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:36.942775Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:57:36.942901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:36.942936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:36.942957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:36.942968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:36.943002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:36.943046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:36.943179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400978483288293:5457]
2025-10-15T10:57:36.943231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:36.943281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:36.943284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:36.941534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 434
2025-10-15T10:57:36.941644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 434, pipe: [1:7561400975683585699:5656]
2025-10-15T10:57:36.941728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 434
2025-10-15T10:57:36.943744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:36.943771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:36.943828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:36.944058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 435 partition: 0 MaxSeqNo: 46 sessionId: src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0
2025-10-15T10:57:36.944096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 8 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:57:36.944227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:57:36.944721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df8a3e1-621341b2-f1279dab-6e6e99be_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:36.964833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0] Write session: try to update token
2025-10-15T10:57:36.964889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:37.002042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:37.002080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:37.002100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:37.002112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:37.002154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400978483288293:5457]
2025-10-15T10:57:37.002185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400978483288293:5457]
2025-10-15T10:57:37.002214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400978483288293:5457]
2025-10-15T10:57:37.002373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:37.002408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:37.002797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:37.002847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:37.002878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:37.007756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:37.070548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId: src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:37.091115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:37.158065Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:37.160593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:37.160785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400975683585699:5656]
2025-10-15T10:57:37.160873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:37.160911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:37.159768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:37.159816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:37.164125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:37.212365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 435 reason: error at write: Disconnected sessionId: src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0
2025-10-15T10:57:37.212697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 435 sessionId: src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0 is DEAD
2025-10-15T10:57:37.213128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:37.213197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0] Write session will restart in 0.007680s
2025-10-15T10:57:37.213488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0] Write session: Do CDS request
2025-10-15T10:57:37.213541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:37.226047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:37.226114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:37.226147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 436
2025-10-15T10:57:37.226596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:37.226706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:37.226721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:37.226732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:37.228050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 436 sessionId:  describe result for acl check
2025-10-15T10:57:37.228148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:37.228159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:37.228169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:37.228186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400979978553443:6003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:37.230694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400979978553443:6003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:37.237177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400979978553443:6003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:37.253036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400979978553443:6003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:37.253080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400979978553443:6003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:37.253096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400979978553443:6003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:37.253125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:37.260847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400979978553583:5656]
2025-10-15T10:57:37.313137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:37.317574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:37.318585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:37.318607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:37.318656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:37.318952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:37.319157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400982778255883:5469]
2025-10-15T10:57:37.321358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:37.324303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:37.324590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:37.326034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:37.326392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:37.326401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:37.326409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:37.326417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:37.326426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:37.326433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:37.326440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:37.326448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:37.326456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:37.326464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:37.326473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:37.326481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.326488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.326494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.326548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:37.326675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:37.326732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:37.326786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:37.326838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:37.326891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:37.326945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:37.326995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:37.327047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:37.327101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:37.327153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:37.327203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.327250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.327303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.327505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:37.327588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:37.327657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:37.327718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:37.327774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:37.327833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:37.327882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:37.327951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:37.328003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:37.328065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:37.328110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:37.328162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:37.328212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:37.328268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:37.328312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:37.328366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:37.328417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:37.328471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:37.328516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:37.328584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:37.328634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:37.328689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:37.328737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.328795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.328848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.328909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.328961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.329018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.329562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:37.349079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:37.358616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:37.358654Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:37.358668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:37.358685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:37.358703Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 435 [2:7561400982778255883:5469]
2025-10-15T10:57:37.358741Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:37.358794Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:37.358806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:37.358815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:37.358824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:37.358864Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:37.358882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:37.358899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:37.360322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.360346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.360359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.360370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:37.360648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:37.360673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.360824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.361021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.361306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:37.362002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 435
2025-10-15T10:57:37.361415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400979978553291:2467], now have 1 active actors on pipe
2025-10-15T10:57:37.361441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400979978553583:5656], now have 1 active actors on pipe
2025-10-15T10:57:37.362093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 435, pipe: [1:7561400979978553583:5656]
2025-10-15T10:57:37.361462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400979978553563:6003], now have 1 active actors on pipe
2025-10-15T10:57:37.361488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400982778255878:5469]
2025-10-15T10:57:37.361504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400982778255878:5469]
2025-10-15T10:57:37.362167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 435
2025-10-15T10:57:37.361517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400982778255878:5469]
2025-10-15T10:57:37.361554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:37.361611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:37.361627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:37.361632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:37.361641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:37.361834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:37.361851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:37.361975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400982778255878:5469]
2025-10-15T10:57:37.362131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:37.362225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:37.362414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:37.362437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:37.362550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4721b80-83237f30-700857-8effa961_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:37.362590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:37.362610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:37.362620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:37.362659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:37.362708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:37.362760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:37.363270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:37.363297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:37.363372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:37.367605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 436 partition: 0 MaxSeqNo: 46 sessionId: src_id|c4721b80-83237f30-700857-8effa961_0
2025-10-15T10:57:37.371978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b8c8fd-b1935738-4ac444ef-713a1183_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c4721b80-83237f30-700857-8effa961_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:37.408109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4721b80-83237f30-700857-8effa961_0] Write session: try to update token
2025-10-15T10:57:37.408173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4721b80-83237f30-700857-8effa961_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:37.457756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:37.457793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:37.457808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:37.457820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:37.457863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400982778255878:5469]
2025-10-15T10:57:37.457891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400982778255878:5469]
2025-10-15T10:57:37.457916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400982778255878:5469]
2025-10-15T10:57:37.458047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:37.458070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:37.458083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:37.458096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:37.458117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:37.459446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:37.563463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId: src_id|c4721b80-83237f30-700857-8effa961_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:37.598039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:37.611476Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:37.612900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:37.612925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:37.615977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:37.616175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400979978553583:5656]
2025-10-15T10:57:37.616270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:37.616284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:37.625963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4721b80-83237f30-700857-8effa961_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:37.626036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4721b80-83237f30-700857-8effa961_0] Write session will restart in 0.007522s
2025-10-15T10:57:37.626223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4721b80-83237f30-700857-8effa961_0] Write session: Do CDS request
2025-10-15T10:57:37.626279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4721b80-83237f30-700857-8effa961_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:37.624078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 436 reason: error at write: Disconnected sessionId: src_id|c4721b80-83237f30-700857-8effa961_0
2025-10-15T10:57:37.624455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 436 sessionId: src_id|c4721b80-83237f30-700857-8effa961_0 is DEAD
2025-10-15T10:57:37.630844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:37.638619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:37.638654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 437
2025-10-15T10:57:37.638918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4721b80-83237f30-700857-8effa961_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:37.639380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:37.639497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:37.639528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:37.639538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:37.641251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 437 sessionId:  describe result for acl check
2025-10-15T10:57:37.641352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:37.641367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:37.641375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:37.641391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400979978553782:6008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:37.643850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400979978553782:6008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:37.653624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400979978553782:6008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:37.672952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400979978553782:6008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:37.672995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400979978553782:6008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:37.673016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400979978553782:6008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:37.673048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:37.717159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400979978554181:5656]
2025-10-15T10:57:37.742436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:37.744499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:37.745371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:37.745393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:37.745439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:37.745709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:37.745911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400982778256149:5471]
2025-10-15T10:57:37.748229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:37.749312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:37.749561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:37.750938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:37.751314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:37.751335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:37.751363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:37.751372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:37.751380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:37.751388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:37.751396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:37.751405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:37.751412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:37.751419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:37.751428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:37.751436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.751445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.751452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.751506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:37.751642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:37.751694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:37.751749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:37.751803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:37.751854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:37.751902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:37.751963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:37.752013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:37.752065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:37.752124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:37.752181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.752236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.752296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.752355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:37.752448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:37.752519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:37.752597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:37.752658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:37.752722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:37.752776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:37.752841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:37.752892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:37.752954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:37.753010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:37.753088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:37.753147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:37.753212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:37.753263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:37.753325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:37.753383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:37.753458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:37.753517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:37.753582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:37.753643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:37.753707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:37.753759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.753821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.753877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.753942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.753995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.754057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.754621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:37.786305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:37.794689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:37.794734Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:37.794752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:37.794772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:37.794804Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 436 [2:7561400982778256149:5471]
2025-10-15T10:57:37.794863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:37.794929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:37.794949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:37.794962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:37.794974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:37.795027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:37.795056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:37.795081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:37.795905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.795932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.795947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.795959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:37.796215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:37.796240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:37.796366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:37.796568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:37.796712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 436
2025-10-15T10:57:37.796809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 436, pipe: [1:7561400979978554181:5656]
2025-10-15T10:57:37.796842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:37.796887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 436
2025-10-15T10:57:37.796935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400979978553832:6008], now have 1 active actors on pipe
2025-10-15T10:57:37.796967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400979978554181:5656], now have 1 active actors on pipe
2025-10-15T10:57:37.796991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400979978553769:2467], now have 1 active actors on pipe
2025-10-15T10:57:37.797017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400982778256144:5471]
2025-10-15T10:57:37.797034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400982778256144:5471]
2025-10-15T10:57:37.797046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400982778256144:5471]
2025-10-15T10:57:37.797087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:37.797128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:37.797148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:37.797160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:37.797162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:37.797355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:37.797385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:37.797537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:37.797564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:37.797613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400982778256144:5471]
2025-10-15T10:57:37.797648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:37.797692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:37.797777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:37.797811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:37.797836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:37.797846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:37.797883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:37.797918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:37.798011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:37.798819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:37.798847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:37.798913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:37.799315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 437 partition: 0 MaxSeqNo: 46 sessionId: src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0
2025-10-15T10:57:37.800027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4721b80-83237f30-700857-8effa961_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:37.827026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0] Write session: try to update token
2025-10-15T10:57:37.827067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:37.890417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:37.890455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:37.890466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:37.890476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:37.890506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400982778256144:5471]
2025-10-15T10:57:37.890533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400982778256144:5471]
2025-10-15T10:57:37.890556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400982778256144:5471]
2025-10-15T10:57:37.890689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:37.890739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:37.890761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:37.890780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:37.890782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:37.892318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:37.912046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId: src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:37.934806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:38.030844Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:38.050020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:38.050075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:38.050138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:38.050152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:38.050194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400982778256144:5471]
2025-10-15T10:57:38.050429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:38.050819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:38.051995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400979978554181:5656]
2025-10-15T10:57:38.052094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:38.052211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:38.078096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 437 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0
2025-10-15T10:57:38.078361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 437 sessionId: src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0 is DEAD
2025-10-15T10:57:38.079720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:38.079753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0] Write session will restart in 0.008965s
2025-10-15T10:57:38.079842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0] Write session: Do CDS request
2025-10-15T10:57:38.079869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:38.094175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:38.101742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:38.101770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 438
2025-10-15T10:57:38.102106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:38.102223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:38.102244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:38.102253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:38.103678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 438 sessionId:  describe result for acl check
2025-10-15T10:57:38.103792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:38.103810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:38.103819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:38.103835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400984273521606:6019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:38.106236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400984273521606:6019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:38.112515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400984273521606:6019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:38.125540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400984273521606:6019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:38.125580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400984273521606:6019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:38.125596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400984273521606:6019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:38.125622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:38.149189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400984273521846:5656]
2025-10-15T10:57:38.190882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:38.192991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:38.193586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:38.193604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:38.193629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:38.193798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:38.193907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400987073223740:5481]
2025-10-15T10:57:38.195509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:38.196278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:38.196500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:38.197619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:38.197895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:38.197901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:38.197906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:38.197911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:38.197917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:38.197931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:38.197937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:38.197943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:38.197949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:38.197953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:38.197960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:38.197965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.197969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.197972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.198004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:38.198080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:38.198114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:38.198157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:38.198198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:38.198236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:38.198266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:38.198305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:38.198348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:38.198382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:38.198415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:38.198457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.198498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.198537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.198574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:38.198636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:38.198686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:38.198736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:38.198780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:38.198842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:38.198883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:38.198932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:38.198977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:38.199025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:38.199067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:38.199113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:38.199141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:38.199180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:38.199221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:38.199266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:38.199308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:38.199379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:38.199420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:38.199480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:38.199543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:38.199602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:38.199645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.199692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.199735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.199783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.199820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.199866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.200322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:38.227958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:38.238502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:38.238546Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:38.238563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:38.238580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:38.238602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 437 [2:7561400987073223740:5481]
2025-10-15T10:57:38.238650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:38.238702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:38.238716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:38.238726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:38.238738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:38.238781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:38.238802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:38.238822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:38.240941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.240970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.240984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.240994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:38.241251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:38.241273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.241402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.241572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.241798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:38.241865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400987073223735:5481]
2025-10-15T10:57:38.241882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400987073223735:5481]
2025-10-15T10:57:38.241893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400987073223735:5481]
2025-10-15T10:57:38.241930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:38.241998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:38.242096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:38.242117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:38.242139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:38.242157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:38.242171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:38.242271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400987073223735:5481]
2025-10-15T10:57:38.242294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:38.242393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:38.242607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400984273521748:6019], now have 1 active actors on pipe
2025-10-15T10:57:38.242642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400984273521846:5656], now have 1 active actors on pipe
2025-10-15T10:57:38.242662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400984273521573:2467], now have 1 active actors on pipe
2025-10-15T10:57:38.242750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 437
2025-10-15T10:57:38.242824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 437, pipe: [1:7561400984273521846:5656]
2025-10-15T10:57:38.242908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 437
2025-10-15T10:57:38.242904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:38.242937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:38.243000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:38.243049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:38.243071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:38.243081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:38.243111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:38.243150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:38.243224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:38.248835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:38.248869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:38.248938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:38.250515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 438 partition: 0 MaxSeqNo: 46 sessionId: src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0
2025-10-15T10:57:38.251147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2484e99e-cd95c35f-5793dc2b-36e598a8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:38.295111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0] Write session: try to update token
2025-10-15T10:57:38.295164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:38.447592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:38.447625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:38.447638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:38.447782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:38.447799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:38.447812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:38.447824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:38.447861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400987073223735:5481]
2025-10-15T10:57:38.447894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400987073223735:5481]
2025-10-15T10:57:38.447929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400987073223735:5481]
2025-10-15T10:57:38.448365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:38.448410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:38.448442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:38.457057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId: src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:38.475962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:38.476014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:38.477189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:38.487491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:38.622446Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:38.623942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:38.623984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:38.624035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400987073223735:5481]
2025-10-15T10:57:38.624173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:38.624203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:38.624231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:38.624829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:38.624865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:38.626261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:38.626517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400984273521846:5656]
2025-10-15T10:57:38.624880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:38.671869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 438 reason: error at write: Disconnected sessionId: src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0
2025-10-15T10:57:38.672215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 438 sessionId: src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0 is DEAD
2025-10-15T10:57:38.672686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:38.672748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0] Write session will restart in 0.006357s
2025-10-15T10:57:38.672941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0] Write session: Do CDS request
2025-10-15T10:57:38.672986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:38.685316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:38.687628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:38.687664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 439
2025-10-15T10:57:38.688025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:38.688185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:38.688214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:38.688226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:38.691152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 439 sessionId:  describe result for acl check
2025-10-15T10:57:38.691325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:38.691374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:38.691396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:38.691426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400984273522118:6027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:38.694921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400984273522118:6027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:38.702785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400984273522118:6027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:38.711247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400984273522118:6027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:38.711287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400984273522118:6027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:38.711305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400984273522118:6027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:38.711334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:38.726754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400984273522428:5656]
2025-10-15T10:57:38.827922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:38.832866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:38.833736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:38.833770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:38.833812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:38.834074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:38.834258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400987073224047:5490]
2025-10-15T10:57:38.836578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:38.837592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:38.837827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:38.839145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:38.839505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:38.839523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:38.839530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:38.839537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:38.839544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:38.839552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:38.839560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:38.839567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:38.839575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:38.839583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:38.839591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:38.839598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.839605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.839612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.839662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:38.839788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:38.839844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:38.839900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:38.839955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:38.840009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:38.840061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:38.840115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:38.840163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:38.840217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:38.840273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:38.840324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.840376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.840426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.840472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:38.840540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:38.840622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:38.840691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:38.840742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:38.840799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:38.840847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:38.840905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:38.840958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:38.841013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:38.841063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:38.841119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:38.841167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:38.841220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:38.841270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:38.841325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:38.841377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:38.841432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:38.841480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:38.841538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:38.841591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:38.841645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:38.841690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.841749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.841805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.841861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.841906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.841964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.842493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:38.860717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:38.870213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:38.870262Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:38.870283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:38.870304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:38.870329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 438 [2:7561400987073224047:5490]
2025-10-15T10:57:38.870384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:38.870450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:38.870465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:38.870478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:38.870492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:38.870545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:38.870569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:38.870593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:38.871696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.871727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.871744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.871757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:38.872017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:38.872046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:38.872202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:38.872415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:38.872677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:38.872762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400987073224042:5490]
2025-10-15T10:57:38.872783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400987073224042:5490]
2025-10-15T10:57:38.872797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400987073224042:5490]
2025-10-15T10:57:38.872836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:38.872917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:38.873117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:38.873134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:38.873143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:38.873148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:38.873159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:38.873285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400984273522281:6027], now have 1 active actors on pipe
2025-10-15T10:57:38.873316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400984273522067:2467], now have 1 active actors on pipe
2025-10-15T10:57:38.873339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400984273522428:5656], now have 1 active actors on pipe
2025-10-15T10:57:38.873357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400987073224042:5490]
2025-10-15T10:57:38.873378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:38.873445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:38.873533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:38.873561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:38.873646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:38.873683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:38.873706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:38.873717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:38.873757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:38.873803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:38.873862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:38.874359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:38.874394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:38.874454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:38.873330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 438
2025-10-15T10:57:38.873360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 438
2025-10-15T10:57:38.873423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 438, pipe: [1:7561400984273522428:5656]
2025-10-15T10:57:38.874740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 439 partition: 0 MaxSeqNo: 46 sessionId: src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0
2025-10-15T10:57:38.875517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a98886b-d0afeb29-d8503228-e0baae8a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:38.907617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0] Write session: try to update token
2025-10-15T10:57:38.907686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:39.006939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:39.006974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:39.006988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:39.006999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:39.007034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400987073224042:5490]
2025-10-15T10:57:39.007071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400987073224042:5490]
2025-10-15T10:57:39.007095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400987073224042:5490]
2025-10-15T10:57:39.007237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:39.007263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:39.007277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:39.007278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:39.007290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:39.007313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:39.007417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:39.007438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:39.008379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:39.024381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId: src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:39.045573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:39.151511Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:39.161442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:39.161496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:39.161578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:39.161593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:39.161636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400987073224042:5490]
2025-10-15T10:57:39.161885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:39.162216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:39.162498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:39.162531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:39.163751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:39.164008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400984273522428:5656]
2025-10-15T10:57:39.191180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 439 reason: error at write: Disconnected sessionId: src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0
2025-10-15T10:57:39.191465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 439 sessionId: src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0 is DEAD
2025-10-15T10:57:39.198289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:39.198332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0] Write session will restart in 0.008192s
2025-10-15T10:57:39.198430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0] Write session: Do CDS request
2025-10-15T10:57:39.198462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:39.215879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:39.215913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 440
2025-10-15T10:57:39.216976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:39.217581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:39.217728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:39.217749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:39.217759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:39.221098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 440 sessionId:  describe result for acl check
2025-10-15T10:57:39.221192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:39.221199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:39.221205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:39.221217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400988568489915:6034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:39.224912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400988568489915:6034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:39.234110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400988568489915:6034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:39.246379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400988568489915:6034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:39.246421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400988568489915:6034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:39.246440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400988568489915:6034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:39.246472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:39.264381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400988568490139:5656]
2025-10-15T10:57:39.305600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:39.307636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:39.308448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:39.308479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:39.308523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:39.308792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:39.308968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400991368191610:5494]
2025-10-15T10:57:39.311238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:39.312258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:39.312496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:39.313626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:39.313896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:39.313902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:39.313909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:39.313917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:39.313924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:39.313932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:39.313939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:39.313947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:39.313955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:39.313961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:39.313968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:39.313975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.313982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.313990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.314040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:39.314154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:39.314204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:39.314252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:39.314298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:39.314344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:39.314376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:39.314408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:39.314447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:39.314482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:39.314515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:39.314547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.314588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.314631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.314662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:39.314725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:39.314767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:39.314813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:39.314861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:39.314900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:39.314937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:39.314991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:39.315043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:39.315099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:39.315147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:39.315203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:39.315252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:39.315307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:39.315417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:39.315474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:39.315527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:39.315582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:39.315626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:39.315681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:39.315731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:39.315787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:39.315834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.315887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.315933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.315997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.316041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.316096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.316631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:39.334501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:39.346909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:39.346956Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:39.346973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:39.346992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:39.347019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 439 [2:7561400991368191610:5494]
2025-10-15T10:57:39.347076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:39.347138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:39.347153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:39.347166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:39.347178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:39.347232Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:39.347264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:39.347309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:39.348174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.348198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.348212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.348224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:39.348436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:39.348461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.348605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.348816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.349042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:39.349121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400991368191605:5494]
2025-10-15T10:57:39.349137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400991368191605:5494]
2025-10-15T10:57:39.349152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400991368191605:5494]
2025-10-15T10:57:39.349192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:39.349271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:39.349472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:39.349493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:39.349616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400991368191605:5494]
2025-10-15T10:57:39.349638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:39.349884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:39.349902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:39.349913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:39.349938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:39.350784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400988568490035:6034], now have 1 active actors on pipe
2025-10-15T10:57:39.350818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400988568490139:5656], now have 1 active actors on pipe
2025-10-15T10:57:39.350844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400988568489862:2467], now have 1 active actors on pipe
2025-10-15T10:57:39.355457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 439, pipe: [1:7561400988568490139:5656]
2025-10-15T10:57:39.355570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 439
2025-10-15T10:57:39.355664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 439
2025-10-15T10:57:39.359509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:39.359549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:39.359639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8779d6b9-80a1bc11-4843de48-40da4622_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:39.359675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:39.359693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:39.359705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:39.359744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:39.359792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:39.359848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:39.363181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 440 partition: 0 MaxSeqNo: 46 sessionId: src_id|8779d6b9-80a1bc11-4843de48-40da4622_0
2025-10-15T10:57:39.364482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90969d5d-391895e1-18d143ba-a9ad4fe8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8779d6b9-80a1bc11-4843de48-40da4622_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:39.362656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:39.362693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:39.362774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:39.384572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8779d6b9-80a1bc11-4843de48-40da4622_0] Write session: try to update token
2025-10-15T10:57:39.384627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8779d6b9-80a1bc11-4843de48-40da4622_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:39.443326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:39.443381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:39.443400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:39.443413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:39.443447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400991368191605:5494]
2025-10-15T10:57:39.443483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400991368191605:5494]
2025-10-15T10:57:39.443515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400991368191605:5494]
2025-10-15T10:57:39.443673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:39.443720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:39.443757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:39.443825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:39.443864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:39.445004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:39.479506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId: src_id|8779d6b9-80a1bc11-4843de48-40da4622_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:39.502637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:39.583186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:39.618159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:39.618211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:39.618277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:39.618291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:39.618328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400991368191605:5494]
2025-10-15T10:57:39.618510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:39.618916Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:39.619486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:39.619615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:39.619625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:39.631504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 440 reason: error at write: Disconnected sessionId: src_id|8779d6b9-80a1bc11-4843de48-40da4622_0
2025-10-15T10:57:39.631844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 440 sessionId: src_id|8779d6b9-80a1bc11-4843de48-40da4622_0 is DEAD
2025-10-15T10:57:39.632756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8779d6b9-80a1bc11-4843de48-40da4622_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:39.632804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8779d6b9-80a1bc11-4843de48-40da4622_0] Write session will restart in 0.009463s
2025-10-15T10:57:39.632928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8779d6b9-80a1bc11-4843de48-40da4622_0] Write session: Do CDS request
2025-10-15T10:57:39.632955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8779d6b9-80a1bc11-4843de48-40da4622_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:39.647244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8779d6b9-80a1bc11-4843de48-40da4622_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:39.659560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400988568490139:5656]
2025-10-15T10:57:39.659730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:39.659750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 441
2025-10-15T10:57:39.660441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:39.660554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:39.660582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:39.660592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:39.661996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 441 sessionId:  describe result for acl check
2025-10-15T10:57:39.662104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:39.662120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:39.662129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:39.662143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400988568490371:6045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:39.664518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400988568490371:6045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:39.669628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400988568490371:6045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:39.677422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400988568490371:6045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:39.677461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400988568490371:6045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:39.677477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400988568490371:6045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:39.677506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:39.760446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400988568490818:5656]
2025-10-15T10:57:39.763905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:39.769944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:39.771109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:39.771127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:39.771172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:39.771462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:39.771643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400991368191893:5502]
2025-10-15T10:57:39.773902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:39.774741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:39.774942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:39.776245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:39.776593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:39.776601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:39.776608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:39.776615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:39.776622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:39.776629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:39.776636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:39.776644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:39.776651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:39.776658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:39.776665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:39.776672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.776678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.776686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.776732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:39.776842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:39.776892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:39.776939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:39.776982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:39.777029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:39.777072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:39.777116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:39.777162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:39.777212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:39.777256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:39.777302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.777347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.777391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.777433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:39.777499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:39.777558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:39.777613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:39.777659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:39.777713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:39.777755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:39.777807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:39.777854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:39.777905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:39.777955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:39.778008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:39.778053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:39.778106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:39.778154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:39.778209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:39.778257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:39.778310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:39.778354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:39.778409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:39.778455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:39.778509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:39.778557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.778612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.778660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.778715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.778762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.778817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.779311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:39.802445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:39.832611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:39.832657Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:39.832670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:39.832686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:39.832708Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 440 [2:7561400991368191893:5502]
2025-10-15T10:57:39.832751Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:39.832801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:39.832814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:39.832825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:39.832835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:39.832877Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:39.832897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:39.832916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:39.834845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.834859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.834871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.834881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:39.835641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 440
2025-10-15T10:57:39.835139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:39.835156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:39.835738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 440, pipe: [1:7561400988568490818:5656]
2025-10-15T10:57:39.835277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:39.835820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 440
2025-10-15T10:57:39.835913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:39.836130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:39.836204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400988568490356:2467], now have 1 active actors on pipe
2025-10-15T10:57:39.836225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400988568490818:5656], now have 1 active actors on pipe
2025-10-15T10:57:39.836244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400988568490417:6045], now have 1 active actors on pipe
2025-10-15T10:57:39.836263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400991368191888:5502]
2025-10-15T10:57:39.836277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400991368191888:5502]
2025-10-15T10:57:39.836287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400991368191888:5502]
2025-10-15T10:57:39.836327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:39.836357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:39.836379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:39.836392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:39.836409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:39.836562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:39.836589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:39.836664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:39.836682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:39.836798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400991368191888:5502]
2025-10-15T10:57:39.836823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:39.836842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:39.836886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:39.836911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:39.836928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:39.836938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:39.836967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:39.836999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:39.837111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:39.842607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:39.842638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:39.842698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:39.843028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 441 partition: 0 MaxSeqNo: 46 sessionId: src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0
2025-10-15T10:57:39.843830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8779d6b9-80a1bc11-4843de48-40da4622_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:39.891125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0] Write session: try to update token
2025-10-15T10:57:39.891187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:39.940849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:39.940880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:39.940893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:39.940903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:39.940934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400991368191888:5502]
2025-10-15T10:57:39.940989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400991368191888:5502]
2025-10-15T10:57:39.941012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400991368191888:5502]
2025-10-15T10:57:39.941131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:39.941155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:39.941166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:39.941176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:39.941176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:39.941203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:39.965363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:39.965444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:39.968386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:40.001945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId: src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:40.026018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:40.107700Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:40.131660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:40.131688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:40.131725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400991368191888:5502]
2025-10-15T10:57:40.131820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:40.131852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:40.131874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:40.132436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:40.132517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:40.132660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400988568490818:5656]
2025-10-15T10:57:40.132723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:40.132734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:40.167296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:40.167363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0] Write session will restart in 0.009866s
2025-10-15T10:57:40.167438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0] Write session: Do CDS request
2025-10-15T10:57:40.167461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:40.166642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 441 reason: error at write: Disconnected sessionId: src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0
2025-10-15T10:57:40.166913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 441 sessionId: src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0 is DEAD
2025-10-15T10:57:40.181608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:40.182098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:40.182138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 442
2025-10-15T10:57:40.182483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:40.182583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:40.182607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:40.182616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:40.183777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 442 sessionId:  describe result for acl check
2025-10-15T10:57:40.183875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:40.183891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:40.183900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:40.183916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400992863458214:6053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:40.186352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400992863458214:6053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:40.192260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400992863458214:6053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:40.203138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400992863458214:6053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:40.203173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400992863458214:6053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:40.203187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400992863458214:6053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:40.203213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:40.232541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400992863458590:5656]
2025-10-15T10:57:40.252444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:40.257458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:40.258359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:40.258377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:40.258419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:40.258658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:40.258839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400995663159499:5513]
2025-10-15T10:57:40.261071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:40.261897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:40.262109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:40.263329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:40.263680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:40.263700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:40.263708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:40.263715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:40.263722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:40.263730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:40.263736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:40.263743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:40.263749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:40.263757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:40.263764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:40.263771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.263777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.263784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.263832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:40.263940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:40.263987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:40.264035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:40.264080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:40.264136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:40.264181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:40.264222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:40.264266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:40.264313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:40.264356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:40.264400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.264445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.264485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.264528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:40.264607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:40.264663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:40.264716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:40.264766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:40.264819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:40.264859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:40.264907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:40.264952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:40.265001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:40.265042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:40.265090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:40.265134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:40.265184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:40.265228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:40.265277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:40.265321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:40.265370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:40.265412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:40.265464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:40.265507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:40.265557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:40.265598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.265647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.265691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.265741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.265786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.265836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.266332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:40.286929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:40.312320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:40.312356Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:40.312366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:40.312379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:40.312396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 441 [2:7561400995663159499:5513]
2025-10-15T10:57:40.312445Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:40.312492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:40.312503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:40.312512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:40.312520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:40.312560Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:40.312594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:40.312613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:40.314701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 441
2025-10-15T10:57:40.314771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 441, pipe: [1:7561400992863458590:5656]
2025-10-15T10:57:40.314839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 441
2025-10-15T10:57:40.313494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.313513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.313522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.313529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:40.313719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:40.313728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.313835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.314010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.314234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:40.314313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400992863458161:2467], now have 1 active actors on pipe
2025-10-15T10:57:40.314336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400992863458355:6053], now have 1 active actors on pipe
2025-10-15T10:57:40.314356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400992863458590:5656], now have 1 active actors on pipe
2025-10-15T10:57:40.314378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400995663159494:5513]
2025-10-15T10:57:40.314392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400995663159494:5513]
2025-10-15T10:57:40.314406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400995663159494:5513]
2025-10-15T10:57:40.314444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:40.314512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:40.314673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:40.314689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:40.314800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400995663159494:5513]
2025-10-15T10:57:40.314818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:40.314980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:40.314988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:40.314995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:40.315009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:40.315478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:40.315503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:40.315583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:40.315612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:40.315630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:40.315640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:40.315672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:40.315703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:40.315744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:40.316549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:40.316594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:40.316654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:40.317637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e61ea1-c3750d7d-aed147bd-f878b56a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:40.316939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 442 partition: 0 MaxSeqNo: 46 sessionId: src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0
2025-10-15T10:57:40.350052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0] Write session: try to update token
2025-10-15T10:57:40.350104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:40.436007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:40.436038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:40.436049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:40.436056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:40.436081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400995663159494:5513]
2025-10-15T10:57:40.436098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400995663159494:5513]
2025-10-15T10:57:40.436113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400995663159494:5513]
2025-10-15T10:57:40.436270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:40.436304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:40.436313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:40.436323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:40.436331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:40.436332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:40.436377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:40.436398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:40.437314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:40.453416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId: src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:40.474238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:40.583616Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:40.603956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:40.604013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:40.604086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:40.604102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:40.604146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400995663159494:5513]
2025-10-15T10:57:40.604467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:40.604865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:40.604796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:40.604957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400992863458590:5656]
2025-10-15T10:57:40.605037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:40.605049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:40.627396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 442 reason: error at write: Disconnected sessionId: src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0
2025-10-15T10:57:40.627769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 442 sessionId: src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0 is DEAD
2025-10-15T10:57:40.628998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:40.629070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0] Write session will restart in 0.006463s
2025-10-15T10:57:40.629246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0] Write session: Do CDS request
2025-10-15T10:57:40.629301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:40.641358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:40.641387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 443
2025-10-15T10:57:40.643912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:40.645231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:40.645377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:40.645400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:40.645408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:40.647280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 443 sessionId:  describe result for acl check
2025-10-15T10:57:40.647417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:40.647439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:40.647455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:40.647472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400992863458662:6058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:40.650003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400992863458662:6058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:40.655716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400992863458662:6058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:40.664143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400992863458662:6058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:40.664185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400992863458662:6058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:40.664208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400992863458662:6058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:40.664241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:40.705391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400992863459054:5656]
2025-10-15T10:57:40.725243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:40.727184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:40.728057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:40.728083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:40.728127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:40.728470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:40.728673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400995663159769:5515]
2025-10-15T10:57:40.730886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:40.731832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:40.732067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:40.733293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:40.733613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:40.733631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:40.733637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:40.733646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:40.733653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:40.733659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:40.733666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:40.733672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:40.733677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:40.733682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:40.733688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:40.733693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.733700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.733706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.733750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:40.733848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:40.733895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:40.733939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:40.733983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:40.734027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:40.734079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:40.734127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:40.734177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:40.734232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:40.734277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:40.734319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.734370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.734420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.734465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:40.734532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:40.734594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:40.734652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:40.734703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:40.734762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:40.734813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:40.734869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:40.734922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:40.734975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:40.735021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:40.735077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:40.735126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:40.735182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:40.735229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:40.735283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:40.735331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:40.735744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:40.735806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:40.735867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:40.735919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:40.735977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:40.736031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.736092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.736147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.736197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.736239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.736292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.736793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:40.756036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:40.774749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:40.774780Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:40.774794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:40.774810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:40.774832Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 442 [2:7561400995663159769:5515]
2025-10-15T10:57:40.774866Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:40.774910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:40.774921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:40.774931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:40.774941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:40.774973Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:40.774988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:40.775001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:40.776351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.776371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.776382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.776393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:40.776579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:40.776608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:40.776709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:40.777135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 442
2025-10-15T10:57:40.777266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 442
2025-10-15T10:57:40.777339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 442, pipe: [1:7561400992863459054:5656]
2025-10-15T10:57:40.776878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:40.777086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:40.777155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400992863458644:2467], now have 1 active actors on pipe
2025-10-15T10:57:40.777175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400992863458738:6058], now have 1 active actors on pipe
2025-10-15T10:57:40.777194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400992863459054:5656], now have 1 active actors on pipe
2025-10-15T10:57:40.777217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400995663159764:5515]
2025-10-15T10:57:40.777229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400995663159764:5515]
2025-10-15T10:57:40.777240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400995663159764:5515]
2025-10-15T10:57:40.777267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:40.777325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:40.777408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:40.777424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:40.777435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:40.777481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:40.777496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:40.777609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400995663159764:5515]
2025-10-15T10:57:40.777644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:40.777702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:40.777703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:40.777720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:40.777848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:40.777874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:40.777890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:40.777898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:40.777926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:40.777961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:40.778022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:40.778828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:40.778854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:40.778924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:40.779234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 443 partition: 0 MaxSeqNo: 46 sessionId: src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0
2025-10-15T10:57:40.779843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d879c79c-caf3ecd6-ff99ddcb-5e6df04b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:40.804491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0] Write session: try to update token
2025-10-15T10:57:40.804545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0] Send 10 message(s) (0 left), first sequence number is 47
E1015 10:57:40.821345619  821866 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:57:40.824049Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:57:40.858103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:40.858133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:40.858143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:40.858151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:40.858178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400995663159764:5515]
2025-10-15T10:57:40.858199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400995663159764:5515]
2025-10-15T10:57:40.858218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400995663159764:5515]
2025-10-15T10:57:40.858307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:40.858336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:40.858361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:40.858385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:40.858403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:40.861858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:40.897318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId: src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:40.918340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:41.008808Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:41.027455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:41.027498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:41.027551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:41.027562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:41.027598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400995663159764:5515]
2025-10-15T10:57:41.027782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:41.028428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:41.028449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400992863459054:5656]
2025-10-15T10:57:41.028526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:41.028644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:41.028656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:41.046968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:41.047044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0] Write session will restart in 0.009214s
2025-10-15T10:57:41.046023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 443 reason: error at write: Disconnected sessionId: src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0
2025-10-15T10:57:41.047139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0] Write session: Do CDS request
2025-10-15T10:57:41.046316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 443 sessionId: src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0 is DEAD
2025-10-15T10:57:41.047165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:41.072800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:41.072845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 444
2025-10-15T10:57:41.073017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:41.073776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:41.074026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:41.074064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:41.074079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:41.076038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 444 sessionId:  describe result for acl check
2025-10-15T10:57:41.076159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:41.076176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:41.076185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:41.076201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400997158426468:6069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:41.078596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400997158426468:6069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:41.083123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400997158426468:6069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:41.089808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400997158426468:6069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:41.089847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400997158426468:6069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:41.089863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400997158426468:6069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:41.089891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:41.128585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400997158426728:5656]
2025-10-15T10:57:41.174091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:41.177386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:41.178136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:41.178166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:41.178215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:41.178458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:41.178640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400999958127365:5525]
2025-10-15T10:57:41.180423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:41.181212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:41.181407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:41.182535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:41.182836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:41.182849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:41.182856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:41.182862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:41.182870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:41.182876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:41.182882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:41.182888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:41.182895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:41.182900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:41.182908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:41.182914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.182920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.182928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.182970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:41.183063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:41.183106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:41.183148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:41.183196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:41.183244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:41.183292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:41.183339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:41.183400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:41.183446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:41.183499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:41.183541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.183584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.183629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.183672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:41.183736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:41.183792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:41.183847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:41.183898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:41.183949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:41.183992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:41.184043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:41.184091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:41.184142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:41.184187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:41.184242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:41.184289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:41.184342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:41.184389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:41.184442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:41.184499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:41.184553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:41.184610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:41.184668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:41.184715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:41.184769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:41.184816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.184885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.184936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.184998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.185048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.185102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.185601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:41.204970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:41.219092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 443
2025-10-15T10:57:41.219186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 443
2025-10-15T10:57:41.219241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 443, pipe: [1:7561400997158426728:5656]
2025-10-15T10:57:41.216025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:41.216067Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:41.216082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:41.216098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:41.216119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 443 [2:7561400999958127365:5525]
2025-10-15T10:57:41.216163Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:41.216212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:41.216225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:41.216234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:41.216243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:41.216286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:41.216304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:41.216323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:41.218580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.218594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.218606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.218615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:41.218853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:41.218867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.218983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.219142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.219340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:41.220302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400997158426499:6069], now have 1 active actors on pipe
2025-10-15T10:57:41.220333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400997158426455:2467], now have 1 active actors on pipe
2025-10-15T10:57:41.220353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400997158426728:5656], now have 1 active actors on pipe
2025-10-15T10:57:41.220394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:41.220414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:41.220448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400999958127360:5525]
2025-10-15T10:57:41.220460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400999958127360:5525]
2025-10-15T10:57:41.220472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400999958127360:5525]
2025-10-15T10:57:41.220506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:41.220587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:41.220616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:41.220632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:41.220642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:41.220754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:41.220769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:41.220822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:41.220847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:41.220863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:41.220873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:41.220903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:41.220940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:41.221048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400999958127360:5525]
2025-10-15T10:57:41.221074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:41.221114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:41.221126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:41.221973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:41.221995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:41.222049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:41.222397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 444 partition: 0 MaxSeqNo: 46 sessionId: src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0
2025-10-15T10:57:41.223140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b98022-3c6f7b92-c8b11c24-3c976ba_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:41.254314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0] Write session: try to update token
2025-10-15T10:57:41.254361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:41.315061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:41.315094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:41.315109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:41.315121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:41.315156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400999958127360:5525]
2025-10-15T10:57:41.315186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400999958127360:5525]
2025-10-15T10:57:41.315212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400999958127360:5525]
2025-10-15T10:57:41.315309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:41.315339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:41.315394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:41.315401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:41.315415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:41.315427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:41.315472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:41.315494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:41.316568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:41.401058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId: src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:41.426908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:41.474578Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:41.476259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:41.476300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:41.478797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:41.478600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:41.478641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:41.480060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:41.480297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400997158426728:5656]
2025-10-15T10:57:41.534226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 444 reason: error at write: Disconnected sessionId: src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0
2025-10-15T10:57:41.534522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 444 sessionId: src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0 is DEAD
2025-10-15T10:57:41.536080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:41.536108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0] Write session will restart in 0.006062s
2025-10-15T10:57:41.536214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0] Write session: Do CDS request
2025-10-15T10:57:41.536237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:41.546653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:41.546685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 445
2025-10-15T10:57:41.547178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:41.547821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:41.548070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:41.548145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:41.548168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:41.552045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 445 sessionId:  describe result for acl check
2025-10-15T10:57:41.552203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:41.552221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:41.552241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:41.552269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400997158427046:6077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:41.556343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400997158427046:6077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:41.563916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400997158427046:6077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:41.571445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400997158427046:6077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:41.571485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400997158427046:6077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:41.571502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400997158427046:6077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:41.571533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:41.578064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561400997158427152:5656]
2025-10-15T10:57:41.646251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:41.648113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:41.649009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:41.649038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:41.649085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:41.649324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:41.649504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400999958127665:5534]
2025-10-15T10:57:41.651688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:41.652612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:41.652821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:41.653841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:41.654154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:41.654175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:41.654183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:41.654189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:41.654196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:41.654204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:41.654210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:41.654215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:41.654221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:41.654228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:41.654243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:41.654248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.654253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.654260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.654307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:41.654400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:41.654446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:41.654490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:41.654532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:41.654576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:41.654619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:41.654662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:41.654705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:41.654749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:41.654794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:41.654850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.654892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.654938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.654967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:41.655027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:41.655079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:41.655129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:41.655157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:41.655191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:41.655217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:41.655251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:41.655285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:41.655333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:41.655391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:41.655442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:41.655487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:41.655538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:41.655581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:41.655629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:41.655678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:41.655727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:41.655770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:41.655818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:41.655863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:41.655911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:41.655953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.655997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.656033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.656083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.656126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.656164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.656499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:41.673124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:41.713692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:41.713736Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:41.713752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:41.713768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:41.713791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 444 [2:7561400999958127665:5534]
2025-10-15T10:57:41.713839Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:41.713888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:41.713900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:41.713912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:41.713923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:41.713965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:41.713992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:41.714011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:41.715057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.715080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.715093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.715103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:41.715760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:41.715798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:41.715919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:41.715911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 444
2025-10-15T10:57:41.716016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 444
2025-10-15T10:57:41.716091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 444, pipe: [1:7561400997158427152:5656]
2025-10-15T10:57:41.716144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:41.716413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:41.716521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400997158427127:6077], now have 1 active actors on pipe
2025-10-15T10:57:41.716557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400997158426953:2467], now have 1 active actors on pipe
2025-10-15T10:57:41.716586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400997158427152:5656], now have 1 active actors on pipe
2025-10-15T10:57:41.716647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:41.716679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:41.716738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561400999958127660:5534]
2025-10-15T10:57:41.716760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561400999958127660:5534]
2025-10-15T10:57:41.716774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561400999958127660:5534]
2025-10-15T10:57:41.716815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:41.716890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:41.717023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:41.717051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:41.717061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:41.717078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:41.717092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:41.717142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70409961-b287c708-b633eee1-ea6d234d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:41.717164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:41.717188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:41.717199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:41.717244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:41.717282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:41.717404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561400999958127660:5534]
2025-10-15T10:57:41.717437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:41.717465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:41.717480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:41.719614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 445 partition: 0 MaxSeqNo: 46 sessionId: src_id|70409961-b287c708-b633eee1-ea6d234d_0
2025-10-15T10:57:41.718835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:41.718876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:41.718934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:41.722319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d882750-77fdcecb-5898ca5-1ae8201b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|70409961-b287c708-b633eee1-ea6d234d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:41.753467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70409961-b287c708-b633eee1-ea6d234d_0] Write session: try to update token
2025-10-15T10:57:41.753534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70409961-b287c708-b633eee1-ea6d234d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:41.832092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:41.832118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:41.832130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:41.832140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:41.832165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561400999958127660:5534]
2025-10-15T10:57:41.832180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561400999958127660:5534]
2025-10-15T10:57:41.832195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561400999958127660:5534]
2025-10-15T10:57:41.832288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:41.832307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:41.832321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:41.832352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:41.832363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:41.832373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:41.832418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:41.832431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:41.834451Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:41.840003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId: src_id|70409961-b287c708-b633eee1-ea6d234d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:41.861599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:41.968973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:41.990084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:41.990126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:41.990189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:41.990201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:41.990236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561400999958127660:5534]
2025-10-15T10:57:41.990463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:41.990716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:41.991014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:41.991039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:41.991471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:41.991661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561400997158427152:5656]
2025-10-15T10:57:41.998771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 445 reason: error at write: Disconnected sessionId: src_id|70409961-b287c708-b633eee1-ea6d234d_0
2025-10-15T10:57:41.999056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 445 sessionId: src_id|70409961-b287c708-b633eee1-ea6d234d_0 is DEAD
2025-10-15T10:57:41.999913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70409961-b287c708-b633eee1-ea6d234d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:41.999985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70409961-b287c708-b633eee1-ea6d234d_0] Write session will restart in 0.005994s
2025-10-15T10:57:42.000273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70409961-b287c708-b633eee1-ea6d234d_0] Write session: Do CDS request
2025-10-15T10:57:42.000335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70409961-b287c708-b633eee1-ea6d234d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:42.013240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70409961-b287c708-b633eee1-ea6d234d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:42.013394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:42.013422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 446
2025-10-15T10:57:42.013865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:42.013984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:42.013999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:42.014008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:42.015611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 446 sessionId:  describe result for acl check
2025-10-15T10:57:42.015716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:42.015726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:42.015735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:42.015752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401001453394770:6082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:42.018166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401001453394770:6082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:42.027573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401001453394770:6082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:42.042272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401001453394770:6082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:42.042313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401001453394770:6082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:42.042330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401001453394770:6082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:42.042360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:42.092178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401001453395218:5656]
2025-10-15T10:57:42.106004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:42.107388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:42.108235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:42.108253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:42.108296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:42.108544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:42.108734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401004253095249:5538]
2025-10-15T10:57:42.110999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:42.111964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:42.112178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:42.113470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:42.113796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:42.113804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:42.113812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:42.113819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:42.113827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:42.113834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:42.113841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:42.113848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:42.113855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:42.113863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:42.113870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:42.113878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.113885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.113894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.113942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:42.114481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:42.114543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:42.114592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:42.114638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:42.114688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:42.114733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:42.114780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:42.114825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:42.114875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:42.114921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:42.114965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.115014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.115061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.115397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:42.115473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:42.115535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:42.115591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:42.115641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:42.115692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:42.115748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:42.115801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:42.115852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:42.115909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:42.115953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:42.116006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:42.116052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:42.116143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:42.116187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:42.116240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:42.116290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:42.116357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:42.116403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:42.116460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:42.116511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:42.116566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:42.116631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.116691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.116738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.116791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.116835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.116905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.117439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:42.149519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:42.158893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:42.158944Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:42.158962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:42.158983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:42.159009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 445 [2:7561401004253095249:5538]
2025-10-15T10:57:42.159064Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:42.159126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:42.159143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:42.159156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:42.159168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:42.159217Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:42.159241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:42.159264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:42.160714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.160740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.160755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.160767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:42.161032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:42.161056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.161204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.161409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.161676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:42.161768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401001453395218:5656], now have 1 active actors on pipe
2025-10-15T10:57:42.161798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400997158427460:2467], now have 1 active actors on pipe
2025-10-15T10:57:42.161826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401001453394851:6082], now have 1 active actors on pipe
2025-10-15T10:57:42.161763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 445, pipe: [1:7561401001453395218:5656]
2025-10-15T10:57:42.161853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401004253095244:5538]
2025-10-15T10:57:42.161871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 445
2025-10-15T10:57:42.161874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401004253095244:5538]
2025-10-15T10:57:42.161887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401004253095244:5538]
2025-10-15T10:57:42.161929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:42.161947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 445
2025-10-15T10:57:42.161975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:42.161999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:42.162012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:42.162016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:42.162204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:42.162228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:42.162386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:42.162414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:42.162464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401004253095244:5538]
2025-10-15T10:57:42.162496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:42.162516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:42.162619Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3adfd77e-98202fb2-2372966c-a52b4453_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:42.162658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:42.162682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:42.162692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:42.162732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:42.162775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:42.162866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:42.163534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:42.163572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:42.163653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:42.164104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 446 partition: 0 MaxSeqNo: 46 sessionId: src_id|3adfd77e-98202fb2-2372966c-a52b4453_0
2025-10-15T10:57:42.166536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70409961-b287c708-b633eee1-ea6d234d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3adfd77e-98202fb2-2372966c-a52b4453_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:42.205973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3adfd77e-98202fb2-2372966c-a52b4453_0] Write session: try to update token
2025-10-15T10:57:42.206036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3adfd77e-98202fb2-2372966c-a52b4453_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:42.273456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:42.273519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:42.273561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:42.273588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:42.273653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401004253095244:5538]
2025-10-15T10:57:42.273700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401004253095244:5538]
2025-10-15T10:57:42.273745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401004253095244:5538]
2025-10-15T10:57:42.273977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:42.274060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:42.274069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:42.274087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:42.274108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:42.274132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:42.274177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:42.274217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:42.290100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:42.316892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId: src_id|3adfd77e-98202fb2-2372966c-a52b4453_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:42.339069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:42.429890Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:42.443606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:42.443772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:42.443851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:42.443866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:42.443907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401004253095244:5538]
2025-10-15T10:57:42.446392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:42.444226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:42.444555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:42.446595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:42.477865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401001453395218:5656]
2025-10-15T10:57:42.477970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 446 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3adfd77e-98202fb2-2372966c-a52b4453_0
2025-10-15T10:57:42.478488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 446 sessionId: src_id|3adfd77e-98202fb2-2372966c-a52b4453_0 is DEAD
2025-10-15T10:57:42.480352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adfd77e-98202fb2-2372966c-a52b4453_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:42.480413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adfd77e-98202fb2-2372966c-a52b4453_0] Write session will restart in 0.008279s
2025-10-15T10:57:42.480563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adfd77e-98202fb2-2372966c-a52b4453_0] Write session: Do CDS request
2025-10-15T10:57:42.480606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adfd77e-98202fb2-2372966c-a52b4453_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:42.494792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3adfd77e-98202fb2-2372966c-a52b4453_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:42.497521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:42.497552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 447
2025-10-15T10:57:42.498188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:42.498313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:42.498329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:42.498339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:42.499863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 447 sessionId:  describe result for acl check
2025-10-15T10:57:42.499978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:42.499990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:42.499999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:42.500017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401001453395268:6093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:42.502654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401001453395268:6093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:42.509960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401001453395268:6093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:42.524880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401001453395268:6093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:42.524927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401001453395268:6093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:42.524945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401001453395268:6093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:42.524976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:42.578044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401001453395595:5656]
2025-10-15T10:57:42.638354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:42.645192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:42.646065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:42.646095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:42.646135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:42.646387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:42.646570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401004253095537:5546]
2025-10-15T10:57:42.648987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:42.649848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:42.650046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:42.651288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:42.651604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:42.651613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:42.651620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:42.651627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:42.651634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:42.651642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:42.651648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:42.651655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:42.651663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:42.651670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:42.651677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:42.651685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.651693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.651700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.651752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:42.651863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:42.651913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:42.651963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:42.652012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:42.652058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:42.652106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:42.652151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:42.652199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:42.652245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:42.652293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:42.652342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.652388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.652435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.652475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:42.652543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:42.652602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:42.652727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:42.652775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:42.652830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:42.652875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:42.652929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:42.652983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:42.653039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:42.653086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:42.653141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:42.653192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:42.653246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:42.653291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:42.653347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:42.653395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:42.653452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:42.653493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:42.653549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:42.653596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:42.653648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:42.653691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.653744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.653792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.653846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.653887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.653942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.654472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:42.673200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:42.699482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:42.699525Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:42.699539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:42.699554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:42.699574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 446 [2:7561401004253095537:5546]
2025-10-15T10:57:42.699617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:42.699667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:42.699678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:42.699689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:42.699699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:42.699742Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:42.699761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:42.699781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:42.701503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.701526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.701537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.701547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:42.701742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:42.701762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:42.701864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:42.703576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 446, pipe: [1:7561401001453395595:5656]
2025-10-15T10:57:42.703657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 446
2025-10-15T10:57:42.703721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 446
2025-10-15T10:57:42.702025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:42.702232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:42.702298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401004253095531:5546]
2025-10-15T10:57:42.702311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401004253095531:5546]
2025-10-15T10:57:42.702322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401004253095531:5546]
2025-10-15T10:57:42.702359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:42.702422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:42.702582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:42.702598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:42.702713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401004253095531:5546]
2025-10-15T10:57:42.702731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:42.702957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:42.702970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:42.702981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:42.703003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:42.704212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401001453395595:5656], now have 1 active actors on pipe
2025-10-15T10:57:42.704243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401001453395369:6093], now have 1 active actors on pipe
2025-10-15T10:57:42.704264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401001453395253:2467], now have 1 active actors on pipe
2025-10-15T10:57:42.704310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:42.704361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:42.704449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:42.704479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:42.704496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:42.704506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:42.704549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:42.704602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:42.704665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:42.707573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:42.707600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:42.707655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:42.707998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 447 partition: 0 MaxSeqNo: 46 sessionId: src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0
2025-10-15T10:57:42.712423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3adfd77e-98202fb2-2372966c-a52b4453_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:42.754970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0] Write session: try to update token
2025-10-15T10:57:42.755020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:42.837259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:42.837294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:42.837310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:42.837322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:42.837357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401004253095531:5546]
2025-10-15T10:57:42.837383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401004253095531:5546]
2025-10-15T10:57:42.837408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401004253095531:5546]
2025-10-15T10:57:42.837489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:42.837522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:42.837550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:42.837575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:42.837587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:42.837599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:42.837646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:42.837666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:42.841196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:42.915932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId: src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:42.941385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:43.008156Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:43.011619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401001453395595:5656]
2025-10-15T10:57:43.011753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:43.011775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:43.013607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:43.009712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:43.009750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:43.013625Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:43.044324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 447 reason: error at write: Disconnected sessionId: src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0
2025-10-15T10:57:43.044677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 447 sessionId: src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0 is DEAD
2025-10-15T10:57:43.046527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:43.046582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0] Write session will restart in 0.005505s
2025-10-15T10:57:43.046684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0] Write session: Do CDS request
2025-10-15T10:57:43.046721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:43.062402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:43.063198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:43.063230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 448
2025-10-15T10:57:43.063557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:43.063685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:43.063707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:43.063717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:43.065088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 448 sessionId:  describe result for acl check
2025-10-15T10:57:43.065197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:43.065212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:43.065223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:43.065240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401005748363105:6101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:43.067980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401005748363105:6101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:43.075293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401005748363105:6101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:43.086498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401005748363105:6101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:43.086536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401005748363105:6101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:43.086553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401005748363105:6101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:43.086587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:43.112518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401005748363323:5656]
2025-10-15T10:57:43.182315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:43.188681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:43.189669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:43.189691Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:43.189737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:43.190017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:43.190203Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401008548063149:5557]
2025-10-15T10:57:43.192467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:43.193647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:43.193859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:43.195279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:43.195655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:43.195678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:43.195686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:43.195693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:43.195700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:43.195708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:43.195717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:43.195725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:43.195733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:43.195740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:43.195747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:43.195755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.195762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.195769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.195820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:43.195939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:43.195993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:43.196044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:43.196094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:43.196147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:43.196197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:43.196247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:43.196292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:43.196342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:43.196392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:43.196439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.196488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.196536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.196582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:43.196675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:43.196739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:43.196799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:43.196849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:43.196909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:43.196956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:43.197013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:43.197062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:43.197117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:43.197165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:43.197220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:43.197269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:43.197323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:43.197370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:43.197426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:43.197477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:43.197532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:43.197579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:43.197636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:43.197716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:43.197779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:43.197830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.197890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.197940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.197996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.198051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.198113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.198657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:43.264441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:43.274926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:43.274972Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:43.274989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:43.275007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:43.275032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 447 [2:7561401008548063149:5557]
2025-10-15T10:57:43.275080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:43.275133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:43.275148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:43.275160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:43.275170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:43.275212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:43.275231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:43.275251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:43.276697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.276718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.276731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.276742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:43.276994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:43.277010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.277141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.277323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.277546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:43.277609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401008548063144:5557]
2025-10-15T10:57:43.277623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401008548063144:5557]
2025-10-15T10:57:43.277635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401008548063144:5557]
2025-10-15T10:57:43.277676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:43.277740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:43.277906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:43.277921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:43.278027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401008548063144:5557]
2025-10-15T10:57:43.278045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:43.278679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:43.278697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:43.278708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:43.279421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 447, pipe: [1:7561401005748363323:5656]
2025-10-15T10:57:43.279506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 447
2025-10-15T10:57:43.279549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 447
2025-10-15T10:57:43.278731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:43.279450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401005748363323:5656], now have 1 active actors on pipe
2025-10-15T10:57:43.279502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401005748363211:6101], now have 1 active actors on pipe
2025-10-15T10:57:43.279528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401005748363072:2467], now have 1 active actors on pipe
2025-10-15T10:57:43.279890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:43.279913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:43.279980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:43.280008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:43.280025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:43.280036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:43.280069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:43.280104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:43.280143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:43.280904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:43.280931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:43.280992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:43.281408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 448 partition: 0 MaxSeqNo: 46 sessionId: src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0
2025-10-15T10:57:43.282512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2259e5-587ee72b-6b95461e-52a12e55_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:43.318911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0] Write session: try to update token
2025-10-15T10:57:43.318980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:43.397393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:43.397432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:43.397445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:43.397506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:43.397524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:43.397540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:43.397552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:43.397589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401008548063144:5557]
2025-10-15T10:57:43.397615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401008548063144:5557]
2025-10-15T10:57:43.397639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401008548063144:5557]
2025-10-15T10:57:43.397791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:43.397802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:43.397814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:43.397833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:43.397868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:43.398894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:43.465751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId: src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:43.486343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:43.546799Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:43.549499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401005748363323:5656]
2025-10-15T10:57:43.549683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:43.549702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:43.548436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:43.548474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:43.552498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:43.557283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 448 reason: error at write: Disconnected sessionId: src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0
2025-10-15T10:57:43.557654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 448 sessionId: src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0 is DEAD
2025-10-15T10:57:43.560439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:43.560504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0] Write session will restart in 0.005992s
2025-10-15T10:57:43.560708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0] Write session: Do CDS request
2025-10-15T10:57:43.560765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:43.583797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:43.583835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 449
2025-10-15T10:57:43.584077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:43.587707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:43.587884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:43.587903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:43.587915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:43.589847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 449 sessionId:  describe result for acl check
2025-10-15T10:57:43.590023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:43.590046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:43.590063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:43.590094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401005748363577:6106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:43.588368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:43.598738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401005748363577:6106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:43.614922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401005748363577:6106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:43.625796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401005748363577:6106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:43.625839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401005748363577:6106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:43.625857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401005748363577:6106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:43.625892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:43.648313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401005748363793:5656]
2025-10-15T10:57:43.718232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:43.727224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:43.728195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:43.728225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:43.728271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:43.728538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:43.728747Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401008548063430:5559]
2025-10-15T10:57:43.731030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:43.733466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:43.733759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:43.735185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:43.735563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:43.735582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:43.735590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:43.735597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:43.735604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:43.735611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:43.735620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:43.735627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:43.735635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:43.735643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:43.735650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:43.735657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.735665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.735671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.735723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:43.735841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:43.735893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:43.735941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:43.735989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:43.736039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:43.736085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:43.736136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:43.736182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:43.736232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:43.736278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:43.736340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.736396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.736455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.736506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:43.736588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:43.736673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:43.736738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:43.736791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:43.736857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:43.736910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:43.736966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:43.737016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:43.737077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:43.737126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:43.737180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:43.737230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:43.737287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:43.737338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:43.737396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:43.737448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:43.737504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:43.737551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:43.737613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:43.737663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:43.737719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:43.737767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.737826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.737874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.737932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.737979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.738033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.738581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:43.757599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:43.768055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:43.768106Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:43.768127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:43.768149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:43.768177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 448 [2:7561401008548063430:5559]
2025-10-15T10:57:43.768235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:43.768301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:43.768318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:43.768332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:43.768345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:43.768396Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:43.768421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:43.768444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:43.769531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.769547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.769562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.769575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:43.769836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:43.769855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:43.770006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:43.770213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:43.770461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:43.770531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401008548063425:5559]
2025-10-15T10:57:43.770547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401008548063425:5559]
2025-10-15T10:57:43.770561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401008548063425:5559]
2025-10-15T10:57:43.770907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:43.770920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:43.770931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:43.771925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:43.772027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:43.772240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:43.772257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:43.772306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401005748363793:5656], now have 1 active actors on pipe
2025-10-15T10:57:43.772332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401005748363641:6106], now have 1 active actors on pipe
2025-10-15T10:57:43.772355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401005748363563:2467], now have 1 active actors on pipe
2025-10-15T10:57:43.772481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401008548063425:5559]
2025-10-15T10:57:43.772503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:43.772551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:43.772641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:43.772663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:43.772811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:43.772844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:43.772863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:43.772874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:43.772908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:43.772947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:43.773006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:43.774061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:43.774091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:43.774153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:43.772145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 448, pipe: [1:7561401005748363793:5656]
2025-10-15T10:57:43.772271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 448
2025-10-15T10:57:43.772353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 448
2025-10-15T10:57:43.774418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 449 partition: 0 MaxSeqNo: 46 sessionId: src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0
2025-10-15T10:57:43.775330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d9989b1-88ff2a3c-12a0c0a6-f4ea521d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:43.811736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0] Write session: try to update token
2025-10-15T10:57:43.811804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:43.867722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:43.867756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:43.867770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:43.968072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:43.968111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:43.968122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:43.968132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:43.968163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401008548063425:5559]
2025-10-15T10:57:43.968186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401008548063425:5559]
2025-10-15T10:57:43.968205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401008548063425:5559]
2025-10-15T10:57:43.968378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:43.968401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:43.968411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:43.968448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:43.968479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:43.969095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:43.969133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:43.969159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:43.970083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:43.986372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId: src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:44.030110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:44.134779Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:44.147804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:44.147847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:44.147908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:44.147921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:44.147955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401008548063425:5559]
2025-10-15T10:57:44.148349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:44.148915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401005748363793:5656]
2025-10-15T10:57:44.149016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:44.149029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:44.149306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:44.197607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:44.197977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 449 reason: error at write: Disconnected sessionId: src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0
2025-10-15T10:57:44.198346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 449 sessionId: src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0 is DEAD
2025-10-15T10:57:44.198888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:44.198927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0] Write session will restart in 0.008978s
2025-10-15T10:57:44.199030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0] Write session: Do CDS request
2025-10-15T10:57:44.199061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:44.213688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:44.213655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:44.213684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 450
2025-10-15T10:57:44.214178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:44.214301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:44.214316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:44.214326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:44.215800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 450 sessionId:  describe result for acl check
2025-10-15T10:57:44.215918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:44.215928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:44.215937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:44.215954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401010043331418:6119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:44.219070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401010043331418:6119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:44.225492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401010043331418:6119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:44.233355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401010043331418:6119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:44.233405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401010043331418:6119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:44.233423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401010043331418:6119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:44.233454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:44.251377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401010043331533:5656]
2025-10-15T10:57:44.318803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:44.322534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:44.323492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:44.323505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:44.323538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:44.323757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:44.323874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401012843031033:5569]
2025-10-15T10:57:44.325760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:44.326764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:44.326970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:44.328156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:44.328507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:44.328522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:44.328530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:44.328536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:44.328543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:44.328550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:44.328557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:44.328564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:44.328571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:44.328580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:44.328587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:44.328594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.328602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.328609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.328679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:44.328792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:44.328841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:44.328889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:44.328926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:44.328959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:44.329003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:44.329048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:44.329092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:44.329140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:44.329181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:44.329242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.329288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.329333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.329374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:44.329454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:44.329515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:44.329571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:44.329608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:44.329645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:44.329675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:44.329720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:44.329758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:44.329811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:44.329857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:44.329908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:44.329940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:44.329977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:44.330009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:44.330053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:44.330101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:44.330140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:44.330173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:44.330225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:44.330272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:44.330324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:44.330355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.330401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.330450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.330504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.330549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.330605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.331053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:44.348334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:44.357167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:44.357214Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:44.357230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:44.357248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:44.357272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 449 [2:7561401012843031033:5569]
2025-10-15T10:57:44.357322Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:44.357377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:44.357393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:44.357405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:44.357414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:44.357479Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:44.357501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:44.357525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:44.374410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.374438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.374445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.374455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:44.374671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:44.374688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.374804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.374946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.375095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:44.375169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401012843031028:5569]
2025-10-15T10:57:44.375186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401012843031028:5569]
2025-10-15T10:57:44.375196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401012843031028:5569]
2025-10-15T10:57:44.375224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:44.375290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:44.375412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:44.375429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:44.375440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:44.376747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:44.376773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:44.376923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401010043331392:2467], now have 1 active actors on pipe
2025-10-15T10:57:44.376950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401010043331465:6119], now have 1 active actors on pipe
2025-10-15T10:57:44.376969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401010043331533:5656], now have 1 active actors on pipe
2025-10-15T10:57:44.376989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401012843031028:5569]
2025-10-15T10:57:44.377015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:44.377078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:44.380029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:44.380072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:44.380146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:44.380187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:44.380205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:44.380215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:44.380247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:44.380292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:44.380362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:44.381444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:44.381480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:44.381540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:44.379533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 449
2025-10-15T10:57:44.379627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 449
2025-10-15T10:57:44.379680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 449, pipe: [1:7561401010043331533:5656]
2025-10-15T10:57:44.386766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 450 partition: 0 MaxSeqNo: 46 sessionId: src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0
2025-10-15T10:57:44.391583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a5c181-46fbbab0-d3cd29cb-e7948377_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:44.432534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0] Write session: try to update token
2025-10-15T10:57:44.432596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:44.488313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:44.488352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:44.488366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:44.488431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:44.488450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:44.488468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:44.488479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:44.488523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401012843031028:5569]
2025-10-15T10:57:44.488553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401012843031028:5569]
2025-10-15T10:57:44.488581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401012843031028:5569]
2025-10-15T10:57:44.488734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:44.488782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:44.488820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:44.488820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:44.488844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:44.491342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:44.560467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId: src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:44.585056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:44.647887Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:44.657875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:44.657935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:44.658025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:44.658042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:44.658089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401012843031028:5569]
2025-10-15T10:57:44.658623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:44.659658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:44.659713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:44.659854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:44.659867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:44.660625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401010043331533:5656]
2025-10-15T10:57:44.711720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 450 reason: error at write: Disconnected sessionId: src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0
2025-10-15T10:57:44.712012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 450 sessionId: src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0 is DEAD
2025-10-15T10:57:44.714256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:44.714330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0] Write session will restart in 0.005977s
2025-10-15T10:57:44.714529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0] Write session: Do CDS request
2025-10-15T10:57:44.714588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:44.726648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:44.727468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:44.727498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 451
2025-10-15T10:57:44.727789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:44.727909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:44.727929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:44.727939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:44.728976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 451 sessionId:  describe result for acl check
2025-10-15T10:57:44.729073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:44.729087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:44.729096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:44.729113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401010043331925:6127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:44.732737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401010043331925:6127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:44.742165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401010043331925:6127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:44.751874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401010043331925:6127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:44.751912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401010043331925:6127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:44.751929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401010043331925:6127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:44.751957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:44.761337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401010043332073:5656]
2025-10-15T10:57:44.816482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:44.818239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:44.818918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:44.818929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:44.818956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:44.819144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:44.819256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401012843031337:5578]
2025-10-15T10:57:44.821623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:44.822924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:44.823106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:44.824758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:44.825154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:44.825163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:44.825171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:44.825177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:44.825184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:44.825202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:44.825210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:44.825217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:44.825223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:44.825228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:44.825235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:44.825242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.825249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.825257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.825306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:44.825428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:44.825488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:44.825545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:44.825600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:44.825657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:44.825710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:44.825763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:44.825834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:44.825885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:44.825937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:44.825987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.826038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.826084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.826136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:44.826211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:44.826280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:44.826360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:44.826417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:44.826475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:44.826528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:44.826589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:44.826645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:44.826706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:44.826761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:44.826824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:44.826880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:44.826942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:44.826995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:44.827054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:44.827110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:44.827199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:44.827253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:44.827337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:44.827546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:44.827625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:44.827682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.827757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.827816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.827879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.827931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.827990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.828537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:44.896116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:44.905003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:44.905049Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:44.905065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:44.905083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:44.905106Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 450 [2:7561401012843031337:5578]
2025-10-15T10:57:44.905153Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:44.905204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:44.905218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:44.905231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:44.905241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:44.905284Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:44.905304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:44.905327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:44.907066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 450, pipe: [1:7561401010043332073:5656]
2025-10-15T10:57:44.906339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.906365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.906378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.907196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 450
2025-10-15T10:57:44.906389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:44.906634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:44.906652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:44.906784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:44.906959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:44.907297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 450
2025-10-15T10:57:44.907176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:44.907247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401010043332073:5656], now have 1 active actors on pipe
2025-10-15T10:57:44.907269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401010043331890:2467], now have 1 active actors on pipe
2025-10-15T10:57:44.907298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401010043332028:6127], now have 1 active actors on pipe
2025-10-15T10:57:44.907326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401012843031332:5578]
2025-10-15T10:57:44.907338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401012843031332:5578]
2025-10-15T10:57:44.907551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401012843031332:5578]
2025-10-15T10:57:44.907593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:44.907615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:44.907628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:44.907654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:44.907667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:44.907849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:44.907864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:44.907915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:44.907935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:44.908064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401012843031332:5578]
2025-10-15T10:57:44.908094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:44.908113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:44.908159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e984afa0-b112875a-777e1b34-886a7395_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:44.908187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:44.908203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:44.908212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:44.908244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:44.908278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:44.908396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:44.908920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:44.908941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:44.908997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:44.909344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 451 partition: 0 MaxSeqNo: 46 sessionId: src_id|e984afa0-b112875a-777e1b34-886a7395_0
2025-10-15T10:57:44.910214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f334e32-dca7c7e-55b463fc-b08bf9bb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e984afa0-b112875a-777e1b34-886a7395_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:44.945916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:44.946264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:44.946314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401012843031332:5578]
2025-10-15T10:57:44.946439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:44.946562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:44.948530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:44.949664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:44.951040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:44.953598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:44.956489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:44.957003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:44.957801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e984afa0-b112875a-777e1b34-886a7395_0] Write session: try to update token
2025-10-15T10:57:44.957845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e984afa0-b112875a-777e1b34-886a7395_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:45.006758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:45.006798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:45.006810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:45.046415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:45.046449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:45.046462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:45.046473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:45.046510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401012843031332:5578]
2025-10-15T10:57:45.046535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401012843031332:5578]
2025-10-15T10:57:45.046557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401012843031332:5578]
2025-10-15T10:57:45.046695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:45.046694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:45.046717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:45.046729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:45.046763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:45.049114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:45.078730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId: src_id|e984afa0-b112875a-777e1b34-886a7395_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:45.102191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:45.198371Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:45.204010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:45.204051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:45.205525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:45.204773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:45.207602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401010043332073:5656]
2025-10-15T10:57:45.207746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:45.215974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 451 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e984afa0-b112875a-777e1b34-886a7395_0
2025-10-15T10:57:45.216372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 451 sessionId: src_id|e984afa0-b112875a-777e1b34-886a7395_0 is DEAD
2025-10-15T10:57:45.216807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e984afa0-b112875a-777e1b34-886a7395_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:45.216866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e984afa0-b112875a-777e1b34-886a7395_0] Write session will restart in 0.006468s
2025-10-15T10:57:45.217036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e984afa0-b112875a-777e1b34-886a7395_0] Write session: Do CDS request
2025-10-15T10:57:45.217089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e984afa0-b112875a-777e1b34-886a7395_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:45.243071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:45.243114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 452
2025-10-15T10:57:45.245486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e984afa0-b112875a-777e1b34-886a7395_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:45.247175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:45.247367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:45.247382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:45.247394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:45.252955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 452 sessionId:  describe result for acl check
2025-10-15T10:57:45.253063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:45.253072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:45.253083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:45.253099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401014338299711:6132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:45.258940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401014338299711:6132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:45.278969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401014338299711:6132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:45.294939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401014338299711:6132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:45.294983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401014338299711:6132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:45.295002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401014338299711:6132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:45.295036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:45.308064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401014338299866:5656]
2025-10-15T10:57:45.403489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:45.405539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:45.406399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:45.406418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:45.406464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:45.406719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:45.406906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401017137998932:5582]
2025-10-15T10:57:45.409416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:45.410754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:45.410986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:45.412327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:45.412691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:45.412700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:45.412707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:45.412716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:45.412723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:45.412731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:45.412738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:45.412746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:45.412753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:45.412760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:45.412766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:45.412773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:45.412779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:45.412787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:45.412836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:45.412951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:45.413005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:45.413056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:45.413106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:45.413156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:45.413202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:45.413252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:45.413300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:45.413349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:45.413397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:45.413444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:45.413491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:45.413537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:45.413580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:45.413656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:45.413716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:45.413775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:45.413827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:45.413883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:45.413929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:45.413983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:45.414863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:45.414941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:45.415001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:45.415059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:45.415118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:45.415177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:45.415228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:45.415283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:45.415333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:45.415402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:45.415458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:45.415534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:45.415586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:45.415643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:45.415691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:45.415748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:45.415799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:45.415855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:45.415903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:45.415957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:45.416479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:45.444061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:45.454371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:45.454415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:45.454434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:45.454454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:45.454479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 451 [2:7561401017137998932:5582]
2025-10-15T10:57:45.454531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:45.454589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:45.454602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:45.454614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:45.454626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:45.454676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:45.454699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:45.454720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:45.470711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:45.470743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:45.470752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:45.470763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:45.471020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:45.471041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:45.471156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:45.471307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:45.471212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 451, pipe: [1:7561401014338299866:5656]
2025-10-15T10:57:45.471316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 451
2025-10-15T10:57:45.471410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 451
2025-10-15T10:57:45.471677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:45.471760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401014338299866:5656], now have 1 active actors on pipe
2025-10-15T10:57:45.471786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401014338299814:6132], now have 1 active actors on pipe
2025-10-15T10:57:45.471805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401014338299698:2467], now have 1 active actors on pipe
2025-10-15T10:57:45.471851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:45.471877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:45.471927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401017137998927:5582]
2025-10-15T10:57:45.471946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401017137998927:5582]
2025-10-15T10:57:45.471958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401017137998927:5582]
2025-10-15T10:57:45.471993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:45.472035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:45.472055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:45.472066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:45.472067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:45.472238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:45.472261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:45.472324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|560fdf66-c7ff21-fa67f659-9a63874a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:45.472361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:45.472378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:45.472388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:45.472423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:45.472467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:45.472598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401017137998927:5582]
2025-10-15T10:57:45.472631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:45.472692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:45.472788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:45.474354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:45.474387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:45.474458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:45.474749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 452 partition: 0 MaxSeqNo: 46 sessionId: src_id|560fdf66-c7ff21-fa67f659-9a63874a_0
2025-10-15T10:57:45.475479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e984afa0-b112875a-777e1b34-886a7395_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|560fdf66-c7ff21-fa67f659-9a63874a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:45.556594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:45.556637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:45.556702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401017137998927:5582]
2025-10-15T10:57:45.556857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:45.556880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:45.556891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:45.556957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:45.560173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:45.564715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|560fdf66-c7ff21-fa67f659-9a63874a_0] Write session: try to update token
2025-10-15T10:57:45.564803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|560fdf66-c7ff21-fa67f659-9a63874a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:45.564535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:45.567072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:45.573219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:45.575041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:45.578149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:45.578652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:45.732810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:45.732840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:45.732851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:45.732902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:45.732915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:45.732926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:45.732935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:45.732967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401017137998927:5582]
2025-10-15T10:57:45.732993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401017137998927:5582]
2025-10-15T10:57:45.733016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401017137998927:5582]
2025-10-15T10:57:45.733084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:45.733115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:45.733143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:45.733163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:45.733162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:45.734140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:45.755724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId: src_id|560fdf66-c7ff21-fa67f659-9a63874a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:45.777547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:45.876228Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:45.884070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:45.884114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:45.884821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:45.890502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401014338299866:5656]
2025-10-15T10:57:45.890642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:45.914371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560fdf66-c7ff21-fa67f659-9a63874a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:45.914431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560fdf66-c7ff21-fa67f659-9a63874a_0] Write session will restart in 0.007729s
2025-10-15T10:57:45.914599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560fdf66-c7ff21-fa67f659-9a63874a_0] Write session: Do CDS request
2025-10-15T10:57:45.914648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560fdf66-c7ff21-fa67f659-9a63874a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:45.913677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 452 reason: status is not ok: tablet will be restarted right now sessionId: src_id|560fdf66-c7ff21-fa67f659-9a63874a_0
2025-10-15T10:57:45.913959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 452 sessionId: src_id|560fdf66-c7ff21-fa67f659-9a63874a_0 is DEAD
2025-10-15T10:57:45.931483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:45.932280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:45.932299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 453
2025-10-15T10:57:45.932936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|560fdf66-c7ff21-fa67f659-9a63874a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:45.933538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:45.933650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:45.933663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:45.933671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:45.935569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 453 sessionId:  describe result for acl check
2025-10-15T10:57:45.935661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:45.935672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:45.935680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:45.935695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401014338300229:6143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:45.937971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401014338300229:6143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:45.944775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401014338300229:6143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:45.958674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401014338300229:6143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:45.958714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401014338300229:6143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:45.958729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401014338300229:6143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:45.958754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:45.990496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401014338300447:5656]
2025-10-15T10:57:46.068596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:46.073169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:46.073953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:46.073982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:46.074023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:46.074250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:46.074435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401021432966558:5595]
2025-10-15T10:57:46.076773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:46.077637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:46.077834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:46.079019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:46.079338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:46.079395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:46.079402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:46.079409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:46.079416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:46.079423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:46.079431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:46.079436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:46.079442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:46.079449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:46.079455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:46.079461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.079467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.079473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.079517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:46.079618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:46.079663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:46.079707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:46.079748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:46.079791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:46.079842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:46.079890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:46.079937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:46.079987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:46.080040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:46.080084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.080131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.080180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.080228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:46.080294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:46.080356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:46.080412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:46.080464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:46.080519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:46.080572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:46.080623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:46.080683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:46.080734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:46.080777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:46.080827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:46.080870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:46.080920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:46.080962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:46.081010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:46.081058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:46.081107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:46.081150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:46.081201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:46.081247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:46.081296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:46.081341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.081390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.081433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.081481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.081522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.081568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.082043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:46.102101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:46.113017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:46.113061Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:46.113077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:46.113094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:46.113118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 452 [2:7561401021432966558:5595]
2025-10-15T10:57:46.113166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:46.113221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:46.113235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:46.113247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:46.113257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:46.113304Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:46.113323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:46.113344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:46.114354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.114368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.114381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.114392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:46.114649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:46.114666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.114797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.114977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.115197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:46.115644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 452
2025-10-15T10:57:46.115268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401014338300306:6143], now have 1 active actors on pipe
2025-10-15T10:57:46.115726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 452, pipe: [1:7561401014338300447:5656]
2025-10-15T10:57:46.115289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401014338300447:5656], now have 1 active actors on pipe
2025-10-15T10:57:46.115310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401014338300217:2467], now have 1 active actors on pipe
2025-10-15T10:57:46.115796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 452
2025-10-15T10:57:46.115331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401021432966553:5595]
2025-10-15T10:57:46.116226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401021432966553:5595]
2025-10-15T10:57:46.116256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401021432966553:5595]
2025-10-15T10:57:46.116288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:46.116372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:46.116549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:46.116564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:46.116614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:46.116634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:46.116774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401021432966553:5595]
2025-10-15T10:57:46.116792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:46.116852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:46.116879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:46.116896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:46.116905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:46.116936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:46.116972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:46.117086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:46.117496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:46.117515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:46.117525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:46.117546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:46.119458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:46.119487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:46.119552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:46.122471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560fdf66-c7ff21-fa67f659-9a63874a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:46.121622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 453 partition: 0 MaxSeqNo: 46 sessionId: src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0
2025-10-15T10:57:46.153914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0] Write session: try to update token
2025-10-15T10:57:46.153982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:46.221152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:46.221187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:46.221201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:46.221212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:46.221253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401021432966553:5595]
2025-10-15T10:57:46.221286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401021432966553:5595]
2025-10-15T10:57:46.221311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401021432966553:5595]
2025-10-15T10:57:46.221441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:46.221468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:46.221480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:46.221491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:46.221491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:46.221520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:46.221532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:46.221552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:46.222642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:46.283869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId: src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:46.340554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:46.369192Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:46.382968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:46.383007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:46.386538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:46.385946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:46.385973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:46.391065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401014338300447:5656]
2025-10-15T10:57:46.391267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:46.401603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 453 reason: error at write: Disconnected sessionId: src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0
2025-10-15T10:57:46.401916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 453 sessionId: src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0 is DEAD
2025-10-15T10:57:46.407594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:46.407642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0] Write session will restart in 0.009860s
2025-10-15T10:57:46.407753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0] Write session: Do CDS request
2025-10-15T10:57:46.407783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:46.424589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:46.424623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 454
2025-10-15T10:57:46.425084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:46.425792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:46.425946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:46.425966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:46.425980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:46.427507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 454 sessionId:  describe result for acl check
2025-10-15T10:57:46.427631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:46.427642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:46.427652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:46.427670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401018633268034:6152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:46.430421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401018633268034:6152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:46.442571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401018633268034:6152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:46.461121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401018633268034:6152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:46.461170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401018633268034:6152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:46.461189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401018633268034:6152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:46.461224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:46.489665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401018633268368:5656]
2025-10-15T10:57:46.537006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:46.542718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:46.543633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:46.543653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:46.543696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:46.543947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:46.544126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401021432966841:5601]
2025-10-15T10:57:46.546236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:46.547178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:46.547398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:46.548665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:46.548997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:46.549015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:46.549022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:46.549028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:46.549034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:46.549041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:46.549047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:46.549054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:46.549061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:46.549067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:46.549074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:46.549080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.549086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.549092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.549134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:46.549240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:46.549284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:46.549329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:46.549373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:46.549417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:46.549461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:46.549502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:46.549546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:46.549591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:46.549634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:46.549676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.549720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.549766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.549805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:46.549866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:46.549923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:46.549975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:46.550021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:46.550072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:46.550116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:46.550169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:46.550216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:46.550267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:46.550315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:46.550364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:46.550411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:46.550460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:46.550505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:46.550553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:46.550601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:46.550652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:46.550694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:46.550752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:46.550795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:46.550844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:46.550886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.550935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.550981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.551032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.551075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.551124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.552684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:46.571631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:46.581408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:46.581454Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:46.581473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:46.581491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:46.581514Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 453 [2:7561401021432966841:5601]
2025-10-15T10:57:46.581565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:46.581618Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:46.581631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:46.581643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:46.581653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:46.581698Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:46.581717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:46.581737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:46.583501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 453, pipe: [1:7561401018633268368:5656]
2025-10-15T10:57:46.583608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 453
2025-10-15T10:57:46.583625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 453
2025-10-15T10:57:46.582754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.582779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.582793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.582813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:46.583068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:46.583085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:46.583229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:46.583426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:46.583693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:46.583767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401018633268204:6152], now have 1 active actors on pipe
2025-10-15T10:57:46.583789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401018633268368:5656], now have 1 active actors on pipe
2025-10-15T10:57:46.583821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401018633268021:2467], now have 1 active actors on pipe
2025-10-15T10:57:46.583845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401021432966836:5601]
2025-10-15T10:57:46.583859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401021432966836:5601]
2025-10-15T10:57:46.583872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401021432966836:5601]
2025-10-15T10:57:46.583908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:46.583976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:46.583993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:46.584004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:46.584014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:46.584138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:46.584153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:46.584259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:46.584272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:46.584304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401021432966836:5601]
2025-10-15T10:57:46.584329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:46.584355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:46.584422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:46.584448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:46.584464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:46.584487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:46.584534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:46.584573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:46.584684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:46.591853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:46.591900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:46.591975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:46.593661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 454 partition: 0 MaxSeqNo: 46 sessionId: src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0
2025-10-15T10:57:46.599611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c3e8e-3b0d0526-1b95b1bf-8c4b6529_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:46.702914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0] Write session: try to update token
2025-10-15T10:57:46.702983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:46.754437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:46.754476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:46.754488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:46.754610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:46.754625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:46.754640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:46.754650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:46.754685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401021432966836:5601]
2025-10-15T10:57:46.754715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401021432966836:5601]
2025-10-15T10:57:46.754736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401021432966836:5601]
2025-10-15T10:57:46.756702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:46.756796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:46.756854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:46.766997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:46.767047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:46.768787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:46.809374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId: src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:46.840603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:46.915783Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:46.917734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:46.917752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:46.917799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401021432966836:5601]
2025-10-15T10:57:46.917953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:46.917977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:46.918756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:46.919395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:46.920603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:46.922180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401018633268368:5656]
2025-10-15T10:57:46.922302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:46.948451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 454 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0
2025-10-15T10:57:46.948814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 454 sessionId: src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0 is DEAD
2025-10-15T10:57:46.952317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:46.952400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0] Write session will restart in 0.005038s
2025-10-15T10:57:46.952605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0] Write session: Do CDS request
2025-10-15T10:57:46.952667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:46.967021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:46.970081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:46.970115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 455
2025-10-15T10:57:46.974001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:46.974133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:46.974145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:46.974152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:46.975991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 455 sessionId:  describe result for acl check
2025-10-15T10:57:46.976106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:46.976117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:46.976127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:46.976144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401018633268564:6158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:46.984195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401018633268564:6158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:46.997689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401018633268564:6158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:47.009425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401018633268564:6158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:47.009464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401018633268564:6158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:47.009481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401018633268564:6158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:47.009509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:47.023246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401022928236011:5656]
2025-10-15T10:57:47.135254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:47.142584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:47.143504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:47.143533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:47.143580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:47.143834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:47.144003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401025727934448:5610]
2025-10-15T10:57:47.146177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:47.151696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:47.152011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:47.153384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:47.153756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:47.153765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:47.153775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:47.153781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:47.153789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:47.153796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:47.153803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:47.153810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:47.153817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:47.153824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:47.153831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:47.153839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.153847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.153854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.153908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:47.154026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:47.154075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:47.154127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:47.154174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:47.154222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:47.154269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:47.154316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:47.154363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:47.154410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:47.154457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:47.154505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.154553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.154600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.154646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:47.154713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:47.154775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:47.154838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:47.154890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:47.154949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:47.155004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:47.155099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:47.155161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:47.155222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:47.155270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:47.155324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:47.159454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:47.159549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:47.159608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:47.159669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:47.159717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:47.159769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:47.159817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:47.159873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:47.159922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:47.159976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:47.160024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.160081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.160129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.160186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.160236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.160289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.160868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:47.186377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:47.200717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:47.200765Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:47.200780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:47.200798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:47.200823Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 454 [2:7561401025727934448:5610]
2025-10-15T10:57:47.200874Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:47.200934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:47.200950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:47.200962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:47.200974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:47.201026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:47.201050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:47.201073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:47.202954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.202970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.202986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.202997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:47.203181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:47.203192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.203286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.203737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.203966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:47.204052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401022928235973:6158], now have 1 active actors on pipe
2025-10-15T10:57:47.204076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401018633268517:2467], now have 1 active actors on pipe
2025-10-15T10:57:47.204098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401022928236011:5656], now have 1 active actors on pipe
2025-10-15T10:57:47.204147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401025727934443:5610]
2025-10-15T10:57:47.204163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401025727934443:5610]
2025-10-15T10:57:47.204180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401025727934443:5610]
2025-10-15T10:57:47.204221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:47.204306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:47.204495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:47.204515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:47.204663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401025727934443:5610]
2025-10-15T10:57:47.204700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:47.204905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:47.204920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:47.204934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:47.204961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:47.205827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 454
2025-10-15T10:57:47.205942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 454
2025-10-15T10:57:47.206015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 454, pipe: [1:7561401022928236011:5656]
2025-10-15T10:57:47.206102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:47.206134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:47.206221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:47.206254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:47.206282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:47.206294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:47.206343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:47.206390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:47.206445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:47.210159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:47.210195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:47.210277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:47.215610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 455 partition: 0 MaxSeqNo: 46 sessionId: src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0
2025-10-15T10:57:47.216670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8189f327-4814a81b-62d7c131-ea98f1a8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:47.275202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0] Write session: try to update token
2025-10-15T10:57:47.275260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:47.303955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:47.303987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:47.304021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401025727934443:5610]
2025-10-15T10:57:47.304127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:47.304138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:47.304150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:47.304213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:47.304297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:47.309695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:47.310803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:47.312104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:47.313492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:47.315892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:47.316479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:47.346937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:47.346975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:47.346990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:47.347002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:47.347041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401025727934443:5610]
2025-10-15T10:57:47.347069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401025727934443:5610]
2025-10-15T10:57:47.347100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401025727934443:5610]
2025-10-15T10:57:47.347210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:47.347257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:47.347288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:47.347289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:47.347315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:47.352462Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:47.422613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId: src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:47.445681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:47.511296Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:47.513338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:47.513389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:47.515180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:47.514197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:47.516410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:47.516622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401022928236011:5656]
2025-10-15T10:57:47.542645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 455 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0
2025-10-15T10:57:47.542995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 455 sessionId: src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0 is DEAD
2025-10-15T10:57:47.544283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:47.544350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0] Write session will restart in 0.005048s
2025-10-15T10:57:47.544551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0] Write session: Do CDS request
2025-10-15T10:57:47.544612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:47.559008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:47.559022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:47.559051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 456
2025-10-15T10:57:47.559522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:47.559645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:47.559659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:47.559669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:47.561120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 456 sessionId:  describe result for acl check
2025-10-15T10:57:47.561247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:47.561260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:47.561270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:47.561288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401022928236366:6171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:47.563907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401022928236366:6171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:47.577997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401022928236366:6171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:47.592950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401022928236366:6171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:47.592990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401022928236366:6171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:47.593005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401022928236366:6171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:47.593034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:47.616620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401022928236578:5656]
2025-10-15T10:57:47.687933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:47.689668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:47.690463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:47.690493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:47.690534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:47.690764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:47.690945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401025727934757:5620]
2025-10-15T10:57:47.693019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:47.693985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:47.694185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:47.695307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:47.695633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:47.695640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:47.695646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:47.695653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:47.695659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:47.695665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:47.695672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:47.695680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:47.695686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:47.695692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:47.695698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:47.695704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.695711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.695717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.695758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:47.695856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:47.695902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:47.695948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:47.695990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:47.696034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:47.696076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:47.696116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:47.696159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:47.696216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:47.696256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:47.696297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.696335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.696376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.696415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:47.696480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:47.696535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:47.696585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:47.696627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:47.696676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:47.696737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:47.696788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:47.696835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:47.696884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:47.696925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:47.696972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:47.697015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:47.697063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:47.697105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:47.697155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:47.697202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:47.697250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:47.697292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:47.697353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:47.697402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:47.697455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:47.697494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.697612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.697661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.697709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.697750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.697799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.698268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:47.718556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:47.772532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:47.772781Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:47.772803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:47.772820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:47.772842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 455 [2:7561401025727934757:5620]
2025-10-15T10:57:47.772886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:47.772923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:47.772931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:47.772939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:47.772946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:47.772975Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:47.772988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:47.773000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:47.773991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.774005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.774017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.774028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:47.774289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:47.774308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:47.774399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:47.774512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:47.774650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:47.774691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401025727934752:5620]
2025-10-15T10:57:47.774700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401025727934752:5620]
2025-10-15T10:57:47.774707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401025727934752:5620]
2025-10-15T10:57:47.774733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:47.774776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:47.774894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:47.774904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:47.774983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401025727934752:5620]
2025-10-15T10:57:47.774994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:47.775711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:47.775720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401022928236488:6171], now have 1 active actors on pipe
2025-10-15T10:57:47.775734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:47.775737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401022928236351:2467], now have 1 active actors on pipe
2025-10-15T10:57:47.775746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:47.775750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401022928236578:5656], now have 1 active actors on pipe
2025-10-15T10:57:47.775769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:47.776533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 455
2025-10-15T10:57:47.776614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 455
2025-10-15T10:57:47.776685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 455, pipe: [1:7561401022928236578:5656]
2025-10-15T10:57:47.779211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 456 partition: 0 MaxSeqNo: 46 sessionId: src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0
2025-10-15T10:57:47.782145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6c2ad9b-bc91160c-1f55d5fa-d59c1c49_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:47.777596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:47.777628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:47.777706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:47.777735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:47.777751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:47.777761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:47.777791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:47.777826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:47.777868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:47.778887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:47.778905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:47.778960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:47.825880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0] Write session: try to update token
2025-10-15T10:57:47.825951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:47.938953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:47.938995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:47.939007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:47.939072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:47.939088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:47.939099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:47.939110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:47.939143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401025727934752:5620]
2025-10-15T10:57:47.939169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401025727934752:5620]
2025-10-15T10:57:47.939194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401025727934752:5620]
2025-10-15T10:57:47.939417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:47.939438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:47.939938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:47.939970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:47.939996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:47.948876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:47.976927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId: src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:47.999770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:48.108040Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:48.119454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:48.119497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:48.119562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:48.119575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:48.119608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401025727934752:5620]
2025-10-15T10:57:48.119896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:48.120778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:48.125169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:48.125812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:48.125983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401022928236578:5656]
2025-10-15T10:57:48.130965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 456 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0
2025-10-15T10:57:48.131212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 456 sessionId: src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0 is DEAD
2025-10-15T10:57:48.131864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:48.131889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0] Write session will restart in 0.009555s
2025-10-15T10:57:48.131947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0] Write session: Do CDS request
2025-10-15T10:57:48.131964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:48.146994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:48.147989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:48.148021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 457
2025-10-15T10:57:48.151557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:48.151696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:48.151712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:48.151722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:48.153525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 457 sessionId:  describe result for acl check
2025-10-15T10:57:48.153643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:48.153654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:48.153665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:48.153682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401027223204177:6176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:48.157267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401027223204177:6176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:48.179729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401027223204177:6176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:48.207955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401027223204177:6176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:48.207998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401027223204177:6176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:48.208015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401027223204177:6176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:48.208047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:48.222376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401027223204386:5656]
2025-10-15T10:57:48.275873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:48.282242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:48.283650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:48.283678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:48.283722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:48.284003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:48.284189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401030022902353:5624]
2025-10-15T10:57:48.286255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:48.287470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:48.287724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:48.289044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:48.289397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:48.289406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:48.289413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:48.289419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:48.289426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:48.289434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:48.289440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:48.289446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:48.289452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:48.289458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:48.289466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:48.289473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.289481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.289489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.289539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:48.289655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:48.289709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:48.289760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:48.289811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:48.289864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:48.289911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:48.289963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:48.290011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:48.290057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:48.290106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:48.290152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.290198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.290242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.290290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:48.290364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:48.290423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:48.290485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:48.290538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:48.290595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:48.290644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:48.290704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:48.290756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:48.290812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:48.290858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:48.290916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:48.290967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:48.291026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:48.291075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:48.291130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:48.291182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:48.291240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:48.291287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:48.291344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:48.292377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:48.292477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:48.292543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.292607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.292675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.292757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.292814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.292880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.293432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:48.315030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:48.324851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:48.324904Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:48.324923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:48.324944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:48.324971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 456 [2:7561401030022902353:5624]
2025-10-15T10:57:48.325029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:48.325096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:48.325112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:48.325127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:48.325140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:48.325192Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:48.325218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:48.325242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:48.340738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.340769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.340780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.340791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:48.341028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:48.341051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.341168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.341312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.341489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:48.341563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401030022902348:5624]
2025-10-15T10:57:48.341583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401030022902348:5624]
2025-10-15T10:57:48.341596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401030022902348:5624]
2025-10-15T10:57:48.341635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:48.341712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:48.341904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:48.341927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:48.342046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401030022902348:5624]
2025-10-15T10:57:48.342070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:48.342516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:48.342534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:48.342545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:48.342570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:48.343466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401027223204386:5656], now have 1 active actors on pipe
2025-10-15T10:57:48.343504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401027223204163:2467], now have 1 active actors on pipe
2025-10-15T10:57:48.343528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401027223204302:6176], now have 1 active actors on pipe
2025-10-15T10:57:48.344438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 456, pipe: [1:7561401027223204386:5656]
2025-10-15T10:57:48.344555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 456
2025-10-15T10:57:48.344561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 456
2025-10-15T10:57:48.347149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 457 partition: 0 MaxSeqNo: 46 sessionId: src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0
2025-10-15T10:57:48.344873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:48.344906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:48.344980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:48.345013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:48.345033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:48.345044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:48.345081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:48.345126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:48.345170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:48.346746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:48.346770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:48.346839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:48.348075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bd7449b-1cab5b68-4806f80f-a20bbedc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:48.390638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0] Write session: try to update token
2025-10-15T10:57:48.390693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:48.425944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:48.431771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:48.431813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:48.431825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:48.431857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401030022902348:5624]
2025-10-15T10:57:48.431883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401030022902348:5624]
2025-10-15T10:57:48.431906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401030022902348:5624]
2025-10-15T10:57:48.432035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:48.432071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:48.432078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:48.432090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:48.432098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:48.432115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:48.432203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:48.432221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:48.440410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:48.514706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId: src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:48.537310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:48.614508Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:48.641650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:48.641697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:48.641796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:48.641810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:48.641849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401030022902348:5624]
2025-10-15T10:57:48.642542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:48.644375Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:48.643536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:48.643560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:48.683447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401027223204386:5656]
2025-10-15T10:57:48.683535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:48.683645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 457 reason: error at write: Disconnected sessionId: src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0
2025-10-15T10:57:48.683906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 457 sessionId: src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0 is DEAD
2025-10-15T10:57:48.688072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:48.688105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0] Write session will restart in 0.008954s
2025-10-15T10:57:48.688196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0] Write session: Do CDS request
2025-10-15T10:57:48.688220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:48.704379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:48.707866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:48.707893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 458
2025-10-15T10:57:48.708249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:48.708354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:48.708368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:48.708377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:48.709620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 458 sessionId:  describe result for acl check
2025-10-15T10:57:48.709721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:48.709731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:48.709740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:48.709756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401027223204722:6187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:48.712167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401027223204722:6187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:48.733908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401027223204722:6187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:48.746264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401027223204722:6187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:48.746308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401027223204722:6187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:48.746326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401027223204722:6187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:48.746356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:48.784019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401027223205076:5656]
2025-10-15T10:57:48.816489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:48.820435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:48.821308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:48.821327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:48.821368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:48.821612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:48.821730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401030022902652:5632]
2025-10-15T10:57:48.823289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:48.826856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:48.827071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:48.828467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:48.828815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:48.828824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:48.828831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:48.828837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:48.828845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:48.828853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:48.828860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:48.828867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:48.828874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:48.828881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:48.828889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:48.828895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.828904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.828910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.828954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:48.829056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:48.829107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:48.829155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:48.829202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:48.829250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:48.829295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:48.829340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:48.829386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:48.829432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:48.829480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:48.829527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.829570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.829615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.829655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:48.829717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:48.829777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:48.829847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:48.829895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:48.829948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:48.829993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:48.830047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:48.830095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:48.830148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:48.830194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:48.830246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:48.830292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:48.830344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:48.830388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:48.830438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:48.830484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:48.830536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:48.830583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:48.830635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:48.830681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:48.830732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:48.830778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.830830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.830875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.830924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.830968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.831019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.831597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:48.876104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:48.886580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:48.886630Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:48.886648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:48.886667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:48.886689Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 457 [2:7561401030022902652:5632]
2025-10-15T10:57:48.886739Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:48.886793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:48.886807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:48.886819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:48.886831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:48.886876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:48.886896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:48.886916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:48.889471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 457
2025-10-15T10:57:48.889554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 457
2025-10-15T10:57:48.889620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 457, pipe: [1:7561401027223205076:5656]
2025-10-15T10:57:48.888685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.888724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.888737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.888748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:48.889036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:48.889055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:48.889189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:48.889375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:48.889604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:48.889677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401027223204904:6187], now have 1 active actors on pipe
2025-10-15T10:57:48.889700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401027223204682:2467], now have 1 active actors on pipe
2025-10-15T10:57:48.889720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401027223205076:5656], now have 1 active actors on pipe
2025-10-15T10:57:48.889744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401030022902647:5632]
2025-10-15T10:57:48.889758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401030022902647:5632]
2025-10-15T10:57:48.889771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401030022902647:5632]
2025-10-15T10:57:48.889814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:48.889842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:48.889856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:48.889866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:48.889881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:48.890057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:48.890075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:48.890230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:48.890250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:48.890279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401030022902647:5632]
2025-10-15T10:57:48.890311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:48.890347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:48.890410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:48.890438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:48.890455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:48.890465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:48.890495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:48.890532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:48.890604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:48.891532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:48.891563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:48.891642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:48.895705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 458 partition: 0 MaxSeqNo: 46 sessionId: src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0
2025-10-15T10:57:48.899382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe74dc89-7fab37b5-ce8d1eb7-9ee40a29_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:48.938559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0] Write session: try to update token
2025-10-15T10:57:48.938620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:49.067480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:49.067562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:49.067609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:49.067703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:49.067731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:49.067756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:49.067794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:49.067853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401030022902647:5632]
2025-10-15T10:57:49.067895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401030022902647:5632]
2025-10-15T10:57:49.067945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401030022902647:5632]
2025-10-15T10:57:49.068266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:49.068302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:49.069933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:49.071721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:49.071800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:49.071863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:49.102012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId: src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:49.124308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:49.213862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:49.242696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:49.242744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:49.242811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:49.242825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:49.242859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401030022902647:5632]
2025-10-15T10:57:49.243119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:49.243828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:49.245341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401027223205076:5656]
2025-10-15T10:57:49.245603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:49.254192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:49.254240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0] Write session will restart in 0.006838s
2025-10-15T10:57:49.254348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0] Write session: Do CDS request
2025-10-15T10:57:49.254386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:49.250976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:49.253078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 458 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0
2025-10-15T10:57:49.253363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 458 sessionId: src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0 is DEAD
2025-10-15T10:57:49.285973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:49.285995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 459
2025-10-15T10:57:49.286548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:49.287038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:49.287197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:49.287213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:49.287228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:49.288513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 459 sessionId:  describe result for acl check
2025-10-15T10:57:49.288586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:49.288593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:49.288599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:49.288608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401031518172516:6197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:49.290375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401031518172516:6197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:49.302339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401031518172516:6197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:49.311686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401031518172516:6197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:49.311731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401031518172516:6197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:49.311749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401031518172516:6197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:49.311781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:49.344371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401031518172672:5656]
2025-10-15T10:57:49.455004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:49.463914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:49.464984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:49.465015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:49.465063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:49.465345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:49.465554Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401034317870276:5643]
2025-10-15T10:57:49.472196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:49.484002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:49.484302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:49.495881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:49.496547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:49.496556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:49.496563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:49.496570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:49.496576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:49.496584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:49.496593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:49.496600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:49.496608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:49.496615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:49.496623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:49.496629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:49.496636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:49.496643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:49.496702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:49.496852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:49.496909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:49.496966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:49.497017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:49.497074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:49.497122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:49.497171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:49.497216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:49.497264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:49.497311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:49.497362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:49.497408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:49.497454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:49.497525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:49.497599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:49.497666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:49.497725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:49.497791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:49.497849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:49.497904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:49.497961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:49.498011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:49.498069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:49.498118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:49.498177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:49.498228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:49.498283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:49.498329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:49.498387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:49.498449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:49.498513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:49.498560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:49.498618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:49.498669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:49.498727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:49.498774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:49.498830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:49.498881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:49.498936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:49.498983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:49.499042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:49.499603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:49.517876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:49.528009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:49.528068Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:49.528088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:49.528110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:49.528140Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 458 [2:7561401034317870276:5643]
2025-10-15T10:57:49.528199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:49.528270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:49.528288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:49.528303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:49.528315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:49.528377Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:49.528406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:49.528434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:49.529879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:49.529907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:49.529922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:49.529933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:49.530206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:49.530230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:49.530383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:49.530591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:49.530830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:49.530931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401031518172562:6197], now have 1 active actors on pipe
2025-10-15T10:57:49.530956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401031518172499:2467], now have 1 active actors on pipe
2025-10-15T10:57:49.530978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401031518172672:5656], now have 1 active actors on pipe
2025-10-15T10:57:49.531003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401034317870271:5643]
2025-10-15T10:57:49.531017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401034317870271:5643]
2025-10-15T10:57:49.531031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401034317870271:5643]
2025-10-15T10:57:49.531068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:49.531139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:49.531322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:49.531339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:49.531445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:49.531461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:49.531474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:49.531514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401034317870271:5643]
2025-10-15T10:57:49.531624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 458
2025-10-15T10:57:49.531540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:49.531735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 458, pipe: [1:7561401031518172672:5656]
2025-10-15T10:57:49.531829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 458
2025-10-15T10:57:49.533894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 459 partition: 0 MaxSeqNo: 46 sessionId: src_id|3bf44b66-81843d72-a8193794-4746792f_0
2025-10-15T10:57:49.532198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:49.532501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:49.532525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:49.532602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bf44b66-81843d72-a8193794-4746792f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:49.532637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:49.532656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:49.532667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:49.532706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:49.532766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:49.532809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:49.533370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:49.533392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:49.533470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:49.538101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c380a7aa-e37f5399-b940d8b4-34ee058b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3bf44b66-81843d72-a8193794-4746792f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:49.574735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf44b66-81843d72-a8193794-4746792f_0] Write session: try to update token
2025-10-15T10:57:49.574796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf44b66-81843d72-a8193794-4746792f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:49.721174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:49.721208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:49.721225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:49.721236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:49.721271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401034317870271:5643]
2025-10-15T10:57:49.721297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401034317870271:5643]
2025-10-15T10:57:49.721322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401034317870271:5643]
2025-10-15T10:57:49.721509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:49.721525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:49.721539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:49.722473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:49.722510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:49.722536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:49.731323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:49.731377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:49.732227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:49.743473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId: src_id|3bf44b66-81843d72-a8193794-4746792f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:49.781426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:49.889584Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:49.891710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:49.891729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:49.891773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401034317870271:5643]
2025-10-15T10:57:49.891926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:49.891950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:49.891964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:49.892818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:49.895510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:49.895529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401031518172672:5656]
2025-10-15T10:57:49.895537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:49.895620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:49.927045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 459 reason: error at write: Disconnected sessionId: src_id|3bf44b66-81843d72-a8193794-4746792f_0
2025-10-15T10:57:49.928019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf44b66-81843d72-a8193794-4746792f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:49.928109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf44b66-81843d72-a8193794-4746792f_0] Write session will restart in 0.006997s
2025-10-15T10:57:49.928359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf44b66-81843d72-a8193794-4746792f_0] Write session: Do CDS request
2025-10-15T10:57:49.928435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf44b66-81843d72-a8193794-4746792f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:49.927491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 459 sessionId: src_id|3bf44b66-81843d72-a8193794-4746792f_0 is DEAD
2025-10-15T10:57:49.945717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf44b66-81843d72-a8193794-4746792f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:49.947623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:49.947653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 460
2025-10-15T10:57:49.948088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:49.948228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:49.948245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:49.948256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:49.955417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 460 sessionId:  describe result for acl check
2025-10-15T10:57:49.955534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:49.955544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:49.955554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:49.955570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401031518173037:6202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:49.958069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401031518173037:6202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:49.976886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401031518173037:6202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:49.988512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401031518173037:6202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:49.988552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401031518173037:6202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:49.988569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401031518173037:6202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:49.988600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:49.995886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401031518173225:5656]
2025-10-15T10:57:50.095498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:50.098276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:50.099242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:50.099279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:50.099326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:50.099618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:50.099842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401038612837888:5651]
2025-10-15T10:57:50.102019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:50.103580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:50.103836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:50.105195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:50.105540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:50.105560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:50.105568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:50.105575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:50.105581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:50.105589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:50.105599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:50.105605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:50.105613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:50.105619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:50.105625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:50.105633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.105640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.105648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.105693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:50.105804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:50.105854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:50.105904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:50.105950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:50.106000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:50.106044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:50.106088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:50.106134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:50.106182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:50.106230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:50.106275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.106319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.106365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.106406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:50.106473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:50.106528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:50.106582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:50.106633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:50.106690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:50.106734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:50.106787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:50.106838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:50.106893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:50.106939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:50.106994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:50.107041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:50.107094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:50.107141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:50.107196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:50.107245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:50.107302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:50.110073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:50.110195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:50.110258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:50.110313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:50.110360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.110417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.110466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.110522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.110568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.110620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.111159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:50.136360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:50.146497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:50.146550Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:50.146568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:50.146587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:50.146612Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 459 [2:7561401038612837888:5651]
2025-10-15T10:57:50.146661Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:50.146723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:50.146737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:50.146750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:50.146761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:50.146812Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:50.146835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:50.146859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:50.157973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 459, pipe: [1:7561401031518173225:5656]
2025-10-15T10:57:50.158079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 459
2025-10-15T10:57:50.158160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 459
2025-10-15T10:57:50.156620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.156653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.156667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.156679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:50.156963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:50.156980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.157121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.157298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.157493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:50.157571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401031518173001:2467], now have 1 active actors on pipe
2025-10-15T10:57:50.157608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401031518173225:5656], now have 1 active actors on pipe
2025-10-15T10:57:50.157628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401031518173187:6202], now have 1 active actors on pipe
2025-10-15T10:57:50.157667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401038612837883:5651]
2025-10-15T10:57:50.157681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401038612837883:5651]
2025-10-15T10:57:50.157694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401038612837883:5651]
2025-10-15T10:57:50.157732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:50.157802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:50.157813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:50.157832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:50.157844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:50.157971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:50.157988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:50.158108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401038612837883:5651]
2025-10-15T10:57:50.158133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:50.158152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:50.158968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:50.158999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:50.159085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:50.159116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:50.159135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:50.159147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:50.159184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:50.159227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:50.159274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:50.161440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 460 partition: 0 MaxSeqNo: 46 sessionId: src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0
2025-10-15T10:57:50.161024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:50.161055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:50.161121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:50.163589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf44b66-81843d72-a8193794-4746792f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:50.211489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0] Write session: try to update token
2025-10-15T10:57:50.211551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:50.319307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:50.319342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:50.319371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:50.319432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:50.319447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:50.319460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:50.319471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:50.319506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401038612837883:5651]
2025-10-15T10:57:50.319535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401038612837883:5651]
2025-10-15T10:57:50.319558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401038612837883:5651]
2025-10-15T10:57:50.319776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:50.319800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:50.320175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:50.320212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:50.320237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:50.346817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:50.379700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId: src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:50.409340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:50.497964Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:50.508860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:50.508913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:50.508989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:50.509006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:50.509052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401038612837883:5651]
2025-10-15T10:57:50.509245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:50.511498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:50.511722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401031518173225:5656]
2025-10-15T10:57:50.511817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:50.509739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:50.525947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 460 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0
2025-10-15T10:57:50.526241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 460 sessionId: src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0 is DEAD
2025-10-15T10:57:50.528108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:50.528183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0] Write session will restart in 0.006277s
2025-10-15T10:57:50.528292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0] Write session: Do CDS request
2025-10-15T10:57:50.528320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:50.547887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:50.547917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 461
2025-10-15T10:57:50.548247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:50.549114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:50.549356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:50.549392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:50.549415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:50.552411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 461 sessionId:  describe result for acl check
2025-10-15T10:57:50.552527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:50.552538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:50.552548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:50.552563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401035813140856:6217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:50.559248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401035813140856:6217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:50.569577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401035813140856:6217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:50.603135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401035813140856:6217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:50.603181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401035813140856:6217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:50.603198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401035813140856:6217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:50.603229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:50.611553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401035813141042:5656]
2025-10-15T10:57:50.751095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:50.757449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:50.758271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:50.758295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:50.758333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:50.758568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:50.758747Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401038612838203:5662]
2025-10-15T10:57:50.760684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:50.761561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:50.761744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:50.762889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:50.763200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:50.763208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:50.763216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:50.763223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:50.763228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:50.763234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:50.763241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:50.763247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:50.763254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:50.763260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:50.763266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:50.763272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.763278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.763285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.763330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:50.763454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:50.763501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:50.763543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:50.763586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:50.763632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:50.763675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:50.763717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:50.763758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:50.763803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:50.763846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:50.763889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.763931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.763971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.764012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:50.764074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:50.764141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:50.764193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:50.764241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:50.764291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:50.764331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:50.764380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:50.764428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:50.764476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:50.764519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:50.764568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:50.764612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:50.764661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:50.764705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:50.764761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:50.764809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:50.764859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:50.764901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:50.764950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:50.764993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:50.765040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:50.765081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.765129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.765170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.765216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.765256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.765304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.767195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:50.799793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:50.810154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:50.810200Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:50.810217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:50.810233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:50.810259Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 460 [2:7561401038612838203:5662]
2025-10-15T10:57:50.810307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:50.810363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:50.810377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:50.810388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:50.810399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:50.810443Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:50.810467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:50.810490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:50.811528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.811543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.811555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.811565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:50.811825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:50.811842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:50.811973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:50.812162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:50.812578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:50.812662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401035813140844:2467], now have 1 active actors on pipe
2025-10-15T10:57:50.812686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401035813141042:5656], now have 1 active actors on pipe
2025-10-15T10:57:50.812708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401035813141015:6217], now have 1 active actors on pipe
2025-10-15T10:57:50.812783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:50.812803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:50.812836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401038612838198:5662]
2025-10-15T10:57:50.812849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401038612838198:5662]
2025-10-15T10:57:50.812862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401038612838198:5662]
2025-10-15T10:57:50.812898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:50.812119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 460
2025-10-15T10:57:50.812210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 460, pipe: [1:7561401035813141042:5656]
2025-10-15T10:57:50.812232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 460
2025-10-15T10:57:50.812936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:50.812960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:50.812966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:50.812972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:50.813145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:50.813161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:50.813226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:50.813254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:50.813272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:50.813284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:50.813320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:50.813360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:50.813485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401038612838198:5662]
2025-10-15T10:57:50.813521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:50.813566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:50.813633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:50.815340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:50.815383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:50.815446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:50.816591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62eab3-de9a05e5-fbbb2af3-e137b2e3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:50.815714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 461 partition: 0 MaxSeqNo: 46 sessionId: src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0
2025-10-15T10:57:50.857323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0] Write session: try to update token
2025-10-15T10:57:50.857394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:50.962148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:50.962196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:50.962241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401038612838198:5662]
2025-10-15T10:57:50.962397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:50.962406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:50.962413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:50.962428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:50.962574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:50.968308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:50.969841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:50.971542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:50.972864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:50.975163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:51.055805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId: src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:51.062817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:51.063011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:51.063044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:51.063059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:51.063071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:51.063121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401038612838198:5662]
2025-10-15T10:57:51.063152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401038612838198:5662]
2025-10-15T10:57:51.063174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401038612838198:5662]
2025-10-15T10:57:51.063331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:51.063361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:51.063374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:51.063384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:51.063411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:51.063425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:51.063434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:51.063447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:51.064632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:51.076870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:51.215620Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:51.217213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:51.217247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:51.218053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:51.219167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:51.219311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401035813141042:5656]
2025-10-15T10:57:51.219499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:51.219524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:51.227096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 461 reason: error at write: Disconnected sessionId: src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0
2025-10-15T10:57:51.227787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:51.227823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0] Write session will restart in 0.007271s
2025-10-15T10:57:51.227976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0] Write session: Do CDS request
2025-10-15T10:57:51.228030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:51.227651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 461 sessionId: src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0 is DEAD
2025-10-15T10:57:51.240509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:51.248294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:51.248348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 462
2025-10-15T10:57:51.249754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:51.249888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:51.249905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:51.249916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:51.252094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 462 sessionId:  describe result for acl check
2025-10-15T10:57:51.252236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:51.252252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:51.252261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:51.252280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401040108108674:6222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:51.255063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401040108108674:6222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:51.290384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401040108108674:6222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:51.307235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401040108108674:6222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:51.307277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401040108108674:6222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:51.307293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401040108108674:6222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:51.307325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:51.313245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401040108108781:5656]
2025-10-15T10:57:51.486135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:51.486666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:51.487480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:51.487509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:51.487552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:51.487796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:51.487976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401042907805818:5666]
2025-10-15T10:57:51.490077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:51.493419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:51.493638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:51.494882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:51.495214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:51.495234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:51.495240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:51.495247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:51.495253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:51.495260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:51.495266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:51.495273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:51.495280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:51.495287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:51.495293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:51.495300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:51.495308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:51.495314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:51.495379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:51.495488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:51.495536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:51.495580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:51.495635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:51.495679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:51.495721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:51.495764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:51.495811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:51.495857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:51.495901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:51.495945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:51.495989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:51.496032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:51.496075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:51.496143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:51.496201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:51.496259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:51.496309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:51.496365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:51.496428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:51.496481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:51.496529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:51.496581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:51.496622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:51.496673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:51.496719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:51.496784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:51.496828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:51.496879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:51.496927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:51.496983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:51.497027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:51.497079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:51.497126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:51.497179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:51.497223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:51.497276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:51.497324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:51.497378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:51.497419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:51.497472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:51.497963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:51.520911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:51.536086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:51.536136Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:51.536155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:51.536173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:51.536196Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 461 [2:7561401042907805818:5666]
2025-10-15T10:57:51.536245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:51.536299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:51.536314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:51.536326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:51.536338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:51.536382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:51.536402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:51.536423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:51.564472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:51.564496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:51.564505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:51.564513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:51.564763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:51.564778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:51.564894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:51.565043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:51.565249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:51.565320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401040108108781:5656], now have 1 active actors on pipe
2025-10-15T10:57:51.565341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401040108108662:2467], now have 1 active actors on pipe
2025-10-15T10:57:51.565360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401040108108761:6222], now have 1 active actors on pipe
2025-10-15T10:57:51.565383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401042907805813:5666]
2025-10-15T10:57:51.565396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401042907805813:5666]
2025-10-15T10:57:51.565407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401042907805813:5666]
2025-10-15T10:57:51.565444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:51.565505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:51.565679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:51.565694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:51.565804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401042907805813:5666]
2025-10-15T10:57:51.565821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:51.566928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 461, pipe: [1:7561401040108108781:5656]
2025-10-15T10:57:51.567052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 461
2025-10-15T10:57:51.567152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 461
2025-10-15T10:57:51.567519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:51.567554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:51.567567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:51.567594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:51.568726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:51.568773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:51.568855Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:51.568888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:51.568908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:51.568920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:51.568972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:51.569032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:51.569082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:51.571568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:51.571602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:51.571678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:51.572081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 462 partition: 0 MaxSeqNo: 46 sessionId: src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0
2025-10-15T10:57:51.575630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1baded1-9e9c5519-3648d60e-7c4df4b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:51.699408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0] Write session: try to update token
2025-10-15T10:57:51.699465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:51.704339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:51.704374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:51.704385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:51.704441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:51.704455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:51.704468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:51.704480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:51.704513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401042907805813:5666]
2025-10-15T10:57:51.704538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401042907805813:5666]
2025-10-15T10:57:51.704560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401042907805813:5666]
2025-10-15T10:57:51.704745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:51.704780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:51.705818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:51.707478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:51.707516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:51.707545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
E1015 10:57:51.748937078  856792 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:57:51.813510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId: src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:51.834638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:51.859912Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:51.873702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:51.873755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:51.873816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:51.873830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:51.873867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401042907805813:5666]
2025-10-15T10:57:51.874358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:51.875073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401040108108781:5656]
2025-10-15T10:57:51.875160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:51.875285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:51.875298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:51.878716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:51.925242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 462 reason: error at write: Disconnected sessionId: src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0
2025-10-15T10:57:51.925574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 462 sessionId: src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0 is DEAD
2025-10-15T10:57:51.932065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:51.932097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0] Write session will restart in 0.009225s
2025-10-15T10:57:51.932192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0] Write session: Do CDS request
2025-10-15T10:57:51.932220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:51.947909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:51.947810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:51.947840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 463
2025-10-15T10:57:51.950101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:51.950242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:51.950263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:51.950273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:51.951543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 463 sessionId:  describe result for acl check
2025-10-15T10:57:51.951660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:51.951678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:51.951687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:51.951705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401040108109219:6233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:51.954926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401040108109219:6233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:51.964372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401040108109219:6233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:51.975444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401040108109279:5656]
2025-10-15T10:57:51.981237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401040108109219:6233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:51.981279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401040108109219:6233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:51.981296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401040108109219:6233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:51.981327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:52.081719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:52.090660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:52.091698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:52.091729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:52.091769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:52.092010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:52.092165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401047202773445:5674]
2025-10-15T10:57:52.094257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:52.100812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:52.101067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:52.137183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:52.137686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:52.137694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:52.137701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:52.137707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:52.137714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:52.137721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:52.137727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:52.137734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:52.137740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:52.137747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:52.137753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:52.137760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.137765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.137771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.137816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:52.137921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:52.137965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:52.138005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:52.138044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:52.138084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:52.138120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:52.138155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:52.138193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:52.138230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:52.138267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:52.138306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.138343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.138379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.138412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:52.138471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:52.138524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:52.138574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:52.138615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:52.138661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:52.138701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:52.138748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:52.138791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:52.138842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:52.138882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:52.138932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:52.138971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:52.139016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:52.139053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:52.139097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:52.139138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:52.139181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:52.139219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:52.139268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:52.139310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:52.139386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:52.139427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.139473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.139515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.139559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.139601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.139650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.140135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:52.164615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:52.173122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:52.173161Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:52.173172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:52.173188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:52.173207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 462 [2:7561401047202773445:5674]
2025-10-15T10:57:52.173250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:52.173303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:52.173321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:52.173338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:52.173350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:52.173388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:52.173406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:52.173423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:52.174285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.174302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.174317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.174330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:52.174598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:52.174616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.174751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.174909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.175105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:52.175159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401047202773439:5674]
2025-10-15T10:57:52.176253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401047202773439:5674]
2025-10-15T10:57:52.176270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401047202773439:5674]
2025-10-15T10:57:52.176296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:52.176365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:52.176524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:52.176545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:52.176586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401040108109181:2467], now have 1 active actors on pipe
2025-10-15T10:57:52.176607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401040108109279:5656], now have 1 active actors on pipe
2025-10-15T10:57:52.176623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401040108109309:6233], now have 1 active actors on pipe
2025-10-15T10:57:52.176658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:52.176674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:52.176791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401047202773439:5674]
2025-10-15T10:57:52.176806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:52.176857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c00e155d-c922140-667bcff9-83fcfd13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:52.176879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:52.176902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:52.176914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:52.176947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:52.176981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:52.177065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:52.177082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:52.177082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:52.177096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:52.177123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:52.178196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:52.178220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:52.178284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:52.175753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 462, pipe: [1:7561401040108109279:5656]
2025-10-15T10:57:52.175758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 462
2025-10-15T10:57:52.175855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 462
2025-10-15T10:57:52.178639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 463 partition: 0 MaxSeqNo: 46 sessionId: src_id|c00e155d-c922140-667bcff9-83fcfd13_0
2025-10-15T10:57:52.180661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c56efbd8-a39b8697-1d4cb7e7-b086bf40_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c00e155d-c922140-667bcff9-83fcfd13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:52.214153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c00e155d-c922140-667bcff9-83fcfd13_0] Write session: try to update token
2025-10-15T10:57:52.214224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c00e155d-c922140-667bcff9-83fcfd13_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:52.288366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:52.288403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:52.288415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:52.288475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:52.288490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:52.288502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:52.288511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:52.288557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401047202773439:5674]
2025-10-15T10:57:52.288610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401047202773439:5674]
2025-10-15T10:57:52.288662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401047202773439:5674]
2025-10-15T10:57:52.289344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:52.289378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:52.289407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:52.325496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:52.325549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:52.326632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:52.362593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId: src_id|c00e155d-c922140-667bcff9-83fcfd13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:52.385410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:52.501679Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:52.503538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:52.503558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:52.503608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401047202773439:5674]
2025-10-15T10:57:52.503768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:52.503798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:52.504182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:52.505722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:52.505752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:52.505320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:52.511532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:52.511702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401040108109279:5656]
2025-10-15T10:57:52.518249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 463 reason: error at write: Disconnected sessionId: src_id|c00e155d-c922140-667bcff9-83fcfd13_0
2025-10-15T10:57:52.518557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 463 sessionId: src_id|c00e155d-c922140-667bcff9-83fcfd13_0 is DEAD
2025-10-15T10:57:52.519511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c00e155d-c922140-667bcff9-83fcfd13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:52.519565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c00e155d-c922140-667bcff9-83fcfd13_0] Write session will restart in 0.008393s
2025-10-15T10:57:52.519713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c00e155d-c922140-667bcff9-83fcfd13_0] Write session: Do CDS request
2025-10-15T10:57:52.519761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c00e155d-c922140-667bcff9-83fcfd13_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:52.532188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:52.532218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 464
2025-10-15T10:57:52.533070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c00e155d-c922140-667bcff9-83fcfd13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:52.533562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:52.533677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:52.533690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:52.533700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:52.535314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 464 sessionId:  describe result for acl check
2025-10-15T10:57:52.535430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:52.535440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:52.535449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:52.535464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401044403077027:6242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:52.537669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401044403077027:6242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:52.557476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401044403077027:6242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:52.569518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401044403077027:6242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:52.569547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401044403077027:6242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:52.569558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401044403077027:6242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:52.569579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:52.611254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401044403077252:5656]
2025-10-15T10:57:52.689769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:52.691934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:52.692787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:52.692806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:52.692848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:52.693118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:52.693292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401047202773738:5685]
2025-10-15T10:57:52.695774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:52.697058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:52.697336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:52.698671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:52.699029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:52.699049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:52.699056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:52.699063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:52.699070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:52.699076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:52.699082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:52.699088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:52.699096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:52.699102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:52.699109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:52.699115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.699122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.699128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.699183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:52.699306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:52.699820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:52.699900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:52.699974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:52.700034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:52.700088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:52.700146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:52.700205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:52.700263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:52.700320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:52.700375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.700435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.700489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.700557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:52.700649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:52.700721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:52.700804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:52.700864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:52.700925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:52.700986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:52.701051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:52.701115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:52.701177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:52.701229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:52.701292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:52.701349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:52.701417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:52.701474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:52.701538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:52.701594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:52.701655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:52.701713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:52.701776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:52.701831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:52.701894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:52.701946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.702011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.702065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.702128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.702183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.702245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.702782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:52.722424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:52.771797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:52.771846Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:52.771863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:52.771882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:52.771906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 463 [2:7561401047202773738:5685]
2025-10-15T10:57:52.771956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:52.772016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:52.772030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:52.772042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:52.772052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:52.772101Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:52.772124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:52.772148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:52.773152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.773170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.773183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.773195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:52.773452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:52.773469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:52.773611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:52.773804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:52.774027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:52.774094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401047202773733:5685]
2025-10-15T10:57:52.774109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401047202773733:5685]
2025-10-15T10:57:52.774122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401047202773733:5685]
2025-10-15T10:57:52.774162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:52.774236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:52.774418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:52.774435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:52.774526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:52.774541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:52.774554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:52.774558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401047202773733:5685]
2025-10-15T10:57:52.774578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:52.774724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:52.775733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401044403077075:6242], now have 1 active actors on pipe
2025-10-15T10:57:52.775775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401044403077015:2467], now have 1 active actors on pipe
2025-10-15T10:57:52.775796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401044403077252:5656], now have 1 active actors on pipe
2025-10-15T10:57:52.775688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 463
2025-10-15T10:57:52.775797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 463
2025-10-15T10:57:52.775864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 463, pipe: [1:7561401044403077252:5656]
2025-10-15T10:57:52.775943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:52.775969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:52.776040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b851035-776166a-25912985-8f509539_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:52.776075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:52.776098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:52.776110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:52.776148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:52.776192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:52.776259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:52.777452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:52.777483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:52.777556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:52.777846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 464 partition: 0 MaxSeqNo: 46 sessionId: src_id|7b851035-776166a-25912985-8f509539_0
2025-10-15T10:57:52.779707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c00e155d-c922140-667bcff9-83fcfd13_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7b851035-776166a-25912985-8f509539_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:52.814993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b851035-776166a-25912985-8f509539_0] Write session: try to update token
2025-10-15T10:57:52.815039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b851035-776166a-25912985-8f509539_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:52.873853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:52.873896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:52.873913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:52.873926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:52.873966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401047202773733:5685]
2025-10-15T10:57:52.873998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401047202773733:5685]
2025-10-15T10:57:52.874025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401047202773733:5685]
2025-10-15T10:57:52.874176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:52.874207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:52.874222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:52.874224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:52.874237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:52.874251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:52.874290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:52.874314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:52.875457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:52.947374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId: src_id|7b851035-776166a-25912985-8f509539_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:52.967932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:53.057548Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:53.060062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:53.060102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:53.068063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:53.068505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401044403077252:5656]
2025-10-15T10:57:53.068603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:53.068615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:53.098490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:53.098632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 464 reason: error at write: Disconnected sessionId: src_id|7b851035-776166a-25912985-8f509539_0
2025-10-15T10:57:53.098958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 464 sessionId: src_id|7b851035-776166a-25912985-8f509539_0 is DEAD
2025-10-15T10:57:53.101229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b851035-776166a-25912985-8f509539_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:53.101267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b851035-776166a-25912985-8f509539_0] Write session will restart in 0.008546s
2025-10-15T10:57:53.101373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b851035-776166a-25912985-8f509539_0] Write session: Do CDS request
2025-10-15T10:57:53.101404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b851035-776166a-25912985-8f509539_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:53.121852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b851035-776166a-25912985-8f509539_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:53.126384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:53.126416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 465
2025-10-15T10:57:53.127484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:53.127612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:53.127629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:53.127637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:53.129483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 465 sessionId:  describe result for acl check
2025-10-15T10:57:53.129595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:53.129606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:53.129616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:53.129633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401048698044857:6253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:53.132167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401048698044857:6253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:53.151020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401048698044857:6253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:53.169690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401048698044980:5656]
2025-10-15T10:57:53.172938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401048698044857:6253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:53.172983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401048698044857:6253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:53.173003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401048698044857:6253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:53.173039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:53.268399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:53.276592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:53.277600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:53.277615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:53.277653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:53.277866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:53.277982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401051497741354:5695]
2025-10-15T10:57:53.279962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:53.281224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:53.281467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:53.282698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:53.283029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:53.283036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:53.283041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:53.283047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:53.283052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:53.283056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:53.283061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:53.283065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:53.283070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:53.283074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:53.283079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:53.283084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.283089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.283094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.283128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:53.283237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:53.283270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:53.283303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:53.283333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:53.283393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:53.283426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:53.283457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:53.283487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:53.283519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:53.283552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:53.283582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.283611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.283642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.283670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:53.283714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:53.283761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:53.283815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:53.283862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:53.283912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:53.283958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:53.284015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:53.284062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:53.284113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:53.284162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:53.284215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:53.284262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:53.284314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:53.284361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:53.284413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:53.284461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:53.284519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:53.284566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:53.284620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:53.284694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:53.284743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:53.284799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.284866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.284896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.284935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.284967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.285004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.285398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:53.325915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:53.336214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:53.336255Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:53.336268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:53.336282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:53.336306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 464 [2:7561401051497741354:5695]
2025-10-15T10:57:53.336360Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:53.336418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:53.336434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:53.336448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:53.336459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:53.336509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:53.336527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:53.336544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:53.338579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.338613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.338626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.338638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:53.338904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:53.338930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.339072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.339267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.339515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:53.339595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401051497741348:5695]
2025-10-15T10:57:53.339619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401051497741348:5695]
2025-10-15T10:57:53.339634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401051497741348:5695]
2025-10-15T10:57:53.339781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:53.339799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:53.339810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:53.340420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 464
2025-10-15T10:57:53.340518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 464, pipe: [1:7561401048698044980:5656]
2025-10-15T10:57:53.340605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 464
2025-10-15T10:57:53.341040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:53.341133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:53.341320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:53.341346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:53.341393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401048698044841:2467], now have 1 active actors on pipe
2025-10-15T10:57:53.341421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401048698044980:5656], now have 1 active actors on pipe
2025-10-15T10:57:53.341449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401048698045004:6253], now have 1 active actors on pipe
2025-10-15T10:57:53.341514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:53.341538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:53.341655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401051497741348:5695]
2025-10-15T10:57:53.341687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:53.341720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:53.341769Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|990df072-fb94121e-8623f326-84e08dca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:53.341804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:53.341826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:53.341836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:53.341878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:53.341923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:53.342061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:53.343326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:53.343372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:53.343449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:53.343876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 465 partition: 0 MaxSeqNo: 46 sessionId: src_id|990df072-fb94121e-8623f326-84e08dca_0
2025-10-15T10:57:53.347451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b851035-776166a-25912985-8f509539_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|990df072-fb94121e-8623f326-84e08dca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:53.400600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|990df072-fb94121e-8623f326-84e08dca_0] Write session: try to update token
2025-10-15T10:57:53.400641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|990df072-fb94121e-8623f326-84e08dca_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:53.411800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:53.411836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:53.411868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401051497741348:5695]
2025-10-15T10:57:53.411983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:53.415481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:53.422256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:53.425583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:53.427539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:53.432567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:53.434498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:53.435006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:53.436504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:53.436526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:53.436537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:53.537474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:53.537509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:53.537522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:53.619227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId: src_id|990df072-fb94121e-8623f326-84e08dca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:53.642582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:53.642619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:53.642632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:53.642642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:53.642679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401051497741348:5695]
2025-10-15T10:57:53.642705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401051497741348:5695]
2025-10-15T10:57:53.642727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401051497741348:5695]
2025-10-15T10:57:53.642869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:53.642881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:53.642891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:53.642933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:53.642951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:53.644013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:53.647480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:53.647517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:53.647546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:53.674874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:53.807862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:53.809356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:53.809397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:53.810902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:53.811045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401048698044980:5656]
2025-10-15T10:57:53.811146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:53.811159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:53.810127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:53.819161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 465 reason: error at write: Disconnected sessionId: src_id|990df072-fb94121e-8623f326-84e08dca_0
2025-10-15T10:57:53.819495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 465 sessionId: src_id|990df072-fb94121e-8623f326-84e08dca_0 is DEAD
2025-10-15T10:57:53.823412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990df072-fb94121e-8623f326-84e08dca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:53.823461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990df072-fb94121e-8623f326-84e08dca_0] Write session will restart in 0.007706s
2025-10-15T10:57:53.823573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990df072-fb94121e-8623f326-84e08dca_0] Write session: Do CDS request
2025-10-15T10:57:53.823606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990df072-fb94121e-8623f326-84e08dca_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:53.837072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|990df072-fb94121e-8623f326-84e08dca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:53.839633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:53.839668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 466
2025-10-15T10:57:53.840033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:53.840171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:53.840195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:53.840206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:53.841891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 466 sessionId:  describe result for acl check
2025-10-15T10:57:53.842001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:53.842021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:53.842031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:53.842050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401048698045383:6261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:53.846338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401048698045383:6261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:53.853707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401048698045383:6261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:53.861781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401048698045383:6261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:53.861831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401048698045383:6261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:53.861848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401048698045383:6261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:53.861880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:53.911541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401048698045661:5656]
E1015 10:57:53.943224064  821071 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:57:53.944412Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:57:53.989180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:53.991004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:53.991606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:53.991622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:53.991656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:53.991804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:53.991906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401051497741677:5704]
2025-10-15T10:57:53.993161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:53.994110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:53.994299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:53.995121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:53.995383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:53.995397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:53.995404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:53.995412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:53.995418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:53.995426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:53.995432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:53.995438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:53.995444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:53.995451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:53.995458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:53.995464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.995471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.995478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.995519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:53.995619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:53.995662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:53.995706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:53.995753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:53.995801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:53.995848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:53.995896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:53.995944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:53.995995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:53.996042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:53.996089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.996137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.996187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.996231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:53.996294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:53.996352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:53.996409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:53.996458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:53.996511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:53.996558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:53.996617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:53.996668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:53.996723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:53.996769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:53.996836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:53.996883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:53.996937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:53.996982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:53.997037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:53.997087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:53.997144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:53.997191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:53.997252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:53.997302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:53.997356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:53.997401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.997456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:53.997506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.997560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:53.997604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.997659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:53.998016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:54.015971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:54.026999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:54.027045Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:54.027061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:54.027081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:54.027105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 465 [2:7561401051497741677:5704]
2025-10-15T10:57:54.027156Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:54.027210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:54.027224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:54.027236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:54.027246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:54.027292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:54.027311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:54.027330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:54.030909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 465
2025-10-15T10:57:54.030994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 465
2025-10-15T10:57:54.031052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 465, pipe: [1:7561401048698045661:5656]
2025-10-15T10:57:54.029699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:54.029727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:54.029740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:54.029751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:54.030008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:54.030022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:54.030163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:54.030350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:54.030580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:54.030654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401048698045415:6261], now have 1 active actors on pipe
2025-10-15T10:57:54.030676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401048698045370:2467], now have 1 active actors on pipe
2025-10-15T10:57:54.030697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401048698045661:5656], now have 1 active actors on pipe
2025-10-15T10:57:54.030721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401051497741672:5704]
2025-10-15T10:57:54.030736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401051497741672:5704]
2025-10-15T10:57:54.030750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401051497741672:5704]
2025-10-15T10:57:54.030788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:54.030822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:54.030836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:54.030847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:54.030857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:54.031029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:54.031046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:54.031151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401051497741672:5704]
2025-10-15T10:57:54.031178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:54.031195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:54.031830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:54.031858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:54.031950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:54.031980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:54.031997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:54.032007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:54.032039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:54.032073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:54.032115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:54.033920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:54.033951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:54.034010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:54.034317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 466 partition: 0 MaxSeqNo: 46 sessionId: src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0
2025-10-15T10:57:54.035140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990df072-fb94121e-8623f326-84e08dca_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:54.073508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0] Write session: try to update token
2025-10-15T10:57:54.073563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:54.174566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:54.174595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:54.174606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:54.174616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:54.174644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401051497741672:5704]
2025-10-15T10:57:54.174666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401051497741672:5704]
2025-10-15T10:57:54.174686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401051497741672:5704]
2025-10-15T10:57:54.174803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:54.174843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:54.174861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:54.174862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:54.174873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:54.174882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:54.174920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:54.174935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:54.176513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:54.229816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId: src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:54.257446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:54.321869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:54.345824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:54.345875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:54.345953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:54.345968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:54.346008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401051497741672:5704]
2025-10-15T10:57:54.347655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:54.348101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:54.349017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:54.349028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:54.349042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:54.349212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401048698045661:5656]
2025-10-15T10:57:54.357595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 466 reason: error at write: Disconnected sessionId: src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0
2025-10-15T10:57:54.357889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 466 sessionId: src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0 is DEAD
2025-10-15T10:57:54.358246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:54.358287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0] Write session will restart in 0.005957s
2025-10-15T10:57:54.358433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0] Write session: Do CDS request
2025-10-15T10:57:54.358469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:54.369816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:54.369932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:54.369860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 467
2025-10-15T10:57:54.370864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:54.371124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:54.371174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:54.371189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:54.373478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 467 sessionId:  describe result for acl check
2025-10-15T10:57:54.373640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:54.373658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:54.373674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:54.373704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401052993013208:6269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:54.377314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401052993013208:6269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:54.385254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401052993013208:6269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:54.402080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401052993013208:6269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:54.402149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401052993013208:6269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:54.402169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401052993013208:6269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:54.402200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:54.451466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401052993013498:5656]
2025-10-15T10:57:54.514385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:54.516684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:54.517714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:54.517736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:54.517785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:54.518060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:54.518253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401055792709283:5708]
2025-10-15T10:57:54.520580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:54.521443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:54.521652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:54.522583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:54.522839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:54.522853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:54.522861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:54.522868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:54.522875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:54.522882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:54.522888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:54.522896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:54.522904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:54.522911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:54.522917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:54.522925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:54.522931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:54.522939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:54.522987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:54.523096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:54.523147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:54.523202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:54.523253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:54.523308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:54.523380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:54.523437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:54.523489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:54.523542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:54.523597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:54.523650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:54.523703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:54.523755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:54.523804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:54.523879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:54.523945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:54.524008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:54.524062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:54.524118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:54.524164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:54.524218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:54.524267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:54.524346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:54.524396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:54.524455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:54.524505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:54.524561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:54.524607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:54.524663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:54.524712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:54.524772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:54.524830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:54.524888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:54.524942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:54.525002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:54.525047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:54.525101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:54.525149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:54.525203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:54.525248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:54.525303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:54.525840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:54.552909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:54.563216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:54.563269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:54.563286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:54.563303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:54.563327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 466 [2:7561401055792709283:5708]
2025-10-15T10:57:54.566239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 466
2025-10-15T10:57:54.566328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 466, pipe: [1:7561401052993013498:5656]
2025-10-15T10:57:54.566401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 466
2025-10-15T10:57:54.563573Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:54.563632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:54.563646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:54.563659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:54.563669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:54.563718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:54.563741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:54.563763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:54.565395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:54.565412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:54.565425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:54.565437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:54.565704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:54.565723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:54.565865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:54.566062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:54.566288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:54.566367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401052993013257:6269], now have 1 active actors on pipe
2025-10-15T10:57:54.566390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401052993013498:5656], now have 1 active actors on pipe
2025-10-15T10:57:54.566412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401052993013194:2467], now have 1 active actors on pipe
2025-10-15T10:57:54.566437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401055792709278:5708]
2025-10-15T10:57:54.566451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401055792709278:5708]
2025-10-15T10:57:54.566465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401055792709278:5708]
2025-10-15T10:57:54.566505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:54.566577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:54.566753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:54.566769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:54.566892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401055792709278:5708]
2025-10-15T10:57:54.566909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:54.567416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:54.567430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:54.567443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:54.567467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:54.567836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:54.567868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:54.567969Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|427292f-17957a4f-56866393-f14c212_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:54.568002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:54.568021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:54.568032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:54.568069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:54.568122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:54.568174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:54.574411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:54.574452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:54.574549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:54.574919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 467 partition: 0 MaxSeqNo: 46 sessionId: src_id|427292f-17957a4f-56866393-f14c212_0
2025-10-15T10:57:54.575876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae9ac6a-d94df6e4-77ea136c-cb665108_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|427292f-17957a4f-56866393-f14c212_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:54.622985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427292f-17957a4f-56866393-f14c212_0] Write session: try to update token
2025-10-15T10:57:54.623045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427292f-17957a4f-56866393-f14c212_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:54.662349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:54.662385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:54.662414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401055792709278:5708]
2025-10-15T10:57:54.662534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:54.663459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:54.676743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:54.681462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:54.684355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:54.693487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:54.695265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:54.697429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:54.697442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:54.697453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:54.697509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:54.752381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:54.752422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:54.752436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:54.752447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:54.752487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401055792709278:5708]
2025-10-15T10:57:54.752514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401055792709278:5708]
2025-10-15T10:57:54.752538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401055792709278:5708]
2025-10-15T10:57:54.752679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:54.752703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:54.752727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:54.752730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:54.752758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:54.753815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:54.791309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId: src_id|427292f-17957a4f-56866393-f14c212_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:54.817567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:54.907470Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:54.910597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:54.910646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:54.911151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:54.911175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:54.911506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:54.942826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401052993013498:5656]
2025-10-15T10:57:54.942911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:54.943034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 467 reason: error at write: Disconnected sessionId: src_id|427292f-17957a4f-56866393-f14c212_0
2025-10-15T10:57:54.943408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 467 sessionId: src_id|427292f-17957a4f-56866393-f14c212_0 is DEAD
2025-10-15T10:57:54.943855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427292f-17957a4f-56866393-f14c212_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:54.943916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427292f-17957a4f-56866393-f14c212_0] Write session will restart in 0.009114s
2025-10-15T10:57:54.944097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427292f-17957a4f-56866393-f14c212_0] Write session: Do CDS request
2025-10-15T10:57:54.944152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427292f-17957a4f-56866393-f14c212_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:54.958150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|427292f-17957a4f-56866393-f14c212_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:54.967878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:54.967905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 468
2025-10-15T10:57:54.968357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:54.968475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:54.968497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:54.968507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:54.969876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 468 sessionId:  describe result for acl check
2025-10-15T10:57:54.970007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:54.970028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:54.970038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:54.970056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401052993013796:6279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:54.972898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401052993013796:6279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:54.981190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401052993013796:6279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:54.990166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401052993013796:6279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:54.990205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401052993013796:6279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:54.990224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401052993013796:6279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:54.990257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:55.043180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401057287981507:5656]
2025-10-15T10:57:55.047910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:55.050023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:55.050902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:55.050933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:55.050981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:55.051297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:55.051531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401060087676905:5716]
2025-10-15T10:57:55.053071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:55.054056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:55.054316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:55.055656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:55.056003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:55.056023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:55.056030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:55.056036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:55.056042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:55.056050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:55.056057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:55.056064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:55.056070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:55.056078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:55.056084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:55.056091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.056098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.056105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.056154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:55.056268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:55.056318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:55.056377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:55.056433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:55.056488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:55.056543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:55.056596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:55.056649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:55.056712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:55.056759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:55.056816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.056864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.056911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.056958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:55.057027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:55.057087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:55.057142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:55.057192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:55.057251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:55.057297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:55.057353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:55.057417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:55.057475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:55.057522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:55.057577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:55.057626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:55.057684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:55.057731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:55.057785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:55.057837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:55.057889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:55.057935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:55.057990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:55.058039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:55.058097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:55.058156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.058209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.058254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.058308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.058352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.058405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.058922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:55.118162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:55.130775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 467, pipe: [1:7561401057287981507:5656]
2025-10-15T10:57:55.130886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 467
2025-10-15T10:57:55.130982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 467
2025-10-15T10:57:55.128555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:55.128608Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:55.128626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:55.128648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:55.128677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 467 [2:7561401060087676905:5716]
2025-10-15T10:57:55.128736Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:55.128816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:55.128833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:55.128845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:55.128858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:55.128911Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:55.128937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:55.128962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:55.129971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.129988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.130002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.130014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:55.130284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:55.130303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.130459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.130644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.130864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:55.130952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401057287981507:5656], now have 1 active actors on pipe
2025-10-15T10:57:55.130976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401052993013728:2467], now have 1 active actors on pipe
2025-10-15T10:57:55.130999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401052993013947:6279], now have 1 active actors on pipe
2025-10-15T10:57:55.131025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401060087676900:5716]
2025-10-15T10:57:55.131041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401060087676900:5716]
2025-10-15T10:57:55.131055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401060087676900:5716]
2025-10-15T10:57:55.131099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:55.131146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:55.131162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:55.131171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:55.131174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:55.133578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:55.133623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:55.133803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:55.133836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:55.133894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401060087676900:5716]
2025-10-15T10:57:55.133927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:55.134052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:55.134054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:55.134084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:55.134103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:55.134114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:55.134153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:55.134197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:55.134290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:55.135009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:55.135039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:55.135105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:55.135534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 468 partition: 0 MaxSeqNo: 46 sessionId: src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0
2025-10-15T10:57:55.139524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|427292f-17957a4f-56866393-f14c212_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:55.186886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0] Write session: try to update token
2025-10-15T10:57:55.186929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:55.255005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:55.255084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:55.255110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:55.255147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:55.255211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401060087676900:5716]
2025-10-15T10:57:55.255257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401060087676900:5716]
2025-10-15T10:57:55.255300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401060087676900:5716]
2025-10-15T10:57:55.255677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:55.255722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:55.255740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:55.255841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:55.255892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:55.256085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:55.256162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:55.256218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:55.258353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:55.279092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId: src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:55.301355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:55.402900Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:55.417834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401057287981507:5656]
2025-10-15T10:57:55.417919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:55.418118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:55.418137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:55.417250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:55.417301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:55.417368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:55.417381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:55.417421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401060087676900:5716]
2025-10-15T10:57:55.417584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:55.417954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:55.425853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 468 reason: error at write: Disconnected sessionId: src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0
2025-10-15T10:57:55.426205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 468 sessionId: src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0 is DEAD
2025-10-15T10:57:55.431683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:55.431758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0] Write session will restart in 0.005748s
2025-10-15T10:57:55.431969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0] Write session: Do CDS request
2025-10-15T10:57:55.432038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:55.442303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:55.442336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 469
2025-10-15T10:57:55.442707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:55.443458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:55.443587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:55.443608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:55.443619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:55.444822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 469 sessionId:  describe result for acl check
2025-10-15T10:57:55.444937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:55.444947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:55.444955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:55.444972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401057287981563:6288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:55.447331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401057287981563:6288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:55.453656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401057287981563:6288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:55.466878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401057287981563:6288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:55.466921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401057287981563:6288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:55.466939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401057287981563:6288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:55.466972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:55.517818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401057287981869:5656]
2025-10-15T10:57:55.587275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:55.589071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:55.589951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:55.589969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:55.590011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:55.590262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:55.590448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401060087677223:5727]
2025-10-15T10:57:55.592742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:55.597531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:55.597767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:55.599016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:55.599340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:55.599372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:55.599380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:55.599387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:55.599394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:55.599402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:55.599408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:55.599414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:55.599420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:55.599426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:55.599432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:55.599438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.599446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.599453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.599501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:55.599610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:55.599664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:55.599713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:55.599761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:55.599809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:55.599859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:55.599907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:55.599954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:55.600004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:55.600050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:55.600096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.600141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.600186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.600228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:55.600294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:55.600352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:55.603055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:55.603137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:55.603219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:55.603268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:55.603327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:55.603395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:55.603457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:55.603504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:55.603558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:55.603607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:55.603666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:55.603716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:55.603783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:55.603834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:55.603888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:55.603935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:55.603991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:55.604042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:55.604092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:55.604137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.604187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.604235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.604288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.604334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.604388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.604915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:55.635241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:55.677718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:55.677772Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:55.677789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:55.677809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:55.677834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 468 [2:7561401060087677223:5727]
2025-10-15T10:57:55.677882Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:55.677946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:55.677961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:55.677972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:55.677983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:55.678032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:55.678055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:55.678075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:55.678863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.678878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.678886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.678894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:55.679139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:55.679163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:55.679298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:55.679461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:55.679616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:55.679675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401057287981869:5656], now have 1 active actors on pipe
2025-10-15T10:57:55.679693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401057287981613:6288], now have 1 active actors on pipe
2025-10-15T10:57:55.679641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 468, pipe: [1:7561401057287981869:5656]
2025-10-15T10:57:55.679708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401057287981549:2467], now have 1 active actors on pipe
2025-10-15T10:57:55.679726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401060087677218:5727]
2025-10-15T10:57:55.679735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401060087677218:5727]
2025-10-15T10:57:55.679764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 468
2025-10-15T10:57:55.679743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401060087677218:5727]
2025-10-15T10:57:55.679773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:55.679808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:55.679820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:55.679842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:55.679845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:55.679862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 468
2025-10-15T10:57:55.680016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:55.680040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:55.680153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:55.680172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:55.680204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401060087677218:5727]
2025-10-15T10:57:55.680227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:55.680249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:55.680326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24736542-97109e06-5366513c-b6275601_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:55.680360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:55.680380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:55.680390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:55.680424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:55.680465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:55.680551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:55.680959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:55.680981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:55.681024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:55.681276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 469 partition: 0 MaxSeqNo: 46 sessionId: src_id|24736542-97109e06-5366513c-b6275601_0
2025-10-15T10:57:55.682048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd10338f-aa3f6195-f8907509-5d1bbb27_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|24736542-97109e06-5366513c-b6275601_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:55.715389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24736542-97109e06-5366513c-b6275601_0] Write session: try to update token
2025-10-15T10:57:55.715454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24736542-97109e06-5366513c-b6275601_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:55.742035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:55.742065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:55.742076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:55.742085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:55.742112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401060087677218:5727]
2025-10-15T10:57:55.742131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401060087677218:5727]
2025-10-15T10:57:55.742150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401060087677218:5727]
2025-10-15T10:57:55.742272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:55.742286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:55.742304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:55.742324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:55.742362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:55.743389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:55.778244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId: src_id|24736542-97109e06-5366513c-b6275601_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:55.805272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:55.890033Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:55.891575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:55.891620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:55.895309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:55.895337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:55.895508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:55.894139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:55.895763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401057287981869:5656]
2025-10-15T10:57:55.918508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 469 reason: error at write: Disconnected sessionId: src_id|24736542-97109e06-5366513c-b6275601_0
2025-10-15T10:57:55.918815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 469 sessionId: src_id|24736542-97109e06-5366513c-b6275601_0 is DEAD
2025-10-15T10:57:55.919365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24736542-97109e06-5366513c-b6275601_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:55.919430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24736542-97109e06-5366513c-b6275601_0] Write session will restart in 0.005759s
2025-10-15T10:57:55.919603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24736542-97109e06-5366513c-b6275601_0] Write session: Do CDS request
2025-10-15T10:57:55.919659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24736542-97109e06-5366513c-b6275601_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:55.929739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:55.929770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 470
2025-10-15T10:57:55.929903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24736542-97109e06-5366513c-b6275601_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:55.930353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:55.930468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:55.930489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:55.930498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:55.931709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 470 sessionId:  describe result for acl check
2025-10-15T10:57:55.931814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:55.931835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:55.931844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:55.931859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401057287982077:6292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:55.934253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401057287982077:6292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:55.944732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401057287982077:6292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:55.957242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401057287982077:6292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:55.957274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401057287982077:6292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:55.957287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401057287982077:6292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:55.957320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:55.996004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401057287982533:5656]
2025-10-15T10:57:56.013834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:56.015337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:56.016270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:56.016309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:56.016357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:56.016621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:56.016833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401064382644832:5729]
2025-10-15T10:57:56.019231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:56.020061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:56.020342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:56.021764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:56.022118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.022140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.022148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.022156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.022164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.022172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.022180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.022187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.022195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.022203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.022210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.022217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.022226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.022233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.022288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.022412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.022468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.022534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.022590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.022651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.022708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.022762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.022817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.022868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.022923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.022979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.023033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.023091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.023138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.023217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.023294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.023402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.023464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.023525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.023573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.023632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.023684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.023744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.023796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.023872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.023925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.023985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.024034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.024092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.024146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.024203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.024253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.024310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.024359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.024416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.024466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.024523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.024576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.024636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.024686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.024741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.025300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:56.043895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:56.060397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:56.060449Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:56.060466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:56.060488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:56.060513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 469 [2:7561401064382644832:5729]
2025-10-15T10:57:56.060564Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:56.060615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:56.060626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:56.060636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:56.060646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:56.060684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:56.060702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:56.060720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:56.062346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.062369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.062378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.062386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:56.062642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:56.062667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.062816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.063015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.063263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:56.063344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401064382644827:5729]
2025-10-15T10:57:56.063385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401064382644827:5729]
2025-10-15T10:57:56.063400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401064382644827:5729]
2025-10-15T10:57:56.063430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:56.063504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:56.063538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:56.063559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:56.063569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:56.063699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:56.063722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:56.063853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401064382644827:5729]
2025-10-15T10:57:56.063887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:56.063941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401057287982533:5656], now have 1 active actors on pipe
2025-10-15T10:57:56.063970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401057287982061:2467], now have 1 active actors on pipe
2025-10-15T10:57:56.063992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401057287982208:6292], now have 1 active actors on pipe
2025-10-15T10:57:56.064131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 469, pipe: [1:7561401057287982533:5656]
2025-10-15T10:57:56.064176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 469
2025-10-15T10:57:56.064213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 469
2025-10-15T10:57:56.064174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:56.064655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:56.064689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:56.064778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74101f11-11df46e-a856e798-416280ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:56.064810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:56.064841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:56.064851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:56.064890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:56.064934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:56.064979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:56.065830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 470 partition: 0 MaxSeqNo: 46 sessionId: src_id|74101f11-11df46e-a856e798-416280ca_0
2025-10-15T10:57:56.066694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24736542-97109e06-5366513c-b6275601_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|74101f11-11df46e-a856e798-416280ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:56.065372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:56.065403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:56.065498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:56.100166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74101f11-11df46e-a856e798-416280ca_0] Write session: try to update token
2025-10-15T10:57:56.100234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74101f11-11df46e-a856e798-416280ca_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:56.137731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:56.137764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:56.137776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:56.137787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:56.137821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401064382644827:5729]
2025-10-15T10:57:56.137851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401064382644827:5729]
2025-10-15T10:57:56.137873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401064382644827:5729]
2025-10-15T10:57:56.138033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:56.138056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:56.138489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:56.138535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:56.138600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:56.139923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:56.216509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId: src_id|74101f11-11df46e-a856e798-416280ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:56.237516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:56.293304Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:56.296767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:56.296815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:56.301371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401057287982533:5656]
2025-10-15T10:57:56.301426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:56.301509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:56.301518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:56.315390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74101f11-11df46e-a856e798-416280ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:56.311555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 470 reason: error at write: Disconnected sessionId: src_id|74101f11-11df46e-a856e798-416280ca_0
2025-10-15T10:57:56.315434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74101f11-11df46e-a856e798-416280ca_0] Write session will restart in 0.009938s
2025-10-15T10:57:56.311910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 470 sessionId: src_id|74101f11-11df46e-a856e798-416280ca_0 is DEAD
2025-10-15T10:57:56.315610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74101f11-11df46e-a856e798-416280ca_0] Write session: Do CDS request
2025-10-15T10:57:56.315644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74101f11-11df46e-a856e798-416280ca_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:56.319493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:56.330743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74101f11-11df46e-a856e798-416280ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:56.345176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:56.345213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 471
2025-10-15T10:57:56.345667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:56.345777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:56.345792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:56.345800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:56.347089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 471 sessionId:  describe result for acl check
2025-10-15T10:57:56.347186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:56.347197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:56.347207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:56.347226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401061582949911:6304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:56.349859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401061582949911:6304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:56.355075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401061582949911:6304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:56.364485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401061582949911:6304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:56.364529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401061582949911:6304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:56.364545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401061582949911:6304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:56.364577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:56.401536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401061582950280:5656]
2025-10-15T10:57:56.436655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:56.439571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:56.440475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:56.440506Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:56.440540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:56.440772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:56.440945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401064382645161:5739]
2025-10-15T10:57:56.442545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:56.443452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:56.443649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:56.444611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:56.444912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.444921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.444930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.444937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.444943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.444949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.444954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.444958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.444963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.444967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.444971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.444976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.444981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.444986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.445030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.445129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.445181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.445234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.445284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.445323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.445360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.445394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.445438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.445486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.445534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.445570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.445608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.445641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.445672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.445741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.445796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.445835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.445870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.445913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.445954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.445995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.446027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.446068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.446108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.446148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.446186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.446242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.446292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.446329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.446367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.446423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.446471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.446527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.446566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.446605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.446637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.446676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.446721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.446761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.446793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.446834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.447252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:56.476840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:56.487113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:56.487162Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:56.487180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:56.487200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:56.487226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 470 [2:7561401064382645161:5739]
2025-10-15T10:57:56.487280Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:56.487338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:56.487778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:56.487797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:56.487808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:56.487862Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:56.487885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:56.487907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:56.490420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 470
2025-10-15T10:57:56.490528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 470, pipe: [1:7561401061582950280:5656]
2025-10-15T10:57:56.490602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 470
2025-10-15T10:57:56.489666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.489692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.489707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.489718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:56.489998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:56.490016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.490164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.490358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.490591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:56.490674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401061582949896:2467], now have 1 active actors on pipe
2025-10-15T10:57:56.490697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401061582950280:5656], now have 1 active actors on pipe
2025-10-15T10:57:56.490719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401061582950008:6304], now have 1 active actors on pipe
2025-10-15T10:57:56.490745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401064382645156:5739]
2025-10-15T10:57:56.490760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401064382645156:5739]
2025-10-15T10:57:56.490772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401064382645156:5739]
2025-10-15T10:57:56.490802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:56.490831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:56.490847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:56.490873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:56.490888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:56.491105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:56.491137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:56.491217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:56.491244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:56.491394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401064382645156:5739]
2025-10-15T10:57:56.491433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:56.491461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:56.491522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:56.491562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:56.491585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:56.491595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:56.491635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:56.491683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:56.491830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:56.492843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:56.492875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:56.492947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:56.493187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 471 partition: 0 MaxSeqNo: 46 sessionId: src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0
2025-10-15T10:57:56.498673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74101f11-11df46e-a856e798-416280ca_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:56.531814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0] Write session: try to update token
2025-10-15T10:57:56.531878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:56.605786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:56.605835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:56.605872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:56.605886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:56.605932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401064382645156:5739]
2025-10-15T10:57:56.605972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401064382645156:5739]
2025-10-15T10:57:56.605997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401064382645156:5739]
2025-10-15T10:57:56.606269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:56.606292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:56.606304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:56.606353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:56.606382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:56.607620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:56.608529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:56.608602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:56.608660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:56.626985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId: src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:56.679166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:56.769899Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:56.779588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:56.779651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:56.779739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:56.779757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:56.779805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401064382645156:5739]
2025-10-15T10:57:56.779993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:56.780280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:56.780312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401061582950280:5656]
2025-10-15T10:57:56.780394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:56.780407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:56.780464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:56.823318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 471 reason: error at write: Disconnected sessionId: src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0
2025-10-15T10:57:56.823854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 471 sessionId: src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0 is DEAD
2025-10-15T10:57:56.827794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:56.827834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0] Write session will restart in 0.005014s
2025-10-15T10:57:56.827934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0] Write session: Do CDS request
2025-10-15T10:57:56.827964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:56.837377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:56.837805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:56.837842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 472
2025-10-15T10:57:56.838189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:56.838332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:56.838347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:56.838357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:56.839661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 472 sessionId:  describe result for acl check
2025-10-15T10:57:56.839767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:56.839778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:56.839788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:56.839805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401061582950565:6311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:56.845402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401061582950565:6311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:56.856708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401061582950565:6311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:56.865280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401061582950565:6311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:56.865323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401061582950565:6311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:56.865342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401061582950565:6311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:56.865372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:56.880764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401061582950869:5656]
2025-10-15T10:57:56.903657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:56.905578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:56.906463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:56.906499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:56.906544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:56.906810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:56.907007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401064382645469:5748]
2025-10-15T10:57:56.909475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:56.910733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:56.911002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:56.912404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:56.912742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.912752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.912759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.912766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.912773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.912781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.912788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.912794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.912801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.912808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.912813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.912821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.912845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.912853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.912905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.913023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.913076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.913127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.913176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.913223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.913270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.913316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.913367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.913415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.913467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.913517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.913563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.913613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.913658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.913727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:56.913791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.913850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:56.913903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.913967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:56.914016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.914070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:56.914122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.914178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:56.914225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.914283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:56.914334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.914387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:56.914434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.914489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:56.914540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.914598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:56.914647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.914710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:56.914767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.914831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:56.914885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.914945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:56.914998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.915052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:56.915097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.915155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:56.916843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:57.001844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:57.016180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:57.016236Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:57.016252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:57.016272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:57.016296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 471 [2:7561401064382645469:5748]
2025-10-15T10:57:57.016351Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:57.016409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:57.016424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:57.016437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:57.016448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:57.016499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:57.016522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:57.016545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:57.017638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:57.017666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:57.017680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:57.017690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:57.017970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:57.017997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:57.018133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:57.018329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:57.018567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:57.018655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401061582950869:5656], now have 1 active actors on pipe
2025-10-15T10:57:57.018688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401061582950771:6311], now have 1 active actors on pipe
2025-10-15T10:57:57.018711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401061582950419:2467], now have 1 active actors on pipe
2025-10-15T10:57:57.018734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401064382645464:5748]
2025-10-15T10:57:57.018748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401064382645464:5748]
2025-10-15T10:57:57.018762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401064382645464:5748]
2025-10-15T10:57:57.018795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:57.018839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:57.018865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:57.018868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:57.018880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:57.019049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:57.019084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:57.019235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:57.019265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:57.019315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401064382645464:5748]
2025-10-15T10:57:57.019388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:57.018309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 471, pipe: [1:7561401061582950869:5656]
2025-10-15T10:57:57.018345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 471
2025-10-15T10:57:57.018424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 471
2025-10-15T10:57:57.021400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:57.021552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:57.021590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:57.021608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:57.021619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:57.021652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:57.021692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:57.021803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:57.022482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:57.022527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:57.022635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:57.022967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 472 partition: 0 MaxSeqNo: 46 sessionId: src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0
2025-10-15T10:57:57.023866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fcce436-3129b3fc-dfbea024-509a95ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:57.045499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0] Write session: try to update token
2025-10-15T10:57:57.045565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:57.129992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:57.130031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:57.130045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:57.130056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:57.130095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401064382645464:5748]
2025-10-15T10:57:57.130123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401064382645464:5748]
2025-10-15T10:57:57.130145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401064382645464:5748]
2025-10-15T10:57:57.130377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:57.130400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:57.130413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:57.130462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:57.130481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:57.131469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:57.131502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:57.131531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:57.132974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:57.156272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId: src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:57.176450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:57.278941Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:57.288519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:57.288578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:57.288654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:57.288670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:57.288716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401064382645464:5748]
2025-10-15T10:57:57.289123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:57.289314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:57.289644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:57.289645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401061582950869:5656]
2025-10-15T10:57:57.289673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:57.289742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:57.304417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 472 reason: error at write: Disconnected sessionId: src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0
2025-10-15T10:57:57.305166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:57.305222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0] Write session will restart in 0.005411s
2025-10-15T10:57:57.305402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0] Write session: Do CDS request
2025-10-15T10:57:57.305451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:57.304781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 472 sessionId: src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0 is DEAD
2025-10-15T10:57:57.328756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:57.328790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 473
2025-10-15T10:57:57.329110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:57.329858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:57.330000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:57.330023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:57.330031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:57.331421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 473 sessionId:  describe result for acl check
2025-10-15T10:57:57.331527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:57.331543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:57.331553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:57.331571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401065877918260:6316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:57.333977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401065877918260:6316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:57.340038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401065877918260:6316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:57.353124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401065877918260:6316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:57.353166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401065877918260:6316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:57.353184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401065877918260:6316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:57.353215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:57.389602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401065877918575:5656]
2025-10-15T10:57:57.435294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:57.444718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:57.445633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:57.445653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:57.445697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:57.445981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:57.446168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401068677613094:5751]
2025-10-15T10:57:57.449192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:57.450414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:57.450655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:57.452040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:57.452399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:57.452417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:57.452424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:57.452431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:57.452438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:57.452445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:57.452453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:57.452461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:57.452469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:57.452476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:57.452483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:57.452493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:57.452501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:57.452508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:57.452558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:57.452675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:57.452726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:57.452784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:57.452851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:57.452907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:57.452959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:57.453006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:57.453052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:57.453100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:57.453146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:57.453195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:57.453243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:57.453291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:57.453341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:57.453411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:57.453470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:57.453526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:57.453574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:57.454208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:57.454266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:57.454332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:57.454387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:57.454445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:57.454499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:57.454562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:57.454641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:57.454700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:57.454749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:57.454808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:57.454858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:57.454916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:57.454963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:57.455021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:57.455070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:57.455123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:57.455170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:57.455223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:57.455257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:57.455296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:57.455330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:57.455401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:57.455876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:57.489039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:57.501342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:57.501395Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:57.501414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:57.501437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:57.501474Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 472 [2:7561401068677613094:5751]
2025-10-15T10:57:57.501532Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:57.501598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:57.501615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:57.501628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:57.501640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:57.501690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:57.501712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:57.501734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:57.503991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:57.504022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:57.504047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:57.504059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:57.504366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:57.504384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:57.504536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:57.504726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:57.504977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:57.505050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401068677613089:5751]
2025-10-15T10:57:57.505066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401068677613089:5751]
2025-10-15T10:57:57.505079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401068677613089:5751]
2025-10-15T10:57:57.505120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:57.505199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:57.505245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:57.505258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:57.505280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:57.505379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:57.505395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:57.505522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401068677613089:5751]
2025-10-15T10:57:57.505541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:57.505574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:57.505652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401065877918575:5656], now have 1 active actors on pipe
2025-10-15T10:57:57.505677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401065877918345:6316], now have 1 active actors on pipe
2025-10-15T10:57:57.505699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401065877918232:2467], now have 1 active actors on pipe
2025-10-15T10:57:57.506235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 472, pipe: [1:7561401065877918575:5656]
2025-10-15T10:57:57.506345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 472
2025-10-15T10:57:57.506415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 472
2025-10-15T10:57:57.506737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:57.506772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:57.506873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8a3dbef-7234155b-735850e6-c80fa503_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:57.506905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:57.506924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:57.506936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:57.506976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:57.507023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:57.507077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:57.507582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:57.507609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:57.507673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:57.508001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 473 partition: 0 MaxSeqNo: 46 sessionId: src_id|b8a3dbef-7234155b-735850e6-c80fa503_0
2025-10-15T10:57:57.508793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd61197-24e52272-e04ddc15-e99ec67c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b8a3dbef-7234155b-735850e6-c80fa503_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:57.537324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a3dbef-7234155b-735850e6-c80fa503_0] Write session: try to update token
2025-10-15T10:57:57.537389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a3dbef-7234155b-735850e6-c80fa503_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:57.569824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:57.569869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:57.569913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401068677613089:5751]
2025-10-15T10:57:57.570051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:57.570048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:57.571969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:57.573341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:57.574964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:57.584318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:57.586055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:57.586562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:57.674174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:57.674205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:57.674213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:57.750043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId: src_id|b8a3dbef-7234155b-735850e6-c80fa503_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:57.805349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:57.805395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:57.805409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:57.805461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:57.805474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:57.805486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:57.805496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:57.805534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401068677613089:5751]
2025-10-15T10:57:57.805560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401068677613089:5751]
2025-10-15T10:57:57.805582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401068677613089:5751]
2025-10-15T10:57:57.805719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:57.805751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:57.805896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:57.805934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:57.805962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:57.808412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:57.817104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:57.954168Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:57.956417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:57.956456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:57.957119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:57.959952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401065877918575:5656]
2025-10-15T10:57:57.960107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:57:57.972655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:57.972779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 473 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8a3dbef-7234155b-735850e6-c80fa503_0
2025-10-15T10:57:57.973068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 473 sessionId: src_id|b8a3dbef-7234155b-735850e6-c80fa503_0 is DEAD
2025-10-15T10:57:57.974233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a3dbef-7234155b-735850e6-c80fa503_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:57:57.974267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a3dbef-7234155b-735850e6-c80fa503_0] Write session will restart in 0.009257s
2025-10-15T10:57:57.974368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a3dbef-7234155b-735850e6-c80fa503_0] Write session: Do CDS request
2025-10-15T10:57:57.974392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a3dbef-7234155b-735850e6-c80fa503_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:58.000079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a3dbef-7234155b-735850e6-c80fa503_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:58.028247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:58.028270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 474
2025-10-15T10:57:58.028616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:58.028708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:58.028721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:58.028728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:58.030062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 474 sessionId:  describe result for acl check
2025-10-15T10:57:58.030151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:58.030160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:58.030167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:58.030182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401070172886239:6327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:58.032348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401070172886239:6327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:58.038886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401070172886239:6327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:58.049251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401070172886239:6327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:58.049289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401070172886239:6327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:58.049304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401070172886239:6327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:58.049330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:58.061565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401070172886447:5656]
2025-10-15T10:57:58.100507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:58.102853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:58.103760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:58.103791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:58.103833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:58.104082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:58.104272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401072972580720:5766]
2025-10-15T10:57:58.106918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:58.108104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:58.108315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:58.109628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:58.109985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:58.110003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:58.110010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:58.110018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:58.110025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:58.110032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:58.110040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:58.110048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:58.110055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:58.110063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:58.110070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:58.110076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.110083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.110091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.110139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:58.110249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:58.110299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:58.110349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:58.110397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:58.110446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:58.110490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:58.110534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:58.110580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:58.110627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:58.110677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:58.110721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.110770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.110815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.110861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:58.110951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:58.111013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:58.111076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:58.111131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:58.111190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:58.111241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:58.111303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:58.111378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:58.111444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:58.111489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:58.111541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:58.111588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:58.111649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:58.111705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:58.111762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:58.111816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:58.111881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:58.111931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:58.111990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:58.112046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:58.112109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:58.112156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.112213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.112260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.112315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.112363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.112418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.112930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:58.131507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:58.172368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:58.172415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:58.172433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:58.172453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:58.172480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 473 [2:7561401072972580720:5766]
2025-10-15T10:57:58.172536Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:58.172600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:58.172616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:58.172629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:58.172641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:58.172692Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:58.172715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:58.172739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:58.173671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.173697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.173711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.173722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:58.173986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:58.174010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.174161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.174365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.174622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:58.174710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401070172886376:6327], now have 1 active actors on pipe
2025-10-15T10:57:58.174737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401065877918780:2467], now have 1 active actors on pipe
2025-10-15T10:57:58.174760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401070172886447:5656], now have 1 active actors on pipe
2025-10-15T10:57:58.174793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401072972580715:5766]
2025-10-15T10:57:58.174812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401072972580715:5766]
2025-10-15T10:57:58.174822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401072972580715:5766]
2025-10-15T10:57:58.174861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:58.174907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:58.174924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:58.174937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:58.174971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:58.174923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 473
2025-10-15T10:57:58.174980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 473
2025-10-15T10:57:58.175007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 473, pipe: [1:7561401070172886447:5656]
2025-10-15T10:57:58.175183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:58.175205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:58.175328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401072972580715:5766]
2025-10-15T10:57:58.175375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:58.175394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:58.175439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:58.175468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:58.175630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:58.175669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:58.175688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:58.175700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:58.175737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:58.175783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:58.175856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:58.176966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:58.177005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:58.177075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:58.178330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8a3dbef-7234155b-735850e6-c80fa503_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:58.177407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 474 partition: 0 MaxSeqNo: 46 sessionId: src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0
2025-10-15T10:57:58.204704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0] Write session: try to update token
2025-10-15T10:57:58.204757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:58.260696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:58.260736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:58.260753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:58.260766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:58.260806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401072972580715:5766]
2025-10-15T10:57:58.260839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401072972580715:5766]
2025-10-15T10:57:58.260879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401072972580715:5766]
2025-10-15T10:57:58.261037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:58.261076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:58.261105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:58.275624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:58.275675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:58.277449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:58.351327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId: src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:58.375130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:58.426288Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:58.427967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:58.427996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:58.428047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401072972580715:5766]
2025-10-15T10:57:58.428219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:58.428246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:58.430216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:58.430249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:58.435595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:58.428515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:58.435964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401070172886447:5656]
2025-10-15T10:57:58.429449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:58.458988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 474 reason: error at write: Disconnected sessionId: src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0
2025-10-15T10:57:58.459735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:58.459772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0] Write session will restart in 0.008966s
2025-10-15T10:57:58.459868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0] Write session: Do CDS request
2025-10-15T10:57:58.459902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:58.459344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 474 sessionId: src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0 is DEAD
2025-10-15T10:57:58.474299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:58.474324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 475
2025-10-15T10:57:58.474737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:58.475244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:58.475320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:58.475328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:58.475336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:58.477015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 475 sessionId:  describe result for acl check
2025-10-15T10:57:58.477144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:58.477155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:58.477165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:58.477182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401070172886645:6336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:58.480925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401070172886645:6336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:58.490018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401070172886645:6336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:58.502835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401070172886645:6336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:58.502882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401070172886645:6336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:58.502901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401070172886645:6336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:58.502937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:58.536012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401070172886882:5656]
2025-10-15T10:57:58.588376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:58.595680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:58.596427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:58.596440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:58.596473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:58.596684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:58.596807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401072972581035:5771]
2025-10-15T10:57:58.598506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:58.599748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:58.600020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:58.601412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:58.601774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:58.601801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:58.601810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:58.601816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:58.601825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:58.601832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:58.601840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:58.601847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:58.601854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:58.601863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:58.601870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:58.601878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.601886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.601893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.601945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:58.602069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:58.602123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:58.602175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:58.602223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:58.602276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:58.602325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:58.602374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:58.602423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:58.602477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:58.602524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:58.602572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.602624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.602669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.602721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:58.602796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:58.602865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:58.602922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:58.602976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:58.603045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:58.603098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:58.603153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:58.603206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:58.603264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:58.603310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:58.603392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:58.603443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:58.603499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:58.603549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:58.603605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:58.603659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:58.603714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:58.603763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:58.603820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:58.603869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:58.603924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:58.603976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.604029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.604078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.604137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.604187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.604243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.604798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:58.633856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:58.645650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:58.645709Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:58.645730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:58.645752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:58.645778Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 474 [2:7561401072972581035:5771]
2025-10-15T10:57:58.647445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 474
2025-10-15T10:57:58.645837Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:58.647516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 474, pipe: [1:7561401070172886882:5656]
2025-10-15T10:57:58.645908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:58.647563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 474
2025-10-15T10:57:58.645929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:58.645943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:58.645956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:58.646014Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:58.646040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:58.646064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:58.646796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.646806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.646814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.646822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:58.647022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:58.647035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:58.647153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:58.647310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:58.647551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:58.647640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401070172886882:5656], now have 1 active actors on pipe
2025-10-15T10:57:58.647667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401070172886737:6336], now have 1 active actors on pipe
2025-10-15T10:57:58.647689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401070172886611:2467], now have 1 active actors on pipe
2025-10-15T10:57:58.647714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401072972581030:5771]
2025-10-15T10:57:58.647728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401072972581030:5771]
2025-10-15T10:57:58.647741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401072972581030:5771]
2025-10-15T10:57:58.647782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:58.647833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:58.647851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:58.647867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:58.647869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:58.648061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:58.648088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:58.648239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:58.648271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:58.648323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401072972581030:5771]
2025-10-15T10:57:58.648354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:58.648381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:58.648457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:58.648488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:58.648506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:58.648516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:58.648553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:58.648594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:58.648683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:58.649151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:58.649185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:58.649251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:58.650396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd8de8df-1ce55448-abc26ab6-84bdfeb6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:58.649620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 475 partition: 0 MaxSeqNo: 46 sessionId: src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0
2025-10-15T10:57:58.670419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0] Write session: try to update token
2025-10-15T10:57:58.670471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:58.711309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:58.711367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:58.711381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:58.711391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:58.711423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401072972581030:5771]
2025-10-15T10:57:58.711450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401072972581030:5771]
2025-10-15T10:57:58.711471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401072972581030:5771]
2025-10-15T10:57:58.711593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:58.711625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:58.711646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:58.711664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:58.711666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:58.712630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:58.767932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId: src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:58.796578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:58.854797Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:58.872829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:58.872889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:58.872948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:58.872963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:58.872998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401072972581030:5771]
2025-10-15T10:57:58.874243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:58.874282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:58.873408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:58.875841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:58.876125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:58.876367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401070172886882:5656]
2025-10-15T10:57:58.898322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 475 reason: error at write: Disconnected sessionId: src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0
2025-10-15T10:57:58.898624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 475 sessionId: src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0 is DEAD
2025-10-15T10:57:58.900371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:58.900419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0] Write session will restart in 0.008385s
2025-10-15T10:57:58.900562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0] Write session: Do CDS request
2025-10-15T10:57:58.900607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:58.915312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:58.927978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:58.928011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 476
2025-10-15T10:57:58.928403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:58.928523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:58.928549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:58.928558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:58.929794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 476 sessionId:  describe result for acl check
2025-10-15T10:57:58.929883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:58.929893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:58.929901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:58.929919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401070172887149:6340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:58.932568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401070172887149:6340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:58.943923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401070172887149:6340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:58.955164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401070172887149:6340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:58.955205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401070172887149:6340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:58.955223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401070172887149:6340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:58.956696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:58.979479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401070172887336:5656]
2025-10-15T10:57:59.054744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:59.056228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:59.056974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:59.057000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:59.057042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:59.057294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:59.057480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401077267548659:5775]
2025-10-15T10:57:59.059725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:59.060726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:59.060887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:59.061741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:59.062007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:59.062023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:59.062030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:59.062037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:59.062045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:59.062051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:59.062059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:59.062066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:59.062073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:59.062079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:59.062084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:59.062089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.062093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.062098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.062132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:59.062216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:59.062254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:59.062287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:59.062320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:59.062354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:59.062386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:59.062420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:59.062452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:59.062487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:59.062528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:59.062563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.062596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.062629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.062659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:59.062707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:59.062750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:59.062793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:59.062826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:59.062864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:59.062896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:59.062936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:59.062971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:59.063009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:59.063041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:59.063076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:59.063109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:59.063143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:59.063173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:59.063209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:59.063240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:59.063279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:59.063307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:59.063365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:59.063419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:59.063473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:59.063509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.063547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.063577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.063611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.063642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.063675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.064053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:59.115071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:59.125000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:59.125050Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:59.125065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:59.125083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:59.125108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 475 [2:7561401077267548659:5775]
2025-10-15T10:57:59.125158Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:59.125213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:59.125226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:59.125238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:59.125249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:59.125297Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:59.125321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:59.125342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:59.127399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.127432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.127446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.127459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:59.127732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:59.127755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.127894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.128087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.128325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:59.128415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401070172887336:5656], now have 1 active actors on pipe
2025-10-15T10:57:59.128447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401070172887133:2467], now have 1 active actors on pipe
2025-10-15T10:57:59.128476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401070172887232:6340], now have 1 active actors on pipe
2025-10-15T10:57:59.128501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401077267548651:5775]
2025-10-15T10:57:59.128516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401077267548651:5775]
2025-10-15T10:57:59.128529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401077267548651:5775]
2025-10-15T10:57:59.128568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:59.128631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:59.128646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:59.128665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:59.128681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:59.128826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:59.128851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:59.128981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401077267548651:5775]
2025-10-15T10:57:59.129017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:59.129048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:59.128973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 475, pipe: [1:7561401070172887336:5656]
2025-10-15T10:57:59.129073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 475
2025-10-15T10:57:59.129149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 475
2025-10-15T10:57:59.129583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:59.129619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:59.129692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:59.129735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:59.129766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:59.129776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:59.129810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:59.129853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:59.129896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:59.130345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:59.130364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:59.130429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:59.130670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 476 partition: 0 MaxSeqNo: 46 sessionId: src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0
2025-10-15T10:57:59.135556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22a48ae0-754e8c50-6d2474c9-cb923886_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:59.191987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:59.192024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:59.192056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401077267548651:5775]
2025-10-15T10:57:59.192167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:57:59.192177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:59.195143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:57:59.196472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:59.199088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0] Write session: try to update token
2025-10-15T10:57:59.199134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:59.202713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:59.204684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:57:59.206491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:57:59.206891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:57:59.225702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:59.225742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:59.225753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:59.354961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:59.354984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:59.354991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:59.355037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:59.355049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:59.355061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:59.355071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:59.355102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401077267548651:5775]
2025-10-15T10:57:59.355125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401077267548651:5775]
2025-10-15T10:57:59.355155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401077267548651:5775]
2025-10-15T10:57:59.355252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:59.355276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:59.355279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:59.355305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:59.355305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:59.356642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:59.381538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId: src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:59.410646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:59.501763Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:59.503695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:59.503722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:59.505069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:59.510316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401070172887336:5656]
2025-10-15T10:57:59.510409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:59.510527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:59.510540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:57:59.525226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:57:59.525303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0] Write session will restart in 0.005152s
2025-10-15T10:57:59.525472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0] Write session: Do CDS request
2025-10-15T10:57:59.525515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:57:59.524431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 476 reason: error at write: Disconnected sessionId: src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0
2025-10-15T10:57:59.524714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 476 sessionId: src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0 is DEAD
2025-10-15T10:57:59.535547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:59.549580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:57:59.549614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 477
2025-10-15T10:57:59.555646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:57:59.555789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:57:59.555805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:57:59.555814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:57:59.557122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 477 sessionId:  describe result for acl check
2025-10-15T10:57:59.557218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:57:59.557228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:57:59.557237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:57:59.557252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401074467855000:6354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:57:59.559838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401074467855000:6354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:57:59.579024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:57:59.584715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:57:59.585535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:57:59.585565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:57:59.585605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:57:59.585824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:57:59.585993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401077267548747:5788]
2025-10-15T10:57:59.585256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401074467855000:6354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:57:59.588027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:57:59.589808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:57:59.590048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:57:59.591531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:57:59.591904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:59.594267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401074467855000:6354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:57:59.591913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:59.591920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:59.594308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401074467855000:6354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:57:59.591928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:59.594323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401074467855000:6354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:57:59.591934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:59.594352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:57:59.591941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:59.591948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:59.591954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:59.591961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:59.591967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:59.591975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:59.591981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.591988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.591996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.592041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:59.592139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:59.592185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:59.592230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:59.592293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:59.592339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:59.592383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:59.592425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:59.592467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:59.592512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:59.592556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:59.592596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.592639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.592682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.592722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:59.592773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:57:59.592826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:59.592894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:57:59.592935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:59.592971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:57:59.592998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:59.593031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:57:59.593061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:59.593097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:57:59.593125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:59.593166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:57:59.593194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:59.593228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:57:59.593254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:59.593285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:57:59.593326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:59.593356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:57:59.593392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:59.593436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:57:59.593479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:59.593525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:57:59.593561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.593593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.593620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.593650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.593679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.593709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.594067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:57:59.610206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401074467855035:5656]
2025-10-15T10:57:59.617501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:57:59.635828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:57:59.635877Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:57:59.635892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:57:59.635909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:57:59.635932Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 476 [2:7561401077267548747:5788]
2025-10-15T10:57:59.635977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:57:59.636030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:57:59.636043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:59.636055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:59.636065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:59.636108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:57:59.636127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:57:59.636146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:57:59.639236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.639311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.639337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.639370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:57:59.639792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:57:59.639844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:57:59.640138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:57:59.640389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:57:59.640617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:57:59.640709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401074467855035:5656], now have 1 active actors on pipe
2025-10-15T10:57:59.640732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401074467855031:6354], now have 1 active actors on pipe
2025-10-15T10:57:59.640753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401074467854983:2467], now have 1 active actors on pipe
2025-10-15T10:57:59.640780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401077267548742:5788]
2025-10-15T10:57:59.640795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401077267548742:5788]
2025-10-15T10:57:59.640808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401077267548742:5788]
2025-10-15T10:57:59.640853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:57:59.640945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:57:59.641130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:57:59.641163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:57:59.641291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401077267548742:5788]
2025-10-15T10:57:59.641311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:57:59.641637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:57:59.641650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:57:59.641663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:57:59.641690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:57:59.643579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 476, pipe: [1:7561401074467855035:5656]
2025-10-15T10:57:59.643677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 476
2025-10-15T10:57:59.643742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 476
2025-10-15T10:57:59.647757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:59.647817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:59.647930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:57:59.647973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:59.648005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:59.648023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:57:59.648088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:59.648171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:57:59.648270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:59.649439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:59.649462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:59.649532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:57:59.650294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 477 partition: 0 MaxSeqNo: 46 sessionId: src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0
2025-10-15T10:57:59.650979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4322cfe9-e33a12d7-e4255f7e-3e859378_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:57:59.724239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0] Write session: try to update token
2025-10-15T10:57:59.724334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:57:59.796240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:57:59.796280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:59.796294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:57:59.796305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:57:59.796341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401077267548742:5788]
2025-10-15T10:57:59.796367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401077267548742:5788]
2025-10-15T10:57:59.796391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401077267548742:5788]
2025-10-15T10:57:59.796563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:57:59.796577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:57:59.796590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:57:59.796696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:57:59.796717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:57:59.797736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:57:59.799495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:57:59.799549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:57:59.799597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:57:59.847457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId: src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:57:59.881300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:57:59.978993Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:57:59.994174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:57:59.994222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:57:59.994294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:57:59.994306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:57:59.994337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401077267548742:5788]
2025-10-15T10:57:59.995633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:57:59.997680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:57:59.996302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:57:59.996467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401074467855035:5656]
2025-10-15T10:57:59.996558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:57:59.996571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:00.007128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 477 reason: error at write: Disconnected sessionId: src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0
2025-10-15T10:58:00.007503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 477 sessionId: src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0 is DEAD
2025-10-15T10:58:00.010320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:00.010358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0] Write session will restart in 0.008652s
2025-10-15T10:58:00.010465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0] Write session: Do CDS request
2025-10-15T10:58:00.010498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:00.024501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:00.024531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 478
2025-10-15T10:58:00.028009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:00.028693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:00.028832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:00.028847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:00.028857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:00.030292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 478 sessionId:  describe result for acl check
2025-10-15T10:58:00.030402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:00.030411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:00.030421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:00.030436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401078762822377:6361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:00.032772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401078762822377:6361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:00.040494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401078762822377:6361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:00.055602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401078762822377:6361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:00.055646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401078762822377:6361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:00.055662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401078762822377:6361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:00.055691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:00.057920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:00.060445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:00.061343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:00.061377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:00.061423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:00.061670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:00.062005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401081562516111:5793]
2025-10-15T10:58:00.064184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:00.065367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:00.065582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:00.066783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:00.067103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:00.067111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:00.067118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:00.067125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:00.067131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:00.067140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:00.067146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:00.067154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:00.067161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:00.067167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:00.067175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:00.067181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.067188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.067195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.067244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:00.067370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:00.067419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:00.067463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:00.067508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:00.067554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:00.067599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:00.067642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:00.067683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:00.067727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:00.067767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:00.067810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.067849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.067890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.067933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:00.067993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:00.068047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:00.068097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:00.068140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:00.068189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:00.068230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:00.068283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:00.068330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:00.068383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:00.068428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:00.068481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:00.068528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:00.068580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:00.068625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:00.068676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:00.068723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:00.068775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:00.068820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:00.068873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:00.068932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:00.068987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:00.069033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.069084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.069132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.069187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.069232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.069283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.069778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:00.099307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401078762822423:5656]
2025-10-15T10:58:00.105508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:00.115833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:00.115882Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:00.115900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:00.115918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:00.115943Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 477 [2:7561401081562516111:5793]
2025-10-15T10:58:00.115994Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:00.116056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:00.116071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:00.116083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:00.116094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:00.116138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:00.116160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:00.116181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:00.117287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.117303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.117315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.117326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:00.117568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:00.117585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.117712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.117888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.118119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:00.118185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401081562516105:5793]
2025-10-15T10:58:00.118198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401081562516105:5793]
2025-10-15T10:58:00.118212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401081562516105:5793]
2025-10-15T10:58:00.118252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:00.118321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:00.118500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:00.118517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:00.118540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:00.118555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:00.118566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:00.118631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401081562516105:5793]
2025-10-15T10:58:00.118653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:00.118803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:00.119145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401078762822423:5656], now have 1 active actors on pipe
2025-10-15T10:58:00.119173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401078762822412:6361], now have 1 active actors on pipe
2025-10-15T10:58:00.119194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401074467855063:2467], now have 1 active actors on pipe
2025-10-15T10:58:00.120701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 477, pipe: [1:7561401078762822423:5656]
2025-10-15T10:58:00.120805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 477
2025-10-15T10:58:00.120871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 477
2025-10-15T10:58:00.121678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:00.121723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:00.121817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:00.121847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:00.121864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:00.121875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:00.121900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:00.121934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:00.121983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:00.123790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:00.123826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:00.123892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:00.126977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cdf4c6-9f467d32-abf00e6d-d15a69f0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:00.126144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 478 partition: 0 MaxSeqNo: 46 sessionId: src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0
2025-10-15T10:58:00.173521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0] Write session: try to update token
2025-10-15T10:58:00.173602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:00.175996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:00.176034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:00.176067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401081562516105:5793]
2025-10-15T10:58:00.176184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:00.179469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:00.185165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:00.191450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:00.202818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:00.209733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:00.212124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:00.212570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:00.216599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:00.216624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:00.216636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:00.301835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:00.301871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:00.301884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:00.301895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:00.301933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401081562516105:5793]
2025-10-15T10:58:00.301958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401081562516105:5793]
2025-10-15T10:58:00.301983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401081562516105:5793]
2025-10-15T10:58:00.302120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:00.302141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:00.303205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:00.307516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:00.307574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:00.307606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:00.328914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId: src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:00.352141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:00.461880Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:00.469570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:00.469622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:00.470950Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:00.471213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401078762822423:5656]
2025-10-15T10:58:00.471311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:00.471324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:00.475658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:00.482391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 478 reason: error at write: Disconnected sessionId: src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0
2025-10-15T10:58:00.482710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 478 sessionId: src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0 is DEAD
2025-10-15T10:58:00.484243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:00.484293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0] Write session will restart in 0.009514s
2025-10-15T10:58:00.484435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0] Write session: Do CDS request
2025-10-15T10:58:00.484476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:00.503618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:00.503647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 479
2025-10-15T10:58:00.504023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:00.507547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:00.507670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:00.507684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:00.507693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:00.508983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 479 sessionId:  describe result for acl check
2025-10-15T10:58:00.509080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:00.509090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:00.509098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:00.509113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401078762822457:6367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:00.511749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401078762822457:6367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:00.526039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401078762822457:6367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:00.532043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:00.535527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:00.536211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:00.536230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:00.536269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:00.536469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:00.536614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401081562516192:5798]
2025-10-15T10:58:00.535691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401078762822457:6367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:00.535731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401078762822457:6367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:00.535748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401078762822457:6367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:00.535774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:00.538159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:00.539270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:00.539452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:00.540376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:00.540622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:00.540627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:00.540632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:00.540637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:00.540641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:00.540646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:00.540651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:00.540656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:00.540660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:00.540665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:00.540669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:00.540675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.540680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.540684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.540720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:00.540810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:00.540848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:00.540896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:00.540931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:00.540963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:00.541001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:00.541035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:00.541070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:00.541103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:00.541136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:00.541169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.541201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.541234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.541261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:00.541310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:00.541351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:00.541392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:00.541426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:00.541466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:00.541498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:00.541537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:00.541573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:00.541627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:00.541662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:00.541706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:00.541739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:00.541781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:00.541811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:00.541851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:00.541883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:00.541923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:00.541967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:00.542005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:00.542037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:00.542076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:00.542109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.542147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.542181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.542219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.542253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.542290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.542669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:00.561336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:00.571491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401078762822502:5656]
2025-10-15T10:58:00.572514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:00.572562Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:00.572583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:00.572602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:00.572630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 478 [2:7561401081562516192:5798]
2025-10-15T10:58:00.572685Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:00.572753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:00.572769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:00.572782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:00.572795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:00.572845Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:00.572870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:00.572906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:00.581836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.581870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.581879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.581890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:00.582176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:00.582192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:00.582325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:00.582484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:00.582681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:00.582752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401081562516187:5798]
2025-10-15T10:58:00.582765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401081562516187:5798]
2025-10-15T10:58:00.582778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401081562516187:5798]
2025-10-15T10:58:00.582821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:00.582894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:00.583075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:00.583095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:00.583239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401081562516187:5798]
2025-10-15T10:58:00.583258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:00.583526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:00.583539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:00.583552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:00.583587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:00.584547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401078762822496:6367], now have 1 active actors on pipe
2025-10-15T10:58:00.584597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401078762822502:5656], now have 1 active actors on pipe
2025-10-15T10:58:00.584628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401078762822448:2467], now have 1 active actors on pipe
2025-10-15T10:58:00.585421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 478
2025-10-15T10:58:00.585498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 478, pipe: [1:7561401078762822502:5656]
2025-10-15T10:58:00.585594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 478
2025-10-15T10:58:00.587431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 479 partition: 0 MaxSeqNo: 46 sessionId: src_id|45408c2c-998be16a-159f1ef4-1fac5286_0
2025-10-15T10:58:00.589906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ae4cc7c-8336e95-8c533b69-fbe0fc74_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|45408c2c-998be16a-159f1ef4-1fac5286_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:00.586245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:00.586285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:00.586382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45408c2c-998be16a-159f1ef4-1fac5286_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:00.586419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:00.586439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:00.586452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:00.586493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:00.586543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:00.586604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:00.587048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:00.587068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:00.587143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:00.616480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45408c2c-998be16a-159f1ef4-1fac5286_0] Write session: try to update token
2025-10-15T10:58:00.616545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45408c2c-998be16a-159f1ef4-1fac5286_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:00.809325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId: src_id|45408c2c-998be16a-159f1ef4-1fac5286_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:00.816232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:00.816262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:00.816271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:00.816364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:00.816375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:00.816386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:00.816395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:00.816423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401081562516187:5798]
2025-10-15T10:58:00.816446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401081562516187:5798]
2025-10-15T10:58:00.816466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401081562516187:5798]
2025-10-15T10:58:00.819805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:00.819846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:00.819873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:00.840217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:00.840259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:00.845825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:00.857015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:00.998565Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:01.000870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:01.000910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:01.000951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401081562516187:5798]
2025-10-15T10:58:01.001085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:01.001113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:01.001587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:01.001973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:01.002364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:01.002390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:01.029516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 479 reason: error at write: Disconnected sessionId: src_id|45408c2c-998be16a-159f1ef4-1fac5286_0
2025-10-15T10:58:01.029742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 479 sessionId: src_id|45408c2c-998be16a-159f1ef4-1fac5286_0 is DEAD
2025-10-15T10:58:01.035653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45408c2c-998be16a-159f1ef4-1fac5286_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:01.035731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45408c2c-998be16a-159f1ef4-1fac5286_0] Write session will restart in 0.006284s
2025-10-15T10:58:01.035895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45408c2c-998be16a-159f1ef4-1fac5286_0] Write session: Do CDS request
2025-10-15T10:58:01.035943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45408c2c-998be16a-159f1ef4-1fac5286_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:01.043362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:01.047941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401078762822502:5656]
2025-10-15T10:58:01.048007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:01.049286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45408c2c-998be16a-159f1ef4-1fac5286_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:01.049784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:01.049805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 480
2025-10-15T10:58:01.049685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:01.050431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:01.050447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:01.050483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:01.050708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:01.050900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401085857483569:5810]
2025-10-15T10:58:01.051083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:01.051188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:01.051201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:01.051208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:01.052268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:01.053394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:01.053565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:01.054353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:01.054648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.054665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.054672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.054678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.054686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.054692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.054699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.054705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.054711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.054717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.054723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.054729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.054738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.054745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.054789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.054926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.054981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.055027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.055069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.055112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.055152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.055196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.055238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.052462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 480 sessionId:  describe result for acl check
2025-10-15T10:58:01.052554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:01.052565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:01.052574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:01.052589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401083057789850:6377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:01.054918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401083057789850:6377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:01.055282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.055331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.055387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.055427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.055466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.055507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.055566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.055618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.055669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.055712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.055764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.055806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.055855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.055901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.055950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.055989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.056036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.056077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.056132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.056175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.056224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.056268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.056316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.056356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.056415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.056461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.056507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.056551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.056599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.056641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.056693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.056734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.056781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.057266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:01.071155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401083057789850:6377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:01.076947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:01.084246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401083057789850:6377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:01.084288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401083057789850:6377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:01.084302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401083057789850:6377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:01.084323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:01.088360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:01.088406Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:01.088422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:01.088439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:01.088461Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 479 [2:7561401085857483569:5810]
2025-10-15T10:58:01.088509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:01.088559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:01.088572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:01.088583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:01.088594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:01.088636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:01.088656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:01.088676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:01.090379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.090410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.090424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.090435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:01.090705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:01.090730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.090859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.091045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.091267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:01.091336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401085857483563:5810]
2025-10-15T10:58:01.091368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401085857483563:5810]
2025-10-15T10:58:01.091381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401085857483563:5810]
2025-10-15T10:58:01.091419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:01.091497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:01.091673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:01.091696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:01.091806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401085857483563:5810]
2025-10-15T10:58:01.091830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:01.092043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:01.092061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:01.092073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:01.092093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:01.092874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401083057789880:6377], now have 1 active actors on pipe
2025-10-15T10:58:01.092920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401083057789846:2467], now have 1 active actors on pipe
2025-10-15T10:58:01.093570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 479
2025-10-15T10:58:01.093718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 479
2025-10-15T10:58:01.093811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:01.093844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:01.093919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:01.093950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:01.093967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:01.093981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:01.094012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:01.094048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:01.094088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:01.094462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:01.094488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:01.094533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:01.094789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 480 partition: 0 MaxSeqNo: 46 sessionId: src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0
2025-10-15T10:58:01.097142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45408c2c-998be16a-159f1ef4-1fac5286_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:01.117586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0] Write session: try to update token
2025-10-15T10:58:01.117649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:01.147409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401083057789888:5656]
2025-10-15T10:58:01.148175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401083057789888:5656], now have 1 active actors on pipe
2025-10-15T10:58:01.148301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 479, pipe: [1:7561401083057789888:5656]
2025-10-15T10:58:01.242888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId: src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:01.260715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:01.260753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:01.260765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:01.260869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:01.260883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:01.260906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:01.260917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:01.260947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401085857483563:5810]
2025-10-15T10:58:01.260972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401085857483563:5810]
2025-10-15T10:58:01.260994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401085857483563:5810]
2025-10-15T10:58:01.261127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:01.261168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:01.261220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:01.275062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:01.295278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:01.295324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:01.296387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:01.464830Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:01.466324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:01.466359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:01.466407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401085857483563:5810]
2025-10-15T10:58:01.466552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:01.466581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:01.466607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:01.467294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:01.467449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:01.467491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:01.471635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401083057789888:5656]
2025-10-15T10:58:01.471800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:01.494876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 480 reason: error at write: Disconnected sessionId: src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0
2025-10-15T10:58:01.495156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 480 sessionId: src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0 is DEAD
2025-10-15T10:58:01.503566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:01.503626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0] Write session will restart in 0.009389s
2025-10-15T10:58:01.503719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0] Write session: Do CDS request
2025-10-15T10:58:01.503745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:01.515551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:01.517698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:01.519246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:01.520218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:01.520239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:01.520287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:01.520574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:01.520762Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401085857483650:5814]
2025-10-15T10:58:01.523034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:01.523459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:01.523492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 481
2025-10-15T10:58:01.524330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:01.524555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:01.525865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:01.526214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.526223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.526229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.526237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.526244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.523903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:01.526251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.526258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.524009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:01.526265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.524025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:01.526272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.524036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:01.526279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.525143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 481 sessionId:  describe result for acl check
2025-10-15T10:58:01.526286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.525245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:01.526295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.525255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:01.526302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.525263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:01.526311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.525279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401083057789947:6386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:01.526359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.526473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.526524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.526575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.526625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.526670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.526714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.526764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.526808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.526858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.526905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.526951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.526999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.527043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.527088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.527157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.527221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.528057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.528128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.528187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.528235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.528290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.528479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.528543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.528591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.528646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.528697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.528756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.528802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.528856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.528918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.528973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.529020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.529078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.529125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.529180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.529225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.529277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.529326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.529381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.529426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.529477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.529998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:01.531814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401083057789947:6386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:01.553273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401083057789947:6386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:01.554005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:01.567336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401083057789947:6386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:01.567394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401083057789947:6386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:01.567410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401083057789947:6386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:01.567453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:01.571726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401083057789979:5656]
2025-10-15T10:58:01.573569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:01.573626Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:01.573645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:01.573665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:01.573693Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 480 [2:7561401085857483650:5814]
2025-10-15T10:58:01.573751Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:01.573820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:01.573835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:01.573850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:01.573862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:01.573919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:01.573945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:01.573970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:01.584773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.584809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.584822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.584835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:01.585146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:01.585165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.585320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.585529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.585779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:01.585855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401085857483645:5814]
2025-10-15T10:58:01.585871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401085857483645:5814]
2025-10-15T10:58:01.585886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401085857483645:5814]
2025-10-15T10:58:01.585930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:01.586010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:01.586216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:01.586236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:01.586364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401085857483645:5814]
2025-10-15T10:58:01.586385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:01.589537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 480
2025-10-15T10:58:01.589672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 480
2025-10-15T10:58:01.589739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 480, pipe: [1:7561401083057789979:5656]
2025-10-15T10:58:01.591180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 481 partition: 0 MaxSeqNo: 46 sessionId: src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0
2025-10-15T10:58:01.587207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:01.587230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:01.587243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:01.587267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:01.587489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401083057789923:2467], now have 1 active actors on pipe
2025-10-15T10:58:01.587531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401083057789977:6386], now have 1 active actors on pipe
2025-10-15T10:58:01.588020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401083057789979:5656], now have 1 active actors on pipe
2025-10-15T10:58:01.589939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:01.589972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:01.590062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:01.590098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:01.590111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:01.590122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:01.590159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:01.590202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:01.590246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:01.590776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:01.590797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:01.590876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:01.591960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad26132d-c911d6b3-39c712ab-2c54df3e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:01.616631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0] Write session: try to update token
2025-10-15T10:58:01.616678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:01.695032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:01.695069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:01.695081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:01.695090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:01.695120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401085857483645:5814]
2025-10-15T10:58:01.695144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401085857483645:5814]
2025-10-15T10:58:01.695164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401085857483645:5814]
2025-10-15T10:58:01.695301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:01.695370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:01.695417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:01.695452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:01.695475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:01.695490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:01.695533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:01.695550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:01.697896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:01.737733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId: src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:01.760349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:01.843779Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:01.857958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:01.858005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:01.858069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:01.858080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:01.858119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401085857483645:5814]
2025-10-15T10:58:01.858985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:01.859699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401083057789979:5656]
2025-10-15T10:58:01.859818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:01.859952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:01.859964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:01.859883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:01.870300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 481 reason: error at write: Disconnected sessionId: src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0
2025-10-15T10:58:01.870661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 481 sessionId: src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0 is DEAD
2025-10-15T10:58:01.874394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:01.874441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0] Write session will restart in 0.005412s
2025-10-15T10:58:01.874549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0] Write session: Do CDS request
2025-10-15T10:58:01.874581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:01.886676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:01.886934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:01.886966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 482
2025-10-15T10:58:01.887396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:01.887512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:01.887533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:01.887544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:01.889717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 482 sessionId:  describe result for acl check
2025-10-15T10:58:01.889896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:01.889918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:01.889938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:01.889972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401083057790004:6390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:01.894717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401083057790004:6390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:01.903052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401083057790004:6390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:01.905361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:01.908662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:01.909467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:01.909498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:01.909539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:01.909770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:01.909913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401085857483712:5817]
2025-10-15T10:58:01.912035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:01.910991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401083057790004:6390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:01.911035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401083057790004:6390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:01.911054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401083057790004:6390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:01.911087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:01.912948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:01.913156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:01.914343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:01.914684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.914703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.914708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.914716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.914722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.914730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.914736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.914743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.914749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.914756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.914763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.914769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.914775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.914782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.914829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.914932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.914977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.915023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.915065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.915120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.915162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.915202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.915246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.915291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.915337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.915397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.915442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.915485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.915525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.915591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:01.915648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.915701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:01.915747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.915797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:01.915839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.915889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:01.915936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.915996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:01.916034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.916086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:01.916133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.916184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:01.916225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.916274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:01.916320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.916372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:01.916415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.916462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:01.916510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.916559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:01.916599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.916649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.916692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.916743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.916785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.916836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.917511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:01.939025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:01.958313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:01.958361Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:01.958378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:01.958397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:01.958420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 481 [2:7561401085857483712:5817]
2025-10-15T10:58:01.958471Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:01.958531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:01.958545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:01.958558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:01.958570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:01.958618Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:01.958639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:01.958658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:01.959911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401083057790050:5656]
2025-10-15T10:58:01.959913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.959943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.959955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.959966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:01.960235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:01.960253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:01.960385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:01.960562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:01.960774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:01.960834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401085857483707:5817]
2025-10-15T10:58:01.960848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401085857483707:5817]
2025-10-15T10:58:01.960860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401085857483707:5817]
2025-10-15T10:58:01.960899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:01.960980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:01.961158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:01.961182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:01.961294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401085857483707:5817]
2025-10-15T10:58:01.961313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:01.961539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:01.961565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:01.961578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:01.961613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:01.962392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401083057790043:6390], now have 1 active actors on pipe
2025-10-15T10:58:01.962435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401083057789987:2467], now have 1 active actors on pipe
2025-10-15T10:58:01.962460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401083057790050:5656], now have 1 active actors on pipe
2025-10-15T10:58:01.962774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 481
2025-10-15T10:58:01.962847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 481
2025-10-15T10:58:01.962866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 481, pipe: [1:7561401083057790050:5656]
2025-10-15T10:58:01.963003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:01.963034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:01.963098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:01.963127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:01.963147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:01.963155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:01.963182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:01.963211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:01.963250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:01.963727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:01.963749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:01.963807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:01.964093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 482 partition: 0 MaxSeqNo: 46 sessionId: src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0
2025-10-15T10:58:01.965130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94bc3ea2-e2bf6c2-5b073752-429f68e0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:01.995244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0] Write session: try to update token
2025-10-15T10:58:01.995298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:02.032350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:02.032394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:02.032408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:02.032420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:02.032456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401085857483707:5817]
2025-10-15T10:58:02.032486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401085857483707:5817]
2025-10-15T10:58:02.032513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401085857483707:5817]
2025-10-15T10:58:02.032640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:02.032668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:02.032677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:02.032690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:02.032717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:02.048544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:02.113479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId: src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:02.134127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:02.197708Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:02.200240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:02.200280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:02.200734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:02.200765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:02.205007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:02.229787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 482 reason: error at write: Disconnected sessionId: src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0
2025-10-15T10:58:02.230084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 482 sessionId: src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0 is DEAD
2025-10-15T10:58:02.235989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:02.236050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0] Write session will restart in 0.005286s
2025-10-15T10:58:02.236192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0] Write session: Do CDS request
2025-10-15T10:58:02.236236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:02.239893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:02.240041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401083057790050:5656]
2025-10-15T10:58:02.246573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:02.247203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:02.247235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 483
2025-10-15T10:58:02.247680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:02.247802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:02.247816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:02.247827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:02.253810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 483 sessionId:  describe result for acl check
2025-10-15T10:58:02.253932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:02.253943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:02.253953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:02.253970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401087352757397:6400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:02.257301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401087352757397:6400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:02.259322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:02.263085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:02.264112Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:02.264133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:02.264180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:02.264461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:02.264647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401090152451085:5826]
2025-10-15T10:58:02.266936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:02.266845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401087352757397:6400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:02.268840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:02.269141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:02.270583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:02.270954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:02.270963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:02.270971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:02.270978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:02.270984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:02.270993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:02.271001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:02.271009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:02.271017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:02.271037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:02.271046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:02.271055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.271062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.271071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.271122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:02.271236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:02.271285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:02.271333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:02.271400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:02.271447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:02.271492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:02.271538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:02.271587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:02.271634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:02.271682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:02.271727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.271773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.271824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.271872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:02.271940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:02.272001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:02.272060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:02.272111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:02.272166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:02.272212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:02.272270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:02.272321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:02.272375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:02.272423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:02.272481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:02.272529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:02.272586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:02.272635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:02.272691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:02.272738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:02.272793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:02.272843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:02.272902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:02.272970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:02.273029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:02.273079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.273136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.273185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.273238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.273285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.273341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.273907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:02.276535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401087352757397:6400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:02.276578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401087352757397:6400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:02.276596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401087352757397:6400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:02.276628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:02.336466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:02.341251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401087352757432:5656]
2025-10-15T10:58:02.351133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:02.364510Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:02.364557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:02.364578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:02.364604Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 482 [2:7561401090152451085:5826]
2025-10-15T10:58:02.364657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:02.364713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:02.364727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:02.364741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:02.364753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:02.364804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:02.364827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:02.364850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:02.367146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.367180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.367195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.367206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:02.367517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:02.367547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.367695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.371972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 482
2025-10-15T10:58:02.367886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.372061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 482, pipe: [1:7561401087352757432:5656]
2025-10-15T10:58:02.372153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 482
2025-10-15T10:58:02.368120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:02.368204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401087352757430:6400], now have 1 active actors on pipe
2025-10-15T10:58:02.368230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401087352757432:5656], now have 1 active actors on pipe
2025-10-15T10:58:02.368253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401087352757377:2467], now have 1 active actors on pipe
2025-10-15T10:58:02.368279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401090152451079:5826]
2025-10-15T10:58:02.368295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401090152451079:5826]
2025-10-15T10:58:02.368308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401090152451079:5826]
2025-10-15T10:58:02.368350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:02.368413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:02.368427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:02.368432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:02.368444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:02.368618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:02.368635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:02.368762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401090152451079:5826]
2025-10-15T10:58:02.368792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:02.369131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:02.372529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:02.372557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:02.372663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:02.372701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:02.372720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:02.372731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:02.372777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:02.372827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:02.372882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:02.375217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 483 partition: 0 MaxSeqNo: 46 sessionId: src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0
2025-10-15T10:58:02.374565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:02.374605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:02.374681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:02.379596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10afa8b-42f5b37d-f06f6dd8-8a01aa40_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:02.435984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0] Write session: try to update token
2025-10-15T10:58:02.436048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:02.514606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:02.514639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:02.514649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:02.514700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:02.514714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:02.514728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:02.514739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:02.514771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401090152451079:5826]
2025-10-15T10:58:02.514797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401090152451079:5826]
2025-10-15T10:58:02.514822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401090152451079:5826]
2025-10-15T10:58:02.514956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:02.514977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:02.516910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:02.519475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:02.519517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:02.519540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:02.622936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId: src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:02.665872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:02.672745Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:02.674941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:02.674987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:02.679531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:02.679559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:02.691298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 483 reason: error at write: Disconnected sessionId: src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0
2025-10-15T10:58:02.700488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 483 sessionId: src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0 is DEAD
2025-10-15T10:58:02.707642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:02.707691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0] Write session will restart in 0.008972s
2025-10-15T10:58:02.707795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0] Write session: Do CDS request
2025-10-15T10:58:02.707826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:02.708589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:02.732174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:02.736799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:02.747691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:02.748572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:02.748603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:02.748651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:02.748906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:02.749101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401090152451177:5834]
2025-10-15T10:58:02.752294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:02.753443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:02.753676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:02.755773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:02.756367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:02.756382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:02.756401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:02.756411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:02.756419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:02.756426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:02.756433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:02.756439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:02.756446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:02.756453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:02.756460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:02.756472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.756491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.756505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.756594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:02.756804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:02.756903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:02.757013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:02.757108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:02.757200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:02.757279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:02.757340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:02.757384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:02.758414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:02.758485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:02.758533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.758583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.758630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.758683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:02.758771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:02.758832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:02.758887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:02.758941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:02.758996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:02.759044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:02.759099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:02.759155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:02.759217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:02.759262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:02.759319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:02.759390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:02.757740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401087352757432:5656]
2025-10-15T10:58:02.757814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:02.757907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:02.757921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 484
2025-10-15T10:58:02.759455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:02.759509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:02.759565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:02.759618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:02.759673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:02.759720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:02.759777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:02.759824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:02.759877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:02.759925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.759978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.760026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.760082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.760129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.760188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.760712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:02.759693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:02.759844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:02.759862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:02.759873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:02.762308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 484 sessionId:  describe result for acl check
2025-10-15T10:58:02.762418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:02.762430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:02.762440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:02.762458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401087352757502:6406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:02.765926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401087352757502:6406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:02.782085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:02.787871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401087352757502:6406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:02.793947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:02.794253Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:02.794276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:02.794296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:02.794321Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 483 [2:7561401090152451177:5834]
2025-10-15T10:58:02.794372Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:02.794431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:02.794444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:02.794456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:02.794469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:02.794521Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:02.794544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:02.794566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:02.803709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401087352757502:6406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:02.803752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401087352757502:6406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:02.803773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401087352757502:6406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:02.803811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:02.819681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.819714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.819726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.819738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:02.820069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:02.820088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:02.820220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:02.820398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:02.820629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:02.820706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401090152451172:5834]
2025-10-15T10:58:02.820722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401090152451172:5834]
2025-10-15T10:58:02.820734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401090152451172:5834]
2025-10-15T10:58:02.820779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:02.820855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:02.821054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:02.821072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:02.821196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401090152451172:5834]
2025-10-15T10:58:02.821214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:02.823273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 483
2025-10-15T10:58:02.823380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 483
2025-10-15T10:58:02.821914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:02.821935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:02.821947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:02.821971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:02.827568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401087352757529:6406], now have 1 active actors on pipe
2025-10-15T10:58:02.827615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401087352757484:2467], now have 1 active actors on pipe
2025-10-15T10:58:02.827673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:02.827697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:02.827801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:02.827839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:02.827861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:02.827872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:02.827916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:02.827967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:02.828019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:02.828763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:02.828790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:02.828856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:02.829222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 484 partition: 0 MaxSeqNo: 46 sessionId: src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0
2025-10-15T10:58:02.831715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8d0042d-2c62fa62-3e5d62a5-ee115390_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:02.859560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401087352757535:5656]
2025-10-15T10:58:02.864426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 483, pipe: [1:7561401087352757535:5656]
2025-10-15T10:58:02.863768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401087352757535:5656], now have 1 active actors on pipe
2025-10-15T10:58:02.870620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0] Write session: try to update token
2025-10-15T10:58:02.870690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:02.913902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:02.913939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:02.913952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:02.914010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:02.914026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:02.914041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:02.914052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:02.914090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401090152451172:5834]
2025-10-15T10:58:02.914119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401090152451172:5834]
2025-10-15T10:58:02.914142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401090152451172:5834]
2025-10-15T10:58:02.914281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:02.914317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:02.914979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:02.915035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:02.915063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:02.915463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:03.039108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId: src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:03.069351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:03.070985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:03.072508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:03.072551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:03.074915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:03.075734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401087352757535:5656]
2025-10-15T10:58:03.075828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:03.075989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:03.083304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 484 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0
2025-10-15T10:58:03.083759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 484 sessionId: src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0 is DEAD
2025-10-15T10:58:03.085755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:03.085809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0] Write session will restart in 0.007028s
2025-10-15T10:58:03.085965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0] Write session: Do CDS request
2025-10-15T10:58:03.086004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:03.104940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:03.104988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 485
2025-10-15T10:58:03.106239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:03.106995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:03.107202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:03.107228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:03.107256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:03.108785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 485 sessionId:  describe result for acl check
2025-10-15T10:58:03.108887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:03.108903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:03.108912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:03.108937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401091647724860:6413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:03.110853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401091647724860:6413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:03.125300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401091647724860:6413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:03.131186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:03.138864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401091647724860:6413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:03.138903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401091647724860:6413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:03.138921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401091647724860:6413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:03.138949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:03.138400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:03.139253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:03.139272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:03.139312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:03.139565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:03.139762Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401094447418547:5839]
2025-10-15T10:58:03.141817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:03.142593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:03.142802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:03.143978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:03.144275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:03.144282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:03.144289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:03.144296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:03.144303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:03.144311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:03.144318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:03.144325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:03.144332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:03.144339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:03.144346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:03.144352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.144359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.144365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.144409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:03.144513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:03.144561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:03.144606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:03.144647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:03.144690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:03.144731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:03.144771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:03.144814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:03.144859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:03.144903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:03.144960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.145004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.145046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.145088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:03.145151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:03.145207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:03.145260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:03.145306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:03.145356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:03.145401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:03.145450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:03.145498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:03.145549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:03.145590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:03.145643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:03.145689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:03.145743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:03.145784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:03.145835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:03.145881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:03.145931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:03.145973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:03.146024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:03.146068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:03.146119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:03.146160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.146210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.146254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.146306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.146349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.146397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.146867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:03.172687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:03.177262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401091647724906:5656]
2025-10-15T10:58:03.183219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:03.183263Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:03.183281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:03.183300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:03.183324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 484 [2:7561401094447418547:5839]
2025-10-15T10:58:03.183386Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:03.183439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:03.183454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:03.183466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:03.183477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:03.183524Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:03.183544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:03.183576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:03.184713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.184744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.184756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.184768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:03.185042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:03.185067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.185211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.185405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.186763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 484, pipe: [1:7561401091647724906:5656]
2025-10-15T10:58:03.186850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 484
2025-10-15T10:58:03.186892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 484
2025-10-15T10:58:03.185650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:03.185719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401094447418542:5839]
2025-10-15T10:58:03.185733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401094447418542:5839]
2025-10-15T10:58:03.185745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401094447418542:5839]
2025-10-15T10:58:03.185781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:03.185850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:03.186035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:03.186051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:03.186168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401094447418542:5839]
2025-10-15T10:58:03.186187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:03.186257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:03.186284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:03.186296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:03.186320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:03.187434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401091647724906:5656], now have 1 active actors on pipe
2025-10-15T10:58:03.187477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401091647724842:2467], now have 1 active actors on pipe
2025-10-15T10:58:03.187498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401091647724901:6413], now have 1 active actors on pipe
2025-10-15T10:58:03.187564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:03.187602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:03.187675Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3964024-52345cb0-26c9b452-978103bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:03.187710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:03.187727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:03.187737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:03.187769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:03.187813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:03.187860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:03.188337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:03.188364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:03.188423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:03.188694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 485 partition: 0 MaxSeqNo: 46 sessionId: src_id|3964024-52345cb0-26c9b452-978103bc_0
2025-10-15T10:58:03.191552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cff9dfb1-ac4690be-f844c9a5-df297489_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3964024-52345cb0-26c9b452-978103bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:03.235827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:03.235866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:03.235902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401094447418542:5839]
2025-10-15T10:58:03.236013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:03.238259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:03.239490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:03.246754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3964024-52345cb0-26c9b452-978103bc_0] Write session: try to update token
2025-10-15T10:58:03.246808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3964024-52345cb0-26c9b452-978103bc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:03.266741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:03.268175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:03.269503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:03.271655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:03.272073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:03.355666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:03.355699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:03.355711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:03.355760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:03.355775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:03.355789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:03.355800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:03.355837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401094447418542:5839]
2025-10-15T10:58:03.355863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401094447418542:5839]
2025-10-15T10:58:03.355887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401094447418542:5839]
2025-10-15T10:58:03.356013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:03.356033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:03.356288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:03.356308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:03.356325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:03.364361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:03.385690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId: src_id|3964024-52345cb0-26c9b452-978103bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:03.417230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:03.535126Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:03.537256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:03.537293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:03.537944Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:03.539062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:03.539325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401091647724906:5656]
2025-10-15T10:58:03.539462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:03.551063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 485 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3964024-52345cb0-26c9b452-978103bc_0
2025-10-15T10:58:03.551409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 485 sessionId: src_id|3964024-52345cb0-26c9b452-978103bc_0 is DEAD
2025-10-15T10:58:03.552075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3964024-52345cb0-26c9b452-978103bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:03.552108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3964024-52345cb0-26c9b452-978103bc_0] Write session will restart in 0.005045s
2025-10-15T10:58:03.552200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3964024-52345cb0-26c9b452-978103bc_0] Write session: Do CDS request
2025-10-15T10:58:03.552226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3964024-52345cb0-26c9b452-978103bc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:03.562037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3964024-52345cb0-26c9b452-978103bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:03.561634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:03.561665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 486
2025-10-15T10:58:03.562667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:03.562845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:03.562870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:03.562886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:03.567472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 486 sessionId:  describe result for acl check
2025-10-15T10:58:03.567694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:03.567718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:03.567735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:03.567767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401091647724938:6419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:03.570850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401091647724938:6419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:03.592714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401091647724938:6419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:03.604339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:03.606112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:03.608089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401091647724938:6419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:03.608130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401091647724938:6419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:03.608147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401091647724938:6419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:03.608174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:03.606939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:03.606969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:03.607011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:03.607257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:03.607460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401094447418638:5842]
2025-10-15T10:58:03.609779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:03.610743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:03.610965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:03.612282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:03.612626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:03.612635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:03.612642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:03.612651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:03.612659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:03.612668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:03.612675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:03.612683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:03.612691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:03.612698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:03.612706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:03.612713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.612721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.612728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.612778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:03.612899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:03.612968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:03.613015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:03.613065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:03.613114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:03.613165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:03.613217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:03.613265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:03.613315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:03.613366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:03.613412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.613462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.613511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.613557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:03.614637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:03.614712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:03.614774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:03.614823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:03.614881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:03.614943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:03.615001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:03.615050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:03.615109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:03.615158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:03.615214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:03.615265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:03.615324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:03.615385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:03.615462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:03.615520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:03.615582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:03.615630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:03.615689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:03.615737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:03.615791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:03.615840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.615896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.615948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.616019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.616116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.616237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.616856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:03.634167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401091647724992:5656]
2025-10-15T10:58:03.642265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:03.666974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 485, pipe: [1:7561401091647724992:5656]
2025-10-15T10:58:03.667085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 485
2025-10-15T10:58:03.667164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 485
2025-10-15T10:58:03.663965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:03.664021Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:03.664038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:03.664056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:03.664084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 485 [2:7561401094447418638:5842]
2025-10-15T10:58:03.664133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:03.664191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:03.664205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:03.664217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:03.664226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:03.664267Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:03.664287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:03.664305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:03.666001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.666017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.666031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.666042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:03.666329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:03.666346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:03.666482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:03.666685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:03.668258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:03.668353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401091647724992:5656], now have 1 active actors on pipe
2025-10-15T10:58:03.668377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401091647724987:6419], now have 1 active actors on pipe
2025-10-15T10:58:03.668397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401091647724929:2467], now have 1 active actors on pipe
2025-10-15T10:58:03.668460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:03.668482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:03.668514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401094447418633:5842]
2025-10-15T10:58:03.668527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401094447418633:5842]
2025-10-15T10:58:03.668540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401094447418633:5842]
2025-10-15T10:58:03.668577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:03.668605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:03.668616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:03.668624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:03.668645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:03.668819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:03.668836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:03.668895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:03.668921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:03.668952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:03.668962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:03.668995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:03.669032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:03.669147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401094447418633:5842]
2025-10-15T10:58:03.669175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:03.669183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:03.669220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:03.669901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:03.669929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:03.669987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:03.673578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 486 partition: 0 MaxSeqNo: 46 sessionId: src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0
2025-10-15T10:58:03.674493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3964024-52345cb0-26c9b452-978103bc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:03.707665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0] Write session: try to update token
2025-10-15T10:58:03.707728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:03.733004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:03.733041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:03.733082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401094447418633:5842]
2025-10-15T10:58:03.733215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:03.733224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:03.738610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:03.742450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:03.743775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:03.752166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:03.768085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:03.827229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:03.827272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:03.827282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:03.827417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:03.851576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId: src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:03.898108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:03.898149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:03.898162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:03.898171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:03.898211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401094447418633:5842]
2025-10-15T10:58:03.898237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401094447418633:5842]
2025-10-15T10:58:03.898260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401094447418633:5842]
2025-10-15T10:58:03.898348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:03.898374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:03.898400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:03.899225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:03.899274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:03.902845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:03.905859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:04.047097Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:04.049830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:04.049870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:04.051456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:04.055500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401091647724992:5656]
2025-10-15T10:58:04.055591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:04.080916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:04.081072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 486 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0
2025-10-15T10:58:04.081434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 486 sessionId: src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0 is DEAD
2025-10-15T10:58:04.082455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:04.082494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0] Write session will restart in 0.005358s
2025-10-15T10:58:04.082601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0] Write session: Do CDS request
2025-10-15T10:58:04.082632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:04.111073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:04.111998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:04.112029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 487
2025-10-15T10:58:04.125039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:04.125194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:04.125211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:04.125223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:04.126628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 487 sessionId:  describe result for acl check
2025-10-15T10:58:04.126744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:04.126756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:04.126764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:04.126782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401095942692354:6429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:04.129539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401095942692354:6429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:04.144033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401095942692354:6429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:04.148427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:04.150778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:04.151705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:04.151726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:04.151777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:04.152068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:04.152257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401098742386020:5851]
2025-10-15T10:58:04.154523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:04.156073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:04.156351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:04.156502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401095942692387:5656]
2025-10-15T10:58:04.157705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:04.158070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:04.158080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:04.158088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:04.158096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:04.158103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:04.158110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:04.158118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:04.158125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:04.158133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:04.158139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:04.158146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:04.158153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.158160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.158167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.158217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:04.157167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401095942692354:6429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:04.158327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:04.157206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401095942692354:6429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:04.158377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:04.157221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401095942692354:6429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:04.158425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:04.157249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:04.158470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:04.158536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:04.158591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:04.158635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:04.158681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:04.158728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:04.158775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:04.158820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.158866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.158911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.158966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:04.159030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:04.159099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:04.159163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:04.159211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:04.159270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:04.159323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:04.159393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:04.159448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:04.159500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:04.159553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:04.159615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:04.159666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:04.159717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:04.159766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:04.159821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:04.159869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:04.159921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:04.159967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:04.160020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:04.160080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:04.160137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:04.160186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.160241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.160290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.160346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.160396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.160459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.161008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:04.180834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:04.194655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:04.194715Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:04.194732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:04.194751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:04.194775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 486 [2:7561401098742386020:5851]
2025-10-15T10:58:04.194825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:04.194884Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:04.194900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:04.194912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:04.194923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:04.194974Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:04.194997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:04.195017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:04.196970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.196996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.197011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.197023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:04.197297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:04.197317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.197467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.197649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.197874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:04.197947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401098742386015:5851]
2025-10-15T10:58:04.197962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401098742386015:5851]
2025-10-15T10:58:04.197974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401098742386015:5851]
2025-10-15T10:58:04.198022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:04.198095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:04.198276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:04.198294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:04.198415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401098742386015:5851]
2025-10-15T10:58:04.198434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:04.199027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:04.199060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:04.199072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:04.199098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:04.199553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401095942692390:6429], now have 1 active actors on pipe
2025-10-15T10:58:04.199578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401095942692333:2467], now have 1 active actors on pipe
2025-10-15T10:58:04.199599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401095942692387:5656], now have 1 active actors on pipe
2025-10-15T10:58:04.200735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 486
2025-10-15T10:58:04.200824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 486
2025-10-15T10:58:04.200893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 486, pipe: [1:7561401095942692387:5656]
2025-10-15T10:58:04.201243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:04.201280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:04.201369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f633aa9f-7250b19f-fb006279-40b77124_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:04.201414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:04.201451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:04.201465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:04.201505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:04.201554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:04.201613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:04.202304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:04.202331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:04.202396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:04.203483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 487 partition: 0 MaxSeqNo: 46 sessionId: src_id|f633aa9f-7250b19f-fb006279-40b77124_0
2025-10-15T10:58:04.204576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c297f67-ae8cc19b-72f1d213-d08d8acc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f633aa9f-7250b19f-fb006279-40b77124_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:04.253110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f633aa9f-7250b19f-fb006279-40b77124_0] Write session: try to update token
2025-10-15T10:58:04.253167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f633aa9f-7250b19f-fb006279-40b77124_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:04.295204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:04.295235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:04.295248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:04.343128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:04.343197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:04.343219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:04.343242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:04.343294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401098742386015:5851]
2025-10-15T10:58:04.343320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401098742386015:5851]
2025-10-15T10:58:04.343342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401098742386015:5851]
2025-10-15T10:58:04.343509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:04.343532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:04.343659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:04.343708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:04.343746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:04.356135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:04.471434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId: src_id|f633aa9f-7250b19f-fb006279-40b77124_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:04.500158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:04.522600Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:04.524159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:04.524204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:04.527746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:04.528102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401095942692387:5656]
2025-10-15T10:58:04.528458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:04.526598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:04.544789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 487 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f633aa9f-7250b19f-fb006279-40b77124_0
2025-10-15T10:58:04.545128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 487 sessionId: src_id|f633aa9f-7250b19f-fb006279-40b77124_0 is DEAD
2025-10-15T10:58:04.547693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f633aa9f-7250b19f-fb006279-40b77124_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:04.547736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f633aa9f-7250b19f-fb006279-40b77124_0] Write session will restart in 0.005538s
2025-10-15T10:58:04.547838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f633aa9f-7250b19f-fb006279-40b77124_0] Write session: Do CDS request
2025-10-15T10:58:04.547870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f633aa9f-7250b19f-fb006279-40b77124_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:04.565032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:04.565077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 488
2025-10-15T10:58:04.565522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f633aa9f-7250b19f-fb006279-40b77124_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:04.566331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:04.566475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:04.566499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:04.566508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:04.567597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 488 sessionId:  describe result for acl check
2025-10-15T10:58:04.567695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:04.567712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:04.567720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:04.567736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401095942692448:6440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:04.570073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401095942692448:6440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:04.577290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401095942692448:6440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:04.590977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:04.591086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401095942692448:6440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:04.591138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401095942692448:6440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:04.591156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401095942692448:6440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:04.591192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:04.598450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:04.599252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:04.599271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:04.599310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:04.599578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:04.599739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401098742386107:5860]
2025-10-15T10:58:04.604062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:04.605163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:04.605373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:04.606562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:04.606888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:04.606906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:04.606913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:04.606920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:04.606928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:04.606935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:04.606943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:04.606950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:04.606957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:04.606964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:04.606972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:04.606980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.606986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.606995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.607045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:04.607150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:04.607201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:04.607255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:04.607307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:04.607376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:04.607431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:04.607476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:04.607521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:04.607567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:04.607613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:04.607659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.607703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.607750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.607796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:04.607867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:04.607926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:04.607979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:04.608030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:04.608081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:04.608127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:04.608181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:04.608229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:04.608283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:04.608328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:04.608385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:04.608430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:04.608483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:04.608530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:04.608583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:04.608629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:04.608683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:04.608724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:04.608777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:04.608824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:04.608873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:04.608918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.608986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.609031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.609089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.609133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.609187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.609682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:04.631471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401095942692497:5656]
2025-10-15T10:58:04.639194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:04.656721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:04.656907Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:04.656929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:04.656957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:04.656980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 487 [2:7561401098742386107:5860]
2025-10-15T10:58:04.657031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:04.657085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:04.657099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:04.657112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:04.657121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:04.657166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:04.657187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:04.657207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:04.659243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 487, pipe: [1:7561401095942692497:5656]
2025-10-15T10:58:04.659368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 487
2025-10-15T10:58:04.659437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 487
2025-10-15T10:58:04.658507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.658533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.658548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.658559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:04.658814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:04.658830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:04.658958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:04.659135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:04.659375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:04.659447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401095942692497:5656], now have 1 active actors on pipe
2025-10-15T10:58:04.659468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401095942692490:6440], now have 1 active actors on pipe
2025-10-15T10:58:04.659488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401095942692432:2467], now have 1 active actors on pipe
2025-10-15T10:58:04.659511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401098742386100:5860]
2025-10-15T10:58:04.659526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401098742386100:5860]
2025-10-15T10:58:04.659537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401098742386100:5860]
2025-10-15T10:58:04.659574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:04.659636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:04.659681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:04.659695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:04.659706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:04.659803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:04.659818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:04.659947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:04.659966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:04.660007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401098742386100:5860]
2025-10-15T10:58:04.660035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:04.660060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:04.660131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a92111fb-d5bf7879-b0de760a-a321306_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:04.660156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:04.660172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:04.660183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:04.660213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:04.660246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:04.660325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:04.661837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:04.661870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:04.661945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:04.662244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 488 partition: 0 MaxSeqNo: 46 sessionId: src_id|a92111fb-d5bf7879-b0de760a-a321306_0
2025-10-15T10:58:04.663122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f633aa9f-7250b19f-fb006279-40b77124_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a92111fb-d5bf7879-b0de760a-a321306_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:04.687135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a92111fb-d5bf7879-b0de760a-a321306_0] Write session: try to update token
2025-10-15T10:58:04.687185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a92111fb-d5bf7879-b0de760a-a321306_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:04.776330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:04.776374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:04.776387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:04.776452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:04.776470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:04.776485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:04.776497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:04.776533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401098742386100:5860]
2025-10-15T10:58:04.776560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401098742386100:5860]
2025-10-15T10:58:04.776586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401098742386100:5860]
2025-10-15T10:58:04.776743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:04.776763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:04.777749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:04.779527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:04.779566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:04.779598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:04.839552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId: src_id|a92111fb-d5bf7879-b0de760a-a321306_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:04.861757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:04.952040Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:04.953611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:04.953641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:04.955322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:04.955535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401095942692497:5656]
2025-10-15T10:58:04.955606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:04.955616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:04.964633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:04.990266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92111fb-d5bf7879-b0de760a-a321306_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:04.990322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92111fb-d5bf7879-b0de760a-a321306_0] Write session will restart in 0.007821s
2025-10-15T10:58:04.990423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92111fb-d5bf7879-b0de760a-a321306_0] Write session: Do CDS request
2025-10-15T10:58:04.990448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92111fb-d5bf7879-b0de760a-a321306_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:04.989494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 488 reason: error at write: Disconnected sessionId: src_id|a92111fb-d5bf7879-b0de760a-a321306_0
2025-10-15T10:58:04.989797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 488 sessionId: src_id|a92111fb-d5bf7879-b0de760a-a321306_0 is DEAD
2025-10-15T10:58:05.002746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a92111fb-d5bf7879-b0de760a-a321306_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:05.002481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:05.002512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 489
2025-10-15T10:58:05.003440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:05.003574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:05.003607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:05.003617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:05.004917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 489 sessionId:  describe result for acl check
2025-10-15T10:58:05.005038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:05.005050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:05.005061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:05.005079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401100237659825:6444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:05.007916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401100237659825:6444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:05.014762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401100237659825:6444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:05.024573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401100237659825:6444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:05.024627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401100237659825:6444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:05.024646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401100237659825:6444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:05.024681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:05.028432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:05.031314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:05.032113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:05.032149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:05.032190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:05.032426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:05.032601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401103037353472:5863]
2025-10-15T10:58:05.034817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:05.035823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:05.036030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:05.037267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:05.037574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:05.037582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:05.037590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:05.037597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:05.037604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:05.037611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:05.037618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:05.037626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:05.037632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:05.037638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:05.037645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:05.037651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.037658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.037664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.037711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:05.037812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:05.037861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:05.037905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:05.037950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:05.037993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:05.038036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:05.038079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:05.038123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:05.038166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:05.038209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:05.038252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.038295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.038338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.038375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:05.038438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:05.038516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:05.038571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:05.038620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:05.038675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:05.038721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:05.038772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:05.038820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:05.038871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:05.038914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:05.038966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:05.039008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:05.039059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:05.039102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:05.039153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:05.039200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:05.039251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:05.039293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:05.040401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:05.040478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:05.040540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:05.040586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.040637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.040685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.040736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.040780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.040833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.041379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:05.056112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401100237659873:5656]
2025-10-15T10:58:05.074055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:05.082990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:05.083646Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:05.083679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:05.083700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:05.083726Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 488 [2:7561401103037353472:5863]
2025-10-15T10:58:05.083788Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:05.083850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:05.083867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:05.083881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:05.083894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:05.083950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:05.083977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:05.084001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:05.085907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.085946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.085961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.085972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:05.086286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:05.086305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.086455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.086683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.087512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 488
2025-10-15T10:58:05.087626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 488
2025-10-15T10:58:05.087679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 488, pipe: [1:7561401100237659873:5656]
2025-10-15T10:58:05.086962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:05.087063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401095942692511:2467], now have 1 active actors on pipe
2025-10-15T10:58:05.087088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401100237659864:6444], now have 1 active actors on pipe
2025-10-15T10:58:05.087112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401100237659873:5656], now have 1 active actors on pipe
2025-10-15T10:58:05.087140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401103037353467:5863]
2025-10-15T10:58:05.087156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401103037353467:5863]
2025-10-15T10:58:05.087171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401103037353467:5863]
2025-10-15T10:58:05.087221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:05.087311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:05.087471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:05.087510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:05.087524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:05.087529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:05.087550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:05.087680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401103037353467:5863]
2025-10-15T10:58:05.087716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:05.087765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:05.088733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:05.088763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:05.088829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:05.088858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:05.088877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:05.088889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:05.088924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:05.088992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:05.089057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:05.089857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:05.089891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:05.089955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:05.090802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 489 partition: 0 MaxSeqNo: 46 sessionId: src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0
2025-10-15T10:58:05.093175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a92111fb-d5bf7879-b0de760a-a321306_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:05.114611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0] Write session: try to update token
2025-10-15T10:58:05.114665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:05.140105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:05.140144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:05.140176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401103037353467:5863]
2025-10-15T10:58:05.140287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:05.140290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:05.142203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:05.145232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:05.146480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:05.147668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:05.149317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:05.149761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:05.191596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:05.191626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:05.191637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:05.273606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:05.273642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:05.273655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:05.273666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:05.273703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401103037353467:5863]
2025-10-15T10:58:05.273731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401103037353467:5863]
2025-10-15T10:58:05.273753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401103037353467:5863]
2025-10-15T10:58:05.275170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:05.275215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:05.275462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:05.275495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:05.275520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:05.284254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:05.329039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId: src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:05.357802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:05.469790Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:05.473511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:05.473553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:05.474146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:05.478393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:05.479461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:05.511881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 489 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0
2025-10-15T10:58:05.512098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 489 sessionId: src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0 is DEAD
2025-10-15T10:58:05.519583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:05.519626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0] Write session will restart in 0.006832s
2025-10-15T10:58:05.519750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0] Write session: Do CDS request
2025-10-15T10:58:05.519780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:05.529710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401100237659873:5656]
2025-10-15T10:58:05.538221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:05.540240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:05.540274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 490
2025-10-15T10:58:05.540591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:05.540712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:05.540737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:05.540749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:05.544080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:05.547567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 490 sessionId:  describe result for acl check
2025-10-15T10:58:05.547663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:05.547670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:05.547676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:05.547689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401100237659943:6456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:05.549474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401100237659943:6456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:05.555838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:05.556784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:05.556804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:05.556845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:05.557150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:05.557331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401103037353556:5872]
2025-10-15T10:58:05.559834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401100237659943:6456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:05.559951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:05.562311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:05.562610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:05.564038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:05.564401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:05.564409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:05.564417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:05.564424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:05.564431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:05.564438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:05.564444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:05.564453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:05.564460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:05.564468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:05.564476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:05.564483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.564492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.564500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.564552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:05.564671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:05.564722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:05.564774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:05.564824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:05.564873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:05.564922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:05.564985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:05.565035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:05.565086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:05.565135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:05.565184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.565234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.565283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.565335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:05.566670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:05.566769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:05.566853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:05.566909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:05.566978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:05.567028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:05.567087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:05.567141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:05.567201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:05.567252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:05.567313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:05.567382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:05.567438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:05.567492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:05.567564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:05.567622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:05.567684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:05.567734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:05.567796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:05.567850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:05.567909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:05.567959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.568018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.568070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.568129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.568180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.568238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.568785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:05.569943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401100237659943:6456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:05.569991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401100237659943:6456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:05.570011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401100237659943:6456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:05.570050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:05.592860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:05.604893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:05.604946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:05.604974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:05.604994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:05.605022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 489 [2:7561401103037353556:5872]
2025-10-15T10:58:05.605076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:05.605136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:05.605153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:05.605166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:05.605177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:05.605230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:05.605253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:05.605276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:05.607254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.607296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.607311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.607323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:05.608033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:05.608054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:05.608213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:05.608413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:05.608779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 489
2025-10-15T10:58:05.608862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 489
2025-10-15T10:58:05.608650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:05.608743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401100237659973:6456], now have 1 active actors on pipe
2025-10-15T10:58:05.608767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401100237659911:2467], now have 1 active actors on pipe
2025-10-15T10:58:05.608792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401103037353549:5872]
2025-10-15T10:58:05.608808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401103037353549:5872]
2025-10-15T10:58:05.608822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401103037353549:5872]
2025-10-15T10:58:05.608863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:05.608936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:05.609124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:05.609137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:05.609138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:05.609150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:05.609155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:05.609279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401103037353549:5872]
2025-10-15T10:58:05.609308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:05.609329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:05.609374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:05.609396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:05.609585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:05.609621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:05.609640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:05.609651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:05.609691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:05.609733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:05.609802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:05.612388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:05.612448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:05.612520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:05.612855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 490 partition: 0 MaxSeqNo: 46 sessionId: src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0
2025-10-15T10:58:05.616789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca0cf2c-54a88ce7-e3cdec16-f0f54465_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:05.629876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401100237659981:5656]
2025-10-15T10:58:05.631907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 489, pipe: [1:7561401100237659981:5656]
2025-10-15T10:58:05.631675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401100237659981:5656], now have 1 active actors on pipe
2025-10-15T10:58:05.681178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0] Write session: try to update token
2025-10-15T10:58:05.681242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:05.707500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:05.707551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:05.707567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:05.792875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:05.792918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:05.792934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:05.792947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:05.792995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401103037353549:5872]
2025-10-15T10:58:05.793023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401103037353549:5872]
2025-10-15T10:58:05.793047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401103037353549:5872]
2025-10-15T10:58:05.793254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:05.793267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:05.793293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:05.793301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:05.793339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:05.794379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:05.843689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId: src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:05.867916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:05.930692Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:05.962637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:05.962671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:05.962713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:05.962721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:05.962743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401103037353549:5872]
2025-10-15T10:58:05.963198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:05.963862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:05.963525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:05.963552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:05.967527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:05.967784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401100237659981:5656]
2025-10-15T10:58:05.973235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:05.973317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0] Write session will restart in 0.005033s
2025-10-15T10:58:05.973509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0] Write session: Do CDS request
2025-10-15T10:58:05.973596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:05.972383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 490 reason: error at write: Disconnected sessionId: src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0
2025-10-15T10:58:05.972696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 490 sessionId: src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0 is DEAD
2025-10-15T10:58:05.987049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:05.988006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:05.988032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 491
2025-10-15T10:58:05.988329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:05.988418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:05.988431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:05.988440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:05.989631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 491 sessionId:  describe result for acl check
2025-10-15T10:58:05.989697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:05.989703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:05.989709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:05.989719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401100237660019:6463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:05.991487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401100237660019:6463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:06.011743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401100237660019:6463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:06.020752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:06.025655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:06.026467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:06.026501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:06.026543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:06.026776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:06.026968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401107332320958:5882]
2025-10-15T10:58:06.029092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:06.029884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:06.030096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:06.031232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:06.027552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401100237660019:6463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:06.027596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401100237660019:6463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:06.027614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401100237660019:6463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:06.027648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:06.031560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.031576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.031583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.031589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.031596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.031602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.031608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.031616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.031623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.031630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.031636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.031642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.031649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.031655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.031700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.031803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.031849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.031897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.031941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.031982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.032027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.032068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.032110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.032170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.032212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.032255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.032299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.032341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.032381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.032443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.032498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.032549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.032593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.032642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.032681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.032731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.032778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.032828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.032870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.032923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.032981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.033032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.033075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.033125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.033169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.033220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.033264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.033315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.033359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.033410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.033455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.033505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.033549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.033600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.033642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.033693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.034163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:06.060513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:06.068083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401104532627368:5656]
2025-10-15T10:58:06.071065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:06.073397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 490
2025-10-15T10:58:06.073480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 490, pipe: [1:7561401104532627368:5656]
2025-10-15T10:58:06.073553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 490
2025-10-15T10:58:06.071250Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:06.071273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:06.071291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:06.071315Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 490 [2:7561401107332320958:5882]
2025-10-15T10:58:06.071380Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:06.071442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:06.071456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:06.071468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:06.071479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:06.071526Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:06.071547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:06.071568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:06.072559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.072574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.072588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.072600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:06.072873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:06.072890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.073056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.073258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.073495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:06.073573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401104532627362:6463], now have 1 active actors on pipe
2025-10-15T10:58:06.073597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401104532627368:5656], now have 1 active actors on pipe
2025-10-15T10:58:06.073617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401100237660006:2467], now have 1 active actors on pipe
2025-10-15T10:58:06.073642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401107332320952:5882]
2025-10-15T10:58:06.073655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401107332320952:5882]
2025-10-15T10:58:06.073667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401107332320952:5882]
2025-10-15T10:58:06.073709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:06.073771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:06.073775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:06.073784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:06.073796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:06.073948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:06.073966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:06.074102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:06.074122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:06.074171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401107332320952:5882]
2025-10-15T10:58:06.074198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:06.074220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:06.075254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bdf2178-3e98b432-8a692596-e2748082_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:06.075297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:06.075316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:06.075334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:06.075391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:06.075432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:06.075550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:06.082230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:06.082278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:06.082366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:06.082946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 491 partition: 0 MaxSeqNo: 46 sessionId: src_id|4bdf2178-3e98b432-8a692596-e2748082_0
2025-10-15T10:58:06.084753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|447e5af4-dc024544-bbe2d5d2-a20c8eff_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4bdf2178-3e98b432-8a692596-e2748082_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:06.127955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdf2178-3e98b432-8a692596-e2748082_0] Write session: try to update token
2025-10-15T10:58:06.128031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdf2178-3e98b432-8a692596-e2748082_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:06.242535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:06.242574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:06.242587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:06.242636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:06.242651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:06.242663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:06.242688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:06.242719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401107332320952:5882]
2025-10-15T10:58:06.242742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401107332320952:5882]
2025-10-15T10:58:06.242764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401107332320952:5882]
2025-10-15T10:58:06.242960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:06.242990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:06.244058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:06.247492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:06.247545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:06.247573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:06.287475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId: src_id|4bdf2178-3e98b432-8a692596-e2748082_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:06.322835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:06.401624Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:06.424641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:06.424692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:06.424757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:06.424772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:06.424811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401107332320952:5882]
2025-10-15T10:58:06.425521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:06.426097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:06.426129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:06.427372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:06.427638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401104532627368:5656]
2025-10-15T10:58:06.426266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:06.434478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 491 reason: error at write: Disconnected sessionId: src_id|4bdf2178-3e98b432-8a692596-e2748082_0
2025-10-15T10:58:06.434795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 491 sessionId: src_id|4bdf2178-3e98b432-8a692596-e2748082_0 is DEAD
2025-10-15T10:58:06.435708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdf2178-3e98b432-8a692596-e2748082_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:06.435781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdf2178-3e98b432-8a692596-e2748082_0] Write session will restart in 0.006019s
2025-10-15T10:58:06.435961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdf2178-3e98b432-8a692596-e2748082_0] Write session: Do CDS request
2025-10-15T10:58:06.436034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdf2178-3e98b432-8a692596-e2748082_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:06.454740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdf2178-3e98b432-8a692596-e2748082_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:06.454516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:06.454565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 492
2025-10-15T10:58:06.455227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:06.455365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:06.455383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:06.455392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:06.457834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 492 sessionId:  describe result for acl check
2025-10-15T10:58:06.457956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:06.457966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:06.457975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:06.457992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401104532627394:6468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:06.460356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401104532627394:6468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:06.470292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401104532627394:6468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:06.483171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401104532627394:6468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:06.483217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401104532627394:6468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:06.483232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401104532627394:6468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:06.483258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:06.493317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:06.496704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:06.497501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:06.497517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:06.497554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:06.497788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:06.497961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401107332321033:5885]
2025-10-15T10:58:06.501175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:06.502133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:06.502365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:06.503592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:06.503924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.503945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.503952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.503960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.503966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.503973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.503980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.503986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.503991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.503997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.504004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.504009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.504015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.504022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.504065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.504166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.504215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.504262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.504307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.504353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.504397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.504442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.504487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.504532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.504574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.504618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.504661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.504703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.504746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.504810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.504865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.504918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.504963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.505026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.505070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.505123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.505169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.505223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.505268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.505318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.505363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.505413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.505456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.505506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.505556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.505607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.505651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.505704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.507015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.507090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.507143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.507196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.507254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.507308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.507368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.507419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.507914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:06.527618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401104532627465:5656]
2025-10-15T10:58:06.541024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:06.552238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:06.552286Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:06.552303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:06.552322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:06.552346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 491 [2:7561401107332321033:5885]
2025-10-15T10:58:06.552397Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:06.552453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:06.552469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:06.552480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:06.552491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:06.552534Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:06.552554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:06.552575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:06.553601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.553616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.553629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.553641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:06.553894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:06.553911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.554046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.554230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.557645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 491
2025-10-15T10:58:06.555183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:06.557756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 491
2025-10-15T10:58:06.555263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401107332321028:5885]
2025-10-15T10:58:06.557819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 491, pipe: [1:7561401104532627465:5656]
2025-10-15T10:58:06.555277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401107332321028:5885]
2025-10-15T10:58:06.559392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 492 partition: 0 MaxSeqNo: 46 sessionId: src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0
2025-10-15T10:58:06.555288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401107332321028:5885]
2025-10-15T10:58:06.555318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:06.555410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:06.555426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:06.555442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:06.555460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:06.555585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:06.555602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:06.555750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401104532627380:2467], now have 1 active actors on pipe
2025-10-15T10:58:06.555774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401104532627465:5656], now have 1 active actors on pipe
2025-10-15T10:58:06.555798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401104532627452:6468], now have 1 active actors on pipe
2025-10-15T10:58:06.555815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401107332321028:5885]
2025-10-15T10:58:06.555844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:06.555947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:06.557930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:06.557953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:06.558022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:06.558053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:06.558070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:06.558080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:06.558113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:06.558151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:06.558193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:06.558941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:06.558961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:06.559017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:06.563027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdf2178-3e98b432-8a692596-e2748082_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:06.586280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0] Write session: try to update token
2025-10-15T10:58:06.586333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:06.603429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:06.603457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:06.603482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401107332321028:5885]
2025-10-15T10:58:06.603581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:06.603592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:06.605285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:06.606487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:06.611739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:06.613408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:06.616347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:06.621623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:06.652783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:06.652813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:06.652823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:06.659618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:58:06.659679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-10-15T10:58:06.663862Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:58:06.665006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 9 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:58:06.665156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:58:06.729301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:06.729343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:06.729358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:06.729369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:06.729406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401107332321028:5885]
2025-10-15T10:58:06.729431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401107332321028:5885]
2025-10-15T10:58:06.729454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401107332321028:5885]
2025-10-15T10:58:06.729578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:06.729586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:06.729607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:06.729625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:06.729652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:06.731150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:06.738487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId: src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:06.767016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:06.907669Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:06.914355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:06.914401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:06.916673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:06.916916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401104532627465:5656]
2025-10-15T10:58:06.917056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:06.917077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:06.915689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:06.929749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:06.929799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0] Write session will restart in 0.007920s
2025-10-15T10:58:06.929906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0] Write session: Do CDS request
2025-10-15T10:58:06.929940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:06.926648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 492 reason: error at write: Disconnected sessionId: src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0
2025-10-15T10:58:06.926932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 492 sessionId: src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0 is DEAD
2025-10-15T10:58:06.943985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:06.956301Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T10:58:06.956577Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 5 consumer shared/user session shared/user_1_5_15539774547917866340_v1 is DEAD
2025-10-15T10:58:06.957009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:06.957022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 493
2025-10-15T10:58:06.957165Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400889784227365:5653] disconnected; active server actors: 1
2025-10-15T10:58:06.957183Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400889784227365:5653] client user disconnected session shared/user_1_5_15539774547917866340_v1
2025-10-15T10:58:06.959114Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T10:58:06.959518Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:58:06.959543Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:58:06.959574Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.007317s
2025-10-15T10:58:06.959414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:06.959538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:06.959554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:06.959562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:06.961830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 493 sessionId:  describe result for acl check
2025-10-15T10:58:06.961923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:06.961932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:06.961941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:06.961956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401104532627515:6479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:06.964247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401104532627515:6479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:06.971697Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T10:58:06.973747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401104532627515:6479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:06.976267Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:58:06.976285Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 6
2025-10-15T10:58:06.976733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:06.978303Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 6 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:58:06.978461Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:58:06.978756Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 auth for : user
2025-10-15T10:58:06.979005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:06.979141Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 Handle describe topics response
2025-10-15T10:58:06.979227Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 auth is DEAD
2025-10-15T10:58:06.979281Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:58:06.979760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:06.979790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:06.979829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:06.980058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:06.980240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401107332321131:5895]
2025-10-15T10:58:06.980453Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:58:06.981315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401104532627515:6479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:06.981345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401104532627515:6479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:06.981361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401104532627515:6479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:06.981393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:06.981460Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_6_5484528221606064911_v1
2025-10-15T10:58:06.981484Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:58:06.981654Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:58:06.981704Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401104532627562:6483] connected; active server actors: 1
2025-10-15T10:58:06.981733Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561401104532627562:6483] session shared/user_1_6_5484528221606064911_v1
2025-10-15T10:58:06.981761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:58:06.981803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:58:06.981839Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_6_5484528221606064911_v1" (Sender=[1:7561401104532627555:6483], Pipe=[1:7561401104532627562:6483], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:58:06.981863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:58:06.981904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:58:06.981950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_6_5484528221606064911_v1" (Sender=[1:7561401104532627555:6483], Pipe=[1:7561401104532627562:6483], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:58:06.982001Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_6_5484528221606064911_v1" sender [1:7561401104532627555:6483] lock partition 0 for ReadingSession "shared/user_1_6_5484528221606064911_v1" (Sender=[1:7561401104532627555:6483], Pipe=[1:7561401104532627562:6483], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-15T10:58:06.982043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:58:06.982071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000143s
2025-10-15T10:58:06.982395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:06.982802Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_6_5484528221606064911_v1" ClientId: "user" PipeClient { RawX1: 7561401104532627562 RawX2: 4503603922344275 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:58:06.983533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:58:06.983656Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:58:06.983397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:06.983593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:06.983759Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 got read request: guid# 9a27e0b1-6cec5e24-67f25875-8139af86
2025-10-15T10:58:06.984905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:06.985236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.985244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.985251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.985257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.985264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.985271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.985278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.985284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.985291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.985297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.985304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.985312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.985321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.985327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.985370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.985470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.985518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.985563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.985625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.985671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.985714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.985757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.985803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.985847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.985891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.985934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.985975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.986019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.986060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.986121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:06.986175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.986230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:06.986276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.986325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:06.986368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.986414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:06.986459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.986512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:06.986555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.986605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:06.986648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.986698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:06.986740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.986791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:06.986836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.986888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:06.986931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.986981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:06.987028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.987076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:06.987117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.987167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:06.987211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.987258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:06.987300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.987369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:06.987842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:07.012696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:07.022714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:07.022763Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:07.022777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:07.022792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:07.022813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 492 [2:7561401107332321131:5895]
2025-10-15T10:58:07.022857Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:07.022909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:07.022923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.022934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.022943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.022980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:07.022995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:07.023010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:07.024623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.024633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.024642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.024649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:07.024830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:07.024842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.024932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.025066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.025221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:07.025269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401104532627566:6479], now have 1 active actors on pipe
2025-10-15T10:58:07.025283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401104532627571:6486], now have 1 active actors on pipe
2025-10-15T10:58:07.025295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401104532627497:2467], now have 1 active actors on pipe
2025-10-15T10:58:07.025312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401107332321126:5895]
2025-10-15T10:58:07.025321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401107332321126:5895]
2025-10-15T10:58:07.025329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401107332321126:5895]
2025-10-15T10:58:07.025355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:07.025396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:07.025413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:07.025427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:07.025435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:07.025530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:07.025541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:07.025618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401107332321126:5895]
2025-10-15T10:58:07.025636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:07.025651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:07.026863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 492
2025-10-15T10:58:07.026969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 492
2025-10-15T10:58:07.027064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 492, pipe: [1:7561401104532627571:6486]
2025-10-15T10:58:07.038846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:07.038887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:07.038942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:07.038955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:07.038982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_6_5484528221606064911_v1 on pipe: [1:7561401104532627571:6486]
2025-10-15T10:58:07.039059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|528d9c78-854a1e-eabf8604-514c9a91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:07.039090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.039106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.039116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:07.039149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.039189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:07.039232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.039252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.039261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:07.039319Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_6_5484528221606064911_v1
2025-10-15T10:58:07.039330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.039464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:07.040255Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:58:07.040330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:07.040347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:07.040491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:07.040864Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_6_5484528221606064911_v1:1 with generation 492
2025-10-15T10:58:07.040837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 493 partition: 0 MaxSeqNo: 46 sessionId: src_id|528d9c78-854a1e-eabf8604-514c9a91_0
2025-10-15T10:58:07.043212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5ea318b-72ae750a-f9700892-7a433ef9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|528d9c78-854a1e-eabf8604-514c9a91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:07.049415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:58:07.049500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:58:07.049529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.049541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.049553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.049588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:58:07.049628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:58:07.051857Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760525887038 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:58:07.051905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T10:58:07.051967Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 sending to client partition status
2025-10-15T10:58:07.072325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|528d9c78-854a1e-eabf8604-514c9a91_0] Write session: try to update token
2025-10-15T10:58:07.072366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|528d9c78-854a1e-eabf8604-514c9a91_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:07.129162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:07.129204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:07.129216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:07.129226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:07.129261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401107332321126:5895]
2025-10-15T10:58:07.129287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401107332321126:5895]
2025-10-15T10:58:07.129308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401107332321126:5895]
2025-10-15T10:58:07.129453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:07.129503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:07.129522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.129533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:07.129534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.129545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.129587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:07.129605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:07.130683Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:07.187193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId: src_id|528d9c78-854a1e-eabf8604-514c9a91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:07.209936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:07.272796Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:07.295469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:07.295518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:07.295582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:07.295594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:07.295630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401107332321126:5895]
2025-10-15T10:58:07.295937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:07.296565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:07.296644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_6_5484528221606064911_v1
2025-10-15T10:58:07.296601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:07.296714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:07.299572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401104532627571:6486]
2025-10-15T10:58:07.299682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:07.299438Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_6_5484528221606064911_v1
2025-10-15T10:58:07.304196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 493 reason: error at write: Disconnected sessionId: src_id|528d9c78-854a1e-eabf8604-514c9a91_0
2025-10-15T10:58:07.304530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 493 sessionId: src_id|528d9c78-854a1e-eabf8604-514c9a91_0 is DEAD
2025-10-15T10:58:07.308035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528d9c78-854a1e-eabf8604-514c9a91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:07.308093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528d9c78-854a1e-eabf8604-514c9a91_0] Write session will restart in 0.008566s
2025-10-15T10:58:07.308258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528d9c78-854a1e-eabf8604-514c9a91_0] Write session: Do CDS request
2025-10-15T10:58:07.308301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528d9c78-854a1e-eabf8604-514c9a91_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:07.321382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:07.321411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 494
2025-10-15T10:58:07.321667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|528d9c78-854a1e-eabf8604-514c9a91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:07.322295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:07.322419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:07.322438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:07.322446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:07.323623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 494 sessionId:  describe result for acl check
2025-10-15T10:58:07.323723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:07.323739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:07.323748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:07.323764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401108827594912:6490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:07.326060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401108827594912:6490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:07.336161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401108827594912:6490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:07.348275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401108827594912:6490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:07.348317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401108827594912:6490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:07.348331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401108827594912:6490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:07.348361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:07.352389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:07.359511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:07.360393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:07.360423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:07.360459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:07.360684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:07.360855Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401111627288530:5905]
2025-10-15T10:58:07.363318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:07.364335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:07.364526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:07.365736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:07.366033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:07.366041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:07.366047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:07.366055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:07.366062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:07.366067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:07.366075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:07.366082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:07.366088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:07.366095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:07.366101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:07.366107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.366113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.366120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.366165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:07.366269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:07.366313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:07.366357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:07.366399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:07.366446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:07.366492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:07.366535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:07.366578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:07.366623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:07.366665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:07.366707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.366754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.366795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.366838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:07.366901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:07.366954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:07.367006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:07.367050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:07.367102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:07.367146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:07.367196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:07.367242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:07.367321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:07.367391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:07.367443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:07.367489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:07.367540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:07.367585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:07.367635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:07.367678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:07.367731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:07.367773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:07.367840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:07.367884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:07.367935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:07.367977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.368027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.368070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.368121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.368160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.368209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.368721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:07.390161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:07.399957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401108827594968:6486]
2025-10-15T10:58:07.399786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:07.399833Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:07.399849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:07.399869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:07.399893Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 493 [2:7561401111627288530:5905]
2025-10-15T10:58:07.399943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:07.399996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:07.400010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.400021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.400032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.400076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:07.400096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:07.400116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:07.413722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.413753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.413767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.413778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:07.414049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:07.414067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.414196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.414374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.414599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:07.414661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401111627288525:5905]
2025-10-15T10:58:07.414675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401111627288525:5905]
2025-10-15T10:58:07.414686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401111627288525:5905]
2025-10-15T10:58:07.414942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:07.414954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:07.414967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:07.415889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 493
2025-10-15T10:58:07.415981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 493
2025-10-15T10:58:07.416037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 493, pipe: [1:7561401108827594968:6486]
2025-10-15T10:58:07.416326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:07.416418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:07.416592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:07.416608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:07.416649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401108827594958:6490], now have 1 active actors on pipe
2025-10-15T10:58:07.416673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401108827594898:2467], now have 1 active actors on pipe
2025-10-15T10:58:07.416694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401108827594968:6486], now have 1 active actors on pipe
2025-10-15T10:58:07.416733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:07.416753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:07.416874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401111627288525:5905]
2025-10-15T10:58:07.416896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:07.416956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:07.416983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.417023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.417035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:07.417068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.417104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:07.417224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:07.417693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:07.418957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:07.418983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:07.419046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:07.419406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 494 partition: 0 MaxSeqNo: 46 sessionId: src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0
2025-10-15T10:58:07.423609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|528d9c78-854a1e-eabf8604-514c9a91_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:07.463148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0] Write session: try to update token
2025-10-15T10:58:07.463200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:07.487323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:07.490876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:07.490914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:07.490923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:07.490950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401111627288525:5905]
2025-10-15T10:58:07.490967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401111627288525:5905]
2025-10-15T10:58:07.490982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401111627288525:5905]
2025-10-15T10:58:07.491098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:07.491114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:07.491253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:07.491291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:07.491322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:07.492518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:07.607449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId: src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:07.642695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:07.646364Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:07.648425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:07.648466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:07.652288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:07.652318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:07.653257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:07.653406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401108827594968:6486]
2025-10-15T10:58:07.669110Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:07.687028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 494 reason: error at write: Disconnected sessionId: src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0
2025-10-15T10:58:07.687302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 494 sessionId: src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0 is DEAD
2025-10-15T10:58:07.691762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:07.691843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0] Write session will restart in 0.008550s
2025-10-15T10:58:07.691972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0] Write session: Do CDS request
2025-10-15T10:58:07.692020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:07.705601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:07.705382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:07.705416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 495
2025-10-15T10:58:07.706173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:07.706300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:07.706314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:07.706323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:07.708671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:07.707723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 495 sessionId:  describe result for acl check
2025-10-15T10:58:07.707817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:07.707827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:07.707835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:07.707849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401108827595028:6496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:07.710238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401108827595028:6496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:07.713145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:07.713944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:07.713974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:07.714018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:07.714255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:07.714442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401111627288616:5908]
2025-10-15T10:58:07.716531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:07.716527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401108827595028:6496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:07.718321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:07.718533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:07.719658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:07.719963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:07.719980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:07.719986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:07.719993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:07.720000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:07.720007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:07.720013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:07.720018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:07.720024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:07.720030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:07.720037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:07.720043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.720049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.720055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.720098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:07.720208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:07.720251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:07.720295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:07.720337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:07.720388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:07.720428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:07.720471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:07.720525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:07.720566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:07.720607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:07.720648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.720689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.720730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.720766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:07.720826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:07.720877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:07.720926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:07.720970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:07.721041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:07.721088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:07.721138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:07.721188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:07.721244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:07.721288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:07.721343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:07.721613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:07.721698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:07.721759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:07.721814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:07.721867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:07.721920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:07.721969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:07.722039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:07.722087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:07.722140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:07.722187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.722238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.722290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.722342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.722389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.722437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.722912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:07.725249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401108827595028:6496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:07.725288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401108827595028:6496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:07.725303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401108827595028:6496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:07.725330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:07.741898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:07.753075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:07.753120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:07.753136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:07.753154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:07.753175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 494 [2:7561401111627288616:5908]
2025-10-15T10:58:07.753222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:07.753273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:07.753287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.753298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.753309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.753352Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:07.753372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:07.753390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:07.753613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401108827595063:6486]
2025-10-15T10:58:07.764973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.765008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.765015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.765025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:07.765256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:07.765277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:07.765387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:07.765534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:07.765713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:07.765772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401111627288611:5908]
2025-10-15T10:58:07.765792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401111627288611:5908]
2025-10-15T10:58:07.765802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401111627288611:5908]
2025-10-15T10:58:07.765834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:07.765893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:07.766045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:07.766066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:07.766168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401111627288611:5908]
2025-10-15T10:58:07.766190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:07.766421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:07.766440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:07.766451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:07.766472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:07.767156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401108827594991:2467], now have 1 active actors on pipe
2025-10-15T10:58:07.767202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401108827595062:6496], now have 1 active actors on pipe
2025-10-15T10:58:07.767223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401108827595063:6486], now have 1 active actors on pipe
2025-10-15T10:58:07.767745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 494
2025-10-15T10:58:07.767840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 494
2025-10-15T10:58:07.767889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 494, pipe: [1:7561401108827595063:6486]
2025-10-15T10:58:07.768201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:07.768231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:07.768300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:07.768338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.768356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.768366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:07.768399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.768437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:07.768486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:07.769082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:07.769107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:07.769162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:07.769554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 495 partition: 0 MaxSeqNo: 46 sessionId: src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0
2025-10-15T10:58:07.770183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dafe48b9-81e1c91-905a9c4-339f1d59_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:07.807954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0] Write session: try to update token
2025-10-15T10:58:07.808010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:07.861475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:07.861510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:07.861522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:07.861627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:07.861642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:07.861656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:07.861667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:07.861732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401111627288611:5908]
2025-10-15T10:58:07.861775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401111627288611:5908]
2025-10-15T10:58:07.861824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401111627288611:5908]
2025-10-15T10:58:07.861980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:07.862094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:07.862132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:07.876949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:07.877011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:07.878064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:07.941373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId: src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:07.962896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:08.044093Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:08.045714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:08.045733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:08.045775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401111627288611:5908]
2025-10-15T10:58:08.045916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:08.045942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:08.046230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:08.046780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:08.046914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:08.046931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:08.048708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401108827595063:6486]
2025-10-15T10:58:08.048393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:08.089222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 495 reason: error at write: Disconnected sessionId: src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0
2025-10-15T10:58:08.089532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 495 sessionId: src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0 is DEAD
2025-10-15T10:58:08.090185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:08.090297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0] Write session will restart in 0.009915s
2025-10-15T10:58:08.090515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0] Write session: Do CDS request
2025-10-15T10:58:08.090582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:08.113609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:08.113224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:08.113255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 496
2025-10-15T10:58:08.114171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:08.114302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:08.114318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:08.114328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:08.115629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 496 sessionId:  describe result for acl check
2025-10-15T10:58:08.115744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:08.115761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:08.115770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:08.115786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401113122562414:6500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:08.118309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401113122562414:6500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:08.120475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:08.126978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401113122562414:6500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:08.126326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:08.127734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:08.127752Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:08.127797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:08.128065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:08.128239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401115922255989:5910]
2025-10-15T10:58:08.130458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:08.132161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:08.132405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:08.133945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:08.134309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:08.134317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:08.134324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:08.134332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:08.134338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:08.134346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:08.134352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:08.134361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:08.134367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:08.134374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:08.134381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:08.134405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.134411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.134418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.134466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:08.134572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:08.134622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:08.134668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:08.134713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:08.134761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:08.134802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:08.134845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:08.134888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:08.134934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:08.134982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:08.135027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.135074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.135119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.135165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:08.135229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:08.135284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:08.135340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:08.135409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:08.135460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:08.135503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:08.135556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:08.135607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:08.135663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:08.135707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:08.135757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:08.135805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:08.135858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:08.135902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:08.135952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:08.135997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:08.136052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:08.136097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:08.136152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:08.136201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:08.136253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:08.136302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.136355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.136403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.136454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.136498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.136556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.137071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:08.139797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401113122562414:6500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:08.139836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401113122562414:6500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:08.139853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401113122562414:6500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:08.139883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:08.148921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401113122562450:6486]
2025-10-15T10:58:08.158966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:08.169529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:08.169576Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:08.169591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:08.169609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:08.169631Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 495 [2:7561401115922255989:5910]
2025-10-15T10:58:08.169678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:08.169733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:08.169746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:08.169758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:08.169770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:08.169814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:08.169833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:08.169853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:08.172744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 495
2025-10-15T10:58:08.172846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 495
2025-10-15T10:58:08.172923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 495, pipe: [1:7561401113122562450:6486]
2025-10-15T10:58:08.171991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.172019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.172034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.172044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:08.172309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:08.172325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.172453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.172621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.172841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:08.172929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401113122562449:6500], now have 1 active actors on pipe
2025-10-15T10:58:08.172953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401113122562376:2467], now have 1 active actors on pipe
2025-10-15T10:58:08.172975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401113122562450:6486], now have 1 active actors on pipe
2025-10-15T10:58:08.172996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401115922255984:5910]
2025-10-15T10:58:08.173029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401115922255984:5910]
2025-10-15T10:58:08.173041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401115922255984:5910]
2025-10-15T10:58:08.173081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:08.173149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:08.173247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:08.173260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:08.173270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:08.173769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:08.173797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:08.173939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:08.173960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:08.174007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401115922255984:5910]
2025-10-15T10:58:08.174029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:08.174112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:08.174126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a917b8f3-b4c1781e-999055ec-74187091_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:08.174154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:08.174169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:08.174179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:08.174212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:08.174266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:08.174364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:08.175975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:08.176007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:08.176071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:08.176694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 496 partition: 0 MaxSeqNo: 46 sessionId: src_id|a917b8f3-b4c1781e-999055ec-74187091_0
2025-10-15T10:58:08.177396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cffb0ffe-b4b69c71-87d4492c-285f006_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a917b8f3-b4c1781e-999055ec-74187091_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:08.207703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a917b8f3-b4c1781e-999055ec-74187091_0] Write session: try to update token
2025-10-15T10:58:08.207766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a917b8f3-b4c1781e-999055ec-74187091_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:08.265265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:08.265298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:08.265317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:08.265331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:08.265361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401115922255984:5910]
2025-10-15T10:58:08.265383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401115922255984:5910]
2025-10-15T10:58:08.265404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401115922255984:5910]
2025-10-15T10:58:08.265567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:08.265612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:08.265654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:08.326786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:08.326832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:08.328901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:08.357645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId: src_id|a917b8f3-b4c1781e-999055ec-74187091_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:08.379468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:08.475467Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:08.478086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:08.478103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:08.478142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401115922255984:5910]
2025-10-15T10:58:08.478559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:08.478743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:08.478774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:08.480044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:08.483590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:08.483873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401113122562450:6486]
2025-10-15T10:58:08.484021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:08.484048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:08.498002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 496 reason: error at write: Disconnected sessionId: src_id|a917b8f3-b4c1781e-999055ec-74187091_0
2025-10-15T10:58:08.498307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 496 sessionId: src_id|a917b8f3-b4c1781e-999055ec-74187091_0 is DEAD
2025-10-15T10:58:08.500081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a917b8f3-b4c1781e-999055ec-74187091_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:08.500113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a917b8f3-b4c1781e-999055ec-74187091_0] Write session will restart in 0.007244s
2025-10-15T10:58:08.500227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a917b8f3-b4c1781e-999055ec-74187091_0] Write session: Do CDS request
2025-10-15T10:58:08.500264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a917b8f3-b4c1781e-999055ec-74187091_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:08.514939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a917b8f3-b4c1781e-999055ec-74187091_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:08.525359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:08.525393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 497
2025-10-15T10:58:08.527783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:08.527876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:08.527891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:08.527899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:08.529094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 497 sessionId:  describe result for acl check
2025-10-15T10:58:08.529157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:08.529165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:08.529170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:08.529180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401113122562492:6512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:08.530981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401113122562492:6512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:08.543583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401113122562492:6512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:08.553498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401113122562492:6512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:08.553536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401113122562492:6512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:08.553553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401113122562492:6512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:08.553578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:08.570325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:08.573274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:08.574064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:08.574080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:08.574120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:08.574358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:08.574552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401115922256080:5919]
2025-10-15T10:58:08.576721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:08.577967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:08.578181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:08.579401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:08.579720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:08.579728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:08.579736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:08.579743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:08.579750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:08.579765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:08.579772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:08.579779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:08.579787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:08.579793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:08.579799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:08.579806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.579812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.579818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.579863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:08.579969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:08.580016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:08.580060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:08.580106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:08.580150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:08.580194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:08.580239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:08.580283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:08.580329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:08.580372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:08.580417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.580462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.580504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.580543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:08.580607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:08.580662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:08.580715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:08.580762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:08.580815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:08.580860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:08.580915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:08.580962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:08.581029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:08.581074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:08.581126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:08.581174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:08.581226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:08.581272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:08.581321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:08.581368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:08.581424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:08.581468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:08.581522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:08.581568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:08.581630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:08.581677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.581728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.581774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.581830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.581873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.581924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.582410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:08.584338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401113122562560:6486]
2025-10-15T10:58:08.619078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:08.634240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:08.634282Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:08.634296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:08.634316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:08.634339Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 496 [2:7561401115922256080:5919]
2025-10-15T10:58:08.634383Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:08.634429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:08.634441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:08.634451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:08.634459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:08.634502Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:08.634521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:08.634539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:08.637353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.637389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.637402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.637413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:08.637694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:08.637723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:08.637867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:08.638068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:08.638299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:08.638393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401113122562530:6512], now have 1 active actors on pipe
2025-10-15T10:58:08.638425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401113122562560:6486], now have 1 active actors on pipe
2025-10-15T10:58:08.638448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401113122562474:2467], now have 1 active actors on pipe
2025-10-15T10:58:08.638483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401115922256075:5919]
2025-10-15T10:58:08.638500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401115922256075:5919]
2025-10-15T10:58:08.638512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401115922256075:5919]
2025-10-15T10:58:08.638550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:08.638186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 496
2025-10-15T10:58:08.638278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 496, pipe: [1:7561401113122562560:6486]
2025-10-15T10:58:08.638370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 496
2025-10-15T10:58:08.638627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:08.638822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:08.638845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:08.638970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401115922256075:5919]
2025-10-15T10:58:08.638997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:08.639446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:08.639471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:08.639483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:08.639508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:08.639654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:08.639698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:08.639782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:08.639812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:08.639827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:08.639839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:08.639868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:08.639906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:08.639948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:08.640772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:08.640793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:08.640861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:08.641179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 497 partition: 0 MaxSeqNo: 46 sessionId: src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0
2025-10-15T10:58:08.643559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a917b8f3-b4c1781e-999055ec-74187091_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:08.687775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0] Write session: try to update token
2025-10-15T10:58:08.687827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0] Send 10 message(s) (0 left), first sequence number is 47
E1015 10:58:08.693152124  821070 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:58:08.695695Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:58:08.771708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:08.771741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:08.771754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:08.771765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:08.771796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401115922256075:5919]
2025-10-15T10:58:08.771820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401115922256075:5919]
2025-10-15T10:58:08.771841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401115922256075:5919]
2025-10-15T10:58:08.771990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:08.772002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:08.772012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:08.772106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:08.772127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:08.773856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:08.775784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:08.775826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:08.775853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:08.823302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId: src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:08.845268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:08.928009Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:08.958080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:08.958131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:08.958202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:08.958214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:08.958253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401115922256075:5919]
2025-10-15T10:58:08.958534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:08.958795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:08.959069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:08.959070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401113122562560:6486]
2025-10-15T10:58:08.959094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:08.959147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:08.968119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 497 reason: error at write: Disconnected sessionId: src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0
2025-10-15T10:58:08.968389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 497 sessionId: src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0 is DEAD
2025-10-15T10:58:08.968791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:08.968846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0] Write session will restart in 0.006596s
2025-10-15T10:58:08.968995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0] Write session: Do CDS request
2025-10-15T10:58:08.969053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:08.979399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:08.979772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:08.979801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 498
2025-10-15T10:58:08.980063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:08.980200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:08.980216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:08.980225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:08.981548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 498 sessionId:  describe result for acl check
2025-10-15T10:58:08.981647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:08.981664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:08.981674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:08.981696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401113122562605:6519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:08.984718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401113122562605:6519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:08.991755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401113122562605:6519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:09.000275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:09.003236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:09.003530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401113122562605:6519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:09.003570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401113122562605:6519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:09.003586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401113122562605:6519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:09.003613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:09.004031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:09.004062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:09.004109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:09.004348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:09.004531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401120217223490:5929]
2025-10-15T10:58:09.006545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:09.007440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:09.007656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:09.008577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:09.008822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.008834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.008839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.008844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.008849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.008853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.008857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.008861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.008866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.008871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.008875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.008881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.008887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.008894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.008933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.009025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.009060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.009092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.009124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.009166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.009197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.009228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.009275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.009315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.009351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.009391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.009438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.009471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.009499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.009560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.009605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.009660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.009716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.009766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.009818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.009873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.009924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.009975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.010024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.010083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.010132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.010187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.010235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.010286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.010336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.010392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.010440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.010492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.010541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.010594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.010641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.010696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.010744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.010809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.010856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.010911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.011323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:09.026365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:09.035951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:09.035994Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:09.036011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:09.036030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:09.036055Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 497 [2:7561401120217223490:5929]
2025-10-15T10:58:09.036106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:09.036164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:09.036179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:09.036191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:09.036202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:09.036282Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:09.036304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:09.036324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:09.048565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.048605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.048621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.048634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:09.048953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:09.048986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.049155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.049290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 497
2025-10-15T10:58:09.049368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.049330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 497
2025-10-15T10:58:09.049608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:09.049703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401117417529953:6519], now have 1 active actors on pipe
2025-10-15T10:58:09.049739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401113122562587:2467], now have 1 active actors on pipe
2025-10-15T10:58:09.049766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401115922256189:5929]
2025-10-15T10:58:09.049783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401115922256189:5929]
2025-10-15T10:58:09.049797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401115922256189:5929]
2025-10-15T10:58:09.049836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:09.049860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:09.049873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:09.049884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:09.049917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:09.050110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:09.050128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:09.050206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:09.050227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:09.050358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401115922256189:5929]
2025-10-15T10:58:09.050388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:09.050405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:09.050469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:09.050503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:09.050522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:09.050532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:09.050575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:09.050621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:09.050760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:09.051282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:09.051311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:09.051411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:09.052546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 498 partition: 0 MaxSeqNo: 46 sessionId: src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0
2025-10-15T10:58:09.053364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|441ca6e1-f50218b4-af1818f7-dbddab94_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:09.058714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401117417529964:6486]
2025-10-15T10:58:09.059610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401117417529964:6486], now have 1 active actors on pipe
2025-10-15T10:58:09.059735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 497, pipe: [1:7561401117417529964:6486]
2025-10-15T10:58:09.074836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0] Write session: try to update token
2025-10-15T10:58:09.074892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:09.080627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:09.080664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:09.080699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401115922256189:5929]
2025-10-15T10:58:09.080824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:09.080885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:09.083194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:09.084657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:09.086063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:09.088517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:09.090514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:09.091077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:09.167897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:09.167935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:09.167946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:09.167955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:09.167989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401115922256189:5929]
2025-10-15T10:58:09.168012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401115922256189:5929]
2025-10-15T10:58:09.168032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401115922256189:5929]
2025-10-15T10:58:09.168178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:09.168196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:09.168207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:09.168211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:09.168244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:09.168260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:09.168262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:09.168292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:09.169338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:09.171987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId: src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:09.194432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:09.334931Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:09.336584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:09.336629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:09.337614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401117417529964:6486]
2025-10-15T10:58:09.337670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:09.337686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:09.337703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:09.337366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:09.347274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 498 reason: error at write: Disconnected sessionId: src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0
2025-10-15T10:58:09.347679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 498 sessionId: src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0 is DEAD
2025-10-15T10:58:09.352879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:09.352920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0] Write session will restart in 0.009646s
2025-10-15T10:58:09.353042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0] Write session: Do CDS request
2025-10-15T10:58:09.353075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:09.386544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:09.386578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 499
2025-10-15T10:58:09.386995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:09.387535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:09.387663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:09.387680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:09.387689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:09.390092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 499 sessionId:  describe result for acl check
2025-10-15T10:58:09.390270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:09.390299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:09.390319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:09.390349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401117417529991:6526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:09.400475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401117417529991:6526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:09.418100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401117417529991:6526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:09.431770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401117417529991:6526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:09.431816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401117417529991:6526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:09.431834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401117417529991:6526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:09.431866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:09.433367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:09.438507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401117417530060:6486]
2025-10-15T10:58:09.443159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:09.444130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:09.444165Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:09.444218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:09.444505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:09.444711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401120217223571:5932]
2025-10-15T10:58:09.447601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:09.451675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:09.451949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:09.452966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:09.453335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.453345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.453353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.453361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.453369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.453375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.453382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.453390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.453397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.453404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.453411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.453418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.453424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.453431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.453482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.453605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.453659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.453715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.453771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.453823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.453876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.453928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.453976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.454026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.454079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.454130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.454179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.454228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.454283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.454361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.454434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.454500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.454553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.454612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.454659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.454716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.454778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.454835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.454884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.454945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.454996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.455057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.455105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.455163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.455216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.455276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.455326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.463499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.463611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.463678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.463747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.463805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.463859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.463919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.463976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.464033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.464601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:09.483806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:09.491422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:09.491476Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:09.491492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:09.491507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:09.491531Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 498 [2:7561401120217223571:5932]
2025-10-15T10:58:09.491586Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:09.491641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:09.491653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:09.491663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:09.491673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:09.491719Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:09.491744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:09.491768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:09.493045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.493071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.493087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.493099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:09.493380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:09.493417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.493758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 498
2025-10-15T10:58:09.493843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 498, pipe: [1:7561401117417530060:6486]
2025-10-15T10:58:09.493918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 498
2025-10-15T10:58:09.493570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.493772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.494005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:09.494099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401117417530055:6526], now have 1 active actors on pipe
2025-10-15T10:58:09.494122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401117417530060:6486], now have 1 active actors on pipe
2025-10-15T10:58:09.494143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401117417529973:2467], now have 1 active actors on pipe
2025-10-15T10:58:09.494169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401120217223563:5932]
2025-10-15T10:58:09.494184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401120217223563:5932]
2025-10-15T10:58:09.494197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401120217223563:5932]
2025-10-15T10:58:09.494229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:09.494254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:09.494264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:09.494272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:09.494305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:09.494493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:09.494520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:09.494595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:09.494620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:09.494729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401120217223563:5932]
2025-10-15T10:58:09.494764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:09.494772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:09.494844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:09.494882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:09.494906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:09.494917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:09.494958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:09.495003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:09.495122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:09.495747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:09.495777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:09.495844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:09.496375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 499 partition: 0 MaxSeqNo: 46 sessionId: src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0
2025-10-15T10:58:09.499492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 446 BytesWritten: 103628882 MessagesWritten: 46 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-15T10:58:09.499634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7eefbf25-eb4f6150-e38a7641-5081ace5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:09.527776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0] Write session: try to update token
2025-10-15T10:58:09.527840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:09.554615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:09.554649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:09.554701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401120217223563:5932]
2025-10-15T10:58:09.554839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:09.554851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:09.559811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:09.561485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:09.562841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:09.564153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:09.566245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:09.566721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:09.638471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:09.638501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:09.638511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:09.638569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:09.638581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:09.638594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:09.638603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:09.638639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401120217223563:5932]
2025-10-15T10:58:09.638670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401120217223563:5932]
2025-10-15T10:58:09.638696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401120217223563:5932]
2025-10-15T10:58:09.638801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:09.638825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:09.639235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:09.639298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:09.639365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:09.643412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:09.657666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId: src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:09.676562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:09.789128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:09.790820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:09.790867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:09.791774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:09.792864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:09.795598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:09.795825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401117417530060:6486]
2025-10-15T10:58:09.816020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 499 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0
2025-10-15T10:58:09.816356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 499 sessionId: src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0 is DEAD
2025-10-15T10:58:09.816774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:09.816843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0] Write session will restart in 0.006657s
2025-10-15T10:58:09.816999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0] Write session: Do CDS request
2025-10-15T10:58:09.817066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:09.828948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:09.837323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:09.837359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 500
2025-10-15T10:58:09.837775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:09.837917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:09.837938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:09.837950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:09.839283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 500 sessionId:  describe result for acl check
2025-10-15T10:58:09.839402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:09.839418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:09.839426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:09.839443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401117417530135:6538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:09.842012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401117417530135:6538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:09.842231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:09.848681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401117417530135:6538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:09.850807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:09.851762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:09.851793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:09.851840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:09.852098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:09.852280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401120217223675:5941]
2025-10-15T10:58:09.854431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:09.855910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:09.856135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:09.857611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:09.857990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.858015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.858027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.858035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.858042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.858049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.858056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.858063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.858070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.858078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.858084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.858091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.858098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.858104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.858151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.858254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.858305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.858352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.858410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.858458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.858504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.858551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.858594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.858637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.858684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.858733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.858782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.858827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.858871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.858936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:09.858992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.859045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:09.859091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.859152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:09.859199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.859253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:09.859300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.860762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401117417530135:6538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:09.860805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401117417530135:6538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:09.860823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401117417530135:6538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:09.860852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:09.860306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:09.860372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.860431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:09.860477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.860530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:09.860573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.860670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:09.860718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.860770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:09.860815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.860867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:09.860935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.860989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:09.861046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.861098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.861145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.861195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.861240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.861289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.861805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:09.892821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:09.896305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401117417530179:6486]
2025-10-15T10:58:09.904058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:09.904105Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:09.904121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:09.904139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:09.904162Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 499 [2:7561401120217223675:5941]
2025-10-15T10:58:09.904209Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:09.904264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:09.904278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:09.904289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:09.904299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:09.904349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:09.904372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:09.904409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:09.906447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.906486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.906499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.906510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:09.906793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:09.906818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:09.906957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:09.907142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:09.907789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 499, pipe: [1:7561401117417530179:6486]
2025-10-15T10:58:09.907896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 499
2025-10-15T10:58:09.907970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 499
2025-10-15T10:58:09.907500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:09.907604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401117417530179:6486], now have 1 active actors on pipe
2025-10-15T10:58:09.907627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401117417530092:2467], now have 1 active actors on pipe
2025-10-15T10:58:09.907649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401117417530175:6538], now have 1 active actors on pipe
2025-10-15T10:58:09.907672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401120217223669:5941]
2025-10-15T10:58:09.907686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401120217223669:5941]
2025-10-15T10:58:09.907699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401120217223669:5941]
2025-10-15T10:58:09.907747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:09.907803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:09.907821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:09.907826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:09.907833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:09.907996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:09.908012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:09.908130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401120217223669:5941]
2025-10-15T10:58:09.908163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:09.908221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:09.908301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:09.908319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:09.908408Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8969b391-ce7af079-e875adaa-e4552f89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:09.908445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:09.908463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:09.908475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:09.908511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:09.908551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:09.908592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:09.910021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:09.910059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:09.910121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:09.910454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 500 partition: 0 MaxSeqNo: 46 sessionId: src_id|8969b391-ce7af079-e875adaa-e4552f89_0
2025-10-15T10:58:09.911279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfdbe82-39c45088-7e466957-28a8bc0f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8969b391-ce7af079-e875adaa-e4552f89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:09.959191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8969b391-ce7af079-e875adaa-e4552f89_0] Write session: try to update token
2025-10-15T10:58:09.959248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8969b391-ce7af079-e875adaa-e4552f89_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:10.006038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:10.006077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:10.006089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:10.006098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:10.006130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401120217223669:5941]
2025-10-15T10:58:10.006154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401120217223669:5941]
2025-10-15T10:58:10.006176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401120217223669:5941]
2025-10-15T10:58:10.006306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:10.006351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:10.006378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:10.006407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:10.006427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:10.006438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:10.006487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:10.006512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:10.012704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:10.072962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId: src_id|8969b391-ce7af079-e875adaa-e4552f89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:10.094499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:10.170763Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:10.187773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:10.187827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:10.187900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:10.187914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:10.187954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401120217223669:5941]
2025-10-15T10:58:10.188212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:10.188572Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:10.188564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401117417530179:6486]
2025-10-15T10:58:10.188657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:10.188808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:10.188828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:10.198908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 500 reason: error at write: Disconnected sessionId: src_id|8969b391-ce7af079-e875adaa-e4552f89_0
2025-10-15T10:58:10.199302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 500 sessionId: src_id|8969b391-ce7af079-e875adaa-e4552f89_0 is DEAD
2025-10-15T10:58:10.199939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8969b391-ce7af079-e875adaa-e4552f89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:10.200007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8969b391-ce7af079-e875adaa-e4552f89_0] Write session will restart in 0.008821s
2025-10-15T10:58:10.200186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8969b391-ce7af079-e875adaa-e4552f89_0] Write session: Do CDS request
2025-10-15T10:58:10.200242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8969b391-ce7af079-e875adaa-e4552f89_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:10.213661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8969b391-ce7af079-e875adaa-e4552f89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:10.225906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:10.225937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 501
2025-10-15T10:58:10.226424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:10.226549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:10.226569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:10.226579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:10.227820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 501 sessionId:  describe result for acl check
2025-10-15T10:58:10.227962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:10.227973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:10.227982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:10.228000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401121712497532:6546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:10.230302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401121712497532:6546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:10.233376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:10.237266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:10.235877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401121712497532:6546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:10.238104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:10.238133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:10.238169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:10.238412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:10.238594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401124512191070:5949]
2025-10-15T10:58:10.240807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:10.241905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:10.242146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:10.243221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:10.243439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401121712497532:6546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:10.243482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401121712497532:6546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:10.243500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401121712497532:6546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:10.243532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:10.243595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:10.243614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:10.243622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:10.243630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:10.243637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:10.243645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:10.243653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:10.243661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:10.243668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:10.243675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:10.243682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:10.243691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.243697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.243704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.243758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:10.243847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:10.243885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:10.243919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:10.243972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:10.244009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:10.244047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:10.244094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:10.244136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:10.244194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:10.244243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:10.244281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.244320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.244357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.244389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:10.244443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:10.244501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:10.244559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:10.244607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:10.244658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:10.244694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:10.244756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:10.244795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:10.244836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:10.244872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:10.244910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:10.244945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:10.244997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:10.245050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:10.245100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:10.245152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:10.245196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:10.245248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:10.245293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:10.245328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:10.245375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:10.245426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.245482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.245533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.245591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.245644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.245705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.246218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:10.265290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:10.275659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:10.275710Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:10.275726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:10.275748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:10.275774Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 500 [2:7561401124512191070:5949]
2025-10-15T10:58:10.275827Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:10.275891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:10.275907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:10.275920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:10.275932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:10.275990Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:10.276017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:10.276043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:10.284941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.284975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.284990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.285001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:10.285262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:10.285286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.285404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.285589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.285642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 500
2025-10-15T10:58:10.285742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 500
2025-10-15T10:58:10.285775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:10.285861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401121712497562:6546], now have 1 active actors on pipe
2025-10-15T10:58:10.285892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401121712497492:2467], now have 1 active actors on pipe
2025-10-15T10:58:10.285924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401124512191064:5949]
2025-10-15T10:58:10.285944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401124512191064:5949]
2025-10-15T10:58:10.285956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401124512191064:5949]
2025-10-15T10:58:10.285994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:10.286024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:10.286048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:10.286061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:10.286079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:10.286264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:10.286293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:10.286352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:10.286374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:10.286525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401124512191064:5949]
2025-10-15T10:58:10.286563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:10.286585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:10.286638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:10.286672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:10.286700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:10.286712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:10.286750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:10.286815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:10.286955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:10.287676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:10.287720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:10.287788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:10.288064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 501 partition: 0 MaxSeqNo: 46 sessionId: src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0
2025-10-15T10:58:10.288945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401121712497570:6486]
2025-10-15T10:58:10.289615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 500, pipe: [1:7561401121712497570:6486]
2025-10-15T10:58:10.289695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401121712497570:6486], now have 1 active actors on pipe
2025-10-15T10:58:10.291898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8969b391-ce7af079-e875adaa-e4552f89_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:10.334549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0] Write session: try to update token
2025-10-15T10:58:10.334620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:10.344990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:10.345052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:10.345094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401124512191064:5949]
2025-10-15T10:58:10.345255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:10.345978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:10.364329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:10.372344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:10.380769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:10.382569Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 5 CurrentSessionLifetimeMs: 241674 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:58:10.384265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:10.395914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:10.396289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:10.396303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:10.396316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:10.396375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:10.483970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId: src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:10.488213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:10.488246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:10.488258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:10.488266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:10.488299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401124512191064:5949]
2025-10-15T10:58:10.488327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401124512191064:5949]
2025-10-15T10:58:10.488343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401124512191064:5949]
2025-10-15T10:58:10.488470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:10.488491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:10.488802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:10.488837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:10.488856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:10.489718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:10.506728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:10.631956Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:10.633417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:10.633448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:10.634734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:10.634766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:10.635282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401121712497570:6486]
2025-10-15T10:58:10.635431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:10.634154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:10.644592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:10.644634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0] Write session will restart in 0.009121s
2025-10-15T10:58:10.643856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 501 reason: error at write: Disconnected sessionId: src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0
2025-10-15T10:58:10.644740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0] Write session: Do CDS request
2025-10-15T10:58:10.644167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 501 sessionId: src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0 is DEAD
2025-10-15T10:58:10.644799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:10.659018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:10.659517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:10.659546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 502
2025-10-15T10:58:10.660804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:10.660901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:10.660911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:10.660920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:10.663263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 502 sessionId:  describe result for acl check
2025-10-15T10:58:10.663329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:10.663336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:10.663342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:10.663368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401121712497611:6555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:10.665655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401121712497611:6555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:10.676035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401121712497611:6555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:10.696164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401121712497611:6555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:10.696211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401121712497611:6555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:10.696228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401121712497611:6555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:10.696265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:10.702978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:10.707169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:10.708094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:10.708124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:10.708172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:10.708439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:10.708625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401124512191172:5954]
2025-10-15T10:58:10.710883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:10.712027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:10.712255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:10.713417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:10.713778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:10.713799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:10.713810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:10.713817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:10.713824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:10.713832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:10.713840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:10.713847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:10.713854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:10.713868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:10.713876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:10.713883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.713891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.713899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.713948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:10.714074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:10.714127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:10.714177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:10.714225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:10.714278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:10.714329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:10.714382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:10.714449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:10.714501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:10.714553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:10.714601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.714651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.714700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.714752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:10.714824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:10.714887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:10.714947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:10.715000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:10.715045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:10.715079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:10.715118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:10.715167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:10.715217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:10.715267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:10.715318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:10.715462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:10.715522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:10.715568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:10.715623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:10.715673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:10.715726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:10.715773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:10.715828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:10.715877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:10.715934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:10.715983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.716040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.716087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.716157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.716204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.716261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.716787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:10.734356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:10.735580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401121712497681:6486]
2025-10-15T10:58:10.745327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:10.745381Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:10.745401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:10.745423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:10.745447Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 501 [2:7561401124512191172:5954]
2025-10-15T10:58:10.745503Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:10.745564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:10.745578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:10.745592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:10.745604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:10.745655Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:10.745679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:10.745702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:10.746691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.746722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.746738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.746751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:10.747528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 501
2025-10-15T10:58:10.747633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 501, pipe: [1:7561401121712497681:6486]
2025-10-15T10:58:10.747027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:10.747053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:10.747205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:10.748300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:10.748550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:10.748646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401121712497603:2467], now have 1 active actors on pipe
2025-10-15T10:58:10.748679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401121712497681:6486], now have 1 active actors on pipe
2025-10-15T10:58:10.748718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401121712497672:6555], now have 1 active actors on pipe
2025-10-15T10:58:10.748783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:10.748805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:10.748844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401124512191167:5954]
2025-10-15T10:58:10.748859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401124512191167:5954]
2025-10-15T10:58:10.748873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401124512191167:5954]
2025-10-15T10:58:10.748912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:10.748941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:10.748954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:10.748968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:10.748991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:10.749197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:10.749217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:10.749292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:10.749323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:10.749343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:10.749353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:10.749390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:10.749435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:10.749565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401124512191167:5954]
2025-10-15T10:58:10.749594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:10.749639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:10.749828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:10.750771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:10.750804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:10.750871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:10.747712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 501
2025-10-15T10:58:10.751198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 502 partition: 0 MaxSeqNo: 46 sessionId: src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0
2025-10-15T10:58:10.752171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0f00219-131746a4-b35e0e09-e69b40aa_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:10.773292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0] Write session: try to update token
2025-10-15T10:58:10.773348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:10.841735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:10.841775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:10.841789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:10.841799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:10.841844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401124512191167:5954]
2025-10-15T10:58:10.841871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401124512191167:5954]
2025-10-15T10:58:10.841894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401124512191167:5954]
2025-10-15T10:58:10.842038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:10.842066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:10.842073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:10.842092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:10.842109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:10.843033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:10.859533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId: src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:10.892096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:10.989796Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:10.991270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:10.991300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:10.992832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:10.993126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401121712497681:6486]
2025-10-15T10:58:10.993207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:10.993217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:10.995551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:11.016800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 502 reason: error at write: Disconnected sessionId: src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0
2025-10-15T10:58:11.017116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 502 sessionId: src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0 is DEAD
2025-10-15T10:58:11.019713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:11.019773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0] Write session will restart in 0.006027s
2025-10-15T10:58:11.019886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0] Write session: Do CDS request
2025-10-15T10:58:11.019909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:11.036977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:11.038692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:11.038729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 503
2025-10-15T10:58:11.039001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:11.039106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:11.039128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:11.039136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:11.040396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 503 sessionId:  describe result for acl check
2025-10-15T10:58:11.040500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:11.040516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:11.040525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:11.040541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401126007465036:6559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:11.042844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401126007465036:6559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:11.045374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:11.047510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:11.048196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:11.048210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:11.048251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:11.048481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:11.048644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401128807158550:5956]
2025-10-15T10:58:11.050668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:11.049689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401126007465036:6559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:11.055775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:11.055993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:11.057437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:11.057764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.057772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.057778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.057786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.057793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.057799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.057806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.057813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.057819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.057825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.057832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.057838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.057844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.057852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.057898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.057996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.058041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.058084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.058126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.058171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.058213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.058257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.058299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.058343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.058384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.058433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.058477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.058517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.058555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.058613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.058665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.058715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.058760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.058810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.058851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.058897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.058939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.058990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.059031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.059079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.059122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.059171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.059212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.059259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.059303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.059372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.059414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.059464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.059507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.059559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.059599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.059650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.059696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.059743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.060271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401126007465036:6559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:11.059786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.059837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.060310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401126007465036:6559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:11.060292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:11.060326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401126007465036:6559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:11.060354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:11.082926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:11.095502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401126007465070:6486]
2025-10-15T10:58:11.093830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:11.093875Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:11.093891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:11.093909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:11.093933Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 502 [2:7561401128807158550:5956]
2025-10-15T10:58:11.093980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:11.094034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:11.094048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:11.094062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:11.094076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:11.094118Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:11.094138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:11.094156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:11.103263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.103294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.103306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.103317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:11.103610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:11.103628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.103764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.103935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.104148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:11.104225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401126007465070:6486], now have 1 active actors on pipe
2025-10-15T10:58:11.104247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401126007465066:6559], now have 1 active actors on pipe
2025-10-15T10:58:11.104267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401121712497695:2467], now have 1 active actors on pipe
2025-10-15T10:58:11.104290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401128807158545:5956]
2025-10-15T10:58:11.104304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401128807158545:5956]
2025-10-15T10:58:11.104316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401128807158545:5956]
2025-10-15T10:58:11.104357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:11.104392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:11.104407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:11.104418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:11.104427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:11.104583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:11.104599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:11.104705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401128807158545:5956]
2025-10-15T10:58:11.104736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:11.104773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:11.104599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 502, pipe: [1:7561401126007465070:6486]
2025-10-15T10:58:11.104713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 502
2025-10-15T10:58:11.104785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 502
2025-10-15T10:58:11.106797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:11.106842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:11.106940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94afa7e3-a279194b-45328263-c1a236ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:11.106971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:11.106988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:11.106998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:11.107033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:11.107085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:11.107134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:11.107676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:11.107694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:11.107750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:11.108988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99632d6-4242a0bd-cc5939ec-635092d6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|94afa7e3-a279194b-45328263-c1a236ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:11.108171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 503 partition: 0 MaxSeqNo: 46 sessionId: src_id|94afa7e3-a279194b-45328263-c1a236ec_0
2025-10-15T10:58:11.142230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94afa7e3-a279194b-45328263-c1a236ec_0] Write session: try to update token
2025-10-15T10:58:11.142288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94afa7e3-a279194b-45328263-c1a236ec_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:11.149184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:11.149218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:11.149250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401128807158545:5956]
2025-10-15T10:58:11.149354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:11.149648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:11.168064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:11.171050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:11.172268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:11.174321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:11.176417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:11.176906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:11.231538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:11.231577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:11.231588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:11.231642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:11.231655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:11.231668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:11.231678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:11.231718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401128807158545:5956]
2025-10-15T10:58:11.231745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401128807158545:5956]
2025-10-15T10:58:11.231768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401128807158545:5956]
2025-10-15T10:58:11.231904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:11.231924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:11.233017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:11.235531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:11.235595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:11.235627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:11.279447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId: src_id|94afa7e3-a279194b-45328263-c1a236ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:11.305608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:11.369390Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:11.371339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:11.371393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:11.372000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:11.372023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401126007465070:6486]
2025-10-15T10:58:11.372115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:11.372073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:11.372127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:11.397096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 503 reason: error at write: Disconnected sessionId: src_id|94afa7e3-a279194b-45328263-c1a236ec_0
2025-10-15T10:58:11.397980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94afa7e3-a279194b-45328263-c1a236ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:11.398058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94afa7e3-a279194b-45328263-c1a236ec_0] Write session will restart in 0.005481s
2025-10-15T10:58:11.397364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 503 sessionId: src_id|94afa7e3-a279194b-45328263-c1a236ec_0 is DEAD
2025-10-15T10:58:11.398255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94afa7e3-a279194b-45328263-c1a236ec_0] Write session: Do CDS request
2025-10-15T10:58:11.398321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94afa7e3-a279194b-45328263-c1a236ec_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:11.421700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94afa7e3-a279194b-45328263-c1a236ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:11.425165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:11.425201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 504
2025-10-15T10:58:11.429143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:11.429378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:11.429404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:11.429421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:11.435202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 504 sessionId:  describe result for acl check
2025-10-15T10:58:11.435329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:11.435340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:11.435368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:11.435385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401126007465138:6567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:11.437965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401126007465138:6567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:11.450782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:11.452976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401126007465138:6567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:11.455282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:11.456091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:11.456124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:11.456165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:11.456415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:11.456616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401128807158649:5965]
2025-10-15T10:58:11.458699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:11.459478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:11.459663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:11.460758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401126007465138:6567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:11.460794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401126007465138:6567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:11.460811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401126007465138:6567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:11.460837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:11.460858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:11.461204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.461212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.461219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.461225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.461232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.461240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.461247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.461254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.461262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.461268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.461275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.461281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.461290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.461296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.461344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.461444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.461493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.461540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.461585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.461633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.461678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.461723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.461766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.461813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.461859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.461902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.461947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.462010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.462052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.462115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.462167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.462220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.462267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.462317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.462362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.462414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.462462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.462515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.462557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.462609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.462654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.462705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.462749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.462802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.462847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.462898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.462943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.462997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.463041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.463094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.463138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.463191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.463234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.463287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.463331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.463479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.463972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:11.473166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401126007465178:6486]
2025-10-15T10:58:11.498534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:11.509206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:11.509247Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:11.509258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:11.509271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:11.509290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 503 [2:7561401128807158649:5965]
2025-10-15T10:58:11.509327Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:11.509373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:11.509385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:11.509395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:11.509416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:11.509455Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:11.509473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:11.509495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:11.519315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.519374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.519387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.519395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:11.519617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:11.519632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.519728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.519847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.519993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:11.520047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401126007465178:6486], now have 1 active actors on pipe
2025-10-15T10:58:11.520063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401126007465081:2467], now have 1 active actors on pipe
2025-10-15T10:58:11.520077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401126007465174:6567], now have 1 active actors on pipe
2025-10-15T10:58:11.520094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401128807158644:5965]
2025-10-15T10:58:11.520104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401128807158644:5965]
2025-10-15T10:58:11.520113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401128807158644:5965]
2025-10-15T10:58:11.520139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:11.520190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:11.520314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:11.520325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:11.520416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401128807158644:5965]
2025-10-15T10:58:11.520427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:11.520543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:11.520561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:11.520575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:11.520602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:11.529293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:11.529342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:11.529430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:11.529473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:11.529501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:11.529513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:11.529555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:11.529610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:11.529658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:11.527566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 503, pipe: [1:7561401126007465178:6486]
2025-10-15T10:58:11.527696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 503
2025-10-15T10:58:11.527781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 503
2025-10-15T10:58:11.535471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:11.535519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:11.535608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:11.539927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94afa7e3-a279194b-45328263-c1a236ec_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:11.538629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 504 partition: 0 MaxSeqNo: 46 sessionId: src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0
2025-10-15T10:58:11.571435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:11.571474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:11.571512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401128807158644:5965]
2025-10-15T10:58:11.571632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:11.572221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:11.584625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:11.585984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:11.587552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:11.590254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:11.591952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:11.600046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:11.611466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:11.611506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:11.611517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:11.614642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0] Write session: try to update token
2025-10-15T10:58:11.614696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:11.736319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:11.736356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:11.736369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:11.736380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:11.736418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401128807158644:5965]
2025-10-15T10:58:11.736444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401128807158644:5965]
2025-10-15T10:58:11.736465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401128807158644:5965]
2025-10-15T10:58:11.736600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:11.736640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:11.736649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:11.736653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:11.736664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:11.736688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:11.736709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:11.736731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:11.737761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:11.739811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId: src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:11.762929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:11.878619Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:11.880421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:11.880457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:11.881547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:11.881164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401126007465178:6486]
2025-10-15T10:58:11.881273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:11.881398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:11.881410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:11.890655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 504 reason: error at write: Disconnected sessionId: src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0
2025-10-15T10:58:11.891007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 504 sessionId: src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0 is DEAD
2025-10-15T10:58:11.896701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:11.896774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0] Write session will restart in 0.005124s
2025-10-15T10:58:11.896952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0] Write session: Do CDS request
2025-10-15T10:58:11.897012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:11.910746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:11.913926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:11.913976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 505
2025-10-15T10:58:11.915109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:11.915381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:11.915408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:11.915418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:11.916774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 505 sessionId:  describe result for acl check
2025-10-15T10:58:11.916888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:11.916905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:11.916915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:11.916932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401126007465230:6578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:11.920129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401126007465230:6578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:11.928760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401126007465230:6578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:11.943165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401126007465230:6578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:11.943211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401126007465230:6578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:11.943227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401126007465230:6578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:11.943258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:11.954103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:11.956292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:11.957031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:11.957052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:11.957095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:11.957269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:11.957428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401128807158772:5973]
2025-10-15T10:58:11.959297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:11.960412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:11.960606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:11.961694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:11.961989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.962005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.962012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.962018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.962024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.962030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.962036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.962043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.962049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.962054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.962058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.962062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.962067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.962071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.962100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.962190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.962233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.962275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.962314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.962353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.962413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.962457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.962493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.962530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.962572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.962614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.962656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.962699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.962745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.962813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:11.962871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.962931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:11.962974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.963027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:11.963072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.963122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:11.963166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.963200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:11.963237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.963271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:11.963318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.963388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:11.963434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.963478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:11.963528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.963570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:11.963600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.963638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:11.963671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.963709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:11.963755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.963796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.963837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.963886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.963931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.963978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.964435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:11.981655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401126007465298:6486]
2025-10-15T10:58:11.982872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:11.992202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:11.992261Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:11.992281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:11.992303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:11.992331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 504 [2:7561401128807158772:5973]
2025-10-15T10:58:11.992389Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:11.992453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:11.992468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:11.992483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:11.992497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:11.992547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:11.992578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:11.992603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:11.993635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.993666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.993679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.993692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:11.993998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:11.994027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:11.994182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:11.994401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:11.994445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 504
2025-10-15T10:58:11.994527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 504, pipe: [1:7561401126007465298:6486]
2025-10-15T10:58:11.994650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:11.994604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 504
2025-10-15T10:58:11.994755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401126007465290:6578], now have 1 active actors on pipe
2025-10-15T10:58:11.994787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401126007465298:6486], now have 1 active actors on pipe
2025-10-15T10:58:11.994818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401126007465202:2467], now have 1 active actors on pipe
2025-10-15T10:58:11.994850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401128807158767:5973]
2025-10-15T10:58:11.994867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401128807158767:5973]
2025-10-15T10:58:11.994881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401128807158767:5973]
2025-10-15T10:58:11.994913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:11.994965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:11.994996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:11.994999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:11.995008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:11.995199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:11.995225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:11.995286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:11.995315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:11.995481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401128807158767:5973]
2025-10-15T10:58:11.995517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:11.995597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:11.995634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:11.995652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:11.995664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:11.995702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:11.995747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:11.995889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:11.995999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:11.996868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:11.996900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:11.996974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:11.998193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551089fa-3fad2f09-ed2aa1c8-40e2f3f1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:11.997347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 505 partition: 0 MaxSeqNo: 46 sessionId: src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0
2025-10-15T10:58:12.031140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0] Write session: try to update token
2025-10-15T10:58:12.031208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:12.134564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId: src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:12.142235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:12.142273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:12.142286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:12.142297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:12.142332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401128807158767:5973]
2025-10-15T10:58:12.142359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401128807158767:5973]
2025-10-15T10:58:12.142381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401128807158767:5973]
2025-10-15T10:58:12.142513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:12.142547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:12.142554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:12.142560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:12.142571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:12.142587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:12.142676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:12.142696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:12.147829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:12.169249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:12.293379Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:12.322447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:12.322505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:12.322579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:12.322593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:12.322636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401128807158767:5973]
2025-10-15T10:58:12.323156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:12.325319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:12.325482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:12.325514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:12.326898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401126007465298:6486]
2025-10-15T10:58:12.327057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:12.348750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 505 reason: error at write: Disconnected sessionId: src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0
2025-10-15T10:58:12.349141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 505 sessionId: src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0 is DEAD
2025-10-15T10:58:12.351959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:12.352001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0] Write session will restart in 0.007217s
2025-10-15T10:58:12.352106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0] Write session: Do CDS request
2025-10-15T10:58:12.352137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:12.363950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:12.363935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:12.363970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 506
2025-10-15T10:58:12.367583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:12.367744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:12.367762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:12.367774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:12.369376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 506 sessionId:  describe result for acl check
2025-10-15T10:58:12.369476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:12.369495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:12.369514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:12.369533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401130302432624:6582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:12.372195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401130302432624:6582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:12.388172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:12.394824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:12.395558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:12.395589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:12.395628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:12.395866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:12.396078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401133102126155:5978]
2025-10-15T10:58:12.396277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401130302432624:6582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:12.398343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:12.401962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:12.402230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:12.403586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:12.403028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401130302432624:6582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:12.403072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401130302432624:6582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:12.403091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401130302432624:6582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:12.403122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:12.403931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:12.403946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:12.403954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:12.403962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:12.403969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:12.403976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:12.403984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:12.403991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:12.403998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:12.404005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:12.404013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:12.404021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.404028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.404035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.404085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:12.404200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:12.404248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:12.404298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:12.404345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:12.404392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:12.404437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:12.404485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:12.404531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:12.404579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:12.404626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:12.404672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.404720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.404766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.404808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:12.404876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:12.404937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:12.404991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:12.405040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:12.405109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:12.405155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:12.405214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:12.405261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:12.405313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:12.405359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:12.405414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:12.405462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:12.405518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:12.405564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:12.405617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:12.405681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:12.405735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:12.405782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:12.405838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:12.405886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:12.405940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:12.405986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.406040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.406086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.406139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.406183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.406238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.406773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:12.426653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401130302432691:6486]
2025-10-15T10:58:12.432675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:12.443613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:12.443663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:12.443679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:12.443698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:12.443723Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 505 [2:7561401133102126155:5978]
2025-10-15T10:58:12.443776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:12.443834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:12.443848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:12.443860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:12.443870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:12.443915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:12.443935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:12.443954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:12.445132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.445147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.445160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.445170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:12.445430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:12.445446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.445581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.445759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.445980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:12.446045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401133102126150:5978]
2025-10-15T10:58:12.446059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401133102126150:5978]
2025-10-15T10:58:12.446072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401133102126150:5978]
2025-10-15T10:58:12.446115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:12.446179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:12.446355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:12.446371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:12.446483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401133102126150:5978]
2025-10-15T10:58:12.446500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:12.447363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:12.447388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:12.447400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:12.447424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:12.448453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401130302432688:6582], now have 1 active actors on pipe
2025-10-15T10:58:12.448488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401130302432608:2467], now have 1 active actors on pipe
2025-10-15T10:58:12.448513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401130302432691:6486], now have 1 active actors on pipe
2025-10-15T10:58:12.449185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:12.449230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:12.449343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:12.449376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:12.449393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:12.449404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:12.449435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:12.449484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:12.449534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:12.451073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:12.451130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:12.451228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:12.448469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 505
2025-10-15T10:58:12.448466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 505
2025-10-15T10:58:12.448565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 505, pipe: [1:7561401130302432691:6486]
2025-10-15T10:58:12.452491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692a0f58-52fd495d-e0f354a5-2b1c1c2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:12.451601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 506 partition: 0 MaxSeqNo: 46 sessionId: src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0
2025-10-15T10:58:12.488116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0] Write session: try to update token
2025-10-15T10:58:12.488170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:12.567379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:12.567427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:12.567456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:12.567470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:12.567510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401133102126150:5978]
2025-10-15T10:58:12.567546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401133102126150:5978]
2025-10-15T10:58:12.567572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401133102126150:5978]
2025-10-15T10:58:12.567756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:12.567787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:12.567799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:12.567917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:12.567943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:12.568091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:12.568140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:12.568176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:12.569301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:12.579472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId: src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:12.601818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:12.719745Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:12.731314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:12.731392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:12.731474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:12.731490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:12.731535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401133102126150:5978]
2025-10-15T10:58:12.731882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:12.732361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:12.734628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:12.736506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:12.736757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401130302432691:6486]
2025-10-15T10:58:12.766611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 506 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0
2025-10-15T10:58:12.766955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 506 sessionId: src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0 is DEAD
2025-10-15T10:58:12.771560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:12.771600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0] Write session will restart in 0.005141s
2025-10-15T10:58:12.771702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0] Write session: Do CDS request
2025-10-15T10:58:12.771732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:12.782749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:12.783853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:12.783884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 507
2025-10-15T10:58:12.784151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:12.784263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:12.784284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:12.784294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:12.785641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 507 sessionId:  describe result for acl check
2025-10-15T10:58:12.785749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:12.785760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:12.785770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:12.785787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401130302432732:6588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:12.788348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401130302432732:6588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:12.796197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401130302432732:6588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:12.814776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401130302432732:6588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:12.814817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401130302432732:6588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:12.814835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401130302432732:6588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:12.814873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:12.814648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:12.816983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:12.817899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:12.817918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:12.817963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:12.818227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:12.818409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401133102126266:5983]
2025-10-15T10:58:12.820953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:12.822213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:12.822430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:12.823761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:12.824115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:12.824123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:12.824131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:12.824137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:12.824144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:12.824151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:12.824158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:12.824166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:12.824171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:12.824179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:12.824187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:12.824195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.824202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.824211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.824259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:12.824372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:12.824509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:12.824560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:12.824607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:12.824658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:12.824709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:12.824758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:12.824807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:12.824857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:12.824905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:12.824952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.825003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.825063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.825124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:12.825196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:12.825260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:12.825318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:12.825370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:12.825425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:12.825473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:12.825535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:12.825588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:12.825645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:12.825697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:12.825756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:12.825806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:12.825862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:12.825912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:12.825968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:12.826018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:12.826077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:12.826124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:12.826181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:12.826231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:12.826288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:12.826336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.826392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.826444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.826500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.826548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.826607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.827147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:12.836894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401130302432800:6486]
2025-10-15T10:58:12.848162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:12.858414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:12.858471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:12.858489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:12.858508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:12.858534Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 506 [2:7561401133102126266:5983]
2025-10-15T10:58:12.858587Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:12.858646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:12.858662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:12.858675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:12.858688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:12.858739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:12.858763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:12.858789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:12.871312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.871399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.871413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.871423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:12.871690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:12.871713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:12.871849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:12.872025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:12.874199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 506, pipe: [1:7561401130302432800:6486]
2025-10-15T10:58:12.874237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 506
2025-10-15T10:58:12.874302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 506
2025-10-15T10:58:12.872248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:12.872327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401133102126260:5983]
2025-10-15T10:58:12.872341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401133102126260:5983]
2025-10-15T10:58:12.872355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401133102126260:5983]
2025-10-15T10:58:12.872387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:12.872465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:12.872650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:12.872668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:12.872787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401133102126260:5983]
2025-10-15T10:58:12.872807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:12.872981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:12.872993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:12.873005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:12.873029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:12.875135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401130302432800:6486], now have 1 active actors on pipe
2025-10-15T10:58:12.875178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401130302432794:6588], now have 1 active actors on pipe
2025-10-15T10:58:12.875200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401130302432714:2467], now have 1 active actors on pipe
2025-10-15T10:58:12.875245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:12.875268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:12.875374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79387e95-43b0e423-d61c5302-f6646424_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:12.875413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:12.875437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:12.875448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:12.875486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:12.875530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:12.875587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:12.876467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:12.876530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:12.876619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:12.876910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 507 partition: 0 MaxSeqNo: 46 sessionId: src_id|79387e95-43b0e423-d61c5302-f6646424_0
2025-10-15T10:58:12.878877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe5c0093-1e52af45-c7f27f54-ab2f8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|79387e95-43b0e423-d61c5302-f6646424_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:12.905377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79387e95-43b0e423-d61c5302-f6646424_0] Write session: try to update token
2025-10-15T10:58:12.905445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79387e95-43b0e423-d61c5302-f6646424_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:12.954340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:12.954374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:12.954385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:12.954394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:12.954425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401133102126260:5983]
2025-10-15T10:58:12.954448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401133102126260:5983]
2025-10-15T10:58:12.954470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401133102126260:5983]
2025-10-15T10:58:12.954561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:12.954592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:12.954601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:12.954617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:12.954621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:12.956392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:13.046696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId: src_id|79387e95-43b0e423-d61c5302-f6646424_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:13.072817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:13.101516Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:13.103788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:13.103828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:13.107845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:13.107684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:13.107862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401130302432800:6486]
2025-10-15T10:58:13.107948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:13.107960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:13.134582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 507 reason: error at write: Disconnected sessionId: src_id|79387e95-43b0e423-d61c5302-f6646424_0
2025-10-15T10:58:13.134911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 507 sessionId: src_id|79387e95-43b0e423-d61c5302-f6646424_0 is DEAD
2025-10-15T10:58:13.136124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79387e95-43b0e423-d61c5302-f6646424_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:13.136156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79387e95-43b0e423-d61c5302-f6646424_0] Write session will restart in 0.008140s
2025-10-15T10:58:13.136251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79387e95-43b0e423-d61c5302-f6646424_0] Write session: Do CDS request
2025-10-15T10:58:13.136279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79387e95-43b0e423-d61c5302-f6646424_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:13.156570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79387e95-43b0e423-d61c5302-f6646424_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:13.160146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:13.160186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 508
2025-10-15T10:58:13.160544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:13.160675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:13.160697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:13.160707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:13.162115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 508 sessionId:  describe result for acl check
2025-10-15T10:58:13.162229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:13.162239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:13.162248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:13.162265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401134597400177:6598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:13.165027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401134597400177:6598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:13.167048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:13.170034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:13.170853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:13.170886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:13.170931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:13.171184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:13.171398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401137397093651:5989]
2025-10-15T10:58:13.173656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401134597400177:6598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:13.173725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:13.174697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:13.174947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:13.176230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:13.176565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.176570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.176575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.176580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.176584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.176588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.176593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.176598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.176602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.176607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.176612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.176617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.176620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.176625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.176660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.176772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.176814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.176857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.176890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.176926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.176958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.176988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.177023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.177059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.177105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.177137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.177170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.177204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.177234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.177284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.177325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.177395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.177446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.177499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.177537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.177572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.177603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.177637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.177669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.177703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.177733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.177768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.177798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.177845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.177904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.177954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.177994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.178031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.178068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.178111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.178155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.178215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.178270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.178330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.178382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.178441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.178929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:13.184536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401134597400177:6598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:13.184580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401134597400177:6598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:13.184602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401134597400177:6598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:13.184647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:13.201974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:13.207965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401134597400212:6486]
2025-10-15T10:58:13.214412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:13.214466Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:13.214483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:13.214503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:13.214527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 507 [2:7561401137397093651:5989]
2025-10-15T10:58:13.214583Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:13.214643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:13.214658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:13.214671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:13.214682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:13.214733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:13.214755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:13.214777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:13.218281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 507
2025-10-15T10:58:13.218365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 507, pipe: [1:7561401134597400212:6486]
2025-10-15T10:58:13.218437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 507
2025-10-15T10:58:13.217562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.217594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.217608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.217621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:13.217894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:13.217912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.218057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.218253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.218497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:13.218588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401134597400210:6598], now have 1 active actors on pipe
2025-10-15T10:58:13.218614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401134597400212:6486], now have 1 active actors on pipe
2025-10-15T10:58:13.218638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401134597400126:2467], now have 1 active actors on pipe
2025-10-15T10:58:13.218664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401137397093646:5989]
2025-10-15T10:58:13.218681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401137397093646:5989]
2025-10-15T10:58:13.218695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401137397093646:5989]
2025-10-15T10:58:13.218737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:13.218762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:13.218776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:13.218789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:13.218822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:13.219026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:13.219042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:13.219102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:13.219123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:13.219263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401137397093646:5989]
2025-10-15T10:58:13.219292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:13.219312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:13.227522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:13.227594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:13.227626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:13.227639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:13.227681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:13.227735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:13.228794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:13.230522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 508 partition: 0 MaxSeqNo: 46 sessionId: src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0
2025-10-15T10:58:13.231887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79387e95-43b0e423-d61c5302-f6646424_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:13.230132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:13.230176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:13.230245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:13.265401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0] Write session: try to update token
2025-10-15T10:58:13.265456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:13.320299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:13.320353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:13.320366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:13.320378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:13.320411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401137397093646:5989]
2025-10-15T10:58:13.320438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401137397093646:5989]
2025-10-15T10:58:13.320461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401137397093646:5989]
2025-10-15T10:58:13.320591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:13.320616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:13.320629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:13.320637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:13.320640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:13.320677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:13.320680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:13.320700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:13.321835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:13.397775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId: src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:13.419372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:13.463253Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:13.464766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:13.464808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:13.465899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:13.465945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:13.466040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401134597400212:6486]
2025-10-15T10:58:13.466186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:13.469563Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:13.512267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:13.515394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:13.515688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 508 reason: error at write: Disconnected sessionId: src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0
2025-10-15T10:58:13.515980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 508 sessionId: src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0 is DEAD
2025-10-15T10:58:13.516481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:13.516550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0] Write session will restart in 0.006934s
2025-10-15T10:58:13.516746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0] Write session: Do CDS request
2025-10-15T10:58:13.516802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:13.516109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:13.516134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:13.516177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:13.516568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:13.516755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401137397093763:5999]
2025-10-15T10:58:13.521352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:13.523704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:13.523919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:13.525165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:13.525493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.525509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.525515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.525522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.525528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.525534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.525541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.525547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.525553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.525561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.525566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.525573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.525579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.525586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.525634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.525737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.525783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.525828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.525871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.525923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.525954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.525984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.526027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.526057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.526094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.526136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.526184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.526217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.526249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.526314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.526361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.526429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.526489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.526544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.526593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.526690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.526751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.526811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.526857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.526912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.526966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.527025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.527076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.527134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.527187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.527235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.527277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.527325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.527385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.527431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.527473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.527532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.527582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.527652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.527698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.527759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.528712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:13.528680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:13.528714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 509
2025-10-15T10:58:13.528238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:13.529277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:13.529436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:13.529460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:13.529471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:13.530747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 509 sessionId:  describe result for acl check
2025-10-15T10:58:13.530861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:13.530878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:13.530890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:13.530910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401134597400292:6606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:13.533757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401134597400292:6606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:13.541207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401134597400292:6606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:13.549874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401134597400292:6606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:13.549923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401134597400292:6606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:13.549954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401134597400292:6606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:13.549986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:13.566941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401134597400322:6486]
2025-10-15T10:58:13.567625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:13.577380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:13.577441Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:13.577463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:13.577485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:13.577512Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 508 [2:7561401137397093763:5999]
2025-10-15T10:58:13.577569Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:13.577638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:13.577655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:13.577669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:13.577681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:13.577738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:13.577776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:13.577815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:13.578974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.578990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.579000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.579009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:13.579286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:13.579318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.579782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 508
2025-10-15T10:58:13.579803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 508
2025-10-15T10:58:13.579890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 508, pipe: [1:7561401134597400322:6486]
2025-10-15T10:58:13.579494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.579710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.579985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:13.580081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401134597400235:2467], now have 1 active actors on pipe
2025-10-15T10:58:13.580105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401134597400322:6486], now have 1 active actors on pipe
2025-10-15T10:58:13.580131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401134597400321:6606], now have 1 active actors on pipe
2025-10-15T10:58:13.580205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:13.580230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:13.580267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401137397093758:5999]
2025-10-15T10:58:13.580282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401137397093758:5999]
2025-10-15T10:58:13.580295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401137397093758:5999]
2025-10-15T10:58:13.580346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:13.580404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:13.580411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:13.580420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:13.580433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:13.580566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:13.580584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:13.580642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:13.580665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:13.580679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:13.580686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:13.580714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:13.580748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:13.580863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401137397093758:5999]
2025-10-15T10:58:13.580895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:13.580931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:13.581013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:13.581813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:13.581844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:13.581916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:13.582302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 509 partition: 0 MaxSeqNo: 46 sessionId: src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0
2025-10-15T10:58:13.583009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2441020c-46780ea2-1669fa5e-c02bacaa_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:13.615430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0] Write session: try to update token
2025-10-15T10:58:13.615495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:13.623342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:13.623426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:13.623469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401137397093758:5999]
2025-10-15T10:58:13.623601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:13.623953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:13.626640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:13.630358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:13.633769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:13.636901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:13.640998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:13.641558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:13.729714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:13.729750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:13.729764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:13.729828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:13.729845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:13.729860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:13.729874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:13.729917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401137397093758:5999]
2025-10-15T10:58:13.729945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401137397093758:5999]
2025-10-15T10:58:13.729970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401137397093758:5999]
2025-10-15T10:58:13.730120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:13.730117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:13.730149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:13.730156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:13.730190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:13.732264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:13.732579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId: src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:13.753500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:13.879252Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:13.896451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:13.896499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:13.897122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:13.897188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401134597400322:6486]
2025-10-15T10:58:13.897259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:13.897279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:13.897304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:13.905665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:13.905732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0] Write session will restart in 0.006544s
2025-10-15T10:58:13.905893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0] Write session: Do CDS request
2025-10-15T10:58:13.905942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:13.903849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 509 reason: error at write: Disconnected sessionId: src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0
2025-10-15T10:58:13.904105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 509 sessionId: src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0 is DEAD
2025-10-15T10:58:13.927911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:13.927944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 510
2025-10-15T10:58:13.928535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:13.931815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:13.931973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:13.931998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:13.932009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:13.933531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 510 sessionId:  describe result for acl check
2025-10-15T10:58:13.933735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:13.933748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:13.933758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:13.933775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401134597400370:6614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:13.936704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401134597400370:6614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:13.945043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401134597400370:6614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:13.956141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401134597400370:6614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:13.956185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401134597400370:6614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:13.956202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401134597400370:6614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:13.956236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:13.960976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:13.963751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:13.964525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:13.964555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:13.964592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:13.964827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:13.965007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401137397093868:6002]
2025-10-15T10:58:13.967127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:13.969098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:13.969305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:13.970734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:13.971069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.971078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.971085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.971091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.971097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.971104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.971110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.971117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.971124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.971131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.971138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.971144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.971150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.971157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.971204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.971312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.971383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.971431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.971474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.971519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.971562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.971604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.971648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.971694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.971735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.971780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.971824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.971865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.971912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.971977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:13.972036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.972090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:13.972139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.972189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:13.972233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.972284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:13.972332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.972383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:13.972428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.972478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:13.972525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.972581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:13.972625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.972677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:13.972724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.972772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:13.972814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.972862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:13.972909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.972963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:13.973006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.973057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:13.973118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.973171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:13.973214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.973265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:13.973764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:13.993161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:14.002643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401134597400442:6486]
2025-10-15T10:58:14.005911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:14.005948Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:14.005962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:14.005980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:14.006002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 509 [2:7561401137397093868:6002]
2025-10-15T10:58:14.006050Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:14.006104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:14.006118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:14.006129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:14.006139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:14.006184Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:14.006204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:14.006224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:14.018252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.018277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.018288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.018299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:14.018554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:14.018569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.018695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.018860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.019069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:14.019128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401137397093863:6002]
2025-10-15T10:58:14.019143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401137397093863:6002]
2025-10-15T10:58:14.019154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401137397093863:6002]
2025-10-15T10:58:14.019191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:14.019257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:14.019888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:14.019904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:14.019914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:14.020339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:14.020365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:14.020491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401134597400352:2467], now have 1 active actors on pipe
2025-10-15T10:58:14.020513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401134597400442:6486], now have 1 active actors on pipe
2025-10-15T10:58:14.020530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401134597400433:6614], now have 1 active actors on pipe
2025-10-15T10:58:14.020549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401137397093863:6002]
2025-10-15T10:58:14.020573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:14.020919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:14.022999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 509
2025-10-15T10:58:14.023122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 509, pipe: [1:7561401134597400442:6486]
2025-10-15T10:58:14.023212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 509
2025-10-15T10:58:14.023461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:14.023490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:14.023554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:14.023583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:14.023598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:14.023609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:14.023642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:14.023679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:14.023718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:14.028316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:14.028345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:14.028413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:14.031640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 510 partition: 0 MaxSeqNo: 46 sessionId: src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0
2025-10-15T10:58:14.032171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c690977-f7aa118c-4cd071-7ebfdbe7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:14.072799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0] Write session: try to update token
2025-10-15T10:58:14.072858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:14.115054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:14.115083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:14.115097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:14.115109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:14.115142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401137397093863:6002]
2025-10-15T10:58:14.115167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401137397093863:6002]
2025-10-15T10:58:14.115192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401137397093863:6002]
2025-10-15T10:58:14.115321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:14.115330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:14.115342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:14.115375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:14.115378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:14.115411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:14.115417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:14.115435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:14.116710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:14.195439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId: src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:14.248071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:14.275912Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:14.277902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:14.277934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:14.279019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401134597400442:6486]
2025-10-15T10:58:14.279254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:14.279280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:14.280080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:14.282234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:14.294783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 510 reason: error at write: Disconnected sessionId: src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0
2025-10-15T10:58:14.295127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 510 sessionId: src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0 is DEAD
2025-10-15T10:58:14.295789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:14.295825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0] Write session will restart in 0.008256s
2025-10-15T10:58:14.295931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0] Write session: Do CDS request
2025-10-15T10:58:14.295961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:14.311420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:14.311476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 511
2025-10-15T10:58:14.312256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:14.313059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:14.313276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:14.313315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:14.313331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:14.315029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 511 sessionId:  describe result for acl check
2025-10-15T10:58:14.315147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:14.315163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:14.315173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:14.315190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401138892367770:6620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:14.317981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401138892367770:6620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:14.332819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401138892367770:6620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:14.349787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:14.349445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401138892367770:6620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:14.349493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401138892367770:6620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:14.349511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401138892367770:6620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:14.349553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:14.358437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:14.359266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:14.359299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:14.359338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:14.359630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:14.359834Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401141692061272:6011]
2025-10-15T10:58:14.361776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:14.364536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:14.364857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:14.366251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:14.366594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:14.366603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:14.366609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:14.366616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:14.366624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:14.366631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:14.366637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:14.366645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:14.366652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:14.366659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:14.366666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:14.366673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.366680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.366689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.366737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:14.366854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:14.366909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:14.366959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:14.367004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:14.367051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:14.367098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:14.367143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:14.367193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:14.367241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:14.367288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:14.367334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.367397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.367451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.367500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:14.367571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:14.367634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:14.367691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:14.367739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:14.367795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:14.367852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:14.367915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:14.367965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:14.368025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:14.368074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:14.368142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:14.368197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:14.368262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:14.368424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:14.368490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:14.368548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:14.368612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:14.368663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:14.368724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:14.368777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:14.368838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:14.368891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.368952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.369010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.369073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.369137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.369197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.369768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:14.379409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401138892367842:6486]
2025-10-15T10:58:14.417893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:14.429111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:14.429156Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:14.429171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:14.429192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:14.429216Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 510 [2:7561401141692061272:6011]
2025-10-15T10:58:14.429274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:14.429336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:14.429350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:14.429362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:14.429372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:14.429425Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:14.429447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:14.429468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:14.431962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.431988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.432003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.432016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:14.432296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:14.432314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.432460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.432659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.432912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:14.432987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401141692061266:6011]
2025-10-15T10:58:14.433003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401141692061266:6011]
2025-10-15T10:58:14.433018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401141692061266:6011]
2025-10-15T10:58:14.433063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:14.433152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:14.433215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:14.433230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:14.433243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:14.433350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:14.433367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:14.433495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401141692061266:6011]
2025-10-15T10:58:14.433516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:14.433537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:14.433627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401138892367842:6486], now have 1 active actors on pipe
2025-10-15T10:58:14.433661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401138892367835:6620], now have 1 active actors on pipe
2025-10-15T10:58:14.433693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401138892367754:2467], now have 1 active actors on pipe
2025-10-15T10:58:14.434419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 510, pipe: [1:7561401138892367842:6486]
2025-10-15T10:58:14.434516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 510
2025-10-15T10:58:14.434584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 510
2025-10-15T10:58:14.434959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:14.435003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:14.435113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:14.435153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:14.435171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:14.435182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:14.435219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:14.435264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:14.435327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:14.436723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 511 partition: 0 MaxSeqNo: 46 sessionId: src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0
2025-10-15T10:58:14.436370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:14.436397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:14.436463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:14.437509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d51b08fd-b85f6abc-d92182a5-39a9b3fb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:14.464616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0] Write session: try to update token
2025-10-15T10:58:14.464675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:14.506973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:14.507007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:14.507019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:14.507028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:14.507060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401141692061266:6011]
2025-10-15T10:58:14.507084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401141692061266:6011]
2025-10-15T10:58:14.507107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401141692061266:6011]
2025-10-15T10:58:14.507239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:14.507259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:14.507269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:14.507301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:14.507341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:14.518370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:14.605368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId: src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:14.629801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:14.679542Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:14.685471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:14.685508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:14.688737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:14.689006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401138892367842:6486]
2025-10-15T10:58:14.689183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:14.689202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:14.709889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 511 reason: error at write: Disconnected sessionId: src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0
2025-10-15T10:58:14.710183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 511 sessionId: src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0 is DEAD
2025-10-15T10:58:14.718682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:14.718718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0] Write session will restart in 0.005220s
2025-10-15T10:58:14.718804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0] Write session: Do CDS request
2025-10-15T10:58:14.718833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:14.720115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:14.733793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:14.753431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:14.753461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 512
2025-10-15T10:58:14.754761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:14.754877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:14.754891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:14.754900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:14.756039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 512 sessionId:  describe result for acl check
2025-10-15T10:58:14.756148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:14.756158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:14.756166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:14.756180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401138892367935:6632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:14.758412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:14.758643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401138892367935:6632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:14.762171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:14.763192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:14.763214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:14.763262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:14.763582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:14.763812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401141692061391:6014]
2025-10-15T10:58:14.766118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:14.767055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:14.767273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:14.768581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:14.768916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:14.768934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:14.768944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:14.768951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:14.768959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:14.768967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:14.768975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:14.768982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:14.768990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:14.768998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:14.769005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:14.769011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.769019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.769026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.769072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:14.769195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:14.769243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:14.769293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:14.769343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:14.769400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:14.769453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:14.769500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:14.769547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:14.769605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:14.769660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:14.769724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.769777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.769833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.769876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:14.769948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:14.770015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:14.770072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:14.770128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:14.770191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:14.770243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:14.770307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:14.770364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:14.770426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:14.770481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:14.770534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:14.770589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:14.770637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:14.770681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:14.770736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:14.770789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:14.770847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:14.770903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:14.770965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:14.771014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:14.771061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:14.770017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401138892367935:6632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:14.771098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.771155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.771206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.771261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.771316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.771444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.772009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:14.783285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401138892367935:6632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:14.783335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401138892367935:6632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:14.783371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401138892367935:6632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:14.783407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:14.789068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:14.789469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401138892367968:6486]
2025-10-15T10:58:14.798810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:14.798854Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:14.798870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:14.798885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:14.798906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 511 [2:7561401141692061391:6014]
2025-10-15T10:58:14.798956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:14.799012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:14.799024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:14.799036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:14.799046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:14.799084Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:14.799103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:14.799121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:14.801302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 511
2025-10-15T10:58:14.801408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 511, pipe: [1:7561401138892367968:6486]
2025-10-15T10:58:14.801499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 511
2025-10-15T10:58:14.800655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.800681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.800694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.800706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:14.800987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:14.801006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:14.801164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:14.801353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:14.801604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:14.801690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401138892367882:2467], now have 1 active actors on pipe
2025-10-15T10:58:14.801718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401138892367968:6486], now have 1 active actors on pipe
2025-10-15T10:58:14.801741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401138892367966:6632], now have 1 active actors on pipe
2025-10-15T10:58:14.801794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:14.801808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:14.801841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401141692061386:6014]
2025-10-15T10:58:14.801859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401141692061386:6014]
2025-10-15T10:58:14.801873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401141692061386:6014]
2025-10-15T10:58:14.801920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:14.801968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:14.801985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:14.801997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:14.802014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:14.802209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:14.802229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:14.802301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:14.802333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:14.802352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:14.802362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:14.802400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:14.802440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:14.802579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401141692061386:6014]
2025-10-15T10:58:14.802613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:14.802636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:14.802661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:14.803125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:14.803146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:14.803488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 512 partition: 0 MaxSeqNo: 46 sessionId: src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0
2025-10-15T10:58:14.803216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:14.804276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238aa4be-1c6b264b-f01fb476-a480c4b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:14.825757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0] Write session: try to update token
2025-10-15T10:58:14.825822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:14.841276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:14.841311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:14.841354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401141692061386:6014]
2025-10-15T10:58:14.841493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:14.841500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:14.843324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:14.844663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:14.847380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:14.848726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:14.850758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:14.851544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:14.913223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId: src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:14.924363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:14.924405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:14.924420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:14.924433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:14.924479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401141692061386:6014]
2025-10-15T10:58:14.924515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401141692061386:6014]
2025-10-15T10:58:14.924550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401141692061386:6014]
2025-10-15T10:58:14.924761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:14.924793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:14.924804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:14.924857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:14.924879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:14.927483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:14.927527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:14.927557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:14.928299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:14.948775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:15.088921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:15.104063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:15.104102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:15.104832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:15.104846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:15.104862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:15.105081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401138892367968:6486]
2025-10-15T10:58:15.105228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:15.141777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 512 reason: error at write: Disconnected sessionId: src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0
2025-10-15T10:58:15.142105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 512 sessionId: src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0 is DEAD
2025-10-15T10:58:15.142538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:15.142612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0] Write session will restart in 0.007782s
2025-10-15T10:58:15.142819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0] Write session: Do CDS request
2025-10-15T10:58:15.142882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:15.146760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:15.150559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:15.151439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:15.151470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:15.151529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:15.151800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:15.152008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401145987028787:6023]
2025-10-15T10:58:15.154150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:15.155162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:15.155332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:15.155379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 513
2025-10-15T10:58:15.155421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:15.155504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:15.155963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:15.156090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:15.156112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:15.156133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:15.156727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:15.157092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.157123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.157130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.157136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.157142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.157149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.157155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.157163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.157169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.157176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.157184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.157191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.157197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.157204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.157253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.157360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.157408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.157454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.157439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 513 sessionId:  describe result for acl check
2025-10-15T10:58:15.157500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.157559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.157564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:15.157576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:15.157583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:15.157603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.157596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401143187335351:6639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:15.157652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.157695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.157747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.157797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.157847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.157900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.157951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.157996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.158080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.158143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.158206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.158271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.158334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.158383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.158425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.158473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.158536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.158587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.158629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.158664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.158709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.158748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.158788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.158824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.158862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.158896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.158935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.158973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.159019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.159058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.159100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.159137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.159172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.159207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.159244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.159654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:15.160023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401143187335351:6639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:15.170066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401143187335351:6639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:15.177990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401143187335351:6639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:15.178034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401143187335351:6639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:15.178052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401143187335351:6639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:15.178086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:15.179698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:15.204141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:15.204198Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:15.204218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:15.204240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:15.204267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 512 [2:7561401145987028787:6023]
2025-10-15T10:58:15.204328Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:15.204398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:15.204415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:15.204428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:15.204441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:15.204497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:15.204530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:15.204555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:15.205309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401143187335383:6486]
2025-10-15T10:58:15.205936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.205961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.205975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.205988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:15.206273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:15.206300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.206455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.206502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 512
2025-10-15T10:58:15.206504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 512, pipe: [1:7561401143187335383:6486]
2025-10-15T10:58:15.206608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 512
2025-10-15T10:58:15.206670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.206924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:15.207019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401143187335382:6639], now have 1 active actors on pipe
2025-10-15T10:58:15.207051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401143187335383:6486], now have 1 active actors on pipe
2025-10-15T10:58:15.207074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401143187335291:2467], now have 1 active actors on pipe
2025-10-15T10:58:15.207124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:15.207152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:15.207206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401145987028782:6023]
2025-10-15T10:58:15.207226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401145987028782:6023]
2025-10-15T10:58:15.207240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401145987028782:6023]
2025-10-15T10:58:15.207283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:15.207328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:15.207386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:15.207387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:15.207404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:15.207588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:15.207613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:15.207682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:15.207721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:15.207739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:15.207750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:15.207790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:15.207840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:15.207984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401145987028782:6023]
2025-10-15T10:58:15.208024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:15.208071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:15.208087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:15.208588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:15.208614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:15.208684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:15.208930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 513 partition: 0 MaxSeqNo: 46 sessionId: src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0
2025-10-15T10:58:15.209776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|745fe464-fcfea320-b610f6c7-73d5f7ea_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:15.230744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0] Write session: try to update token
2025-10-15T10:58:15.230808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:15.235447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:15.235482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:15.235524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401145987028782:6023]
2025-10-15T10:58:15.235661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:15.235666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:15.237577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:15.238831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:15.240099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:15.241573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:15.243379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:15.243923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:15.295729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:15.295765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:15.295779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:15.295790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:15.295832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401145987028782:6023]
2025-10-15T10:58:15.295858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401145987028782:6023]
2025-10-15T10:58:15.295884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401145987028782:6023]
2025-10-15T10:58:15.295997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:15.296041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:15.296047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:15.296060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:15.296072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:15.297714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:15.322399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId: src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:15.343978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:15.446538Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:15.459498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:15.459546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:15.460242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:15.460275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:15.460493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401143187335383:6486]
2025-10-15T10:58:15.460629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:15.460361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:15.485792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 513 reason: error at write: Disconnected sessionId: src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0
2025-10-15T10:58:15.486165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 513 sessionId: src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0 is DEAD
2025-10-15T10:58:15.486597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:15.486652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0] Write session will restart in 0.008092s
2025-10-15T10:58:15.486799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0] Write session: Do CDS request
2025-10-15T10:58:15.486865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:15.500553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:15.500584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 514
2025-10-15T10:58:15.500693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:15.501317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:15.501454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:15.501479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:15.501489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:15.501919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:15.502793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 514 sessionId:  describe result for acl check
2025-10-15T10:58:15.502907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:15.502923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:15.502933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:15.502950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401143187335450:6644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:15.506667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401143187335450:6644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:15.507483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:15.508924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:15.508981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:15.509056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:15.509559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:15.509881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401145987028882:6026]
2025-10-15T10:58:15.513333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:15.514371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:15.514582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401143187335450:6644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:15.514622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:15.515905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:15.516237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.516258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.516265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.516271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.516277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.516284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.516292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.516298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.516303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.516310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.516318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.516325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.516333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.516340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.516385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.516486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.516529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.516573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.516616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.516647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.516678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.516709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.516745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.516777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.516826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.516862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.516896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.516928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.516962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.517008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.517048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.517082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.517123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.517155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.517183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.517215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.517244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.517278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.517305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.517336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.517363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.517394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.517421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.517452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.517480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.517515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.517541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.517573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.517603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.517643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.517670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.517702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.517730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.517761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.517788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.517819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.518110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:15.521717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401143187335450:6644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:15.521760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401143187335450:6644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:15.521778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401143187335450:6644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:15.521822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:15.534528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:15.550479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:15.550534Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:15.550553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:15.550578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:15.550608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 513 [2:7561401145987028882:6026]
2025-10-15T10:58:15.550670Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:15.550732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:15.550746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:15.550757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:15.550767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:15.550808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:15.550827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:15.550847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:15.551685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.551695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.551705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.551717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:15.551923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:15.551935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.552040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.552174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.553664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 513
2025-10-15T10:58:15.553756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 513
2025-10-15T10:58:15.552336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:15.552389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401145987028876:6026]
2025-10-15T10:58:15.552399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401145987028876:6026]
2025-10-15T10:58:15.552407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401145987028876:6026]
2025-10-15T10:58:15.552436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:15.552487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:15.552636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:15.552647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:15.552742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401145987028876:6026]
2025-10-15T10:58:15.552754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:15.552960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:15.552978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:15.552991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:15.553028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:15.554251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401143187335483:6644], now have 1 active actors on pipe
2025-10-15T10:58:15.554275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401143187335392:2467], now have 1 active actors on pipe
2025-10-15T10:58:15.554311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:15.554327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:15.554391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:15.554415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:15.554428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:15.554435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:15.554463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:15.554498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:15.554533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:15.555093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:15.555116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:15.555182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:15.558027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 514 partition: 0 MaxSeqNo: 46 sessionId: src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0
2025-10-15T10:58:15.558361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401143187335488:6486]
2025-10-15T10:58:15.559155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 513, pipe: [1:7561401143187335488:6486]
2025-10-15T10:58:15.559119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401143187335488:6486], now have 1 active actors on pipe
2025-10-15T10:58:15.563974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e780d6e5-3bad9b02-9738ac51-4f0b3179_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:15.586572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0] Write session: try to update token
2025-10-15T10:58:15.586634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:15.644903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:15.644954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:15.644980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:15.645005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:15.645065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401145987028876:6026]
2025-10-15T10:58:15.645110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401145987028876:6026]
2025-10-15T10:58:15.645158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401145987028876:6026]
2025-10-15T10:58:15.645410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:15.645448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:15.645589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:15.645623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:15.645653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:15.649785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:15.682443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId: src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:15.704406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:15.794409Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:15.806809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:15.806852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:15.806909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:15.806922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:15.806958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401145987028876:6026]
2025-10-15T10:58:15.807143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:15.807536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:15.807571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:15.807700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:15.807967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401143187335488:6486]
2025-10-15T10:58:15.807553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:15.817877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 514 reason: error at write: Disconnected sessionId: src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0
2025-10-15T10:58:15.818221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 514 sessionId: src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0 is DEAD
2025-10-15T10:58:15.819828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:15.819864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0] Write session will restart in 0.008051s
2025-10-15T10:58:15.819967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0] Write session: Do CDS request
2025-10-15T10:58:15.819998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:15.836326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:15.836355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 515
2025-10-15T10:58:15.836631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:15.839810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:15.839985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:15.840009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:15.840020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:15.842861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 515 sessionId:  describe result for acl check
2025-10-15T10:58:15.843049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:15.843073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:15.843091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:15.843126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401143187335520:6649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:15.847278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401143187335520:6649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:15.854808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401143187335520:6649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:15.863746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401143187335520:6649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:15.863789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401143187335520:6649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:15.863806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401143187335520:6649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:15.863837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:15.880346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:15.883247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:15.884127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:15.884159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:15.884202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:15.884468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:15.884665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401145987029003:6035]
2025-10-15T10:58:15.886867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:15.892232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:15.892515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:15.893891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:15.894247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.894265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.894273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.894280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.894288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.894295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.894303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.894310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.894318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.894325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.894333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.894340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.894349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.894359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.894408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.894524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.894571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.894621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.894666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.894724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.894771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.894818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.894866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.894913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.894963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.895013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.895065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.895116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.895163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.895235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:15.895299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.895467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:15.895534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.895595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:15.895643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.895712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:15.895761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.895819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:15.895881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.895937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:15.895986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.896049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:15.896098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.896152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:15.896201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.896256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:15.896309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.896369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:15.896424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.896479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:15.896528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.896586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.896636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.896696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.896747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.896806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.897362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:15.909798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401143187335601:6486]
2025-10-15T10:58:15.926556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:15.938360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:15.938406Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:15.938423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:15.938444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:15.938470Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 514 [2:7561401145987029003:6035]
2025-10-15T10:58:15.938525Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:15.938592Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:15.938608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:15.938622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:15.938634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:15.938684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:15.938705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:15.938729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:15.941631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.941663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.941678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.941691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:15.942310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 514
2025-10-15T10:58:15.942436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 514
2025-10-15T10:58:15.942510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 514, pipe: [1:7561401143187335601:6486]
2025-10-15T10:58:15.942300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:15.942328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:15.942477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:15.942672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:15.942914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:15.942960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401143187335505:2467], now have 1 active actors on pipe
2025-10-15T10:58:15.942986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401143187335569:6649], now have 1 active actors on pipe
2025-10-15T10:58:15.943009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401143187335601:6486], now have 1 active actors on pipe
2025-10-15T10:58:15.943113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:15.943134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:15.943173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401145987028998:6035]
2025-10-15T10:58:15.943188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401145987028998:6035]
2025-10-15T10:58:15.943203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401145987028998:6035]
2025-10-15T10:58:15.943249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:15.943304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:15.943324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:15.943329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:15.943343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:15.943534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:15.943552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:15.943621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4739188-9ae8c390-2af0c658-50921d04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:15.943653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:15.943673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:15.943685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:15.943723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:15.943768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:15.943900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401145987028998:6035]
2025-10-15T10:58:15.943933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:15.943963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:15.943981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:15.944768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:15.944800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:15.944867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:15.945949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 515 partition: 0 MaxSeqNo: 46 sessionId: src_id|b4739188-9ae8c390-2af0c658-50921d04_0
2025-10-15T10:58:15.949142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb6e5e9f-668f035-dfc9dcb7-34358ca4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b4739188-9ae8c390-2af0c658-50921d04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:15.986861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4739188-9ae8c390-2af0c658-50921d04_0] Write session: try to update token
2025-10-15T10:58:15.986919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4739188-9ae8c390-2af0c658-50921d04_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:16.068026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:16.068053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:16.068062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:16.068113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:16.068125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:16.068137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:16.068145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:16.068171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401145987028998:6035]
2025-10-15T10:58:16.068192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401145987028998:6035]
2025-10-15T10:58:16.068211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401145987028998:6035]
2025-10-15T10:58:16.068365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:16.068394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:16.069231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:16.071486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:16.071522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:16.071552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:16.120996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId: src_id|b4739188-9ae8c390-2af0c658-50921d04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:16.154851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:16.251132Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:16.263799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:16.263853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:16.263955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:16.263971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:16.264017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401145987028998:6035]
2025-10-15T10:58:16.264315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:16.264685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:16.268372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:16.268610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:16.291175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401143187335601:6486]
2025-10-15T10:58:16.291278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 515 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b4739188-9ae8c390-2af0c658-50921d04_0
2025-10-15T10:58:16.291563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 515 sessionId: src_id|b4739188-9ae8c390-2af0c658-50921d04_0 is DEAD
2025-10-15T10:58:16.299664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4739188-9ae8c390-2af0c658-50921d04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:16.299732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4739188-9ae8c390-2af0c658-50921d04_0] Write session will restart in 0.005956s
2025-10-15T10:58:16.299901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4739188-9ae8c390-2af0c658-50921d04_0] Write session: Do CDS request
2025-10-15T10:58:16.299966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4739188-9ae8c390-2af0c658-50921d04_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:16.331876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4739188-9ae8c390-2af0c658-50921d04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:16.332100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:16.332137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 516
2025-10-15T10:58:16.332920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:16.333054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:16.333077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:16.333087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:16.338756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 516 sessionId:  describe result for acl check
2025-10-15T10:58:16.338884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:16.338896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:16.338906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:16.338924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401147482302981:6659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:16.341730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401147482302981:6659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:16.347588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:16.350764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:16.351732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:16.351756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:16.351803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:16.352077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:16.352249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401150281996414:6043]
2025-10-15T10:58:16.354335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:16.356020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401147482302981:6659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:16.355575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:16.355781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:16.357187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:16.357516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:16.357525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:16.357532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:16.357538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:16.357545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:16.357553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:16.357560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:16.357568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:16.357575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:16.357583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:16.357589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:16.357596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.357603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.357610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.357659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:16.357784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:16.357835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:16.357884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:16.357930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:16.357976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:16.358023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:16.358067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:16.358113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:16.358159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:16.359061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:16.359119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.359166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.359212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.359259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:16.359325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:16.359399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:16.359453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:16.359501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:16.359560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:16.359606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:16.359660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:16.359709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:16.359766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:16.359815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:16.359871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:16.359920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:16.359975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:16.360023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:16.360078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:16.360124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:16.360177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:16.360224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:16.360278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:16.360326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:16.360381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:16.360429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.360482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.360529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.360578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.360624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.360678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.361215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:16.364064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401147482302981:6659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:16.364101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401147482302981:6659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:16.364119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401147482302981:6659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:16.364167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:16.382123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:16.391498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401147482303017:6486]
2025-10-15T10:58:16.392506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:16.392543Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:16.392559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:16.392579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:16.392604Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 515 [2:7561401150281996414:6043]
2025-10-15T10:58:16.392660Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:16.392722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:16.392742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:16.392755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:16.392766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:16.392815Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:16.392844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:16.392867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:16.394740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.394765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.394779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.394792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:16.395062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:16.395080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.395228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.396035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.396281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:16.396373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401147482303015:6659], now have 1 active actors on pipe
2025-10-15T10:58:16.396403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401147482303017:6486], now have 1 active actors on pipe
2025-10-15T10:58:16.396424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401147482302927:2467], now have 1 active actors on pipe
2025-10-15T10:58:16.396450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401150281996407:6043]
2025-10-15T10:58:16.396466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401150281996407:6043]
2025-10-15T10:58:16.396481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401150281996407:6043]
2025-10-15T10:58:16.396518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:16.396601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:16.396643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 515
2025-10-15T10:58:16.396716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 515, pipe: [1:7561401147482303017:6486]
2025-10-15T10:58:16.396784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 515
2025-10-15T10:58:16.396797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:16.396822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:16.396941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401150281996407:6043]
2025-10-15T10:58:16.396964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:16.397048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:16.397062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:16.397074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:16.397098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:16.397098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:16.397122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:16.397236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:16.397268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:16.397286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:16.397297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:16.397335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:16.397377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:16.397423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:16.398074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:16.398103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:16.398175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:16.398599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 516 partition: 0 MaxSeqNo: 46 sessionId: src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0
2025-10-15T10:58:16.399867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4739188-9ae8c390-2af0c658-50921d04_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:16.449712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0] Write session: try to update token
2025-10-15T10:58:16.449773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:16.529589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:16.529613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:16.529622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:16.529682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:16.529697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:16.529711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:16.529720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:16.529746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401150281996407:6043]
2025-10-15T10:58:16.529765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401150281996407:6043]
2025-10-15T10:58:16.529781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401150281996407:6043]
2025-10-15T10:58:16.529913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:16.529928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:16.529944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:16.529947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:16.529985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:16.530806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:16.647441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId: src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:16.696927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:16.725289Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:16.759790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:16.759844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:16.759918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:16.759932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:16.759973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401150281996407:6043]
2025-10-15T10:58:16.760146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:16.760587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:16.763481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:16.763503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:16.763780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401147482303017:6486]
2025-10-15T10:58:16.774071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 516 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0
2025-10-15T10:58:16.774453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 516 sessionId: src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0 is DEAD
2025-10-15T10:58:16.775919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:16.775962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0] Write session will restart in 0.006039s
2025-10-15T10:58:16.776073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0] Write session: Do CDS request
2025-10-15T10:58:16.776108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:16.788043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:16.790782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:16.788111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 517
2025-10-15T10:58:16.791616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:16.791773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:16.791798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:16.791809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:16.794081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 517 sessionId:  describe result for acl check
2025-10-15T10:58:16.794209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:16.794220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:16.794229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:16.794247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401147482303071:6668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:16.797325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401147482303071:6668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:16.806952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401147482303071:6668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:16.825177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401147482303071:6668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:16.825233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401147482303071:6668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:16.825254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401147482303071:6668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:16.825291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:16.834962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:16.836888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:16.837846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:16.837868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:16.837916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:16.838202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:16.838406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401150281996529:6048]
2025-10-15T10:58:16.841319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:16.848677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:16.848962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:16.850382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:16.850788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:16.850798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:16.850805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:16.850814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:16.850822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:16.850829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:16.850836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:16.850843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:16.850850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:16.850858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:16.850866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:16.850873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.850881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.850889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.850944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:16.851067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:16.851120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:16.851170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:16.851220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:16.851272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:16.851322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:16.851395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:16.851442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:16.851494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:16.851541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:16.851590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.851652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.851703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.851758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:16.851834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:16.851902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:16.851961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:16.852010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:16.852068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:16.852117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:16.852173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:16.852223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:16.852283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:16.853350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:16.853433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:16.853488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:16.853549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:16.853604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:16.853664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:16.853722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:16.853784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:16.853839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:16.853901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:16.853957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:16.854018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:16.854074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.854134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.854195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.854262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.854318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.854379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.854945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:16.864657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401147482303155:6486]
2025-10-15T10:58:16.894893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:16.904309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:16.904342Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:16.904355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:16.904370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:16.904391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 516 [2:7561401150281996529:6048]
2025-10-15T10:58:16.904430Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:16.904479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:16.904492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:16.904503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:16.904512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:16.904549Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:16.904568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:16.904586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:16.905352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.905363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.905373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.905380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:16.905575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:16.905587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:16.905690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:16.905841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:16.906007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:16.906073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401147482303155:6486], now have 1 active actors on pipe
2025-10-15T10:58:16.906091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401147482303055:2467], now have 1 active actors on pipe
2025-10-15T10:58:16.906107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401147482303146:6668], now have 1 active actors on pipe
2025-10-15T10:58:16.906125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401150281996524:6048]
2025-10-15T10:58:16.906135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401150281996524:6048]
2025-10-15T10:58:16.906144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401150281996524:6048]
2025-10-15T10:58:16.906175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:16.906229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:16.906237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:16.906248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:16.906260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:16.906392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:16.906404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:16.906494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401150281996524:6048]
2025-10-15T10:58:16.906512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:16.906538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:16.911559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 516
2025-10-15T10:58:16.911691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 516
2025-10-15T10:58:16.911765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 516, pipe: [1:7561401147482303155:6486]
2025-10-15T10:58:16.912576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:16.912619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:16.912695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14b270be-9832838f-e432cc99-ef65aa9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:16.912731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:16.912748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:16.912761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:16.912798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:16.912839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:16.912883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:16.917899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:16.917945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:16.918026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:16.922968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 517 partition: 0 MaxSeqNo: 46 sessionId: src_id|14b270be-9832838f-e432cc99-ef65aa9f_0
2025-10-15T10:58:16.923986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44ec9cd4-b3606a7e-5b0295bc-1a063984_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|14b270be-9832838f-e432cc99-ef65aa9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:16.966333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14b270be-9832838f-e432cc99-ef65aa9f_0] Write session: try to update token
2025-10-15T10:58:16.966404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14b270be-9832838f-e432cc99-ef65aa9f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:17.033910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:17.033951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:17.033965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:17.033976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:17.034015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401150281996524:6048]
2025-10-15T10:58:17.034042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401150281996524:6048]
2025-10-15T10:58:17.034065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401150281996524:6048]
2025-10-15T10:58:17.034252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:17.034272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:17.034285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:17.034390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:17.034403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:17.034415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:17.034430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:17.034454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:17.037906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:17.060691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId: src_id|14b270be-9832838f-e432cc99-ef65aa9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:17.093328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:17.188620Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:17.207477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:17.207523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:17.207602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:17.207615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:17.207655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401150281996524:6048]
2025-10-15T10:58:17.207967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:17.208768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:17.208426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:17.208454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:17.208761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:17.209027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401147482303155:6486]
2025-10-15T10:58:17.217693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 517 reason: error at write: Disconnected sessionId: src_id|14b270be-9832838f-e432cc99-ef65aa9f_0
2025-10-15T10:58:17.218039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 517 sessionId: src_id|14b270be-9832838f-e432cc99-ef65aa9f_0 is DEAD
2025-10-15T10:58:17.222233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b270be-9832838f-e432cc99-ef65aa9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:17.222279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b270be-9832838f-e432cc99-ef65aa9f_0] Write session will restart in 0.007270s
2025-10-15T10:58:17.222392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b270be-9832838f-e432cc99-ef65aa9f_0] Write session: Do CDS request
2025-10-15T10:58:17.222435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b270be-9832838f-e432cc99-ef65aa9f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:17.239428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14b270be-9832838f-e432cc99-ef65aa9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:17.239672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:17.239728Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 518
2025-10-15T10:58:17.240910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:17.241040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:17.241057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:17.241077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:17.242583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 518 sessionId:  describe result for acl check
2025-10-15T10:58:17.242711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:17.242722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:17.242738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:17.242760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401151777270479:6672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:17.247548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401151777270479:6672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:17.260164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401151777270479:6672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:17.277235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401151777270479:6672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:17.277288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401151777270479:6672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:17.277306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401151777270479:6672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:17.277334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:17.294068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:17.304799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:17.305553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:17.305572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:17.305607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:17.305878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:17.306090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401154576963938:6057]
2025-10-15T10:58:17.308457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:17.309470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:17.309540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401151777270565:6486]
2025-10-15T10:58:17.309688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:17.310824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:17.311131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:17.311138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:17.311146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:17.311153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:17.311160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:17.311167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:17.311174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:17.311180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:17.311187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:17.311194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:17.311201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:17.311208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.311216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.311222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.311268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:17.311404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:17.311456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:17.311504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:17.311549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:17.311598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:17.311645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:17.311692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:17.311739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:17.311786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:17.311832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:17.311877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.311925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.311972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.312018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:17.312091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:17.312155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:17.312215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:17.312266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:17.312321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:17.312369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:17.312425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:17.312476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:17.312531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:17.312577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:17.312630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:17.312679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:17.312735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:17.312784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:17.312841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:17.312889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:17.312941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:17.312974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:17.313012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:17.313046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:17.313086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:17.313117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.313170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.313207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.313255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.313300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.313352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.313883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:17.334894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:17.354039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:17.354087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:17.354104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:17.354124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:17.354152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 517 [2:7561401154576963938:6057]
2025-10-15T10:58:17.354205Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:17.354267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:17.354283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:17.354296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:17.354307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:17.354359Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:17.354383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:17.354407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:17.356698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.356727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.356740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.356752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:17.357058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:17.357081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.357253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.357454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.357706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:17.358664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 517
2025-10-15T10:58:17.357785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401154576963933:6057]
2025-10-15T10:58:17.358779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 517
2025-10-15T10:58:17.357803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401154576963933:6057]
2025-10-15T10:58:17.358838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 517, pipe: [1:7561401151777270565:6486]
2025-10-15T10:58:17.357839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401154576963933:6057]
2025-10-15T10:58:17.357889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:17.357978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:17.358034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:17.358049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:17.358060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:17.358197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:17.358219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:17.358366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401154576963933:6057]
2025-10-15T10:58:17.358389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:17.358398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:17.358445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401151777270559:6672], now have 1 active actors on pipe
2025-10-15T10:58:17.358526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401151777270565:6486], now have 1 active actors on pipe
2025-10-15T10:58:17.358548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401151777270469:2467], now have 1 active actors on pipe
2025-10-15T10:58:17.359272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:17.359313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:17.359428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:17.359471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:17.359503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:17.359518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:17.359560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:17.359644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:17.359713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:17.360678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:17.360708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:17.360780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:17.361062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 518 partition: 0 MaxSeqNo: 46 sessionId: src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0
2025-10-15T10:58:17.362109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b270be-9832838f-e432cc99-ef65aa9f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:17.389105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0] Write session: try to update token
2025-10-15T10:58:17.389180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:17.418392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:17.418427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:17.418443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:17.418457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:17.418495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401154576963933:6057]
2025-10-15T10:58:17.418523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401154576963933:6057]
2025-10-15T10:58:17.418549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401154576963933:6057]
2025-10-15T10:58:17.418687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:17.418701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:17.418722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:17.418723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:17.418751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:17.422539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:17.505263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId: src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:17.542269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:17.589196Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:17.592149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:17.592194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:17.595544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:17.595796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:17.595822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:17.612063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 518 reason: error at write: Disconnected sessionId: src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0
2025-10-15T10:58:17.612415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 518 sessionId: src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0 is DEAD
2025-10-15T10:58:17.615803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:17.615844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0] Write session will restart in 0.007095s
2025-10-15T10:58:17.615953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0] Write session: Do CDS request
2025-10-15T10:58:17.615984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:17.621844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:17.632988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:17.662971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401151777270565:6486]
2025-10-15T10:58:17.663079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:17.663094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 519
2025-10-15T10:58:17.670487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:17.670631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:17.670647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:17.670655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:17.672110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 519 sessionId:  describe result for acl check
2025-10-15T10:58:17.672228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:17.672248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:17.672258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:17.672275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401151777270644:6683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:17.674961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401151777270644:6683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:17.684566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401151777270644:6683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:17.686311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:17.689395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:17.690211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:17.690236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:17.690277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:17.690525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:17.690715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401154576964054:6059]
2025-10-15T10:58:17.692974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:17.694272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:17.694483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:17.694159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401151777270644:6683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:17.694201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401151777270644:6683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:17.694220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401151777270644:6683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:17.694253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:17.695739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:17.696070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:17.696078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:17.696084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:17.696091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:17.696097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:17.696104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:17.696112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:17.696118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:17.696124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:17.696132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:17.696139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:17.696146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.696153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.696160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.696202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:17.696308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:17.696353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:17.696397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:17.696446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:17.696495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:17.696542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:17.696586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:17.696631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:17.696675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:17.696716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:17.696756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.696796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.696835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.696876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:17.696936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:17.696989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:17.697038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:17.697082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:17.697127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:17.697181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:17.697230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:17.697274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:17.697327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:17.697369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:17.697422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:17.697468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:17.697517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:17.697560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:17.697610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:17.697656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:17.697704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:17.697748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:17.697800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:17.697846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:17.697896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:17.697939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.697991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.698035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.698083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.698123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.698180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.699926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:17.735014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:17.748133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:17.748172Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:17.748187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:17.748203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:17.748224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 518 [2:7561401154576964054:6059]
2025-10-15T10:58:17.748270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:17.748322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:17.748335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:17.748347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:17.748356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:17.748398Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:17.748418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:17.748437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:17.750358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.750374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.750386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.750397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:17.750672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:17.750689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:17.750821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:17.751006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:17.751235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:17.751296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401154576964049:6059]
2025-10-15T10:58:17.751310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401154576964049:6059]
2025-10-15T10:58:17.751322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401154576964049:6059]
2025-10-15T10:58:17.751989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:17.752009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:17.752020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:17.752352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:17.752439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:17.752611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:17.752627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:17.752671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401151777270593:2467], now have 1 active actors on pipe
2025-10-15T10:58:17.752694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401151777270682:6683], now have 1 active actors on pipe
2025-10-15T10:58:17.752793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401154576964049:6059]
2025-10-15T10:58:17.752822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:17.753136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:17.756300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:17.756336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:17.756412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:17.756443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:17.756460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:17.756471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:17.756506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:17.756538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:17.756570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:17.755506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 518
2025-10-15T10:58:17.755614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 518
2025-10-15T10:58:17.759749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:17.759784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:17.759868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:17.763585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 519 partition: 0 MaxSeqNo: 46 sessionId: src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0
2025-10-15T10:58:17.767638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a09c58-5a1a89a1-e3a3a887-680e27c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:17.768568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401151777270702:6486]
2025-10-15T10:58:17.769216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401151777270702:6486], now have 1 active actors on pipe
2025-10-15T10:58:17.773531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 518, pipe: [1:7561401151777270702:6486]
2025-10-15T10:58:17.807318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0] Write session: try to update token
2025-10-15T10:58:17.808387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:17.904190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:17.904220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:17.904232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:17.904244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:17.904275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401154576964049:6059]
2025-10-15T10:58:17.904299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401154576964049:6059]
2025-10-15T10:58:17.904321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401154576964049:6059]
2025-10-15T10:58:17.904470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:17.904483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:17.904493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:17.904588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:17.904604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:17.905692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:17.907510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:17.907544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:17.907570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:17.950822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId: src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:17.978335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:18.063677Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:18.084302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:18.084357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:18.084432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:18.084448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:18.084491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401154576964049:6059]
2025-10-15T10:58:18.084967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:18.085061Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:18.086231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:18.086475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:18.087589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401151777270702:6486]
2025-10-15T10:58:18.118157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 519 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0
2025-10-15T10:58:18.118518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 519 sessionId: src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0 is DEAD
2025-10-15T10:58:18.118881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:18.118932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0] Write session will restart in 0.007758s
2025-10-15T10:58:18.119102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0] Write session: Do CDS request
2025-10-15T10:58:18.119151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:18.134880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:18.138915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:18.138952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 520
2025-10-15T10:58:18.139404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:18.139548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:18.139571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:18.139582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:18.141800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 520 sessionId:  describe result for acl check
2025-10-15T10:58:18.141928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:18.141950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:18.141961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:18.141979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401156072238083:6691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:18.144824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401156072238083:6691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:18.149039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:18.151277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401156072238083:6691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:18.155862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:18.156854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:18.156885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:18.156932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:18.157220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:18.157413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401158871931467:6069]
2025-10-15T10:58:18.159782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:18.160737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:18.160971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:18.164921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401156072238083:6691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:18.164971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401156072238083:6691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:18.164989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401156072238083:6691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:18.165024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:18.162280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:18.162620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.162629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.162636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.162642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.162649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.162655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.162662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.162669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.162675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.162682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.162690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.162697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.162704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.162711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.162760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.162866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.162916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.162961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.163004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.163051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.163094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.163138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.163181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.163229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.163274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.163318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.163386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.163431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.163475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.163539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.163597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.163649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.163698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.163747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.163794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.163842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.163888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.163943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.163989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.164039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.164085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.164136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.164180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.164232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.164277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.164329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.164371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.164424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.164469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.164521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.164564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.164615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.164663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.164716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.164760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.164813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.165313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:18.186599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401156072238120:6486]
2025-10-15T10:58:18.198000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:18.208086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:18.208130Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:18.208146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:18.208163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:18.208186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 519 [2:7561401158871931467:6069]
2025-10-15T10:58:18.208235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:18.208290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:18.208304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:18.208316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:18.208325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:18.208370Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:18.208388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:18.208407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:18.209388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.209404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.209417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.209427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:18.209696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:18.209714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.209849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.210021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.210243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:18.210322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401156072238120:6486], now have 1 active actors on pipe
2025-10-15T10:58:18.210345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401156072238117:6691], now have 1 active actors on pipe
2025-10-15T10:58:18.210365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401156072238022:2467], now have 1 active actors on pipe
2025-10-15T10:58:18.210388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401158871931462:6069]
2025-10-15T10:58:18.210402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401158871931462:6069]
2025-10-15T10:58:18.210414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401158871931462:6069]
2025-10-15T10:58:18.210456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:18.210521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:18.210693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:18.210707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:18.210817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401158871931462:6069]
2025-10-15T10:58:18.210837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:18.210966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:18.210981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:18.210992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:18.211017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:18.211929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:18.211959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:18.212044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:18.212073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:18.212089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:18.212100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:18.212132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:18.212168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:18.212213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:18.211517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 519, pipe: [1:7561401156072238120:6486]
2025-10-15T10:58:18.211635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 519
2025-10-15T10:58:18.211711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 519
2025-10-15T10:58:18.213337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:18.213364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:18.213429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:18.214153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 520 partition: 0 MaxSeqNo: 46 sessionId: src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0
2025-10-15T10:58:18.215558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4842b2cc-1960be51-5c976d9c-1dbd819c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:18.249380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0] Write session: try to update token
2025-10-15T10:58:18.249448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:18.312891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:18.312923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:18.312939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:18.312953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:18.312994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401158871931462:6069]
2025-10-15T10:58:18.313022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401158871931462:6069]
2025-10-15T10:58:18.313050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401158871931462:6069]
2025-10-15T10:58:18.313184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:18.313231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:18.313235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:18.313249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:18.313259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:18.313262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:18.313327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:18.313349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:18.314289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:18.342155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId: src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:18.369867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:18.462258Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:18.464025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:18.464057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:18.466342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:18.466370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:18.466455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:18.466561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:18.466710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401156072238120:6486]
2025-10-15T10:58:18.505959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:18.507216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 520 reason: error at write: Disconnected sessionId: src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0
2025-10-15T10:58:18.507522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 520 sessionId: src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0 is DEAD
2025-10-15T10:58:18.507959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:18.508035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0] Write session will restart in 0.009482s
2025-10-15T10:58:18.508228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0] Write session: Do CDS request
2025-10-15T10:58:18.508300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:18.511775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:18.513228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:18.513271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:18.513322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:18.513570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:18.513750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401158871931570:6072]
2025-10-15T10:58:18.515978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:18.516946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:18.517137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:18.518258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:18.518561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.518577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.518583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.518589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.518596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.518602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.518608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.518614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.518621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.518628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.518634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.518640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.518645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.518650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.518687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.518772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.518809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.518845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.518880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.518912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.518946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.518986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.519026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.519066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.519105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.519145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.519184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.519224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.519268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.519328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.519398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.519448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.519493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.519537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.519577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.519622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.519661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.519706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.519745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.519792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.519842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.519885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.519922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.519969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.520010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.520058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.520093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.520138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.520180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.520225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.520265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.520309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.520348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.520392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.520447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.520497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.520911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:18.524924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:18.524988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 521
2025-10-15T10:58:18.525392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:18.526094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:18.526254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:18.526280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:18.526293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:18.527450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 521 sessionId:  describe result for acl check
2025-10-15T10:58:18.527518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:18.527532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:18.527540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:18.527554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401156072238199:6696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:18.529567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401156072238199:6696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:18.534830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401156072238199:6696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:18.541284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401156072238199:6696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:18.541378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401156072238199:6696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:18.541420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401156072238199:6696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:18.541477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:18.542903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:18.553099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:18.553146Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:18.553174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:18.553194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:18.553220Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 520 [2:7561401158871931570:6072]
2025-10-15T10:58:18.553273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:18.553336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:18.553351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:18.553362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:18.553373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:18.553419Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:18.553440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:18.553460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:18.554539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.554554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.554566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.554576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:18.554850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:18.554866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.554999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.555184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.555902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:18.556010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401156072238228:6696], now have 1 active actors on pipe
2025-10-15T10:58:18.556041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401156072238129:2467], now have 1 active actors on pipe
2025-10-15T10:58:18.556068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401158871931565:6072]
2025-10-15T10:58:18.556089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401158871931565:6072]
2025-10-15T10:58:18.556102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401158871931565:6072]
2025-10-15T10:58:18.556144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:18.556199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:18.556222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:18.556229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:18.556242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:18.556394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:18.556416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:18.556550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:18.556574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:18.556604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401158871931565:6072]
2025-10-15T10:58:18.556634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:18.556661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:18.556734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c77de077-9696f78b-23b10eae-524c4164_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:18.556763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:18.556784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:18.556793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:18.556826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:18.556865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:18.556958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:18.557822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:18.557852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:18.557912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:18.559234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce053b88-951cb619-aaa9ab46-e4f16196_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c77de077-9696f78b-23b10eae-524c4164_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:18.556176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 520
2025-10-15T10:58:18.556283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 520
2025-10-15T10:58:18.558493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 521 partition: 0 MaxSeqNo: 46 sessionId: src_id|c77de077-9696f78b-23b10eae-524c4164_0
2025-10-15T10:58:18.567043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401156072238233:6486]
2025-10-15T10:58:18.567634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401156072238233:6486], now have 1 active actors on pipe
2025-10-15T10:58:18.567819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 520, pipe: [1:7561401156072238233:6486]
2025-10-15T10:58:18.581337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c77de077-9696f78b-23b10eae-524c4164_0] Write session: try to update token
2025-10-15T10:58:18.581397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c77de077-9696f78b-23b10eae-524c4164_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:18.651016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:18.651047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:18.651059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:18.651069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:18.651100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401158871931565:6072]
2025-10-15T10:58:18.651126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401158871931565:6072]
2025-10-15T10:58:18.651149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401158871931565:6072]
2025-10-15T10:58:18.651281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:18.651319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:18.651365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:18.671810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:18.671858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:18.673272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:18.691191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId: src_id|c77de077-9696f78b-23b10eae-524c4164_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:18.718367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:18.816062Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:18.821942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:18.821981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:18.822020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401158871931565:6072]
2025-10-15T10:58:18.822151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:18.822158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:18.822183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:18.822833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401156072238233:6486]
2025-10-15T10:58:18.822947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:18.822931Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:18.822965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:18.823954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:18.833529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 521 reason: error at write: Disconnected sessionId: src_id|c77de077-9696f78b-23b10eae-524c4164_0
2025-10-15T10:58:18.833873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 521 sessionId: src_id|c77de077-9696f78b-23b10eae-524c4164_0 is DEAD
2025-10-15T10:58:18.834834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c77de077-9696f78b-23b10eae-524c4164_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:18.834896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c77de077-9696f78b-23b10eae-524c4164_0] Write session will restart in 0.007984s
2025-10-15T10:58:18.835089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c77de077-9696f78b-23b10eae-524c4164_0] Write session: Do CDS request
2025-10-15T10:58:18.835154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c77de077-9696f78b-23b10eae-524c4164_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:18.852020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:18.852050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 522
2025-10-15T10:58:18.852281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c77de077-9696f78b-23b10eae-524c4164_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:18.852734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:18.852874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:18.852895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:18.852905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:18.854499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 522 sessionId:  describe result for acl check
2025-10-15T10:58:18.854680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:18.854713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:18.854733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:18.854768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401156072238262:6701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:18.859831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401156072238262:6701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:18.866510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401156072238262:6701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:18.874376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401156072238262:6701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:18.874419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401156072238262:6701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:18.874435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401156072238262:6701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:18.874461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:18.883832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:18.886948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:18.887803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:18.887830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:18.887876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:18.888121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:18.888315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401158871931696:6081]
2025-10-15T10:58:18.890570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:18.891496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:18.891676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:18.892907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:18.893252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.893260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.893267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.893284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.893293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.893299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.893307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.893313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.893321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.893328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.893335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.893343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.893352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.893359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.893419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.893529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.893576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.893624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.893669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.893714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.893760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.893804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.893851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.893898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.893942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.893985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.894029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.894077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.894119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.894183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:18.894241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.894296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:18.894342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.894408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:18.894453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.894506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:18.894555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.894611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:18.894653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.894705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:18.894747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.894799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:18.894842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.894893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:18.894940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.894990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:18.895030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.895083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:18.895127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.895179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:18.895221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.895273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.895317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.896441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.896500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.896559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.897052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:18.922867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401156072238352:6486]
2025-10-15T10:58:18.924302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:18.934053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:18.934106Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:18.934122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:18.934141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:18.934163Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 521 [2:7561401158871931696:6081]
2025-10-15T10:58:18.934213Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:18.934272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:18.934286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:18.934299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:18.934310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:18.934357Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:18.934378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:18.934400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:18.936214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.936242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.936255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.936267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:18.936545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:18.936574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:18.936711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:18.936899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:18.937142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:18.937225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401156072238248:2467], now have 1 active actors on pipe
2025-10-15T10:58:18.937248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401156072238330:6701], now have 1 active actors on pipe
2025-10-15T10:58:18.937266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401156072238352:6486], now have 1 active actors on pipe
2025-10-15T10:58:18.936868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 521
2025-10-15T10:58:18.936869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 521
2025-10-15T10:58:18.936967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 521, pipe: [1:7561401156072238352:6486]
2025-10-15T10:58:18.937333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:18.937360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:18.937399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401158871931691:6081]
2025-10-15T10:58:18.937417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401158871931691:6081]
2025-10-15T10:58:18.937428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401158871931691:6081]
2025-10-15T10:58:18.937468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:18.937550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:18.937736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:18.937761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:18.937833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:18.937872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:18.937894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:18.937904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:18.937942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:18.937991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:18.938134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401158871931691:6081]
2025-10-15T10:58:18.938160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:18.938208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:18.938309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:18.938332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:18.938344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:18.938370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:18.939790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:18.939829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:18.939900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:18.940218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 522 partition: 0 MaxSeqNo: 46 sessionId: src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0
2025-10-15T10:58:18.943591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c77de077-9696f78b-23b10eae-524c4164_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:18.975270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0] Write session: try to update token
2025-10-15T10:58:18.975328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:18.993687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:18.993721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:18.993759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401158871931691:6081]
2025-10-15T10:58:18.993906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:18.993905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:18.995806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:18.997174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:18.998388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:18.999890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:19.002654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:19.003130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:19.034444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:19.034473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:19.034485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:19.096873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:19.096908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:19.096922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:19.096933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:19.096972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401158871931691:6081]
2025-10-15T10:58:19.096999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401158871931691:6081]
2025-10-15T10:58:19.097028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401158871931691:6081]
2025-10-15T10:58:19.097182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:19.097199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:19.097219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:19.097224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:19.097258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:19.100484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:19.108460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId: src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:19.130592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:19.241724Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:19.243875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:19.243917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:19.244693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:19.245443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:19.254131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 522 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0
2025-10-15T10:58:19.254838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:19.254883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0] Write session will restart in 0.006130s
2025-10-15T10:58:19.255015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0] Write session: Do CDS request
2025-10-15T10:58:19.255065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:19.254495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 522 sessionId: src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0 is DEAD
2025-10-15T10:58:19.268614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:19.308323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:19.310480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:19.311301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:19.311320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:19.311380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:19.313692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401156072238352:6486]
2025-10-15T10:58:19.313769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:19.314004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:19.314018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 523
2025-10-15T10:58:19.311639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:19.311832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401163166899113:6089]
2025-10-15T10:58:19.314089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:19.315331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:19.315479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:19.315495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:19.315504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:19.316928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 523 sessionId:  describe result for acl check
2025-10-15T10:58:19.317035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:19.317045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:19.317055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:19.317071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401160367205745:6713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:19.316001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:19.316225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:19.317554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:19.317885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:19.317894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:19.317901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:19.317910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:19.317917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:19.317924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:19.317932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:19.317939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:19.317947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:19.317954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:19.317961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:19.317968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.317975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.317983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.318031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:19.318142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:19.318196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:19.318240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:19.318287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:19.318335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:19.318384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:19.318428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:19.318474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:19.318524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:19.318568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:19.318617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.318661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.318707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.318749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:19.318816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:19.318875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:19.318932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:19.318983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:19.319039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:19.319084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:19.319140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:19.319189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:19.319246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:19.319293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:19.319957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401160367205745:6713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:19.320854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:19.320941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:19.321017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:19.321074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:19.321139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:19.321208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:19.321269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:19.321324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:19.321383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:19.321440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:19.321500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:19.321555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.321619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.321674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.321737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.321786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.321846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.322394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:19.328484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401160367205745:6713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:19.337472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401160367205745:6713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:19.337511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401160367205745:6713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:19.337522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401160367205745:6713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:19.337542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:19.342800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:19.352837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:19.352878Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:19.352895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:19.352913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:19.352937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 522 [2:7561401163166899113:6089]
2025-10-15T10:58:19.352986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:19.353043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:19.353057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:19.353072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:19.353082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:19.353131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:19.353152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:19.353188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:19.354743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.354757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.354770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.354784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:19.355040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:19.355059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.355198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.355422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 522
2025-10-15T10:58:19.355517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 522
2025-10-15T10:58:19.355895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.356137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:19.356217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401160367205775:6713], now have 1 active actors on pipe
2025-10-15T10:58:19.356239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401160367205739:2467], now have 1 active actors on pipe
2025-10-15T10:58:19.356264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401163166899108:6089]
2025-10-15T10:58:19.356280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401163166899108:6089]
2025-10-15T10:58:19.356293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401163166899108:6089]
2025-10-15T10:58:19.356331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:19.356402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:19.356576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:19.356583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:19.356589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:19.356600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:19.356601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:19.356737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401163166899108:6089]
2025-10-15T10:58:19.356763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:19.356794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:19.356819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:19.356838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:19.356981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15b71ba4-eb847080-19bc351-6908e7cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:19.357012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:19.357030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:19.357041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:19.357076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:19.357116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:19.357188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:19.358482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:19.358511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:19.358574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:19.358974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 523 partition: 0 MaxSeqNo: 46 sessionId: src_id|15b71ba4-eb847080-19bc351-6908e7cd_0
2025-10-15T10:58:19.359726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7078fb8c-a9db0979-707b6f4c-ceafa464_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|15b71ba4-eb847080-19bc351-6908e7cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:19.384629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b71ba4-eb847080-19bc351-6908e7cd_0] Write session: try to update token
2025-10-15T10:58:19.384677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b71ba4-eb847080-19bc351-6908e7cd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:19.414008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401160367205783:6486]
2025-10-15T10:58:19.415428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 522, pipe: [1:7561401160367205783:6486]
2025-10-15T10:58:19.461282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId: src_id|15b71ba4-eb847080-19bc351-6908e7cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:19.493706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:19.493738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:19.493750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:19.493762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:19.493794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401163166899108:6089]
2025-10-15T10:58:19.493821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401163166899108:6089]
2025-10-15T10:58:19.493845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401163166899108:6089]
2025-10-15T10:58:19.493999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401160367205783:6486], now have 1 active actors on pipe
2025-10-15T10:58:19.494083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:19.494077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:19.494094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:19.494105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:19.494117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:19.494146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:19.494146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:19.494165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:19.498363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:19.513571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:19.653348Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:19.667087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:19.667131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:19.667191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:19.667204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:19.667259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401163166899108:6089]
2025-10-15T10:58:19.670001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:19.670452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:19.671246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401160367205783:6486]
2025-10-15T10:58:19.671319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:19.671496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:19.684790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 523 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15b71ba4-eb847080-19bc351-6908e7cd_0
2025-10-15T10:58:19.685099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 523 sessionId: src_id|15b71ba4-eb847080-19bc351-6908e7cd_0 is DEAD
2025-10-15T10:58:19.691924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b71ba4-eb847080-19bc351-6908e7cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:19.691958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b71ba4-eb847080-19bc351-6908e7cd_0] Write session will restart in 0.005775s
2025-10-15T10:58:19.692045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b71ba4-eb847080-19bc351-6908e7cd_0] Write session: Do CDS request
2025-10-15T10:58:19.692070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b71ba4-eb847080-19bc351-6908e7cd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:19.701885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b71ba4-eb847080-19bc351-6908e7cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:19.707582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:19.707635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 524
2025-10-15T10:58:19.708203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:19.708431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:19.708453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:19.708495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:19.710391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 524 sessionId:  describe result for acl check
2025-10-15T10:58:19.710468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:19.710475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:19.710482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:19.710493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401160367205818:6721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:19.712162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401160367205818:6721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:19.721960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401160367205818:6721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:19.734795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401160367205818:6721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:19.734847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401160367205818:6721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:19.734864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401160367205818:6721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:19.734896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:19.742773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:19.752456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:19.753245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:19.753257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:19.753283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:19.753470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:19.753639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401163166899227:6093]
2025-10-15T10:58:19.755571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:19.756546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:19.756747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:19.757850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:19.758128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:19.758151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:19.758158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:19.758165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:19.758172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:19.758179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:19.758185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:19.758191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:19.758198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:19.758204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:19.758212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:19.758219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.758225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.758233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.758277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:19.758382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:19.758428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:19.758472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:19.758517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:19.758563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:19.758607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:19.758661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:19.758714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:19.758767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:19.758818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:19.758872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.758923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.758973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.759019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:19.759087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:19.759164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:19.759225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:19.759282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:19.759364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:19.759416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:19.759474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:19.759529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:19.759714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:19.759771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:19.759824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:19.759871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:19.759922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:19.759964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:19.760029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:19.760077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:19.760131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:19.760176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:19.760229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:19.760271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:19.760323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:19.760369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.760420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.760465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.760516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.760562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.760615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.761115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:19.771290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401160367205903:6486]
2025-10-15T10:58:19.779060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:19.789376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:19.789413Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:19.789428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:19.789446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:19.789468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 523 [2:7561401163166899227:6093]
2025-10-15T10:58:19.789518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:19.789573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:19.789586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:19.789598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:19.789609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:19.789651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:19.789680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:19.789700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:19.790791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.790813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.790826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.790837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:19.791077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:19.791101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:19.791230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:19.791839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:19.791882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 523, pipe: [1:7561401160367205903:6486]
2025-10-15T10:58:19.791991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 523
2025-10-15T10:58:19.792065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:19.792075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 523
2025-10-15T10:58:19.792143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401160367205903:6486], now have 1 active actors on pipe
2025-10-15T10:58:19.792169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401160367205802:2467], now have 1 active actors on pipe
2025-10-15T10:58:19.792188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401160367205895:6721], now have 1 active actors on pipe
2025-10-15T10:58:19.792210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401163166899222:6093]
2025-10-15T10:58:19.792223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401163166899222:6093]
2025-10-15T10:58:19.792235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401163166899222:6093]
2025-10-15T10:58:19.792269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:19.792334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:19.792501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:19.792517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:19.792623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401163166899222:6093]
2025-10-15T10:58:19.792642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:19.792786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:19.792797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:19.792807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:19.792827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:19.792928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:19.792950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:19.793029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:19.793060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:19.793077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:19.793088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:19.793121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:19.793157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:19.793216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:19.794825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:19.794857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:19.794918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:19.795221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 524 partition: 0 MaxSeqNo: 46 sessionId: src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0
2025-10-15T10:58:19.799594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b71ba4-eb847080-19bc351-6908e7cd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:19.827386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0] Write session: try to update token
2025-10-15T10:58:19.827438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:19.883515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:19.883547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:19.883560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:19.883571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:19.883605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401163166899222:6093]
2025-10-15T10:58:19.883633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401163166899222:6093]
2025-10-15T10:58:19.883655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401163166899222:6093]
2025-10-15T10:58:19.883766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:19.883797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:19.883830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:19.883854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:19.883877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:19.885234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:19.923098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId: src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:19.946102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:20.026869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:20.044563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:20.044613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:20.044680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:20.044694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:20.044736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401163166899222:6093]
2025-10-15T10:58:20.044859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:20.045128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:20.045168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:20.045169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:20.045353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401160367205903:6486]
2025-10-15T10:58:20.045409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:20.055660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 524 reason: error at write: Disconnected sessionId: src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0
2025-10-15T10:58:20.055932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 524 sessionId: src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0 is DEAD
2025-10-15T10:58:20.056258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:20.056299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0] Write session will restart in 0.009343s
2025-10-15T10:58:20.056420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0] Write session: Do CDS request
2025-10-15T10:58:20.056456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:20.069935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:20.069973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 525
2025-10-15T10:58:20.070131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:20.070682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:20.070825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:20.070854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:20.070869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:20.072782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 525 sessionId:  describe result for acl check
2025-10-15T10:58:20.072933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:20.072961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:20.072978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:20.073002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401164662173258:6726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:20.075957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401164662173258:6726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:20.084069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401164662173258:6726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:20.090513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:20.090654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401164662173258:6726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:20.090691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401164662173258:6726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:20.090706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401164662173258:6726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:20.090732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:20.093350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:20.094069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:20.094094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:20.094129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:20.094351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:20.094521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401167461866638:6096]
2025-10-15T10:58:20.096549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:20.097471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:20.097688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:20.098850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:20.099163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.099182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.099189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.099195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.099202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.099208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.099215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.099222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.099228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.099235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.099242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.099249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.099254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.099261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.099305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.099429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.099474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.099519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.099564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.099620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.099665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.099714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.099760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.099810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.099857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.099903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.099953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.100001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.100047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.100114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.100180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.100234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.100288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.100343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.100388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.100444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.100496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.100552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.100602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.100650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.100701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.100756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.100803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.100872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.100927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.100983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.101033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.101085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.101133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.101200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.101248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.101301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.101348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.101399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.101447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.101501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.101966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:20.116338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:20.126991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:20.127028Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:20.127041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:20.127058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:20.127078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 524 [2:7561401167461866638:6096]
2025-10-15T10:58:20.127123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:20.127173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:20.127186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:20.127196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:20.127204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:20.127246Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:20.127265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:20.127285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:20.129111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.129136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.129148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.129158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:20.129422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:20.129443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.129557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.129700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 524
2025-10-15T10:58:20.129725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.129710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 524
2025-10-15T10:58:20.129942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:20.130016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401164662173323:6726], now have 1 active actors on pipe
2025-10-15T10:58:20.130043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401164662173227:2467], now have 1 active actors on pipe
2025-10-15T10:58:20.130099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:20.130116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:20.130148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401167461866632:6096]
2025-10-15T10:58:20.130165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401167461866632:6096]
2025-10-15T10:58:20.130177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401167461866632:6096]
2025-10-15T10:58:20.130210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:20.130242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:20.130256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:20.130269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:20.130285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:20.130422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:20.130444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:20.130499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d055de3-66710b8d-104ad951-69add816_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:20.130529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:20.130544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:20.130553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:20.130585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:20.130617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:20.130726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401167461866632:6096]
2025-10-15T10:58:20.130771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:20.130803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:20.130813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:20.131255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:20.131277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:20.131328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:20.131619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 525 partition: 0 MaxSeqNo: 46 sessionId: src_id|6d055de3-66710b8d-104ad951-69add816_0
2025-10-15T10:58:20.132278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2e17294-c6d2da00-7bfc63ba-c82b9aab_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6d055de3-66710b8d-104ad951-69add816_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:20.145489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401164662173334:6486]
2025-10-15T10:58:20.145798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401164662173334:6486], now have 1 active actors on pipe
2025-10-15T10:58:20.145856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 524, pipe: [1:7561401164662173334:6486]
2025-10-15T10:58:20.155512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d055de3-66710b8d-104ad951-69add816_0] Write session: try to update token
2025-10-15T10:58:20.155559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d055de3-66710b8d-104ad951-69add816_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:20.160706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:20.160740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:20.160774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401167461866632:6096]
2025-10-15T10:58:20.160885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:20.162933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:20.163449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:20.164337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:20.165662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:20.174734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:20.176674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:20.178590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:20.229902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:20.229930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:20.229943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:20.229953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:20.229988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401167461866632:6096]
2025-10-15T10:58:20.230014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401167461866632:6096]
2025-10-15T10:58:20.230037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401167461866632:6096]
2025-10-15T10:58:20.230182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:20.230180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:20.230193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:20.230203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:20.230211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:20.230238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:20.230243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:20.230261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:20.231309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:20.239530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId: src_id|6d055de3-66710b8d-104ad951-69add816_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:20.261503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:20.372112Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:20.374194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:20.374240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:20.374932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:20.376474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:20.376894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401164662173334:6486]
2025-10-15T10:58:20.377009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:20.385034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 525 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d055de3-66710b8d-104ad951-69add816_0
2025-10-15T10:58:20.385275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 525 sessionId: src_id|6d055de3-66710b8d-104ad951-69add816_0 is DEAD
2025-10-15T10:58:20.385738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d055de3-66710b8d-104ad951-69add816_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:20.385785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d055de3-66710b8d-104ad951-69add816_0] Write session will restart in 0.006507s
2025-10-15T10:58:20.385929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d055de3-66710b8d-104ad951-69add816_0] Write session: Do CDS request
2025-10-15T10:58:20.385963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d055de3-66710b8d-104ad951-69add816_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:20.400968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d055de3-66710b8d-104ad951-69add816_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:20.400712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:20.400763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 526
2025-10-15T10:58:20.401568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:20.401750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:20.401777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:20.401793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:20.405852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 526 sessionId:  describe result for acl check
2025-10-15T10:58:20.405980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:20.405991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:20.405999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:20.406015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401164662173351:6730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:20.409416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401164662173351:6730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:20.416342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401164662173351:6730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:20.423862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401164662173351:6730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:20.423903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401164662173351:6730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:20.423919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401164662173351:6730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:20.423949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:20.438379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:20.453906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:20.454769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:20.454786Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:20.454829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:20.455060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:20.455229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401167461866759:6105]
2025-10-15T10:58:20.458470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:20.460230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:20.460465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:20.461924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:20.462367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.462390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.462396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.462402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.462408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.462415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.462421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.462427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.462433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.462438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.462444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.462451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.462458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.462463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.462507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.462616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.462658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.462698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.462740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.462777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.462818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.462859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.462897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.462939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.462981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.463021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.463058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.463096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.463134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.463192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.463244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.463296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.463339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.463406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.463447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.463493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.463534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.463581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.463622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.463667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.463708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.463754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.463793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.463837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.463878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.463924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.463964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.464008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.464047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.464094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.464135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.464183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.464222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.464267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.464307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.464352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.464781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:20.479503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401164662173443:6486]
2025-10-15T10:58:20.490220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:20.500324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:20.500363Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:20.500379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:20.500395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:20.500416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 525 [2:7561401167461866759:6105]
2025-10-15T10:58:20.500460Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:20.500507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:20.500521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:20.500531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:20.500541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:20.500583Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:20.500603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:20.500622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:20.502265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.502274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.502281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.502288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:20.502507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:20.502521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.502622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.502770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.502909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:20.502948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401167461866754:6105]
2025-10-15T10:58:20.502956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401167461866754:6105]
2025-10-15T10:58:20.502963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401167461866754:6105]
2025-10-15T10:58:20.502995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:20.503055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:20.503208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:20.503209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:20.503220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:20.503225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:20.503231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:20.503618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 525, pipe: [1:7561401164662173443:6486]
2025-10-15T10:58:20.503631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 525
2025-10-15T10:58:20.503711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 525
2025-10-15T10:58:20.504069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401164662173443:6486], now have 1 active actors on pipe
2025-10-15T10:58:20.504096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401164662173398:6730], now have 1 active actors on pipe
2025-10-15T10:58:20.504110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401167461866754:6105]
2025-10-15T10:58:20.504128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:20.504188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401164662173339:2467], now have 1 active actors on pipe
2025-10-15T10:58:20.504234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:20.504303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:20.504321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:20.504378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:20.504425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:20.504452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:20.504462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:20.504496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:20.504545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:20.504589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:20.505394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:20.505422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:20.505530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:20.505906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 526 partition: 0 MaxSeqNo: 46 sessionId: src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0
2025-10-15T10:58:20.506616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d055de3-66710b8d-104ad951-69add816_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:20.555693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0] Write session: try to update token
2025-10-15T10:58:20.555743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:20.613029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:20.613068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:20.613083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:20.613157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:20.613171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:20.613185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:20.613208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:20.613237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401167461866754:6105]
2025-10-15T10:58:20.613263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401167461866754:6105]
2025-10-15T10:58:20.613284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401167461866754:6105]
2025-10-15T10:58:20.613453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:20.613466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:20.613646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:20.613687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:20.613710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:20.623554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:20.632998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId: src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:20.696205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:20.763343Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:20.780844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:20.780881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:20.780941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:20.780952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:20.780982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401167461866754:6105]
2025-10-15T10:58:20.783545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:20.783803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401164662173443:6486]
2025-10-15T10:58:20.783933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:20.781332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:20.782027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:20.812784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 526 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0
2025-10-15T10:58:20.814475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:20.814531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0] Write session will restart in 0.007735s
2025-10-15T10:58:20.814664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0] Write session: Do CDS request
2025-10-15T10:58:20.814701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:20.813232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 526 sessionId: src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0 is DEAD
2025-10-15T10:58:20.830412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:20.831162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:20.831198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 527
2025-10-15T10:58:20.832327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:20.832435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:20.832449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:20.832458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:20.834419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 527 sessionId:  describe result for acl check
2025-10-15T10:58:20.834512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:20.834522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:20.834530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:20.834544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401164662173508:6742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:20.836812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401164662173508:6742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:20.846628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401164662173508:6742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:20.853100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:20.855825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401164662173508:6742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:20.855868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401164662173508:6742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:20.855886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401164662173508:6742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:20.855916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:20.858132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:20.858937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:20.858965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:20.859003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:20.859236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:20.859426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401167461866882:6112]
2025-10-15T10:58:20.861444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:20.862426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:20.862603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:20.863728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:20.864020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.864034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.864041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.864048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.864055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.864061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.864067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.864073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.864079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.864085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.864092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.864097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.864103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.864110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.864151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.864246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.864289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.864331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.864371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.864419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.864465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.864509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.864574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.864621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.864666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.864712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.864760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.864799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.864840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.864902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:20.864960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.865013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:20.865062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.865113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:20.865158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.865227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:20.865275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.865326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:20.865370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.865423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:20.865470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.865528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:20.865576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.865630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:20.865682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.865750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:20.865794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.865844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:20.865891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.865944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:20.865988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.866038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.866083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.866135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.866181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.866234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.866695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:20.883121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:20.884994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401164662173585:6486]
E1015 10:58:20.908308298  821866 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:58:20.915284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:20.915319Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:20.915332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:20.915363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:20.915382Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 526 [2:7561401167461866882:6112]
2025-10-15T10:58:20.915422Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:20.915464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:20.915475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:20.915484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:20.915494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:20.915533Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:20.915551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:20.915567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:20.916807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.916832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.916842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.916851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:20.917104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:20.917127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:20.917256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:20.917442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:20.917743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 526
2025-10-15T10:58:20.917836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 526, pipe: [1:7561401164662173585:6486]
2025-10-15T10:58:20.917846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 526
2025-10-15T10:58:20.917644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:20.917718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401164662173469:2467], now have 1 active actors on pipe
2025-10-15T10:58:20.917739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401164662173585:6486], now have 1 active actors on pipe
2025-10-15T10:58:20.917759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401164662173579:6742], now have 1 active actors on pipe
2025-10-15T10:58:20.917780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401167461866876:6112]
2025-10-15T10:58:20.917793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401167461866876:6112]
2025-10-15T10:58:20.917803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401167461866876:6112]
2025-10-15T10:58:20.917839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:20.917869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:20.917883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:20.917893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:20.917895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:20.918047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:20.918062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:20.918159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401167461866876:6112]
2025-10-15T10:58:20.918177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:20.918191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:20.918286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:20.918313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:20.918406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:20.918435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:20.918452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:20.918463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:20.918494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:20.918525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:20.918587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:20.919282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:20.919305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:20.919517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:20.919862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 527 partition: 0 MaxSeqNo: 46 sessionId: src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0
2025-10-15T10:58:20.920536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18dc5c71-fa698652-fd4cf3e5-5f64eb76_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:20.949672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0] Write session: try to update token
2025-10-15T10:58:20.949713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:21.043050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:21.043100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:21.043129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:21.043153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:21.043204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401167461866876:6112]
2025-10-15T10:58:21.043254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401167461866876:6112]
2025-10-15T10:58:21.043297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401167461866876:6112]
2025-10-15T10:58:21.043536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:21.043556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:21.043578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:21.043842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:21.043874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:21.043902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:21.061314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:21.061358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:21.062418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:21.073291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId: src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:21.095766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:21.200657Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:21.201897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:21.201921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:21.201961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401167461866876:6112]
2025-10-15T10:58:21.202073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:21.202087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:21.202109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:21.202774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:21.202872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:21.203088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401164662173585:6486]
2025-10-15T10:58:21.203185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:21.203205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:21.247781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:21.247835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0] Write session will restart in 0.006404s
2025-10-15T10:58:21.247081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 527 reason: error at write: Disconnected sessionId: src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0
2025-10-15T10:58:21.247955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0] Write session: Do CDS request
2025-10-15T10:58:21.247403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 527 sessionId: src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0 is DEAD
2025-10-15T10:58:21.247991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:21.259833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:21.259864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 528
2025-10-15T10:58:21.260042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:21.260347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:21.263921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:21.264089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:21.264115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:21.264125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:21.264506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:21.265817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:21.265865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:21.265941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:21.266393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:21.266749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401171756834306:6118]
2025-10-15T10:58:21.266737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 528 sessionId:  describe result for acl check
2025-10-15T10:58:21.266904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:21.266935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:21.266954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:21.266980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401168957140979:6749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:21.270906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:21.271034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401168957140979:6749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:21.271866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:21.272098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:21.273280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:21.273603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.273620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.273626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.273633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.273640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.273646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.273653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.273659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.273664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.273672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.273678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.273685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.273691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.273697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.273738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.273832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.273875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.273918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.273961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.274012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.274057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.274101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.274153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.274195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.274238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.274280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.274326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.274368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.274405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.274465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.274522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.274577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.274629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.274683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.274729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.274780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.274827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.274880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.274920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.274968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.275013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.275064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.275112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.275167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.275216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.275268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.275315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.275422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.275471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.275522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.275581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.275635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.275683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.275736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.275780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.275834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.276282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:21.281110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401168957140979:6749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:21.287662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401168957140979:6749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:21.287700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401168957140979:6749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:21.287716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401168957140979:6749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:21.287745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:21.293307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:21.298539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401168957141013:6486]
2025-10-15T10:58:21.302798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:21.302838Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:21.302855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:21.302872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:21.302895Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 527 [2:7561401171756834306:6118]
2025-10-15T10:58:21.302946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:21.303002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:21.303016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:21.303028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:21.303037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:21.303080Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:21.303100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:21.303119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:21.310675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.310706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.310721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.310733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:21.311007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:21.311035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.311182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.311386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.311473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 527
2025-10-15T10:58:21.311563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 527
2025-10-15T10:58:21.311629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 527, pipe: [1:7561401168957141013:6486]
2025-10-15T10:58:21.311626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:21.311708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401168957141012:6749], now have 1 active actors on pipe
2025-10-15T10:58:21.311737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401168957140908:2467], now have 1 active actors on pipe
2025-10-15T10:58:21.311757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401168957141013:6486], now have 1 active actors on pipe
2025-10-15T10:58:21.311779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401171756834301:6118]
2025-10-15T10:58:21.311791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401171756834301:6118]
2025-10-15T10:58:21.311802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401171756834301:6118]
2025-10-15T10:58:21.311836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:21.311897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:21.311905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:21.311921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:21.311932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:21.312065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:21.312090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:21.312197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:21.312221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:21.312265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401171756834301:6118]
2025-10-15T10:58:21.312292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:21.312316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:21.312391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:21.312424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:21.312445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:21.312455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:21.312484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:21.312521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:21.312608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:21.313307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:21.313341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:21.313432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:21.313729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 528 partition: 0 MaxSeqNo: 46 sessionId: src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0
2025-10-15T10:58:21.314426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6ef1ae3-30d30b8b-ace01343-f191f57_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:21.334850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0] Write session: try to update token
2025-10-15T10:58:21.334901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:21.396665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:21.396692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:21.396704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:21.396711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:21.396738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401171756834301:6118]
2025-10-15T10:58:21.396759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401171756834301:6118]
2025-10-15T10:58:21.396777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401171756834301:6118]
2025-10-15T10:58:21.396898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:21.396932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:21.396954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:21.396959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:21.396977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:21.398072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:21.438564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId: src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:21.467952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:21.541083Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:21.551178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:21.551224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:21.551286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:21.551299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:21.551334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401171756834301:6118]
2025-10-15T10:58:21.551538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:21.552038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:21.552068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:21.552602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:21.553050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:21.553288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401168957141013:6486]
2025-10-15T10:58:21.578103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 528 reason: error at write: Disconnected sessionId: src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0
2025-10-15T10:58:21.578407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 528 sessionId: src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0 is DEAD
2025-10-15T10:58:21.578765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:21.578821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0] Write session will restart in 0.009210s
2025-10-15T10:58:21.578996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0] Write session: Do CDS request
2025-10-15T10:58:21.579035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:21.592310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:21.592786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:21.592830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 529
2025-10-15T10:58:21.595712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:21.595848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:21.595862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:21.595870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:21.596946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 529 sessionId:  describe result for acl check
2025-10-15T10:58:21.597046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:21.597057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:21.597065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:21.597078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401168957141094:6754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:21.599186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401168957141094:6754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:21.604530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401168957141094:6754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:21.605715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:21.610742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:21.611589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:21.611618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:21.611660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:21.611897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:21.612066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401171756834427:6120]
2025-10-15T10:58:21.614235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:21.615898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:21.616096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:21.616928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401168957141094:6754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:21.616966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401168957141094:6754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:21.616982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401168957141094:6754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:21.617007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:21.617233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:21.617523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.617536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.617543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.617549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.617555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.617562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.617570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.617576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.617583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.617588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.617595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.617601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.617608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.617613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.617654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.617748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.617790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.617831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.617878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.617926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.617973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.618017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.618060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.618106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.618151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.618197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.618242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.618288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.618328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.618389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.618442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.618492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.618538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.618593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.618634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.618686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.618731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.618782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.618826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.618880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.618927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.618974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.619020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.619071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.619117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.619170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.619214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.619267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.619312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.619381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.619426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.619479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.619526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.619575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.619619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.619675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.620159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:21.642655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:21.655459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401168957141133:6486]
2025-10-15T10:58:21.657547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:21.657574Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:21.657584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:21.657601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:21.657616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 528 [2:7561401171756834427:6120]
2025-10-15T10:58:21.657646Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:21.657687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:21.657699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:21.657709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:21.657719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:21.657760Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:21.657781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:21.657799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:21.669279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.669300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.669308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.669315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:21.669509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:21.669519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.669606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.669729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.669870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:21.669911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401171756834413:6120]
2025-10-15T10:58:21.669920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401171756834413:6120]
2025-10-15T10:58:21.669928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401171756834413:6120]
2025-10-15T10:58:21.669961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:21.670029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:21.670179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:21.670190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:21.670191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:21.670202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:21.670205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:21.670329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401168957141025:2467], now have 1 active actors on pipe
2025-10-15T10:58:21.670351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401168957141127:6754], now have 1 active actors on pipe
2025-10-15T10:58:21.670368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401171756834413:6120]
2025-10-15T10:58:21.670395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:21.670409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:21.670466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401168957141133:6486], now have 1 active actors on pipe
2025-10-15T10:58:21.671168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 528
2025-10-15T10:58:21.671257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 528
2025-10-15T10:58:21.671308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 528, pipe: [1:7561401168957141133:6486]
2025-10-15T10:58:21.671796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:21.671822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:21.671889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:21.671917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:21.671933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:21.671943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:21.671974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:21.672010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:21.672049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:21.675750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:21.675772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:21.675818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:21.676139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 529 partition: 0 MaxSeqNo: 46 sessionId: src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0
2025-10-15T10:58:21.677085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c934338-a3355fc2-4afb5233-39d1c4e2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:21.705446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0] Write session: try to update token
2025-10-15T10:58:21.705512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:21.755942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:21.755981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:21.755993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:21.756003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:21.756036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401171756834413:6120]
2025-10-15T10:58:21.756059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401171756834413:6120]
2025-10-15T10:58:21.756083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401171756834413:6120]
2025-10-15T10:58:21.756216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:21.756242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:21.756261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:21.756263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:21.756291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:21.757676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:21.839264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId: src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:21.861166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:21.905895Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:21.915364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:21.915414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:21.917344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401168957141133:6486]
2025-10-15T10:58:21.917469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:21.917661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:21.917686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:21.920079Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:21.945711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:21.945771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0] Write session will restart in 0.009557s
2025-10-15T10:58:21.945913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0] Write session: Do CDS request
2025-10-15T10:58:21.945956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:21.944983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 529 reason: error at write: Disconnected sessionId: src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0
2025-10-15T10:58:21.945351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 529 sessionId: src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0 is DEAD
2025-10-15T10:58:21.963827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:21.965469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:21.965505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 530
2025-10-15T10:58:21.965873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:21.965951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:21.965962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:21.965969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:21.968664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 530 sessionId:  describe result for acl check
2025-10-15T10:58:21.968748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:21.968756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:21.968763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:21.968775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401168957141212:6765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:21.970672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401168957141212:6765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:21.979071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401168957141212:6765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:21.985289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:21.988133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:21.988915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:21.988947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:21.988987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:21.988296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401168957141212:6765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:21.988336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401168957141212:6765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:21.988353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401168957141212:6765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:21.988385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:21.989240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:21.989426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401171756834566:6128]
2025-10-15T10:58:21.991553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:21.992441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:21.992628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:21.993509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:21.993726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.993731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.993736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.993740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.993744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.993749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.993753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.993757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.993761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.993765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.993770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.993773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.993777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.993781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.993811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.993880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.993916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.993960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.993991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.994021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.994050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.994080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.994111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.994143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.994174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.994202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.994234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.994264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.994287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.994331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:21.994377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.994410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:21.994439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.994487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:21.994519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.994552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:21.994582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.994613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:21.994642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.994673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:21.994701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.994735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:21.994762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.994795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:21.994827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.994858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:21.994885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.994917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:21.994947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.994993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:21.995027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.995059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:21.995089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.995122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:21.995150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.995182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:21.996346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:22.017392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401173252108576:6486]
2025-10-15T10:58:22.020460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:22.030533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:22.030569Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:22.030585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:22.030603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:22.030625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 529 [2:7561401171756834566:6128]
2025-10-15T10:58:22.030676Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:22.030727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:22.030749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:22.030760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:22.030771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:22.030814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:22.030839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:22.030859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:22.032486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.032508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.032522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.032532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:22.032814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:22.032839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.032969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.033153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.033400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:22.033478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401173252108576:6486], now have 1 active actors on pipe
2025-10-15T10:58:22.033505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401168957141155:2467], now have 1 active actors on pipe
2025-10-15T10:58:22.033527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401168957141273:6765], now have 1 active actors on pipe
2025-10-15T10:58:22.033552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401171756834550:6128]
2025-10-15T10:58:22.033569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401171756834550:6128]
2025-10-15T10:58:22.033581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401171756834550:6128]
2025-10-15T10:58:22.033618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:22.033658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:22.033679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:22.033689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:22.033691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:22.033577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 529, pipe: [1:7561401173252108576:6486]
2025-10-15T10:58:22.033677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 529
2025-10-15T10:58:22.033747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 529
2025-10-15T10:58:22.033851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:22.033873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:22.033978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401171756834550:6128]
2025-10-15T10:58:22.034006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:22.034040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:22.034398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:22.034425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:22.034501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20ab08bb-17278dd5-f378299f-9727de4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:22.034535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:22.034556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:22.034565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:22.034597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:22.034640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:22.034690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:22.035223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:22.035263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:22.035333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:22.035700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 530 partition: 0 MaxSeqNo: 46 sessionId: src_id|20ab08bb-17278dd5-f378299f-9727de4d_0
2025-10-15T10:58:22.037646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c1d31e9-83d454d0-f8d206c8-f61f0292_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|20ab08bb-17278dd5-f378299f-9727de4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:22.066774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab08bb-17278dd5-f378299f-9727de4d_0] Write session: try to update token
2025-10-15T10:58:22.066825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab08bb-17278dd5-f378299f-9727de4d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:22.127016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:22.127056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:22.127076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:22.127095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:22.127154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401171756834550:6128]
2025-10-15T10:58:22.127180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401171756834550:6128]
2025-10-15T10:58:22.127201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401171756834550:6128]
2025-10-15T10:58:22.127417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:22.127442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:22.127495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:22.127529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:22.127555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:22.136935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:22.170088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId: src_id|20ab08bb-17278dd5-f378299f-9727de4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:22.191205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:22.283920Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:22.313344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:22.313392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:22.313453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:22.313468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:22.313510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401171756834550:6128]
2025-10-15T10:58:22.313719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:22.314128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:22.314066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401173252108576:6486]
2025-10-15T10:58:22.314197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:22.314208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:22.323064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab08bb-17278dd5-f378299f-9727de4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:22.323135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab08bb-17278dd5-f378299f-9727de4d_0] Write session will restart in 0.005973s
2025-10-15T10:58:22.323325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab08bb-17278dd5-f378299f-9727de4d_0] Write session: Do CDS request
2025-10-15T10:58:22.323393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab08bb-17278dd5-f378299f-9727de4d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:22.322420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 530 reason: error at write: Disconnected sessionId: src_id|20ab08bb-17278dd5-f378299f-9727de4d_0
2025-10-15T10:58:22.322681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 530 sessionId: src_id|20ab08bb-17278dd5-f378299f-9727de4d_0 is DEAD
2025-10-15T10:58:22.335050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab08bb-17278dd5-f378299f-9727de4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:22.354409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:22.354435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 531
2025-10-15T10:58:22.354666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:22.355540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:22.355674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:22.355690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:22.355699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:22.356865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 531 sessionId:  describe result for acl check
2025-10-15T10:58:22.356961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:22.356976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:22.356985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:22.357001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401173252108657:6769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:22.359339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401173252108657:6769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:22.367191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401173252108657:6769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:22.375523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:22.380393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:22.381043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401173252108657:6769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:22.381088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401173252108657:6769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:22.381107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401173252108657:6769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:22.381138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:22.381337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:22.381364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:22.381402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:22.381680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:22.381862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401176051801976:6137]
2025-10-15T10:58:22.384339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:22.385458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:22.385681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:22.386910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:22.387244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:22.387262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:22.387270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:22.387276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:22.387283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:22.387290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:22.387296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:22.387303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:22.387309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:22.387316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:22.387325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:22.387331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.387338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.387381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.387431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:22.387536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:22.387584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:22.387640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:22.387697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:22.387743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:22.387791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:22.387847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:22.387893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:22.387946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:22.387999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:22.388041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.388091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.388137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.388187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:22.388257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:22.388319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:22.388382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:22.388431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:22.388490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:22.388541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:22.388599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:22.388651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:22.388710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:22.388758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:22.388816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:22.388869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:22.388926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:22.388978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:22.389038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:22.389087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:22.389139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:22.389186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:22.389254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:22.389301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:22.389352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:22.389399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.389450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.389497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.389548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.389592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.389645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.390145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:22.414309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401173252108705:6486]
2025-10-15T10:58:22.415222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:22.440333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:22.440382Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:22.440399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:22.440416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:22.440439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 530 [2:7561401176051801976:6137]
2025-10-15T10:58:22.440489Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:22.442618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 530
2025-10-15T10:58:22.442656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 530, pipe: [1:7561401173252108705:6486]
2025-10-15T10:58:22.442704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 530
2025-10-15T10:58:22.440546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:22.440560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:22.440572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:22.440583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:22.440630Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:22.440650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:22.440670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:22.441933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.441948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.441961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.441971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:22.442223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:22.442239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.442378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.443268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.443514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:22.443585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401173252108652:2467], now have 1 active actors on pipe
2025-10-15T10:58:22.443609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401173252108705:6486], now have 1 active actors on pipe
2025-10-15T10:58:22.443631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401173252108688:6769], now have 1 active actors on pipe
2025-10-15T10:58:22.443691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:22.443710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:22.443741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401176051801969:6137]
2025-10-15T10:58:22.443753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401176051801969:6137]
2025-10-15T10:58:22.443766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401176051801969:6137]
2025-10-15T10:58:22.444068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:22.444123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:22.444142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:22.444145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:22.444156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:22.444314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:22.444329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:22.444388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88b5b361-1878fa7b-421c4792-801b3932_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:22.444414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:22.444431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:22.444441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:22.444470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:22.444505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:22.444612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401176051801969:6137]
2025-10-15T10:58:22.444638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:22.444660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:22.444681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:22.447893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:22.447923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:22.447989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:22.448313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 531 partition: 0 MaxSeqNo: 46 sessionId: src_id|88b5b361-1878fa7b-421c4792-801b3932_0
2025-10-15T10:58:22.451905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20ab08bb-17278dd5-f378299f-9727de4d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|88b5b361-1878fa7b-421c4792-801b3932_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:22.484590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b5b361-1878fa7b-421c4792-801b3932_0] Write session: try to update token
2025-10-15T10:58:22.484646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b5b361-1878fa7b-421c4792-801b3932_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:22.542373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:22.542419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:22.542431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:22.542440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:22.542469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401176051801969:6137]
2025-10-15T10:58:22.542492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401176051801969:6137]
2025-10-15T10:58:22.542511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401176051801969:6137]
2025-10-15T10:58:22.542626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:22.542664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:22.542689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:22.542707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:22.542718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:22.542729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:22.542766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:22.542782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:22.543820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:22.601968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId: src_id|88b5b361-1878fa7b-421c4792-801b3932_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:22.624551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:22.683971Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:22.703791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:22.703840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:22.703908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:22.703923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:22.703961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401176051801969:6137]
2025-10-15T10:58:22.704145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:22.704480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:22.705171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:22.705318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401173252108705:6486]
2025-10-15T10:58:22.705395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:22.730192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 531 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88b5b361-1878fa7b-421c4792-801b3932_0
2025-10-15T10:58:22.730543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 531 sessionId: src_id|88b5b361-1878fa7b-421c4792-801b3932_0 is DEAD
2025-10-15T10:58:22.731211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b5b361-1878fa7b-421c4792-801b3932_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:22.731287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b5b361-1878fa7b-421c4792-801b3932_0] Write session will restart in 0.009207s
2025-10-15T10:58:22.731493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b5b361-1878fa7b-421c4792-801b3932_0] Write session: Do CDS request
2025-10-15T10:58:22.731545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b5b361-1878fa7b-421c4792-801b3932_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:22.748912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b5b361-1878fa7b-421c4792-801b3932_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:22.748949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:22.749002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 532
2025-10-15T10:58:22.750481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:22.750621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:22.750643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:22.750652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:22.751813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 532 sessionId:  describe result for acl check
2025-10-15T10:58:22.751905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:22.751912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:22.751917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:22.751929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401173252108790:6777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:22.753609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401173252108790:6777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:22.756102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:22.759152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:22.759981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:22.760013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:22.760052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:22.760309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:22.762018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401173252108790:6777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:22.760504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401176051802093:6141]
2025-10-15T10:58:22.762724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:22.764562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:22.764791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:22.766048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:22.766379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:22.766388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:22.766395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:22.766403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:22.766410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:22.766417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:22.766424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:22.766431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:22.766437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:22.766444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:22.766450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:22.766456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.766462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.766469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.766513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:22.766621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:22.766668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:22.766714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:22.766761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:22.766809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:22.766852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:22.766912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:22.766958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:22.767005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:22.767048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:22.767092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.767134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.767177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.767220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:22.767283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:22.767336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:22.767429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:22.767480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:22.767534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:22.767578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:22.767630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:22.767678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:22.767731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:22.767776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:22.767828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:22.767874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:22.767931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:22.767978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:22.768028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:22.768079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:22.768132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:22.768177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:22.768228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:22.768275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:22.768345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:22.768396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.768449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.768498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.768560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.768608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.768661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.769191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:22.770055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401173252108790:6777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:22.770095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401173252108790:6777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:22.770111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401173252108790:6777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:22.770138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:22.788307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:22.797847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:22.797883Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:22.797896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:22.797909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:22.797928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 531 [2:7561401176051802093:6141]
2025-10-15T10:58:22.797962Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:22.798006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:22.798016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:22.798026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:22.798033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:22.798064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:22.798080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:22.798095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:22.799191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.799208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.799217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.799225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:22.799477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:22.799508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:22.799666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:22.799866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 531
2025-10-15T10:58:22.799867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 531
2025-10-15T10:58:22.799882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:22.800124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:22.800219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401173252108718:2467], now have 1 active actors on pipe
2025-10-15T10:58:22.800256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401173252108822:6777], now have 1 active actors on pipe
2025-10-15T10:58:22.800324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:22.800354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:22.800392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401176051802088:6141]
2025-10-15T10:58:22.800408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401176051802088:6141]
2025-10-15T10:58:22.800422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401176051802088:6141]
2025-10-15T10:58:22.800470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:22.800511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:22.800526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:22.800536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:22.800537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:22.800676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:22.800694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:22.800759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9db01fea-9998f064-a58d27fe-eccc2490_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:22.800787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:22.800804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:22.800814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:22.800846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:22.800884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:22.801014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401176051802088:6141]
2025-10-15T10:58:22.801039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:22.801064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:22.801068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:22.801530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:22.801571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:22.801652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:22.801923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 532 partition: 0 MaxSeqNo: 46 sessionId: src_id|9db01fea-9998f064-a58d27fe-eccc2490_0
2025-10-15T10:58:22.802724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b5b361-1878fa7b-421c4792-801b3932_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9db01fea-9998f064-a58d27fe-eccc2490_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:22.807447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401173252108831:6486]
2025-10-15T10:58:22.810365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 531, pipe: [1:7561401173252108831:6486]
2025-10-15T10:58:22.810208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401173252108831:6486], now have 1 active actors on pipe
2025-10-15T10:58:22.823266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9db01fea-9998f064-a58d27fe-eccc2490_0] Write session: try to update token
2025-10-15T10:58:22.823318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9db01fea-9998f064-a58d27fe-eccc2490_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:22.831744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:22.831775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:22.831812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401176051802088:6141]
2025-10-15T10:58:22.831924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:22.832007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:22.834137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:22.835638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:22.837308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:22.839031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:22.841181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:22.878354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:22.925833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId: src_id|9db01fea-9998f064-a58d27fe-eccc2490_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:22.927527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:22.927561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:22.927573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:22.927637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:22.927653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:22.927667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:22.927679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:22.927723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401176051802088:6141]
2025-10-15T10:58:22.927751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401176051802088:6141]
2025-10-15T10:58:22.927778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401176051802088:6141]
2025-10-15T10:58:22.927955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:22.927982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:22.928281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:22.928317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:22.928348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:22.932526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:22.956819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:23.077019Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:23.079131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:23.079169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:23.079881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:23.079821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:23.079926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:23.079941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:23.079985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401173252108831:6486]
2025-10-15T10:58:23.127275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 532 reason: error at write: Disconnected sessionId: src_id|9db01fea-9998f064-a58d27fe-eccc2490_0
2025-10-15T10:58:23.127635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 532 sessionId: src_id|9db01fea-9998f064-a58d27fe-eccc2490_0 is DEAD
2025-10-15T10:58:23.127987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db01fea-9998f064-a58d27fe-eccc2490_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:23.128062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db01fea-9998f064-a58d27fe-eccc2490_0] Write session will restart in 0.007298s
2025-10-15T10:58:23.128213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db01fea-9998f064-a58d27fe-eccc2490_0] Write session: Do CDS request
2025-10-15T10:58:23.128271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db01fea-9998f064-a58d27fe-eccc2490_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:23.133216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:23.136080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:23.137318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:23.137353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:23.137401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:23.137704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:23.137928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401180346769529:6150]
2025-10-15T10:58:23.139852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:23.140094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:23.140126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 533
2025-10-15T10:58:23.140350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9db01fea-9998f064-a58d27fe-eccc2490_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:23.140836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:23.140890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:23.140982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:23.141006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:23.141014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:23.141132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:23.142584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:23.142942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.142963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.142971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.142979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.142986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.142994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.143001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.143007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.143015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.143022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.143029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.143035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.143043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.143050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.143099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.143208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.143259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.143306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.143328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 533 sessionId:  describe result for acl check
2025-10-15T10:58:23.143380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.143430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.143456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:23.143473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:23.143483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:23.143499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401177547076228:6782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:23.143478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.143535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.143582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.143629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.143677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.143724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.143770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.143816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.143864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.143929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.143986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.144041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.144090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.144145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.144198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.144256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.144306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.144369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.144415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.144470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.144521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.144579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.144629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.144692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.144743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.144801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.144851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.144908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.144959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.145019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.145065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.145121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.145171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.145239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.145292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.145349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.145803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:23.146104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401177547076228:6782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:23.153126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401177547076228:6782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:23.161456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401177547076228:6782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:23.161505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401177547076228:6782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:23.161524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401177547076228:6782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:23.161555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:23.168672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:23.177996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:23.178044Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:23.178060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:23.178081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:23.178106Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 532 [2:7561401180346769529:6150]
2025-10-15T10:58:23.178157Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:23.178215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:23.178230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:23.178241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:23.178252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:23.178305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:23.178328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:23.178350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:23.180125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401177547076261:6486]
2025-10-15T10:58:23.181572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.181878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.181907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.181919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:23.182222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:23.182248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.182392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.182590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.182815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:23.182895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401180346769523:6150]
2025-10-15T10:58:23.182916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401180346769523:6150]
2025-10-15T10:58:23.182930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401180346769523:6150]
2025-10-15T10:58:23.182968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:23.183054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:23.183093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:23.183114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:23.183139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:23.183240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:23.183261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:23.183393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401180346769523:6150]
2025-10-15T10:58:23.183419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:23.183451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:23.183512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401177547076259:6782], now have 1 active actors on pipe
2025-10-15T10:58:23.183535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401177547076151:2467], now have 1 active actors on pipe
2025-10-15T10:58:23.183556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401177547076261:6486], now have 1 active actors on pipe
2025-10-15T10:58:23.184206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 532
2025-10-15T10:58:23.184222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 532
2025-10-15T10:58:23.184285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 532, pipe: [1:7561401177547076261:6486]
2025-10-15T10:58:23.184442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:23.184474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:23.184560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:23.184609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:23.184632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:23.184642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:23.184687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:23.184735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:23.184791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:23.185191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:23.185214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:23.185292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:23.185513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 533 partition: 0 MaxSeqNo: 46 sessionId: src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0
2025-10-15T10:58:23.187594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9db01fea-9998f064-a58d27fe-eccc2490_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:23.208949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0] Write session: try to update token
2025-10-15T10:58:23.209003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:23.285198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:23.285224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:23.285242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:23.285251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:23.285273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401180346769523:6150]
2025-10-15T10:58:23.285287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401180346769523:6150]
2025-10-15T10:58:23.285298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401180346769523:6150]
2025-10-15T10:58:23.285408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:23.285438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:23.285464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:23.285493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:23.285503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:23.285514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:23.285552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:23.285566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:23.287402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:23.327442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId: src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:23.366051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:23.425539Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:23.441359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:23.441395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:23.441454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:23.441467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:23.441505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401180346769523:6150]
2025-10-15T10:58:23.441685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:23.442119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:23.441933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:23.441962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:23.474945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 533 reason: error at write: Disconnected sessionId: src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0
2025-10-15T10:58:23.475238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 533 sessionId: src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0 is DEAD
2025-10-15T10:58:23.475650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:23.475694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0] Write session will restart in 0.009791s
2025-10-15T10:58:23.475808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0] Write session: Do CDS request
2025-10-15T10:58:23.475842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:23.487249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:23.487466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401177547076261:6486]
2025-10-15T10:58:23.492643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:23.495906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:23.495935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 534
2025-10-15T10:58:23.496124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:23.496331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:23.496445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:23.496461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:23.496470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:23.503737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:23.504502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 534 sessionId:  describe result for acl check
2025-10-15T10:58:23.504562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:23.504613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:23.504594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:23.504641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:23.504629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:23.504639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:23.504653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401177547076363:6793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:23.504907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:23.505103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401180346769661:6153]
2025-10-15T10:58:23.507103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401177547076363:6793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:23.507504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:23.509101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:23.509364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:23.510644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:23.510971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.510989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.510996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.511004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.511011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.511017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.511024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.511034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.511041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.511048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.511056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.511063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.511069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.511076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.511120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.511223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.511272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.511319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.511380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.511439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.511488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.511543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.511596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.511651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.511703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.511756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.511810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.511863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.511919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.512003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.512069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.512133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.512193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.512255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.512308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.512367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.512422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.512481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.512535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.512594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.512647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.512694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.512733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.512778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.512815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.512856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.512890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.512942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.512991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.513051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.513104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.513165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.513218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.513285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.513338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.513390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.513854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:23.518045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401177547076363:6793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:23.541092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401177547076363:6793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:23.541137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401177547076363:6793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:23.541154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401177547076363:6793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:23.541186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:23.546640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:23.559801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:23.559841Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:23.559857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:23.559874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:23.559896Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 533 [2:7561401180346769661:6153]
2025-10-15T10:58:23.559945Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:23.559997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:23.560011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:23.560022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:23.560031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:23.560074Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:23.562458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 533
2025-10-15T10:58:23.562556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 533
2025-10-15T10:58:23.560093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:23.560122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:23.561864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.561879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.561892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.561902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:23.562157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:23.562175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.562302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.562474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.562687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:23.562755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401177547076392:6793], now have 1 active actors on pipe
2025-10-15T10:58:23.562776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401177547076352:2467], now have 1 active actors on pipe
2025-10-15T10:58:23.562797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401180346769644:6153]
2025-10-15T10:58:23.562810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401180346769644:6153]
2025-10-15T10:58:23.562821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401180346769644:6153]
2025-10-15T10:58:23.562847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:23.562895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:23.562909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:23.562912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:23.562919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:23.563071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:23.563088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:23.563135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:23.563154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:23.563271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401180346769644:6153]
2025-10-15T10:58:23.563300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:23.563323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:23.563943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e470f75f-b0535395-99095b5c-b8b8483b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:23.563979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:23.563995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:23.564005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:23.564036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:23.564070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:23.564205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:23.565726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:23.565757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:23.565827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:23.566073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 534 partition: 0 MaxSeqNo: 46 sessionId: src_id|e470f75f-b0535395-99095b5c-b8b8483b_0
2025-10-15T10:58:23.567215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3a5a92d-e02a1dee-a377589f-cc6ec67f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e470f75f-b0535395-99095b5c-b8b8483b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:23.587708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401177547076398:6486]
2025-10-15T10:58:23.588304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401177547076398:6486], now have 1 active actors on pipe
2025-10-15T10:58:23.588447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 533, pipe: [1:7561401177547076398:6486]
2025-10-15T10:58:23.604199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e470f75f-b0535395-99095b5c-b8b8483b_0] Write session: try to update token
2025-10-15T10:58:23.604251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e470f75f-b0535395-99095b5c-b8b8483b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:23.658330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:23.658381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:23.658408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:23.658432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:23.658483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401180346769644:6153]
2025-10-15T10:58:23.658516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401180346769644:6153]
2025-10-15T10:58:23.658558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401180346769644:6153]
2025-10-15T10:58:23.658745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:23.658810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:23.658852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:23.658856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:23.658882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:23.662748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:23.742248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId: src_id|e470f75f-b0535395-99095b5c-b8b8483b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:23.764791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:23.804262Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:23.817443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:23.817475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:23.817518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:23.817527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:23.817554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401180346769644:6153]
2025-10-15T10:58:23.817789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:23.818008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:23.818356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401177547076398:6486]
2025-10-15T10:58:23.818431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:23.818554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:23.867411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e470f75f-b0535395-99095b5c-b8b8483b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:23.865487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 534 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e470f75f-b0535395-99095b5c-b8b8483b_0
2025-10-15T10:58:23.867457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e470f75f-b0535395-99095b5c-b8b8483b_0] Write session will restart in 0.005116s
2025-10-15T10:58:23.865781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 534 sessionId: src_id|e470f75f-b0535395-99095b5c-b8b8483b_0 is DEAD
2025-10-15T10:58:23.867560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e470f75f-b0535395-99095b5c-b8b8483b_0] Write session: Do CDS request
2025-10-15T10:58:23.867602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e470f75f-b0535395-99095b5c-b8b8483b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:23.876134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:23.880856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:23.882161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:23.882194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:23.882280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:23.882811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:23.883042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401180346769775:6160]
2025-10-15T10:58:23.883197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:23.883223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 535
2025-10-15T10:58:23.883664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e470f75f-b0535395-99095b5c-b8b8483b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:23.885178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:23.886970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:23.887102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:23.887116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:23.887126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:23.888325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 535 sessionId:  describe result for acl check
2025-10-15T10:58:23.888438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:23.888454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:23.888463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:23.888479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401177547076482:6797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:23.886033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:23.886214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:23.887362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:23.887669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.887676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.887684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.887690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.887697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.887703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.887710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.887716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.887723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.887728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.887736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.887742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.887748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.887754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.887801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.887899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.887944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.887988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.888033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.888078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.888119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.888159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.888201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.888243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.888289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.888330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.888370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.888411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.888451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.888511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:23.888572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.888626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:23.888671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.888721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:23.888765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.888813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:23.888857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.888906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:23.888947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.888997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:23.889042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.889093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:23.889135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.889183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:23.889227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.889308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:23.889351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.889401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:23.889446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.889493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:23.889534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.889583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.889634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.890879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401177547076482:6797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:23.890784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.890844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.890899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.891391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:23.903987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401177547076482:6797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:23.911758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:23.913689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401177547076482:6797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:23.913737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401177547076482:6797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:23.913754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401177547076482:6797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:23.913785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:23.919291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401177547076526:6486]
2025-10-15T10:58:23.922318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:23.922354Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:23.922370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:23.922386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:23.922408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 534 [2:7561401180346769775:6160]
2025-10-15T10:58:23.922455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:23.922504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:23.922517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:23.922527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:23.922538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:23.922578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:23.922597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:23.922615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:23.935497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.935520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.935530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.935540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:23.935788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:23.935802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:23.935914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:23.936966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 534
2025-10-15T10:58:23.936061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:23.936256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:23.937069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 534, pipe: [1:7561401177547076526:6486]
2025-10-15T10:58:23.936315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401180346769770:6160]
2025-10-15T10:58:23.937086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 534
2025-10-15T10:58:23.936327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401180346769770:6160]
2025-10-15T10:58:23.936337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401180346769770:6160]
2025-10-15T10:58:23.936375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:23.936439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:23.936485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:23.936500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:23.936509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:23.936603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:23.936618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:23.936718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401180346769770:6160]
2025-10-15T10:58:23.936736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:23.936743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:23.936778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401177547076401:2467], now have 1 active actors on pipe
2025-10-15T10:58:23.936840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401177547076526:6486], now have 1 active actors on pipe
2025-10-15T10:58:23.936860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401177547076518:6797], now have 1 active actors on pipe
2025-10-15T10:58:23.937591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:23.937618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:23.937684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:23.937710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:23.937725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:23.937734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:23.937765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:23.937802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:23.937840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:23.938254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:23.938276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:23.938329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:23.938601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 535 partition: 0 MaxSeqNo: 46 sessionId: src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0
2025-10-15T10:58:23.943539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e470f75f-b0535395-99095b5c-b8b8483b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
E1015 10:58:23.960601100  821865 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:58:23.964292Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:58:23.987538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0] Write session: try to update token
2025-10-15T10:58:23.987591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:23.995081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:23.995109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:23.995146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401180346769770:6160]
2025-10-15T10:58:23.995267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:23.995307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:23.997821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:23.999327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:24.001032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:24.002257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:24.003917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:24.004385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:24.067153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:24.067179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:24.067190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:24.067260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:24.067275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:24.067288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:24.067307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:24.067379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401180346769770:6160]
2025-10-15T10:58:24.067408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401180346769770:6160]
2025-10-15T10:58:24.067441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401180346769770:6160]
2025-10-15T10:58:24.067571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:24.067580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:24.067590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:24.067611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:24.067654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:24.069022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:24.071257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId: src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:24.093346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:24.214369Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:24.216522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:24.216558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:24.219812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:24.219971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401177547076526:6486]
2025-10-15T10:58:24.220026Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:24.220060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:24.220078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:24.260968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 535 reason: error at write: Disconnected sessionId: src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0
2025-10-15T10:58:24.261270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 535 sessionId: src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0 is DEAD
2025-10-15T10:58:24.261704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:24.261794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0] Write session will restart in 0.006229s
2025-10-15T10:58:24.261975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0] Write session: Do CDS request
2025-10-15T10:58:24.262028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:24.272859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:24.275531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:24.275582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 536
2025-10-15T10:58:24.276168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:24.276393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:24.276445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:24.276488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:24.280094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 536 sessionId:  describe result for acl check
2025-10-15T10:58:24.280211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:24.280231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:24.280240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:24.280257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401181842043921:6807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:24.282166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401181842043921:6807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:24.287732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401181842043921:6807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:24.293110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:24.295256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:24.295260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401181842043921:6807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:24.295299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401181842043921:6807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:24.295313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401181842043921:6807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:24.295339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:24.296020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:24.296049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:24.296088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:24.296344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:24.296512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401184641737207:6166]
2025-10-15T10:58:24.298516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:24.299201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:24.299402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:24.300586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:24.300891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:24.300898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:24.300905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:24.300913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:24.300919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:24.300925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:24.300931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:24.300937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:24.300944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:24.300952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:24.300958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:24.300965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.300970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.300978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.301021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:24.301121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:24.301167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:24.301212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:24.301270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:24.301315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:24.301356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:24.301399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:24.301443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:24.301487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:24.301529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:24.301570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.301613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.301656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.301696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:24.301757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:24.301810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:24.301861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:24.301909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:24.301958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:24.301999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:24.302048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:24.302093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:24.302143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:24.302184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:24.302234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:24.302277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:24.302324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:24.302368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:24.302414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:24.302457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:24.302503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:24.302545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:24.302594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:24.302636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:24.302686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:24.302739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.302789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.302832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.302881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.302922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.302970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.303449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:24.321128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401181842043964:6486]
2025-10-15T10:58:24.324928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:24.334410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:24.334465Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:24.334484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:24.334506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:24.334535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 535 [2:7561401184641737207:6166]
2025-10-15T10:58:24.334593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:24.334662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:24.334681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:24.334698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:24.334711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:24.334768Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:24.334792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:24.334816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:24.336284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.336310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.336327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.336339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:24.336642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:24.336663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.336813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.337009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.337262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:24.337346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401181842043964:6486], now have 1 active actors on pipe
2025-10-15T10:58:24.337372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401181842043850:2467], now have 1 active actors on pipe
2025-10-15T10:58:24.337395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401181842043958:6807], now have 1 active actors on pipe
2025-10-15T10:58:24.337422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401184641737202:6166]
2025-10-15T10:58:24.337438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401184641737202:6166]
2025-10-15T10:58:24.337451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401184641737202:6166]
2025-10-15T10:58:24.337495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:24.337536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:24.337551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:24.337562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:24.337573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:24.337769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:24.337789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:24.337916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401184641737202:6166]
2025-10-15T10:58:24.337938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:24.337997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:24.338715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:24.338745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:24.338824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:24.338860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:24.338883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:24.338895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:24.338934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:24.338981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:24.339032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:24.337343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 535, pipe: [1:7561401181842043964:6486]
2025-10-15T10:58:24.337451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 535
2025-10-15T10:58:24.337528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 535
2025-10-15T10:58:24.339878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:24.339911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:24.339992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:24.340290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 536 partition: 0 MaxSeqNo: 46 sessionId: src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0
2025-10-15T10:58:24.341052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59afff45-d5a9924-8c551e4e-58ca3ecc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:24.360342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0] Write session: try to update token
2025-10-15T10:58:24.360405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:24.423076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:24.423118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:24.423163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401184641737202:6166]
2025-10-15T10:58:24.423294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:24.423305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:24.436361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:24.437599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:24.438722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:24.440066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:24.447620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:24.448185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:24.448209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:24.448222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:24.448292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:24.515067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:24.515102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:24.515121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:24.515131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:24.515160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401184641737202:6166]
2025-10-15T10:58:24.515177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401184641737202:6166]
2025-10-15T10:58:24.515192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401184641737202:6166]
2025-10-15T10:58:24.515305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:24.515333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:24.515364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:24.515379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:24.515388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:24.517020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:24.517129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId: src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:24.537890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:24.659152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:24.667585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:24.667633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:24.670348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:24.668569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:24.668602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:24.669631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401181842043964:6486]
2025-10-15T10:58:24.669793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:24.689967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 536 reason: error at write: Disconnected sessionId: src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0
2025-10-15T10:58:24.690340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 536 sessionId: src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0 is DEAD
2025-10-15T10:58:24.690703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:24.690752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0] Write session will restart in 0.007385s
2025-10-15T10:58:24.690889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0] Write session: Do CDS request
2025-10-15T10:58:24.690960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:24.705569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:24.705695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:24.705597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 537
2025-10-15T10:58:24.706174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:24.706311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:24.706335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:24.706345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:24.707531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 537 sessionId:  describe result for acl check
2025-10-15T10:58:24.707660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:24.707686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:24.707695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:24.707713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401181842043989:6812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:24.710518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401181842043989:6812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:24.717579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401181842043989:6812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:24.731780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401181842043989:6812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:24.731824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401181842043989:6812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:24.731841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401181842043989:6812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:24.731870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:24.739179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:24.742528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:24.743368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:24.743396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:24.743441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:24.743702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:24.743906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401184641737338:6174]
2025-10-15T10:58:24.746063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:24.746827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:24.747027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:24.748302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:24.748624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:24.748641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:24.748649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:24.748655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:24.748661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:24.748669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:24.748675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:24.748680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:24.748687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:24.748693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:24.748700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:24.748706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.748712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.748719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.748764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:24.748868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:24.748919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:24.748970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:24.749016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:24.749066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:24.749115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:24.749160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:24.749210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:24.749273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:24.749322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:24.749371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.749419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.749466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.749513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:24.749594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:24.749659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:24.749719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:24.749771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:24.749825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:24.749872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:24.749928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:24.749976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:24.750033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:24.750080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:24.750135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:24.750186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:24.750242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:24.750287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:24.750343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:24.750393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:24.750451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:24.750496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:24.750550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:24.750596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:24.750652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:24.750717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.750773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.750821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.750874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.750921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.750976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.751492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:24.769894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401181842044089:6486]
2025-10-15T10:58:24.781434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:24.791219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:24.791259Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:24.791276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:24.791296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:24.791325Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 536 [2:7561401184641737338:6174]
2025-10-15T10:58:24.791394Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:24.791451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:24.791470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:24.791487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:24.791499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:24.791550Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:24.791573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:24.791609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:24.793267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.793294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.793309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.793321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:24.793599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:24.793623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:24.793762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:24.793959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:24.794204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:24.794282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401184641737333:6174]
2025-10-15T10:58:24.794298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401184641737333:6174]
2025-10-15T10:58:24.794312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401184641737333:6174]
2025-10-15T10:58:24.794351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:24.794427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:24.794498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:24.794513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:24.794526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:24.794618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:24.794641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:24.794764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401184641737333:6174]
2025-10-15T10:58:24.794800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:24.794820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:24.795051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 536
2025-10-15T10:58:24.795178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 536
2025-10-15T10:58:24.795253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 536, pipe: [1:7561401181842044089:6486]
2025-10-15T10:58:24.794901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401181842044078:6812], now have 1 active actors on pipe
2025-10-15T10:58:24.794929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401181842043975:2467], now have 1 active actors on pipe
2025-10-15T10:58:24.794952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401181842044089:6486], now have 1 active actors on pipe
2025-10-15T10:58:24.795553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:24.795590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:24.795677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:24.795714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:24.795736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:24.795751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:24.795796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:24.795847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:24.795900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:24.796366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:24.796387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:24.796450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:24.797691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 537 partition: 0 MaxSeqNo: 46 sessionId: src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0
2025-10-15T10:58:24.798613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2775c96a-32a392bf-63f36df6-d52f13a3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:24.818931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0] Write session: try to update token
2025-10-15T10:58:24.819000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:24.873000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:24.873032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:24.873047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:24.873057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:24.873091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401184641737333:6174]
2025-10-15T10:58:24.873117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401184641737333:6174]
2025-10-15T10:58:24.873139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401184641737333:6174]
2025-10-15T10:58:24.873244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:24.873280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:24.873315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:24.873354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:24.873382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:24.874437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:24.896601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId: src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:24.917009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:25.020627Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:25.038042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:25.038091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:25.038161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:25.038178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:25.038220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401184641737333:6174]
2025-10-15T10:58:25.038647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:25.038822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:25.039545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:25.077349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:25.078323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:25.078374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0] Write session will restart in 0.008605s
2025-10-15T10:58:25.078536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0] Write session: Do CDS request
2025-10-15T10:58:25.078597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:25.077496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401181842044089:6486]
2025-10-15T10:58:25.077564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 537 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0
2025-10-15T10:58:25.077907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 537 sessionId: src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0 is DEAD
2025-10-15T10:58:25.083492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:25.089227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:25.090067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:25.090097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:25.090143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:25.090400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:25.090593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401188936704781:6182]
2025-10-15T10:58:25.092812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:25.094186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:25.094216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 538
2025-10-15T10:58:25.098107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:25.098774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:25.098922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:25.098945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:25.098957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:25.094584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:25.094838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:25.096260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:25.096608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.096617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.096625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.096632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.096639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.096647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.096653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.096663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.096669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.096677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.096684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.096691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.096698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.096705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.096755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.096873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.096926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.096976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.097026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.097075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.097122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.097172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.097219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.097284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.097330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.097382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.097430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.097499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.097549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.097621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.097684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.097745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.097796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.097857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.097915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.097974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.098025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.098088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.098135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.098191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.098241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.098298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.098348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.098405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.098456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.098514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.098578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.098636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.098684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.098749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.098797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.098855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.098905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.098963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.099011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.099068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.100638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 538 sessionId:  describe result for acl check
2025-10-15T10:58:25.100765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:25.100780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:25.100791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:25.100809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401186137011509:6823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:25.100852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:25.103543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401186137011509:6823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:25.109812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401186137011509:6823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:25.116962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401186137011509:6823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:25.117005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401186137011509:6823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:25.117022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401186137011509:6823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:25.117053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:25.127203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:25.137230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:25.137283Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:25.137300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:25.137321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:25.137344Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 537 [2:7561401188936704781:6182]
2025-10-15T10:58:25.137395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:25.137456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:25.137470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:25.137483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:25.137497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:25.137548Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:25.137572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:25.137594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:25.139133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.139156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.139170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.139192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:25.139480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:25.139506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.139647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.139882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 537
2025-10-15T10:58:25.139983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 537
2025-10-15T10:58:25.139837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.140083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:25.140164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401186137011539:6823], now have 1 active actors on pipe
2025-10-15T10:58:25.140197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401186137011500:2467], now have 1 active actors on pipe
2025-10-15T10:58:25.140249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:25.140270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:25.140306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401188936704775:6182]
2025-10-15T10:58:25.140321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401188936704775:6182]
2025-10-15T10:58:25.140334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401188936704775:6182]
2025-10-15T10:58:25.140384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:25.140427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:25.140444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:25.140455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:25.140457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:25.140646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:25.140664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:25.140745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:25.140777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:25.140795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:25.140805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:25.140841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:25.140882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:25.141005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401188936704775:6182]
2025-10-15T10:58:25.141036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:25.141073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:25.141086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:25.141632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:25.141661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:25.141724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:25.141950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 538 partition: 0 MaxSeqNo: 46 sessionId: src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0
2025-10-15T10:58:25.142727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f48f3b-8cd7c866-4f80677-9d892c80_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:25.166197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0] Write session: try to update token
2025-10-15T10:58:25.166256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:25.172719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:25.172751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:25.172788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401188936704775:6182]
2025-10-15T10:58:25.172917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:25.173408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:25.174753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:25.177964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401186137011548:6486]
2025-10-15T10:58:25.178753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 537, pipe: [1:7561401186137011548:6486]
2025-10-15T10:58:25.182364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:25.189293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:25.198536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:25.203964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:25.204782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401186137011548:6486], now have 1 active actors on pipe
2025-10-15T10:58:25.204834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:25.237866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:25.237896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:25.237907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:25.269185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId: src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:25.275523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:25.275562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:25.275579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:25.275592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:25.275637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401188936704775:6182]
2025-10-15T10:58:25.275667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401188936704775:6182]
2025-10-15T10:58:25.275697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401188936704775:6182]
2025-10-15T10:58:25.275864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:25.275890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:25.275900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:25.275948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:25.275980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:25.277091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:25.293062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:25.432154Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:25.433789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:25.433829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:25.434471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401186137011548:6486]
2025-10-15T10:58:25.434554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:25.434587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:25.434577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:25.434613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:25.484200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 538 reason: error at write: Disconnected sessionId: src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0
2025-10-15T10:58:25.484542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 538 sessionId: src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0 is DEAD
2025-10-15T10:58:25.484942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:25.484999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0] Write session will restart in 0.006507s
2025-10-15T10:58:25.485150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0] Write session: Do CDS request
2025-10-15T10:58:25.485201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:25.496378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:25.496414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 539
2025-10-15T10:58:25.496534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:25.496958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:25.497094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:25.497115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:25.497125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:25.498622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 539 sessionId:  describe result for acl check
2025-10-15T10:58:25.498730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:25.498745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:25.498754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:25.498770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401186137011651:6831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:25.498548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:25.501206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401186137011651:6831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:25.501402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:25.502389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:25.502409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:25.502453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:25.502704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:25.502891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401188936704908:6187]
2025-10-15T10:58:25.505050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:25.507392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401186137011651:6831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:25.505921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:25.506126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:25.508040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:25.508372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.508380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.508387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.508394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.508400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.508407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.508414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.508420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.508426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.508432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.508438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.508444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.508450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.508457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.508503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.508609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.508656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.508702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.508746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.508788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.508829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.508882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.508928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.508973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.509015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.509057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.509099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.509142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.509185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.509245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.509318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.509372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.509419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.509470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.509512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.509560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.509605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.509656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.510706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.510779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.510830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.510886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.510930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.510981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.511029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.511081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.511130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.511183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.511230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.511282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.511327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.511399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.511446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.511497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.511546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.511596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.512051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:25.515237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401186137011651:6831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:25.515282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401186137011651:6831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:25.515301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401186137011651:6831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:25.515332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:25.531649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:25.534882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401186137011683:6486]
2025-10-15T10:58:25.541397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:25.541438Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:25.541454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:25.541474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:25.541497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 538 [2:7561401188936704908:6187]
2025-10-15T10:58:25.541545Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:25.541599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:25.541611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:25.541623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:25.541634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:25.541678Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:25.541696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:25.541716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:25.542902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.543753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 538
2025-10-15T10:58:25.543836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 538, pipe: [1:7561401186137011683:6486]
2025-10-15T10:58:25.543898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 538
2025-10-15T10:58:25.545910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 539 partition: 0 MaxSeqNo: 46 sessionId: src_id|4471620-aef604e3-ff787edc-3a4b8061_0
2025-10-15T10:58:25.543000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.543018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.543029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:25.543301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:25.543318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.543463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.543645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.543901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:25.543975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401186137011682:6831], now have 1 active actors on pipe
2025-10-15T10:58:25.544000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401186137011683:6486], now have 1 active actors on pipe
2025-10-15T10:58:25.544022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401186137011568:2467], now have 1 active actors on pipe
2025-10-15T10:58:25.544073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:25.544093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:25.544132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401188936704903:6187]
2025-10-15T10:58:25.544147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401188936704903:6187]
2025-10-15T10:58:25.544159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401188936704903:6187]
2025-10-15T10:58:25.544199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:25.544235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:25.544252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:25.544264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:25.544267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:25.544443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:25.544459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:25.544531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4471620-aef604e3-ff787edc-3a4b8061_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:25.544559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:25.544578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:25.544588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:25.544621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:25.544656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:25.544764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401188936704903:6187]
2025-10-15T10:58:25.544796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:25.544839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:25.544922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:25.545514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:25.545533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:25.545591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:25.550735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c9ec6b2-57ca13df-931aa6f1-6db065bc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4471620-aef604e3-ff787edc-3a4b8061_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:25.570884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4471620-aef604e3-ff787edc-3a4b8061_0] Write session: try to update token
2025-10-15T10:58:25.570950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4471620-aef604e3-ff787edc-3a4b8061_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:25.608471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:25.608533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:25.608586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401188936704903:6187]
2025-10-15T10:58:25.608780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:25.608806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:25.612704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:25.615122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:25.616580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:25.618219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:25.619838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:25.620324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:25.662351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId: src_id|4471620-aef604e3-ff787edc-3a4b8061_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:25.676566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:25.676594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:25.676606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:25.676658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:25.676672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:25.676684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:25.676696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:25.676732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401188936704903:6187]
2025-10-15T10:58:25.676760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401188936704903:6187]
2025-10-15T10:58:25.676786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401188936704903:6187]
2025-10-15T10:58:25.676893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:25.676913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:25.676926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:25.676932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:25.676954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:25.677961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:25.704783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:25.813090Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:25.814306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:25.814340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:25.814873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:25.814919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:25.814908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:25.814923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:25.815109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401186137011683:6486]
2025-10-15T10:58:25.825580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 539 reason: error at write: Disconnected sessionId: src_id|4471620-aef604e3-ff787edc-3a4b8061_0
2025-10-15T10:58:25.825904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 539 sessionId: src_id|4471620-aef604e3-ff787edc-3a4b8061_0 is DEAD
2025-10-15T10:58:25.826216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471620-aef604e3-ff787edc-3a4b8061_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:25.826274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471620-aef604e3-ff787edc-3a4b8061_0] Write session will restart in 0.008835s
2025-10-15T10:58:25.826433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471620-aef604e3-ff787edc-3a4b8061_0] Write session: Do CDS request
2025-10-15T10:58:25.826493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471620-aef604e3-ff787edc-3a4b8061_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:25.839932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4471620-aef604e3-ff787edc-3a4b8061_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:25.841781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:25.841814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 540
2025-10-15T10:58:25.842108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:25.842218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:25.842238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:25.842250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:25.844012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 540 sessionId:  describe result for acl check
2025-10-15T10:58:25.844163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:25.844187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:25.844197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:25.844221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401186137011709:6835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:25.845964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401186137011709:6835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:25.855981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401186137011709:6835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:25.864023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401186137011709:6835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:25.864065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401186137011709:6835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:25.864082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401186137011709:6835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:25.864112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:25.867043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:25.870560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:25.871275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:25.871300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:25.871338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:25.871583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:25.871736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401188936705029:6189]
2025-10-15T10:58:25.873313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:25.874139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:25.874356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:25.875687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:25.876052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.876072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.876080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.876088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.876095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.876102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.876109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.876118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.876126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.876132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.876140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.876147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.876153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.876159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.876207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.876320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.876371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.876418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.876472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.876529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.876578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.876630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.876678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.876726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.876776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.876825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.876876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.876929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.876982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.877054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:25.877119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.877181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:25.877236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.877307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:25.877359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.877419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:25.877467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.877532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:25.877585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.877648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:25.877702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.877747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:25.877783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.877827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:25.877864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.877923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:25.877972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.878033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:25.878086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.878146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:25.878197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.878257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.878312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.878368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.878419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.878474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.878955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:25.903218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:25.912275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:25.912324Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:25.912343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:25.912365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:25.912394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 539 [2:7561401188936705029:6189]
2025-10-15T10:58:25.912452Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:25.912524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:25.912546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:25.912564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:25.912580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:25.912639Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:25.912674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:25.912698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:25.913726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.913752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.913768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.913782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:25.914082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:25.914109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:25.914270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:25.914363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 539
2025-10-15T10:58:25.914491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:25.914511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 539
2025-10-15T10:58:25.914755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:25.914851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401186137011693:2467], now have 1 active actors on pipe
2025-10-15T10:58:25.914883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401186137011803:6835], now have 1 active actors on pipe
2025-10-15T10:58:25.914948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:25.914975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:25.915014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401188936705024:6189]
2025-10-15T10:58:25.915031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401188936705024:6189]
2025-10-15T10:58:25.915045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401188936705024:6189]
2025-10-15T10:58:25.915082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:25.915138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:25.915161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:25.915165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:25.915174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:25.915213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401186137011812:6486]
2025-10-15T10:58:25.915372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:25.915389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:25.915440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:25.915464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:25.915481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:25.915489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:25.915516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:25.915554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:25.915661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401188936705024:6189]
2025-10-15T10:58:25.915651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 539, pipe: [1:7561401186137011812:6486]
2025-10-15T10:58:25.915695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:25.915715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:25.915742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401186137011812:6486], now have 1 active actors on pipe
2025-10-15T10:58:25.915764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:25.916225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:25.916258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:25.916324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:25.916584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 540 partition: 0 MaxSeqNo: 46 sessionId: src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0
2025-10-15T10:58:25.919633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4471620-aef604e3-ff787edc-3a4b8061_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:25.942092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0] Write session: try to update token
2025-10-15T10:58:25.942160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:25.944554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:25.944591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:25.944633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401188936705024:6189]
2025-10-15T10:58:25.944772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:25.944778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:25.946847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:25.948294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:25.949903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:25.951340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:25.953384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:25.953909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:26.027037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:26.027073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:26.027088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:26.027101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:26.027137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401188936705024:6189]
2025-10-15T10:58:26.027165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401188936705024:6189]
2025-10-15T10:58:26.027189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401188936705024:6189]
2025-10-15T10:58:26.027337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:26.027366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:26.027380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:26.027392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:26.027404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:26.027437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:26.027436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:26.027456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:26.028528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:26.032160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId: src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:26.056192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:26.161387Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:26.163810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:26.163847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:26.164299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:26.164355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:26.164371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:26.164409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401186137011812:6486]
2025-10-15T10:58:26.164663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:26.176546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 540 reason: error at write: Disconnected sessionId: src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0
2025-10-15T10:58:26.176896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 540 sessionId: src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0 is DEAD
2025-10-15T10:58:26.177123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:26.177176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0] Write session will restart in 0.007348s
2025-10-15T10:58:26.177325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0] Write session: Do CDS request
2025-10-15T10:58:26.177368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:26.190827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:26.190869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 541
2025-10-15T10:58:26.191172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:26.192085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:26.192330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:26.192363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:26.192380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:26.194114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 541 sessionId:  describe result for acl check
2025-10-15T10:58:26.194276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:26.194304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:26.194323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:26.194349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401190431979147:6840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:26.196968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401190431979147:6840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:26.204997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401190431979147:6840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:26.213268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401190431979147:6840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:26.213318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401190431979147:6840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:26.213334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401190431979147:6840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:26.213359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:26.223482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:26.227895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:26.228779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:26.228807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:26.228848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:26.229102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:26.229346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401193231672471:6198]
2025-10-15T10:58:26.231741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:26.232804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:26.233016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:26.234310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:26.234634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.234652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.234660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.234667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.234674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.234681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.234689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.234698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.234705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.234712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.234720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.234728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.234735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.234742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.234790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.234905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.234968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.235019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.235074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.235130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.235184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.235253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.235312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.235386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.235441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.235494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.235546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.235600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.235648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.235722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.235790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.235852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.235910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.235976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.236026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.236089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.236155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.236217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.236264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.236325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.236379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.236442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.236492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.236550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.236604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.236666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.236720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.236779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.236834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.236897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.236950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.237012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.237063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.237126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.237189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.237252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.237820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:26.263385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:26.264476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401190431979253:6486]
2025-10-15T10:58:26.274231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:26.274281Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:26.274299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:26.274319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:26.274345Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 540 [2:7561401193231672471:6198]
2025-10-15T10:58:26.274401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:26.274461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:26.274478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:26.274492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:26.274504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:26.274557Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:26.274580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:26.274603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:26.276132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.276159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.276173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.276185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:26.276451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:26.276476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.276626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.276825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.277003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 540
2025-10-15T10:58:26.277069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:26.276989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 540
2025-10-15T10:58:26.277091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 540, pipe: [1:7561401190431979253:6486]
2025-10-15T10:58:26.277155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401190431979133:2467], now have 1 active actors on pipe
2025-10-15T10:58:26.277184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401190431979230:6840], now have 1 active actors on pipe
2025-10-15T10:58:26.277207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401190431979253:6486], now have 1 active actors on pipe
2025-10-15T10:58:26.277233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401193231672466:6198]
2025-10-15T10:58:26.277252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401193231672466:6198]
2025-10-15T10:58:26.277266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401193231672466:6198]
2025-10-15T10:58:26.277319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:26.277348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:26.277369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:26.277381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:26.277408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:26.277429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:26.277493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:26.277684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:26.277706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:26.277865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c8a794-547126ca-13247464-89c6506_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:26.277900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:26.277922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:26.277933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:26.277969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:26.278011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:26.278053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401193231672466:6198]
2025-10-15T10:58:26.278081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:26.278103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:26.278171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:26.278592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:26.278614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:26.278674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:26.279013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 541 partition: 0 MaxSeqNo: 46 sessionId: src_id|7c8a794-547126ca-13247464-89c6506_0
2025-10-15T10:58:26.279721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a784b32c-fe659897-41a89e44-8b4c6e2e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7c8a794-547126ca-13247464-89c6506_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:26.298711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8a794-547126ca-13247464-89c6506_0] Write session: try to update token
2025-10-15T10:58:26.298769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8a794-547126ca-13247464-89c6506_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:26.339912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:26.339950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:26.339963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:26.339975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:26.340010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401193231672466:6198]
2025-10-15T10:58:26.340036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401193231672466:6198]
2025-10-15T10:58:26.340061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401193231672466:6198]
2025-10-15T10:58:26.340187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:26.340224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:26.340251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:26.340264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:26.340274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:26.341340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:26.388394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId: src_id|7c8a794-547126ca-13247464-89c6506_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:26.414552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:26.477664Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:26.500382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:26.500422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:26.500471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:26.500484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:26.500520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401193231672466:6198]
2025-10-15T10:58:26.500666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:26.500943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401190431979253:6486]
2025-10-15T10:58:26.501061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:26.501078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:26.501105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:26.532049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:26.532176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 541 reason: error at write: Disconnected sessionId: src_id|7c8a794-547126ca-13247464-89c6506_0
2025-10-15T10:58:26.532451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 541 sessionId: src_id|7c8a794-547126ca-13247464-89c6506_0 is DEAD
2025-10-15T10:58:26.532750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8a794-547126ca-13247464-89c6506_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:26.532781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8a794-547126ca-13247464-89c6506_0] Write session will restart in 0.006265s
2025-10-15T10:58:26.532894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8a794-547126ca-13247464-89c6506_0] Write session: Do CDS request
2025-10-15T10:58:26.532935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8a794-547126ca-13247464-89c6506_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:26.546585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8a794-547126ca-13247464-89c6506_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:26.546885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:26.552832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:26.552856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 542
2025-10-15T10:58:26.553257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:26.553379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:26.553397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:26.553406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:26.551937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:26.553004Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:26.553020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:26.553059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:26.553345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:26.553520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401193231672609:6201]
2025-10-15T10:58:26.554302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 542 sessionId:  describe result for acl check
2025-10-15T10:58:26.554390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:26.554404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:26.554413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:26.554427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401190431979362:6851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:26.555608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:26.556324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401190431979362:6851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:26.556510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:26.556731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:26.557910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:26.558215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.558231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.558238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.558244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.558250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.558256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.558263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.558269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.558276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.558282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.558289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.558295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.558301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.558307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.558349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.558446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.558488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.558531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.558581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.558625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.558664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.558703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.558744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.558785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.558826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.558866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.558904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.558947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.558985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.559043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.559092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.559145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.559188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.559238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.559282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.559330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.559550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.559603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.559645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.559695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.559751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.559803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.559843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.559891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.559935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.559985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.560046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.560100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.560146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.560199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.560247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.560301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.560348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.560404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.560450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.560504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.560993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:26.563915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401190431979362:6851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:26.570318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401190431979362:6851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:26.570351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401190431979362:6851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:26.570361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401190431979362:6851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:26.570380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:26.577148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:26.594584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:26.594624Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:26.594637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:26.594654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:26.594675Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 541 [2:7561401193231672609:6201]
2025-10-15T10:58:26.594718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:26.594763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:26.594776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:26.594785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:26.594795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:26.594834Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:26.594854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:26.594871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:26.596483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.596504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.596517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.596527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:26.596773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:26.596795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.596915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.597035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 541
2025-10-15T10:58:26.597076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.597155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 541
2025-10-15T10:58:26.597300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:26.597376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401190431979310:2467], now have 1 active actors on pipe
2025-10-15T10:58:26.597402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401190431979391:6851], now have 1 active actors on pipe
2025-10-15T10:58:26.597458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:26.597480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:26.597511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401193231672604:6201]
2025-10-15T10:58:26.597528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401193231672604:6201]
2025-10-15T10:58:26.597539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401193231672604:6201]
2025-10-15T10:58:26.597571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:26.597609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:26.597631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:26.597631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:26.597641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:26.597781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:26.597800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:26.597857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20e79db4-1bb58280-c54257aa-896436_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:26.597889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:26.597904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:26.597913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:26.597941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:26.597974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:26.598078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401193231672604:6201]
2025-10-15T10:58:26.598109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:26.598148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:26.598162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:26.598551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:26.598574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:26.598627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:26.599153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 542 partition: 0 MaxSeqNo: 46 sessionId: src_id|20e79db4-1bb58280-c54257aa-896436_0
2025-10-15T10:58:26.599974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8a794-547126ca-13247464-89c6506_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|20e79db4-1bb58280-c54257aa-896436_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:26.601267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401190431979397:6486]
2025-10-15T10:58:26.601611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401190431979397:6486], now have 1 active actors on pipe
2025-10-15T10:58:26.601725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 541, pipe: [1:7561401190431979397:6486]
2025-10-15T10:58:26.621526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e79db4-1bb58280-c54257aa-896436_0] Write session: try to update token
2025-10-15T10:58:26.621580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e79db4-1bb58280-c54257aa-896436_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:26.625864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:26.625894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:26.625927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401193231672604:6201]
2025-10-15T10:58:26.626031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:26.626043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:26.627963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:26.629198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:26.630442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:26.631580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:26.633302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:26.633804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:26.713637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:26.713685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:26.713709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:26.713773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:26.713789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:26.713799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:26.713806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:26.713841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401193231672604:6201]
2025-10-15T10:58:26.713883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401193231672604:6201]
2025-10-15T10:58:26.713910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401193231672604:6201]
2025-10-15T10:58:26.714023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:26.714032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:26.714037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:26.714066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:26.714102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:26.715076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:26.740277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId: src_id|20e79db4-1bb58280-c54257aa-896436_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:26.761194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:26.848701Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:26.868222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:26.868269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:26.868808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401190431979397:6486]
2025-10-15T10:58:26.868871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:26.868880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:26.868923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:26.868903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:26.876978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 542 reason: error at write: Disconnected sessionId: src_id|20e79db4-1bb58280-c54257aa-896436_0
2025-10-15T10:58:26.877247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 542 sessionId: src_id|20e79db4-1bb58280-c54257aa-896436_0 is DEAD
2025-10-15T10:58:26.879515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e79db4-1bb58280-c54257aa-896436_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:26.879550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e79db4-1bb58280-c54257aa-896436_0] Write session will restart in 0.005885s
2025-10-15T10:58:26.879634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e79db4-1bb58280-c54257aa-896436_0] Write session: Do CDS request
2025-10-15T10:58:26.879662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e79db4-1bb58280-c54257aa-896436_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:26.897028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:26.897057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 543
2025-10-15T10:58:26.897175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e79db4-1bb58280-c54257aa-896436_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:26.897701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:26.897812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:26.897831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:26.897839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:26.899033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 543 sessionId:  describe result for acl check
2025-10-15T10:58:26.899187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:26.899216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:26.899232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:26.899259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401190431979433:6858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:26.902833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401190431979433:6858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:26.908969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401190431979433:6858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:26.915426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401190431979433:6858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:26.915466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401190431979433:6858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:26.915481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401190431979433:6858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:26.915507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:26.920621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:26.922021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:26.922725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:26.922745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:26.922773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:26.922924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:26.923058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401193231672739:6210]
2025-10-15T10:58:26.924705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:26.925426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:26.925628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:26.926839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:26.927161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.927178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.927184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.927191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.927198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.927205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.927211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.927217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.927223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.927229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.927236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.927243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.927249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.927255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.927296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.927412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.927459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.927503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.927545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.927588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.927630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.927672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.927714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.927764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.927814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.927863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.927911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.927960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.928007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.928074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:26.928137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.928190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:26.928239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.928296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:26.928340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.928393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:26.928443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.928499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:26.928546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.928599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:26.928647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.928700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:26.928745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.928797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:26.928849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.928901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:26.928946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.929003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:26.929049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.929102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:26.929148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.929202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.929250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.929315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.929363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.929419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.929891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:26.947155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:26.957034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:26.957075Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:26.957091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:26.957108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:26.957131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 542 [2:7561401193231672739:6210]
2025-10-15T10:58:26.957177Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:26.957228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:26.957242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:26.957254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:26.957265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:26.957318Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:26.957338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:26.957358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:26.968945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401190431979539:6486]
2025-10-15T10:58:26.980211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.980238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.980248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.980258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:26.980506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:26.980525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:26.980636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:26.980785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:26.980806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 542
2025-10-15T10:58:26.980808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 542
2025-10-15T10:58:26.980876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 542, pipe: [1:7561401190431979539:6486]
2025-10-15T10:58:26.980971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:26.981044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401190431979527:6858], now have 1 active actors on pipe
2025-10-15T10:58:26.981068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401190431979416:2467], now have 1 active actors on pipe
2025-10-15T10:58:26.981086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401190431979539:6486], now have 1 active actors on pipe
2025-10-15T10:58:26.981106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401193231672734:6210]
2025-10-15T10:58:26.981119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401193231672734:6210]
2025-10-15T10:58:26.981130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401193231672734:6210]
2025-10-15T10:58:26.981160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:26.981186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:26.981199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:26.981210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:26.981244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:26.981265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:26.981317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:26.981471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:26.981495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:26.981625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5448f69-774381e9-5f6c760c-c007671_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:26.981658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:26.981673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:26.981682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:26.981710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:26.981743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:26.981775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401193231672734:6210]
2025-10-15T10:58:26.981801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:26.981822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:26.981867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:26.982311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:26.982333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:26.982384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:26.982612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 543 partition: 0 MaxSeqNo: 46 sessionId: src_id|c5448f69-774381e9-5f6c760c-c007671_0
2025-10-15T10:58:26.983238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e79db4-1bb58280-c54257aa-896436_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c5448f69-774381e9-5f6c760c-c007671_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:27.003120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5448f69-774381e9-5f6c760c-c007671_0] Write session: try to update token
2025-10-15T10:58:27.003170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5448f69-774381e9-5f6c760c-c007671_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:27.009892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:27.009919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:27.009949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401193231672734:6210]
2025-10-15T10:58:27.010056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:27.010110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:27.011696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:27.013091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:27.015945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:27.017262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:27.018612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:27.018881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:27.072845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:27.072882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:27.072894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:27.072950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:27.072966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:27.072980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:27.072992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:27.073038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401193231672734:6210]
2025-10-15T10:58:27.073065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401193231672734:6210]
2025-10-15T10:58:27.073087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401193231672734:6210]
2025-10-15T10:58:27.073237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:27.073233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:27.073259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:27.073303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:27.073337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:27.077519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:27.095907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId: src_id|c5448f69-774381e9-5f6c760c-c007671_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:27.116394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:27.219435Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:27.220999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:27.221031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:27.221471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:27.221499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:27.221522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:27.221725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:27.221769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401190431979539:6486]
2025-10-15T10:58:27.252758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 543 reason: error at write: Disconnected sessionId: src_id|c5448f69-774381e9-5f6c760c-c007671_0
2025-10-15T10:58:27.253074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 543 sessionId: src_id|c5448f69-774381e9-5f6c760c-c007671_0 is DEAD
2025-10-15T10:58:27.253594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5448f69-774381e9-5f6c760c-c007671_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:27.253649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5448f69-774381e9-5f6c760c-c007671_0] Write session will restart in 0.008534s
2025-10-15T10:58:27.253828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5448f69-774381e9-5f6c760c-c007671_0] Write session: Do CDS request
2025-10-15T10:58:27.253899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5448f69-774381e9-5f6c760c-c007671_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:27.268343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:27.268385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 544
2025-10-15T10:58:27.268541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5448f69-774381e9-5f6c760c-c007671_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:27.269163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:27.269283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:27.269324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:27.269333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:27.270513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 544 sessionId:  describe result for acl check
2025-10-15T10:58:27.270621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:27.270638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:27.270646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:27.270659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401194726946944:6863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:27.273043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401194726946944:6863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:27.273856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:27.279851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:27.280690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:27.280721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:27.280763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:27.281021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:27.281210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401197526640172:6214]
2025-10-15T10:58:27.281419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401194726946944:6863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:27.287159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:27.288322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:27.288622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:27.288663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401194726946944:6863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:27.288707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401194726946944:6863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:27.288723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401194726946944:6863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:27.288753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:27.289827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:27.290158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:27.290177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:27.290184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:27.290192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:27.290198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:27.290205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:27.290212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:27.290219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:27.290226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:27.290233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:27.290240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:27.290246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.290252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.290259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.290305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:27.290426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:27.290471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:27.290516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:27.290560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:27.290604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:27.290652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:27.290703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:27.290752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:27.290802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:27.290854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:27.290907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.290949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.290986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.291019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:27.291073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:27.291133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:27.291179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:27.291210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:27.291252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:27.291287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:27.291325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:27.291387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:27.291432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:27.291468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:27.291508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:27.291543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:27.291588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:27.291636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:27.291691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:27.291740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:27.291780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:27.291816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:27.291854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:27.291902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:27.291958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:27.292006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.292060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.292100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.292147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.292199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.292252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.292700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:27.310366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:27.319747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:27.319798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:27.319817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:27.319843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:27.319872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 543 [2:7561401197526640172:6214]
2025-10-15T10:58:27.319933Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:27.320003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:27.320020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:27.320034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:27.320047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:27.320101Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:27.320135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:27.320160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:27.324463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401194726946980:6486]
2025-10-15T10:58:27.328795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.328830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.328846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.328860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:27.329668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 543
2025-10-15T10:58:27.329668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 543
2025-10-15T10:58:27.329747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 543, pipe: [1:7561401194726946980:6486]
2025-10-15T10:58:27.329180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:27.329207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.329385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.329601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.329840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:27.329929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401194726946977:6863], now have 1 active actors on pipe
2025-10-15T10:58:27.329953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401194726946859:2467], now have 1 active actors on pipe
2025-10-15T10:58:27.329975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401194726946980:6486], now have 1 active actors on pipe
2025-10-15T10:58:27.330029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:27.330045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:27.330072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401197526640167:6214]
2025-10-15T10:58:27.330082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401197526640167:6214]
2025-10-15T10:58:27.330091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401197526640167:6214]
2025-10-15T10:58:27.330122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:27.330168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:27.330179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:27.330186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:27.330200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:27.330324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:27.330335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:27.330386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:27.330418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:27.330437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:27.330447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:27.330475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:27.330508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:27.330626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401197526640167:6214]
2025-10-15T10:58:27.330654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:27.330679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:27.330701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:27.331187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:27.331214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:27.331309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:27.331582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 544 partition: 0 MaxSeqNo: 46 sessionId: src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0
2025-10-15T10:58:27.332276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5448f69-774381e9-5f6c760c-c007671_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:27.355232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0] Write session: try to update token
2025-10-15T10:58:27.355303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:27.363598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:27.363631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:27.363674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401197526640167:6214]
2025-10-15T10:58:27.363805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:27.363818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:27.365539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:27.366647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:27.367791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:27.369120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:27.370824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:27.371335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:27.421309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:27.421344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:27.421357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:27.421367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:27.421413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401197526640167:6214]
2025-10-15T10:58:27.421440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401197526640167:6214]
2025-10-15T10:58:27.421464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401197526640167:6214]
2025-10-15T10:58:27.421596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:27.421610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:27.421623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:27.421635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:27.421642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:27.421676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:27.421684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:27.421696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:27.426234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:27.440906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId: src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:27.463174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:27.568967Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:27.577386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:27.577428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:27.578153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:27.578695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:27.578734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:27.578880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401194726946980:6486]
2025-10-15T10:58:27.588960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 544 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0
2025-10-15T10:58:27.589511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 544 sessionId: src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0 is DEAD
2025-10-15T10:58:27.589943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:27.590006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0] Write session will restart in 0.007255s
2025-10-15T10:58:27.590213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0] Write session: Do CDS request
2025-10-15T10:58:27.590261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:27.601659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:27.601664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:27.601700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 545
2025-10-15T10:58:27.602150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:27.602311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:27.602336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:27.602347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:27.603705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 545 sessionId:  describe result for acl check
2025-10-15T10:58:27.603819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:27.603834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:27.603843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:27.603859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401194726947003:6868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:27.606294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401194726947003:6868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:27.613540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401194726947003:6868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:27.620542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401194726947003:6868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:27.620584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401194726947003:6868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:27.620602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401194726947003:6868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:27.620634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:27.635053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:27.639139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:27.639981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:27.640014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:27.640056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:27.640295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:27.640482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401197526640309:6222]
2025-10-15T10:58:27.643184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:27.644271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:27.644498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:27.645899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:27.646211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:27.646231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:27.646239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:27.646245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:27.646257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:27.646275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:27.646289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:27.646303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:27.646316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:27.646329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:27.646345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:27.646355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.646371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.646383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.646459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:27.646620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:27.646669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:27.646718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:27.646769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:27.646819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:27.646864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:27.646921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:27.646970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:27.647021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:27.647072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:27.647126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.647175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.647227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.647274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:27.647342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:27.647431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:27.647504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:27.647607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:27.647712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:27.647800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:27.647865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:27.647919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:27.647980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:27.648023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:27.648085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:27.648136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:27.648197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:27.648249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:27.648308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:27.648359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:27.648419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:27.648465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:27.648523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:27.648575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:27.648635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:27.648684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.648742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.648791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.648849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.648899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.648957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.649475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:27.669574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:27.679106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401194726947114:6486]
2025-10-15T10:58:27.684337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:27.684371Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:27.684382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:27.684397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:27.684422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 544 [2:7561401197526640309:6222]
2025-10-15T10:58:27.684469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:27.684513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:27.684524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:27.684534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:27.684542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:27.684588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:27.684608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:27.684624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:27.686660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.686680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.686689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.686697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:27.686884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:27.686901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:27.686994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:27.687117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:27.687118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 544, pipe: [1:7561401194726947114:6486]
2025-10-15T10:58:27.687214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 544
2025-10-15T10:58:27.687218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 544
2025-10-15T10:58:27.687271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:27.687331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401194726947114:6486], now have 1 active actors on pipe
2025-10-15T10:58:27.687377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401194726947043:6868], now have 1 active actors on pipe
2025-10-15T10:58:27.687400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401194726946990:2467], now have 1 active actors on pipe
2025-10-15T10:58:27.687424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401197526640304:6222]
2025-10-15T10:58:27.687434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401197526640304:6222]
2025-10-15T10:58:27.687444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401197526640304:6222]
2025-10-15T10:58:27.687479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:27.687508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:27.687532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:27.687544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:27.687550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:27.687704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:27.687722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:27.687762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:27.687780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:27.687880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401197526640304:6222]
2025-10-15T10:58:27.687901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:27.687928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:27.687948Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20209a48-27bf1037-c678a5c9-81778bcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:27.687967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:27.687980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:27.687987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:27.688012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:27.688039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:27.688153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:27.688596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:27.688619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:27.688670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:27.688941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 545 partition: 0 MaxSeqNo: 46 sessionId: src_id|20209a48-27bf1037-c678a5c9-81778bcc_0
2025-10-15T10:58:27.689670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1aa13-72396fb2-70eb73dd-7b6da293_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|20209a48-27bf1037-c678a5c9-81778bcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:27.708972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20209a48-27bf1037-c678a5c9-81778bcc_0] Write session: try to update token
2025-10-15T10:58:27.709026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20209a48-27bf1037-c678a5c9-81778bcc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:27.734113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:27.734153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:27.734188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401197526640304:6222]
2025-10-15T10:58:27.734342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:27.734350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:27.736167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:27.737393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:27.738587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:27.739845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:27.741511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:27.742046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:27.784227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:27.784264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:27.784277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:27.784289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:27.784326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401197526640304:6222]
2025-10-15T10:58:27.784353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401197526640304:6222]
2025-10-15T10:58:27.784376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401197526640304:6222]
2025-10-15T10:58:27.784508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:27.784525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:27.784547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:27.784557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:27.784593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:27.785689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:27.789099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId: src_id|20209a48-27bf1037-c678a5c9-81778bcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:27.811368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:27.931020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:27.931052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:27.927957Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:27.930306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:27.930336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:27.931013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:27.943653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:27.943873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401194726947114:6486]
2025-10-15T10:58:27.943978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 545 reason: error at write: Disconnected sessionId: src_id|20209a48-27bf1037-c678a5c9-81778bcc_0
2025-10-15T10:58:27.944373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 545 sessionId: src_id|20209a48-27bf1037-c678a5c9-81778bcc_0 is DEAD
2025-10-15T10:58:27.944742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20209a48-27bf1037-c678a5c9-81778bcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:27.944793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20209a48-27bf1037-c678a5c9-81778bcc_0] Write session will restart in 0.005385s
2025-10-15T10:58:27.944919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20209a48-27bf1037-c678a5c9-81778bcc_0] Write session: Do CDS request
2025-10-15T10:58:27.944962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20209a48-27bf1037-c678a5c9-81778bcc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:27.954403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20209a48-27bf1037-c678a5c9-81778bcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:27.976413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:27.976444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 546
2025-10-15T10:58:27.977231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:27.977412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:27.977436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:27.977451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:27.979562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 546 sessionId:  describe result for acl check
2025-10-15T10:58:27.979720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:27.979737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:27.979752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:27.979778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401194726947153:6878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:27.983373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401194726947153:6878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:27.990651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401194726947153:6878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:28.001428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401194726947153:6878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:28.001474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401194726947153:6878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:28.001492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401194726947153:6878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:28.001525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:28.019900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:28.022937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:28.023791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:28.023823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:28.023867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:28.024127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:28.024326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401201821607760:6224]
2025-10-15T10:58:28.026499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:28.030881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:28.031144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:28.032484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:28.032849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.032867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.032876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.032883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.032890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.032897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.032904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.032912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.032919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.032926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.032934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.032940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.032948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.032955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.033007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.033125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.033184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.033245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.033314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.033373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.033429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.033484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.033541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.033598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.033661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.033739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.033798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.033851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.033900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.033978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.034047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.034109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.034168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.034232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.034289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.034351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.034407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.034469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.034524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.034583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.034642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.034702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.034754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.034814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.034865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.034925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.034979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.035044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.035095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.035152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.035202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.035257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.035308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.036816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.036889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.036954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.037530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:28.044176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401199021914570:6486]
2025-10-15T10:58:28.054671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:28.065012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:28.065063Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:28.065082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:28.065101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:28.065126Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 545 [2:7561401201821607760:6224]
2025-10-15T10:58:28.065175Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:28.065236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:28.065251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:28.065264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:28.065275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:28.065336Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:28.065361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:28.065392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:28.066772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.066789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.066797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.066805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:28.067010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:28.067028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.067152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.067378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.067380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 545
2025-10-15T10:58:28.067503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 545
2025-10-15T10:58:28.067578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 545, pipe: [1:7561401199021914570:6486]
2025-10-15T10:58:28.067595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:28.067679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401194726947141:2467], now have 1 active actors on pipe
2025-10-15T10:58:28.067708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401199021914570:6486], now have 1 active actors on pipe
2025-10-15T10:58:28.067730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401199021914537:6878], now have 1 active actors on pipe
2025-10-15T10:58:28.067806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:28.067832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:28.067870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401201821607743:6224]
2025-10-15T10:58:28.067888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401201821607743:6224]
2025-10-15T10:58:28.067902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401201821607743:6224]
2025-10-15T10:58:28.067940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:28.068017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:28.068209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:28.068233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:28.068302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:28.068332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:28.068350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:28.068360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:28.068396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:28.068436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:28.068564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401201821607743:6224]
2025-10-15T10:58:28.068587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:28.068632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:28.068841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:28.068854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:28.068866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:28.068889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:28.069741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:28.069763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:28.069828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:28.071172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20209a48-27bf1037-c678a5c9-81778bcc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:28.070197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 546 partition: 0 MaxSeqNo: 46 sessionId: src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0
2025-10-15T10:58:28.094796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0] Write session: try to update token
2025-10-15T10:58:28.094858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:28.169181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId: src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:28.173409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:28.173446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:28.173460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:28.173472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:28.173507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401201821607743:6224]
2025-10-15T10:58:28.173536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401201821607743:6224]
2025-10-15T10:58:28.173560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401201821607743:6224]
2025-10-15T10:58:28.173698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:28.173742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:28.173778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:28.173785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:28.173800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:28.173811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:28.173858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:28.173882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:28.174901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:28.196553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:28.319849Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:28.329160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:28.329211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:28.329284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:28.329294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:28.329340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401201821607743:6224]
2025-10-15T10:58:28.329505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:28.329849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:28.329817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:28.329925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401199021914570:6486]
2025-10-15T10:58:28.329981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:28.330016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:28.340392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 546 reason: error at write: Disconnected sessionId: src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0
2025-10-15T10:58:28.340763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 546 sessionId: src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0 is DEAD
2025-10-15T10:58:28.341068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:28.341136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0] Write session will restart in 0.006167s
2025-10-15T10:58:28.341300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0] Write session: Do CDS request
2025-10-15T10:58:28.341352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:28.351958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:28.352064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:28.351993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 547
2025-10-15T10:58:28.352554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:28.352695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:28.352718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:28.352729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:28.354142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 547 sessionId:  describe result for acl check
2025-10-15T10:58:28.354253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:28.354272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:28.354283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:28.354300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401199021914607:6886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:28.356919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401199021914607:6886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:28.362195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401199021914607:6886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:28.372864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401199021914607:6886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:28.372904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401199021914607:6886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:28.372920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401199021914607:6886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:28.372948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:28.384145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:28.386331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:28.387243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:28.387276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:28.387320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:28.387601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:28.387790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401201821607895:6235]
2025-10-15T10:58:28.390221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:28.391272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:28.391517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:28.392821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:28.393150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.393167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.393174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.393180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.393186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.393193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.393199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.393206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.393214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.393220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.393227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.393234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.393241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.393248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.393292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.393433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.393518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.393610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.393701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.393782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.393873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.393959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.394055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.394161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.394244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.394334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.394439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.394525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.394632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.394764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.394874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.395009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.395102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.395220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.395383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.395519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.395629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.395752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.395852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.395977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.396085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.396212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.396298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.396407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.396489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.396602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.396670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.396805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.396925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.397000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.397088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.397176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.397240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.397337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.397404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.397497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.398002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:28.414776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:28.430220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401199021914717:6486]
2025-10-15T10:58:28.439788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:28.439842Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:28.439861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:28.439885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:28.439915Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 546 [2:7561401201821607895:6235]
2025-10-15T10:58:28.439978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:28.440050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:28.440067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:28.440082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:28.440096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:28.440153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:28.440182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:28.440208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:28.441361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.441390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.441403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.441415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:28.441696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:28.441720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.441878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.442072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.442301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:28.442374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401201821607890:6235]
2025-10-15T10:58:28.442392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401201821607890:6235]
2025-10-15T10:58:28.442405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401201821607890:6235]
2025-10-15T10:58:28.442434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:28.442590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:28.442616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:28.442626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:28.442890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:28.442962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 546, pipe: [1:7561401199021914717:6486]
2025-10-15T10:58:28.442982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 546
2025-10-15T10:58:28.443050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 546
2025-10-15T10:58:28.443072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:28.443099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:28.443154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401199021914717:6486], now have 1 active actors on pipe
2025-10-15T10:58:28.443175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401199021914710:6886], now have 1 active actors on pipe
2025-10-15T10:58:28.443196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401199021914593:2467], now have 1 active actors on pipe
2025-10-15T10:58:28.443326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401201821607890:6235]
2025-10-15T10:58:28.443381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:28.443440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:28.443983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:28.444015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:28.444092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:28.444128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:28.444149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:28.444159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:28.444193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:28.444229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:28.444286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:28.444679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:28.444701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:28.444756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:28.445023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 547 partition: 0 MaxSeqNo: 46 sessionId: src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0
2025-10-15T10:58:28.445693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ed6d7d-8a78fac8-4ae4a54e-e03433c8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:28.472229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0] Write session: try to update token
2025-10-15T10:58:28.472286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:28.484013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:28.484047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:28.484084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401201821607890:6235]
2025-10-15T10:58:28.484199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:28.484208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:28.486281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:28.487727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:28.489298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:28.490551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:28.492747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:28.493363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:28.541133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:28.541169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:28.541182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:28.541192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:28.541232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401201821607890:6235]
2025-10-15T10:58:28.541282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401201821607890:6235]
2025-10-15T10:58:28.541324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401201821607890:6235]
2025-10-15T10:58:28.541494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:28.541533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:28.542562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:28.543338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:28.543390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:28.543416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:28.563266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId: src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:28.588051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:28.688583Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:28.690058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:28.690101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:28.690690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401199021914717:6486]
2025-10-15T10:58:28.690817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:28.690830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:28.690837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:28.691740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:28.722851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 547 reason: error at write: Disconnected sessionId: src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0
2025-10-15T10:58:28.723228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 547 sessionId: src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0 is DEAD
2025-10-15T10:58:28.723665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:28.723734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0] Write session will restart in 0.009286s
2025-10-15T10:58:28.723921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0] Write session: Do CDS request
2025-10-15T10:58:28.723977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:28.741055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:28.742243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:28.742279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 548
2025-10-15T10:58:28.742657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:28.742819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:28.742847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:28.742858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:28.744715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 548 sessionId:  describe result for acl check
2025-10-15T10:58:28.744841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:28.744861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:28.744871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:28.744890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401199021914817:6891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:28.747835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401199021914817:6891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:28.752712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:28.754159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401199021914817:6891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:28.755801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:28.756624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:28.756653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:28.756691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:28.756932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:28.757121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401201821608024:6237]
2025-10-15T10:58:28.758876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:28.759750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:28.759943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:28.760897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401199021914817:6891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:28.760950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:28.760941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401199021914817:6891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:28.760960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401199021914817:6891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:28.760992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:28.761193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.761206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.761211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.761215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.761220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.761224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.761229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.761233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.761237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.761241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.761245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.761250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.761254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.761258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.761290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.761386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.761422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.761453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.761486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.761521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.761562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.761607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.761649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.761682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.761714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.761763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.761807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.761851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.761902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.761972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:28.762025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.762081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:28.762137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.762195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:28.762246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.762301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:28.762353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.762410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:28.762457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.762515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:28.762565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.762620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:28.762664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.762719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:28.762770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.762829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:28.762872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.762924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:28.762974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.763017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:28.763044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.763091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.763129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.763166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.763205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.763256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.763663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:28.779204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:28.788303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:28.788350Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:28.788365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:28.788384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:28.788406Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 547 [2:7561401201821608024:6237]
2025-10-15T10:58:28.788458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:28.788514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:28.788529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:28.788541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:28.788552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:28.788604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:28.788626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:28.788645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:28.789822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.789848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.789863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.789875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:28.790126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:28.790154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:28.790288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:28.790377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 547
2025-10-15T10:58:28.790455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 547
2025-10-15T10:58:28.790477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:28.790720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:28.790805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401199021914850:6891], now have 1 active actors on pipe
2025-10-15T10:58:28.790836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401199021914728:2467], now have 1 active actors on pipe
2025-10-15T10:58:28.790897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:28.790925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:28.790959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401201821608019:6237]
2025-10-15T10:58:28.790980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401201821608019:6237]
2025-10-15T10:58:28.790993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401201821608019:6237]
2025-10-15T10:58:28.791027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:28.791056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:28.791076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:28.791086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:28.791094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:28.791110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401199021914854:6486]
2025-10-15T10:58:28.791265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:28.791291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:28.791365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:28.791403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:28.791418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:28.791427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:28.791458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:28.791494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:28.791538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 547, pipe: [1:7561401199021914854:6486]
2025-10-15T10:58:28.791612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401201821608019:6237]
2025-10-15T10:58:28.791642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:28.791658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:28.791680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401199021914854:6486], now have 1 active actors on pipe
2025-10-15T10:58:28.791706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:28.792238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:28.792267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:28.792328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:28.792654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 548 partition: 0 MaxSeqNo: 46 sessionId: src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0
2025-10-15T10:58:28.793625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9cf938-9ac8424a-37a99e8d-ef288922_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:28.815332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0] Write session: try to update token
2025-10-15T10:58:28.815413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:28.885780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:28.885807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:28.885816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:28.885824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:28.885847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401201821608019:6237]
2025-10-15T10:58:28.885876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401201821608019:6237]
2025-10-15T10:58:28.885890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401201821608019:6237]
2025-10-15T10:58:28.886025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:28.886046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:28.886062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:28.886065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:28.886090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:28.887060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:28.895496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId: src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:28.916121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:29.032099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:29.045146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:29.045198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:29.045265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:29.045280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:29.045337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401201821608019:6237]
2025-10-15T10:58:29.047045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:29.047505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:29.048345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:29.048466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:29.048496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401199021914854:6486]
2025-10-15T10:58:29.059750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 548 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0
2025-10-15T10:58:29.060063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 548 sessionId: src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0 is DEAD
2025-10-15T10:58:29.066144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:29.066210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0] Write session will restart in 0.008210s
2025-10-15T10:58:29.066371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0] Write session: Do CDS request
2025-10-15T10:58:29.066420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:29.079912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:29.079750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:29.079784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 549
2025-10-15T10:58:29.080411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:29.080537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:29.080553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:29.080563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:29.082548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 549 sessionId:  describe result for acl check
2025-10-15T10:58:29.082728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:29.082746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:29.082764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:29.082796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401203316882197:6896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:29.087032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401203316882197:6896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:29.102321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401203316882197:6896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:29.111504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401203316882197:6896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:29.111552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401203316882197:6896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:29.111570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401203316882197:6896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:29.111600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:29.119229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:29.120866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:29.121723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:29.121754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:29.121801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:29.122097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:29.122312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401206116575473:6242]
2025-10-15T10:58:29.124645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:29.125714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:29.126114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:29.127181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:29.127518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.127533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.127537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.127542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.127546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.127550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.127554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.127558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.127563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.127567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.127572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.127576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.127582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.127590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.127632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.127735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.127779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.127822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.127863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.127907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.127951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.128005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.128051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.128101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.128150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.128199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.128251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.128311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.128356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.128420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.128557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.128620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.128665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.128728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.128768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.128826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.128879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.128929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.128975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.129026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.129070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.129122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.129163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.129216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.129259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.129311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.129371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.129428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.129478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.129532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.129582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.129654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.129706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.129763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.129809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.129864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.130501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:29.148571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401203316882308:6486]
2025-10-15T10:58:29.151587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:29.162970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:29.163022Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:29.163042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:29.163062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:29.163089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 548 [2:7561401206116575473:6242]
2025-10-15T10:58:29.163146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:29.163209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:29.163225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:29.163238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:29.163250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:29.163300Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:29.163324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:29.163363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:29.165279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.165307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.165330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.165343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:29.165629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:29.165654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.165807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.165984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.166149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:29.166484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 548
2025-10-15T10:58:29.166490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 548, pipe: [1:7561401203316882308:6486]
2025-10-15T10:58:29.166598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 548
2025-10-15T10:58:29.166227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401203316882299:6896], now have 1 active actors on pipe
2025-10-15T10:58:29.166260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401203316882308:6486], now have 1 active actors on pipe
2025-10-15T10:58:29.166283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401203316882181:2467], now have 1 active actors on pipe
2025-10-15T10:58:29.166302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401206116575468:6242]
2025-10-15T10:58:29.166312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401206116575468:6242]
2025-10-15T10:58:29.166326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401206116575468:6242]
2025-10-15T10:58:29.166362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:29.166418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:29.166441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:29.166455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:29.166458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:29.166632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:29.166644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:29.166790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:29.166810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:29.166841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401206116575468:6242]
2025-10-15T10:58:29.166868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:29.166889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:29.166975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:29.167004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:29.167030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:29.167043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:29.167087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:29.167130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:29.167227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:29.167909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:29.167934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:29.167999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:29.168480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 549 partition: 0 MaxSeqNo: 46 sessionId: src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0
2025-10-15T10:58:29.169289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb67fccd-1a6e2564-c83134ad-dcc491f5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:29.209440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0] Write session: try to update token
2025-10-15T10:58:29.209493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:29.275779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:29.275809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:29.275820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:29.275831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:29.275860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401206116575468:6242]
2025-10-15T10:58:29.275883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401206116575468:6242]
2025-10-15T10:58:29.275906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401206116575468:6242]
2025-10-15T10:58:29.276081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:29.276096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:29.276109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:29.276120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:29.276133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:29.276157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:29.276176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:29.276178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:29.285578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:29.314987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId: src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:29.340483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:29.424088Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:29.435054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:29.435098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:29.435160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:29.435173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:29.435210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401206116575468:6242]
2025-10-15T10:58:29.435659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:29.435807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:29.435736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401203316882308:6486]
2025-10-15T10:58:29.435813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:29.435924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:29.435947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:29.465619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 549 reason: error at write: Disconnected sessionId: src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0
2025-10-15T10:58:29.465888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 549 sessionId: src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0 is DEAD
2025-10-15T10:58:29.467673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:29.467728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0] Write session will restart in 0.006473s
2025-10-15T10:58:29.467869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0] Write session: Do CDS request
2025-10-15T10:58:29.467912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:29.491294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:29.497245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:29.497275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 550
2025-10-15T10:58:29.499538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:29.499671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:29.499686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:29.499695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:29.501895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 550 sessionId:  describe result for acl check
2025-10-15T10:58:29.502005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:29.502019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:29.502027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:29.502045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401203316882382:6909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:29.504591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401203316882382:6909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:29.513206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401203316882382:6909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:29.518103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:29.522055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:29.522909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:29.522938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:29.522976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:29.522963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401203316882382:6909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:29.522998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401203316882382:6909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:29.523013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401203316882382:6909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:29.523037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:29.523229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:29.523492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401206116575623:6249]
2025-10-15T10:58:29.525521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:29.526628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:29.526817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:29.528278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:29.528599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.528624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.528631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.528644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.528650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.528657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.528662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.528668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.528674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.528681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.528687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.528693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.528700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.528705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.528745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.528854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.528899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.528967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.529015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.529057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.529099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.529142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.529185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.529236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.529279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.529321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.529377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.529421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.529463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.529533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.529585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.529636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.529684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.529731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.529773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.529823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.529871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.529920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.529962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.530013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.530059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.530109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.530153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.530203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.530247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.530312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.530361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.530415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.530466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.530517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.530561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.530632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.530678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.530731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.530775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.530826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.531288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:29.536166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401203316882464:6486]
2025-10-15T10:58:29.546737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:29.557373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:29.557418Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:29.557434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:29.557450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:29.557471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 549 [2:7561401206116575623:6249]
2025-10-15T10:58:29.557519Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:29.557570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:29.557583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:29.557594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:29.557604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:29.557647Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:29.557667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:29.557686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:29.567203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.567236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.567257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.567269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:29.567551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:29.567574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.567731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.567899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.568112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:29.567996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 549
2025-10-15T10:58:29.568191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401203316882458:6909], now have 1 active actors on pipe
2025-10-15T10:58:29.568093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 549
2025-10-15T10:58:29.568217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401203316882334:2467], now have 1 active actors on pipe
2025-10-15T10:58:29.568158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 549, pipe: [1:7561401203316882464:6486]
2025-10-15T10:58:29.568238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401203316882464:6486], now have 1 active actors on pipe
2025-10-15T10:58:29.568291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:29.568318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:29.568350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401206116575618:6249]
2025-10-15T10:58:29.568364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401206116575618:6249]
2025-10-15T10:58:29.568375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401206116575618:6249]
2025-10-15T10:58:29.568414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:29.568465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:29.568483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:29.568496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:29.568508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:29.568638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:29.568660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:29.568733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2b1ca00-5cf3f406-82381b48-489247df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:29.568759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:29.568775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:29.568784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:29.568814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:29.568850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:29.568980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401206116575618:6249]
2025-10-15T10:58:29.569015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:29.569058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:29.569072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:29.569563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:29.569598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:29.569663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:29.569960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 550 partition: 0 MaxSeqNo: 46 sessionId: src_id|c2b1ca00-5cf3f406-82381b48-489247df_0
2025-10-15T10:58:29.570712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ce3e775-a01e7a1-c1d01c36-4b6e4927_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c2b1ca00-5cf3f406-82381b48-489247df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:29.591707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1ca00-5cf3f406-82381b48-489247df_0] Write session: try to update token
2025-10-15T10:58:29.591762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1ca00-5cf3f406-82381b48-489247df_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:29.602704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:29.602743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:29.602787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401206116575618:6249]
2025-10-15T10:58:29.602930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:29.602927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:29.604980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:29.606438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:29.608070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:29.609483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:29.611293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:29.611680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:29.682171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId: src_id|c2b1ca00-5cf3f406-82381b48-489247df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:29.689001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:29.689030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:29.689038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:29.689082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:29.689092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:29.689100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:29.689108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:29.689138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401206116575618:6249]
2025-10-15T10:58:29.689153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401206116575618:6249]
2025-10-15T10:58:29.689172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401206116575618:6249]
2025-10-15T10:58:29.689276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:29.689291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:29.689314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:29.689368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:29.689399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:29.690169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:29.710657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:29.831926Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:29.833554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:29.833601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:29.834496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:29.834516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:29.834533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:29.834772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401203316882464:6486]
2025-10-15T10:58:29.834350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:29.872964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 550 reason: error at write: Disconnected sessionId: src_id|c2b1ca00-5cf3f406-82381b48-489247df_0
2025-10-15T10:58:29.873280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 550 sessionId: src_id|c2b1ca00-5cf3f406-82381b48-489247df_0 is DEAD
2025-10-15T10:58:29.873634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1ca00-5cf3f406-82381b48-489247df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:29.873681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1ca00-5cf3f406-82381b48-489247df_0] Write session will restart in 0.006837s
2025-10-15T10:58:29.873855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1ca00-5cf3f406-82381b48-489247df_0] Write session: Do CDS request
2025-10-15T10:58:29.873921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1ca00-5cf3f406-82381b48-489247df_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:29.885246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:29.885273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 551
2025-10-15T10:58:29.885402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1ca00-5cf3f406-82381b48-489247df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:29.885838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:29.885915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:29.885931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:29.885938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:29.887501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 551 sessionId:  describe result for acl check
2025-10-15T10:58:29.887627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:29.887638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:29.887644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:29.887657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401203316882577:6916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:29.890143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401203316882577:6916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:29.895504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:29.898512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401203316882577:6916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:29.900187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:29.901114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:29.901145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:29.901190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:29.901480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:29.901685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401206116575760:6258]
2025-10-15T10:58:29.904014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:29.904970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:29.905197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:29.905991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401203316882577:6916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:29.906036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401203316882577:6916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:29.906054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401203316882577:6916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:29.906086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:29.906538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:29.906812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.906826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.906831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.906835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.906840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.906844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.906849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.906854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.906858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.906863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.906867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.906874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.906879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.906884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.906922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.907036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.907072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.907107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.907142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.907183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.907224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.907259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.907301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.907341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.907412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.907461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.907513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.907561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.907609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.907685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:29.907752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.907814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:29.907869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.907932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:29.907985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.908062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:29.908121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.908185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:29.908238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.908300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:29.908357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.908419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:29.908467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.908529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:29.908586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.908649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:29.908707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.908764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:29.908818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.908882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:29.908933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.908981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.909023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.909060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.909114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.909172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.909635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:29.927162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:29.934991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401203316882617:6486]
2025-10-15T10:58:29.936363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:29.936404Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:29.936424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:29.936446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:29.936471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 550 [2:7561401206116575760:6258]
2025-10-15T10:58:29.936527Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:29.936595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:29.936612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:29.936625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:29.936639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:29.936694Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:29.936721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:29.936746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:29.956417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.956450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.956461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.956472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:29.956741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:29.956764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:29.956909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:29.957091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:29.957308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:29.957406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401203316882617:6486], now have 1 active actors on pipe
2025-10-15T10:58:29.957429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401203316882612:6916], now have 1 active actors on pipe
2025-10-15T10:58:29.958139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 550, pipe: [1:7561401203316882617:6486]
2025-10-15T10:58:29.957451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401203316882486:2467], now have 1 active actors on pipe
2025-10-15T10:58:29.957477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401206116575754:6258]
2025-10-15T10:58:29.957492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401206116575754:6258]
2025-10-15T10:58:29.957503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401206116575754:6258]
2025-10-15T10:58:29.957546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:29.957591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:29.957606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:29.957625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:29.957631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:29.957813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:29.957829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:29.957951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401206116575754:6258]
2025-10-15T10:58:29.957978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:29.958019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:29.958526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:29.958556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:29.958659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:29.958697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:29.958720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:29.958762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:29.958818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:29.958866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:29.958919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:29.958292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 550
2025-10-15T10:58:29.958377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 550
2025-10-15T10:58:29.959656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:29.959697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:29.959774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:29.960073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 551 partition: 0 MaxSeqNo: 46 sessionId: src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0
2025-10-15T10:58:29.960788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2b1ca00-5cf3f406-82381b48-489247df_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:29.989054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0] Write session: try to update token
2025-10-15T10:58:29.989106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:29.994696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:29.994727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:29.994765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401206116575754:6258]
2025-10-15T10:58:29.994886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:29.994911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:29.997205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:29.998656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:30.000203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:30.001684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:30.004810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:30.005432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:30.080624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:30.080658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:30.080671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:30.080728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:30.080743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:30.080755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:30.080766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:30.080807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401206116575754:6258]
2025-10-15T10:58:30.080835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401206116575754:6258]
2025-10-15T10:58:30.080859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401206116575754:6258]
2025-10-15T10:58:30.080994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:30.081016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:30.081260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:30.081298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:30.081356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:30.083683Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:30.102147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId: src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:30.124594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:30.226929Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:30.228426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:30.228459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:30.229035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:30.229235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401203316882617:6486]
2025-10-15T10:58:30.229312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:30.229320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:30.230958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:30.262562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 551 reason: error at write: Disconnected sessionId: src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0
2025-10-15T10:58:30.262894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 551 sessionId: src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0 is DEAD
2025-10-15T10:58:30.267063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:30.267118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0] Write session will restart in 0.006795s
2025-10-15T10:58:30.267248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0] Write session: Do CDS request
2025-10-15T10:58:30.267293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:30.280084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:30.280125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 552
2025-10-15T10:58:30.280297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:30.281358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:30.281587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:30.281613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:30.281624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:30.284209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 552 sessionId:  describe result for acl check
2025-10-15T10:58:30.284322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:30.284338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:30.284347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:30.284363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401207611850030:6921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:30.286802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401207611850030:6921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:30.291520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401207611850030:6921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:30.291426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:30.295121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:30.295876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:30.295908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:30.295944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:30.296165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:30.296344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401210411543201:6262]
2025-10-15T10:58:30.297588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401207611850030:6921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:30.297628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401207611850030:6921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:30.297646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401207611850030:6921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:30.297672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:30.298389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:30.300076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:30.300285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:30.301482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:30.301770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:30.301786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:30.301792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:30.301799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:30.301805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:30.301812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:30.301818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:30.301823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:30.301829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:30.301835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:30.301842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:30.301847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.301853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.301859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.301899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:30.301993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:30.302035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:30.302077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:30.302114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:30.302154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:30.302193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:30.302231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:30.302270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:30.302320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:30.302363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:30.302406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.302450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.302496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.302538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:30.302598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:30.302666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:30.302718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:30.302767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:30.302819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:30.302864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:30.302917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:30.302964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:30.303017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:30.303055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:30.303101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:30.303147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:30.303197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:30.303241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:30.303289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:30.303336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:30.303595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:30.303646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:30.303697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:30.303744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:30.303796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:30.303839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.303898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.303939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.303986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.304024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.304076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.304498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:30.321974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:30.329715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401207611850067:6486]
2025-10-15T10:58:30.336565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:30.336609Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:30.336624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:30.336640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:30.336663Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 551 [2:7561401210411543201:6262]
2025-10-15T10:58:30.336708Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:30.336760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:30.336772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:30.336784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:30.336794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:30.336840Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:30.336860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:30.336877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:30.337902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.337926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.337939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.337950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:30.338198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:30.338219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.338356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.338532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.338738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:30.338795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401210411543196:6262]
2025-10-15T10:58:30.338812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401210411543196:6262]
2025-10-15T10:58:30.338824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401210411543196:6262]
2025-10-15T10:58:30.338857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:30.338918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:30.338980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:30.339001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:30.339012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:30.339086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:30.339108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:30.339213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401210411543196:6262]
2025-10-15T10:58:30.339236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:30.339270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:30.339314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401207611850067:6486], now have 1 active actors on pipe
2025-10-15T10:58:30.339507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 551
2025-10-15T10:58:30.339523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 551, pipe: [1:7561401207611850067:6486]
2025-10-15T10:58:30.339621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 551
2025-10-15T10:58:30.339670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401207611849940:2467], now have 1 active actors on pipe
2025-10-15T10:58:30.339746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401207611850062:6921], now have 1 active actors on pipe
2025-10-15T10:58:30.340035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:30.340060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:30.340121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|142dde4-90541c38-94d290cd-d092dbf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:30.340150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:30.340166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:30.340176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:30.340205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:30.340238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:30.340280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:30.340993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:30.341021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:30.341082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:30.341385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 552 partition: 0 MaxSeqNo: 46 sessionId: src_id|142dde4-90541c38-94d290cd-d092dbf1_0
2025-10-15T10:58:30.342163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c78f39d0-bc219db0-63b1f9d7-2aed6f4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|142dde4-90541c38-94d290cd-d092dbf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:30.366845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|142dde4-90541c38-94d290cd-d092dbf1_0] Write session: try to update token
2025-10-15T10:58:30.366912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|142dde4-90541c38-94d290cd-d092dbf1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:30.452340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:30.452378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:30.452395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:30.452408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:30.452449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401210411543196:6262]
2025-10-15T10:58:30.452478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401210411543196:6262]
2025-10-15T10:58:30.452503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401210411543196:6262]
2025-10-15T10:58:30.452674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:30.452716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:30.452744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:30.452751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:30.452765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:30.452777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:30.452832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:30.452855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:30.454156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:30.482962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId: src_id|142dde4-90541c38-94d290cd-d092dbf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:30.504276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:30.615427Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:30.635006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:30.635049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:30.635119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:30.635134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:30.635175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401210411543196:6262]
2025-10-15T10:58:30.635589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:30.635781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:30.635935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401207611850067:6486]
2025-10-15T10:58:30.636012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:30.636142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:30.636161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:30.654569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 552 reason: error at write: Disconnected sessionId: src_id|142dde4-90541c38-94d290cd-d092dbf1_0
2025-10-15T10:58:30.654906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 552 sessionId: src_id|142dde4-90541c38-94d290cd-d092dbf1_0 is DEAD
2025-10-15T10:58:30.655402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142dde4-90541c38-94d290cd-d092dbf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:30.655445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142dde4-90541c38-94d290cd-d092dbf1_0] Write session will restart in 0.009499s
2025-10-15T10:58:30.655610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142dde4-90541c38-94d290cd-d092dbf1_0] Write session: Do CDS request
2025-10-15T10:58:30.655660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142dde4-90541c38-94d290cd-d092dbf1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:30.682458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|142dde4-90541c38-94d290cd-d092dbf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:30.686136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:30.686189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 553
2025-10-15T10:58:30.687819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:30.687971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:30.688004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:30.688015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:30.689311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 553 sessionId:  describe result for acl check
2025-10-15T10:58:30.689441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:30.689459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:30.689470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:30.689487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401207611850103:6926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:30.692203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401207611850103:6926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:30.704284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401207611850103:6926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:30.712572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401207611850103:6926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:30.712616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401207611850103:6926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:30.712634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401207611850103:6926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:30.712663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:30.719805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:30.722119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:30.723013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:30.723042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:30.723088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:30.723339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:30.723550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401210411543347:6270]
2025-10-15T10:58:30.725810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:30.726673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:30.726894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:30.728165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:30.728495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:30.728504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:30.728510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:30.728518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:30.728525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:30.728532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:30.728539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:30.728546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:30.728553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:30.728560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:30.728568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:30.728576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.728582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.728590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.728637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:30.728741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:30.728789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:30.728835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:30.728883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:30.728933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:30.728979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:30.729029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:30.729077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:30.729127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:30.729174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:30.729219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.729263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.729310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.729365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:30.729433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:30.729494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:30.729552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:30.729604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:30.729659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:30.729707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:30.729762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:30.729811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:30.729863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:30.729911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:30.729968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:30.730017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:30.730072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:30.730122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:30.730178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:30.730231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:30.730289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:30.730333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:30.730387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:30.730436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:30.730488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:30.730535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.730589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.730639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.730696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.730741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.730797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.732535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:30.735712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401207611850222:6486]
2025-10-15T10:58:30.756852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:30.768111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:30.768162Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:30.768178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:30.768197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:30.768223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 552 [2:7561401210411543347:6270]
2025-10-15T10:58:30.768277Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:30.768335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:30.768349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:30.768362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:30.768375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:30.768426Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:30.768450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:30.768472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:30.770676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.770707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.770721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.770732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:30.770985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:30.771013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:30.771161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:30.771445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 552
2025-10-15T10:58:30.771471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:30.771536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 552, pipe: [1:7561401207611850222:6486]
2025-10-15T10:58:30.771622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 552
2025-10-15T10:58:30.771738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:30.771849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401207611850204:6926], now have 1 active actors on pipe
2025-10-15T10:58:30.771883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401207611850222:6486], now have 1 active actors on pipe
2025-10-15T10:58:30.771906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401207611850078:2467], now have 1 active actors on pipe
2025-10-15T10:58:30.771957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:30.771987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:30.772025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401210411543342:6270]
2025-10-15T10:58:30.772047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401210411543342:6270]
2025-10-15T10:58:30.772060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401210411543342:6270]
2025-10-15T10:58:30.772101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:30.772137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:30.772165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:30.772176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:30.772179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:30.772359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:30.772383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:30.772463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e272432d-86780676-b9021fc8-c7b215a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:30.772504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:30.772524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:30.772535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:30.772587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:30.772634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:30.772767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401210411543342:6270]
2025-10-15T10:58:30.772808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:30.772848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:30.772871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:30.773450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:30.773479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:30.773548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:30.774499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 553 partition: 0 MaxSeqNo: 46 sessionId: src_id|e272432d-86780676-b9021fc8-c7b215a9_0
2025-10-15T10:58:30.775317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|142dde4-90541c38-94d290cd-d092dbf1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e272432d-86780676-b9021fc8-c7b215a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:30.797967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e272432d-86780676-b9021fc8-c7b215a9_0] Write session: try to update token
2025-10-15T10:58:30.798026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e272432d-86780676-b9021fc8-c7b215a9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:30.806665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:30.806704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:30.806743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401210411543342:6270]
2025-10-15T10:58:30.806874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:30.807728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:30.809254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:30.810705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:30.812405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:30.813935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:30.816539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:30.817208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:30.873822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:30.873876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:30.873903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:30.873923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:30.873987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401210411543342:6270]
2025-10-15T10:58:30.874041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401210411543342:6270]
2025-10-15T10:58:30.874089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401210411543342:6270]
2025-10-15T10:58:30.874326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:30.874340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:30.874352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:30.874399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:30.874418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:30.874517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:30.874547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:30.874572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:30.884167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:30.929864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId: src_id|e272432d-86780676-b9021fc8-c7b215a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:30.954931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:31.034163Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:31.036359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:31.036401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:31.037913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:31.037273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:31.037309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:31.046790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 553 reason: error at write: Disconnected sessionId: src_id|e272432d-86780676-b9021fc8-c7b215a9_0
2025-10-15T10:58:31.051770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 553 sessionId: src_id|e272432d-86780676-b9021fc8-c7b215a9_0 is DEAD
2025-10-15T10:58:31.055839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272432d-86780676-b9021fc8-c7b215a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:31.055889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272432d-86780676-b9021fc8-c7b215a9_0] Write session will restart in 0.005675s
2025-10-15T10:58:31.056044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272432d-86780676-b9021fc8-c7b215a9_0] Write session: Do CDS request
2025-10-15T10:58:31.056088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272432d-86780676-b9021fc8-c7b215a9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:31.077014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e272432d-86780676-b9021fc8-c7b215a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:31.085632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401207611850222:6486]
2025-10-15T10:58:31.085714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:31.088620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:31.088653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 554
2025-10-15T10:58:31.089433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:31.089545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:31.089560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:31.089570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:31.091052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 554 sessionId:  describe result for acl check
2025-10-15T10:58:31.091169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:31.091180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:31.091189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:31.091206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401211906817578:6937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:31.094821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401211906817578:6937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:31.108821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401211906817578:6937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:31.113389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:31.119318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:31.120200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:31.120237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:31.120281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:31.120556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:31.120747Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401214706510806:6277]
2025-10-15T10:58:31.119617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401211906817578:6937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:31.119656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401211906817578:6937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:31.119672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401211906817578:6937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:31.119700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:31.122873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:31.123847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:31.124083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:31.125346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:31.125690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.125698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.125705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.125712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.125719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.125725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.125732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.125738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.125744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.125751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.125758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.125765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.125771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.125779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.125825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.125935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.125982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.126030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.126076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.126128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.126174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.126218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.126263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.126310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.126355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.126401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.126447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.126495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.126534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.126599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.126658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.126714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.126760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.126814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.126856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.126911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.126958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.127011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.127055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.127107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.127153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.127205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.127247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.127295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.127343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.128320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.128380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.128433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.128476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.128525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.128571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.128620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.128667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.128718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.128761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.128810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.129286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:31.159847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:31.168903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:31.168949Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:31.168967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:31.168989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:31.169016Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 553 [2:7561401214706510806:6277]
2025-10-15T10:58:31.169070Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:31.169133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:31.169155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:31.169168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:31.169176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:31.169214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:31.169232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:31.169249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:31.170329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.170339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.170349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.170357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:31.170573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:31.170605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.170727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.170890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.171075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:31.171123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401214706510801:6277]
2025-10-15T10:58:31.171135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401214706510801:6277]
2025-10-15T10:58:31.171145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401214706510801:6277]
2025-10-15T10:58:31.171170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:31.171222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:31.171251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:31.171265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:31.171277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:31.171394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:31.171415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:31.171559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401211906817670:6937], now have 1 active actors on pipe
2025-10-15T10:58:31.171585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401211906817546:2467], now have 1 active actors on pipe
2025-10-15T10:58:31.171604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401214706510801:6277]
2025-10-15T10:58:31.171635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:31.171683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:31.171741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 553
2025-10-15T10:58:31.171846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 553
2025-10-15T10:58:31.172300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:31.172331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:31.172417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d0d1d8c-42840244-7032e0-f667c056_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:31.172455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:31.172478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:31.172489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:31.172528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:31.173621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 554 partition: 0 MaxSeqNo: 46 sessionId: src_id|7d0d1d8c-42840244-7032e0-f667c056_0
2025-10-15T10:58:31.174350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e272432d-86780676-b9021fc8-c7b215a9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7d0d1d8c-42840244-7032e0-f667c056_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:31.172575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:31.172636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:31.173185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:31.173207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:31.173276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:31.185859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401211906817693:6486]
2025-10-15T10:58:31.186535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401211906817693:6486], now have 1 active actors on pipe
2025-10-15T10:58:31.186607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 553, pipe: [1:7561401211906817693:6486]
2025-10-15T10:58:31.205314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d0d1d8c-42840244-7032e0-f667c056_0] Write session: try to update token
2025-10-15T10:58:31.205392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d0d1d8c-42840244-7032e0-f667c056_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:31.285527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:31.285573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:31.285594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:31.285610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:31.285656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401214706510801:6277]
2025-10-15T10:58:31.285692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401214706510801:6277]
2025-10-15T10:58:31.285724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401214706510801:6277]
2025-10-15T10:58:31.285984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:31.286004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:31.286020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:31.286170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:31.286192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:31.287446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:31.287481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:31.287507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:31.288133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:31.321550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId: src_id|7d0d1d8c-42840244-7032e0-f667c056_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:31.364772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:31.435583Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:31.445851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:31.445908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:31.445991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:31.446007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:31.446054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401214706510801:6277]
2025-10-15T10:58:31.446493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:31.446671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:31.450080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:31.450743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401211906817693:6486]
2025-10-15T10:58:31.450859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:31.462424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d0d1d8c-42840244-7032e0-f667c056_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:31.462524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d0d1d8c-42840244-7032e0-f667c056_0] Write session will restart in 0.005028s
2025-10-15T10:58:31.462713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d0d1d8c-42840244-7032e0-f667c056_0] Write session: Do CDS request
2025-10-15T10:58:31.462765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d0d1d8c-42840244-7032e0-f667c056_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:31.460527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d0d1d8c-42840244-7032e0-f667c056_0
2025-10-15T10:58:31.460794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 554 sessionId: src_id|7d0d1d8c-42840244-7032e0-f667c056_0 is DEAD
2025-10-15T10:58:31.478225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d0d1d8c-42840244-7032e0-f667c056_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:31.478117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:31.478156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 555
2025-10-15T10:58:31.480682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:31.480787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:31.480796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:31.480805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:31.482014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 555 sessionId:  describe result for acl check
2025-10-15T10:58:31.482100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:31.482108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:31.482114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:31.482126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401211906817713:6944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:31.484357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401211906817713:6944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:31.497231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401211906817713:6944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:31.524356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401211906817713:6944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:31.524401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401211906817713:6944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:31.524419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401211906817713:6944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:31.524450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:31.544184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:31.550751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401211906817829:6486]
2025-10-15T10:58:31.550605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:31.551479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:31.551498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:31.551537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:31.551781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:31.551956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401214706510953:6283]
2025-10-15T10:58:31.554370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:31.555486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:31.555752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:31.557042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:31.557391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.557409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.557416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.557423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.557430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.557436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.557443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.557450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.557456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.557463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.557471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.557477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.557483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.557490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.557538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.557648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.557695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.557740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.557783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.557842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.557894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.557938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.557981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.558027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.558071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.558113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.558157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.558200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.558258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.558322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.558381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.558434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.558486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.558541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.558590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.558642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.558688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.558743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.558789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.558841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.558892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.558945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.558989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.559041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.559090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.559142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.559185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.559239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.559286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.559338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.559398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.559449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.559510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.559565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.559612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.559668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.560076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:31.580119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:31.589607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:31.589647Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:31.589663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:31.589680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:31.589702Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 554 [2:7561401214706510953:6283]
2025-10-15T10:58:31.589750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:31.589807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:31.589822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:31.589839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:31.589850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:31.589893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:31.589914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:31.589934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:31.604911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.604944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.604960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.604971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:31.605252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:31.605270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.605422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.605610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.605840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:31.605907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401214706510947:6283]
2025-10-15T10:58:31.605923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401214706510947:6283]
2025-10-15T10:58:31.605936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401214706510947:6283]
2025-10-15T10:58:31.605983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:31.606049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:31.606097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:31.606110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:31.606121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:31.606227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:31.606243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:31.606351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401214706510947:6283]
2025-10-15T10:58:31.606390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:31.606437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401211906817806:6944], now have 1 active actors on pipe
2025-10-15T10:58:31.607120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 554
2025-10-15T10:58:31.606476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401211906817701:2467], now have 1 active actors on pipe
2025-10-15T10:58:31.607246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 554
2025-10-15T10:58:31.606534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401211906817829:6486], now have 1 active actors on pipe
2025-10-15T10:58:31.606638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:31.607560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 554, pipe: [1:7561401211906817829:6486]
2025-10-15T10:58:31.607955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:31.607987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:31.608084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e3bec98-10187735-11994ca3-a131d963_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:31.608116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:31.608132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:31.608142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:31.608176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:31.608213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:31.608256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:31.609515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:31.609540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:31.609605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:31.609940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 555 partition: 0 MaxSeqNo: 46 sessionId: src_id|3e3bec98-10187735-11994ca3-a131d963_0
2025-10-15T10:58:31.610696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d0d1d8c-42840244-7032e0-f667c056_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3e3bec98-10187735-11994ca3-a131d963_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:31.648230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3bec98-10187735-11994ca3-a131d963_0] Write session: try to update token
2025-10-15T10:58:31.648292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3bec98-10187735-11994ca3-a131d963_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:31.703582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:31.703616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:31.703629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:31.703680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:31.703699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:31.703713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:31.703724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:31.703757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401214706510947:6283]
2025-10-15T10:58:31.703782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401214706510947:6283]
2025-10-15T10:58:31.703805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401214706510947:6283]
2025-10-15T10:58:31.703931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:31.703960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:31.704256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:31.704301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:31.704332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:31.705044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:31.738659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId: src_id|3e3bec98-10187735-11994ca3-a131d963_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:31.765486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:31.843190Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:31.844657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:31.844699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:31.847010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:31.847057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:31.848521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:31.848763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401211906817829:6486]
2025-10-15T10:58:31.857615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 555 reason: error at write: Disconnected sessionId: src_id|3e3bec98-10187735-11994ca3-a131d963_0
2025-10-15T10:58:31.857935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 555 sessionId: src_id|3e3bec98-10187735-11994ca3-a131d963_0 is DEAD
2025-10-15T10:58:31.858307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3bec98-10187735-11994ca3-a131d963_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:31.858365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3bec98-10187735-11994ca3-a131d963_0] Write session will restart in 0.009019s
2025-10-15T10:58:31.858518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3bec98-10187735-11994ca3-a131d963_0] Write session: Do CDS request
2025-10-15T10:58:31.858574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3bec98-10187735-11994ca3-a131d963_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:31.858780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:31.871344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:31.871386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 556
2025-10-15T10:58:31.871621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3bec98-10187735-11994ca3-a131d963_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:31.872080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:31.872206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:31.872230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:31.872241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:31.873462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 556 sessionId:  describe result for acl check
2025-10-15T10:58:31.873578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:31.873597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:31.873606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:31.873621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401211906817858:6949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:31.877298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401211906817858:6949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:31.883926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401211906817858:6949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:31.893927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401211906817858:6949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:31.893967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401211906817858:6949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:31.893983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401211906817858:6949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:31.894011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:31.906201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:31.907960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:31.908573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:31.908598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:31.908631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:31.908808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:31.908995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401214706511087:6285]
2025-10-15T10:58:31.910628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:31.911664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:31.911877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:31.913035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:31.913333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.913345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.913352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.913358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.913381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.913388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.913395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.913402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.913409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.913416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.913423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.913430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.913436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.913443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.913488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.913589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.913645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.913693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.913741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.913786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.913836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.913886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.913935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.913984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.914033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.914080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.914127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.914174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.914219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.914288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:31.914346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.914404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:31.914454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.914508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:31.914559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.914614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:31.914665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.914719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:31.914771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.914829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:31.914880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.914938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:31.914990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.915043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:31.915095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.915154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:31.915202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.915257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:31.915308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.915380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:31.915432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.915485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.915534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.915586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.915630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.915683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.916177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:31.933185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:31.944426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:31.944471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:31.944488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:31.944507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:31.944532Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 555 [2:7561401214706511087:6285]
2025-10-15T10:58:31.944583Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:31.944645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:31.944659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:31.944671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:31.944681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:31.944726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:31.944745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:31.944766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:31.945761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.945786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.945799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.945810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:31.946080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:31.946103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:31.946231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:31.946415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:31.946640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:31.946715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401211906817967:6949], now have 1 active actors on pipe
2025-10-15T10:58:31.946743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401211906817844:2467], now have 1 active actors on pipe
2025-10-15T10:58:31.946775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:31.946792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:31.946829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401214706511081:6285]
2025-10-15T10:58:31.946842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401214706511081:6285]
2025-10-15T10:58:31.946849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401214706511081:6285]
2025-10-15T10:58:31.946872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:31.946914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:31.946914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:31.946926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:31.946937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:31.947051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:31.947066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:31.947104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:31.947123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:31.947133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:31.947139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:31.947172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:31.947203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:31.947307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401214706511081:6285]
2025-10-15T10:58:31.947338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:31.947381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:31.946479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 555
2025-10-15T10:58:31.946486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 555
2025-10-15T10:58:31.947575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:31.948353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:31.948377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:31.948421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:31.948689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 556 partition: 0 MaxSeqNo: 46 sessionId: src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0
2025-10-15T10:58:31.949156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401211906817983:6486]
2025-10-15T10:58:31.949513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401211906817983:6486], now have 1 active actors on pipe
2025-10-15T10:58:31.949674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 555, pipe: [1:7561401211906817983:6486]
2025-10-15T10:58:31.951632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3bec98-10187735-11994ca3-a131d963_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:31.978483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0] Write session: try to update token
2025-10-15T10:58:31.978546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:32.000902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:32.000933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:32.000960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401214706511081:6285]
2025-10-15T10:58:32.001077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:32.001107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:32.002874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:32.004344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:32.005709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:32.007105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:32.009108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:32.009619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:32.078066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId: src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:32.102927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:32.102968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:32.102981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:32.103036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:32.103049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:32.103060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:32.103071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:32.103108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401214706511081:6285]
2025-10-15T10:58:32.103134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401214706511081:6285]
2025-10-15T10:58:32.103158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401214706511081:6285]
2025-10-15T10:58:32.103286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:32.103308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:32.103320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:32.103329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:32.103361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:32.104749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:32.126946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:32.264643Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:32.271885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:32.271930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:32.272882Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:32.273233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401211906817983:6486]
2025-10-15T10:58:32.273332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:32.283973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 556 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0
2025-10-15T10:58:32.284302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 556 sessionId: src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0 is DEAD
2025-10-15T10:58:32.284756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:32.284807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0] Write session will restart in 0.006688s
2025-10-15T10:58:32.284944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0] Write session: Do CDS request
2025-10-15T10:58:32.284986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:32.300732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:32.310273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:32.310411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:32.310426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 557
2025-10-15T10:58:32.310832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:32.310950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:32.310972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:32.310980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:32.312176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 557 sessionId:  describe result for acl check
2025-10-15T10:58:32.312288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:32.312308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:32.312318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:32.312333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401216201785327:6960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:32.314882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401216201785327:6960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:32.320475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401216201785327:6960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:32.331936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401216201785327:6960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:32.331985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401216201785327:6960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:32.332010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401216201785327:6960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:32.332048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:32.351686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:32.356680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:32.357541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:32.357573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:32.357616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:32.357873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:32.358061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401219001478547:6295]
2025-10-15T10:58:32.360249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:32.361048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:32.361259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:32.362527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:32.362857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:32.362876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:32.362884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:32.362891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:32.362899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:32.362907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:32.362915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:32.362923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:32.362930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:32.362937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:32.362945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:32.362953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.362960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.362967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.363016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:32.363124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:32.363172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:32.363222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:32.363275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:32.363332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:32.363408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:32.363462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:32.363515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:32.363570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:32.363622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:32.363668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.363716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.363763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.363806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:32.363874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:32.363936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:32.363991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:32.364048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:32.364107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:32.364160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:32.364219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:32.364276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:32.364334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:32.364388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:32.364448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:32.364499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:32.364563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:32.364613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:32.364672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:32.364730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:32.364792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:32.364846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:32.364902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:32.364955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:32.365013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:32.365063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.365120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.365173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.365232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.365283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.365343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.365881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:32.373722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401216201785447:6486]
2025-10-15T10:58:32.383909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:32.396919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:32.396968Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:32.396984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:32.397004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:32.397029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 556 [2:7561401219001478547:6295]
2025-10-15T10:58:32.397080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:32.397138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:32.397153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:32.397166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:32.397178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:32.397229Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:32.397252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:32.397275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:32.398883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.398908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.398922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.398933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:32.399189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:32.399218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.399422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.399462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 556, pipe: [1:7561401216201785447:6486]
2025-10-15T10:58:32.399620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.399584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 556
2025-10-15T10:58:32.399687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 556
2025-10-15T10:58:32.399863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:32.399958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401216201785447:6486], now have 1 active actors on pipe
2025-10-15T10:58:32.399990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401216201785323:2467], now have 1 active actors on pipe
2025-10-15T10:58:32.400014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401216201785428:6960], now have 1 active actors on pipe
2025-10-15T10:58:32.400079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:32.400105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:32.400145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401219001478541:6295]
2025-10-15T10:58:32.400161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401219001478541:6295]
2025-10-15T10:58:32.400176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401219001478541:6295]
2025-10-15T10:58:32.400215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:32.400290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:32.402236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 557 partition: 0 MaxSeqNo: 46 sessionId: src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0
2025-10-15T10:58:32.403075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7a1da9-2629a1b4-57e284a5-c785a3e3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:32.400478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:32.400504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:32.400568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:32.400600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:32.400619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:32.400631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:32.400669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:32.400708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:32.400840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401219001478541:6295]
2025-10-15T10:58:32.400860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:32.400907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:32.401493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:32.401506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:32.401518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:32.401541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:32.401826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:32.401849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:32.401934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:32.424430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0] Write session: try to update token
2025-10-15T10:58:32.424486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:32.457681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:32.457725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:32.457741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:32.457754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:32.457792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401219001478541:6295]
2025-10-15T10:58:32.457820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401219001478541:6295]
2025-10-15T10:58:32.457844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401219001478541:6295]
2025-10-15T10:58:32.458000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:32.458029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:32.458865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:32.458907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:32.458936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:32.461787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:32.558711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId: src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:32.579692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:32.614492Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:32.616654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:32.616703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:32.621292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:32.617567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:32.617610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:32.629164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401216201785447:6486]
2025-10-15T10:58:32.629264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:32.629811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 557 reason: error at write: Disconnected sessionId: src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0
2025-10-15T10:58:32.630134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 557 sessionId: src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0 is DEAD
2025-10-15T10:58:32.631968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:32.632020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0] Write session will restart in 0.007491s
2025-10-15T10:58:32.632175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0] Write session: Do CDS request
2025-10-15T10:58:32.632232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:32.648709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:32.652653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:32.652684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 558
2025-10-15T10:58:32.655897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:32.656035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:32.656052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:32.656062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:32.657347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 558 sessionId:  describe result for acl check
2025-10-15T10:58:32.657464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:32.657474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:32.657484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:32.657502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401216201785486:6966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:32.660238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401216201785486:6966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:32.675256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401216201785486:6966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:32.690043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401216201785486:6966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:32.690077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401216201785486:6966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:32.690088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401216201785486:6966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:32.690115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:32.702330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:32.703581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:32.704377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:32.704411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:32.704457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:32.704715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:32.704914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401219001478709:6302]
2025-10-15T10:58:32.707056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:32.708102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:32.708302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:32.709326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:32.709597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:32.709614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:32.709621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:32.709628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:32.709635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:32.709643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:32.709650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:32.709657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:32.709664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:32.709671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:32.709678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:32.709685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.709692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.709699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.709747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:32.709861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:32.709911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:32.709964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:32.710018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:32.710071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:32.710122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:32.710169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:32.710221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:32.710274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:32.710322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:32.710374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.710426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.710460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.710495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:32.710549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:32.710594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:32.710639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:32.710679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:32.710724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:32.710763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:32.710806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:32.710843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:32.710892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:32.710933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:32.710977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:32.711013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:32.711055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:32.711106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:32.711163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:32.711211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:32.711254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:32.711285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:32.711325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:32.711382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:32.711426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:32.711459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.711497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.711529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.711579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.711625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.711681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.712200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:32.728119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:32.729417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401216201785603:6486]
2025-10-15T10:58:32.737899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:32.737962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:32.740948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 557, pipe: [1:7561401216201785603:6486]
2025-10-15T10:58:32.741771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 557
2025-10-15T10:58:32.741832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 557
2025-10-15T10:58:32.744314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 558 partition: 0 MaxSeqNo: 46 sessionId: src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0
2025-10-15T10:58:32.745066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f428e8a-33809e3c-fc3e30f7-72d9213_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:32.737983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:32.738005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:32.738032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 557 [2:7561401219001478709:6302]
2025-10-15T10:58:32.738090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:32.738169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:32.738186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:32.738200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:32.738213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:32.738272Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:32.738298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:32.738322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:32.740261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.740278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.740293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.740306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:32.741804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:32.741824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:32.741969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:32.742157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:32.742360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:32.742439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401216201785603:6486], now have 1 active actors on pipe
2025-10-15T10:58:32.742464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401216201785594:6966], now have 1 active actors on pipe
2025-10-15T10:58:32.742486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401216201785459:2467], now have 1 active actors on pipe
2025-10-15T10:58:32.742531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:32.742551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:32.742603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401219001478704:6302]
2025-10-15T10:58:32.742618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401219001478704:6302]
2025-10-15T10:58:32.742630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401219001478704:6302]
2025-10-15T10:58:32.742669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:32.742706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:32.742722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:32.742733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:32.742739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:32.742916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:32.742933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:32.742998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:32.743030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:32.743048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:32.743058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:32.743095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:32.743137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:32.743262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401219001478704:6302]
2025-10-15T10:58:32.743289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:32.743328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:32.743332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:32.743938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:32.743961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:32.744026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:32.769057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0] Write session: try to update token
2025-10-15T10:58:32.769120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:32.782382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:32.782430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:32.782469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401219001478704:6302]
2025-10-15T10:58:32.782591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:32.782626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:32.786456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:32.788991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:32.790710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:32.791981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:32.793735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:32.794037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:32.838512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:32.838553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:32.838566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:32.865411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId: src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:32.897249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:32.905107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:32.905154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:32.905171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:32.905183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:32.905228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401219001478704:6302]
2025-10-15T10:58:32.905255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401219001478704:6302]
2025-10-15T10:58:32.905282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401219001478704:6302]
2025-10-15T10:58:32.905446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:32.905486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:32.905520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:32.905522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:32.905550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:32.905595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:32.905625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:32.906573Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:33.049856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:33.052130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:33.052160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:33.052107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:33.055567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:33.055840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401216201785603:6486]
2025-10-15T10:58:33.084441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 558 reason: error at write: Disconnected sessionId: src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0
2025-10-15T10:58:33.084794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 558 sessionId: src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0 is DEAD
2025-10-15T10:58:33.088683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:33.088722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0] Write session will restart in 0.007363s
2025-10-15T10:58:33.088836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0] Write session: Do CDS request
2025-10-15T10:58:33.088875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:33.104816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:33.105194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:33.105230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 559
2025-10-15T10:58:33.105504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:33.105620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:33.105634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:33.105644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:33.106958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 559 sessionId:  describe result for acl check
2025-10-15T10:58:33.107066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:33.107082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:33.107091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:33.107108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401220496752999:6972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:33.109896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401220496752999:6972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:33.116612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401220496752999:6972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:33.120321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:33.125162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:33.125879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:33.125905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:33.125938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:33.125944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401220496752999:6972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:33.125987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401220496752999:6972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:33.126004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401220496752999:6972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:33.126033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:33.126121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:33.126252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401223296446142:6306]
2025-10-15T10:58:33.127830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:33.128922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:33.129148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:33.130467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:33.130781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.130804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.130811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.130817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.130823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.130829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.130836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.130842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.130847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.130854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.130860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.130866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.130872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.130878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.130921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.131018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.131063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.131105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.131153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.131199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.131246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.131292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.131337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.131406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.131456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.131500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.131548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.131591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.131639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.131704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.131763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.131820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.131870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.131928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.131972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.132026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.132072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.132123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.132166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.132220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.132262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.132316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.132360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.132412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.132458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.132509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.132553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.132604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.132650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.132700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.132744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.132796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.132840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.132889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.132932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.132984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.133438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:33.155189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:33.156456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401220496753053:6486]
2025-10-15T10:58:33.177575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:33.177618Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:33.177634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:33.177650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:33.177670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 558 [2:7561401223296446142:6306]
2025-10-15T10:58:33.177715Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:33.177766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:33.177780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:33.177791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:33.177799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:33.177837Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:33.177856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:33.177874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:33.178802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.178827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.178837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.178848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:33.179087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:33.179110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.179238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.179612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 558
2025-10-15T10:58:33.179648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 558
2025-10-15T10:58:33.179699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 558, pipe: [1:7561401220496753053:6486]
2025-10-15T10:58:33.180329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.180554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:33.180633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401220496753046:6972], now have 1 active actors on pipe
2025-10-15T10:58:33.180653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401220496752918:2467], now have 1 active actors on pipe
2025-10-15T10:58:33.180673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401220496753053:6486], now have 1 active actors on pipe
2025-10-15T10:58:33.180721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:33.180741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:33.180788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401223296446137:6306]
2025-10-15T10:58:33.180801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401223296446137:6306]
2025-10-15T10:58:33.180811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401223296446137:6306]
2025-10-15T10:58:33.180851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:33.180894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:33.180910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:33.180912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:33.180922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:33.181063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:33.181079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:33.181129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|968436ee-5c51e779-c37836fc-ba870d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:33.181155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:33.181170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:33.181179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:33.181209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:33.181241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:33.181350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401223296446137:6306]
2025-10-15T10:58:33.181379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:33.181411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:33.181431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:33.187473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:33.187510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:33.187580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:33.187981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 559 partition: 0 MaxSeqNo: 46 sessionId: src_id|968436ee-5c51e779-c37836fc-ba870d0_0
2025-10-15T10:58:33.188792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fda6e6-24f08bc-4edd07a6-4b60c7d6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|968436ee-5c51e779-c37836fc-ba870d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:33.227746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968436ee-5c51e779-c37836fc-ba870d0_0] Write session: try to update token
2025-10-15T10:58:33.227804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968436ee-5c51e779-c37836fc-ba870d0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:33.261797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:33.261834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:33.261848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:33.261861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:33.261895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401223296446137:6306]
2025-10-15T10:58:33.261921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401223296446137:6306]
2025-10-15T10:58:33.261945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401223296446137:6306]
2025-10-15T10:58:33.262094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:33.262141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:33.262146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:33.262170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:33.262188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:33.263247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:33.354072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId: src_id|968436ee-5c51e779-c37836fc-ba870d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:33.375095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:33.408465Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:33.420690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:33.420733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:33.420785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:33.420797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:33.420832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401223296446137:6306]
2025-10-15T10:58:33.421260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:33.421361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:33.421492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:33.421532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:33.421546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:33.421673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401220496753053:6486]
2025-10-15T10:58:33.450192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 559 reason: error at write: Disconnected sessionId: src_id|968436ee-5c51e779-c37836fc-ba870d0_0
2025-10-15T10:58:33.450480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 559 sessionId: src_id|968436ee-5c51e779-c37836fc-ba870d0_0 is DEAD
2025-10-15T10:58:33.451707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968436ee-5c51e779-c37836fc-ba870d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:33.451741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968436ee-5c51e779-c37836fc-ba870d0_0] Write session will restart in 0.005234s
2025-10-15T10:58:33.451826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968436ee-5c51e779-c37836fc-ba870d0_0] Write session: Do CDS request
2025-10-15T10:58:33.451851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968436ee-5c51e779-c37836fc-ba870d0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:33.462381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|968436ee-5c51e779-c37836fc-ba870d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:33.462236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:33.462272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 560
2025-10-15T10:58:33.462943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:33.463110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:33.463133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:33.463152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:33.464631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 560 sessionId:  describe result for acl check
2025-10-15T10:58:33.464766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:33.464785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:33.464796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:33.464815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401220496753090:6977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:33.468090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401220496753090:6977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:33.483613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401220496753090:6977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:33.495364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401220496753090:6977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:33.495409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401220496753090:6977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:33.495424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401220496753090:6977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:33.495454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:33.501268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:33.507419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:33.508594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:33.508630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:33.508679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:33.508985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:33.509204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401223296446309:6316]
2025-10-15T10:58:33.511151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:33.512142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:33.512366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:33.513799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:33.514226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.514236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.514244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.514251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.514258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.514266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.514273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.514281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.514289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.514298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.514307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.514314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.514322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.514330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.514398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.514528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.514582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.514634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.514687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.514737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.514783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.514834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.514881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.514934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.514981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.515872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.515937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.515986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.516038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.516110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.516176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.516231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.516281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.516342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.516390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.516444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.516497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.516556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.516606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.516661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.516712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.516768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.516818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.516874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.516925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.516982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.517031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.517092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.517144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.517203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.517252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.517311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.517363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.517433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.517485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.517543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.518077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:33.523556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401220496753213:6486]
2025-10-15T10:58:33.537567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:33.554312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 559
2025-10-15T10:58:33.554343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 559, pipe: [1:7561401220496753213:6486]
2025-10-15T10:58:33.554406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 559
2025-10-15T10:58:33.551953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:33.551995Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:33.552006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:33.552021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:33.552040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 559 [2:7561401223296446309:6316]
2025-10-15T10:58:33.552080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:33.552126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:33.552138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:33.552147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:33.552156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:33.552193Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:33.552210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:33.552227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:33.553662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.553672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.553681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.553689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:33.553873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:33.553884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.553985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.554134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.554295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:33.554347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401220496753203:6977], now have 1 active actors on pipe
2025-10-15T10:58:33.554362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401220496753213:6486], now have 1 active actors on pipe
2025-10-15T10:58:33.554379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401220496753073:2467], now have 1 active actors on pipe
2025-10-15T10:58:33.554397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401223296446303:6316]
2025-10-15T10:58:33.554408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401223296446303:6316]
2025-10-15T10:58:33.554416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401223296446303:6316]
2025-10-15T10:58:33.554439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:33.554476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:33.554491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:33.554503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:33.554503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:33.554687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:33.554703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:33.554763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:33.554784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:33.554925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401223296446303:6316]
2025-10-15T10:58:33.554957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:33.555030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:33.555060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:33.555080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:33.555090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:33.555128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:33.555165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:33.555299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:33.555303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:33.555835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:33.555871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:33.555942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:33.556328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 560 partition: 0 MaxSeqNo: 46 sessionId: src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0
2025-10-15T10:58:33.557052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|968436ee-5c51e779-c37836fc-ba870d0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:33.583697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0] Write session: try to update token
2025-10-15T10:58:33.583751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:33.609102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:33.609147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:33.609188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401223296446303:6316]
2025-10-15T10:58:33.609309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:33.609317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:33.611206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:33.613658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:33.615005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:33.616341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:33.618838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:33.619383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:33.725470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:33.725501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:33.725509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:33.725556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:33.725566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:33.725576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:33.725584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:33.725612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401223296446303:6316]
2025-10-15T10:58:33.725630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401223296446303:6316]
2025-10-15T10:58:33.725646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401223296446303:6316]
2025-10-15T10:58:33.725758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:33.725775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:33.725774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:33.725830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:33.725862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:33.732747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:33.762734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId: src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:33.784495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:33.880589Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:33.882455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:33.882497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:33.883111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:33.883265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:33.883262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:33.883273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:33.893357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401220496753213:6486]
2025-10-15T10:58:33.893473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 560 reason: error at write: Disconnected sessionId: src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0
2025-10-15T10:58:33.893744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 560 sessionId: src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0 is DEAD
2025-10-15T10:58:33.895285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:33.895373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0] Write session will restart in 0.007933s
2025-10-15T10:58:33.895515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0] Write session: Do CDS request
2025-10-15T10:58:33.895571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:33.910108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:33.920982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:33.921013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 561
2025-10-15T10:58:33.923584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:33.923732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:33.923748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:33.923756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:33.925183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 561 sessionId:  describe result for acl check
2025-10-15T10:58:33.925294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:33.925304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:33.925312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:33.925328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401220496753261:6988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:33.928043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401220496753261:6988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:33.940944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401220496753261:6988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:33.949661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401220496753261:6988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:33.949704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401220496753261:6988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:33.949720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401220496753261:6988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:33.949748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:33.955678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:33.957780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:33.958743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:33.958764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:33.958813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:33.959109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:33.959312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401223296446467:6323]
2025-10-15T10:58:33.961560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:33.962393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:33.962553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:33.963771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:33.964089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.964108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.964116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.964123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.964133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.964139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.964148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.964154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.964161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.964168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.964174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.964182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.964188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.964195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.964244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.964352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.964399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.964445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.964491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.964537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.964583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.964628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.964685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.964733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.964779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.964824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.964869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.964916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.964961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.965026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:33.965081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.965134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:33.965184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.965239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:33.965284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.965338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:33.965384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.965450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:33.965498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.965551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:33.965597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.965651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:33.965697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.965751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:33.965795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.965848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:33.965896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.965948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:33.965995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.966050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:33.966095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.966150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:33.966196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.966249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:33.966293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.966345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:33.966880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:33.995478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401220496753378:6486]
2025-10-15T10:58:34.002841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:34.011776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:34.011823Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:34.011838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:34.011856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:34.011879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 560 [2:7561401223296446467:6323]
2025-10-15T10:58:34.011926Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:34.011977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:34.011987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:34.011996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:34.012003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:34.012044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:34.012059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:34.012075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:34.014871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.014880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.014888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.014895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:34.015146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:34.015161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.015288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.015494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.015706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:34.015774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401220496753378:6486], now have 1 active actors on pipe
2025-10-15T10:58:34.015796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401220496753240:2467], now have 1 active actors on pipe
2025-10-15T10:58:34.015816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401220496753370:6988], now have 1 active actors on pipe
2025-10-15T10:58:34.015836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401223296446462:6323]
2025-10-15T10:58:34.015849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401223296446462:6323]
2025-10-15T10:58:34.015861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401223296446462:6323]
2025-10-15T10:58:34.015895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:34.015963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:34.016100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:34.016113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:34.016210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401223296446462:6323]
2025-10-15T10:58:34.016221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:34.016318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:34.016330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:34.016341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:34.016362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:34.018645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 560, pipe: [1:7561401220496753378:6486]
2025-10-15T10:58:34.018766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 560
2025-10-15T10:58:34.018855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 560
2025-10-15T10:58:34.019469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:34.019505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:34.019577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:34.019606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:34.019623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:34.019634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:34.019668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:34.019717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:34.019760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:34.020289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:34.020309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:34.020375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:34.021970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2edd18e-31fe1536-67ce94bd-6a24717c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:34.020646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 561 partition: 0 MaxSeqNo: 46 sessionId: src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0
2025-10-15T10:58:34.047514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:34.047547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:34.047582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401223296446462:6323]
2025-10-15T10:58:34.047697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:34.047710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:34.050079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:34.051643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:34.053411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:34.054813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:34.055906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0] Write session: try to update token
2025-10-15T10:58:34.055951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:34.057950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:34.058522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:34.163390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId: src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:34.164030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:34.164060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:34.164071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:34.164133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:34.164151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:34.164166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:34.164177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:34.164224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401223296446462:6323]
2025-10-15T10:58:34.164247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401223296446462:6323]
2025-10-15T10:58:34.164268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401223296446462:6323]
2025-10-15T10:58:34.164381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:34.164387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:34.164405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:34.164423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:34.164454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:34.165476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:34.189440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:34.320948Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:34.322864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:34.322893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:34.323673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:34.323812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:34.323859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:34.325944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401220496753378:6486]
2025-10-15T10:58:34.326112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:34.368982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 561 reason: error at write: Disconnected sessionId: src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0
2025-10-15T10:58:34.369848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:34.369278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 561 sessionId: src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0 is DEAD
2025-10-15T10:58:34.369891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0] Write session will restart in 0.007108s
2025-10-15T10:58:34.370064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0] Write session: Do CDS request
2025-10-15T10:58:34.370109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:34.389730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:34.389809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 562
2025-10-15T10:58:34.390125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:34.391120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:34.391430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:34.391467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:34.391485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:34.393680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 562 sessionId:  describe result for acl check
2025-10-15T10:58:34.393852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:34.393870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:34.393890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:34.393918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401224791720819:6998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:34.398190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:34.398294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401224791720819:6998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:34.401962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:34.402884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:34.402917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:34.402965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:34.403195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:34.403369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401227591413925:6329]
2025-10-15T10:58:34.404866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401224791720819:6998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:34.405227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:34.406047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:34.406288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:34.407259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:34.407550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:34.407571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:34.407580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:34.407587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:34.407594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:34.407600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:34.407608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:34.407616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:34.407622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:34.407627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:34.407632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:34.407637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.407641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.407646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.407681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:34.407769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:34.407807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:34.407844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:34.407879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:34.407913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:34.407947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:34.407980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:34.408013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:34.408070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:34.408120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:34.408160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.408203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.408258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.408309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:34.408394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:34.408460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:34.408525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:34.408574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:34.408629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:34.408673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:34.408721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:34.408766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:34.408809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:34.408848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:34.408895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:34.408935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:34.408978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:34.409017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:34.409070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:34.409122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:34.409175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:34.409214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:34.409260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:34.409315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:34.409374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:34.409437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.409496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.409544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.409604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.409660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.409717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.410567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:34.426231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401224791720819:6998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:34.426248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401224791720850:6486]
2025-10-15T10:58:34.426279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401224791720819:6998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:34.426299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401224791720819:6998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:34.426334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:34.438535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:34.447177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:34.447333Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:34.447364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:34.447388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:34.447416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 561 [2:7561401227591413925:6329]
2025-10-15T10:58:34.447478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:34.447546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:34.447565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:34.447577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:34.447588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:34.447641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:34.447665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:34.447687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:34.448792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.448817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.448833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.448846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:34.449055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:34.449079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.449307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 561
2025-10-15T10:58:34.449323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 561, pipe: [1:7561401224791720850:6486]
2025-10-15T10:58:34.449391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 561
2025-10-15T10:58:34.449220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.449437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.449662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:34.449749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401224791720717:2467], now have 1 active actors on pipe
2025-10-15T10:58:34.449767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401224791720850:6486], now have 1 active actors on pipe
2025-10-15T10:58:34.449782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401224791720854:6998], now have 1 active actors on pipe
2025-10-15T10:58:34.449801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401227591413920:6329]
2025-10-15T10:58:34.449813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401227591413920:6329]
2025-10-15T10:58:34.449823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401227591413920:6329]
2025-10-15T10:58:34.449852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:34.449907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:34.449961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:34.449975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:34.449988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:34.450052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:34.450064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:34.450213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:34.450230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:34.450254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401227591413920:6329]
2025-10-15T10:58:34.450276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:34.450358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:34.450380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:34.450393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:34.450400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:34.450397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:34.450427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:34.450459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:34.450513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:34.450950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:34.450967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:34.451014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:34.451248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 562 partition: 0 MaxSeqNo: 46 sessionId: src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0
2025-10-15T10:58:34.453371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba9f5ace-b7bf044-d64bd668-955547f6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:34.480426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0] Write session: try to update token
2025-10-15T10:58:34.480469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:34.550038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId: src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:34.576312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:34.576357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:34.576374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:34.576385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:34.576430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401227591413920:6329]
2025-10-15T10:58:34.576462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401227591413920:6329]
2025-10-15T10:58:34.576488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401227591413920:6329]
2025-10-15T10:58:34.576647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:34.576698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:34.576728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:34.576746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:34.576763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:34.576776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:34.576826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:34.576848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:34.582940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:34.578038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:34.724039Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:34.749034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:34.749086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:34.749163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:34.749179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:34.749222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401227591413920:6329]
2025-10-15T10:58:34.749512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:34.749918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401224791720850:6486]
2025-10-15T10:58:34.749930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:34.750028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:34.750041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:34.749960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:34.758815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 562 reason: error at write: Disconnected sessionId: src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0
2025-10-15T10:58:34.759165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 562 sessionId: src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0 is DEAD
2025-10-15T10:58:34.759502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:34.759557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0] Write session will restart in 0.005079s
2025-10-15T10:58:34.759717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0] Write session: Do CDS request
2025-10-15T10:58:34.759769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:34.769645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:34.771628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:34.771675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 563
2025-10-15T10:58:34.772071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:34.772199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:34.772223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:34.772234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:34.773509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 563 sessionId:  describe result for acl check
2025-10-15T10:58:34.773624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:34.773640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:34.773649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:34.773666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401224791720879:7003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:34.776090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401224791720879:7003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:34.783530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401224791720879:7003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:34.790165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401224791720879:7003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:34.790208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401224791720879:7003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:34.790225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401224791720879:7003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:34.790250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:34.808154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:34.811743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:34.812632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:34.812652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:34.812704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:34.812986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:34.813176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401227591414068:6331]
2025-10-15T10:58:34.815852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:34.816843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:34.817083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:34.818464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:34.818837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:34.818859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:34.818866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:34.818875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:34.818883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:34.818891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:34.818901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:34.818909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:34.818916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:34.818923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:34.818932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:34.818940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.818948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.818955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.819007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:34.819129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:34.819183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:34.819242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:34.819300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:34.819378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:34.819439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:34.819493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:34.819548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:34.819604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:34.819661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:34.819720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.819774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.819827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.819883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:34.819961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:34.820036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:34.820104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:34.820166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:34.820232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:34.820281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:34.820345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:34.820400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:34.820458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:34.820510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:34.820569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:34.820632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:34.820696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:34.820753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:34.820811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:34.820869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:34.820936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:34.820993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:34.821055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:34.821112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:34.821171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:34.821226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.821290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.821348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.821429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.821480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.821540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.822121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:34.840355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:34.850181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401224791721005:6486]
2025-10-15T10:58:34.850449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:34.850497Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:34.850516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:34.850533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:34.850556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 562 [2:7561401227591414068:6331]
2025-10-15T10:58:34.850604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:34.850656Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:34.850671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:34.850683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:34.850692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:34.850736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:34.850758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:34.850777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:34.851831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.851856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.851869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.851881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:34.852140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:34.852165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:34.852301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:34.852488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:34.852400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 562
2025-10-15T10:58:34.852499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 562, pipe: [1:7561401224791721005:6486]
2025-10-15T10:58:34.852587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 562
2025-10-15T10:58:34.852707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:34.852788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401224791720865:2467], now have 1 active actors on pipe
2025-10-15T10:58:34.852818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401224791721005:6486], now have 1 active actors on pipe
2025-10-15T10:58:34.852837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401224791720933:7003], now have 1 active actors on pipe
2025-10-15T10:58:34.852900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:34.852922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:34.852954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401227591414063:6331]
2025-10-15T10:58:34.852974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401227591414063:6331]
2025-10-15T10:58:34.852987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401227591414063:6331]
2025-10-15T10:58:34.853024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:34.853076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:34.853091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:34.853106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:34.853119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:34.853249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:34.853272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:34.853332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:34.853362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:34.853379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:34.853388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:34.853429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:34.853469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:34.853586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401227591414063:6331]
2025-10-15T10:58:34.853615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:34.853658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:34.853662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:34.854774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:34.854806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:34.854885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:34.855214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 563 partition: 0 MaxSeqNo: 46 sessionId: src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0
2025-10-15T10:58:34.855928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b3a4126-1d96f9bb-25e6a858-f3da46c2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:34.886408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0] Write session: try to update token
2025-10-15T10:58:34.886485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:34.941946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:34.941982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:34.942026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401227591414063:6331]
2025-10-15T10:58:34.942158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:34.942221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:34.944089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:34.945477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:34.946651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:34.947941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:34.952624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:35.013083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:35.013121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:35.013133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:35.013194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:35.013331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:35.013346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:35.013361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:35.013372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:35.013423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401227591414063:6331]
2025-10-15T10:58:35.013450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401227591414063:6331]
2025-10-15T10:58:35.013478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401227591414063:6331]
2025-10-15T10:58:35.013647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:35.013673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:35.013680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:35.013736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:35.013766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:35.015672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:35.020221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId: src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:35.041527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:35.161788Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:35.167854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:35.167910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:35.168669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:35.171498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:35.174773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401224791721005:6486]
2025-10-15T10:58:35.183939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:35.184100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 563 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0
2025-10-15T10:58:35.184400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 563 sessionId: src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0 is DEAD
2025-10-15T10:58:35.185900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:35.185956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0] Write session will restart in 0.005892s
2025-10-15T10:58:35.186090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0] Write session: Do CDS request
2025-10-15T10:58:35.186128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:35.196748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:35.210186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:35.210221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 564
2025-10-15T10:58:35.211503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:35.211619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:35.211633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:35.211641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:35.214354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 564 sessionId:  describe result for acl check
2025-10-15T10:58:35.214467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:35.214479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:35.214487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:35.214503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401229086688345:7011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:35.221582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401229086688345:7011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:35.231862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401229086688345:7011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:35.240303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401229086688345:7011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:35.240350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401229086688345:7011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:35.240366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401229086688345:7011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:35.240398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:35.246687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:35.248454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:35.249394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:35.249441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:35.249492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:35.249758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:35.249965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401231886381520:6339]
2025-10-15T10:58:35.252439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:35.253365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:35.253617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:35.254982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:35.255331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:35.255370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:35.255378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:35.255385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:35.255392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:35.255399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:35.255408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:35.255416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:35.255423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:35.255431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:35.255438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:35.255445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.255454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.255461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.255512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:35.255631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:35.255685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:35.255748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:35.255797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:35.255853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:35.255905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:35.255961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:35.256014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:35.256062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:35.256109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:35.256165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.256222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.256274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.256329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:35.256403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:35.256473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:35.256539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:35.256594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:35.256658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:35.256714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:35.256775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:35.256831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:35.256895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:35.256944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:35.257008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:35.257063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:35.257123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:35.257177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:35.257242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:35.257300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:35.257384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:35.257449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:35.257508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:35.257564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:35.257624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:35.257676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.257737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.257792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.257852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.257907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.257970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.258506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:35.275363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401229086688471:6486]
2025-10-15T10:58:35.277588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:35.286895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:35.286940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:35.286955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:35.286972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:35.286995Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 563 [2:7561401231886381520:6339]
2025-10-15T10:58:35.287045Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:35.287099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:35.287112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:35.287124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:35.287134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:35.287187Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:35.287215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:35.287244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:35.289341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.289369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.289383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.289396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:35.289705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:35.289732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.289869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.290070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.290298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:35.290400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401229086688462:7011], now have 1 active actors on pipe
2025-10-15T10:58:35.290431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401229086688471:6486], now have 1 active actors on pipe
2025-10-15T10:58:35.290461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401229086688325:2467], now have 1 active actors on pipe
2025-10-15T10:58:35.290492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401231886381515:6339]
2025-10-15T10:58:35.290510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401231886381515:6339]
2025-10-15T10:58:35.290523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401231886381515:6339]
2025-10-15T10:58:35.290562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:35.290608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:35.290632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:35.290642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:35.290645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:35.290823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:35.290858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:35.291004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401231886381515:6339]
2025-10-15T10:58:35.291039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:35.291076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:35.291143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 563
2025-10-15T10:58:35.291233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 563, pipe: [1:7561401229086688471:6486]
2025-10-15T10:58:35.291312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 563
2025-10-15T10:58:35.291858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:35.291892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:35.291978Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:35.292009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:35.292028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:35.292039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:35.292075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:35.292118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:35.292173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:35.292720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:35.292748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:35.292817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:35.293171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 564 partition: 0 MaxSeqNo: 46 sessionId: src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0
2025-10-15T10:58:35.294040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fb0a0c1-9118bd1c-dfcbfe7b-3ee2bff_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:35.321631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0] Write session: try to update token
2025-10-15T10:58:35.321690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:35.329861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:35.329896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:35.329975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401231886381515:6339]
2025-10-15T10:58:35.330117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:35.330930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:35.332362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:35.333915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:35.335323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:35.336797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:35.339321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:35.340148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:35.442418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId: src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:35.448938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:35.448976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:35.448989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:35.449042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:35.449056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:35.449071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:35.449081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:35.449119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401231886381515:6339]
2025-10-15T10:58:35.449146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401231886381515:6339]
2025-10-15T10:58:35.449169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401231886381515:6339]
2025-10-15T10:58:35.449299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:35.449319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:35.450190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:35.450221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:35.450249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:35.451888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:35.471729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:35.598939Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:35.601190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:35.601232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:35.601971Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:35.606730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:35.622934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 564 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0
2025-10-15T10:58:35.623312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 564 sessionId: src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0 is DEAD
2025-10-15T10:58:35.624807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:35.624858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0] Write session will restart in 0.008180s
2025-10-15T10:58:35.624994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0] Write session: Do CDS request
2025-10-15T10:58:35.625042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:35.628181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401229086688471:6486]
2025-10-15T10:58:35.634807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:35.640770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:35.641302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:35.641336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 565
2025-10-15T10:58:35.644498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:35.644667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:35.644696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:35.644708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:35.647682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 565 sessionId:  describe result for acl check
2025-10-15T10:58:35.647828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:35.647851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:35.647860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:35.647879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401229086688521:7022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:35.652448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401229086688521:7022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:35.665670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401229086688521:7022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:35.679998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401229086688521:7022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:35.680050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401229086688521:7022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:35.680068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401229086688521:7022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:35.680103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:35.698450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:35.701792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:35.702613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:35.702630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:35.702668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:35.702898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:35.703067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401231886381704:6348]
2025-10-15T10:58:35.705534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:35.706445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:35.706660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:35.707866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:35.708188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:35.708213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:35.708220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:35.708227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:35.708234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:35.708240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:35.708247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:35.708254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:35.708262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:35.708268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:35.708275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:35.708281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.708288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.708293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.708337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:35.708437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:35.708485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:35.708531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:35.708574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:35.708618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:35.708671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:35.708715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:35.708766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:35.708815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:35.708864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:35.708914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.708957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.709005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.709046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:35.709107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:35.709161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:35.709213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:35.709272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:35.709346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:35.709401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:35.709474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:35.709526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:35.709584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:35.709636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:35.709693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:35.709751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:35.709806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:35.709855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:35.709926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:35.709991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:35.710050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:35.710130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:35.710183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:35.710228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:35.710280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:35.710324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.710375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.710439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.710492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.710535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.710610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.711104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:35.728264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401229086688645:6486]
2025-10-15T10:58:35.756513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:35.766181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:35.766230Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:35.766246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:35.766264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:35.766286Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 564 [2:7561401231886381704:6348]
2025-10-15T10:58:35.766335Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:35.766390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:35.766403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:35.766414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:35.766425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:35.766470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:35.766490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:35.766512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:35.767538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.767566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.767579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.767590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:35.767852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:35.767876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:35.768007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:35.768195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:35.768431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:35.768511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401229086688645:6486], now have 1 active actors on pipe
2025-10-15T10:58:35.768540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401229086688621:7022], now have 1 active actors on pipe
2025-10-15T10:58:35.768561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401229086688501:2467], now have 1 active actors on pipe
2025-10-15T10:58:35.768588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401231886381699:6348]
2025-10-15T10:58:35.768607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401231886381699:6348]
2025-10-15T10:58:35.768620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401231886381699:6348]
2025-10-15T10:58:35.768653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:35.768684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:35.768692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:35.768700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:35.768724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:35.768889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:35.768914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:35.768987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:35.769007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:35.768205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 564, pipe: [1:7561401229086688645:6486]
2025-10-15T10:58:35.768385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 564
2025-10-15T10:58:35.768465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 564
2025-10-15T10:58:35.769120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401231886381699:6348]
2025-10-15T10:58:35.769147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:35.769216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:35.769228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:35.769242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:35.769259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:35.769269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:35.769300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:35.769331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:35.769471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:35.770383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:35.770423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:35.770486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:35.770799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 565 partition: 0 MaxSeqNo: 46 sessionId: src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0
2025-10-15T10:58:35.772087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd551457-a8a9ebe9-a691cc6b-45652b9a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:35.798631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0] Write session: try to update token
2025-10-15T10:58:35.798684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:35.860425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:35.860460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:35.860474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:35.860485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:35.860516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401231886381699:6348]
2025-10-15T10:58:35.860540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401231886381699:6348]
2025-10-15T10:58:35.860563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401231886381699:6348]
2025-10-15T10:58:35.861011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:35.861047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:35.861075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:35.870734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:35.870779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:35.873105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:35.908936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId: src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:35.932425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:36.023169Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:36.028701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:36.028742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:36.028792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401231886381699:6348]
2025-10-15T10:58:36.028958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:36.028986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:36.029328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:36.030109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:36.030112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401229086688645:6486]
2025-10-15T10:58:36.030142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:36.030179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:36.030500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:36.088767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 565 reason: error at write: Disconnected sessionId: src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0
2025-10-15T10:58:36.089139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 565 sessionId: src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0 is DEAD
2025-10-15T10:58:36.089544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:36.089625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0] Write session will restart in 0.006507s
2025-10-15T10:58:36.089798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0] Write session: Do CDS request
2025-10-15T10:58:36.089857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:36.106715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:36.108756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:36.108791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 566
2025-10-15T10:58:36.111694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:36.112345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:36.112526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:36.112545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:36.112555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:36.112886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:36.113873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:36.113893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:36.113938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:36.114214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:36.114442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401236181349144:6352]
2025-10-15T10:58:36.116617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:36.114079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 566 sessionId:  describe result for acl check
2025-10-15T10:58:36.114206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:36.114216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:36.114226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:36.114244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401233381656066:7026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:36.117132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401233381656066:7026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:36.117559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:36.117753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:36.118698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:36.118977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.118982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.118987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.118992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.119001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.119009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.119017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.119023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.119028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.119033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.119037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.119042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.119046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.119050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.119083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.119171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.119214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.119251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.119297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.119338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.119395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.119442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.119490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.119540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.119586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.119632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.119679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.119725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.119769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.119833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.119892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.119946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.119995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.120048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.120109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.120163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.120211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.120267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.120313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.120366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.120400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.120439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.120472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.120514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.120561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.120616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.120664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.120718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.120767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.120820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.120867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.120923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.120970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.121027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.121070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.121123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.121603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:36.125828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401233381656066:7026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:36.130384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401233381656094:6486]
2025-10-15T10:58:36.135588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401233381656066:7026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:36.135632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401233381656066:7026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:36.135651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401233381656066:7026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:36.135685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:36.144727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:36.154342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:36.154402Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:36.154423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:36.154445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:36.154473Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 565 [2:7561401236181349144:6352]
2025-10-15T10:58:36.154537Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:36.154605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:36.154625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:36.154638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:36.154650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:36.154703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:36.154728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:36.154752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:36.177646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.177675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.177683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.177692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:36.177928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:36.177949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.178072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.178232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.178353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 565
2025-10-15T10:58:36.178415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:36.178373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 565
2025-10-15T10:58:36.178448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 565, pipe: [1:7561401233381656094:6486]
2025-10-15T10:58:36.178498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401233381656099:7026], now have 1 active actors on pipe
2025-10-15T10:58:36.178522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401233381655954:2467], now have 1 active actors on pipe
2025-10-15T10:58:36.178540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401233381656094:6486], now have 1 active actors on pipe
2025-10-15T10:58:36.178563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401236181349138:6352]
2025-10-15T10:58:36.178576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401236181349138:6352]
2025-10-15T10:58:36.178588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401236181349138:6352]
2025-10-15T10:58:36.178620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:36.178650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:36.178672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:36.178683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:36.178687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:36.178862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:36.178886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:36.178938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:36.178962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:36.179090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401236181349138:6352]
2025-10-15T10:58:36.179120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:36.179182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:36.179182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:36.179217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:36.179234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:36.179244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:36.179279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:36.179320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:36.179469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:36.180133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:36.180162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:36.180221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:36.180580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 566 partition: 0 MaxSeqNo: 46 sessionId: src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0
2025-10-15T10:58:36.181473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a165a-41671134-3f45dd0d-bf1ceb6f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:36.202244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0] Write session: try to update token
2025-10-15T10:58:36.202305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:36.235811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:36.235852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:36.235894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401236181349138:6352]
2025-10-15T10:58:36.236033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:36.236299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:36.244418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:36.252080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:36.254078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:36.255380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:36.257586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:36.258365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:36.258381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:36.258389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:36.258431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:36.316680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:36.316718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:36.316731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:36.316743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:36.316782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401236181349138:6352]
2025-10-15T10:58:36.316809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401236181349138:6352]
2025-10-15T10:58:36.316832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401236181349138:6352]
2025-10-15T10:58:36.316973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:36.317009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:36.318123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:36.319461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:36.319511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:36.319541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:36.340792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId: src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:36.360079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:36.464664Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:36.466589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:36.466611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:36.469378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:36.468952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:36.468979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:36.470905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:36.471146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401233381656094:6486]
2025-10-15T10:58:36.503316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:36.503388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0] Write session will restart in 0.009366s
2025-10-15T10:58:36.502468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 566 reason: error at write: Disconnected sessionId: src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0
2025-10-15T10:58:36.502764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 566 sessionId: src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0 is DEAD
2025-10-15T10:58:36.503505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0] Write session: Do CDS request
2025-10-15T10:58:36.503556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:36.518679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:36.518737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 567
2025-10-15T10:58:36.518998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:36.521559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:36.521757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:36.521781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:36.521791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:36.523435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 567 sessionId:  describe result for acl check
2025-10-15T10:58:36.523548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:36.523558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:36.523567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:36.523582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401233381656192:7032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:36.525888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401233381656192:7032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:36.532749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401233381656192:7032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:36.540599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:36.541099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401233381656192:7032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:36.541147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401233381656192:7032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:36.541164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401233381656192:7032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:36.541193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:36.545358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:36.546354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:36.546388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:36.546437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:36.546725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:36.546906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401236181349318:6362]
2025-10-15T10:58:36.549223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:36.550435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:36.550727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:36.552218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:36.552577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.552596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.552601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.552608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.552614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.552620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.552627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.552632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.552639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.552645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.552652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.552659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.552700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.552708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.552753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.552855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.552901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.552972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.553026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.553072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.553115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.553152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.553182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.553214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.553252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.553295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.553343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.553386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.553427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.553485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.553523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.553567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.553598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.553637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.553664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.553702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.553731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.553765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.553791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.553822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.553850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.553883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.553915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.553950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.553979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.554008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.554033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.554064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.554098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.554131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.554157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.554189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.554216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.554245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.554271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.554317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.554706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:36.571072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:36.571517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401233381656270:6486]
2025-10-15T10:58:36.591148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:36.591192Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:36.591207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:36.591224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:36.591246Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 566 [2:7561401236181349318:6362]
2025-10-15T10:58:36.591294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:36.591362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:36.591375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:36.591386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:36.591395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:36.591439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:36.591460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:36.591492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:36.593186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.593217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.593230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.593243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:36.593528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:36.593556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.593691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.593872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.594097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:36.594168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401233381656124:2467], now have 1 active actors on pipe
2025-10-15T10:58:36.594190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401233381656270:6486], now have 1 active actors on pipe
2025-10-15T10:58:36.594209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401233381656265:7032], now have 1 active actors on pipe
2025-10-15T10:58:36.594231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401236181349312:6362]
2025-10-15T10:58:36.594244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401236181349312:6362]
2025-10-15T10:58:36.594256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401236181349312:6362]
2025-10-15T10:58:36.594294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:36.594352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:36.594359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:36.594368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:36.594383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:36.594529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:36.594545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:36.594643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401236181349312:6362]
2025-10-15T10:58:36.594671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:36.594692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:36.595264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 566
2025-10-15T10:58:36.595266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 566, pipe: [1:7561401233381656270:6486]
2025-10-15T10:58:36.595378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 566
2025-10-15T10:58:36.595659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:36.595689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:36.595760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:36.595794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:36.595816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:36.595826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:36.595858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:36.595892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:36.595952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:36.596378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:36.596400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:36.596457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:36.596836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 567 partition: 0 MaxSeqNo: 46 sessionId: src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0
2025-10-15T10:58:36.597507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b90a292-7791be7a-1fe78af7-c7b3861c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:36.620492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0] Write session: try to update token
2025-10-15T10:58:36.620545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:36.629739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:36.629769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:36.629792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401236181349312:6362]
2025-10-15T10:58:36.629884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:36.629939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:36.644520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:36.652889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:36.660016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:58:36.660084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-10-15T10:58:36.660791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:36.662868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:36.670643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:36.671596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:36.671872Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:58:36.688848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 10 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:58:36.689051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:58:36.725881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:36.725921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:36.725932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:36.725989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:36.726005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:36.726019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:36.726031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:36.726069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401236181349312:6362]
2025-10-15T10:58:36.726096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401236181349312:6362]
2025-10-15T10:58:36.726123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401236181349312:6362]
2025-10-15T10:58:36.726269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:36.726299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:36.726317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:36.726323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:36.726345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:36.727467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:36.739619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId: src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:36.758676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:36.877258Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:36.879433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:36.879479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:36.880223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:36.880027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:36.880181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401233381656270:6486]
2025-10-15T10:58:36.880254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:36.880266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:36.904844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 567 reason: error at write: Disconnected sessionId: src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0
2025-10-15T10:58:36.905227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 567 sessionId: src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0 is DEAD
2025-10-15T10:58:36.905594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:36.905625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0] Write session will restart in 0.008384s
2025-10-15T10:58:36.905738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0] Write session: Do CDS request
2025-10-15T10:58:36.905771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:36.919691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:36.921365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:36.921405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 568
2025-10-15T10:58:36.921844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:36.921969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:36.921990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:36.922000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:36.923478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 568 sessionId:  describe result for acl check
2025-10-15T10:58:36.923597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:36.923608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:36.923617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:36.923633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401233381656353:7042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:36.926387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401233381656353:7042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:36.932308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401233381656353:7042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:36.942562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401233381656353:7042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:36.942605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401233381656353:7042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:36.942622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401233381656353:7042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:36.942649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:36.945073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:36.951066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:36.952410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:36.952450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:36.952499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:36.952800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:36.952995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401236181349485:6370]
2025-10-15T10:58:36.955305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:36.960745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:36.961003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:36.962299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:36.962590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.962598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.962604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.962612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.962618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.962624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.962630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.962637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.962644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.962650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.962657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.962662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.962669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.962676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.962721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.962828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.962874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.962919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.962961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.963004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.963046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.963091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.963132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.963175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.963219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.963262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.963304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.963373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.963417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.963482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:36.963542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.963596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:36.963639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.963689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:36.963733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.963785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:36.963833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.963886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:36.963929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.963980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:36.964023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.964075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:36.964121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.964173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:36.964218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.964268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:36.964308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.964361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:36.964421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.964473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:36.964521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.964578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.964630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.964687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.964735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.964791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.965316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:36.980577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401233381656447:6486]
2025-10-15T10:58:36.986974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:36.996137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:36.996193Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:36.996211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:36.996228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:36.996246Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 567 [2:7561401236181349485:6370]
2025-10-15T10:58:36.996286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:36.996341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:36.996356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:36.996369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:36.996380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:36.996427Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:36.996447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:36.996475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:36.997975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.997996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.998011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.998023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:36.998293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:36.998318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:36.998460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:36.998660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:36.998616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 567, pipe: [1:7561401233381656447:6486]
2025-10-15T10:58:36.998713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 567
2025-10-15T10:58:36.998790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 567
2025-10-15T10:58:36.998907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:36.999006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401233381656447:6486], now have 1 active actors on pipe
2025-10-15T10:58:36.999042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401233381656300:2467], now have 1 active actors on pipe
2025-10-15T10:58:36.999064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401233381656440:7042], now have 1 active actors on pipe
2025-10-15T10:58:36.999089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401236181349480:6370]
2025-10-15T10:58:36.999104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401236181349480:6370]
2025-10-15T10:58:36.999117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401236181349480:6370]
2025-10-15T10:58:36.999150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:36.999178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:36.999205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:36.999216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:36.999222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:36.999422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:36.999446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:36.999504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:36.999522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:36.999665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401236181349480:6370]
2025-10-15T10:58:36.999700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:36.999740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:36.999768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:36.999798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:36.999817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:36.999828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:36.999861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:36.999899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:37.000033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:37.000970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:37.001010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:37.001093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:37.001404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 568 partition: 0 MaxSeqNo: 46 sessionId: src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0
2025-10-15T10:58:37.003902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e96eaa4-7811f097-d0e1b45e-851e2ca7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:37.024095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0] Write session: try to update token
2025-10-15T10:58:37.024160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:37.093020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:37.093081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:37.093145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401236181349480:6370]
2025-10-15T10:58:37.093281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:37.093364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:37.097421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:37.098932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:37.100495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:37.101728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:37.103142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:37.115684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId: src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:37.146105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:37.153529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:37.153563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:37.153574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:37.153637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:37.153759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:37.153782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:37.153794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:37.153804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:37.153841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401236181349480:6370]
2025-10-15T10:58:37.153864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401236181349480:6370]
2025-10-15T10:58:37.153885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401236181349480:6370]
2025-10-15T10:58:37.154000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:37.154046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:37.154063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:37.154075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:37.154087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:37.154120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:37.154143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:37.155063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:37.299427Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:37.301472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:37.301482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:37.301497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:37.301702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401233381656447:6486]
2025-10-15T10:58:37.301659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:37.310379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 568 reason: error at write: Disconnected sessionId: src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0
2025-10-15T10:58:37.310748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 568 sessionId: src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0 is DEAD
2025-10-15T10:58:37.311174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:37.311241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0] Write session will restart in 0.007288s
2025-10-15T10:58:37.311416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0] Write session: Do CDS request
2025-10-15T10:58:37.311464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:37.323151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:37.323379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:37.323184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 569
2025-10-15T10:58:37.323938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:37.324079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:37.324098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:37.324106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:37.325278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 569 sessionId:  describe result for acl check
2025-10-15T10:58:37.325379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:37.325398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:37.325407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:37.325422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401237676623783:7049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:37.328734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401237676623783:7049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:37.338719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401237676623783:7049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:37.356175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401237676623783:7049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:37.356217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401237676623783:7049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:37.356233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401237676623783:7049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:37.356262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:37.362566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:37.365670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:37.366362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:37.366392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:37.366422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:37.366587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:37.366732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401240476316940:6374]
2025-10-15T10:58:37.368271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:37.368963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:37.369116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:37.370050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:37.370301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:37.370314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:37.370318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:37.370323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:37.370327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:37.370331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:37.370335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:37.370341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:37.370347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:37.370353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:37.370359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:37.370366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.370372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.370377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.370410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:37.370482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:37.370514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:37.370544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:37.370573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:37.370612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:37.370648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:37.370677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:37.370710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:37.370749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:37.370782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:37.370814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.370842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.370886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.370920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:37.370965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:37.371007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:37.371046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:37.371081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:37.371126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:37.371168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:37.371229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:37.371272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:37.371310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:37.371366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:37.371417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:37.371468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:37.371517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:37.371559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:37.371615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:37.371662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:37.371719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:37.371765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:37.371818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:37.371865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:37.371918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:37.371963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.372018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.372066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.372122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.372167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.372220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.372569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:37.394679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:37.401969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401237676623927:6486]
2025-10-15T10:58:37.404277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:37.404327Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:37.404344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:37.404362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:37.404386Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 568 [2:7561401240476316940:6374]
2025-10-15T10:58:37.404434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:37.404491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:37.404505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:37.404517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:37.404527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:37.404571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:37.404601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:37.404622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:37.405697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.405722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.405736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.405747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:37.406007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:37.406035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.406158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.406322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 568
2025-10-15T10:58:37.406339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 568, pipe: [1:7561401237676623927:6486]
2025-10-15T10:58:37.406407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 568
2025-10-15T10:58:37.406349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.406563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:37.406640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401237676623919:7049], now have 1 active actors on pipe
2025-10-15T10:58:37.406667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401237676623927:6486], now have 1 active actors on pipe
2025-10-15T10:58:37.406686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401237676623769:2467], now have 1 active actors on pipe
2025-10-15T10:58:37.406726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:37.406749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:37.406794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401240476316935:6374]
2025-10-15T10:58:37.406813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401240476316935:6374]
2025-10-15T10:58:37.406824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401240476316935:6374]
2025-10-15T10:58:37.406858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:37.406897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:37.406921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:37.406921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:37.406934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:37.407080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:37.407102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:37.407154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:37.407184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:37.407205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:37.407214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:37.407244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:37.407281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:37.407410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401240476316935:6374]
2025-10-15T10:58:37.407443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:37.407485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:37.407487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:37.407927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:37.407952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:37.408009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:37.408297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 569 partition: 0 MaxSeqNo: 46 sessionId: src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0
2025-10-15T10:58:37.408978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73fa30c2-daf69c43-987ff8b1-55e5cef9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:37.429110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0] Write session: try to update token
2025-10-15T10:58:37.429161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:37.459469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:37.463487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:37.463548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401240476316935:6374]
2025-10-15T10:58:37.463672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:37.463693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:37.466654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:37.472631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:37.474397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:37.475835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:37.481653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:37.482262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:37.511111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:37.511144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:37.511154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:37.544279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:37.544313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:37.544327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:37.544336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:37.544367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401240476316935:6374]
2025-10-15T10:58:37.544386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401240476316935:6374]
2025-10-15T10:58:37.544402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401240476316935:6374]
2025-10-15T10:58:37.544518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:37.544535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:37.544599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:37.544653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:37.544697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:37.545334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:37.557699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId: src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:37.577955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:37.688348Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:37.696524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:37.696578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:37.697117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:37.697147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:37.697150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401237676623927:6486]
2025-10-15T10:58:37.697251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:37.697551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:37.715845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 569 reason: error at write: Disconnected sessionId: src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0
2025-10-15T10:58:37.716589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:37.716651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0] Write session will restart in 0.009070s
2025-10-15T10:58:37.716829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0] Write session: Do CDS request
2025-10-15T10:58:37.716879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:37.716189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 569 sessionId: src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0 is DEAD
2025-10-15T10:58:37.733917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:37.733844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:37.733878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 570
2025-10-15T10:58:37.734519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:37.734667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:37.734690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:37.734700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:37.736357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 570 sessionId:  describe result for acl check
2025-10-15T10:58:37.736484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:37.736501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:37.736510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:37.736528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401237676623998:7055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:37.739331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401237676623998:7055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:37.746367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401237676623998:7055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:37.754233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:37.754405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401237676623998:7055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:37.754458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401237676623998:7055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:37.754475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401237676623998:7055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:37.754504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:37.755709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:37.756464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:37.756492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:37.756533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:37.756787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:37.756969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401240476317100:6378]
2025-10-15T10:58:37.759177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:37.760131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:37.760358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:37.761646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:37.761979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:37.761988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:37.761996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:37.762003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:37.762010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:37.762017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:37.762024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:37.762032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:37.762038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:37.762046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:37.762053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:37.762061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.762068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.762076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.762124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:37.762241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:37.762293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:37.762346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:37.762417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:37.762469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:37.762516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:37.762566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:37.762616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:37.762665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:37.762716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:37.762763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.762813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.762861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.762909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:37.762980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:37.763041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:37.763120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:37.763172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:37.763232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:37.763277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:37.763333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:37.764171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:37.764251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:37.764309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:37.764375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:37.764431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:37.764493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:37.764550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:37.764622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:37.764679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:37.764743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:37.764799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:37.764861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:37.764916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:37.764978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:37.765030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.765094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.765152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.765212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.765261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.765326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.765881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:37.785633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:37.797342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401237676624091:6486]
2025-10-15T10:58:37.796132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:37.796203Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:37.796220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:37.796240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:37.796268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 569 [2:7561401240476317100:6378]
2025-10-15T10:58:37.796320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:37.796379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:37.796393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:37.796405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:37.796417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:37.796467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:37.796491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:37.796524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:37.816359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.816391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.816403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.816415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:37.816676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:37.816703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:37.816957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 569
2025-10-15T10:58:37.816966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 569, pipe: [1:7561401237676624091:6486]
2025-10-15T10:58:37.817068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 569
2025-10-15T10:58:37.816837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:37.817019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:37.817227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:37.817305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401237676624085:7055], now have 1 active actors on pipe
2025-10-15T10:58:37.817328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401237676624091:6486], now have 1 active actors on pipe
2025-10-15T10:58:37.817346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401237676623940:2467], now have 1 active actors on pipe
2025-10-15T10:58:37.817394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:37.817415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:37.817486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401240476317094:6378]
2025-10-15T10:58:37.817499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401240476317094:6378]
2025-10-15T10:58:37.817511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401240476317094:6378]
2025-10-15T10:58:37.817550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:37.817583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:37.817610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:37.817622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:37.817623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:37.817798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:37.817815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:37.817875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd7b1a55-31bf662a-22055607-95dde544_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:37.817906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:37.817924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:37.817934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:37.817968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:37.818012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:37.818139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401240476317094:6378]
2025-10-15T10:58:37.818169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:37.818204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:37.818215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:37.818678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:37.818698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:37.818772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:37.819157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 570 partition: 0 MaxSeqNo: 46 sessionId: src_id|cd7b1a55-31bf662a-22055607-95dde544_0
2025-10-15T10:58:37.819921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbedc4a-e8cf6224-f053444c-85100a83_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cd7b1a55-31bf662a-22055607-95dde544_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:37.850554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:37.850593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:37.850654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401240476317094:6378]
2025-10-15T10:58:37.850767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:37.850784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:37.857322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:37.861668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:37.862824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7b1a55-31bf662a-22055607-95dde544_0] Write session: try to update token
2025-10-15T10:58:37.862871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7b1a55-31bf662a-22055607-95dde544_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:37.862895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:37.864109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:37.865941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:37.866457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:37.926153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:37.926213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:37.926232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:37.926311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:37.926332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:37.926358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:37.926376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:37.926439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401240476317094:6378]
2025-10-15T10:58:37.926489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401240476317094:6378]
2025-10-15T10:58:37.926544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401240476317094:6378]
2025-10-15T10:58:37.926699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:37.926745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:37.926767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:37.926777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:37.926805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:37.929091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:37.951037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId: src_id|cd7b1a55-31bf662a-22055607-95dde544_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:37.972568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:38.064179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:38.068170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:38.068210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:38.068828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:38.068832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401237676624091:6486]
2025-10-15T10:58:38.068838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:38.068907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:38.068915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:38.099742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 570 reason: error at write: Disconnected sessionId: src_id|cd7b1a55-31bf662a-22055607-95dde544_0
2025-10-15T10:58:38.100030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 570 sessionId: src_id|cd7b1a55-31bf662a-22055607-95dde544_0 is DEAD
2025-10-15T10:58:38.101207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7b1a55-31bf662a-22055607-95dde544_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:38.101261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7b1a55-31bf662a-22055607-95dde544_0] Write session will restart in 0.006698s
2025-10-15T10:58:38.101402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7b1a55-31bf662a-22055607-95dde544_0] Write session: Do CDS request
2025-10-15T10:58:38.101454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7b1a55-31bf662a-22055607-95dde544_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:38.113685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7b1a55-31bf662a-22055607-95dde544_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:38.114779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:38.114820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 571
2025-10-15T10:58:38.115154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:38.115274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:38.115286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:38.115295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:38.116838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 571 sessionId:  describe result for acl check
2025-10-15T10:58:38.116969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:38.116982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:38.116991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:38.117010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401241971591418:7059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:38.120603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401241971591418:7059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:38.126716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401241971591418:7059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:38.144738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401241971591418:7059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:38.144779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401241971591418:7059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:38.144791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401241971591418:7059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:38.144813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:38.154876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:38.158549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:38.159308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:38.159343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:38.159407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:38.159637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:38.159811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401244771284560:6386]
2025-10-15T10:58:38.161602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:38.162347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:38.162551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:38.163739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:38.164054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.164076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.164083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.164090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.164097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.164103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.164109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.164115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.164122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.164128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.164135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.164140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.164146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.164153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.164195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.164294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.164338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.164383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.164427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.164469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.164521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.164571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.164618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.164666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.164713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.164774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.164821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.164867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.164908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.164967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.165017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.165076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.165126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.165185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.165236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.165289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.165340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.165393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.165440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.165506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.165555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.165607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.165655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.165708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.165757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.165812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.165857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.165911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.165960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.166013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.166054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.166101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.166151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.166205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.166252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.166306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.166791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:38.169385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401241971591558:6486]
2025-10-15T10:58:38.187996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:38.199273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:38.199321Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:38.199336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:38.199388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:38.199410Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 570 [2:7561401244771284560:6386]
2025-10-15T10:58:38.199454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:38.199500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:38.199514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:38.199525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:38.199535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:38.199577Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:38.199598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:38.199617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:38.211192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.211227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.211240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.211250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:38.211562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:38.211587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.211704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.211873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.212075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:38.212151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401241971591403:2467], now have 1 active actors on pipe
2025-10-15T10:58:38.212175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401241971591558:6486], now have 1 active actors on pipe
2025-10-15T10:58:38.212195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401241971591530:7059], now have 1 active actors on pipe
2025-10-15T10:58:38.212216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401244771284555:6386]
2025-10-15T10:58:38.212036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 570
2025-10-15T10:58:38.212236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401244771284555:6386]
2025-10-15T10:58:38.212122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 570, pipe: [1:7561401241971591558:6486]
2025-10-15T10:58:38.212246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401244771284555:6386]
2025-10-15T10:58:38.212192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 570
2025-10-15T10:58:38.212273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:38.212302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:38.212314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:38.212332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:38.212358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:38.212518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:38.212540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:38.212587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:38.212610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:38.212718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401244771284555:6386]
2025-10-15T10:58:38.212750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:38.212810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4e1f42b-777df716-b911ff8-797c808d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:38.212840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:38.212855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:38.212865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:38.212895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:38.212931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:38.213039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:38.213193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:38.214016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:38.214042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:38.214098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:38.214378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 571 partition: 0 MaxSeqNo: 46 sessionId: src_id|f4e1f42b-777df716-b911ff8-797c808d_0
2025-10-15T10:58:38.215042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7b1a55-31bf662a-22055607-95dde544_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f4e1f42b-777df716-b911ff8-797c808d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:38.245567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e1f42b-777df716-b911ff8-797c808d_0] Write session: try to update token
2025-10-15T10:58:38.245637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e1f42b-777df716-b911ff8-797c808d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:38.280901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:38.280927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:38.280936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:38.280943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:38.280965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401244771284555:6386]
2025-10-15T10:58:38.280980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401244771284555:6386]
2025-10-15T10:58:38.280994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401244771284555:6386]
2025-10-15T10:58:38.281090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:38.281105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:38.281106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:38.281142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:38.281170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:38.281969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:38.399686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId: src_id|f4e1f42b-777df716-b911ff8-797c808d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:38.421344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:38.427253Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:38.429391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:38.429427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:38.431642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:38.431885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401241971591558:6486]
2025-10-15T10:58:38.432006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:38.432036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:38.433651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:38.446081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 571 reason: error at write: Disconnected sessionId: src_id|f4e1f42b-777df716-b911ff8-797c808d_0
2025-10-15T10:58:38.446645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e1f42b-777df716-b911ff8-797c808d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:38.446697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e1f42b-777df716-b911ff8-797c808d_0] Write session will restart in 0.007797s
2025-10-15T10:58:38.446847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e1f42b-777df716-b911ff8-797c808d_0] Write session: Do CDS request
2025-10-15T10:58:38.446894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e1f42b-777df716-b911ff8-797c808d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:38.446355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 571 sessionId: src_id|f4e1f42b-777df716-b911ff8-797c808d_0 is DEAD
2025-10-15T10:58:38.460875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e1f42b-777df716-b911ff8-797c808d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:38.481527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:38.481563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 572
2025-10-15T10:58:38.482051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:38.482169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:38.482185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:38.482194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:38.483799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 572 sessionId:  describe result for acl check
2025-10-15T10:58:38.483892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:38.483902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:38.483912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:38.483927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401241971591632:7070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:38.486629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401241971591632:7070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:38.499816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401241971591632:7070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:38.504666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401241971591632:7070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:38.504710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401241971591632:7070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:38.504731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401241971591632:7070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:38.504765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:38.511892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:38.513808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:38.514636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:38.514653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:38.514690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:38.514914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:38.515086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401244771284743:6394]
2025-10-15T10:58:38.517165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:38.519059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:38.519268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:38.520539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:38.520880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.520899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.520905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.520911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.520918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.520925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.520931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.520937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.520942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.520948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.520954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.520960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.520967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.520973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.521018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.521114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.521158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.521207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.521255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.521305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.521352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.521398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.521446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.521510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.521557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.521606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.521646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.521693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.521737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.521802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.521857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.521912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.521965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.522013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.522054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.522104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.522154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.522208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.522257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.522305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.522352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.522405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.522452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.522505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.522584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.522645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.522692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.522747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.522798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.522851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.522900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.522949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.522989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.523052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.523095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.523140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.523686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:38.532545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401241971591740:6486]
2025-10-15T10:58:38.545586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:38.555026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:38.555066Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:38.555081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:38.555096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:38.555118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 571 [2:7561401244771284743:6394]
2025-10-15T10:58:38.555164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:38.555210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:38.555223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:38.555233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:38.555243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:38.555288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:38.555308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:38.555327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:38.556808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.556838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.556851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.556863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:38.557165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:38.557195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.557315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.557410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 571
2025-10-15T10:58:38.557498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.557520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 571, pipe: [1:7561401241971591740:6486]
2025-10-15T10:58:38.557598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 571
2025-10-15T10:58:38.557718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:38.557777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401241971591590:2467], now have 1 active actors on pipe
2025-10-15T10:58:38.557794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401241971591740:6486], now have 1 active actors on pipe
2025-10-15T10:58:38.557813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401241971591730:7070], now have 1 active actors on pipe
2025-10-15T10:58:38.557856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401244771284737:6394]
2025-10-15T10:58:38.557871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401244771284737:6394]
2025-10-15T10:58:38.557882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401244771284737:6394]
2025-10-15T10:58:38.557916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:38.557942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:38.557965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:38.557970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:38.557976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:38.557988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:38.558032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:38.558183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:38.558207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:38.558323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6270ed5c-95dc55b3-fcac487-d795869f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:38.558344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:38.558356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:38.558363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:38.558383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:38.558408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:38.558437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401244771284737:6394]
2025-10-15T10:58:38.558465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:38.558491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:38.558535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:38.559010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:38.559039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:38.559111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:38.559395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 572 partition: 0 MaxSeqNo: 46 sessionId: src_id|6270ed5c-95dc55b3-fcac487-d795869f_0
2025-10-15T10:58:38.560057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e1f42b-777df716-b911ff8-797c808d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6270ed5c-95dc55b3-fcac487-d795869f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:38.580681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6270ed5c-95dc55b3-fcac487-d795869f_0] Write session: try to update token
2025-10-15T10:58:38.580729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6270ed5c-95dc55b3-fcac487-d795869f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:38.591610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:38.591654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:38.591695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401244771284737:6394]
2025-10-15T10:58:38.591829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:38.593718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:38.594995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:38.595547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:38.596528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:38.607896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:38.609600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:38.610066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:38.658415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:38.658446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:38.658456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:38.658464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:38.658492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401244771284737:6394]
2025-10-15T10:58:38.658509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401244771284737:6394]
2025-10-15T10:58:38.658525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401244771284737:6394]
2025-10-15T10:58:38.658645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:38.658648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:38.658657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:38.658669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:38.658677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:38.658712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:38.658713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:38.658728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:38.659741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:38.722087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId: src_id|6270ed5c-95dc55b3-fcac487-d795869f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:38.742569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:38.805422Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:38.819200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:38.819253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:38.819832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:38.819920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401241971591740:6486]
2025-10-15T10:58:38.820011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:38.820031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:38.819945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:38.830377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 572 reason: error at write: Disconnected sessionId: src_id|6270ed5c-95dc55b3-fcac487-d795869f_0
2025-10-15T10:58:38.830680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 572 sessionId: src_id|6270ed5c-95dc55b3-fcac487-d795869f_0 is DEAD
2025-10-15T10:58:38.831591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6270ed5c-95dc55b3-fcac487-d795869f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:38.831640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6270ed5c-95dc55b3-fcac487-d795869f_0] Write session will restart in 0.005422s
2025-10-15T10:58:38.831806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6270ed5c-95dc55b3-fcac487-d795869f_0] Write session: Do CDS request
2025-10-15T10:58:38.831864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6270ed5c-95dc55b3-fcac487-d795869f_0] Start write session. Will connect to endpoint: localhost:13695
E1015 10:58:38.838381062  821866 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:58:38.841105Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:58:38.841461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6270ed5c-95dc55b3-fcac487-d795869f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:38.842386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:38.842434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 573
2025-10-15T10:58:38.842876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:38.843052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:38.843090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:38.843107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:38.846612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 573 sessionId:  describe result for acl check
2025-10-15T10:58:38.846733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:38.846746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:38.846755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:38.846771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401241971591776:7078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:38.851174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401241971591776:7078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:38.856537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401241971591776:7078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:38.868360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401241971591776:7078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:38.868390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401241971591776:7078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:38.868401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401241971591776:7078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:38.868421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:38.879024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:38.882984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:38.883804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:38.883833Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:38.883872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:38.884114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:38.884304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401244771284902:6399]
2025-10-15T10:58:38.886479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:38.887392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:38.887594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:38.888802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:38.889139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.889157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.889165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.889173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.889179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.889187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.889193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.889201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.889208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.889215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.889222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.889228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.889234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.889240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.889284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.889391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.889437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.889497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.889547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.889604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.889655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.889705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.889754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.889803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.889867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.889918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.889965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.890016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.890056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.890129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:38.890191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.890248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:38.890297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.890353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:38.890403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.890461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:38.890516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.890575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:38.890627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.890684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:38.890737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.890796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:38.890844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.890899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:38.890952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.891009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:38.891065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.891117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:38.891169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.891226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:38.891274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.891330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.891418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.891475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.891525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.891585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.892086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:38.910014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:38.920072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401241971591912:6486]
2025-10-15T10:58:38.935658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:38.935705Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:38.935723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:38.935739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:38.935761Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 572 [2:7561401244771284902:6399]
2025-10-15T10:58:38.935807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:38.935857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:38.935869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:38.935880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:38.935890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:38.935934Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:38.935954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:38.935974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:38.936989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.937013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.937027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.937036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:38.937287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:38.937312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:38.937614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 572
2025-10-15T10:58:38.937625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 572, pipe: [1:7561401241971591912:6486]
2025-10-15T10:58:38.937716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 572
2025-10-15T10:58:38.937440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:38.937646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:38.937876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:38.937949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401241971591761:2467], now have 1 active actors on pipe
2025-10-15T10:58:38.937973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401241971591912:6486], now have 1 active actors on pipe
2025-10-15T10:58:38.937994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401241971591868:7078], now have 1 active actors on pipe
2025-10-15T10:58:38.938055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:38.938073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:38.938107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401244771284897:6399]
2025-10-15T10:58:38.938121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401244771284897:6399]
2025-10-15T10:58:38.938134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401244771284897:6399]
2025-10-15T10:58:38.938172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:38.938214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:38.938231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:38.938241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:38.938243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:38.938411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:38.938426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:38.938482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:38.938510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:38.938527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:38.938536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:38.938567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:38.938600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:38.938709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401244771284897:6399]
2025-10-15T10:58:38.938738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:38.938759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:38.938778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:38.939585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:38.939614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:38.939675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:38.940009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 573 partition: 0 MaxSeqNo: 46 sessionId: src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0
2025-10-15T10:58:38.940787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6270ed5c-95dc55b3-fcac487-d795869f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:38.960332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0] Write session: try to update token
2025-10-15T10:58:38.960395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:38.979935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:38.979977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:38.980016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401244771284897:6399]
2025-10-15T10:58:38.980150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:38.980146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:38.986317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:38.990480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:38.992756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:38.994259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:38.995846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:38.996369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:39.045283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:39.045333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:39.045346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:39.045419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:39.045436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:39.045451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:39.045461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:39.045516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401244771284897:6399]
2025-10-15T10:58:39.045559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401244771284897:6399]
2025-10-15T10:58:39.045586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401244771284897:6399]
2025-10-15T10:58:39.045725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:39.045744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:39.045768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:39.045770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:39.045799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:39.056862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId: src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:39.058976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:39.084058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:39.202105Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:39.203416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:39.203465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:39.204124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:39.204330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:39.204507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401241971591912:6486]
2025-10-15T10:58:39.204582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:39.204594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:39.225146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 573 reason: error at write: Disconnected sessionId: src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0
2025-10-15T10:58:39.225493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 573 sessionId: src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0 is DEAD
2025-10-15T10:58:39.227880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:39.227920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0] Write session will restart in 0.009015s
2025-10-15T10:58:39.228041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0] Write session: Do CDS request
2025-10-15T10:58:39.228082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:39.242104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:39.245056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:39.245092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 574
2025-10-15T10:58:39.245407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:39.245552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:39.245578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:39.245588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:39.246999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 574 sessionId:  describe result for acl check
2025-10-15T10:58:39.247127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:39.247144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:39.247154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:39.247173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401246266559242:7084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:39.249972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401246266559242:7084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:39.260951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401246266559242:7084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:39.272786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401246266559242:7084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:39.272832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401246266559242:7084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:39.272850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401246266559242:7084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:39.272878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:39.280520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:39.284378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:39.285223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:39.285254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:39.285293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:39.285550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:39.285727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401249066252351:6401]
2025-10-15T10:58:39.288110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:39.289009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:39.289225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:39.290529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:39.290837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:39.290845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:39.290851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:39.290859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:39.290866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:39.290873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:39.290881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:39.290888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:39.290895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:39.290901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:39.290907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:39.290914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.290920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.290926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.290974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:39.291095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:39.291145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:39.291194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:39.291243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:39.291292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:39.291336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:39.291402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:39.291448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:39.291496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:39.291542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:39.291587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.291634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.291678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.291721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:39.291790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:39.291853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:39.291909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:39.291958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:39.292011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:39.292058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:39.292112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:39.292156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:39.292212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:39.292256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:39.292309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:39.292355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:39.292411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:39.292456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:39.292508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:39.292554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:39.292608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:39.292654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:39.293785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:39.293859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:39.293915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:39.293969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.294033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.294089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.294152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.294201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.294257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.294793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:39.304055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401246266559377:6486]
2025-10-15T10:58:39.317347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:39.327638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:39.327690Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:39.327707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:39.327724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:39.327742Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 573 [2:7561401249066252351:6401]
2025-10-15T10:58:39.327781Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:39.327828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:39.327839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:39.327851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:39.327864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:39.327916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:39.327936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:39.327955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:39.329837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.329864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.329874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.329882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:39.330083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:39.330094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.330208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.330340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.330533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:39.330597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401249066252346:6401]
2025-10-15T10:58:39.330609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401249066252346:6401]
2025-10-15T10:58:39.330617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401249066252346:6401]
2025-10-15T10:58:39.330654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:39.330715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:39.330730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:39.330730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:39.330743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:39.331223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 573
2025-10-15T10:58:39.330917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:39.330936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:39.331361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 573
2025-10-15T10:58:39.331082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401246266559223:2467], now have 1 active actors on pipe
2025-10-15T10:58:39.331109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401246266559369:7084], now have 1 active actors on pipe
2025-10-15T10:58:39.331131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401246266559377:6486], now have 1 active actors on pipe
2025-10-15T10:58:39.331422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 573, pipe: [1:7561401246266559377:6486]
2025-10-15T10:58:39.331150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401249066252346:6401]
2025-10-15T10:58:39.331187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:39.331243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:39.331601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:39.331644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:39.331742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:39.331784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:39.331803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:39.331814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:39.331852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:39.331896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:39.331957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:39.332384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:39.332422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:39.332508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:39.332822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 574 partition: 0 MaxSeqNo: 46 sessionId: src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0
2025-10-15T10:58:39.333531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa58e37c-b5bbe310-d91b64ec-99df7fc7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:39.356973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0] Write session: try to update token
2025-10-15T10:58:39.357037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:39.412356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:39.412411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:39.412427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:39.412439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:39.412478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401249066252346:6401]
2025-10-15T10:58:39.412507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401249066252346:6401]
2025-10-15T10:58:39.412530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401249066252346:6401]
2025-10-15T10:58:39.412674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:39.412738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:39.412751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:39.412773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:39.412776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:39.413676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:39.468963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId: src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:39.490921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:39.560143Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:39.573228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:39.573275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:39.573326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:39.573336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:39.573371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401249066252346:6401]
2025-10-15T10:58:39.573604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:39.573895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:39.574491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:39.575707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:39.575944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401246266559377:6486]
2025-10-15T10:58:39.595290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 574 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0
2025-10-15T10:58:39.595642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 574 sessionId: src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0 is DEAD
2025-10-15T10:58:39.596971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:39.597027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0] Write session will restart in 0.009570s
2025-10-15T10:58:39.597186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0] Write session: Do CDS request
2025-10-15T10:58:39.597227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:39.617270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:39.627928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:39.627960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 575
2025-10-15T10:58:39.628367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:39.628446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:39.628455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:39.628463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:39.629563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 575 sessionId:  describe result for acl check
2025-10-15T10:58:39.629660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:39.629670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:39.629680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:39.629697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401246266559420:7092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:39.632078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401246266559420:7092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:39.644519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401246266559420:7092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:39.652423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401246266559420:7092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:39.652466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401246266559420:7092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:39.652482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401246266559420:7092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:39.652511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:39.666008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:39.670396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:39.671270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:39.671306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:39.671367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:39.671650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:39.671868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401249066252532:6411]
2025-10-15T10:58:39.674105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:39.676320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:39.676572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:39.677857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:39.678128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:39.678140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:39.678146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:39.678152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:39.678156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:39.678161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:39.678166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:39.678171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:39.678176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:39.678181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:39.678185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:39.678190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.678194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.678200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.678234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:39.678358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:39.678396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:39.678430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:39.678470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:39.678512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:39.678556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:39.678591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:39.678625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:39.678661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:39.678826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401246266559565:6486]
2025-10-15T10:58:39.678923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:39.678961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.678998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.679046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.679093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:39.679149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:39.679215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:39.679285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:39.679337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:39.679453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:39.679515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:39.679573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:39.679633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:39.679693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:39.679809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:39.679872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:39.679921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:39.679975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:39.680023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:39.680075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:39.680126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:39.680182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:39.680244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:39.680305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:39.680352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:39.680418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:39.680467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.680520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.680567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.680620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.680976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.681048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.681659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:39.705229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:39.716565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:39.716617Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:39.716634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:39.716653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:39.716677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 574 [2:7561401249066252532:6411]
2025-10-15T10:58:39.716728Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:39.716786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:39.716801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:39.716813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:39.716825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:39.716874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:39.716896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:39.716918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:39.718905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.718920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.718933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.718945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:39.719231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:39.719250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:39.719871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 574
2025-10-15T10:58:39.719977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 574
2025-10-15T10:58:39.720042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 574, pipe: [1:7561401246266559565:6486]
2025-10-15T10:58:39.719874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:39.720094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:39.720317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:39.720406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401246266559552:7092], now have 1 active actors on pipe
2025-10-15T10:58:39.720443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401246266559400:2467], now have 1 active actors on pipe
2025-10-15T10:58:39.720467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401246266559565:6486], now have 1 active actors on pipe
2025-10-15T10:58:39.720494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401249066252527:6411]
2025-10-15T10:58:39.720509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401249066252527:6411]
2025-10-15T10:58:39.720522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401249066252527:6411]
2025-10-15T10:58:39.720565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:39.720640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:39.720816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:39.720833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:39.720990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401249066252527:6411]
2025-10-15T10:58:39.721009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:39.721771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:39.721796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:39.721807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:39.721829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:39.722610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:39.722642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:39.722731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:39.722766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:39.722783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:39.722794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:39.722830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:39.722875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:39.722926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:39.727585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:39.727628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:39.727706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:39.730878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 575 partition: 0 MaxSeqNo: 46 sessionId: src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0
2025-10-15T10:58:39.735570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94a53dc4-e5035bf1-782fe5b9-88c03534_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:39.780791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0] Write session: try to update token
2025-10-15T10:58:39.780848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:39.814689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:39.814729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:39.814743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:39.814754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:39.814792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401249066252527:6411]
2025-10-15T10:58:39.814819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401249066252527:6411]
2025-10-15T10:58:39.814845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401249066252527:6411]
2025-10-15T10:58:39.814987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:39.815012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:39.815037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:39.815046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:39.815074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:39.819226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:39.880620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId: src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:39.923869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:39.969406Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:39.971376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:39.971417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:39.972138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401246266559565:6486]
2025-10-15T10:58:39.972261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:39.972483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:39.972522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:39.982681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 575 reason: error at write: Disconnected sessionId: src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0
2025-10-15T10:58:39.983025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 575 sessionId: src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0 is DEAD
2025-10-15T10:58:39.983424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:39.983474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0] Write session will restart in 0.008716s
2025-10-15T10:58:39.983639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0] Write session: Do CDS request
2025-10-15T10:58:39.983698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:39.996495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:39.997516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:40.010642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:40.010670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 576
2025-10-15T10:58:40.011043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:40.011126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:40.011136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:40.011144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:40.013254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 576 sessionId:  describe result for acl check
2025-10-15T10:58:40.013345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:40.013358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:40.013366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:40.013378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401250561526899:7100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:40.015950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401250561526899:7100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:40.026669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401250561526899:7100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:40.038746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401250561526899:7100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:40.038792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401250561526899:7100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:40.038806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401250561526899:7100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:40.038829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:40.046869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:40.051640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:40.052566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:40.052601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:40.052648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:40.052924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:40.053118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401253361220001:6418]
2025-10-15T10:58:40.055404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:40.056305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:40.056468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:40.057389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:40.057674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.057679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.057684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.057688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.057694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.057699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.057704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.057709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.057714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.057718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.057722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.057726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.057734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.057741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.057775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.057858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.057894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.057928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.057963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.058001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.058040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.058071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.058103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.058141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.058181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.058216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.058256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.058288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.058317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.058365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.058408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.058444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.058477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.058533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.058565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.058601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.058643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.058709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.058754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.058793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.058832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.058871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.058912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.058951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.058991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.059045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.059079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.059124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.059169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.059210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.059252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.059305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.059408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.059459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.059513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.059566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.060056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:40.072090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401250561527039:6486]
2025-10-15T10:58:40.082967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:40.093072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:40.093114Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:40.093130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:40.093148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:40.093171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 575 [2:7561401253361220001:6418]
2025-10-15T10:58:40.093217Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:40.093268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:40.093283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:40.093294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:40.093306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:40.093349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:40.093371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:40.093389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:40.094539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.094570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.094582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.094591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:40.094832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:40.094859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.094989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.095173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.095851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 575
2025-10-15T10:58:40.095960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 575, pipe: [1:7561401250561527039:6486]
2025-10-15T10:58:40.096054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 575
2025-10-15T10:58:40.095868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:40.095957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401246266559580:2467], now have 1 active actors on pipe
2025-10-15T10:58:40.095978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401250561527039:6486], now have 1 active actors on pipe
2025-10-15T10:58:40.095999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401250561527017:7100], now have 1 active actors on pipe
2025-10-15T10:58:40.096021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401253361219996:6418]
2025-10-15T10:58:40.096035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401253361219996:6418]
2025-10-15T10:58:40.096047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401253361219996:6418]
2025-10-15T10:58:40.096081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:40.096148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:40.096260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:40.096280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:40.096293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:40.096314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:40.096328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:40.096438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401253361219996:6418]
2025-10-15T10:58:40.096467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:40.096483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:40.096577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:40.096596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:40.096686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4d74515-987a14e7-c536882-dd8e00cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:40.096725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:40.096752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:40.096762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:40.096794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:40.096828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:40.096887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:40.098121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:40.098149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:40.098207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:40.098501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 576 partition: 0 MaxSeqNo: 46 sessionId: src_id|c4d74515-987a14e7-c536882-dd8e00cb_0
2025-10-15T10:58:40.099187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3407e99d-9055d1b6-41fcb1a-3394b2ca_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c4d74515-987a14e7-c536882-dd8e00cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:40.124322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d74515-987a14e7-c536882-dd8e00cb_0] Write session: try to update token
2025-10-15T10:58:40.124375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d74515-987a14e7-c536882-dd8e00cb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:40.199794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:40.199838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:40.199851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:40.199860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:40.199893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401253361219996:6418]
2025-10-15T10:58:40.199933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401253361219996:6418]
2025-10-15T10:58:40.199957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401253361219996:6418]
2025-10-15T10:58:40.200080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:40.200132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:40.200169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:40.200204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:40.200217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:40.200227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:40.200266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:40.200282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:40.201755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:40.222674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId: src_id|c4d74515-987a14e7-c536882-dd8e00cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:40.243875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:40.340892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:40.359099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:40.359146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:40.359208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:40.359220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:40.359260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401253361219996:6418]
2025-10-15T10:58:40.359451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:40.359653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:40.359683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:40.359750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:40.359847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:40.359928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401250561527039:6486]
2025-10-15T10:58:40.368567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d74515-987a14e7-c536882-dd8e00cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:40.368654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d74515-987a14e7-c536882-dd8e00cb_0] Write session will restart in 0.009937s
2025-10-15T10:58:40.368817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d74515-987a14e7-c536882-dd8e00cb_0] Write session: Do CDS request
2025-10-15T10:58:40.368873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d74515-987a14e7-c536882-dd8e00cb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:40.367586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 576 reason: error at write: Disconnected sessionId: src_id|c4d74515-987a14e7-c536882-dd8e00cb_0
2025-10-15T10:58:40.367855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 576 sessionId: src_id|c4d74515-987a14e7-c536882-dd8e00cb_0 is DEAD
2025-10-15T10:58:40.384793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d74515-987a14e7-c536882-dd8e00cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:40.385658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:40.385682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 577
2025-10-15T10:58:40.386497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:40.386619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:40.386638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:40.386645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:40.387685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 577 sessionId:  describe result for acl check
2025-10-15T10:58:40.387801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:40.387818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:40.387828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:40.387846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401250561527077:7108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:40.390058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401250561527077:7108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:40.398867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401250561527077:7108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:40.407658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401250561527077:7108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:40.407705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401250561527077:7108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:40.407723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401250561527077:7108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:40.407757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:40.424658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:40.426185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:40.427033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:40.427061Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:40.427104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:40.427369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:40.427557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401253361220167:6423]
2025-10-15T10:58:40.429727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:40.430529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:40.430735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:40.431969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:40.432284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.432303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.432309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.432316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.432322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.432328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.432336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.432341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.432348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.432354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.432359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.432366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.432373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.432379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.432421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.432524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.432567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.432610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.432650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.432691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.432731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.432780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.432827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.432873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.432921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.432962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.433007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.433052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.433096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.433168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.433227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.433285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.433337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.433391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.433433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.433482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.433547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.433605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.433650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.433705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.433753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.433806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.433853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.433901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.433949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.434008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.434056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.434112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.434163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.434212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.434256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.434307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.434353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.434403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.434445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.434500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.434970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:40.450126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:40.459579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:40.459625Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:40.459642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:40.459659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:40.459683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 576 [2:7561401253361220167:6423]
2025-10-15T10:58:40.459738Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:40.459793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:40.459807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:40.459818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:40.459828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:40.459882Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:40.459901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:40.459918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:40.460269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401250561527215:6486]
2025-10-15T10:58:40.469925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.469953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.469962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.469970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:40.470206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:40.470226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.470337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.470492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.470524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 576, pipe: [1:7561401250561527215:6486]
2025-10-15T10:58:40.470633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 576
2025-10-15T10:58:40.470632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 576
2025-10-15T10:58:40.470701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:40.470781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401250561527215:6486], now have 1 active actors on pipe
2025-10-15T10:58:40.470802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401250561527157:7108], now have 1 active actors on pipe
2025-10-15T10:58:40.470821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401250561527049:2467], now have 1 active actors on pipe
2025-10-15T10:58:40.470844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401253361220162:6423]
2025-10-15T10:58:40.470856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401253361220162:6423]
2025-10-15T10:58:40.470869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401253361220162:6423]
2025-10-15T10:58:40.470900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:40.470931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:40.470955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:40.470962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:40.470966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:40.471120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:40.471141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:40.471204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:40.471228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:40.471335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401253361220162:6423]
2025-10-15T10:58:40.471386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:40.471411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:40.471453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77fe9b69-8805eeee-503d2e17-95342b22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:40.471491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:40.471507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:40.471517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:40.471548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:40.471587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:40.471708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:40.472112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:40.472139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:40.472203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:40.472470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 577 partition: 0 MaxSeqNo: 46 sessionId: src_id|77fe9b69-8805eeee-503d2e17-95342b22_0
2025-10-15T10:58:40.473191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4d74515-987a14e7-c536882-dd8e00cb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|77fe9b69-8805eeee-503d2e17-95342b22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:40.493216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77fe9b69-8805eeee-503d2e17-95342b22_0] Write session: try to update token
2025-10-15T10:58:40.493276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77fe9b69-8805eeee-503d2e17-95342b22_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:40.499703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:40.499746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:40.499782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401253361220162:6423]
2025-10-15T10:58:40.499874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:40.499896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:40.501964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:40.503244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:40.504565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:40.505861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:40.507932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:40.508455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:40.577625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:40.577667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:40.577683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:40.577697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:40.577748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401253361220162:6423]
2025-10-15T10:58:40.577782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401253361220162:6423]
2025-10-15T10:58:40.577805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401253361220162:6423]
2025-10-15T10:58:40.577954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:40.577994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:40.578007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:40.578020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:40.578020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:40.578052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:40.578069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:40.578090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:40.580539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:40.587614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId: src_id|77fe9b69-8805eeee-503d2e17-95342b22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:40.610493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:40.720112Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:40.721452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:40.721488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:40.722221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:40.722276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401250561527215:6486]
2025-10-15T10:58:40.722385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:40.722398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:40.723252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:40.731994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 577 reason: error at write: Disconnected sessionId: src_id|77fe9b69-8805eeee-503d2e17-95342b22_0
2025-10-15T10:58:40.739692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 577 sessionId: src_id|77fe9b69-8805eeee-503d2e17-95342b22_0 is DEAD
2025-10-15T10:58:40.740001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fe9b69-8805eeee-503d2e17-95342b22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:40.740057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fe9b69-8805eeee-503d2e17-95342b22_0] Write session will restart in 0.008543s
2025-10-15T10:58:40.740210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fe9b69-8805eeee-503d2e17-95342b22_0] Write session: Do CDS request
2025-10-15T10:58:40.740249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fe9b69-8805eeee-503d2e17-95342b22_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:40.753471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77fe9b69-8805eeee-503d2e17-95342b22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:40.753449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:40.753487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 578
2025-10-15T10:58:40.754004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:40.754164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:40.754187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:40.754197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:40.757192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 578 sessionId:  describe result for acl check
2025-10-15T10:58:40.757362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:40.757387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:40.757403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:40.757430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401250561527250:7113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:40.760205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401250561527250:7113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:40.768505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401250561527250:7113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:40.780906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401250561527250:7113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:40.780961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401250561527250:7113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:40.780979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401250561527250:7113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:40.781010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:40.785047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:40.795029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:40.795994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:40.796026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:40.796068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:40.796341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:40.796530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401253361220340:6426]
2025-10-15T10:58:40.798660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:40.799766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:40.800016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:40.801228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:40.801570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.801590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.801597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.801604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.801612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.801619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.801627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.801635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.801643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.801650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.801658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.801666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.801673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.801680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.801730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.801841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.801888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.801935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.801980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.802026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.802069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.802112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.802166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.802219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.802268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.802318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.802377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.802421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.802470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.802542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:40.802606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.802667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:40.802722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.802780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:40.802830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.802888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:40.802943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.803002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:40.803050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.803108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:40.803159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.803218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:40.803269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.803325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:40.803478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.803552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:40.803606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.803664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:40.803719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.803778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:40.803830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.803902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.803964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.804024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.804070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.804127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.804640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:40.820998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:40.822629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401250561527381:6486]
2025-10-15T10:58:40.831695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:40.831745Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:40.831759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:40.831777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:40.831799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 577 [2:7561401253361220340:6426]
2025-10-15T10:58:40.831845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:40.831899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:40.831915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:40.831927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:40.831937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:40.831981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:40.832001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:40.832021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:40.833054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.833084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.833099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.833110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:40.833375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:40.833401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:40.833553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:40.833739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:40.834199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:40.834291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401250561527373:7113], now have 1 active actors on pipe
2025-10-15T10:58:40.834321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401250561527224:2467], now have 1 active actors on pipe
2025-10-15T10:58:40.834340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401250561527381:6486], now have 1 active actors on pipe
2025-10-15T10:58:40.834363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401253361220331:6426]
2025-10-15T10:58:40.834378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401253361220331:6426]
2025-10-15T10:58:40.834390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401253361220331:6426]
2025-10-15T10:58:40.834430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:40.834510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:40.834567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:40.834596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:40.834475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 577
2025-10-15T10:58:40.834608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:40.834479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 577
2025-10-15T10:58:40.834568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 577, pipe: [1:7561401250561527381:6486]
2025-10-15T10:58:40.834695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:40.834728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:40.834852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401253361220331:6426]
2025-10-15T10:58:40.834892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:40.834918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:40.835577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:40.835612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:40.835695Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:40.835724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:40.835740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:40.835751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:40.835784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:40.835820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:40.835864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:40.836797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 578 partition: 0 MaxSeqNo: 46 sessionId: src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0
2025-10-15T10:58:40.836393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:40.836421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:40.836479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:40.837577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77fe9b69-8805eeee-503d2e17-95342b22_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:40.866483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0] Write session: try to update token
2025-10-15T10:58:40.866536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:40.927625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:40.927662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:40.927675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:40.927685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:40.927714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401253361220331:6426]
2025-10-15T10:58:40.927746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401253361220331:6426]
2025-10-15T10:58:40.927768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401253361220331:6426]
2025-10-15T10:58:40.927863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:40.927902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:40.927928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:40.927937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:40.927956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:40.929177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:40.983896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId: src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:41.004187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:41.074810Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:41.095627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:41.095676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:41.095729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:41.095742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:41.095780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401253361220331:6426]
2025-10-15T10:58:41.096881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:41.097478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:41.098300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:41.098324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:41.098460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401250561527381:6486]
2025-10-15T10:58:41.132513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 578 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0
2025-10-15T10:58:41.132809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 578 sessionId: src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0 is DEAD
2025-10-15T10:58:41.135630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:41.135689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0] Write session will restart in 0.006366s
2025-10-15T10:58:41.135842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0] Write session: Do CDS request
2025-10-15T10:58:41.135889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:41.152579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:41.152615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 579
2025-10-15T10:58:41.152824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:41.153616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:41.153751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:41.153776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:41.153785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:41.155139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 579 sessionId:  describe result for acl check
2025-10-15T10:58:41.155251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:41.155267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:41.155276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:41.155293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401254856494786:7123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:41.157944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401254856494786:7123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:41.168641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401254856494786:7123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:41.170403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:41.173820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:41.174453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:41.174471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:41.174511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:41.174683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:41.174803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401257656187803:6434]
2025-10-15T10:58:41.177040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:41.177699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401254856494786:7123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:41.177744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401254856494786:7123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:41.177761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401254856494786:7123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:41.177792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:41.179621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:41.179876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:41.180786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:41.181082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:41.181087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:41.181092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:41.181097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:41.181101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:41.181106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:41.181111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:41.181116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:41.181120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:41.181124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:41.181129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:41.181133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.181138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.181142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.181179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:41.181261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:41.181306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:41.181342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:41.181375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:41.181412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:41.181446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:41.181482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:41.181531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:41.181563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:41.181597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:41.181629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.181661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.181695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.181723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:41.181772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:41.181814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:41.181850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:41.181884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:41.181923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:41.181955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:41.181992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:41.182024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:41.182063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:41.182104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:41.182145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:41.182177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:41.182214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:41.182246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:41.182284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:41.182315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:41.182352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:41.182384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:41.182430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:41.182470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:41.182510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:41.182542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.182581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.182613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.182652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.182683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.182720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.183081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:41.197557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401254856494864:6486]
2025-10-15T10:58:41.207718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:41.217651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:41.217695Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:41.217714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:41.217733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:41.217757Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 578 [2:7561401257656187803:6434]
2025-10-15T10:58:41.217805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:41.217861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:41.217875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:41.217887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:41.217898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:41.217949Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:41.217973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:41.217995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:41.219910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.219943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.219957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.219970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:41.220246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:41.220272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.220411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.220598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.220823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:41.221577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 578, pipe: [1:7561401254856494864:6486]
2025-10-15T10:58:41.220918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401254856494864:6486], now have 1 active actors on pipe
2025-10-15T10:58:41.220943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401254856494858:7123], now have 1 active actors on pipe
2025-10-15T10:58:41.220964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401254856494699:2467], now have 1 active actors on pipe
2025-10-15T10:58:41.221701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 578
2025-10-15T10:58:41.220988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401257656187798:6434]
2025-10-15T10:58:41.221004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401257656187798:6434]
2025-10-15T10:58:41.221015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401257656187798:6434]
2025-10-15T10:58:41.221050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:41.221773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 578
2025-10-15T10:58:41.221123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:41.221306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:41.221323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:41.221441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401257656187798:6434]
2025-10-15T10:58:41.221459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:41.222446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:41.222469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:41.222480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:41.222505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:41.222887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:41.222916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:41.223016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54900e49-e877d73a-e592b3a4-7dec8607_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:41.223051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:41.223068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:41.223079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:41.223118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:41.223162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:41.223214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:41.227299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:41.227331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:41.227417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:41.227777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 579 partition: 0 MaxSeqNo: 46 sessionId: src_id|54900e49-e877d73a-e592b3a4-7dec8607_0
2025-10-15T10:58:41.228612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19727cc-b358c23b-f07facf8-b8f5e600_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|54900e49-e877d73a-e592b3a4-7dec8607_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:41.249009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54900e49-e877d73a-e592b3a4-7dec8607_0] Write session: try to update token
2025-10-15T10:58:41.249060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54900e49-e877d73a-e592b3a4-7dec8607_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:41.367461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId: src_id|54900e49-e877d73a-e592b3a4-7dec8607_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:41.397253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:41.397298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:41.397314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:41.397326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:41.397365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401257656187798:6434]
2025-10-15T10:58:41.397394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401257656187798:6434]
2025-10-15T10:58:41.397422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401257656187798:6434]
2025-10-15T10:58:41.397572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:41.397576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:41.397585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:41.397594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:41.397625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:41.397658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:41.397681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:41.397697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:41.398528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:41.412741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:41.543073Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:41.567016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:41.567081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:41.567158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:41.567174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:41.567220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401257656187798:6434]
2025-10-15T10:58:41.567607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:41.568528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:41.567958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401254856494864:6486]
2025-10-15T10:58:41.567966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:41.567989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:41.568051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:41.578731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54900e49-e877d73a-e592b3a4-7dec8607_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:41.578810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54900e49-e877d73a-e592b3a4-7dec8607_0] Write session will restart in 0.009182s
2025-10-15T10:58:41.578963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54900e49-e877d73a-e592b3a4-7dec8607_0] Write session: Do CDS request
2025-10-15T10:58:41.579007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54900e49-e877d73a-e592b3a4-7dec8607_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:41.577887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 579 reason: error at write: Disconnected sessionId: src_id|54900e49-e877d73a-e592b3a4-7dec8607_0
2025-10-15T10:58:41.578245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 579 sessionId: src_id|54900e49-e877d73a-e592b3a4-7dec8607_0 is DEAD
2025-10-15T10:58:41.599852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:41.599888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 580
2025-10-15T10:58:41.600100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54900e49-e877d73a-e592b3a4-7dec8607_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:41.600551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:41.600683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:41.600703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:41.600712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:41.601949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 580 sessionId:  describe result for acl check
2025-10-15T10:58:41.602043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:41.602057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:41.602066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:41.602082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401254856494918:7132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:41.604435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401254856494918:7132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:41.612219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401254856494918:7132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:41.624916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401254856494918:7132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:41.624958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401254856494918:7132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:41.624973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401254856494918:7132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:41.625000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:41.641107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:41.642875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:41.643689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:41.643732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:41.643777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:41.644020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:41.644206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401257656188002:6444]
2025-10-15T10:58:41.646337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:41.647276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:41.647520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:41.648823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:41.649174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:41.649201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:41.649208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:41.649216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:41.649223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:41.649230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:41.649237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:41.649243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:41.649250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:41.649258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:41.649265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:41.649272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.649280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.649287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.649338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:41.649457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:41.649506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:41.649582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:41.649631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:41.649684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:41.649733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:41.649780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:41.649828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:41.649886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:41.649938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:41.649983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.650039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.650086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.650139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:41.650212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:41.650275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:41.650333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:41.650384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:41.650439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:41.650485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:41.650541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:41.650592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:41.650646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:41.650691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:41.650746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:41.650795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:41.650848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:41.650893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:41.650950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:41.651000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:41.651057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:41.651105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:41.651161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:41.651209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:41.651259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:41.651303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.651378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.651427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.651483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.651528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.651582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.652110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:41.671497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401254856495055:6486]
2025-10-15T10:58:41.674937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:41.687529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:41.687584Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:41.687604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:41.687625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:41.687651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 579 [2:7561401257656188002:6444]
2025-10-15T10:58:41.687709Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:41.687775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:41.687790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:41.687805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:41.687818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:41.687870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:41.687909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:41.687933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:41.722129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 579
2025-10-15T10:58:41.722264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 579
2025-10-15T10:58:41.722318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 579, pipe: [1:7561401254856495055:6486]
2025-10-15T10:58:41.720738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.720775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.720789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.720808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:41.721135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:41.721163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:41.721306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:41.721473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:41.721689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:41.721768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401254856494901:2467], now have 1 active actors on pipe
2025-10-15T10:58:41.721787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401254856495046:7132], now have 1 active actors on pipe
2025-10-15T10:58:41.721806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401254856495055:6486], now have 1 active actors on pipe
2025-10-15T10:58:41.721830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401257656187997:6444]
2025-10-15T10:58:41.721843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401257656187997:6444]
2025-10-15T10:58:41.721855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401257656187997:6444]
2025-10-15T10:58:41.721889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:41.721924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:41.721938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:41.721940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:41.721950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:41.722076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:41.722091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:41.722190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401257656187997:6444]
2025-10-15T10:58:41.722202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:41.722212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:41.722420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:41.722444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:41.722515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:41.722550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:41.722568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:41.722589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:41.722629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:41.722681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:41.722728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:41.723704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:41.723734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:41.723799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:41.725279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 580 partition: 0 MaxSeqNo: 46 sessionId: src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0
2025-10-15T10:58:41.726061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54900e49-e877d73a-e592b3a4-7dec8607_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:41.747205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0] Write session: try to update token
2025-10-15T10:58:41.747260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:41.755244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:41.755277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:41.755308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401257656187997:6444]
2025-10-15T10:58:41.755427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:41.755450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:41.757420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:41.758837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:41.760326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:41.761705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:41.763416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:41.763907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:41.815402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:41.815432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:41.815446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:41.815504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:41.815520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:41.815533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:41.815544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:41.815588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401257656187997:6444]
2025-10-15T10:58:41.815615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401257656187997:6444]
2025-10-15T10:58:41.815642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401257656187997:6444]
2025-10-15T10:58:41.815757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:41.815766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:41.815787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:41.815798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:41.815830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:41.818243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:41.848623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId: src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:41.870901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:41.969851Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:41.971413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:41.971446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:41.972603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:41.972767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:41.972784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:41.972484Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:41.975508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401254856495055:6486]
2025-10-15T10:58:42.028901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 580 reason: error at write: Disconnected sessionId: src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0
2025-10-15T10:58:42.029263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 580 sessionId: src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0 is DEAD
2025-10-15T10:58:42.034395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:42.034433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0] Write session will restart in 0.007904s
2025-10-15T10:58:42.034526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0] Write session: Do CDS request
2025-10-15T10:58:42.034552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:42.040823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:42.047510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:42.048306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:42.048330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:42.048364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:42.048553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:42.048701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401261951155458:6447]
2025-10-15T10:58:42.049702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:42.050275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:42.051590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:42.051616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 581
2025-10-15T10:58:42.051878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:42.052005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:42.052028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:42.052037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:42.052187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:42.052419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:42.053384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 581 sessionId:  describe result for acl check
2025-10-15T10:58:42.053494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:42.053511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:42.053533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:42.053550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401259151462497:7136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:42.053605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:42.053871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:42.053876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:42.053882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:42.053886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:42.053891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:42.053896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:42.053902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:42.053906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:42.053912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:42.053916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:42.053921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:42.053925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.053930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.053935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.053969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:42.054056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:42.054093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:42.054127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:42.054159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:42.056212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401259151462497:7136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:42.054197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:42.054238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:42.054273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:42.054308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:42.054343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:42.054390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:42.054433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.054466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.054499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.054527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:42.054574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:42.054613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:42.054653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:42.054686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:42.054723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:42.054755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:42.054793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:42.054825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:42.054860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:42.054893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:42.054944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:42.054975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:42.055011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:42.055041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:42.055080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:42.055111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:42.055150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:42.055181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:42.055218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:42.055250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:42.055287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:42.055318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.055382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.055429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.055482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.055522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.055562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.055939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:42.062044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401259151462497:7136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:42.069451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401259151462497:7136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:42.069495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401259151462497:7136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:42.069514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401259151462497:7136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:42.069558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:42.075313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:42.075514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401259151462526:6486]
2025-10-15T10:58:42.084466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:42.084516Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:42.084535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:42.084554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:42.084581Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 580 [2:7561401261951155458:6447]
2025-10-15T10:58:42.084638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:42.084696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:42.084711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:42.084723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:42.084735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:42.084785Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:42.084808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:42.084833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:42.086482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.086512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.086526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.086538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:42.086804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:42.086829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.086974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.087178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.087197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 580, pipe: [1:7561401259151462526:6486]
2025-10-15T10:58:42.087317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 580
2025-10-15T10:58:42.087433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 580
2025-10-15T10:58:42.087442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:42.087533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401254856495070:2467], now have 1 active actors on pipe
2025-10-15T10:58:42.087556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401259151462526:6486], now have 1 active actors on pipe
2025-10-15T10:58:42.087579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401259151462524:7136], now have 1 active actors on pipe
2025-10-15T10:58:42.087604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401261951155453:6447]
2025-10-15T10:58:42.087619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401261951155453:6447]
2025-10-15T10:58:42.087633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401261951155453:6447]
2025-10-15T10:58:42.087672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:42.087747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:42.087856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:42.087883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:42.087896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:42.087946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:42.087969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:42.088037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:42.088064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:42.088187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401261951155453:6447]
2025-10-15T10:58:42.088217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:42.088244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:42.088290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:42.088328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:42.088349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:42.088360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:42.088397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:42.088440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:42.088564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:42.089017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:42.089051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:42.089132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:42.089681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 581 partition: 0 MaxSeqNo: 46 sessionId: src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0
2025-10-15T10:58:42.090494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a422f93d-6e4aab84-4bd72b6e-a39337f0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:42.110693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0] Write session: try to update token
2025-10-15T10:58:42.110735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:42.177737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:42.177776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:42.177815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401261951155453:6447]
2025-10-15T10:58:42.177949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:42.178062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:42.181791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:42.185796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:42.187433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:42.190256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:42.194730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:42.195414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:42.195449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:42.195469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:42.195577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:42.271631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId: src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:42.301497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:42.301543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:42.301553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:42.301561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:42.301590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401261951155453:6447]
2025-10-15T10:58:42.301609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401261951155453:6447]
2025-10-15T10:58:42.301623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401261951155453:6447]
2025-10-15T10:58:42.301748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:42.301756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:42.301763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:42.301800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:42.301816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:42.302578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:42.303460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:42.303501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:42.303529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:42.311618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:42.448797Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:42.451948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:42.451998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:42.452535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:42.452687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401259151462526:6486]
2025-10-15T10:58:42.452770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:42.452787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:42.452725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:42.481220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 581 reason: error at write: Disconnected sessionId: src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0
2025-10-15T10:58:42.481590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 581 sessionId: src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0 is DEAD
2025-10-15T10:58:42.487817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:42.487879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0] Write session will restart in 0.006122s
2025-10-15T10:58:42.488038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0] Write session: Do CDS request
2025-10-15T10:58:42.488082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:42.502258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:42.504504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:42.504541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 582
2025-10-15T10:58:42.507570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:42.507715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:42.507731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:42.507743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:42.512651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 582 sessionId:  describe result for acl check
2025-10-15T10:58:42.512772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:42.512783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:42.512792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:42.512807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401259151462565:7141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:42.518852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401259151462565:7141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:42.532082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401259151462565:7141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:42.551024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401259151462565:7141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:42.551067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401259151462565:7141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:42.551083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401259151462565:7141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:42.551112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:42.554571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401259151462680:6486]
2025-10-15T10:58:42.597503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:42.599475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:42.600284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:42.600320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:42.600363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:42.600596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:42.600808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401261951155637:6456]
2025-10-15T10:58:42.602936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:42.604076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:42.604332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:42.605464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:42.605818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:42.605826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:42.605833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:42.605839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:42.605845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:42.605852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:42.605858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:42.605865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:42.605872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:42.605879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:42.605887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:42.605894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.605901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.605908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.605950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:42.606047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:42.606091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:42.606137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:42.606178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:42.606220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:42.606263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:42.606305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:42.606346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:42.606387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:42.606428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:42.606470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.607127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.607187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.607232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:42.607297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:42.607390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:42.607453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:42.607501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:42.607552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:42.607594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:42.607643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:42.607686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:42.607733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:42.607775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:42.607824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:42.607869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:42.607920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:42.607963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:42.608013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:42.608056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:42.608105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:42.608147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:42.608197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:42.608239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:42.608284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:42.608327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.608376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.608438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.608490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.608532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.608581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.609035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:42.630930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:42.643994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:42.644033Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:42.644041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:42.644052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:42.644067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 581 [2:7561401261951155637:6456]
2025-10-15T10:58:42.644097Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:42.644135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:42.644144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:42.644152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:42.644159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:42.644189Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:42.644201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:42.644216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:42.659746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.659778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.659789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.659799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:42.660161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:42.660190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:42.660365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:42.660670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:42.660894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:42.660963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401261951155632:6456]
2025-10-15T10:58:42.660977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401261951155632:6456]
2025-10-15T10:58:42.660989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401261951155632:6456]
2025-10-15T10:58:42.661020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:42.661068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:42.661081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:42.661093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:42.661105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:42.661261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:42.661274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:42.661341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401259151462669:7141], now have 1 active actors on pipe
2025-10-15T10:58:42.661382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401259151462548:2467], now have 1 active actors on pipe
2025-10-15T10:58:42.661424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401259151462680:6486], now have 1 active actors on pipe
2025-10-15T10:58:42.661607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401261951155632:6456]
2025-10-15T10:58:42.661657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:42.661720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:42.663594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 581
2025-10-15T10:58:42.663753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 581
2025-10-15T10:58:42.663844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 581, pipe: [1:7561401259151462680:6486]
2025-10-15T10:58:42.665061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:42.665122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:42.665264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:42.665314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:42.665334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:42.665344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:42.665374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:42.665411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:42.665455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:42.666568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:42.666603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:42.666664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:42.667252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 582 partition: 0 MaxSeqNo: 46 sessionId: src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0
2025-10-15T10:58:42.668046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd0ec40c-fb10c74-85b871a9-f19fecae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:42.705226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0] Write session: try to update token
2025-10-15T10:58:42.705288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:42.745593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:42.745626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:42.745639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:42.792798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:42.792835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:42.792847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:42.792859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:42.792893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401261951155632:6456]
2025-10-15T10:58:42.792919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401261951155632:6456]
2025-10-15T10:58:42.792944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401261951155632:6456]
2025-10-15T10:58:42.793082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:42.793109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:42.794634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:42.795856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:42.795880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:42.795901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:42.831554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId: src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:42.882675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:42.947035Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:42.948977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:42.949020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:42.953397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:42.953697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:42.953735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:42.991129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:42.991419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401259151462680:6486]
2025-10-15T10:58:42.993747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 582 reason: error at write: Disconnected sessionId: src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0
2025-10-15T10:58:42.994130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 582 sessionId: src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0 is DEAD
2025-10-15T10:58:42.999244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:42.999274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0] Write session will restart in 0.009589s
2025-10-15T10:58:42.999362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0] Write session: Do CDS request
2025-10-15T10:58:42.999398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:43.014889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:43.015641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:43.015680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 583
2025-10-15T10:58:43.016125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:43.016268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:43.016301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:43.016310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:43.017829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 583 sessionId:  describe result for acl check
2025-10-15T10:58:43.017925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:43.017935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:43.017945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:43.017960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401263446430159:7155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:43.020490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401263446430159:7155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:43.026425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401263446430159:7155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:43.031724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:43.036487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:43.037161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401263446430159:7155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:43.037209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401263446430159:7155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:43.037225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401263446430159:7155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:43.037254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:43.037344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:43.037376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:43.037416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:43.037685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:43.037872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401266246123129:6464]
2025-10-15T10:58:43.040446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:43.041675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:43.041921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:43.043271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:43.043619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.043641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.043648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.043657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.043666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.043673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.043680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.043688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.043696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.043704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.043713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.043720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.043728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.043735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.043788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.043911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.043968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.044022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.044073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.044128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.044193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.044244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.044295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.044345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.044392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.044454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.044506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.044555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.044603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.044674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.044736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.044797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.044849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.044908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.044957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.045014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.045066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.045127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.045178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.045236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.045290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.045345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.045395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.045452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.045505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.045575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.045626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.045685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.045734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.045788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.045837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.045897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.045950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.046006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.046053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.046107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.046647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:43.083572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:43.091919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401263446430207:6486]
2025-10-15T10:58:43.094695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:43.094751Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:43.094771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:43.094791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:43.094820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 582 [2:7561401266246123129:6464]
2025-10-15T10:58:43.094876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:43.094944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:43.094962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:43.094975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:43.094987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:43.095044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:43.095069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:43.095094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:43.096633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.096664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.096678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.096692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:43.096977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:43.096996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.097132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.097265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.097417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:43.099122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 582
2025-10-15T10:58:43.099149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 582
2025-10-15T10:58:43.099201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 582, pipe: [1:7561401263446430207:6486]
2025-10-15T10:58:43.097468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401266246123124:6464]
2025-10-15T10:58:43.097487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401266246123124:6464]
2025-10-15T10:58:43.097497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401266246123124:6464]
2025-10-15T10:58:43.097524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:43.097589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:43.097729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:43.097741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:43.097832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401266246123124:6464]
2025-10-15T10:58:43.097844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:43.098036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:43.098044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:43.098052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:43.098067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:43.098738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401263446430198:7155], now have 1 active actors on pipe
2025-10-15T10:58:43.098756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401259151462770:2467], now have 1 active actors on pipe
2025-10-15T10:58:43.098771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401263446430207:6486], now have 1 active actors on pipe
2025-10-15T10:58:43.099307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:43.099325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:43.099411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:43.099446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:43.099465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:43.099476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:43.099515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:43.099561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:43.099627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:43.100369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:43.100392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:43.100467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:43.100840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 583 partition: 0 MaxSeqNo: 46 sessionId: src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0
2025-10-15T10:58:43.103578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95771563-b61b5912-d1d46a5d-c329c6e1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:43.130294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0] Write session: try to update token
2025-10-15T10:58:43.130359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:43.223082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId: src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:43.251059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:43.261581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:43.261624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:43.261636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:43.261646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:43.261681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401266246123124:6464]
2025-10-15T10:58:43.261705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401266246123124:6464]
2025-10-15T10:58:43.261727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401266246123124:6464]
2025-10-15T10:58:43.261901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:43.261923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:43.261933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:43.262362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:43.262406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:43.262434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:43.262594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:43.262630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:43.262675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:43.262697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:43.263639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:43.414026Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:43.423937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:43.423979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:43.424030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401266246123124:6464]
2025-10-15T10:58:43.424203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:43.424763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:43.424778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:43.424789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:43.424811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:43.424987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401263446430207:6486]
2025-10-15T10:58:43.460041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 583 reason: error at write: Disconnected sessionId: src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0
2025-10-15T10:58:43.460731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:43.460770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0] Write session will restart in 0.005792s
2025-10-15T10:58:43.460386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 583 sessionId: src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0 is DEAD
2025-10-15T10:58:43.460887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0] Write session: Do CDS request
2025-10-15T10:58:43.460925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:43.472535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:43.472413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:43.472445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 584
2025-10-15T10:58:43.472995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:43.473101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:43.473111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:43.473119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:43.474259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 584 sessionId:  describe result for acl check
2025-10-15T10:58:43.474359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:43.474369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:43.474378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:43.474396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401263446430290:7160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:43.476919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401263446430290:7160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:43.484343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401263446430290:7160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:43.493606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:43.497611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401263446430290:7160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:43.497659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401263446430290:7160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:43.497678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401263446430290:7160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:43.497710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:43.501043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:43.501944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:43.501978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:43.502022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:43.502286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:43.502486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401266246123297:6468]
2025-10-15T10:58:43.504847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:43.505888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:43.506125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:43.507512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:43.507855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.507877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.507886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.507893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.507900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.507908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.507917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.507925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.507932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.507939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.507947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.507954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.507961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.507968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.508020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.508138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.508192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.508245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.508298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.508359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.508410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.508471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.508529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.508587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.508647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.508701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.508754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.508809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.508862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.508942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.509013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.509081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.509134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.509196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.509246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.509311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.509371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.509435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.509491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.509569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.509626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.509688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.509745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.509804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.509863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.509924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.509976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.510038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.510095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.510159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.510218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.510277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.510335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.510396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.510451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.510513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.511065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:43.524475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401263446430393:6486]
2025-10-15T10:58:43.527621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:43.548897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:43.548957Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:43.548977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:43.548997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:43.549024Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 583 [2:7561401266246123297:6468]
2025-10-15T10:58:43.549075Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:43.549141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:43.549162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:43.549175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:43.549186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:43.549238Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:43.549268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:43.549293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:43.550400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.550428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.550444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.550456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:43.550741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:43.550771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.550919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.551127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.551430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:43.551560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401263446430393:6486], now have 1 active actors on pipe
2025-10-15T10:58:43.551595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401263446430386:7160], now have 1 active actors on pipe
2025-10-15T10:58:43.551619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401263446430217:2467], now have 1 active actors on pipe
2025-10-15T10:58:43.551652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401266246123291:6468]
2025-10-15T10:58:43.551671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401266246123291:6468]
2025-10-15T10:58:43.551684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401266246123291:6468]
2025-10-15T10:58:43.551723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:43.551775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:43.551790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:43.551806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:43.551811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:43.552005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:43.552022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:43.552180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:43.552216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:43.552265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401266246123291:6468]
2025-10-15T10:58:43.552295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:43.552386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:43.552413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:43.552448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:43.552475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:43.552486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:43.552525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:43.552571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:43.552667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:43.551481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 583, pipe: [1:7561401263446430393:6486]
2025-10-15T10:58:43.551598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 583
2025-10-15T10:58:43.551621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 583
2025-10-15T10:58:43.553570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:43.553618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:43.553701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:43.553996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 584 partition: 0 MaxSeqNo: 46 sessionId: src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0
2025-10-15T10:58:43.554757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e200b8dc-e4c173cd-4002f7a9-44833d4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:43.579404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0] Write session: try to update token
2025-10-15T10:58:43.579474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:43.649425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:43.649474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:43.649485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:43.649492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:43.649524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401266246123291:6468]
2025-10-15T10:58:43.649557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401266246123291:6468]
2025-10-15T10:58:43.649578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401266246123291:6468]
2025-10-15T10:58:43.649720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:43.649782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:43.649800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:43.649808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:43.649812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:43.649821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:43.649865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:43.649884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:43.652025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:43.672971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId: src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:43.694810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:43.799530Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:43.810973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:43.811019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:43.811080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:43.811095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:43.811138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401266246123291:6468]
2025-10-15T10:58:43.811324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:43.811731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:43.811678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:43.811706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:43.811717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401263446430393:6486]
2025-10-15T10:58:43.811837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:43.821364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 584 reason: error at write: Disconnected sessionId: src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0
2025-10-15T10:58:43.821757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 584 sessionId: src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0 is DEAD
2025-10-15T10:58:43.822554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:43.822600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0] Write session will restart in 0.005919s
2025-10-15T10:58:43.822786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0] Write session: Do CDS request
2025-10-15T10:58:43.822839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:43.836731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:43.836799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 585
2025-10-15T10:58:43.836983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:43.837577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:43.837705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:43.837730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:43.837740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:43.839328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 585 sessionId:  describe result for acl check
2025-10-15T10:58:43.839488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:43.839531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:43.839549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:43.839580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401263446430420:7165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:43.842512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401263446430420:7165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:43.848820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401263446430420:7165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:43.860881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401263446430420:7165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:43.860929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401263446430420:7165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:43.860947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401263446430420:7165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:43.860975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:43.911951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:43.912023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401263446430564:6486]
2025-10-15T10:58:43.914038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:43.914957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:43.914986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:43.915029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:43.915276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:43.915487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401266246123489:6478]
2025-10-15T10:58:43.917843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:43.919029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:43.919258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:43.920579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:43.920897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.920912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.920920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.920928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.920935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.920941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.920949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.920959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.920966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.920977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.920983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.920991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.920998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.921005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.921053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.921167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.921216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.921274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.921329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.921387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.921443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.921493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.921558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.921618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.921673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.921724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.921780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.921836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.921887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.921963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:43.922030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.922093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:43.922151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.922210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:43.922264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.922321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:43.922379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.922438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:43.922490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.922548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:43.922603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.922662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:43.922711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.922770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:43.922824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.922885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:43.922937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.922999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:43.923053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.923113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:43.923164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.923224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.923278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.923334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.923477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.923541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.924061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:43.940698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:43.951439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:43.951490Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:43.951507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:43.951528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:43.951555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 584 [2:7561401266246123489:6478]
2025-10-15T10:58:43.951610Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:43.951668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:43.951686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:43.951697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:43.951709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:43.951758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:43.951780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:43.951802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:43.953361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.953391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.953405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.953417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:43.953687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:43.953711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:43.954401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 584, pipe: [1:7561401263446430564:6486]
2025-10-15T10:58:43.954501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 584
2025-10-15T10:58:43.954572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 584
2025-10-15T10:58:43.953856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:43.954056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:43.954285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:43.954365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401263446430564:6486], now have 1 active actors on pipe
2025-10-15T10:58:43.954389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401263446430405:2467], now have 1 active actors on pipe
2025-10-15T10:58:43.954413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401263446430452:7165], now have 1 active actors on pipe
2025-10-15T10:58:43.954438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401266246123483:6478]
2025-10-15T10:58:43.954455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401266246123483:6478]
2025-10-15T10:58:43.954469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401266246123483:6478]
2025-10-15T10:58:43.954506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:43.954550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:43.954567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:43.954578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:43.954583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:43.954766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:43.954784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:43.954899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401266246123483:6478]
2025-10-15T10:58:43.954918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:43.954938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:43.955038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:43.955059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:43.955163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ebb26c5-261db497-b324b009-55f83a70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:43.955192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:43.955212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:43.955224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:43.955262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:43.955302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:43.955987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:43.957160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:43.957189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:43.957255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:43.958352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfb211e5-e99b99d-b5ae05cb-482e51ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2ebb26c5-261db497-b324b009-55f83a70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:43.957571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 585 partition: 0 MaxSeqNo: 46 sessionId: src_id|2ebb26c5-261db497-b324b009-55f83a70_0
2025-10-15T10:58:43.981941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ebb26c5-261db497-b324b009-55f83a70_0] Write session: try to update token
2025-10-15T10:58:43.981998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ebb26c5-261db497-b324b009-55f83a70_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:44.057159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:44.057202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:44.057216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:44.057228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:44.057263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401266246123483:6478]
2025-10-15T10:58:44.057291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401266246123483:6478]
2025-10-15T10:58:44.057316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401266246123483:6478]
2025-10-15T10:58:44.057524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:44.057558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:44.057572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:44.057584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:44.057584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:44.057615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:44.057632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:44.057655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:44.058599Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:44.084367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId: src_id|2ebb26c5-261db497-b324b009-55f83a70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:44.104262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:44.206057Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:44.223502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:44.223560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:44.223633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:44.223650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:44.223692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401266246123483:6478]
2025-10-15T10:58:44.223877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:44.224296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:44.224193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:44.224224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:44.236320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401263446430564:6486]
2025-10-15T10:58:44.236399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:44.236514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 585 reason: error at write: Disconnected sessionId: src_id|2ebb26c5-261db497-b324b009-55f83a70_0
2025-10-15T10:58:44.236759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 585 sessionId: src_id|2ebb26c5-261db497-b324b009-55f83a70_0 is DEAD
2025-10-15T10:58:44.237923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ebb26c5-261db497-b324b009-55f83a70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:44.237989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ebb26c5-261db497-b324b009-55f83a70_0] Write session will restart in 0.006654s
2025-10-15T10:58:44.238171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ebb26c5-261db497-b324b009-55f83a70_0] Write session: Do CDS request
2025-10-15T10:58:44.238226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ebb26c5-261db497-b324b009-55f83a70_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:44.250318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ebb26c5-261db497-b324b009-55f83a70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:44.270951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:44.270989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 586
2025-10-15T10:58:44.276557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:44.276723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:44.276748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:44.276759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:44.280692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 586 sessionId:  describe result for acl check
2025-10-15T10:58:44.280819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:44.280830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:44.280841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:44.280860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401267741397952:7177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:44.284724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401267741397952:7177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:44.292465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401267741397952:7177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:44.303689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401267741397952:7177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:44.303742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401267741397952:7177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:44.303759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401267741397952:7177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:44.303792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:44.312974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:44.314769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:44.315556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:44.315598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:44.315639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:44.315872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:44.316066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401270541090968:6485]
2025-10-15T10:58:44.318305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:44.319091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:44.319301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:44.320442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:44.320689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:44.320703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:44.320708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:44.320713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:44.320718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:44.320723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:44.320728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:44.320733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:44.320738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:44.320742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:44.320749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:44.320756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.320763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.320771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.320830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:44.320937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:44.320974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:44.321010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:44.321044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:44.321079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:44.321114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:44.321158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:44.321192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:44.321228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:44.321263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:44.321314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.321349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.321396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.321434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:44.321488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:44.321528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:44.321590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:44.321628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:44.321678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:44.321713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:44.321756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:44.321806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:44.321843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:44.321879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:44.321935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:44.321974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:44.322016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:44.322051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:44.322094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:44.322131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:44.322180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:44.322215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:44.322258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:44.322303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:44.322353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:44.322386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.322439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.322477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.322517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.322552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.322590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.323001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:44.336506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401267741398060:6486]
2025-10-15T10:58:44.341222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:44.357047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:44.357088Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:44.357102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:44.357117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:44.357137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 585 [2:7561401270541090968:6485]
2025-10-15T10:58:44.357183Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:44.357228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:44.357241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:44.357251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:44.357260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:44.357302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:44.357320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:44.357339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:44.358901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.358926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.358939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.358949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:44.359195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:44.359218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.359342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.359571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.359535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 585, pipe: [1:7561401267741398060:6486]
2025-10-15T10:58:44.359663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 585
2025-10-15T10:58:44.359765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 585
2025-10-15T10:58:44.359794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:44.359877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401267741398060:6486], now have 1 active actors on pipe
2025-10-15T10:58:44.359901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401267741397899:2467], now have 1 active actors on pipe
2025-10-15T10:58:44.359921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401267741398051:7177], now have 1 active actors on pipe
2025-10-15T10:58:44.359944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401270541090963:6485]
2025-10-15T10:58:44.359957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401270541090963:6485]
2025-10-15T10:58:44.359968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401270541090963:6485]
2025-10-15T10:58:44.360007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:44.360069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:44.360130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:44.360146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:44.360157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:44.360230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:44.360247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:44.360399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:44.360417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:44.360446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401270541090963:6485]
2025-10-15T10:58:44.360474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:44.360491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:44.360573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|249fa811-fa510da4-7e00848b-7de7e88b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:44.360600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:44.360615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:44.360624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:44.360654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:44.360685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:44.360757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:44.361634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:44.361658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:44.361718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:44.362056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 586 partition: 0 MaxSeqNo: 46 sessionId: src_id|249fa811-fa510da4-7e00848b-7de7e88b_0
2025-10-15T10:58:44.363563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ebb26c5-261db497-b324b009-55f83a70_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|249fa811-fa510da4-7e00848b-7de7e88b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:44.408311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249fa811-fa510da4-7e00848b-7de7e88b_0] Write session: try to update token
2025-10-15T10:58:44.408378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249fa811-fa510da4-7e00848b-7de7e88b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:44.481157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:44.481194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:44.481208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:44.481265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:44.481280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:44.481293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:44.481310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:44.481350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401270541090963:6485]
2025-10-15T10:58:44.481376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401270541090963:6485]
2025-10-15T10:58:44.481410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401270541090963:6485]
2025-10-15T10:58:44.481600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:44.481602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:44.481622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:44.481663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:44.481698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:44.485888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:44.540699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId: src_id|249fa811-fa510da4-7e00848b-7de7e88b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:44.561420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:44.626922Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:44.635257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:44.635292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:44.639268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:44.636099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:44.636142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:44.636403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401267741398060:6486]
2025-10-15T10:58:44.636525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:44.678319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 586 reason: error at write: Disconnected sessionId: src_id|249fa811-fa510da4-7e00848b-7de7e88b_0
2025-10-15T10:58:44.678611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 586 sessionId: src_id|249fa811-fa510da4-7e00848b-7de7e88b_0 is DEAD
2025-10-15T10:58:44.678963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249fa811-fa510da4-7e00848b-7de7e88b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:44.679025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249fa811-fa510da4-7e00848b-7de7e88b_0] Write session will restart in 0.005248s
2025-10-15T10:58:44.679172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249fa811-fa510da4-7e00848b-7de7e88b_0] Write session: Do CDS request
2025-10-15T10:58:44.679230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249fa811-fa510da4-7e00848b-7de7e88b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:44.690867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249fa811-fa510da4-7e00848b-7de7e88b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:44.690702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:44.690732Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 587
2025-10-15T10:58:44.691416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:44.691522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:44.691535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:44.691543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:44.692862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 587 sessionId:  describe result for acl check
2025-10-15T10:58:44.692960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:44.692970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:44.692979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:44.692994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401267741398167:7186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:44.695883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401267741398167:7186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:44.703882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401267741398167:7186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:44.712346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401267741398167:7186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:44.712389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401267741398167:7186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:44.712404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401267741398167:7186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:44.712429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:44.721349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:44.722847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:44.723547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:44.723573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:44.723611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:44.723822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:44.723994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401270541091155:6490]
2025-10-15T10:58:44.726025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:44.726801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:44.726977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:44.728132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:44.728451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:44.728465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:44.728473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:44.728479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:44.728485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:44.728492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:44.728499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:44.728506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:44.728513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:44.728519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:44.728526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:44.728532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.728537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.728545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.728588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:44.728690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:44.728738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:44.728781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:44.728824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:44.728876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:44.728921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:44.728967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:44.729016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:44.729065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:44.729116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:44.729157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.729202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.729246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.729291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:44.729354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:44.729413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:44.729467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:44.729520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:44.729589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:44.729636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:44.729686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:44.729730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:44.729780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:44.729824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:44.729873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:44.729917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:44.729968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:44.730011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:44.730059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:44.730102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:44.730152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:44.730190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:44.730237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:44.730279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:44.730327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:44.730368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.730414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.730457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.730507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.730548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.730597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.731058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:44.735321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401267741398262:6486]
2025-10-15T10:58:44.745738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:44.754314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:44.754356Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:44.754372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:44.754390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:44.754412Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 586 [2:7561401270541091155:6490]
2025-10-15T10:58:44.754458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:44.754512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:44.754526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:44.754535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:44.754543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:44.754576Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:44.754589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:44.754604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:44.755342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.755376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.755387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.755394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:44.755655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:44.755674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:44.755798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:44.755858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 586
2025-10-15T10:58:44.755935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 586, pipe: [1:7561401267741398262:6486]
2025-10-15T10:58:44.755960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:44.756020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 586
2025-10-15T10:58:44.756142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:44.756194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401267741398254:7186], now have 1 active actors on pipe
2025-10-15T10:58:44.756211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401267741398262:6486], now have 1 active actors on pipe
2025-10-15T10:58:44.756224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401267741398096:2467], now have 1 active actors on pipe
2025-10-15T10:58:44.756254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:44.756271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:44.756295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401270541091150:6490]
2025-10-15T10:58:44.756302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401270541091150:6490]
2025-10-15T10:58:44.756310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401270541091150:6490]
2025-10-15T10:58:44.756332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:44.756368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:44.756373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:44.756381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:44.756392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:44.756513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:44.756528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:44.756573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:44.756605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:44.756624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:44.756634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:44.756659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:44.756684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:44.756799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401270541091150:6490]
2025-10-15T10:58:44.756822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:44.756851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:44.756867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:44.757718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:44.757746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:44.757814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:44.758090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 587 partition: 0 MaxSeqNo: 46 sessionId: src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0
2025-10-15T10:58:44.758762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249fa811-fa510da4-7e00848b-7de7e88b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:44.779795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0] Write session: try to update token
2025-10-15T10:58:44.779846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:44.785622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:44.785651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:44.785685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401270541091150:6490]
2025-10-15T10:58:44.785841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:44.786129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:44.791745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:44.793363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:44.798152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:44.799610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:44.801669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:44.802551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:44.881584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:44.881612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:44.881628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:44.881639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:44.881675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401270541091150:6490]
2025-10-15T10:58:44.881703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401270541091150:6490]
2025-10-15T10:58:44.881727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401270541091150:6490]
2025-10-15T10:58:44.881870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:44.881882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:44.881895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:44.881931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:44.881949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:44.882949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:44.883295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:44.883328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:44.883393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:44.907458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId: src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:44.933489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:45.032568Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:45.034096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:45.034125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:45.035366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:45.035527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:45.035546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:45.035577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401267741398262:6486]
2025-10-15T10:58:45.034870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:45.062462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 587 reason: error at write: Disconnected sessionId: src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0
2025-10-15T10:58:45.062767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 587 sessionId: src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0 is DEAD
2025-10-15T10:58:45.063806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:45.063837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0] Write session will restart in 0.007054s
2025-10-15T10:58:45.063927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0] Write session: Do CDS request
2025-10-15T10:58:45.063955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:45.081415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:45.083122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:45.083159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 588
2025-10-15T10:58:45.083583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:45.083695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:45.083710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:45.083719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:45.086836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 588 sessionId:  describe result for acl check
2025-10-15T10:58:45.086955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:45.086965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:45.086975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:45.086991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401272036365599:7190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:45.089469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401272036365599:7190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:45.099988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401272036365599:7190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:45.112075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401272036365599:7190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:45.112118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401272036365599:7190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:45.112134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401272036365599:7190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:45.112164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:45.134571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:45.139708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401272036365736:6486]
2025-10-15T10:58:45.140023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:45.140929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:45.140950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:45.140994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:45.141272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:45.141460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401274836058624:6493]
2025-10-15T10:58:45.143833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:45.144913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:45.145165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:45.146533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:45.146875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:45.146885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:45.146892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:45.146900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:45.146909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:45.146917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:45.146924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:45.146931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:45.146938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:45.146945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:45.146952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:45.146958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.146965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.146972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.147020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:45.147159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:45.147213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:45.147264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:45.147312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:45.147384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:45.147435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:45.147485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:45.147536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:45.147590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:45.147639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:45.147688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.147737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.147787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.147834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:45.147909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:45.147976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:45.148033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:45.148087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:45.148147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:45.148200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:45.148274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:45.148326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:45.148398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:45.148451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:45.148518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:45.148590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:45.148649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:45.148705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:45.148891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:45.148950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:45.149009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:45.149057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:45.149131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:45.149181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:45.149236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:45.149286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.149343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.149394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.149451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.149503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.149560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.150144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:45.169505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:45.179796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:45.179834Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:45.179851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:45.179868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:45.179890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 587 [2:7561401274836058624:6493]
2025-10-15T10:58:45.179939Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:45.179990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:45.180001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:45.180012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:45.180022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:45.180062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:45.180081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:45.180101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:45.196593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.196614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.196623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.196630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:45.196821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:45.196833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.196923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.197038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.197188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:45.197242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401272036365571:2467], now have 1 active actors on pipe
2025-10-15T10:58:45.197259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401272036365736:6486], now have 1 active actors on pipe
2025-10-15T10:58:45.197274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401272036365695:7190], now have 1 active actors on pipe
2025-10-15T10:58:45.197289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401274836058618:6493]
2025-10-15T10:58:45.197298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401274836058618:6493]
2025-10-15T10:58:45.197306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401274836058618:6493]
2025-10-15T10:58:45.197331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:45.197373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:45.197384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:45.197403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:45.197415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:45.197494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:45.197505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:45.197616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401274836058618:6493]
2025-10-15T10:58:45.197643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:45.197675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:45.197900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 587
2025-10-15T10:58:45.198003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 587, pipe: [1:7561401272036365736:6486]
2025-10-15T10:58:45.198069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 587
2025-10-15T10:58:45.199874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:45.199904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:45.199990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:45.200009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:45.200020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:45.200028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:45.200052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:45.200081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:45.200113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:45.200512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:45.200532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:45.200569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:45.201581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9176a9bb-ad4bb6f4-b86d7b5-550d6ed4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:45.200837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 588 partition: 0 MaxSeqNo: 46 sessionId: src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0
2025-10-15T10:58:45.245690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0] Write session: try to update token
2025-10-15T10:58:45.245745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:45.311972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:45.312003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:45.312013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:45.312062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:45.312077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:45.312090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:45.312101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:45.312134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401274836058618:6493]
2025-10-15T10:58:45.312158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401274836058618:6493]
2025-10-15T10:58:45.312181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401274836058618:6493]
2025-10-15T10:58:45.312316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:45.312345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:45.313179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:45.313221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:45.313258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:45.313334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:45.400093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId: src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:45.422354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:45.461528Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:45.463340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:45.463394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:45.468105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401272036365736:6486]
2025-10-15T10:58:45.468228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:45.468239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:45.469421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:45.472276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:45.490435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 588 reason: error at write: Disconnected sessionId: src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0
2025-10-15T10:58:45.490771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 588 sessionId: src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0 is DEAD
2025-10-15T10:58:45.494879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:45.494925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0] Write session will restart in 0.009488s
2025-10-15T10:58:45.495057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0] Write session: Do CDS request
2025-10-15T10:58:45.495092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:45.513047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:45.515461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:45.515491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 589
2025-10-15T10:58:45.515894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:45.516007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:45.516022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:45.516029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:45.517356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 589 sessionId:  describe result for acl check
2025-10-15T10:58:45.517449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:45.517463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:45.517472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:45.517487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401272036365783:7198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:45.519919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401272036365783:7198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:45.532519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401272036365783:7198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:45.560893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401272036365783:7198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:45.560934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401272036365783:7198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:45.560949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401272036365783:7198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:45.560975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:45.568863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401272036365936:6486]
2025-10-15T10:58:45.577763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:45.582389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:45.583239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:45.583267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:45.583305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:45.583558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:45.583761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401274836058803:6501]
2025-10-15T10:58:45.585934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:45.586809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:45.587010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:45.588447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:45.588758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:45.588774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:45.588781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:45.588787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:45.588794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:45.588801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:45.588808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:45.588814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:45.588820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:45.588827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:45.588834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:45.588840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.588847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.588855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.588895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:45.588992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:45.589038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:45.589081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:45.589123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:45.589175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:45.589216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:45.589256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:45.589298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:45.589341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:45.589383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:45.589424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.589464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.589505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.589544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:45.589615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:45.589669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:45.589719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:45.589766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:45.589816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:45.589859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:45.589907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:45.589950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:45.589997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:45.590038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:45.590087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:45.590130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:45.590179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:45.590218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:45.590269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:45.590313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:45.590363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:45.590405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:45.590453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:45.590494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:45.590544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:45.590586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.590634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.590676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.590724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.590767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.590817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.591280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:45.615040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:45.624942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:45.624974Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:45.624989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:45.625007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:45.625029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 588 [2:7561401274836058803:6501]
2025-10-15T10:58:45.625080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:45.625127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:45.625140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:45.625151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:45.625161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:45.625204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:45.625223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:45.625242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:45.633679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.633706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.633718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.633728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:45.634006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:45.634027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:45.634152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:45.634332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:45.634556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:45.634639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401272036365919:7198], now have 1 active actors on pipe
2025-10-15T10:58:45.634662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401272036365936:6486], now have 1 active actors on pipe
2025-10-15T10:58:45.634684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401272036365750:2467], now have 1 active actors on pipe
2025-10-15T10:58:45.634705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401274836058798:6501]
2025-10-15T10:58:45.634719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401274836058798:6501]
2025-10-15T10:58:45.634514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 588
2025-10-15T10:58:45.634730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401274836058798:6501]
2025-10-15T10:58:45.634757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:45.634591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 588, pipe: [1:7561401272036365936:6486]
2025-10-15T10:58:45.634777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:45.634663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 588
2025-10-15T10:58:45.634804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:45.634816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:45.634839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:45.634857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:45.634891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:45.635063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:45.635088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:45.635250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:45.635284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:45.635299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:45.635308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:45.635341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:45.635394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:45.635434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401274836058798:6501]
2025-10-15T10:58:45.635468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:45.635493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:45.635569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:45.636301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:45.636338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:45.636400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:45.636701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 589 partition: 0 MaxSeqNo: 46 sessionId: src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0
2025-10-15T10:58:45.637378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a809e81-2506fc7e-e3dbe4b-89cf24b9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:45.676773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0] Write session: try to update token
2025-10-15T10:58:45.676838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:45.752941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:45.752967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:45.752977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:45.752985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:45.753010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401274836058798:6501]
2025-10-15T10:58:45.753028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401274836058798:6501]
2025-10-15T10:58:45.753045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401274836058798:6501]
2025-10-15T10:58:45.753164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:45.753173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:45.753180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:45.753204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:45.753241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:45.753270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:45.764752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:45.764805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:45.766804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:45.824247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId: src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:45.849057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:45.915608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:45.917666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:45.917686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:45.917714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401274836058798:6501]
2025-10-15T10:58:45.917810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:45.917835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:45.917857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:45.918861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:45.919044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:45.919087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:45.919102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:45.919253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401272036365936:6486]
2025-10-15T10:58:45.958791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:45.958861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0] Write session will restart in 0.008195s
2025-10-15T10:58:45.959044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0] Write session: Do CDS request
2025-10-15T10:58:45.959094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:45.957938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 589 reason: error at write: Disconnected sessionId: src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0
2025-10-15T10:58:45.958334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 589 sessionId: src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0 is DEAD
2025-10-15T10:58:45.972607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:45.973627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:45.973662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 590
2025-10-15T10:58:45.973979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:45.974088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:45.974101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:45.974108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:45.975547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 590 sessionId:  describe result for acl check
2025-10-15T10:58:45.975657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:45.975686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:45.975695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:45.975714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401272036366001:7209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:45.978475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401272036366001:7209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:45.990308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401272036366001:7209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:46.004344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401272036366001:7209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:46.004389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401272036366001:7209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:46.004408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401272036366001:7209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:46.004438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:46.012947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:46.017308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:46.018310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:46.018343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:46.018391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:46.018702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:46.018906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401279131026304:6512]
2025-10-15T10:58:46.020976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401276331333426:6486]
2025-10-15T10:58:46.021265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:46.022233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:46.022502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:46.023799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:46.024095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.024106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.024113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.024118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.024123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.024128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.024134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.024138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.024144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.024148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.024153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.024161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.024169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.024177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.024226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.024321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.024357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.024395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.024439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.024487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.024542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.024590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.024628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.024668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.024722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.024776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.024823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.024875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.024922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.024996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.025063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.025132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.025186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.025246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.025296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.025356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.025411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.025472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.025523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.025609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.025664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.025726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.025787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.025850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.025902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.025961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.026023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.026086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.026138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.026196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.026248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.026316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.026371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.026433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.026483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.026543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.027071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:46.053096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:46.063009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:46.063057Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:46.063077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:46.063101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:46.063130Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 589 [2:7561401279131026304:6512]
2025-10-15T10:58:46.063186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:46.063253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:46.063269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:46.063283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:46.063296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:46.063602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:46.063643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:46.063669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:46.064974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.065002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.065018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.065031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:46.065329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:46.065355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.066385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 589
2025-10-15T10:58:46.066468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 589, pipe: [1:7561401276331333426:6486]
2025-10-15T10:58:46.066535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 589
2025-10-15T10:58:46.065515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.065764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.066028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:46.066113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401276331333422:7209], now have 1 active actors on pipe
2025-10-15T10:58:46.066142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401276331333426:6486], now have 1 active actors on pipe
2025-10-15T10:58:46.066165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401272036365967:2467], now have 1 active actors on pipe
2025-10-15T10:58:46.066194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401279131026299:6512]
2025-10-15T10:58:46.066209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401279131026299:6512]
2025-10-15T10:58:46.066223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401279131026299:6512]
2025-10-15T10:58:46.066265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:46.066344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:46.066546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:46.066563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:46.066609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:46.066626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:46.066638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:46.066687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401279131026299:6512]
2025-10-15T10:58:46.066716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:46.066724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:46.067576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:46.067613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:46.067719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:46.067755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:46.067775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:46.067787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:46.067841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:46.067884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:46.067950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:46.068533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:46.068552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:46.068625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:46.069338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 590 partition: 0 MaxSeqNo: 46 sessionId: src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0
2025-10-15T10:58:46.071728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83e01b19-b6fb625d-ba3f6fd3-391ccc6c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:46.095749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0] Write session: try to update token
2025-10-15T10:58:46.095815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:46.157740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId: src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:46.174094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:46.174157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:46.174203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:46.174235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:46.174299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401279131026299:6512]
2025-10-15T10:58:46.174360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401279131026299:6512]
2025-10-15T10:58:46.174411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401279131026299:6512]
2025-10-15T10:58:46.174645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:46.174714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:46.174789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:46.174794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:46.174823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:46.174849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:46.174934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:46.174976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:46.176408Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:46.195308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:46.324292Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:46.348442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:46.348490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:46.348586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:46.348604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:46.348659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401279131026299:6512]
2025-10-15T10:58:46.348891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:46.349566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:46.349610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:46.349880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:46.352882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401276331333426:6486]
2025-10-15T10:58:46.353060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:46.360276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 590 reason: error at write: Disconnected sessionId: src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0
2025-10-15T10:58:46.361198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:46.361266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0] Write session will restart in 0.006974s
2025-10-15T10:58:46.361463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0] Write session: Do CDS request
2025-10-15T10:58:46.361516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:46.360712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 590 sessionId: src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0 is DEAD
2025-10-15T10:58:46.374373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:46.374524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:46.374418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 591
2025-10-15T10:58:46.375083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:46.375282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:46.375310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:46.375325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:46.376920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 591 sessionId:  describe result for acl check
2025-10-15T10:58:46.377036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:46.377054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:46.377064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:46.377080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401276331333457:7213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:46.379677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401276331333457:7213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:46.385291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401276331333457:7213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:46.396736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401276331333457:7213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:46.396786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401276331333457:7213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:46.396803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401276331333457:7213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:46.396837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:46.419722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:46.421672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:46.422500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:46.422532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:46.422576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:46.422826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:46.423019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401279131026475:6514]
2025-10-15T10:58:46.425154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:46.426172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:46.426385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:46.427738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:46.428084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.428112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.428121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.428129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.428136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.428144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.428152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.428159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.428166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.428173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.428181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.428188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.428194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.428201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.428253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.428377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.428427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.428480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.428534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.428584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.428629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.428676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.428728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.428778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.428826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.428874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.428922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.428969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.429021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.429092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.429157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.429222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.429275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.429333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.429380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.429443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.429493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.429549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.429612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.429670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.429720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.429777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.429824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.429879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.429928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.429984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.430028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.430081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.430131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.430186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.430239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.430299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.430349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.430416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.430464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.430522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.432368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:46.450972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:46.453207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401276331333612:6486]
2025-10-15T10:58:46.466673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 590
2025-10-15T10:58:46.466804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 590
2025-10-15T10:58:46.466897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 590, pipe: [1:7561401276331333612:6486]
2025-10-15T10:58:46.464471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:46.464524Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:46.464544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:46.464564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:46.464592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 590 [2:7561401279131026475:6514]
2025-10-15T10:58:46.464655Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:46.464723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:46.464738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:46.464752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:46.464765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:46.464818Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:46.464841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:46.464866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:46.465842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.465861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.465876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.465889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:46.466174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:46.466194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.466355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.466565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.466829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:46.466910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401276331333522:7213], now have 1 active actors on pipe
2025-10-15T10:58:46.466935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401276331333445:2467], now have 1 active actors on pipe
2025-10-15T10:58:46.466960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401276331333612:6486], now have 1 active actors on pipe
2025-10-15T10:58:46.467013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:46.467035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:46.467075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401279131026470:6514]
2025-10-15T10:58:46.467091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401279131026470:6514]
2025-10-15T10:58:46.467106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401279131026470:6514]
2025-10-15T10:58:46.467147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:46.467189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:46.467206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:46.467218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:46.467225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:46.468206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:46.468232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:46.468329Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:46.468361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:46.468381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:46.468393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:46.468432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:46.468476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:46.468610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401279131026470:6514]
2025-10-15T10:58:46.468648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:46.468703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:46.468801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:46.469429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:46.469454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:46.469527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:46.469872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 591 partition: 0 MaxSeqNo: 46 sessionId: src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0
2025-10-15T10:58:46.470740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2af524-d51c0efe-6956ae5d-15ab83eb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:46.510543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0] Write session: try to update token
2025-10-15T10:58:46.510599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:46.561616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:46.561641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:46.561649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:46.561657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:46.561679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401279131026470:6514]
2025-10-15T10:58:46.561697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401279131026470:6514]
2025-10-15T10:58:46.561711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401279131026470:6514]
2025-10-15T10:58:46.561810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:46.561850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:46.561859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:46.561867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:46.561889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:46.562893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:46.632681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId: src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:46.653121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:46.710377Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:46.722569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:46.722625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:46.722701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:46.722717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:46.722762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401279131026470:6514]
2025-10-15T10:58:46.723085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:46.723670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:46.723698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:46.723733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:46.723747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:46.723896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401276331333612:6486]
2025-10-15T10:58:46.737687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 591 reason: error at write: Disconnected sessionId: src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0
2025-10-15T10:58:46.738053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 591 sessionId: src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0 is DEAD
2025-10-15T10:58:46.738476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:46.738535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0] Write session will restart in 0.007602s
2025-10-15T10:58:46.738693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0] Write session: Do CDS request
2025-10-15T10:58:46.738745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:46.750710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:46.750718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:46.750751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 592
2025-10-15T10:58:46.751215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:46.751335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:46.751370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:46.751380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:46.752686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 592 sessionId:  describe result for acl check
2025-10-15T10:58:46.752789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:46.752806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:46.752815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:46.752837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401276331333648:7219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:46.755480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401276331333648:7219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:46.764243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401276331333648:7219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:46.772162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401276331333648:7219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:46.772206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401276331333648:7219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:46.772224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401276331333648:7219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:46.772255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:46.803144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:46.807572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:46.808326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:46.808354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:46.808389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:46.808621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:46.808795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401279131026672:6523]
2025-10-15T10:58:46.810813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:46.811838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:46.812036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:46.813122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:46.813404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.813412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.813418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.813424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.813430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.813438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.813444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.813450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.813457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.813464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.813471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.813477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.813484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.813491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.813533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.813647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.813691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.813733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.813776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.813820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.813862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.813904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.813948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.813988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.814031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.814072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.814114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.814155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.814192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.814251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:46.814303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.814355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:46.814401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.814449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:46.814493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.814544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:46.814587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.814638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:46.814683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.814734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:46.814773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.814825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:46.814865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.814914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:46.814959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.815027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:46.815073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.815126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:46.815169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.815217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:46.815258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.815304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.816348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.816421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.816470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.816519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.817001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:46.823799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401276331333805:6486]
2025-10-15T10:58:46.840657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:46.850847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:46.850883Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:46.850898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:46.850913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:46.850935Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 591 [2:7561401279131026672:6523]
2025-10-15T10:58:46.850980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:46.851026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:46.851037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:46.851049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:46.851058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:46.851098Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:46.851117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:46.851136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:46.852746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.852772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.852784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.852794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:46.853040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:46.853061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:46.853178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:46.853350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:46.853387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 591, pipe: [1:7561401276331333805:6486]
2025-10-15T10:58:46.853393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 591
2025-10-15T10:58:46.853513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 591
2025-10-15T10:58:46.853568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:46.853660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401276331333635:2467], now have 1 active actors on pipe
2025-10-15T10:58:46.853686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401276331333805:6486], now have 1 active actors on pipe
2025-10-15T10:58:46.853707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401276331333679:7219], now have 1 active actors on pipe
2025-10-15T10:58:46.853770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:46.853795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:46.853829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401279131026667:6523]
2025-10-15T10:58:46.853842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401279131026667:6523]
2025-10-15T10:58:46.853854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401279131026667:6523]
2025-10-15T10:58:46.853893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:46.853955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:46.853956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:46.853970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:46.853981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:46.854116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:46.854135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:46.854193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:46.854222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:46.854238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:46.854247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:46.854275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:46.854308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:46.854422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401279131026667:6523]
2025-10-15T10:58:46.854450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:46.854470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:46.854486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:46.854879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:46.854902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:46.854957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:46.855244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 592 partition: 0 MaxSeqNo: 46 sessionId: src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0
2025-10-15T10:58:46.856022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b7613e-f83a5f67-1e8de9eb-abc65946_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:46.876152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0] Write session: try to update token
2025-10-15T10:58:46.876213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:46.910510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:46.910544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:46.910581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401279131026667:6523]
2025-10-15T10:58:46.910717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:46.910729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:46.912846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:46.914386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:46.915847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:46.917350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:46.919145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:46.920016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:46.989326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:46.989358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:46.989370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:46.989430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:46.989454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:46.989484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:46.989496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:46.989537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401279131026667:6523]
2025-10-15T10:58:46.989563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401279131026667:6523]
2025-10-15T10:58:46.989588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401279131026667:6523]
2025-10-15T10:58:46.989754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:46.989789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:46.990913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:46.990958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:46.990984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:46.992003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:46.995683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId: src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:47.017437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:47.137311Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:47.138995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:47.139030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:47.139783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:47.140433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401276331333805:6486]
2025-10-15T10:58:47.140539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:47.140551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:47.155470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 592 reason: error at write: Disconnected sessionId: src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0
2025-10-15T10:58:47.156215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:47.156300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0] Write session will restart in 0.009596s
2025-10-15T10:58:47.156496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0] Write session: Do CDS request
2025-10-15T10:58:47.156553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:47.155786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 592 sessionId: src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0 is DEAD
2025-10-15T10:58:47.171159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:47.174091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:47.174215Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T10:58:47.174498Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 6 consumer shared/user session shared/user_1_6_5484528221606064911_v1 is DEAD
2025-10-15T10:58:47.174820Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T10:58:47.174870Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401104532627562:6483] disconnected; active server actors: 1
2025-10-15T10:58:47.174894Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401104532627562:6483] client user disconnected session shared/user_1_6_5484528221606064911_v1
2025-10-15T10:58:47.175031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:47.175051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 593
2025-10-15T10:58:47.175302Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:58:47.175333Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:58:47.175384Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.005794s
2025-10-15T10:58:47.175390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:47.175501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:47.175524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:47.175534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:47.176737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 593 sessionId:  describe result for acl check
2025-10-15T10:58:47.176837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:47.176852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:47.176861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:47.176876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401280626301138:7229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:47.179749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401280626301138:7229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:47.183854Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T10:58:47.184373Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:58:47.184406Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 7
2025-10-15T10:58:47.185167Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 7 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:58:47.185373Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:58:47.185750Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 auth for : user
2025-10-15T10:58:47.188773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401280626301138:7229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:47.189230Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 Handle describe topics response
2025-10-15T10:58:47.189352Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 auth is DEAD
2025-10-15T10:58:47.189524Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:58:47.190582Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:58:47.190866Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_7_4774374852114715437_v1
2025-10-15T10:58:47.190911Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:58:47.191111Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:58:47.191156Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401280626301167:7233] connected; active server actors: 1
2025-10-15T10:58:47.191196Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561401280626301167:7233] session shared/user_1_7_4774374852114715437_v1
2025-10-15T10:58:47.191231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:58:47.191283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:58:47.191325Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_7_4774374852114715437_v1" (Sender=[1:7561401280626301157:7233], Pipe=[1:7561401280626301167:7233], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:58:47.191368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:58:47.191415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:58:47.191468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_7_4774374852114715437_v1" (Sender=[1:7561401280626301157:7233], Pipe=[1:7561401280626301167:7233], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:58:47.191523Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_7_4774374852114715437_v1" sender [1:7561401280626301157:7233] lock partition 0 for ReadingSession "shared/user_1_7_4774374852114715437_v1" (Sender=[1:7561401280626301157:7233], Pipe=[1:7561401280626301167:7233], Partitions=[], ActiveFamilyCount=1) generation 1 step 7
2025-10-15T10:58:47.191564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:58:47.191597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000154s
2025-10-15T10:58:47.192806Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:58:47.193486Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_7_4774374852114715437_v1" ClientId: "user" PipeClient { RawX1: 7561401280626301167 RawX2: 4503603922345025 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:58:47.193631Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 got read request: guid# 3f7f0786-f807aa45-bff41247-7a81a687
2025-10-15T10:58:47.193706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:58:47.199476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401280626301138:7229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:47.199513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401280626301138:7229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:47.199530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401280626301138:7229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:47.199559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:47.236005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:47.237953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:47.238754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:47.238800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:47.238841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:47.239073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:47.239246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401283425994160:6531]
2025-10-15T10:58:47.241437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:47.242370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:47.242636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:47.244168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:47.244510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:47.244528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:47.244535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:47.244543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:47.244549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:47.244556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:47.244563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:47.244570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:47.244578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:47.244586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:47.244594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:47.244601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.244608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.244615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.244661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:47.244768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:47.244816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:47.244859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:47.244914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:47.244970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:47.245012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:47.245054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:47.245098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:47.245145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:47.245198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:47.245254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.245301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.245356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.245399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:47.245480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:47.245539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:47.245611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:47.245662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:47.245715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:47.245761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:47.245814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:47.245873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:47.245928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:47.245975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:47.246029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:47.246076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:47.246130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:47.246174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:47.246225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:47.246272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:47.246323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:47.246367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:47.246422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:47.246467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:47.246521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:47.246567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.246618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.246664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.246718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.246762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.246835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.247335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:47.265350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:47.278981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:47.279030Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:47.279049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:47.279069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:47.279096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 592 [2:7561401283425994160:6531]
2025-10-15T10:58:47.279147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:47.279206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:47.279221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:47.279236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:47.279246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:47.279297Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:47.279319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:47.279343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:47.281385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.281416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.281430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.281443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:47.281755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:47.281775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.281928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.282123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.282363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:47.282444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401283425994155:6531]
2025-10-15T10:58:47.282460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401283425994155:6531]
2025-10-15T10:58:47.282474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401283425994155:6531]
2025-10-15T10:58:47.282523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:47.282603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:47.282705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:47.282723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:47.282736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:47.282789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:47.282808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:47.282940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401283425994155:6531]
2025-10-15T10:58:47.282964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:47.283014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:47.283060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401280626301182:7229], now have 1 active actors on pipe
2025-10-15T10:58:47.283087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401280626301175:7236], now have 1 active actors on pipe
2025-10-15T10:58:47.283111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401280626301133:2467], now have 1 active actors on pipe
2025-10-15T10:58:47.284106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 592
2025-10-15T10:58:47.284216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 592, pipe: [1:7561401280626301175:7236]
2025-10-15T10:58:47.284288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 592
2025-10-15T10:58:47.284462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:47.284496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:47.284536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_7_4774374852114715437_v1 on pipe: [1:7561401280626301175:7236]
2025-10-15T10:58:47.284601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:47.284617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:47.284668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:47.284702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:47.284713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:47.284795Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_7_4774374852114715437_v1
2025-10-15T10:58:47.284811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:47.284972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:47.285001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:58:47.285020Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:58:47.285459Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_7_4774374852114715437_v1:1 with generation 592
2025-10-15T10:58:47.302799Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760525927281 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:58:47.302848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T10:58:47.303026Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 sending to client partition status
2025-10-15T10:58:47.304887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a27479-8d4f43ef-8649ca36-d55a474a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:47.302149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:58:47.302227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:58:47.302253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:47.302276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:47.302287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:47.302323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:47.302365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:47.302391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:58:47.302430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:58:47.302483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:47.303263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:47.303298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:47.303381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:47.304260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 593 partition: 0 MaxSeqNo: 46 sessionId: src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0
2025-10-15T10:58:47.338218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0] Write session: try to update token
2025-10-15T10:58:47.338283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:47.368717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:47.368755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:47.368767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:47.368775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:47.368811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401283425994155:6531]
2025-10-15T10:58:47.368831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401283425994155:6531]
2025-10-15T10:58:47.368855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401283425994155:6531]
2025-10-15T10:58:47.369012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:47.369036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:47.369047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:47.369059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:47.369087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:47.370433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:47.439520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId: src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:47.484456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:47.525786Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:47.527620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:47.527650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:47.531162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401280626301175:7236]
2025-10-15T10:58:47.531318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:47.531516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:47.529887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_7_4774374852114715437_v1
2025-10-15T10:58:47.529922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:47.533313Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_7_4774374852114715437_v1
2025-10-15T10:58:47.540024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 593 reason: status is not ok: tablet will be restarted right now sessionId: src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0
2025-10-15T10:58:47.540307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 593 sessionId: src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0 is DEAD
2025-10-15T10:58:47.541104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:47.541201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0] Write session will restart in 0.007486s
2025-10-15T10:58:47.541421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0] Write session: Do CDS request
2025-10-15T10:58:47.541482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:47.556410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:47.556455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 594
2025-10-15T10:58:47.558816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:47.560301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:47.560429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:47.560451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:47.560460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:47.562119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 594 sessionId:  describe result for acl check
2025-10-15T10:58:47.562255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:47.562281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:47.562296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:47.562314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401280626301360:7242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:47.568735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401280626301360:7242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:47.576480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401280626301360:7242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:47.586386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401280626301360:7242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:47.586436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401280626301360:7242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:47.586458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401280626301360:7242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:47.586511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:47.621510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:47.624654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:47.625453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:47.625485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:47.625526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:47.625791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:47.625979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401283425994344:6536]
2025-10-15T10:58:47.627699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:47.628568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:47.628764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:47.629702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:47.629982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:47.629990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:47.629998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:47.630004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:47.630012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:47.630017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:47.630022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:47.630026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:47.630030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:47.630035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:47.630038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:47.630043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.630047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.630051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.630082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:47.630157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:47.630195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:47.630238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:47.630280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:47.630323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:47.630367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:47.630409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:47.630453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:47.630498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:47.630534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:47.630565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.630601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.630646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.630677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:47.630738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:47.630787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:47.630826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:47.630870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:47.630919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:47.630956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:47.631000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:47.631044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:47.631095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:47.631137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:47.631189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:47.631234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:47.631283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:47.631326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:47.631395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:47.631442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:47.631492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:47.631534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:47.631584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:47.631628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:47.631679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:47.631723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.631772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.631813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.631865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.631908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.631958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.632429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:47.633950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401280626301515:7236]
2025-10-15T10:58:47.652649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:47.669922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:47.669964Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:47.669982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:47.669999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:47.670023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 593 [2:7561401283425994344:6536]
2025-10-15T10:58:47.670071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:47.670128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:47.670142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:47.670153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:47.670164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:47.670206Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:47.670225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:47.670245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:47.671317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.671342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.671370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.671382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:47.671657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:47.671683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:47.671823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:47.672054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 593, pipe: [1:7561401280626301515:7236]
2025-10-15T10:58:47.672186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 593
2025-10-15T10:58:47.672302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 593
2025-10-15T10:58:47.672005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:47.672245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:47.672323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401280626301515:7236], now have 1 active actors on pipe
2025-10-15T10:58:47.672345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401280626301332:2467], now have 1 active actors on pipe
2025-10-15T10:58:47.672366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401280626301443:7242], now have 1 active actors on pipe
2025-10-15T10:58:47.672392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401283425994339:6536]
2025-10-15T10:58:47.672405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401283425994339:6536]
2025-10-15T10:58:47.672414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401283425994339:6536]
2025-10-15T10:58:47.672446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:47.672484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:47.672500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:47.672513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:47.672515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:47.672686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:47.672702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:47.672771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:47.672790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:47.672893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401283425994339:6536]
2025-10-15T10:58:47.672911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:47.672952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:47.672977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:47.673004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:47.673020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:47.673030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:47.673061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:47.673094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:47.673222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:47.673679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:47.673702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:47.673752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:47.674041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 594 partition: 0 MaxSeqNo: 46 sessionId: src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0
2025-10-15T10:58:47.676762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53d9254d-9c6e3895-f1b278f3-277d8190_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:47.733739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0] Write session: try to update token
2025-10-15T10:58:47.733833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:47.734403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:47.734439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:47.734480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401283425994339:6536]
2025-10-15T10:58:47.734634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:47.734631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:47.736709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:47.738340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:47.739742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:47.741149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:47.743363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:47.743880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:47.802387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:47.802417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:47.802431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:47.802491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:47.802507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:47.802520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:47.802531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:47.802573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401283425994339:6536]
2025-10-15T10:58:47.802600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401283425994339:6536]
2025-10-15T10:58:47.802621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401283425994339:6536]
2025-10-15T10:58:47.802785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:47.802817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:47.803976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:47.807119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:47.807165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:47.807194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:47.822123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId: src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:47.847483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:47.948360Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:47.949952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:47.950001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:47.950768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401280626301515:7236]
2025-10-15T10:58:47.950850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:47.950975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:47.950995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:47.950773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:47.982292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 594 reason: error at write: Disconnected sessionId: src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0
2025-10-15T10:58:47.982647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 594 sessionId: src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0 is DEAD
2025-10-15T10:58:47.983036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:47.983085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0] Write session will restart in 0.006714s
2025-10-15T10:58:47.983237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0] Write session: Do CDS request
2025-10-15T10:58:47.983285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:48.001137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:48.001278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:48.001317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 595
2025-10-15T10:58:48.001696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:48.001830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:48.001845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:48.001856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:48.003171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 595 sessionId:  describe result for acl check
2025-10-15T10:58:48.003275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:48.003287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:48.003297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:48.003315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401284921268924:7246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:48.006178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401284921268924:7246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:48.013404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401284921268924:7246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:48.020008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:48.023255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401284921268924:7246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:48.023310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401284921268924:7246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:48.023329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401284921268924:7246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:48.023384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:48.025658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:48.026548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:48.026578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:48.026620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:48.026853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:48.027012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401287720961830:6539]
2025-10-15T10:58:48.029255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:48.030020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:48.030201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:48.031506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:48.031837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.031845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.031852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.031858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.031865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.031871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.031878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.031885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.031892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.031897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.031920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.031926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.031934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.031940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.031984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.032077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.032124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.032165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.032207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.032251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.032291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.032332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.032372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.032411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.032454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.032494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.032536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.032578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.032615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.032671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.032721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.032769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.032813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.032861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.032902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.032948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.032994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.033042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.033083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.033130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.033173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.033223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.033262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.033311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.033352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.033405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.033446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.033496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.033541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.033589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.033648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.033697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.033741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.033791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.033832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.033879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.034335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:48.050068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401284921268996:7236]
2025-10-15T10:58:48.055272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:48.068308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:48.068346Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:48.068360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:48.068377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:48.068398Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 594 [2:7561401287720961830:6539]
2025-10-15T10:58:48.068443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:48.068491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:48.068504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:48.068516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:48.068526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:48.068570Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:48.068591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:48.068612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:48.070512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.070535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.070548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.070559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:48.070825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:48.070849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.070977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.071189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.071430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:48.071496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401287720961823:6539]
2025-10-15T10:58:48.071510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401287720961823:6539]
2025-10-15T10:58:48.071523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401287720961823:6539]
2025-10-15T10:58:48.071561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:48.071628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:48.071795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:48.071812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:48.071929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401287720961823:6539]
2025-10-15T10:58:48.071947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:48.072239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:48.072251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:48.072263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:48.072287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:48.073223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401284921268987:7246], now have 1 active actors on pipe
2025-10-15T10:58:48.073257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401280626301526:2467], now have 1 active actors on pipe
2025-10-15T10:58:48.073277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401284921268996:7236], now have 1 active actors on pipe
2025-10-15T10:58:48.074903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:48.074934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:48.075015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:48.075048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:48.075068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:48.075078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:48.075111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:48.075148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:48.075202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:48.074024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 594
2025-10-15T10:58:48.074116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 594, pipe: [1:7561401284921268996:7236]
2025-10-15T10:58:48.074189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 594
2025-10-15T10:58:48.079925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:48.079958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:48.080033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:48.080959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 595 partition: 0 MaxSeqNo: 46 sessionId: src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0
2025-10-15T10:58:48.081719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d0be66-968dba3-79d5e67-b05e0fcf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:48.111778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0] Write session: try to update token
2025-10-15T10:58:48.111830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:48.177923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:48.179420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:48.179445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:48.179456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:48.179492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401287720961823:6539]
2025-10-15T10:58:48.179517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401287720961823:6539]
2025-10-15T10:58:48.179537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401287720961823:6539]
2025-10-15T10:58:48.179768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:48.179782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:48.179792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:48.179840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:48.179859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:48.179886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:48.179928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:48.179955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:48.184178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:48.232982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId: src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:48.257812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:48.337023Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:48.353711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:48.353765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:48.353844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:48.353862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:48.353905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401287720961823:6539]
2025-10-15T10:58:48.354172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:48.354314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:48.354347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:48.354384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:48.354625Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:48.354628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401284921268996:7236]
2025-10-15T10:58:48.380525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 595 reason: error at write: Disconnected sessionId: src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0
2025-10-15T10:58:48.380826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 595 sessionId: src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0 is DEAD
2025-10-15T10:58:48.383697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:48.383724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0] Write session will restart in 0.008696s
2025-10-15T10:58:48.383785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0] Write session: Do CDS request
2025-10-15T10:58:48.383804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:48.400482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:48.401007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:48.401042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 596
2025-10-15T10:58:48.401324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:48.401437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:48.401461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:48.401471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:48.402572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 596 sessionId:  describe result for acl check
2025-10-15T10:58:48.402664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:48.402687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:48.402696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:48.402711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401284921269023:7250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:48.405249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401284921269023:7250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:48.412722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401284921269023:7250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:48.425725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401284921269023:7250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:48.425766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401284921269023:7250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:48.425781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401284921269023:7250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:48.425808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:48.444485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:48.447433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:48.448314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:48.448332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:48.448374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:48.448613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:48.448786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401287720962033:6547]
2025-10-15T10:58:48.450368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:48.451449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:48.451634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:48.452560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:48.452845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.452858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.452865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.452873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.452880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.452886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.452895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.452903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.452909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.452916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.452922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.452929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.452936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.452943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.452987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.453089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.453133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.453188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.453239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.453289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.453336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.453386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.453434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.453480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.453529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.453577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.453641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.453690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.453735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.453804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.453862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.453918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.453968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.454022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.454068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.454122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.454173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.454229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.454278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.454332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.454390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.454445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.454491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.454546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.454613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.454672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.454724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.454779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.454828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.454884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.454931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.454985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.455033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.455000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401284921269178:7236]
2025-10-15T10:58:48.455087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.455136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.455191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.455690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:48.472941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:48.488944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:48.488985Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:48.488995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:48.489008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:48.489029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 595 [2:7561401287720962033:6547]
2025-10-15T10:58:48.489068Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:48.489124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:48.489139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:48.489152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:48.489160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:48.489199Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:48.489216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:48.489233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:48.491191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.491210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.491226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.491239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:48.491501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:48.491514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.491625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.491767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.491960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:48.492256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 595, pipe: [1:7561401284921269178:7236]
2025-10-15T10:58:48.492027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401284921269178:7236], now have 1 active actors on pipe
2025-10-15T10:58:48.492043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401284921269006:2467], now have 1 active actors on pipe
2025-10-15T10:58:48.492357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 595
2025-10-15T10:58:48.492060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401284921269137:7250], now have 1 active actors on pipe
2025-10-15T10:58:48.492457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 595
2025-10-15T10:58:48.492078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401287720962028:6547]
2025-10-15T10:58:48.492088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401287720962028:6547]
2025-10-15T10:58:48.492098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401287720962028:6547]
2025-10-15T10:58:48.492125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:48.492176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:48.492182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:48.492200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:48.492213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:48.492337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:48.492350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:48.492501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401287720962028:6547]
2025-10-15T10:58:48.492516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:48.492539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:48.492626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:48.492649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:48.492770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:48.492804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:48.492823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:48.492834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:48.492872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:48.492914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:48.492995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:48.493442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:48.493468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:48.493534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:48.493849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 596 partition: 0 MaxSeqNo: 46 sessionId: src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0
2025-10-15T10:58:48.494469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8faa3491-3917da56-ba4db0d0-f7d1a297_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:48.515713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0] Write session: try to update token
2025-10-15T10:58:48.515780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:48.588747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:48.588777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:48.588788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:48.588796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:48.588827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401287720962028:6547]
2025-10-15T10:58:48.588849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401287720962028:6547]
2025-10-15T10:58:48.588871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401287720962028:6547]
2025-10-15T10:58:48.588989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:48.589030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:48.589054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:48.589055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:48.589075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:48.590357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:48.641803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId: src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:48.663101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:48.771417Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:48.810481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:48.810531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:48.810601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:48.810616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:48.810658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401287720962028:6547]
2025-10-15T10:58:48.810934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:48.811235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:48.811428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:48.811461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:48.837479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401284921269178:7236]
2025-10-15T10:58:48.837561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:48.837676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 596 reason: error at write: Disconnected sessionId: src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0
2025-10-15T10:58:48.837957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 596 sessionId: src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0 is DEAD
2025-10-15T10:58:48.839819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:48.839863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0] Write session will restart in 0.006274s
2025-10-15T10:58:48.839990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0] Write session: Do CDS request
2025-10-15T10:58:48.840030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:48.856389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:48.858020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:48.858389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 597
2025-10-15T10:58:48.858746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:48.858861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:48.858885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:48.858895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:48.860216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 597 sessionId:  describe result for acl check
2025-10-15T10:58:48.860320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:48.860340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:48.860350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:48.860365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401284921269277:7262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:48.862704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401284921269277:7262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:48.868548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401284921269277:7262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:48.875483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401284921269277:7262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:48.875519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401284921269277:7262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:48.875536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401284921269277:7262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:48.875563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:48.883581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:48.885243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:48.886138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:48.886158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:48.886205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:48.886465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:48.886653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401287720962222:6556]
2025-10-15T10:58:48.888651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:48.889606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:48.889845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:48.891183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:48.891526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.891544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.891551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.891559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.891566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.891572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.891580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.891588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.891595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.891602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.891608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.891616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.891623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.891630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.891678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.891790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.891840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.891887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.891951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.892000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.892051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.892097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.892143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.892192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.892238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.892286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.892331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.892378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.892441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.892511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:48.892571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.892629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:48.892692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.892753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:48.892805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.892865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:48.892919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.892978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:48.893046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.893107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:48.893162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.893220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:48.893275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.893338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:48.893395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.893460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:48.893514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.893571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:48.893635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.893695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:48.893744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.893807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.893861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.893918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.893966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.894023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.894549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:48.912728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:48.937863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401284921269404:7236]
2025-10-15T10:58:48.946907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:48.946953Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:48.946969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:48.946987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:48.947010Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 596 [2:7561401287720962222:6556]
2025-10-15T10:58:48.947060Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:48.947119Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:48.947133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:48.947145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:48.947156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:48.947201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:48.947222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:48.947242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:48.949512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 596
2025-10-15T10:58:48.949636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 596, pipe: [1:7561401284921269404:7236]
2025-10-15T10:58:48.949709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 596
2025-10-15T10:58:48.948651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.948676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.948690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.948701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:48.948973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:48.948993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:48.949129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:48.949343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:48.949569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:48.949668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401284921269227:2467], now have 1 active actors on pipe
2025-10-15T10:58:48.949693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401284921269404:7236], now have 1 active actors on pipe
2025-10-15T10:58:48.949716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401284921269381:7262], now have 1 active actors on pipe
2025-10-15T10:58:48.949739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401287720962217:6556]
2025-10-15T10:58:48.949752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401287720962217:6556]
2025-10-15T10:58:48.949764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401287720962217:6556]
2025-10-15T10:58:48.949809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:48.949868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:48.949879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:48.949897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:48.949911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:48.950053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:48.950070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:48.950227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:48.950248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:48.950278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401287720962217:6556]
2025-10-15T10:58:48.950315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:48.950436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:48.950464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:48.950481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:48.950490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:48.950524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:48.950559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:48.950635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:48.951503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:48.952562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:48.952617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:48.952706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:48.953041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 597 partition: 0 MaxSeqNo: 46 sessionId: src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0
2025-10-15T10:58:48.953754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eac7d4f-9ddddef8-8a3b9560-2e14a5de_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:48.985088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0] Write session: try to update token
2025-10-15T10:58:48.985147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:49.000274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:49.000310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:49.000352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401287720962217:6556]
2025-10-15T10:58:49.000489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:49.000504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:49.003188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:49.004639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:49.006103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:49.007485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:49.009540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:49.010022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:49.063336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:49.063410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:49.063432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:49.063537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:49.063569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:49.063598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:49.063623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:49.063682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401287720962217:6556]
2025-10-15T10:58:49.063731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401287720962217:6556]
2025-10-15T10:58:49.063784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401287720962217:6556]
2025-10-15T10:58:49.063972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:49.064013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:49.064030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:49.064050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:49.064088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:49.065376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:49.077672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId: src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:49.098526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:49.228554Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:49.229993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:49.230030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:49.232069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:49.232220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401284921269404:7236]
2025-10-15T10:58:49.232243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:49.232255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:49.235966Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:49.284019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 597 reason: error at write: Disconnected sessionId: src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0
2025-10-15T10:58:49.284352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 597 sessionId: src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0 is DEAD
2025-10-15T10:58:49.287942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:49.288031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0] Write session will restart in 0.005318s
2025-10-15T10:58:49.288213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0] Write session: Do CDS request
2025-10-15T10:58:49.288268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:49.298511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:49.298549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 598
2025-10-15T10:58:49.299016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:49.299741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:49.299903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:49.299928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:49.299938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:49.302854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 598 sessionId:  describe result for acl check
2025-10-15T10:58:49.303077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:49.303113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:49.303130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:49.303164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401289216236806:7271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:49.306866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401289216236806:7271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:49.314849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401289216236806:7271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:49.325823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:49.326193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401289216236806:7271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:49.326241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401289216236806:7271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:49.326258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401289216236806:7271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:49.326291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:49.329053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:49.329996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:49.330028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:49.330078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:49.330379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:49.330581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401292015929704:6560]
2025-10-15T10:58:49.332591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401289216236888:7236]
2025-10-15T10:58:49.332937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:49.334010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:49.334248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:49.335623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:49.335965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:49.335975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:49.335983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:49.335990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:49.335998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:49.336006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:49.336014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:49.336022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:49.336029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:49.336036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:49.336044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:49.336052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.336059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.336066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.336117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:49.336240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:49.336299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:49.336352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:49.336402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:49.336455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:49.336506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:49.336557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:49.336605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:49.336653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:49.336706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:49.336754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.336805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.336856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.336904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:49.336977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:49.337045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:49.337105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:49.337156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:49.337215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:49.337264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:49.337323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:49.337376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:49.337434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:49.337488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:49.337548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:49.337601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:49.337675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:49.337729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:49.337786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:49.337839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:49.337901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:49.337949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:49.338010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:49.338063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:49.338117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:49.338166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.338226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.338279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.338338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.338387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.338449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.339007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:49.357456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:49.366698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:49.366731Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:49.366741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:49.366753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:49.366769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 597 [2:7561401292015929704:6560]
2025-10-15T10:58:49.366804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:49.366846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:49.366859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:49.366870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:49.366878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:49.366922Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:49.366939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:49.366958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:49.383411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.383439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.383450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.383461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:49.383742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:49.383768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.383915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.384169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 597
2025-10-15T10:58:49.384274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 597, pipe: [1:7561401289216236888:7236]
2025-10-15T10:58:49.384360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 597
2025-10-15T10:58:49.384124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.384363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:49.384439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401289216236714:2467], now have 1 active actors on pipe
2025-10-15T10:58:49.384461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401289216236888:7236], now have 1 active actors on pipe
2025-10-15T10:58:49.384484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401289216236885:7271], now have 1 active actors on pipe
2025-10-15T10:58:49.384508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401292015929698:6560]
2025-10-15T10:58:49.384541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401292015929698:6560]
2025-10-15T10:58:49.384554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401292015929698:6560]
2025-10-15T10:58:49.384593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:49.384626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:49.384641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:49.384652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:49.384682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:49.384863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:49.384887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:49.385030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:49.385057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:49.385091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401292015929698:6560]
2025-10-15T10:58:49.385126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:49.385193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:49.385241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:49.385280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:49.385296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:49.385306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:49.385339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:49.385376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:49.385458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:49.388850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 598 partition: 0 MaxSeqNo: 46 sessionId: src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0
2025-10-15T10:58:49.386276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:49.386304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:49.389665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f8873a3-a7e4d0c3-ed983b17-d1dbe710_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:49.386375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:49.412906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0] Write session: try to update token
2025-10-15T10:58:49.412960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:49.531763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId: src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:49.549624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:49.549663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:49.549675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:49.549768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:49.549780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:49.549791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:49.549801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:49.549830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401292015929698:6560]
2025-10-15T10:58:49.549852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401292015929698:6560]
2025-10-15T10:58:49.549872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401292015929698:6560]
2025-10-15T10:58:49.549984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:49.550035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:49.550080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:49.560549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:49.560590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:49.567657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:49.569328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:49.707755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:49.712721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:49.712750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:49.712786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401292015929698:6560]
2025-10-15T10:58:49.712906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:49.712939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:49.713528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:49.714194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:49.715039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:49.715198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401289216236888:7236]
2025-10-15T10:58:49.715263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:49.757718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 598 reason: status is not ok: tablet will be restarted right now sessionId: src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0
2025-10-15T10:58:49.757994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 598 sessionId: src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0 is DEAD
2025-10-15T10:58:49.758453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:49.758494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0] Write session will restart in 0.009257s
2025-10-15T10:58:49.758649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0] Write session: Do CDS request
2025-10-15T10:58:49.758701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:49.775232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:49.775452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:49.775485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 599
2025-10-15T10:58:49.775774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:49.775938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:49.775978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:49.775990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:49.778054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 599 sessionId:  describe result for acl check
2025-10-15T10:58:49.778159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:49.778169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:49.778178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:49.778193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401289216236983:7277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:49.780648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401289216236983:7277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:49.785724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401289216236983:7277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:49.792633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401289216236983:7277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:49.792673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401289216236983:7277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:49.792687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401289216236983:7277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:49.792713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:49.800905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:49.817416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401289216237088:7236]
2025-10-15T10:58:49.819762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:49.820498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:49.820530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:49.820565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:49.820784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:49.820953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401292015929911:6569]
2025-10-15T10:58:49.823001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:49.824029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:49.824220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:49.825396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:49.825727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:49.825743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:49.825749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:49.825756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:49.825763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:49.825770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:49.825776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:49.825783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:49.825789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:49.825796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:49.825803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:49.825810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.825817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.825823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.825866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:49.825966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:49.826011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:49.826053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:49.826104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:49.826173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:49.826217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:49.826260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:49.826301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:49.826344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:49.826386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:49.826435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.826478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.826523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.826563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:49.826629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:49.826686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:49.826740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:49.826797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:49.826853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:49.826899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:49.826955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:49.827004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:49.827058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:49.827103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:49.827157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:49.827207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:49.827259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:49.827306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:49.827730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:49.827802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:49.827861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:49.827911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:49.827961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:49.828007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:49.828058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:49.828100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.828151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.828194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.828246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.828289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.828338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.828812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:49.845935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:49.859411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:49.859448Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:49.859463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:49.859480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:49.859502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 598 [2:7561401292015929911:6569]
2025-10-15T10:58:49.859546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:49.859595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:49.859608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:49.859619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:49.859628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:49.859672Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:49.859693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:49.859710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:49.861360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.861385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.861397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.861409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:49.861672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:49.861695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:49.861818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:49.862461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 598
2025-10-15T10:58:49.862578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 598
2025-10-15T10:58:49.862660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 598, pipe: [1:7561401289216237088:7236]
2025-10-15T10:58:49.861988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:49.862211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:49.862278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401289216237088:7236], now have 1 active actors on pipe
2025-10-15T10:58:49.862300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401289216237083:7277], now have 1 active actors on pipe
2025-10-15T10:58:49.862320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401289216236914:2467], now have 1 active actors on pipe
2025-10-15T10:58:49.862343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401292015929895:6569]
2025-10-15T10:58:49.862356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401292015929895:6569]
2025-10-15T10:58:49.862369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401292015929895:6569]
2025-10-15T10:58:49.862406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:49.862434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:49.862447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:49.862458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:49.862473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:49.862633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:49.862648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:49.862775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:49.862793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:49.862838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401292015929895:6569]
2025-10-15T10:58:49.864074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 599 partition: 0 MaxSeqNo: 46 sessionId: src_id|be229201-f66ea0ea-3434d352-489a8234_0
2025-10-15T10:58:49.862865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:49.862880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:49.862954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be229201-f66ea0ea-3434d352-489a8234_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:49.862981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:49.862997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:49.863008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:49.863037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:49.863070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:49.863140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:49.863745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:49.863774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:49.863864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:49.865059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607990c4-852be2e6-b5b25ec4-bae3bcbf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|be229201-f66ea0ea-3434d352-489a8234_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:49.893798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be229201-f66ea0ea-3434d352-489a8234_0] Write session: try to update token
2025-10-15T10:58:49.893857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be229201-f66ea0ea-3434d352-489a8234_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:49.966723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:49.966755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:49.966769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:49.966780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:49.966813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401292015929895:6569]
2025-10-15T10:58:49.966849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401292015929895:6569]
2025-10-15T10:58:49.966875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401292015929895:6569]
2025-10-15T10:58:49.967038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:49.967074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:49.967082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:49.967097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:49.967105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:49.967107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:49.967149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:49.967167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:49.971744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:50.000551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId: src_id|be229201-f66ea0ea-3434d352-489a8234_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:50.021881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:50.115797Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:50.129572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:50.129622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:50.129712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:50.129726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:50.129769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401292015929895:6569]
2025-10-15T10:58:50.130048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:50.130131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401289216237088:7236]
2025-10-15T10:58:50.130259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:50.130278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:50.130388Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:50.141986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be229201-f66ea0ea-3434d352-489a8234_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:50.142054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be229201-f66ea0ea-3434d352-489a8234_0] Write session will restart in 0.007591s
2025-10-15T10:58:50.142239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be229201-f66ea0ea-3434d352-489a8234_0] Write session: Do CDS request
2025-10-15T10:58:50.142291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be229201-f66ea0ea-3434d352-489a8234_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:50.141153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 599 reason: error at write: Disconnected sessionId: src_id|be229201-f66ea0ea-3434d352-489a8234_0
2025-10-15T10:58:50.141523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 599 sessionId: src_id|be229201-f66ea0ea-3434d352-489a8234_0 is DEAD
2025-10-15T10:58:50.154150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be229201-f66ea0ea-3434d352-489a8234_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:50.166595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:50.166819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:50.166836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 600
2025-10-15T10:58:50.171597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:50.171754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:50.171772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:50.171782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:50.173148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 600 sessionId:  describe result for acl check
2025-10-15T10:58:50.173301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:50.173312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:50.173320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:50.173337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401293511204459:7287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:50.176246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401293511204459:7287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:50.188793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401293511204459:7287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:50.207623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401293511204459:7287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:50.207670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401293511204459:7287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:50.207687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401293511204459:7287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:50.207717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:50.221405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:50.227528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:50.228451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:50.228481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:50.228528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:50.228803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:50.228994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401296310897402:6577]
2025-10-15T10:58:50.231071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:50.230149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401293511204589:7236]
2025-10-15T10:58:50.231974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:50.232155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:50.233078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:50.233387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:50.233399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:50.233404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:50.233409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:50.233415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:50.233420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:50.233425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:50.233430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:50.233435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:50.233440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:50.233445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:50.233450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.233455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.233459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.233503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:50.233616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:50.233676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:50.233726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:50.233774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:50.233834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:50.233885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:50.233931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:50.233972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:50.234013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:50.234059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:50.234105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.234152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.234200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.234232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:50.234285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:50.234336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:50.234381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:50.234417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:50.234455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:50.234486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:50.234526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:50.234561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:50.234600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:50.234633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:50.234674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:50.234707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:50.234745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:50.234779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:50.234818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:50.234862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:50.234900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:50.234934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:50.234974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:50.235009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:50.235048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:50.235088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.235141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.235190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.235242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.235292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.236090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.236647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:50.261711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:50.271507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:50.271554Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:50.271572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:50.271592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:50.271618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 599 [2:7561401296310897402:6577]
2025-10-15T10:58:50.271673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:50.271733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:50.271748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:50.271761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:50.271772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:50.271825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:50.271848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:50.271872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:50.273658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.273684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.273698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.273710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:50.274021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:50.274048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.274194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.274384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.274626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:50.274719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401293511204435:2467], now have 1 active actors on pipe
2025-10-15T10:58:50.274680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 599
2025-10-15T10:58:50.274748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401293511204589:7236], now have 1 active actors on pipe
2025-10-15T10:58:50.274770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401293511204584:7287], now have 1 active actors on pipe
2025-10-15T10:58:50.274787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 599, pipe: [1:7561401293511204589:7236]
2025-10-15T10:58:50.274795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401296310897397:6577]
2025-10-15T10:58:50.274809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401296310897397:6577]
2025-10-15T10:58:50.274822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401296310897397:6577]
2025-10-15T10:58:50.274860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 599
2025-10-15T10:58:50.274859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:50.274922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:50.274936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:50.274950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:50.274957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:50.275143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:50.275163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:50.275342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:50.275566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:50.275612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401296310897397:6577]
2025-10-15T10:58:50.275644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:50.275676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:50.275767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:50.275804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:50.275824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:50.275835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:50.275874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:50.275922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:50.276014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:50.277271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:50.277301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:50.277373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:50.277679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 600 partition: 0 MaxSeqNo: 46 sessionId: src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0
2025-10-15T10:58:50.278424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be229201-f66ea0ea-3434d352-489a8234_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:50.301287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0] Write session: try to update token
2025-10-15T10:58:50.301344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:50.362277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:50.362310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:50.362325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:50.362335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:50.362367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401296310897397:6577]
2025-10-15T10:58:50.362393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401296310897397:6577]
2025-10-15T10:58:50.362416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401296310897397:6577]
2025-10-15T10:58:50.362532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:50.362563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:50.362591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:50.362616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:50.362640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:50.367212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:50.392032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId: src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:50.411954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:50.522688Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:50.546173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:50.546229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:50.546307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:50.546325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:50.546372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401296310897397:6577]
2025-10-15T10:58:50.546743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:50.547192Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:50.547567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:50.547592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401293511204589:7236]
2025-10-15T10:58:50.547599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:50.547668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:50.557077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 600 reason: error at write: Disconnected sessionId: src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0
2025-10-15T10:58:50.557397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 600 sessionId: src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0 is DEAD
2025-10-15T10:58:50.557780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:50.557837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0] Write session will restart in 0.009468s
2025-10-15T10:58:50.557995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0] Write session: Do CDS request
2025-10-15T10:58:50.558032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:50.577809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:50.576731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:50.576779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 601
2025-10-15T10:58:50.578310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:50.578434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:50.578448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:50.578456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:50.579656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 601 sessionId:  describe result for acl check
2025-10-15T10:58:50.579773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:50.579792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:50.579801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:50.579816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401293511204634:7295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:50.582156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401293511204634:7295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:50.591394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401293511204634:7295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:50.604828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401293511204634:7295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:50.604871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401293511204634:7295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:50.604887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401293511204634:7295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:50.604915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:50.615574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:50.620436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:50.621226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:50.621245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:50.621285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:50.621515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:50.621697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401296310897590:6581]
2025-10-15T10:58:50.623996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:50.624770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:50.624952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:50.626245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:50.626547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:50.626554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:50.626560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:50.626567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:50.626573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:50.626579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:50.626584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:50.626591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:50.626596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:50.626603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:50.626609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:50.626615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.626623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.626629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.626671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:50.626770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:50.626816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:50.626862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:50.626904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:50.626949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:50.626991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:50.627033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:50.627076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:50.627119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:50.627162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:50.627205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.627247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.627288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.627326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:50.627409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:50.627466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:50.627519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:50.627567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:50.627617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:50.627661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:50.627710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:50.627758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:50.627807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:50.627849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:50.627897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:50.627942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:50.627990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:50.628031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:50.628078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:50.628125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:50.628175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:50.628220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:50.628270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:50.628351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:50.628403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:50.628448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.628498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.628542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.628589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.628631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.628680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.629160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:50.647963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401293511204795:7236]
2025-10-15T10:58:50.650156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:50.660443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:50.660484Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:50.660502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:50.660520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:50.660544Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 600 [2:7561401296310897590:6581]
2025-10-15T10:58:50.660592Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:50.660643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:50.660660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:50.660672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:50.660682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:50.660726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:50.660746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:50.660765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:50.661867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.661888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.661901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.661911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:50.662164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:50.662186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:50.662315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:50.662496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:50.662500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 600
2025-10-15T10:58:50.662517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 600
2025-10-15T10:58:50.662595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 600, pipe: [1:7561401293511204795:7236]
2025-10-15T10:58:50.662732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:50.662808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401293511204787:7295], now have 1 active actors on pipe
2025-10-15T10:58:50.662835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401293511204617:2467], now have 1 active actors on pipe
2025-10-15T10:58:50.662856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401293511204795:7236], now have 1 active actors on pipe
2025-10-15T10:58:50.662883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401296310897585:6581]
2025-10-15T10:58:50.662896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401296310897585:6581]
2025-10-15T10:58:50.662908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401296310897585:6581]
2025-10-15T10:58:50.662941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:50.662981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:50.662999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:50.663009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:50.663012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:50.663223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:50.663267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:50.663486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:50.663510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:50.663553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401296310897585:6581]
2025-10-15T10:58:50.663584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:50.663694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:50.663699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:50.663722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:50.663737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:50.663748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:50.663779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:50.663816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:50.663921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:50.664879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:50.664906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:50.664967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:50.665219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 601 partition: 0 MaxSeqNo: 46 sessionId: src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0
2025-10-15T10:58:50.665895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1e016b-a476730-9279f5c6-ea6b52e7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:50.692736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0] Write session: try to update token
2025-10-15T10:58:50.692808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:50.777590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:50.777623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:50.777639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:50.777649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:50.777695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401296310897585:6581]
2025-10-15T10:58:50.777722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401296310897585:6581]
2025-10-15T10:58:50.777765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401296310897585:6581]
2025-10-15T10:58:50.777895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:50.777932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:50.777961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:50.778024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:50.778038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:50.778050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:50.778102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:50.778125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:50.779371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:50.793897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId: src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:50.813529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:50.922348Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:50.937327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:50.937365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:50.937422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:50.937436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:50.937474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401296310897585:6581]
2025-10-15T10:58:50.937719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:50.938302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:50.938311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:50.938329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:50.938502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401293511204795:7236]
2025-10-15T10:58:50.938002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:50.947030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 601 reason: error at write: Disconnected sessionId: src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0
2025-10-15T10:58:50.951718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 601 sessionId: src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0 is DEAD
2025-10-15T10:58:50.952197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:50.952255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0] Write session will restart in 0.006434s
2025-10-15T10:58:50.952417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0] Write session: Do CDS request
2025-10-15T10:58:50.952466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:50.966361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:50.966399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 602
2025-10-15T10:58:50.966767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:50.967379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:50.967519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:50.967541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:50.967551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:50.968978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 602 sessionId:  describe result for acl check
2025-10-15T10:58:50.969083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:50.969098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:50.969107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:50.969126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401293511204837:7300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:50.971757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401293511204837:7300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:50.982167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401293511204837:7300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:50.990808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401293511204837:7300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:50.990859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401293511204837:7300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:50.990876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401293511204837:7300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:50.990911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:51.007285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:51.011229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:51.011857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:51.011882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:51.011915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:51.012118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:51.012244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401300605865094:6591]
2025-10-15T10:58:51.013992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:51.014838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:51.015058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:51.016219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:51.016492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.016506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.016513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.016520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.016528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.016534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.016541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.016548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.016555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.016560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.016565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.016569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.016573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.016578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.016611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.016694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.016730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.016763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.016802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.016861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.016915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.016968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.017004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.017047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.017097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.017142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.017190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.017238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.017268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.017332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.017397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.017453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.017507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.017563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.017613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.017684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.017737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.017795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.017844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.017902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.017953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.018013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.018062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.018119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.018157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.018207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.018243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.018286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.018347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.018401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.018437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.018497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.018556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.018615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.018665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.018723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.019187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:51.038048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401297806172294:7236]
2025-10-15T10:58:51.042291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:51.050556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:51.050594Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:51.050610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:51.050627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:51.050651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 601 [2:7561401300605865094:6591]
2025-10-15T10:58:51.050698Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:51.050756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:51.050769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:51.050781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:51.050792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:51.050841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:51.050863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:51.050895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:51.052395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.052417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.052432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.052442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:51.052706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:51.052730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.052872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.053047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 601, pipe: [1:7561401297806172294:7236]
2025-10-15T10:58:51.053072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.053156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 601
2025-10-15T10:58:51.053247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 601
2025-10-15T10:58:51.053307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:51.053402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401297806172294:7236], now have 1 active actors on pipe
2025-10-15T10:58:51.053432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401293511204911:7300], now have 1 active actors on pipe
2025-10-15T10:58:51.053453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401293511204818:2467], now have 1 active actors on pipe
2025-10-15T10:58:51.053498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401300605865088:6591]
2025-10-15T10:58:51.053514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401300605865088:6591]
2025-10-15T10:58:51.053530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401300605865088:6591]
2025-10-15T10:58:51.053568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:51.053597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:51.053611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:51.053622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:51.053652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:51.053686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:51.053736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:51.053910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:51.053936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:51.054096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:51.054133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:51.054156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:51.054166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:51.054200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:51.054247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:51.054288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401300605865088:6591]
2025-10-15T10:58:51.054312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:51.054341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:51.054390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:51.054891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:51.054920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:51.054988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:51.055376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 602 partition: 0 MaxSeqNo: 46 sessionId: src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0
2025-10-15T10:58:51.056293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb105f4f-7c1ea70c-2336d674-18d6fe7d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:51.076095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0] Write session: try to update token
2025-10-15T10:58:51.076146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:51.136238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:51.136281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:51.136296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:51.136309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:51.136344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401300605865088:6591]
2025-10-15T10:58:51.136374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401300605865088:6591]
2025-10-15T10:58:51.136400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401300605865088:6591]
2025-10-15T10:58:51.136591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:51.136609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:51.136635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:51.136642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:51.136696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:51.142433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:51.159455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId: src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:51.181384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:51.277948Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:51.296040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:51.296074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:51.296118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:51.296128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:51.296151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401300605865088:6591]
2025-10-15T10:58:51.296277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:51.296623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:51.296779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401297806172294:7236]
2025-10-15T10:58:51.296912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:51.297337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:51.307173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 602 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0
2025-10-15T10:58:51.307552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 602 sessionId: src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0 is DEAD
2025-10-15T10:58:51.308097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:51.308164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0] Write session will restart in 0.006122s
2025-10-15T10:58:51.308347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0] Write session: Do CDS request
2025-10-15T10:58:51.308400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:51.321372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:51.321275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:51.321335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 603
2025-10-15T10:58:51.322729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:51.322997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:51.323040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:51.323056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:51.325560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 603 sessionId:  describe result for acl check
2025-10-15T10:58:51.325721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:51.325734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:51.325744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:51.325763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401297806172319:7304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:51.328622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401297806172319:7304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:51.339600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401297806172319:7304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:51.351990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401297806172319:7304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:51.352037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401297806172319:7304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:51.352055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401297806172319:7304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:51.352083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:51.387725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:51.390344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:51.390915Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:51.390942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:51.390967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:51.391116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:51.391226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401300605865296:6593]
2025-10-15T10:58:51.392461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:51.397011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401297806172499:7236]
2025-10-15T10:58:51.393306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:51.393471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:51.394575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:51.394931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.394938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.394943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.394950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.394957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.394963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.394970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.394976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.394982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.394988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.394995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.395001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.395007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.395013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.395054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.395147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.395190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.395231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.395274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.395318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.395379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.395419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.395460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.395502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.395543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.395583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.395625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.395668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.395702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.395761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.395809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.395857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.395901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.395947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.395987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.396033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.396076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.396124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.396166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.396213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.396257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.396306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.396346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.396394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.396437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.396486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.396526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.396573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.396613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.396662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.396702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.396750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.396790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.396838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.396878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.396924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.397965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:51.422503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:51.432922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:51.432957Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:51.432973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:51.432986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:51.433002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 602 [2:7561401300605865296:6593]
2025-10-15T10:58:51.433039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:51.433093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:51.433108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:51.433121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:51.433134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:51.433188Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:51.433210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:51.433229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:51.450046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.450070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.450083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.450092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:51.450356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:51.450371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.450492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.450643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.450842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:51.450906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401300605865291:6593]
2025-10-15T10:58:51.450919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401300605865291:6593]
2025-10-15T10:58:51.450930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401300605865291:6593]
2025-10-15T10:58:51.450971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:51.451034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:51.451094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:51.451108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:51.451119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:51.451188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:51.451205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:51.451311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401300605865291:6593]
2025-10-15T10:58:51.451329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:51.451406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:51.451917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401297806172499:7236], now have 1 active actors on pipe
2025-10-15T10:58:51.451987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401297806172365:7304], now have 1 active actors on pipe
2025-10-15T10:58:51.452006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401297806172308:2467], now have 1 active actors on pipe
2025-10-15T10:58:51.455464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 602
2025-10-15T10:58:51.455564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 602, pipe: [1:7561401297806172499:7236]
2025-10-15T10:58:51.455643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 602
2025-10-15T10:58:51.455838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:51.455866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:51.455935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:51.455968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:51.455985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:51.455998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:51.456037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:51.456077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:51.456133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:51.456793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:51.456814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:51.456867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:51.457182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 603 partition: 0 MaxSeqNo: 46 sessionId: src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0
2025-10-15T10:58:51.458992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d15a06a-cc899c06-1ccfb5f3-5687c284_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:51.487292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:51.487325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:51.487375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401300605865291:6593]
2025-10-15T10:58:51.487487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:51.488805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:51.490021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:51.491369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:51.492948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:51.499799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:51.501529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:51.502046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:51.504250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0] Write session: try to update token
2025-10-15T10:58:51.504304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:51.531827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:51.531857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:51.531868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:51.580403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:51.580451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:51.580475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:51.580494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:51.580538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401300605865291:6593]
2025-10-15T10:58:51.580580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401300605865291:6593]
2025-10-15T10:58:51.580617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401300605865291:6593]
2025-10-15T10:58:51.580800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:51.580828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:51.580853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:51.580869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:51.580920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:51.587499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId: src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:51.591915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:51.619370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:51.745481Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:51.769123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:51.769172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:51.769992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:51.769775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401297806172499:7236]
2025-10-15T10:58:51.769894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:51.769906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:51.770615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:51.781101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:51.781162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0] Write session will restart in 0.007201s
2025-10-15T10:58:51.781308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0] Write session: Do CDS request
2025-10-15T10:58:51.781357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:51.779695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 603 reason: error at write: Disconnected sessionId: src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0
2025-10-15T10:58:51.780015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 603 sessionId: src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0 is DEAD
2025-10-15T10:58:51.797645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:51.797687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 604
2025-10-15T10:58:51.798293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:51.807707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:51.808017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:51.808046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:51.808064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:51.812755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 604 sessionId:  describe result for acl check
2025-10-15T10:58:51.812864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:51.812873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:51.812884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:51.812900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401297806172567:7319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:51.815519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401297806172567:7319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:51.828047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401297806172567:7319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:51.836261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401297806172567:7319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:51.836303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401297806172567:7319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:51.836316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401297806172567:7319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:51.836343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:51.869043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:51.871388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401297806172716:7236]
2025-10-15T10:58:51.870637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:51.871259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:51.871270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:51.871296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:51.871521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:51.871646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401300605865502:6603]
2025-10-15T10:58:51.873575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:51.874536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:51.874720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:51.875731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:51.876011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.876026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.876033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.876040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.876047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.876054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.876061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.876068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.876074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.876080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.876086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.876092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.876099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.876106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.876150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.876250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.876295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.876339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.876393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.876437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.876468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.876498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.876527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.876562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.876605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.876654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.876685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.876716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.876742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.876784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:51.876832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.876869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:51.876899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.876936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:51.876966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.877000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:51.877031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.877075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:51.877108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.877141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:51.877172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.877214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:51.877255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.877288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:51.877327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.877368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:51.877396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.877431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:51.877459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.877495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:51.877522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.877556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.877589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.877629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.877658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.877706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.878053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:51.926529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:51.936182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:51.936233Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:51.936253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:51.936273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:51.936300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 603 [2:7561401300605865502:6603]
2025-10-15T10:58:51.936358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:51.936425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:51.936439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:51.936454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:51.936466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:51.936518Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:51.936542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:51.936566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:51.937706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.937736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.937750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.937763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:51.938507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 603, pipe: [1:7561401297806172716:7236]
2025-10-15T10:58:51.938636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 603
2025-10-15T10:58:51.938713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 603
2025-10-15T10:58:51.938064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:51.938096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:51.938254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:51.938480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:51.938733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:51.938820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401297806172716:7236], now have 1 active actors on pipe
2025-10-15T10:58:51.938846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401297806172626:7319], now have 1 active actors on pipe
2025-10-15T10:58:51.938869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401297806172542:2467], now have 1 active actors on pipe
2025-10-15T10:58:51.938895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401300605865496:6603]
2025-10-15T10:58:51.938912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401300605865496:6603]
2025-10-15T10:58:51.938926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401300605865496:6603]
2025-10-15T10:58:51.938972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:51.939043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:51.939059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:51.939059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:51.939073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:51.939255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:51.939274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:51.939334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:51.939797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:51.939966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401300605865496:6603]
2025-10-15T10:58:51.940002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:51.940070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:51.940108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:51.940128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:51.940136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:51.940165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:51.940200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:51.940296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:51.940382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:51.941036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:51.941058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:51.941126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:51.941408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 604 partition: 0 MaxSeqNo: 46 sessionId: src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0
2025-10-15T10:58:51.942803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51a63fb0-4e88367a-5cb28f8b-cc6eaf47_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:51.961733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0] Write session: try to update token
2025-10-15T10:58:51.961794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:51.972827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:51.972861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:51.972891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401300605865496:6603]
2025-10-15T10:58:51.972993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:51.973007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:51.974868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:51.977414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:51.978783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:51.980081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:51.981836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:51.982326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:52.037762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId: src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:52.051504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:52.051533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:52.051546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:52.051622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:52.051635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:52.051646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:52.051656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:52.051685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401300605865496:6603]
2025-10-15T10:58:52.051708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401300605865496:6603]
2025-10-15T10:58:52.051734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401300605865496:6603]
2025-10-15T10:58:52.051846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:52.051886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:52.051888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:52.051911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:52.051917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:52.052872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:52.062905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:52.198755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:52.200204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:52.200248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:52.200752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:52.200777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:52.200783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:52.201002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401297806172716:7236]
2025-10-15T10:58:52.201013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:52.230825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 604 reason: error at write: Disconnected sessionId: src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0
2025-10-15T10:58:52.231141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 604 sessionId: src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0 is DEAD
2025-10-15T10:58:52.231604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:52.231669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0] Write session will restart in 0.009391s
2025-10-15T10:58:52.231858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0] Write session: Do CDS request
2025-10-15T10:58:52.231907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:52.245531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:52.248340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:52.248387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 605
2025-10-15T10:58:52.248805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:52.249000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:52.249038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:52.249056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:52.251397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 605 sessionId:  describe result for acl check
2025-10-15T10:58:52.251584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:52.251612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:52.251629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:52.251659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401302101140115:7323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:52.255798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401302101140115:7323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:52.265740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401302101140115:7323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:52.277744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401302101140115:7323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:52.277798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401302101140115:7323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:52.277819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401302101140115:7323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:52.277857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:52.280529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:52.283057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:52.284003Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:52.284038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:52.284084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:52.284387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:52.284603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401304900832981:6606]
2025-10-15T10:58:52.286981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:52.288979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:52.289243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:52.290503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:52.290862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:52.290870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:52.290878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:52.290885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:52.290893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:52.290901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:52.290908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:52.290915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:52.290923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:52.290932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:52.290939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:52.290947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.290954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.290960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.291013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:52.291143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:52.291197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:52.291250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:52.291299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:52.291372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:52.291422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:52.291472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:52.291523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:52.291591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:52.291640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:52.291689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.291742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.291790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.291843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:52.291920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:52.292004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:52.292072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:52.292131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:52.292195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:52.292251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:52.292308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:52.292366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:52.292429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:52.292484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:52.292546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:52.292601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:52.292661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:52.292719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:52.292781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:52.292842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:52.292905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:52.292957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:52.293020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:52.293075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:52.293138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:52.293190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.293238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.293276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.293330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.293386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.293443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.293901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:52.301170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401302101140219:7236]
2025-10-15T10:58:52.326004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:52.335483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:52.335526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:52.338343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 604, pipe: [1:7561401302101140219:7236]
2025-10-15T10:58:52.338399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 604
2025-10-15T10:58:52.335546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:52.338478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 604
2025-10-15T10:58:52.335567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:52.335588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 604 [2:7561401304900832981:6606]
2025-10-15T10:58:52.335647Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:52.335710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:52.335725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:52.335737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:52.335750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:52.335792Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:52.335811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:52.335831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:52.336675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.336685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.336696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.336705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:52.336913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:52.336925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.337048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.337214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.337465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:52.337531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401304900832976:6606]
2025-10-15T10:58:52.337547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401304900832976:6606]
2025-10-15T10:58:52.337561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401304900832976:6606]
2025-10-15T10:58:52.337608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:52.337696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:52.337779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:52.337794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:52.337808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:52.337891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:52.337910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:52.338033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401304900832976:6606]
2025-10-15T10:58:52.338053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:52.338100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:52.338146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401302101140219:7236], now have 1 active actors on pipe
2025-10-15T10:58:52.338170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401302101140036:2467], now have 1 active actors on pipe
2025-10-15T10:58:52.338194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401302101140213:7323], now have 1 active actors on pipe
2025-10-15T10:58:52.338637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:52.338662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:52.338738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:52.338770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:52.338790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:52.338802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:52.338838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:52.338882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:52.338932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:52.339953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:52.339978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:52.340028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:52.340326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 605 partition: 0 MaxSeqNo: 46 sessionId: src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0
2025-10-15T10:58:52.343642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d41a18fc-1955e3d4-17230633-c8546ca2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:52.381349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0] Write session: try to update token
2025-10-15T10:58:52.381400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:52.415214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:52.415243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:52.415277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401304900832976:6606]
2025-10-15T10:58:52.415405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:52.415414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:52.424293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:52.430717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:52.432177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:52.436014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:52.441137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:52.496546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:52.496572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:52.496581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:52.496695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:52.507401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId: src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:52.570758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:52.570793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:52.570808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:52.570820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:52.570862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401304900832976:6606]
2025-10-15T10:58:52.570889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401304900832976:6606]
2025-10-15T10:58:52.570913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401304900832976:6606]
2025-10-15T10:58:52.571057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:52.571070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:52.571092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:52.571095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:52.571122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:52.575922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:52.584796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:52.724144Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:52.729140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:52.729171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:52.730040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:52.731238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:52.731342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401302101140219:7236]
2025-10-15T10:58:52.731509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:52.731550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:52.757964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 605 reason: error at write: Disconnected sessionId: src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0
2025-10-15T10:58:52.758316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 605 sessionId: src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0 is DEAD
2025-10-15T10:58:52.758694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:52.758746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0] Write session will restart in 0.006100s
2025-10-15T10:58:52.758895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0] Write session: Do CDS request
2025-10-15T10:58:52.758931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:52.769439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:52.774570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:52.774602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 606
2025-10-15T10:58:52.774969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:52.775119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:52.775144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:52.775155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:52.777411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 606 sessionId:  describe result for acl check
2025-10-15T10:58:52.777511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:52.777527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:52.777536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:52.777552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401302101140284:7331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:52.779926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401302101140284:7331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:52.792048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401302101140284:7331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:52.805960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401302101140284:7331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:52.806012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401302101140284:7331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:52.806030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401302101140284:7331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:52.806064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:52.809433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:52.812465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:52.813089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:52.813110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:52.813141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:52.813311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:52.813434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401304900833186:6614]
2025-10-15T10:58:52.815072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:52.819411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:52.819907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:52.821782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:52.822231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:52.822246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:52.822250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:52.822255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:52.822261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:52.822266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:52.822271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:52.822275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:52.822280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:52.822285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:52.822289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:52.822294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.822299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.822304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.822340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:52.822434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:52.822472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:52.822508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:52.822543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:52.822577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:52.822612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:52.822660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:52.822703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:52.822739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:52.822778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:52.822816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.822854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.822897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.822928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:52.822984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:52.823038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:52.823089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:52.823130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:52.823177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:52.823223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:52.823273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:52.823312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:52.823379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:52.823428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:52.823491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:52.823534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:52.823583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:52.823632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:52.823681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:52.823730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:52.823788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:52.823843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:52.823895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:52.823938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:52.823989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:52.824030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.824081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.824128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.824168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.824198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.824244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.824659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:52.832051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401302101140442:7236]
2025-10-15T10:58:52.848812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:52.858687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:52.858734Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:52.858750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:52.858772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:52.858799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 605 [2:7561401304900833186:6614]
2025-10-15T10:58:52.858853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:52.858916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:52.858940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:52.858953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:52.858965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:52.859015Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:52.859039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:52.859064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:52.860550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.860575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.860591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.860603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:52.860885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:52.860910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:52.861073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:52.861198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 605
2025-10-15T10:58:52.861277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:52.861320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 605
2025-10-15T10:58:52.861392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 605, pipe: [1:7561401302101140442:7236]
2025-10-15T10:58:52.861531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:52.861618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401302101140232:2467], now have 1 active actors on pipe
2025-10-15T10:58:52.861649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401302101140434:7331], now have 1 active actors on pipe
2025-10-15T10:58:52.861673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401302101140442:7236], now have 1 active actors on pipe
2025-10-15T10:58:52.861752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:52.861774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:52.861810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401304900833176:6614]
2025-10-15T10:58:52.861831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401304900833176:6614]
2025-10-15T10:58:52.861845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401304900833176:6614]
2025-10-15T10:58:52.861879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:52.861955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:52.861975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:52.861989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:52.862002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:52.862144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:52.862167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:52.862235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:52.862281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:52.862305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:52.862316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:52.862351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:52.862391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:52.862513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401304900833176:6614]
2025-10-15T10:58:52.862543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:52.862565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:52.862585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:52.863195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:52.863233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:52.863302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:52.863554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 606 partition: 0 MaxSeqNo: 46 sessionId: src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0
2025-10-15T10:58:52.864247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b152c88-9b9ab1c5-7bf865e0-e6c3f9a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:52.889987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0] Write session: try to update token
2025-10-15T10:58:52.890041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:52.933620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:52.933654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:52.933669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:52.933680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:52.933728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401304900833176:6614]
2025-10-15T10:58:52.933756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401304900833176:6614]
2025-10-15T10:58:52.933782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401304900833176:6614]
2025-10-15T10:58:52.933934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:52.933963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:52.934995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:52.936629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:52.936673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:52.936703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:52.986339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId: src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:53.006594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:53.086308Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:53.094809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:53.094851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:53.095754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:53.095808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:53.099005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:53.126119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401302101140442:7236]
2025-10-15T10:58:53.126213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:53.147482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 606 reason: error at write: Disconnected sessionId: src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0
2025-10-15T10:58:53.147800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 606 sessionId: src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0 is DEAD
2025-10-15T10:58:53.148205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:53.148251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0] Write session will restart in 0.006305s
2025-10-15T10:58:53.148388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0] Write session: Do CDS request
2025-10-15T10:58:53.148431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:53.159338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:53.159389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 607
2025-10-15T10:58:53.159518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:53.160043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:53.160185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:53.160207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:53.160218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:53.161504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:53.161562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 607 sessionId:  describe result for acl check
2025-10-15T10:58:53.161683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:53.161719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:53.161728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:53.161751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401306396107915:7342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:53.164271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401306396107915:7342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:53.170348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401306396107915:7342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:53.172780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:53.173652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:53.173683Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:53.173739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:53.174004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:53.174217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401309195800702:6623]
2025-10-15T10:58:53.176400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:53.177365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:53.177598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:53.178144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401306396107915:7342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:53.178191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401306396107915:7342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:53.178208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401306396107915:7342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:53.178239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:53.178929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:53.179265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.179282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.179289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.179297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.179304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.179311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.179318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.179326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.179333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.179340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.179364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.179372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.179380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.179385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.179434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.179544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.179594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.179641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.179685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.179738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.179789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.179835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.179879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.179928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.179974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.180019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.180067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.180111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.180156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.180224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.180283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.180353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.180402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.180455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.180502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.180554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.180604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.180661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.180704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.180759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.180804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.180859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.180903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.180956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.181005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.181062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.181107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.181160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.181207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.181261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.181310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.181362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.181409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.181461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.181504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.181558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.182072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:53.198689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:53.208422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:53.208471Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:53.208490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:53.208512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:53.208538Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 606 [2:7561401309195800702:6623]
2025-10-15T10:58:53.208594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:53.208661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:53.208678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:53.208694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:53.208706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:53.208757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:53.208789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:53.208811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:53.209938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.209975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.209991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.210005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:53.210291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:53.210316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.210479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.210701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.210720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 606
2025-10-15T10:58:53.210736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 606
2025-10-15T10:58:53.210977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:53.211071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401306396107943:7342], now have 1 active actors on pipe
2025-10-15T10:58:53.211101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401306396107772:2467], now have 1 active actors on pipe
2025-10-15T10:58:53.211156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:53.211186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:53.211244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401309195800696:6623]
2025-10-15T10:58:53.211262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401309195800696:6623]
2025-10-15T10:58:53.211275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401309195800696:6623]
2025-10-15T10:58:53.211313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:53.211375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:53.211396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:53.211408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:53.211421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:53.211616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:53.211638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:53.211708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b68d171-25a66703-6eab722d-4376b4f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:53.211743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:53.211766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:53.211777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:53.211814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:53.211860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:53.212005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401309195800696:6623]
2025-10-15T10:58:53.212037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:53.212066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:53.212095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:53.212612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:53.212646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:53.212719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:53.213067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 607 partition: 0 MaxSeqNo: 46 sessionId: src_id|5b68d171-25a66703-6eab722d-4376b4f4_0
2025-10-15T10:58:53.213881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31091b0-fb286a9a-1c8abbbb-2f44eb9c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5b68d171-25a66703-6eab722d-4376b4f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:53.226388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401306396107951:7236]
2025-10-15T10:58:53.227011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401306396107951:7236], now have 1 active actors on pipe
2025-10-15T10:58:53.227161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 606, pipe: [1:7561401306396107951:7236]
2025-10-15T10:58:53.234153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b68d171-25a66703-6eab722d-4376b4f4_0] Write session: try to update token
2025-10-15T10:58:53.234217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b68d171-25a66703-6eab722d-4376b4f4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:53.243096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:53.243138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:53.243181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401309195800696:6623]
2025-10-15T10:58:53.243302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:53.243324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:53.245410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:53.265001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:53.266467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:53.269411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:53.275995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:53.276753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:53.308642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId: src_id|5b68d171-25a66703-6eab722d-4376b4f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:53.333158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:53.333188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:53.333200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:53.333209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:53.333243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401309195800696:6623]
2025-10-15T10:58:53.333264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401309195800696:6623]
2025-10-15T10:58:53.333279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401309195800696:6623]
2025-10-15T10:58:53.333391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:53.333423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:53.333451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:53.333453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:53.333465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:53.333478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:53.333520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:53.333541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:53.334435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:53.346532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:53.491073Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:53.492259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:53.492287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:53.492890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:53.493595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401306396107951:7236]
2025-10-15T10:58:53.493690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:53.495868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:53.505691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 607 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b68d171-25a66703-6eab722d-4376b4f4_0
2025-10-15T10:58:53.506207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 607 sessionId: src_id|5b68d171-25a66703-6eab722d-4376b4f4_0 is DEAD
2025-10-15T10:58:53.506649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b68d171-25a66703-6eab722d-4376b4f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:53.506700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b68d171-25a66703-6eab722d-4376b4f4_0] Write session will restart in 0.005526s
2025-10-15T10:58:53.506864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b68d171-25a66703-6eab722d-4376b4f4_0] Write session: Do CDS request
2025-10-15T10:58:53.506907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b68d171-25a66703-6eab722d-4376b4f4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:53.520482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:53.520523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 608
2025-10-15T10:58:53.520637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b68d171-25a66703-6eab722d-4376b4f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:53.521190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:53.521329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:53.521354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:53.521363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:53.522525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 608 sessionId:  describe result for acl check
2025-10-15T10:58:53.522642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:53.522661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:53.522671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:53.522688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401306396107972:7346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:53.525082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401306396107972:7346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:53.535171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401306396107972:7346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:53.545350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401306396107972:7346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:53.545396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401306396107972:7346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:53.545412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401306396107972:7346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:53.545442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:53.565023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:53.568367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:53.569200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:53.569225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:53.569271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:53.569538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:53.569746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401309195800889:6627]
2025-10-15T10:58:53.571995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:53.572805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:53.572986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:53.574124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:53.574432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.574441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.574448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.574455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.574462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.574469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.574475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.574481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.574486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.574494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.574500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.574507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.574514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.574521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.574564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.574669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.574715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.574762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.574808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.574852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.574897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.574944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.574985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.575028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.575071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.575116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.575176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.575226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.575266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.575327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.575402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.575453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.575496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.575547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.575592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.575643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.575689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.575740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.575783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.575835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.575894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.575947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.575992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.576043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.576089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.576144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.576187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.576240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.576283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.576330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.576373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.576425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.576470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.576521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.576563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.576615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.577127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:53.593445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401306396108143:7236]
2025-10-15T10:58:53.611026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:53.620914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:53.620960Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:53.620978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:53.620997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:53.621022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 607 [2:7561401309195800889:6627]
2025-10-15T10:58:53.621070Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:53.621125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:53.621139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:53.621150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:53.621160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:53.621204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:53.621223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:53.621242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:53.622329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.622355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.622370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.622381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:53.622656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:53.622681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.622820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.623014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.622982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 607
2025-10-15T10:58:53.623250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:53.623082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 607, pipe: [1:7561401306396108143:7236]
2025-10-15T10:58:53.623165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 607
2025-10-15T10:58:53.623364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401306396107955:2467], now have 1 active actors on pipe
2025-10-15T10:58:53.623394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401306396108143:7236], now have 1 active actors on pipe
2025-10-15T10:58:53.623417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401306396108077:7346], now have 1 active actors on pipe
2025-10-15T10:58:53.623459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401309195800884:6627]
2025-10-15T10:58:53.623473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401309195800884:6627]
2025-10-15T10:58:53.623484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401309195800884:6627]
2025-10-15T10:58:53.623521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:53.623559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:53.623575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:53.623587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:53.623602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:53.623622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:53.623667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:53.623851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:53.623881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:53.624033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95be4420-f7091337-6f367bf-e6566f8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:53.624069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:53.624085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:53.624095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:53.624126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:53.624161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:53.624200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401309195800884:6627]
2025-10-15T10:58:53.624233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:53.624262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:53.624315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:53.624804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:53.624837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:53.624900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:53.625171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 608 partition: 0 MaxSeqNo: 46 sessionId: src_id|95be4420-f7091337-6f367bf-e6566f8a_0
2025-10-15T10:58:53.625803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b68d171-25a66703-6eab722d-4376b4f4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|95be4420-f7091337-6f367bf-e6566f8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:53.643950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95be4420-f7091337-6f367bf-e6566f8a_0] Write session: try to update token
2025-10-15T10:58:53.644005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95be4420-f7091337-6f367bf-e6566f8a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:53.652382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:53.652413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:53.652448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401309195800884:6627]
2025-10-15T10:58:53.652554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:53.652558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:53.654635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:53.656240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:53.657689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:53.659447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:53.661180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:53.661720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:53.731148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:53.731176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:53.731189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:53.731199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:53.731235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401309195800884:6627]
2025-10-15T10:58:53.731261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401309195800884:6627]
2025-10-15T10:58:53.731283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401309195800884:6627]
2025-10-15T10:58:53.731460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:53.731515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:53.731560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:53.731775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:53.731798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:53.731809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:53.731846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:53.731865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:53.736697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:53.765040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId: src_id|95be4420-f7091337-6f367bf-e6566f8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:53.787730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:53.874608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:53.877031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:53.877067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:53.877780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:53.877827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:53.878002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401306396108143:7236]
2025-10-15T10:58:53.878081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:53.878092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:53.904553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 608 reason: error at write: Disconnected sessionId: src_id|95be4420-f7091337-6f367bf-e6566f8a_0
2025-10-15T10:58:53.904873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 608 sessionId: src_id|95be4420-f7091337-6f367bf-e6566f8a_0 is DEAD
2025-10-15T10:58:53.907798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95be4420-f7091337-6f367bf-e6566f8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:53.907874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95be4420-f7091337-6f367bf-e6566f8a_0] Write session will restart in 0.005308s
2025-10-15T10:58:53.908053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95be4420-f7091337-6f367bf-e6566f8a_0] Write session: Do CDS request
2025-10-15T10:58:53.908114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95be4420-f7091337-6f367bf-e6566f8a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:53.918519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:53.918863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95be4420-f7091337-6f367bf-e6566f8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:53.918589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 609
2025-10-15T10:58:53.919855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:53.920119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:53.920151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:53.920169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:53.923603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 609 sessionId:  describe result for acl check
2025-10-15T10:58:53.923719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:53.923735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:53.923745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:53.923761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401306396108181:7352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:53.926083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401306396108181:7352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:53.934249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401306396108181:7352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:53.950157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401306396108181:7352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:53.950202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401306396108181:7352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:53.950219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401306396108181:7352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:53.950249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:53.969374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:53.971868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:53.972828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:53.972858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:53.972905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:53.973170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:53.973380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401309195801105:6635]
2025-10-15T10:58:53.975667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:53.976700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:53.976917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:53.978289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:53.978460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401306396108350:7236]
2025-10-15T10:58:53.978673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.978702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.978712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.978720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.978727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.978734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.978742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.978748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.978755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.978762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.978769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.978776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.978783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.978791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.978838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.978949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.978999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.979046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.979094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.979153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.979200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.979246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.979290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.979338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.979405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.979449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.979495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.979542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.979590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.979660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:53.979723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.979786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:53.979836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.979892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:53.979938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.979989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:53.980036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.980088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:53.980134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.980189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:53.980252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.980306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:53.980349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.980406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:53.980453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.980504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:53.980547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.980603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:53.980650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.980702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:53.980747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.980801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:53.980846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.980900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:53.980943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.980996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:53.981509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:54.003302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
E1015 10:58:54.007535701  821071 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:58:54.013507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:54.013556Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:54.013570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:54.013587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:54.013609Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 608 [2:7561401309195801105:6635]
2025-10-15T10:58:54.013657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:54.013719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:54.013733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:54.013745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:54.013755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:54.013801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:54.013820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:54.013839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:54.030768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.030797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.030807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.030816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:54.031078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:54.031105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.031219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.031395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.031443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 608, pipe: [1:7561401306396108350:7236]
2025-10-15T10:58:54.031480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 608
2025-10-15T10:58:54.031586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 608
2025-10-15T10:58:54.031621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:54.031705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401306396108350:7236], now have 1 active actors on pipe
2025-10-15T10:58:54.031732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401306396108325:7352], now have 1 active actors on pipe
2025-10-15T10:58:54.031751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401306396108164:2467], now have 1 active actors on pipe
2025-10-15T10:58:54.031771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401309195801100:6635]
2025-10-15T10:58:54.031784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401309195801100:6635]
2025-10-15T10:58:54.031795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401309195801100:6635]
2025-10-15T10:58:54.031832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:54.031902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:54.031912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:54.031926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:54.031929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:54.031939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:54.031989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:54.032141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:54.032164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:54.032298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:54.032332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:54.032347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:54.032356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:54.032404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:54.032448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:54.032491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401309195801100:6635]
2025-10-15T10:58:54.032524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:54.032552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:54.032598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:54.033113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:54.033139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:54.033197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:54.033536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 609 partition: 0 MaxSeqNo: 46 sessionId: src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0
2025-10-15T10:58:54.034367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95be4420-f7091337-6f367bf-e6566f8a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:54.058115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0] Write session: try to update token
2025-10-15T10:58:54.058177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:54.091709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:54.091758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:54.091779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:54.091793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:54.091844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401309195801100:6635]
2025-10-15T10:58:54.091879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401309195801100:6635]
2025-10-15T10:58:54.091907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401309195801100:6635]
2025-10-15T10:58:54.092085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:54.092119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:54.092229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:54.092270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:54.092308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:54.096448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:54.137582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId: src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:54.158660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:54.253968Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:54.259068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:54.259320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401306396108350:7236]
2025-10-15T10:58:54.258052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:54.258106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:54.262670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:54.259433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:54.259454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:54.294632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 609 reason: error at write: Disconnected sessionId: src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0
2025-10-15T10:58:54.294994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 609 sessionId: src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0 is DEAD
2025-10-15T10:58:54.295433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:54.295490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0] Write session will restart in 0.008597s
2025-10-15T10:58:54.295664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0] Write session: Do CDS request
2025-10-15T10:58:54.295712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:54.308643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:54.311571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:54.311613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 610
2025-10-15T10:58:54.315517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:54.315705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:54.315723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:54.315736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:54.317617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 610 sessionId:  describe result for acl check
2025-10-15T10:58:54.317767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:54.317779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:54.317789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:54.317809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401310691075695:7364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:54.320687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401310691075695:7364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:54.326663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401310691075695:7364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:54.349299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401310691075695:7364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:54.349346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401310691075695:7364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:54.349362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401310691075695:7364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:54.349392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:54.358860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401310691075857:7236]
2025-10-15T10:58:54.361602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:54.365743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:54.366636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:54.366669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:54.366715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:54.366959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:54.367150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401313490768608:6639]
2025-10-15T10:58:54.369287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:54.370767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:54.370987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:54.372305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:54.372626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:54.372640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:54.372648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:54.372655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:54.372662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:54.372669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:54.372678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:54.372685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:54.372692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:54.372699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:54.372706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:54.372712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.372719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.372727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.372774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:54.372878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:54.372927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:54.372972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:54.373028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:54.373079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:54.373132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:54.373182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:54.373230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:54.373281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:54.373330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:54.373376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.373423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.373473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.373519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:54.373589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:54.373653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:54.373725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:54.373780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:54.373842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:54.373890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:54.373948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:54.374002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:54.374059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:54.374112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:54.374172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:54.374229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:54.374285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:54.374337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:54.374393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:54.374446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:54.374505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:54.374555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:54.374617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:54.374670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:54.374730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:54.374780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.374835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.374889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.374945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.374993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.375053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.375579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:54.393170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:54.405908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:54.405951Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:54.405967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:54.405985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:54.406008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 609 [2:7561401313490768608:6639]
2025-10-15T10:58:54.406756Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:54.406820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:54.406833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:54.406845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:54.406855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:54.406901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:54.406920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:54.406939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:54.408733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.408759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.408773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.408784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:54.409039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:54.409063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.409191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.409377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.409608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:54.409679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401313490768603:6639]
2025-10-15T10:58:54.409702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401313490768603:6639]
2025-10-15T10:58:54.409727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401313490768603:6639]
2025-10-15T10:58:54.409769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:54.409832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:54.410784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 609
2025-10-15T10:58:54.410915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 609
2025-10-15T10:58:54.411487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 609, pipe: [1:7561401310691075857:7236]
2025-10-15T10:58:54.413214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 610 partition: 0 MaxSeqNo: 46 sessionId: src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0
2025-10-15T10:58:54.410006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:54.410038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:54.410151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401313490768603:6639]
2025-10-15T10:58:54.410171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:54.410515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:54.410532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:54.410544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:54.410571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:54.410597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401310691075676:2467], now have 1 active actors on pipe
2025-10-15T10:58:54.410636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401310691075831:7364], now have 1 active actors on pipe
2025-10-15T10:58:54.411478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:54.411499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:54.411538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401310691075857:7236], now have 1 active actors on pipe
2025-10-15T10:58:54.411591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:54.411617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:54.411633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:54.411642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:54.411673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:54.411708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:54.411749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:54.412817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:54.412835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:54.412891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:54.414039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99821e6b-d1ea0a2-900a36f5-ef371afe_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:54.436394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0] Write session: try to update token
2025-10-15T10:58:54.436451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:54.501119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:54.501157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:54.501172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:54.501184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:54.501221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401313490768603:6639]
2025-10-15T10:58:54.501249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401313490768603:6639]
2025-10-15T10:58:54.501272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401313490768603:6639]
2025-10-15T10:58:54.501402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:54.501442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:54.501474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:54.501489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:54.501511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:54.502837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:54.546808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId: src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:54.567103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:54.651440Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:54.659942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:54.659983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:54.660038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:54.660048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:54.660080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401313490768603:6639]
2025-10-15T10:58:54.660344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:54.660514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:54.660942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401310691075857:7236]
2025-10-15T10:58:54.661032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:54.661152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:54.670662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 610 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0
2025-10-15T10:58:54.671030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 610 sessionId: src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0 is DEAD
2025-10-15T10:58:54.671474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:54.671520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0] Write session will restart in 0.008258s
2025-10-15T10:58:54.671673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0] Write session: Do CDS request
2025-10-15T10:58:54.671716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:54.688786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:54.688816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 611
2025-10-15T10:58:54.689032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:54.689475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:54.689558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:54.689578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:54.689589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:54.690725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 611 sessionId:  describe result for acl check
2025-10-15T10:58:54.690808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:54.690819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:54.690826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:54.690839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401310691075902:7372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:54.692839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401310691075902:7372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:54.697630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401310691075902:7372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:54.709758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401310691075902:7372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:54.709806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401310691075902:7372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:54.709825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401310691075902:7372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:54.709860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:54.749808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:54.753910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:54.754747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:54.754773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:54.754819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:54.755068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:54.755246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401313490768807:6648]
2025-10-15T10:58:54.756887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:54.757833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:54.758073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:54.758793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401310691076071:7236]
2025-10-15T10:58:54.759459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:54.759804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:54.759812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:54.759820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:54.759827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:54.759834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:54.759841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:54.759848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:54.759857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:54.759864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:54.759872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:54.759879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:54.759886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.759893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.759900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.759950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:54.760066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:54.760118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:54.760169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:54.760219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:54.760271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:54.760317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:54.760367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:54.760416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:54.760468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:54.760517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:54.760564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.760612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.760659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.760704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:54.760775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:54.760836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:54.760894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:54.760946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:54.761004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:54.761049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:54.761107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:54.761160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:54.761219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:54.761268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:54.761326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:54.761375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:54.761428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:54.761476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:54.761529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:54.761578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:54.761634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:54.761682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:54.761748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:54.761796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:54.761853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:54.761900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.761957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.762008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.762065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.762116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.762158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.762567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:54.804538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:54.813982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:54.814028Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:54.814047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:54.814068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:54.814093Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 610 [2:7561401313490768807:6648]
2025-10-15T10:58:54.814136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:54.814188Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:54.814200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:54.814211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:54.814219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:54.814259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:54.814277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:54.814295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:54.815508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.815537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.815553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.815566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:54.815854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:54.815881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:54.816043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:54.816286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:54.816381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 610
2025-10-15T10:58:54.816385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 610
2025-10-15T10:58:54.816468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 610, pipe: [1:7561401310691076071:7236]
2025-10-15T10:58:54.816549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:54.816644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401310691075929:7372], now have 1 active actors on pipe
2025-10-15T10:58:54.816675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401310691075888:2467], now have 1 active actors on pipe
2025-10-15T10:58:54.816701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401310691076071:7236], now have 1 active actors on pipe
2025-10-15T10:58:54.816730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401313490768802:6648]
2025-10-15T10:58:54.816746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401313490768802:6648]
2025-10-15T10:58:54.816762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401313490768802:6648]
2025-10-15T10:58:54.816803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:54.816898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:54.817053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:54.817068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:54.817080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:54.817100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:54.817119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:54.817282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:54.817305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:54.817354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401313490768802:6648]
2025-10-15T10:58:54.817384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:54.817415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:54.817498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35248853-82dfea47-6b3cc004-671c2b5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:54.817531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:54.817551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:54.817563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:54.817602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:54.817644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:54.817754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:54.819691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:54.819721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:54.819796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:54.822191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 611 partition: 0 MaxSeqNo: 46 sessionId: src_id|35248853-82dfea47-6b3cc004-671c2b5b_0
2025-10-15T10:58:54.823008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdd7734c-77c65e21-ea86c9c1-f0f10a5e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|35248853-82dfea47-6b3cc004-671c2b5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:54.858570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35248853-82dfea47-6b3cc004-671c2b5b_0] Write session: try to update token
2025-10-15T10:58:54.858633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35248853-82dfea47-6b3cc004-671c2b5b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:54.955665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:54.955697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:54.955710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:54.955721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:54.955755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401313490768802:6648]
2025-10-15T10:58:54.955781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401313490768802:6648]
2025-10-15T10:58:54.955804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401313490768802:6648]
2025-10-15T10:58:54.956010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:54.956023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:54.956034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:54.956077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:54.956097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:54.957094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:54.957122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:54.957148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:54.957181Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:54.974169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId: src_id|35248853-82dfea47-6b3cc004-671c2b5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:54.995893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:55.106684Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:55.122711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:55.122759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:55.122822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:55.122837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:55.122877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401313490768802:6648]
2025-10-15T10:58:55.123122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:55.123643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:55.126108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:55.127511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:55.127792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401310691076071:7236]
2025-10-15T10:58:55.153805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 611 reason: status is not ok: tablet will be restarted right now sessionId: src_id|35248853-82dfea47-6b3cc004-671c2b5b_0
2025-10-15T10:58:55.154145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 611 sessionId: src_id|35248853-82dfea47-6b3cc004-671c2b5b_0 is DEAD
2025-10-15T10:58:55.155928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35248853-82dfea47-6b3cc004-671c2b5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:55.155963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35248853-82dfea47-6b3cc004-671c2b5b_0] Write session will restart in 0.006218s
2025-10-15T10:58:55.156069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35248853-82dfea47-6b3cc004-671c2b5b_0] Write session: Do CDS request
2025-10-15T10:58:55.156100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35248853-82dfea47-6b3cc004-671c2b5b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:55.167055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:55.167110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 612
2025-10-15T10:58:55.167804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35248853-82dfea47-6b3cc004-671c2b5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:55.168646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:55.168891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:55.168918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:55.168936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:55.171178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 612 sessionId:  describe result for acl check
2025-10-15T10:58:55.171326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:55.171344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:55.171382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:55.171402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401314986043416:7377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:55.174651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401314986043416:7377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:55.193542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401314986043416:7377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:55.207612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401314986043416:7377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:55.207661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401314986043416:7377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:55.207680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401314986043416:7377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:55.207713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:55.229659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401314986043583:7236]
2025-10-15T10:58:55.238441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:55.243610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:55.244428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:55.244446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:55.244487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:55.244730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:55.244908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401317785736308:6652]
2025-10-15T10:58:55.247526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:55.248615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:55.248820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:55.250049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:55.250354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:55.250362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:55.250370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:55.250377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:55.250384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:55.250391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:55.250398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:55.250405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:55.250412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:55.250419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:55.250425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:55.250431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.250437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.250444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.250490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:55.250597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:55.250646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:55.250695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:55.250742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:55.250791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:55.250839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:55.250884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:55.250929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:55.250977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:55.251021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:55.251071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.251120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.251165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.251205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:55.251270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:55.251326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:55.251400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:55.251451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:55.251504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:55.251548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:55.251598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:55.251648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:55.251703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:55.251745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:55.251808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:55.251853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:55.251904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:55.251947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:55.251999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:55.252047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:55.252097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:55.252141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:55.252196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:55.252242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:55.252291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:55.252338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.252393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.252440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.252502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.252548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.252598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.253102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:55.270576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:55.286762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:55.286807Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:55.286823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:55.286842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:55.286865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 611 [2:7561401317785736308:6652]
2025-10-15T10:58:55.286916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:55.286970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:55.286984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:55.286995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:55.287005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:55.287051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:55.287071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:55.287091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:55.289264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.289291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.289307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.289318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:55.289593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:55.289610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.289763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.289956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.290184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:55.290258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401314986043583:7236], now have 1 active actors on pipe
2025-10-15T10:58:55.290282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401314986043527:7377], now have 1 active actors on pipe
2025-10-15T10:58:55.290304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401314986043401:2467], now have 1 active actors on pipe
2025-10-15T10:58:55.290330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401317785736302:6652]
2025-10-15T10:58:55.290345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401317785736302:6652]
2025-10-15T10:58:55.290359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401317785736302:6652]
2025-10-15T10:58:55.290396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:55.290478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:55.291150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:55.291169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:55.291181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:55.290147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 611
2025-10-15T10:58:55.290273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 611
2025-10-15T10:58:55.290358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 611, pipe: [1:7561401314986043583:7236]
2025-10-15T10:58:55.291555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:55.291584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:55.291730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:55.291758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:55.291812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401317785736302:6652]
2025-10-15T10:58:55.291839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:55.291944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9453e47c-39079fa-b1904f79-186e2a82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:55.291974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:55.291991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:55.292001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:55.292033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:55.292071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:55.292147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:55.292505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:55.293686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:55.293715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:55.293792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:55.296022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 612 partition: 0 MaxSeqNo: 46 sessionId: src_id|9453e47c-39079fa-b1904f79-186e2a82_0
2025-10-15T10:58:55.301566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35248853-82dfea47-6b3cc004-671c2b5b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9453e47c-39079fa-b1904f79-186e2a82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:55.334126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:55.334165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:55.334207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401317785736302:6652]
2025-10-15T10:58:55.334346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:55.334348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:55.336641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:55.337960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:55.339270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:55.343776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:55.351513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:55.361532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9453e47c-39079fa-b1904f79-186e2a82_0] Write session: try to update token
2025-10-15T10:58:55.361596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9453e47c-39079fa-b1904f79-186e2a82_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:55.365554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:55.420866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:55.420908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:55.420924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:55.420999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:55.421020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:55.421047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:55.421068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:55.421150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401317785736302:6652]
2025-10-15T10:58:55.421201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401317785736302:6652]
2025-10-15T10:58:55.421232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401317785736302:6652]
2025-10-15T10:58:55.421421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:55.421469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:55.423197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:55.423487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:55.423544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:55.423595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:55.479519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId: src_id|9453e47c-39079fa-b1904f79-186e2a82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:55.506233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:55.572318Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:55.574417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:55.574465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:55.575169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:55.575196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:55.577010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:55.577307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401314986043583:7236]
2025-10-15T10:58:55.575277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:55.585386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9453e47c-39079fa-b1904f79-186e2a82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:55.584589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 612 reason: error at write: Disconnected sessionId: src_id|9453e47c-39079fa-b1904f79-186e2a82_0
2025-10-15T10:58:55.585429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9453e47c-39079fa-b1904f79-186e2a82_0] Write session will restart in 0.007094s
2025-10-15T10:58:55.584967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 612 sessionId: src_id|9453e47c-39079fa-b1904f79-186e2a82_0 is DEAD
2025-10-15T10:58:55.585542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9453e47c-39079fa-b1904f79-186e2a82_0] Write session: Do CDS request
2025-10-15T10:58:55.585578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9453e47c-39079fa-b1904f79-186e2a82_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:55.600207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9453e47c-39079fa-b1904f79-186e2a82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:55.600613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:55.600647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 613
2025-10-15T10:58:55.601028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:55.601143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:55.601159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:55.601170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:55.602740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 613 sessionId:  describe result for acl check
2025-10-15T10:58:55.602864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:55.602875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:55.602884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:55.602901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401314986043613:7382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:55.605569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401314986043613:7382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:55.613096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401314986043613:7382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:55.624206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401314986043613:7382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:55.624257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401314986043613:7382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:55.624273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401314986043613:7382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:55.624303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:55.676133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401314986043798:7236]
2025-10-15T10:58:55.686990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:55.689088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:55.689966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:55.689985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:55.690030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:55.690231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:55.690357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401317785736513:6660]
2025-10-15T10:58:55.691945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:55.695587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:55.695827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:55.697194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:55.697558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:55.697575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:55.697583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:55.697589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:55.697597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:55.697603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:55.697610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:55.697616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:55.697623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:55.697631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:55.697637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:55.697643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.697650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.697657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.697704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:55.697819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:55.697866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:55.697912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:55.697963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:55.698015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:55.698063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:55.698109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:55.698158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:55.698212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:55.698259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:55.698306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.698354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.698401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.698446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:55.698513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:55.698579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:55.698636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:55.698684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:55.698740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:55.698788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:55.698845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:55.698897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:55.698952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:55.698999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:55.699057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:55.699104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:55.699159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:55.699208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:55.699265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:55.699315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:55.699433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:55.699492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:55.699547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:55.699596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:55.699652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:55.699698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.699752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.699797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.699846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.699888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.699937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.700469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:55.722543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:55.733498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:55.733543Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:55.733559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:55.733577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:55.733602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 612 [2:7561401317785736513:6660]
2025-10-15T10:58:55.733650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:55.733706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:55.733719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:55.733742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:55.733754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:55.733805Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:55.733828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:55.733857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:55.736162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.736194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.736207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.736219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:55.736487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:55.736506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:55.736638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:55.736824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:55.737087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:55.737178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401314986043645:7382], now have 1 active actors on pipe
2025-10-15T10:58:55.737207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401314986043601:2467], now have 1 active actors on pipe
2025-10-15T10:58:55.737228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401314986043798:7236], now have 1 active actors on pipe
2025-10-15T10:58:55.737252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401317785736508:6660]
2025-10-15T10:58:55.737266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401317785736508:6660]
2025-10-15T10:58:55.737278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401317785736508:6660]
2025-10-15T10:58:55.737297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 612
2025-10-15T10:58:55.737315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:55.737351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:55.737367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:55.737394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 612
2025-10-15T10:58:55.737379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:55.737389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:55.737466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 612, pipe: [1:7561401314986043798:7236]
2025-10-15T10:58:55.737564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:55.737586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:55.737702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401317785736508:6660]
2025-10-15T10:58:55.737739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:55.737809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:55.737866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:55.737893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:55.737999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:55.738040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:55.738057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:55.738068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:55.738104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:55.738149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:55.738196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:55.739325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:55.739369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:55.739435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:55.739713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 613 partition: 0 MaxSeqNo: 46 sessionId: src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0
2025-10-15T10:58:55.743561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9453e47c-39079fa-b1904f79-186e2a82_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:55.791839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0] Write session: try to update token
2025-10-15T10:58:55.791909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:55.796699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:55.796729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:55.796770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401317785736508:6660]
2025-10-15T10:58:55.796888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:55.796904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:55.798820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:55.800118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:55.801628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:55.803112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:55.805168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:55.805704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:55.869868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:55.869900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:55.869913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:55.869976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:55.869991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:55.870004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:55.870015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:55.870056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401317785736508:6660]
2025-10-15T10:58:55.870081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401317785736508:6660]
2025-10-15T10:58:55.870108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401317785736508:6660]
2025-10-15T10:58:55.870229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:55.870257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:55.870264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:55.870281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:55.870294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:55.871201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:55.903315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId: src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:55.924835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:56.017642Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:56.019843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:56.019884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:56.020553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:56.024561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401314986043798:7236]
2025-10-15T10:58:56.024705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:56.069668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:56.069825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 613 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0
2025-10-15T10:58:56.070136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 613 sessionId: src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0 is DEAD
2025-10-15T10:58:56.071816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:56.071854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0] Write session will restart in 0.009061s
2025-10-15T10:58:56.071957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0] Write session: Do CDS request
2025-10-15T10:58:56.071984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:56.086795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:56.091213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:56.091254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 614
2025-10-15T10:58:56.091699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:56.091810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:56.091825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:56.091834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:56.093320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 614 sessionId:  describe result for acl check
2025-10-15T10:58:56.093422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:56.093432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:56.093441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:56.093457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401319281011269:7393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:56.096327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401319281011269:7393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:56.103447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:56.102945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401319281011269:7393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:56.108350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:56.109121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:56.109149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:56.109199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:56.109428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:56.109607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401322080704033:6669]
2025-10-15T10:58:56.110643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401319281011269:7393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:56.110686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401319281011269:7393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:56.110702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401319281011269:7393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:56.110742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:56.111839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:56.112729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:56.112921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:56.113837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:56.114124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.114137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.114141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.114146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.114151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.114154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.114159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.114164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.114167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.114171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.114175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.114180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.114188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.114194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.114236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.114339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.114384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.114428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.114472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.114516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.114567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.114609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.114657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.114707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.114753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.114799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.114843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.114901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.114947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.115010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.115066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.115119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.115168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.115222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.115270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.115322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.115388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.115434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.115481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.115529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.115572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.115616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.115658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.115707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.115753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.115800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.115844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.115896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.115941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.115981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.116008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.116039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.116069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.116104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.116133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.116168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.116534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:56.125793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401319281011321:7236]
2025-10-15T10:58:56.135234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:56.145582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:56.145627Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:56.145643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:56.145663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:56.145689Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 613 [2:7561401322080704033:6669]
2025-10-15T10:58:56.145750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:56.145841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:56.145866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:56.145880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:56.145893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:56.145971Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:56.145997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:56.146019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:56.147727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.147753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.147765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.147776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:56.148056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:56.148084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.148219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.148396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.148610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:56.148694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401319281011321:7236], now have 1 active actors on pipe
2025-10-15T10:58:56.148720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401319281011315:7393], now have 1 active actors on pipe
2025-10-15T10:58:56.148741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401319281011163:2467], now have 1 active actors on pipe
2025-10-15T10:58:56.148770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401322080704028:6669]
2025-10-15T10:58:56.148785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401322080704028:6669]
2025-10-15T10:58:56.148798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401322080704028:6669]
2025-10-15T10:58:56.148838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:56.148920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:56.148967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:56.148983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:56.148994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:56.149094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:56.149110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:56.149268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:56.149289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:56.149322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401322080704028:6669]
2025-10-15T10:58:56.149352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:56.149373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:56.149485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:56.149516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:56.149533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:56.149543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:56.149578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:56.149617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:56.149697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:56.150525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:56.150552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:56.150617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:56.148908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 613
2025-10-15T10:58:56.149027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 613
2025-10-15T10:58:56.149101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 613, pipe: [1:7561401319281011321:7236]
2025-10-15T10:58:56.151138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 614 partition: 0 MaxSeqNo: 46 sessionId: src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0
2025-10-15T10:58:56.151909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5395bb-19ae01da-aca316d9-b696b08c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:56.173057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0] Write session: try to update token
2025-10-15T10:58:56.173123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:56.220470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:56.220502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:56.220515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:56.220527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:56.220563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401322080704028:6669]
2025-10-15T10:58:56.220591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401322080704028:6669]
2025-10-15T10:58:56.220618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401322080704028:6669]
2025-10-15T10:58:56.220792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:56.220825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:56.220835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:56.220855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:56.220872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:56.232798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:56.261681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId: src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:56.286965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:56.387240Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:56.394712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:56.394754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:56.395571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:56.395598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401319281011321:7236]
2025-10-15T10:58:56.395778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:56.395813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:56.398834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:56.404998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 614 reason: error at write: Disconnected sessionId: src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0
2025-10-15T10:58:56.405282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 614 sessionId: src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0 is DEAD
2025-10-15T10:58:56.405775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:56.405848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0] Write session will restart in 0.009169s
2025-10-15T10:58:56.405949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0] Write session: Do CDS request
2025-10-15T10:58:56.405977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:56.419504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:56.419537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 615
2025-10-15T10:58:56.419706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:56.420204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:56.420325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:56.420352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:56.420360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:56.421269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 615 sessionId:  describe result for acl check
2025-10-15T10:58:56.421364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:56.421379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:56.421387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:56.421401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401319281011355:7400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:56.423572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401319281011355:7400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:56.430020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401319281011355:7400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:56.441567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401319281011355:7400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:56.441610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401319281011355:7400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:56.441625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401319281011355:7400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:56.441653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:56.459823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:56.464776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:56.465621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:56.465652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:56.465693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:56.465963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:56.466179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401322080704236:6673]
2025-10-15T10:58:56.468329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:56.469246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:56.469450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:56.470650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:56.470964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.470972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.470979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.470985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.470992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.470998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.471004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.471010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.471017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.471022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.471029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.471036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.471042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.471048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.471089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.471188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.471230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.471273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.471316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.471381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.471423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.471467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.471510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.471551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.471592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.471634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.471675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.471717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.471761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.471821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.471874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.471925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.471987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.472035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.472075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.472123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.472174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.472235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.472287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.472344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.472423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.472495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.472554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.472623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.472688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.472750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.472806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.472869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.472921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.472981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.473040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.473108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.473162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.473227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.473288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.473349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.473821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:56.493998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:56.496561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401319281011533:7236]
2025-10-15T10:58:56.516636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:56.516682Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:56.516698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:56.516716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:56.516739Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 614 [2:7561401322080704236:6673]
2025-10-15T10:58:56.516790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:56.516840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:56.516851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:56.516860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:56.516868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:56.516899Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:56.516916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:56.516932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:56.517913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.517940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.517954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.517964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:56.518581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 614
2025-10-15T10:58:56.518594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 614
2025-10-15T10:58:56.518670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 614, pipe: [1:7561401319281011533:7236]
2025-10-15T10:58:56.518246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:56.518275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.518408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.518588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.518814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:56.518874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401319281011445:7400], now have 1 active actors on pipe
2025-10-15T10:58:56.518897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401319281011341:2467], now have 1 active actors on pipe
2025-10-15T10:58:56.518917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401319281011533:7236], now have 1 active actors on pipe
2025-10-15T10:58:56.518960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:56.518978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:56.519024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401322080704231:6673]
2025-10-15T10:58:56.519037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401322080704231:6673]
2025-10-15T10:58:56.519049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401322080704231:6673]
2025-10-15T10:58:56.519084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:56.519123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:56.519128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:56.519137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:56.519147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:56.519265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:56.519281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:56.519326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:56.519702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:56.519728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:56.519739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:56.519770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:56.519796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:56.519907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401322080704231:6673]
2025-10-15T10:58:56.519941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:56.519981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:56.519990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:56.520430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:56.520456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:56.520515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:56.520895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 615 partition: 0 MaxSeqNo: 46 sessionId: src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0
2025-10-15T10:58:56.521615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f26bb260-42ecd694-14119713-f7bd2cc8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:56.543161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0] Write session: try to update token
2025-10-15T10:58:56.543210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:56.557708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:56.557731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:56.557768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401322080704231:6673]
2025-10-15T10:58:56.557854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:56.557872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:56.560215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:56.564724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:56.566175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:56.568511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:56.570492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:56.571382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:56.649464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:56.649500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:56.649513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:56.649571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:56.649588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:56.649603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:56.649614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:56.649657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401322080704231:6673]
2025-10-15T10:58:56.649684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401322080704231:6673]
2025-10-15T10:58:56.649709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401322080704231:6673]
2025-10-15T10:58:56.649863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:56.649884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:56.650842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:56.651477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:56.651517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:56.651549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:56.680727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId: src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:56.720562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:56.802264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:56.807456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:56.807507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:56.808258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:56.809287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:56.809457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401319281011533:7236]
2025-10-15T10:58:56.809565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:56.818653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 615 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0
2025-10-15T10:58:56.818957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 615 sessionId: src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0 is DEAD
2025-10-15T10:58:56.829534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:56.829594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0] Write session will restart in 0.008154s
2025-10-15T10:58:56.829711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0] Write session: Do CDS request
2025-10-15T10:58:56.829760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:56.848508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:56.848541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 616
2025-10-15T10:58:56.849002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:56.849639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:56.849774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:56.849793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:56.849801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:56.851035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 616 sessionId:  describe result for acl check
2025-10-15T10:58:56.851134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:56.851143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:56.851151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:56.851166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401319281011580:7406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:56.853960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401319281011580:7406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:56.859298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401319281011580:7406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:56.865880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401319281011580:7406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:56.865920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401319281011580:7406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:56.865934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401319281011580:7406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:56.865958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:56.882342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:56.888189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:56.889102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:56.889129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:56.889173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:56.889434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:56.889620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401322080704446:6678]
2025-10-15T10:58:56.891948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:56.892908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:56.893138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:56.894461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:56.894790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.894806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.894814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.894821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.894828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.894836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.894842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.894849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.894856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.894864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.894871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.894880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.894886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.894893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.894940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.895056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.895105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.895153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.895208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.895257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.895306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.895367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.895413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.895460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.895504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.895551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.895598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.895642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.895690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.895759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:56.895820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.895886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:56.895937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.895993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:56.896051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.896114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:56.896168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.896229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:56.896281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.896344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:56.896400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.896460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:56.896515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.896575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:56.896625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.896694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:56.896742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.896799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:56.896848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.896906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:56.896954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.897012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.897062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.897119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.897167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.897223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.897757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:56.908651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401319281011752:7236]
2025-10-15T10:58:56.926252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:56.936108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:56.936158Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:56.936178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:56.936199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:56.936227Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 615 [2:7561401322080704446:6678]
2025-10-15T10:58:56.936283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:56.936348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:56.936363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:56.936377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:56.936391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:56.936444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:56.936470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:56.936493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:56.938621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.938652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.938669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.938682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:56.938947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:56.938975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:56.939137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:56.939217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 615
2025-10-15T10:58:56.939223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 615, pipe: [1:7561401319281011752:7236]
2025-10-15T10:58:56.939314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 615
2025-10-15T10:58:56.939369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:56.939638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:56.939733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401319281011673:7406], now have 1 active actors on pipe
2025-10-15T10:58:56.939766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401319281011752:7236], now have 1 active actors on pipe
2025-10-15T10:58:56.939789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401319281011546:2467], now have 1 active actors on pipe
2025-10-15T10:58:56.939845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:56.939868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:56.939927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401322080704441:6678]
2025-10-15T10:58:56.939944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401322080704441:6678]
2025-10-15T10:58:56.939959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401322080704441:6678]
2025-10-15T10:58:56.940001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:56.940038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:56.940053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:56.940065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:56.940081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:56.940277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:56.940297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:56.940365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:56.940399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:56.940420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:56.940432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:56.940470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:56.940514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:56.940650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401322080704441:6678]
2025-10-15T10:58:56.940679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:56.940698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:56.940725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:56.942205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:56.942231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:56.942302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:56.942624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 616 partition: 0 MaxSeqNo: 46 sessionId: src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0
2025-10-15T10:58:56.943416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aea69c4-9e4d165b-80d2feaa-9ec0e1df_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:56.987195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:56.987226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:56.987257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401322080704441:6678]
2025-10-15T10:58:56.987639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:56.987706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:56.989698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:56.991034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:56.992191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0] Write session: try to update token
2025-10-15T10:58:56.992236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:56.992705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:56.997261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:57.000824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:57.001315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:57.058110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:57.058139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:57.058151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:57.058201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:57.058214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:57.058225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:57.058236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:57.058273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401322080704441:6678]
2025-10-15T10:58:57.058299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401322080704441:6678]
2025-10-15T10:58:57.058321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401322080704441:6678]
2025-10-15T10:58:57.058448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:57.058470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:57.058500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:57.058550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:57.058584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:57.059572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:57.100843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId: src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:57.123127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:57.216211Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:57.221441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:57.221477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:57.222117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:57.223529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:57.235193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:57.235275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0] Write session will restart in 0.006940s
2025-10-15T10:58:57.233875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401319281011752:7236]
2025-10-15T10:58:57.235445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0] Write session: Do CDS request
2025-10-15T10:58:57.233948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:57.234036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 616 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0
2025-10-15T10:58:57.235477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:57.234283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 616 sessionId: src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0 is DEAD
2025-10-15T10:58:57.251541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:57.255998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:57.256032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 617
2025-10-15T10:58:57.256393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:57.256505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:57.256525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:57.256533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:57.257695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 617 sessionId:  describe result for acl check
2025-10-15T10:58:57.257810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:57.257827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:57.257834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:57.257843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401323575979084:7412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:57.259892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401323575979084:7412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:57.265849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401323575979084:7412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:57.272104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401323575979084:7412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:57.272135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401323575979084:7412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:57.272146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401323575979084:7412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:57.272165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:57.307912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:57.313314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:57.314451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:57.314467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:57.314503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:57.314741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:57.314890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401326375671969:6690]
2025-10-15T10:58:57.317069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:57.318047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:57.318234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:57.319437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:57.319733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:57.319749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:57.319755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:57.319762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:57.319768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:57.319775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:57.319781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:57.319787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:57.319794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:57.319800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:57.319807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:57.319814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.319821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.319827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.319869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:57.319966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:57.320007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:57.320051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:57.320091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:57.320134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:57.320176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:57.320217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:57.320257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:57.320300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:57.320340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:57.320384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.320426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.320465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.320500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:57.320564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:57.320621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:57.320684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:57.320729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:57.320777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:57.320819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:57.320875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:57.320920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:57.320971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:57.321018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:57.321066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:57.321109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:57.321154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:57.321192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:57.321259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:57.321321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:57.321382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:57.321427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:57.321478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:57.321524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:57.321573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:57.321619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.321673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.321717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.321780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.321823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.321873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.322396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:57.334137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401323575979268:7236]
2025-10-15T10:58:57.345461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:57.357158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:57.357199Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:57.357214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:57.357232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:57.357253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 616 [2:7561401326375671969:6690]
2025-10-15T10:58:57.357298Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:57.357348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:57.357362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:57.357373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:57.357384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:57.357441Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:57.357460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:57.357478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:57.360290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.360317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.360330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.360339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:57.360596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:57.360619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.360740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.360908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.361122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:57.361185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401326375671964:6690]
2025-10-15T10:58:57.361198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401326375671964:6690]
2025-10-15T10:58:57.361211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401326375671964:6690]
2025-10-15T10:58:57.361246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:57.361308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:57.361461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:57.361475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:57.361574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401326375671964:6690]
2025-10-15T10:58:57.361591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:57.361829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:57.361840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:57.361850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:57.361871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:57.362394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401323575979073:2467], now have 1 active actors on pipe
2025-10-15T10:58:57.362425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401323575979268:7236], now have 1 active actors on pipe
2025-10-15T10:58:57.362445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401323575979118:7412], now have 1 active actors on pipe
2025-10-15T10:58:57.362592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 616
2025-10-15T10:58:57.362676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 616, pipe: [1:7561401323575979268:7236]
2025-10-15T10:58:57.362736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 616
2025-10-15T10:58:57.363779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:57.363806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:57.363871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38130fcd-b146c68f-5289413f-79e6add_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:57.363898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:57.363913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:57.363923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:57.363954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:57.363990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:57.364030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:57.364886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:57.364908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:57.364966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:57.365384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 617 partition: 0 MaxSeqNo: 46 sessionId: src_id|38130fcd-b146c68f-5289413f-79e6add_0
2025-10-15T10:58:57.366289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae3b904-46b9ddd5-4d647c75-c7905093_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|38130fcd-b146c68f-5289413f-79e6add_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:57.391096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38130fcd-b146c68f-5289413f-79e6add_0] Write session: try to update token
2025-10-15T10:58:57.391161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38130fcd-b146c68f-5289413f-79e6add_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:57.402418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:57.402456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:57.402499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401326375671964:6690]
2025-10-15T10:58:57.402693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:57.403897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:57.405282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:57.457836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:57.458783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:57.460428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:57.466305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:57.466944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:57.466957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:57.466968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:57.467025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:58:57.496400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:57.496440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:57.496452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:57.496463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:57.496510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401326375671964:6690]
2025-10-15T10:58:57.496535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401326375671964:6690]
2025-10-15T10:58:57.496565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401326375671964:6690]
2025-10-15T10:58:57.496706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:57.496733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:57.496742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:57.496788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:57.496818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:57.497869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:57.512638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId: src_id|38130fcd-b146c68f-5289413f-79e6add_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:57.532926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:57.639189Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:57.641422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:57.641465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:57.646919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:57.647093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401323575979268:7236]
2025-10-15T10:58:57.642175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:57.647185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:57.657187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 617 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38130fcd-b146c68f-5289413f-79e6add_0
2025-10-15T10:58:57.657473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 617 sessionId: src_id|38130fcd-b146c68f-5289413f-79e6add_0 is DEAD
2025-10-15T10:58:57.657965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38130fcd-b146c68f-5289413f-79e6add_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:57.658019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38130fcd-b146c68f-5289413f-79e6add_0] Write session will restart in 0.005249s
2025-10-15T10:58:57.658189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38130fcd-b146c68f-5289413f-79e6add_0] Write session: Do CDS request
2025-10-15T10:58:57.658242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38130fcd-b146c68f-5289413f-79e6add_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:57.667475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:57.667514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 618
2025-10-15T10:58:57.668237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38130fcd-b146c68f-5289413f-79e6add_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:57.668772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:57.668910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:57.668927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:57.668938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:57.670360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 618 sessionId:  describe result for acl check
2025-10-15T10:58:57.670484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:57.670494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:57.670503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:57.670521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401323575979307:7424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:57.673518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401323575979307:7424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:57.715405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401323575979307:7424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:57.733177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401323575979307:7424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:57.733225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401323575979307:7424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:57.733241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401323575979307:7424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:57.733270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:57.747244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401323575979482:7236]
2025-10-15T10:58:57.753408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:57.760869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:57.761735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:57.761775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:57.761817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:57.762077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:57.762250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401326375672175:6694]
2025-10-15T10:58:57.764340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:57.765456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:57.765684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:57.766854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:57.767161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:57.767168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:57.767175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:57.767182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:57.767187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:57.767193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:57.767201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:57.767207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:57.767213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:57.767219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:57.767225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:57.767231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.767238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.767243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.767289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:57.767413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:57.767466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:57.767514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:57.767558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:57.767603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:57.767648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:57.767693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:57.767751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:57.767799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:57.767841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:57.767887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.767930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.767975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.768016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:57.768082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:57.768138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:57.768191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:57.768240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:57.768292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:57.768336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:57.768387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:57.769807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:57.769879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:57.769927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:57.769979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:57.770028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:57.770082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:57.770125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:57.770177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:57.770236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:57.770288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:57.770330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:57.770381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:57.770425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:57.770473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:57.770517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.770567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.770614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.770663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.770726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.770778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.771269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:57.790221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:57.799671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:57.799726Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:57.799744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:57.799761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:57.799785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 617 [2:7561401326375672175:6694]
2025-10-15T10:58:57.799843Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:57.799903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:57.799917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:57.799929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:57.799940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:57.799984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:57.800005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:57.800025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:57.801209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.801224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.801237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.801248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:57.801508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:57.801532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:57.801665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:57.801838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:57.802027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:57.802106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401323575979482:7236], now have 1 active actors on pipe
2025-10-15T10:58:57.802132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401323575979294:2467], now have 1 active actors on pipe
2025-10-15T10:58:57.802154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401323575979446:7424], now have 1 active actors on pipe
2025-10-15T10:58:57.802180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401326375672170:6694]
2025-10-15T10:58:57.802197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401326375672170:6694]
2025-10-15T10:58:57.802208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401326375672170:6694]
2025-10-15T10:58:57.802246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:57.802319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:57.802474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:57.802494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:57.802602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401326375672170:6694]
2025-10-15T10:58:57.802626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:57.803333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 617, pipe: [1:7561401323575979482:7236]
2025-10-15T10:58:57.803457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 617
2025-10-15T10:58:57.803558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 617
2025-10-15T10:58:57.804064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:57.804085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:57.804096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:57.804120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:57.805993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:57.806030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:57.806099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9747400a-a580c27a-a48bf475-40f993dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:57.806136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:57.806152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:57.806161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:57.806193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:57.806232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:57.806275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:57.807849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:57.807887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:57.807961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:57.811540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 618 partition: 0 MaxSeqNo: 46 sessionId: src_id|9747400a-a580c27a-a48bf475-40f993dc_0
2025-10-15T10:58:57.815602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38130fcd-b146c68f-5289413f-79e6add_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9747400a-a580c27a-a48bf475-40f993dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:57.862531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9747400a-a580c27a-a48bf475-40f993dc_0] Write session: try to update token
2025-10-15T10:58:57.862595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9747400a-a580c27a-a48bf475-40f993dc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:57.896800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:57.896836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:57.896849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:57.959782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:57.959817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:57.959832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:57.959843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:57.959881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401326375672170:6694]
2025-10-15T10:58:57.959909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401326375672170:6694]
2025-10-15T10:58:57.959934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401326375672170:6694]
2025-10-15T10:58:57.960029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:57.960064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:57.960083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:57.960087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:57.960112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:57.961179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:57.979299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId: src_id|9747400a-a580c27a-a48bf475-40f993dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:58.004290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:58.140487Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:58.146398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:58.146439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:58.151998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401323575979482:7236]
2025-10-15T10:58:58.152085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:58.152211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:58.152224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:58.152390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:58.181651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 618 reason: error at write: Disconnected sessionId: src_id|9747400a-a580c27a-a48bf475-40f993dc_0
2025-10-15T10:58:58.182020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 618 sessionId: src_id|9747400a-a580c27a-a48bf475-40f993dc_0 is DEAD
2025-10-15T10:58:58.183460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9747400a-a580c27a-a48bf475-40f993dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:58.183652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9747400a-a580c27a-a48bf475-40f993dc_0] Write session will restart in 0.006426s
2025-10-15T10:58:58.183754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9747400a-a580c27a-a48bf475-40f993dc_0] Write session: Do CDS request
2025-10-15T10:58:58.183787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9747400a-a580c27a-a48bf475-40f993dc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:58.199145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:58.199186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 619
2025-10-15T10:58:58.200072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9747400a-a580c27a-a48bf475-40f993dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:58.200741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:58.200886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:58.200901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:58.200911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:58.202777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 619 sessionId:  describe result for acl check
2025-10-15T10:58:58.202896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:58.202908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:58.202918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:58.202936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401327870946829:7429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:58.207404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401327870946829:7429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:58.222865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401327870946829:7429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:58.234690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401327870946829:7429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:58.234739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401327870946829:7429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:58.234759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401327870946829:7429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:58.234795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:58.252220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401327870946982:7236]
2025-10-15T10:58:58.271270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:58.280052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:58.280812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:58.280829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:58.280863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:58.281085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:58.281253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401330670639695:6698]
2025-10-15T10:58:58.283253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:58.285579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:58.285799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:58.287319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:58.287670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:58.287679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:58.287685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:58.287692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:58.287699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:58.287706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:58.287712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:58.287720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:58.287727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:58.287733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:58.287739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:58.287746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.287752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.287758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.287802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:58.287901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:58.287945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:58.287988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:58.288033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:58.288079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:58.288122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:58.288164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:58.288206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:58.288249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:58.288290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:58.288330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.288373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.288413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.289044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:58.289115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:58.289167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:58.289220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:58.289265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:58.289311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:58.289351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:58.289396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:58.289438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:58.289487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:58.289529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:58.289578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:58.289621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:58.289669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:58.289710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:58.289759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:58.289817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:58.289870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:58.289912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:58.289966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:58.290010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:58.290055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:58.290096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.290147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.290188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.290238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.290282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.290328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.290787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:58.316323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:58.337505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:58.337731Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:58.337754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:58.337789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:58.337814Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 618 [2:7561401330670639695:6698]
2025-10-15T10:58:58.337868Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:58.337932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:58.337949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:58.337962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:58.337973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:58.338024Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:58.338049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:58.338073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:58.339937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.339954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.339968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.339979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:58.340261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:58.340279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.340426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.340617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.340855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:58.340924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401330670639687:6698]
2025-10-15T10:58:58.340939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401330670639687:6698]
2025-10-15T10:58:58.340953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401330670639687:6698]
2025-10-15T10:58:58.341101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:58.341115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:58.341128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:58.342344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 618, pipe: [1:7561401327870946982:7236]
2025-10-15T10:58:58.342435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 618
2025-10-15T10:58:58.342488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 618
2025-10-15T10:58:58.343053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:58.343157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:58.343374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:58.343392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:58.343449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401327870946982:7236], now have 1 active actors on pipe
2025-10-15T10:58:58.343476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401327870946945:7429], now have 1 active actors on pipe
2025-10-15T10:58:58.343497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401327870946811:2467], now have 1 active actors on pipe
2025-10-15T10:58:58.343548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:58.343571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:58.343726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401330670639687:6698]
2025-10-15T10:58:58.343760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:58.343836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:58.343869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:58.343890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:58.343902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:58.343948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:58.343996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:58.344144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:58.344623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:58.346317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:58.346345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:58.346419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:58.346822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 619 partition: 0 MaxSeqNo: 46 sessionId: src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0
2025-10-15T10:58:58.347816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9747400a-a580c27a-a48bf475-40f993dc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:58.389606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0] Write session: try to update token
2025-10-15T10:58:58.389666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:58.472248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:58.472279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:58.472292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:58.472303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:58.472334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401330670639687:6698]
2025-10-15T10:58:58.472360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401330670639687:6698]
2025-10-15T10:58:58.472383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401330670639687:6698]
2025-10-15T10:58:58.472529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:58.472541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:58.472552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:58.472592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:58.472611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:58.473004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:58.473055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:58.473085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:58.488926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:58.586447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId: src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:58.609447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:58.640502Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:58.642509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:58.642543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:58.643401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401327870946982:7236]
2025-10-15T10:58:58.643479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:58:58.643492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:58:58.643494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:58.650628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:58.701596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 619 reason: error at write: Disconnected sessionId: src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0
2025-10-15T10:58:58.701921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 619 sessionId: src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0 is DEAD
2025-10-15T10:58:58.707627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:58:58.707683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0] Write session will restart in 0.005770s
2025-10-15T10:58:58.707821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0] Write session: Do CDS request
2025-10-15T10:58:58.707864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:58.717579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:58.744843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401327870947160:7236]
2025-10-15T10:58:58.744927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:58.744935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 620
2025-10-15T10:58:58.745246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:58.745325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:58.745339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:58.745346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:58.747970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 620 sessionId:  describe result for acl check
2025-10-15T10:58:58.748075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:58.748085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:58.748094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:58.748110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401327870947172:7440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:58.750557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401327870947172:7440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:58.757463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401327870947172:7440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:58.762563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:58.765996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:58.766224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401327870947172:7440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:58.766271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401327870947172:7440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:58.766286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401327870947172:7440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:58.766324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:58.766766Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:58.766785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:58.766819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:58.767021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:58.767135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401330670639916:6706]
2025-10-15T10:58:58.768863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:58.769731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:58.769946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:58.771172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:58.771501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:58.771517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:58.771523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:58.771530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:58.771536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:58.771543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:58.771549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:58.771555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:58.771562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:58.771568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:58.771574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:58.771581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.771586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.771593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.771636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:58.771739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:58.771782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:58.771828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:58.771878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:58.771932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:58.771973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:58.772014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:58.772056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:58.772098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:58.772139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:58.772181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.772223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.772266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.772304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:58.772363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:58.772416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:58.772466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:58.772512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:58.772558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:58.772598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:58.772644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:58.772689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:58.772740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:58.772779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:58.772826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:58.772871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:58.772925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:58.772967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:58.773014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:58.773100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:58.773157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:58.773203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:58.773252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:58.773297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:58.773346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:58.773389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.773436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.773482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.773530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.773572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.773623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.774112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:58.794973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:58.807343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:58.807398Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:58.807416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:58.807433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:58.807456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 619 [2:7561401330670639916:6706]
2025-10-15T10:58:58.807504Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:58.807559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:58.807572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:58.807584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:58.807594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:58.807636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:58.807656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:58.807677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:58.837554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.837585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.837596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.837605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:58.837878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:58.837894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:58.838024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:58.838187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:58.838388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:58.838456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401330670639911:6706]
2025-10-15T10:58:58.838469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401330670639911:6706]
2025-10-15T10:58:58.838479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401330670639911:6706]
2025-10-15T10:58:58.838520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:58.838587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:58.838755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:58.838771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:58.838892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401330670639911:6706]
2025-10-15T10:58:58.838909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:58.840433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 619
2025-10-15T10:58:58.840550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 619
2025-10-15T10:58:58.840622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 619, pipe: [1:7561401327870947160:7236]
2025-10-15T10:58:58.842022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 620 partition: 0 MaxSeqNo: 46 sessionId: src_id|34fd786e-337e4da2-500475df-24f98cbf_0
2025-10-15T10:58:58.843023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb6d542-c39fcea5-1e4a28a5-1d959f6a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|34fd786e-337e4da2-500475df-24f98cbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:58.839442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:58.839467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:58.839478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:58.839503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:58.840341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401327870947160:7236], now have 1 active actors on pipe
2025-10-15T10:58:58.840369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401327870947020:2467], now have 1 active actors on pipe
2025-10-15T10:58:58.840390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401327870947226:7440], now have 1 active actors on pipe
2025-10-15T10:58:58.840834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:58.840858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:58.840932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34fd786e-337e4da2-500475df-24f98cbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:58.840964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:58.840981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:58.840991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:58.841026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:58.841070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:58.841113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:58.841589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:58.841605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:58.841664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:58.916987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:58.917018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:58.917029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:58.917081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:58.917094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:58.917125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401330670639911:6706]
2025-10-15T10:58:58.917235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:58:58.917267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:58.923447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:58:58.925235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:58.926835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:58.930213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fd786e-337e4da2-500475df-24f98cbf_0] Write session: try to update token
2025-10-15T10:58:58.930264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fd786e-337e4da2-500475df-24f98cbf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:58.931433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:58:58.933161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:58:58.933500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
E1015 10:58:59.016115752  821071 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:58:59.017913Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:58:59.056505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:59.056537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:59.056552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:59.056564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:59.056602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401330670639911:6706]
2025-10-15T10:58:59.056630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401330670639911:6706]
2025-10-15T10:58:59.056654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401330670639911:6706]
2025-10-15T10:58:59.056795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:59.056807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:59.056818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:59.056856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:59.056875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:59.057897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:59.057931Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:59.057937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:59.057979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:59.092875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId: src_id|34fd786e-337e4da2-500475df-24f98cbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:59.114361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:59.204406Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:59.205909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:59.205948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:59.206758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:59.207744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401327870947160:7236]
2025-10-15T10:58:59.207848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:59.208055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:59.244961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 620 reason: status is not ok: tablet will be restarted right now sessionId: src_id|34fd786e-337e4da2-500475df-24f98cbf_0
2025-10-15T10:58:59.245255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 620 sessionId: src_id|34fd786e-337e4da2-500475df-24f98cbf_0 is DEAD
2025-10-15T10:58:59.247649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fd786e-337e4da2-500475df-24f98cbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:59.247708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fd786e-337e4da2-500475df-24f98cbf_0] Write session will restart in 0.006114s
2025-10-15T10:58:59.247890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fd786e-337e4da2-500475df-24f98cbf_0] Write session: Do CDS request
2025-10-15T10:58:59.247935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fd786e-337e4da2-500475df-24f98cbf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:59.260897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fd786e-337e4da2-500475df-24f98cbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:59.261553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:59.261598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 621
2025-10-15T10:58:59.263185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:59.263302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:59.263316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:59.263324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:59.264727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 621 sessionId:  describe result for acl check
2025-10-15T10:58:59.264837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:59.264853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:59.264862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:59.264877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401332165914611:7450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:59.267246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401332165914611:7450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:59.288310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401332165914611:7450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:59.301007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401332165914611:7450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:59.301054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401332165914611:7450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:59.301070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401332165914611:7450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:59.301099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:59.308666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401332165914696:7236]
2025-10-15T10:58:59.341486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:59.346665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:59.347677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:59.347710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:59.347757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:59.348350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:59.348576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401334965607434:6717]
2025-10-15T10:58:59.350925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:59.352651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:59.352902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:59.354337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:59.354705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:59.354724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:59.354732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:59.354740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:59.354747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:59.354755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:59.354763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:59.354771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:59.354779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:59.354787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:59.354794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:59.354802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.354809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.354817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.354870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:59.354997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:59.355052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:59.355116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:59.355171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:59.355225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:59.355281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:59.355337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:59.355415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:59.355474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:59.355524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:59.355579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.355631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.355682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.356308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:59.356402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:59.356469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:59.356529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:59.356582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:59.356640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:59.356689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:59.356747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:59.356804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:59.356867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:59.356917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:59.356976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:59.357024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:59.357079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:59.357128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:59.357185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:59.357238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:59.357292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:59.357339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:59.357396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:59.357447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:59.357505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:59.357555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.357611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.357660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.357718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.357767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.357837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.358376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:59.380317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:59.389078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:59.389129Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:59.389150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:59.389171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:59.389199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 620 [2:7561401334965607434:6717]
2025-10-15T10:58:59.389259Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:59.389328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:59.389344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:59.389356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:59.389369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:59.389423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:59.389448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:59.389470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:59.390571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.390598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.390613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.390624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:59.390914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:59.390939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.391088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.391294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.391474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 620, pipe: [1:7561401332165914696:7236]
2025-10-15T10:58:59.391511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 620
2025-10-15T10:58:59.391590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 620
2025-10-15T10:58:59.391661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:59.391760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401332165914696:7236], now have 1 active actors on pipe
2025-10-15T10:58:59.391785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401332165914695:7450], now have 1 active actors on pipe
2025-10-15T10:58:59.391807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401332165914574:2467], now have 1 active actors on pipe
2025-10-15T10:58:59.391833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401334965607429:6717]
2025-10-15T10:58:59.391852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401334965607429:6717]
2025-10-15T10:58:59.391867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401334965607429:6717]
2025-10-15T10:58:59.391907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:59.392002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:59.392194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:59.392212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:59.392272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:59.392295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:59.392444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401334965607429:6717]
2025-10-15T10:58:59.392465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:59.392542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|553c203a-59262c8e-89ea375a-22c4d97f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:59.392573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:59.392592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:59.392604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:59.392645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:59.392690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:59.392837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:59.393189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:59.393205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:59.393220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:59.393246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:59.394134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:59.394177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:59.394262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:59.394834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 621 partition: 0 MaxSeqNo: 46 sessionId: src_id|553c203a-59262c8e-89ea375a-22c4d97f_0
2025-10-15T10:58:59.398207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fd786e-337e4da2-500475df-24f98cbf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|553c203a-59262c8e-89ea375a-22c4d97f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:59.426491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|553c203a-59262c8e-89ea375a-22c4d97f_0] Write session: try to update token
2025-10-15T10:58:59.426559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|553c203a-59262c8e-89ea375a-22c4d97f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:59.506313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:59.506351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:59.506366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:59.506376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:59.506414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401334965607429:6717]
2025-10-15T10:58:59.506438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401334965607429:6717]
2025-10-15T10:58:59.506460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401334965607429:6717]
2025-10-15T10:58:59.506697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:59.506710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:59.506722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:59.506769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:59.506789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:59.506984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:59.507023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:59.507071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:59.507981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:59.570192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId: src_id|553c203a-59262c8e-89ea375a-22c4d97f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:58:59.590833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:58:59.654278Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:58:59.682837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:59.682888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:59.682967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:58:59.682984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:59.683030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401334965607429:6717]
2025-10-15T10:58:59.683247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:58:59.683674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:58:59.686315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:58:59.686614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401332165914696:7236]
2025-10-15T10:58:59.686619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:58:59.694623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 621 reason: status is not ok: tablet will be restarted right now sessionId: src_id|553c203a-59262c8e-89ea375a-22c4d97f_0
2025-10-15T10:58:59.695215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 621 sessionId: src_id|553c203a-59262c8e-89ea375a-22c4d97f_0 is DEAD
2025-10-15T10:58:59.697570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553c203a-59262c8e-89ea375a-22c4d97f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:58:59.697650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553c203a-59262c8e-89ea375a-22c4d97f_0] Write session will restart in 0.006816s
2025-10-15T10:58:59.697824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553c203a-59262c8e-89ea375a-22c4d97f_0] Write session: Do CDS request
2025-10-15T10:58:59.697864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553c203a-59262c8e-89ea375a-22c4d97f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:58:59.710391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:58:59.710435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 622
2025-10-15T10:58:59.710779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|553c203a-59262c8e-89ea375a-22c4d97f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:59.711440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:58:59.711594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:58:59.711613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:58:59.711625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:58:59.713349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 622 sessionId:  describe result for acl check
2025-10-15T10:58:59.713464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:58:59.713476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:58:59.713485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:58:59.713504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401332165914798:7455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:58:59.716171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401332165914798:7455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:58:59.726848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401332165914798:7455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:58:59.744273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401332165914798:7455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:58:59.744330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401332165914798:7455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:58:59.744346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401332165914798:7455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:58:59.744378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:58:59.780362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:58:59.782218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:58:59.783070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:58:59.783092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:58:59.783135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:58:59.783414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:58:59.783605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401334965607639:6719]
2025-10-15T10:58:59.785877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:58:59.788489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:58:59.788718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:58:59.787612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401332165914980:7236]
2025-10-15T10:58:59.790084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:58:59.790425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:59.790443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:59.790451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:59.790459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:59.790467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:59.790476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:59.790483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:59.790492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:59.790500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:59.790507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:59.790515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:59.790522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.790530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.790537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.790590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:59.790710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:59.790763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:59.790814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:59.790865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:59.790916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:59.790968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:59.791016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:59.791065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:59.791118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:59.791167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:59.791217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.791267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.791316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.791963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:59.792048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:58:59.792111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:59.792171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:58:59.792223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:59.792281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:58:59.792334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:59.792394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:58:59.792461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:59.792516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:58:59.792565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:59.792617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:58:59.792664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:59.792717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:58:59.792762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:59.792819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:58:59.792874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:59.792933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:58:59.792983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:59.793039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:58:59.793090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:59.793147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:58:59.793192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.793248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.793297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.793355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.793403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.793458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.794017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:58:59.816890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:58:59.828243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:58:59.828291Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:58:59.828310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:58:59.828332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:58:59.828360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 621 [2:7561401334965607639:6719]
2025-10-15T10:58:59.828414Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:58:59.828478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:58:59.828493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:59.828506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:59.828518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:59.828571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:58:59.828594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:58:59.828616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:58:59.861501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.861531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.861545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.861557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:58:59.861848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:58:59.861866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:58:59.862001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:58:59.862173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:58:59.862393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:58:59.862458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401334965607634:6719]
2025-10-15T10:58:59.862474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401334965607634:6719]
2025-10-15T10:58:59.862486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401334965607634:6719]
2025-10-15T10:58:59.862518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:58:59.862574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:58:59.862590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:58:59.862593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:58:59.862602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:58:59.862766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:58:59.862782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:58:59.862824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401332165914980:7236], now have 1 active actors on pipe
2025-10-15T10:58:59.862849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401332165914855:7455], now have 1 active actors on pipe
2025-10-15T10:58:59.862870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401332165914784:2467], now have 1 active actors on pipe
2025-10-15T10:58:59.862982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401334965607634:6719]
2025-10-15T10:58:59.863010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:58:59.863509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:58:59.865010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:59.865044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:59.865120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b186816-743e264c-3cdb08dc-edb5c468_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:58:59.865145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:58:59.865159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:58:59.865166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:58:59.865193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:58:59.865226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:58:59.865258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:59.866348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:58:59.863480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 621, pipe: [1:7561401332165914980:7236]
2025-10-15T10:58:59.866376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:58:59.863585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 621
2025-10-15T10:58:59.866423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:58:59.863636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 621
2025-10-15T10:58:59.867364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553c203a-59262c8e-89ea375a-22c4d97f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4b186816-743e264c-3cdb08dc-edb5c468_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:58:59.866628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 622 partition: 0 MaxSeqNo: 46 sessionId: src_id|4b186816-743e264c-3cdb08dc-edb5c468_0
2025-10-15T10:58:59.892051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b186816-743e264c-3cdb08dc-edb5c468_0] Write session: try to update token
2025-10-15T10:58:59.892112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b186816-743e264c-3cdb08dc-edb5c468_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:58:59.927819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:58:59.927847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:58:59.927862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:58:59.927873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:58:59.927900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401334965607634:6719]
2025-10-15T10:58:59.927918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401334965607634:6719]
2025-10-15T10:58:59.927934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401334965607634:6719]
2025-10-15T10:58:59.928024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:58:59.928061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:58:59.928105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:58:59.928129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:58:59.928159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:58:59.929898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:58:59.983975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId: src_id|4b186816-743e264c-3cdb08dc-edb5c468_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:00.005029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:00.078316Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:00.094759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:00.094801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:00.094849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:00.094864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:00.094903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401334965607634:6719]
2025-10-15T10:59:00.095203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:00.095670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:00.095721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:00.095735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401332165914980:7236]
2025-10-15T10:59:00.095758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:00.095822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:00.126725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 622 reason: error at write: Disconnected sessionId: src_id|4b186816-743e264c-3cdb08dc-edb5c468_0
2025-10-15T10:59:00.127086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 622 sessionId: src_id|4b186816-743e264c-3cdb08dc-edb5c468_0 is DEAD
2025-10-15T10:59:00.130112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b186816-743e264c-3cdb08dc-edb5c468_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:00.130173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b186816-743e264c-3cdb08dc-edb5c468_0] Write session will restart in 0.007241s
2025-10-15T10:59:00.130345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b186816-743e264c-3cdb08dc-edb5c468_0] Write session: Do CDS request
2025-10-15T10:59:00.130400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b186816-743e264c-3cdb08dc-edb5c468_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:00.142429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:00.142469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 623
2025-10-15T10:59:00.142831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b186816-743e264c-3cdb08dc-edb5c468_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:00.143455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:00.143603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:00.143626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:00.143636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:00.145571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 623 sessionId:  describe result for acl check
2025-10-15T10:59:00.145687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:00.145707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:00.145717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:00.145734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401336460882332:7460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:00.148262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401336460882332:7460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:00.161370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401336460882332:7460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:00.176210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401336460882332:7460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:00.176260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401336460882332:7460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:00.176278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401336460882332:7460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:00.176310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:00.197650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401336460882506:7236]
2025-10-15T10:59:00.211777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:00.214137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:00.214937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:00.214965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:00.215008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:00.215245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:00.215436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401339260575160:6729]
2025-10-15T10:59:00.217631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:00.218629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:00.218862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:00.220258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:00.220631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:00.220648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:00.220655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:00.220663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:00.220672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:00.220679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:00.220686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:00.220694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:00.220701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:00.220709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:00.220716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:00.220723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.220729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.220737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.220787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:00.220903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:00.220983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:00.221036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:00.221088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:00.221138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:00.221189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:00.221238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:00.221289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:00.221340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:00.221385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:00.221429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.221479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.221530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.221585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:00.221663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:00.221733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:00.221807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:00.221856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:00.221916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:00.221963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:00.222017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:00.222066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:00.222123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:00.222171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:00.222228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:00.222279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:00.222337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:00.222388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:00.222446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:00.222502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:00.222560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:00.222608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:00.222664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:00.222713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:00.222771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:00.222830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.222891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.222944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.222997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.223033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.223075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.223511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:00.249479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:00.259778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:00.262564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 622
2025-10-15T10:59:00.259826Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:00.259843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:00.262672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 622
2025-10-15T10:59:00.259863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:00.262746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 622, pipe: [1:7561401336460882506:7236]
2025-10-15T10:59:00.259889Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 622 [2:7561401339260575160:6729]
2025-10-15T10:59:00.259944Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:00.260002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:00.260018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:00.260032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:00.260044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:00.260094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:00.260117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:00.260139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:00.261807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.261825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.261839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.261852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:00.262132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:00.262149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.262305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.262515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.262756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:00.262842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401336460882418:7460], now have 1 active actors on pipe
2025-10-15T10:59:00.262868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401336460882307:2467], now have 1 active actors on pipe
2025-10-15T10:59:00.262891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401336460882506:7236], now have 1 active actors on pipe
2025-10-15T10:59:00.262921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401339260575155:6729]
2025-10-15T10:59:00.262940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401339260575155:6729]
2025-10-15T10:59:00.262955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401339260575155:6729]
2025-10-15T10:59:00.262990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:00.263019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:00.263049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:00.263063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:00.263068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:00.263258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:00.263278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:00.263334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:00.264136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:00.264311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401339260575155:6729]
2025-10-15T10:59:00.264349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:00.264389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:00.264427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d363010-250fe9be-32c22834-4b039df6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:00.264459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:00.264480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:00.264490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:00.264527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:00.264570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:00.264703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:00.265148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:00.265174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:00.265239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:00.265522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 623 partition: 0 MaxSeqNo: 46 sessionId: src_id|2d363010-250fe9be-32c22834-4b039df6_0
2025-10-15T10:59:00.266288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b186816-743e264c-3cdb08dc-edb5c468_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2d363010-250fe9be-32c22834-4b039df6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:00.285701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d363010-250fe9be-32c22834-4b039df6_0] Write session: try to update token
2025-10-15T10:59:00.285755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d363010-250fe9be-32c22834-4b039df6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:00.386121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:00.386168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:00.386187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:00.386254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:00.386271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:00.386285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:00.386296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:00.386333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401339260575155:6729]
2025-10-15T10:59:00.386362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401339260575155:6729]
2025-10-15T10:59:00.386392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401339260575155:6729]
2025-10-15T10:59:00.386551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:00.386575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:00.386759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:00.386791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:00.386818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:00.393812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:00.412646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId: src_id|2d363010-250fe9be-32c22834-4b039df6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:00.441914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:00.541685Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:00.543796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:00.543839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:00.545688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:00.545724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:00.548208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:00.590857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 623 reason: error at write: Disconnected sessionId: src_id|2d363010-250fe9be-32c22834-4b039df6_0
2025-10-15T10:59:00.591174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 623 sessionId: src_id|2d363010-250fe9be-32c22834-4b039df6_0 is DEAD
2025-10-15T10:59:00.591875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d363010-250fe9be-32c22834-4b039df6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:00.591920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d363010-250fe9be-32c22834-4b039df6_0] Write session will restart in 0.006629s
2025-10-15T10:59:00.592062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d363010-250fe9be-32c22834-4b039df6_0] Write session: Do CDS request
2025-10-15T10:59:00.592115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d363010-250fe9be-32c22834-4b039df6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:00.604256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d363010-250fe9be-32c22834-4b039df6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:00.609935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:00.610090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401336460882506:7236]
2025-10-15T10:59:00.610163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:00.610185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 624
2025-10-15T10:59:00.610576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:00.610713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:00.610733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:00.610741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:00.612158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 624 sessionId:  describe result for acl check
2025-10-15T10:59:00.612256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:00.612276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:00.612285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:00.612301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401336460882684:7471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:00.614529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401336460882684:7471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:00.620898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401336460882684:7471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:00.629617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:00.630198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401336460882684:7471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:00.630247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401336460882684:7471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:00.630264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401336460882684:7471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:00.630297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:00.632743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:00.633669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:00.633687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:00.633727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:00.633978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:00.634213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401339260575380:6736]
2025-10-15T10:59:00.636363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:00.637560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:00.637848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:00.639301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:00.639674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:00.639694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:00.639701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:00.639709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:00.639716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:00.639723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:00.639731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:00.639738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:00.639746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:00.639753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:00.639761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:00.639767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.639774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.639781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.639830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:00.639945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:00.639994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:00.640040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:00.640089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:00.640137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:00.640195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:00.640242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:00.640295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:00.640340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:00.640387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:00.640430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.640480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.640527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.640575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:00.640645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:00.640701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:00.640756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:00.640806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:00.640862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:00.640908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:00.640962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:00.641011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:00.641069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:00.641115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:00.641168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:00.641217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:00.641273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:00.641318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:00.641374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:00.641425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:00.641483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:00.641529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:00.641585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:00.641634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:00.641687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:00.641736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.641790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.641855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.641910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.641954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.642009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.642539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:00.659062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:00.668995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:00.669048Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:00.669067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:00.669090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:00.669117Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 623 [2:7561401339260575380:6736]
2025-10-15T10:59:00.669177Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:00.669245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:00.669262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:00.669278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:00.669292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:00.669348Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:00.669373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:00.669402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:00.684844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.684877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.684892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.684906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:00.685232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:00.685252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:00.685410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:00.685623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:00.685897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:00.685989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401336460882727:7471], now have 1 active actors on pipe
2025-10-15T10:59:00.686016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401336460882671:2467], now have 1 active actors on pipe
2025-10-15T10:59:00.686044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401339260575374:6736]
2025-10-15T10:59:00.686059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401339260575374:6736]
2025-10-15T10:59:00.686073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401339260575374:6736]
2025-10-15T10:59:00.686118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:00.686178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:00.686193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:00.686204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:00.686708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:00.686930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:00.686950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:00.687090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401339260575374:6736]
2025-10-15T10:59:00.687126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:00.687197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:00.687978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:00.688010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:00.688091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:00.688125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:00.688146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:00.688158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:00.688200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:00.688259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:00.688309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:00.689021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:00.689046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:00.689112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:00.687705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 623
2025-10-15T10:59:00.687725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 623
2025-10-15T10:59:00.689508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 624 partition: 0 MaxSeqNo: 46 sessionId: src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0
2025-10-15T10:59:00.692982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d363010-250fe9be-32c22834-4b039df6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:00.713081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401336460882749:7236], now have 1 active actors on pipe
2025-10-15T10:59:00.712547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401336460882749:7236]
2025-10-15T10:59:00.713174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 623, pipe: [1:7561401336460882749:7236]
2025-10-15T10:59:00.716544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0] Write session: try to update token
2025-10-15T10:59:00.716590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:00.734687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:00.734729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:00.734766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401339260575374:6736]
2025-10-15T10:59:00.734891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:00.734915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:00.737109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:00.741167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:00.742875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:00.790109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:00.791751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:00.792261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:00.792286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:00.792298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:00.792430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:00.818541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId: src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:00.834838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:00.834874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:00.834890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:00.834902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:00.834950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401339260575374:6736]
2025-10-15T10:59:00.834981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401339260575374:6736]
2025-10-15T10:59:00.835006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401339260575374:6736]
2025-10-15T10:59:00.835130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:00.835163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:00.835164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:00.835188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:00.835202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:00.836359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:00.848433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:00.979917Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:00.981336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:00.981382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:00.982182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:00.983134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:00.983639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401336460882749:7236]
2025-10-15T10:59:00.983807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:00.991547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 624 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0
2025-10-15T10:59:00.991908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 624 sessionId: src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0 is DEAD
2025-10-15T10:59:00.992618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:00.992725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0] Write session will restart in 0.005169s
2025-10-15T10:59:00.993006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0] Write session: Do CDS request
2025-10-15T10:59:00.993071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:01.012536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:01.012573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 625
2025-10-15T10:59:01.015916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:01.016577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:01.016744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:01.016779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:01.016790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:01.018231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 625 sessionId:  describe result for acl check
2025-10-15T10:59:01.018357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:01.018376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:01.018386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:01.018415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401340755850084:7479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:01.021052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401340755850084:7479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:01.038284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401340755850084:7479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:01.059086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401340755850084:7479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:01.059135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401340755850084:7479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:01.059153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401340755850084:7479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:01.059187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:01.082619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:01.086290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401340755850266:7236]
2025-10-15T10:59:01.091265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:01.092069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:01.092100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:01.092144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:01.092426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:01.092634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401343555542890:6741]
2025-10-15T10:59:01.094991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:01.096252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:01.096498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:01.097673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:01.097978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:01.097983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:01.097989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:01.097994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:01.097999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:01.098004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:01.098009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:01.098015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:01.098021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:01.098026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:01.098031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:01.098035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.098040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.098045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.098082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:01.098182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:01.098222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:01.098259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:01.098294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:01.098337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:01.098386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:01.098433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:01.098481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:01.098531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:01.098580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:01.098628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.098676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.098723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.098772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:01.098844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:01.098909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:01.098967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:01.099016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:01.099072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:01.099118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:01.099175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:01.099226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:01.099282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:01.099324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:01.099542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:01.099607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:01.099663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:01.099708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:01.099763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:01.099813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:01.099870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:01.099919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:01.099975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:01.100027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:01.100084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:01.100133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.100187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.100237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.100292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.100340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.100409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.100937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:01.126836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:01.141823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:01.141866Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:01.141882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:01.141898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:01.141920Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 624 [2:7561401343555542890:6741]
2025-10-15T10:59:01.141966Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:01.142017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:01.142031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:01.142041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:01.142051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:01.142094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:01.142114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:01.142132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:01.144569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.144593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.144607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.144617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:01.144888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:01.144904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.145037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.145212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.145418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:01.145487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401340755850266:7236], now have 1 active actors on pipe
2025-10-15T10:59:01.145510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401336460882772:2467], now have 1 active actors on pipe
2025-10-15T10:59:01.145532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401340755850188:7479], now have 1 active actors on pipe
2025-10-15T10:59:01.145554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401343555542884:6741]
2025-10-15T10:59:01.145568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401343555542884:6741]
2025-10-15T10:59:01.145579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401343555542884:6741]
2025-10-15T10:59:01.145616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:01.145681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:01.145687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:01.145706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:01.145720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:01.145860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:01.145884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:01.145984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401343555542884:6741]
2025-10-15T10:59:01.146006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:01.146114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:01.147895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 624, pipe: [1:7561401340755850266:7236]
2025-10-15T10:59:01.148013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 624
2025-10-15T10:59:01.148095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 624
2025-10-15T10:59:01.149829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:01.149859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:01.149927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:01.149953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:01.149969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:01.149979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:01.150008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:01.150046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:01.150085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:01.151074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:01.151097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:01.151154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:01.151541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 625 partition: 0 MaxSeqNo: 46 sessionId: src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0
2025-10-15T10:59:01.152393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7faaeb6f-3c6a8024-a60a15a2-8451489f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:01.171218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0] Write session: try to update token
2025-10-15T10:59:01.171265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:01.186848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:01.186877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:01.186914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401343555542884:6741]
2025-10-15T10:59:01.187025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:01.187075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:01.188661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:01.189735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:01.190762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:01.192920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:01.205091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:01.266221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:01.266256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:01.266268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:01.266329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:01.313434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:01.313467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:01.313481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:01.313491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:01.313529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401343555542884:6741]
2025-10-15T10:59:01.313554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401343555542884:6741]
2025-10-15T10:59:01.313576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401343555542884:6741]
2025-10-15T10:59:01.313723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:01.313744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:01.314369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:01.314403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:01.314431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:01.314829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:01.326576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId: src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:01.349123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:01.451722Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:01.458473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:01.458515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:01.459494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401340755850266:7236]
2025-10-15T10:59:01.459592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:01.459729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:01.459744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:01.459897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:01.486124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 625 reason: error at write: Disconnected sessionId: src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0
2025-10-15T10:59:01.486430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 625 sessionId: src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0 is DEAD
2025-10-15T10:59:01.491592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:01.491649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0] Write session will restart in 0.006183s
2025-10-15T10:59:01.491793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0] Write session: Do CDS request
2025-10-15T10:59:01.491836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:01.502275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:01.502307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 626
2025-10-15T10:59:01.503099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:01.504390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:01.504530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:01.504551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:01.504561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:01.506320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 626 sessionId:  describe result for acl check
2025-10-15T10:59:01.506430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:01.506441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:01.506450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:01.506466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401340755850298:7483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:01.508869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401340755850298:7483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:01.514052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401340755850298:7483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:01.529172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401340755850298:7483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:01.529219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401340755850298:7483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:01.529235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401340755850298:7483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:01.529263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:01.559729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401340755850446:7236]
2025-10-15T10:59:01.580909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:01.582564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:01.583135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:01.583145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:01.583169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:01.583320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:01.583478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401343555543122:6750]
2025-10-15T10:59:01.584804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:01.585667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:01.585797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:01.586585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:01.586792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:01.586798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:01.586802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:01.586807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:01.586812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:01.586816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:01.586820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:01.586824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:01.586829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:01.586833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:01.586837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:01.586842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.586846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.586850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.586883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:01.586968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:01.587001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:01.587032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:01.587062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:01.587092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:01.587123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:01.587152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:01.587181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:01.587211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:01.587239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:01.587270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.587297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.587324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.587369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:01.587429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:01.587474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:01.587508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:01.587539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:01.587571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:01.587601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:01.587634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:01.587663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:01.587697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:01.587735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:01.587766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:01.587794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:01.587828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:01.587854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:01.587887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:01.587916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:01.587952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:01.587986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:01.588023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:01.588051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:01.588087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:01.588115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.588148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.588177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.588212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.588238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.588271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.588609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:01.606200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:01.615392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:01.615427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:01.615437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:01.615450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:01.615464Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 625 [2:7561401343555543122:6750]
2025-10-15T10:59:01.615494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:01.615532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:01.615542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:01.615553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:01.615560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:01.615592Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:01.615612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:01.615630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:01.617133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.617147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.617159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.617169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:01.617440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:01.617471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:01.617596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:01.617757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:01.617971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:01.618039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401343555543117:6750]
2025-10-15T10:59:01.618053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401343555543117:6750]
2025-10-15T10:59:01.618064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401343555543117:6750]
2025-10-15T10:59:01.618105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:01.618171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:01.618322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:01.618338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:01.618452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401343555543117:6750]
2025-10-15T10:59:01.618472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:01.619259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:01.619283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:01.619294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:01.619315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:01.620255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401340755850446:7236], now have 1 active actors on pipe
2025-10-15T10:59:01.620288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401340755850282:2467], now have 1 active actors on pipe
2025-10-15T10:59:01.620307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401340755850361:7483], now have 1 active actors on pipe
2025-10-15T10:59:01.621572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 625, pipe: [1:7561401340755850446:7236]
2025-10-15T10:59:01.621683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 625
2025-10-15T10:59:01.621781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 625
2025-10-15T10:59:01.623571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:01.623593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:01.623653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:01.623672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:01.623682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:01.623688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:01.623709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:01.623734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:01.623767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:01.629110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:01.629145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:01.629214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:01.631552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 626 partition: 0 MaxSeqNo: 46 sessionId: src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0
2025-10-15T10:59:01.633148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|904eaa60-22f661cf-a6f8a29a-74f49d0f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:01.677975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0] Write session: try to update token
2025-10-15T10:59:01.678026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:01.807878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:01.807911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:01.807923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:01.807934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:01.807967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401343555543117:6750]
2025-10-15T10:59:01.807992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401343555543117:6750]
2025-10-15T10:59:01.808013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401343555543117:6750]
2025-10-15T10:59:01.808173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:01.808190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:01.808200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:01.808296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:01.808320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:01.808489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:01.808528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:01.808555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:01.809389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:01.862032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId: src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:01.886278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:01.958306Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:01.972916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:01.972961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:01.973031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:01.973045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:01.973084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401343555543117:6750]
2025-10-15T10:59:01.973914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401340755850446:7236]
2025-10-15T10:59:01.974019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:01.974131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:01.974149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:01.973512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:01.973703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:02.056187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 626 reason: error at write: Disconnected sessionId: src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0
2025-10-15T10:59:02.057026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:02.057106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0] Write session will restart in 0.005774s
2025-10-15T10:59:02.057297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0] Write session: Do CDS request
2025-10-15T10:59:02.057357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:02.056492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 626 sessionId: src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0 is DEAD
2025-10-15T10:59:02.062932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:02.067533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:02.068059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:02.068985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:02.069015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:02.069056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:02.069322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:02.069520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401347850510642:6758]
2025-10-15T10:59:02.073527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:02.073560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 627
2025-10-15T10:59:02.074042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:02.074206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:02.074224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:02.074235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:02.075567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 627 sessionId:  describe result for acl check
2025-10-15T10:59:02.075703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:02.075716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:02.075727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:02.075742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401345050818000:7495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:02.076830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:02.078506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401345050818004:7236]
2025-10-15T10:59:02.078581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401345050818000:7495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:02.082140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:02.082463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:02.083894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:02.084285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.084304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.084312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.084319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.084327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.084335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.084343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.084351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.084359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.084367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.084374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.084381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.084387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.084395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.084445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.084559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.084611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.084659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.084718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.084771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.084823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.084876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.084933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.084993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.085050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.085106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.085164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.085217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.085273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.085354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.085430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.085499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.085558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.085622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.085678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.085742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.085805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.086106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.086169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.086233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.086286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.086348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.086398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.086456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.086510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.086568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.086620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.086680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.086737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.086795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.086846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.086906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.086960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.087021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.087075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.087135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.087716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:02.091388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401345050818000:7495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:02.098486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401345050818000:7495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:02.098529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401345050818000:7495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:02.098545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401345050818000:7495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:02.098574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:02.109447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:02.119648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:02.119695Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:02.119712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:02.119730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:02.119753Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 626 [2:7561401347850510642:6758]
2025-10-15T10:59:02.119808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:02.119867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:02.119879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:02.119890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:02.119901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:02.119942Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:02.119962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:02.119981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:02.121671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.121688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.121702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.121713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:02.122004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:02.122023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.122167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.122357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.122588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:02.122665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401347850510637:6758]
2025-10-15T10:59:02.122679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401347850510637:6758]
2025-10-15T10:59:02.122691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401347850510637:6758]
2025-10-15T10:59:02.122760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:02.122773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:02.122784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:02.124286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:02.124370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:02.124564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:02.124587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:02.124631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401340755850530:2467], now have 1 active actors on pipe
2025-10-15T10:59:02.124654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401345050818033:7495], now have 1 active actors on pipe
2025-10-15T10:59:02.124676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401345050818004:7236], now have 1 active actors on pipe
2025-10-15T10:59:02.124816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:02.124835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:02.124866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401347850510637:6758]
2025-10-15T10:59:02.124897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:02.124929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:02.124999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:02.125028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:02.125045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:02.125063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:02.125106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:02.125151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:02.125241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:02.124019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 626
2025-10-15T10:59:02.124122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 626
2025-10-15T10:59:02.124176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 626, pipe: [1:7561401345050818004:7236]
2025-10-15T10:59:02.126536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:02.126563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:02.126623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:02.126987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 627 partition: 0 MaxSeqNo: 46 sessionId: src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0
2025-10-15T10:59:02.127787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98cd2ebe-f01003a-4b52cd03-7e987553_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:02.157566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0] Write session: try to update token
2025-10-15T10:59:02.157627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:02.254956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId: src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:02.266973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:02.267002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:02.267014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:02.267064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:02.267078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:02.267091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:02.267101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:02.267132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401347850510637:6758]
2025-10-15T10:59:02.267156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401347850510637:6758]
2025-10-15T10:59:02.267178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401347850510637:6758]
2025-10-15T10:59:02.267428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:02.267464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:02.267490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:02.267539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:02.267559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:02.268602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:02.282482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:02.412570Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:02.421763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:02.421807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:02.421885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:02.421899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:02.421935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401347850510637:6758]
2025-10-15T10:59:02.422172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:02.422480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:02.422465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:02.422656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:02.423596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401345050818004:7236]
2025-10-15T10:59:02.432007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 627 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0
2025-10-15T10:59:02.432377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 627 sessionId: src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0 is DEAD
2025-10-15T10:59:02.435265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:02.435310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0] Write session will restart in 0.007052s
2025-10-15T10:59:02.435545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0] Write session: Do CDS request
2025-10-15T10:59:02.435589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:02.448694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:02.455257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:02.455305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 628
2025-10-15T10:59:02.455717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:02.455858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:02.455882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:02.455893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:02.457566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 628 sessionId:  describe result for acl check
2025-10-15T10:59:02.457700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:02.457725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:02.457736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:02.457754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401345050818071:7502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:02.461471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401345050818071:7502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:02.473940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401345050818071:7502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:02.483389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401345050818071:7502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:02.483452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401345050818071:7502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:02.483470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401345050818071:7502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:02.483507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:02.523034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:02.523730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401345050818256:7236]
2025-10-15T10:59:02.524944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:02.525790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:02.525817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:02.525869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:02.526091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:02.526257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401347850510871:6763]
2025-10-15T10:59:02.528317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:02.529297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:02.529543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:02.530944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:02.531288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.531305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.531314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.531322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.531330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.531337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.531344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.531372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.531379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.531387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.531396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.531403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.531411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.531418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.531469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.531594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.531649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.531705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.531759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.531816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.531871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.531942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.531993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.532046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.532103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.532156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.532209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.532258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.532311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.532389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.532463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.532528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.532584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.532642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.532693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.532752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.532814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.532870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.532924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.532985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.533041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.533104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.533157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.533220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.533277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.533338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.533393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.533474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.533532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.533588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.533641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.533703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.533760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.533822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.533885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.533946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.534489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:02.553797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:02.563314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:02.563608Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:02.563637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:02.563659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:02.563686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 627 [2:7561401347850510871:6763]
2025-10-15T10:59:02.563746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:02.563813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:02.563840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:02.563855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:02.563868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:02.563924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:02.563947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:02.563968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:02.564995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.565020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.565035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.565048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:02.565323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:02.565349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.565629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 627
2025-10-15T10:59:02.565721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 627
2025-10-15T10:59:02.565813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 627, pipe: [1:7561401345050818256:7236]
2025-10-15T10:59:02.565516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.565740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.565986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:02.566046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401345050818154:7502], now have 1 active actors on pipe
2025-10-15T10:59:02.566063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401345050818055:2467], now have 1 active actors on pipe
2025-10-15T10:59:02.566077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401345050818256:7236], now have 1 active actors on pipe
2025-10-15T10:59:02.566097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401347850510865:6763]
2025-10-15T10:59:02.566107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401347850510865:6763]
2025-10-15T10:59:02.566116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401347850510865:6763]
2025-10-15T10:59:02.566145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:02.566196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:02.566207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:02.566221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:02.566235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:02.566340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:02.566352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:02.566486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:02.566511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:02.566545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401347850510865:6763]
2025-10-15T10:59:02.566564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:02.566592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:02.566641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf282290-7ade84e3-933d36cf-f4a49745_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:02.566669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:02.566683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:02.566690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:02.566718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:02.566749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:02.566808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:02.568667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:02.568703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:02.568784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:02.570537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 628 partition: 0 MaxSeqNo: 46 sessionId: src_id|cf282290-7ade84e3-933d36cf-f4a49745_0
2025-10-15T10:59:02.571537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50408e9e-7a8eb66-ab5273cf-afded06f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cf282290-7ade84e3-933d36cf-f4a49745_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:02.608522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf282290-7ade84e3-933d36cf-f4a49745_0] Write session: try to update token
2025-10-15T10:59:02.608592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf282290-7ade84e3-933d36cf-f4a49745_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:02.646463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:02.646514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:02.646536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:02.646554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:02.646609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401347850510865:6763]
2025-10-15T10:59:02.646656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401347850510865:6763]
2025-10-15T10:59:02.646697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401347850510865:6763]
2025-10-15T10:59:02.646944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:02.646978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:02.650203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:02.650946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:02.651003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:02.651035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:02.717292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId: src_id|cf282290-7ade84e3-933d36cf-f4a49745_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:02.744988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:02.807154Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:02.811079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:02.811085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:02.811122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:02.811270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401345050818256:7236]
2025-10-15T10:59:02.810206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:02.810248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:02.814869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:02.823527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 628 reason: error at write: Disconnected sessionId: src_id|cf282290-7ade84e3-933d36cf-f4a49745_0
2025-10-15T10:59:02.823823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 628 sessionId: src_id|cf282290-7ade84e3-933d36cf-f4a49745_0 is DEAD
2025-10-15T10:59:02.824723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf282290-7ade84e3-933d36cf-f4a49745_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:02.824775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf282290-7ade84e3-933d36cf-f4a49745_0] Write session will restart in 0.008055s
2025-10-15T10:59:02.824948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf282290-7ade84e3-933d36cf-f4a49745_0] Write session: Do CDS request
2025-10-15T10:59:02.824979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf282290-7ade84e3-933d36cf-f4a49745_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:02.858836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf282290-7ade84e3-933d36cf-f4a49745_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:02.860228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:02.860290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 629
2025-10-15T10:59:02.860636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:02.860747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:02.860767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:02.860775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:02.862062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 629 sessionId:  describe result for acl check
2025-10-15T10:59:02.862172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:02.862201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:02.862221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:02.862248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401345050818291:7507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:02.864714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401345050818291:7507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:02.872998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401345050818291:7507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:02.882986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401345050818291:7507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:02.883028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401345050818291:7507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:02.883044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401345050818291:7507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:02.883069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:02.909043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401345050818380:7236]
2025-10-15T10:59:02.945155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:02.953646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:02.954521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:02.954547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:02.954586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:02.954826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:02.954996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401347850511097:6771]
2025-10-15T10:59:02.957135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:02.958311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:02.958532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:02.959763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:02.960071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.960079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.960085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.960091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.960097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.960104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.960110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.960117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.960122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.960128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.960135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.960141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.960148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.960154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.960193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.960289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.960331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.960371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.960412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.960455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.960497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.960538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.960577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.960617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.960656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.960699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.960738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.960776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.960812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.960866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:02.960917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.960982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:02.961026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.961081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:02.961128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.961175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:02.961218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.961265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:02.961303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.961350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:02.961390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.961445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:02.961485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.961530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:02.961571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.961618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:02.961655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.961703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:02.961742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.961789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:02.961832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.961896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:02.961939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.961987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:02.962040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.962088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:02.962525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:02.983675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:02.999668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:02.999711Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:02.999724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:02.999739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:02.999758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 628 [2:7561401347850511097:6771]
2025-10-15T10:59:02.999804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:02.999850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:02.999862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:02.999873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:02.999882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:02.999923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:02.999943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:02.999963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:03.001892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.001919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.001933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.001943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:03.002191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:03.002216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.002339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.002662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 628
2025-10-15T10:59:03.002743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 628, pipe: [1:7561401345050818380:7236]
2025-10-15T10:59:03.002814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 628
2025-10-15T10:59:03.002530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.002775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:03.002845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401345050818323:7507], now have 1 active actors on pipe
2025-10-15T10:59:03.002869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401345050818380:7236], now have 1 active actors on pipe
2025-10-15T10:59:03.002889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401345050818274:2467], now have 1 active actors on pipe
2025-10-15T10:59:03.002911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401347850511092:6771]
2025-10-15T10:59:03.002924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401347850511092:6771]
2025-10-15T10:59:03.002936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401347850511092:6771]
2025-10-15T10:59:03.002975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:03.003031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:03.003046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:03.003052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:03.003058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:03.003212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:03.003228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:03.003278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:03.003295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:03.003853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401347850511092:6771]
2025-10-15T10:59:03.003893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:03.003954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:03.003985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:03.004000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:03.004010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:03.004040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:03.004075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:03.004188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:03.004191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:03.004833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:03.004859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:03.004917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:03.005296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 629 partition: 0 MaxSeqNo: 46 sessionId: src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0
2025-10-15T10:59:03.006100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf282290-7ade84e3-933d36cf-f4a49745_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:03.037337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:03.037492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:03.037532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401347850511092:6771]
2025-10-15T10:59:03.037653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:03.037995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:03.038956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0] Write session: try to update token
2025-10-15T10:59:03.039003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:03.046011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:03.047272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:03.049177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:03.059060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:03.065295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:03.065796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:03.161262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:03.161281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:03.161289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:03.161322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:03.161330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:03.161338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:03.161344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:03.161366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401347850511092:6771]
2025-10-15T10:59:03.161380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401347850511092:6771]
2025-10-15T10:59:03.161392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401347850511092:6771]
2025-10-15T10:59:03.161487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:03.161500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:03.162269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:03.163770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:03.163813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:03.163832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:03.165024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId: src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:03.189525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:03.300291Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:03.302353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:03.302388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:03.303542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401345050818380:7236]
2025-10-15T10:59:03.303683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:03.303698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:03.303232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:03.346090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:03.346252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 629 reason: error at write: Disconnected sessionId: src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0
2025-10-15T10:59:03.346621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 629 sessionId: src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0 is DEAD
2025-10-15T10:59:03.351562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:03.351605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0] Write session will restart in 0.006962s
2025-10-15T10:59:03.351706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0] Write session: Do CDS request
2025-10-15T10:59:03.351736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:03.368617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:03.374257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:03.374294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 630
2025-10-15T10:59:03.374769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:03.374902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:03.374919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:03.374930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:03.380559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 630 sessionId:  describe result for acl check
2025-10-15T10:59:03.380676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:03.380686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:03.380697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:03.380713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401349345785929:7518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:03.383231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401349345785929:7518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:03.391967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401349345785929:7518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:03.400597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401349345785929:7518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:03.400635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401349345785929:7518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:03.400646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401349345785929:7518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:03.400667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:03.402919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401349345786021:7236]
2025-10-15T10:59:03.407084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:03.410945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:03.411782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:03.411810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:03.411846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:03.412016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:03.412134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401352145478632:6780]
2025-10-15T10:59:03.413480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:03.414179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:03.414340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:03.415237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:03.415521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:03.415537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:03.415545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:03.415552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:03.415558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:03.415564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:03.415570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:03.415577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:03.415583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:03.415589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:03.415595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:03.415601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.415608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.415614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.415659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:03.415757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:03.415804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:03.415848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:03.415902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:03.415953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:03.415997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:03.416044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:03.416091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:03.416702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:03.416772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:03.416824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.416874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.416923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.416972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:03.417037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:03.417096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:03.417154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:03.417207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:03.417265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:03.417313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:03.417369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:03.417418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:03.417472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:03.417521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:03.417577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:03.417629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:03.417686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:03.417735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:03.417793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:03.417825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:03.417873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:03.417903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:03.417944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:03.417975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:03.418010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:03.418038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.418073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.418104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.418138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.418166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.418199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.418530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:03.434222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:03.442934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:03.442972Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:03.442988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:03.443006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:03.443028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 629 [2:7561401352145478632:6780]
2025-10-15T10:59:03.443079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:03.443134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:03.443154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:03.443165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:03.443177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:03.443219Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:03.443240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:03.443259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:03.444744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.444767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.444779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.444791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:03.445002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:03.445024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.445138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.445288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.445481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:03.445542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401352145478627:6780]
2025-10-15T10:59:03.445560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401352145478627:6780]
2025-10-15T10:59:03.445573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401352145478627:6780]
2025-10-15T10:59:03.447284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 629
2025-10-15T10:59:03.447367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 629, pipe: [1:7561401349345786021:7236]
2025-10-15T10:59:03.447448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 629
2025-10-15T10:59:03.445610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:03.445680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:03.445843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:03.445877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:03.445982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401352145478627:6780]
2025-10-15T10:59:03.446000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:03.446046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:03.446057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:03.446066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:03.446078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401349345786018:7518], now have 1 active actors on pipe
2025-10-15T10:59:03.446085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:03.446098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401349345786021:7236], now have 1 active actors on pipe
2025-10-15T10:59:03.446118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401349345785831:2467], now have 1 active actors on pipe
2025-10-15T10:59:03.447874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:03.447905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:03.447982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:03.448012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:03.448029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:03.448039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:03.448068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:03.448107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:03.448149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:03.448691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:03.448712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:03.448768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:03.449530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|199a93dc-dd1c182b-24131b7e-a02ad29_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:03.448974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 630 partition: 0 MaxSeqNo: 46 sessionId: src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0
2025-10-15T10:59:03.495956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:03.495988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:03.496025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401352145478627:6780]
2025-10-15T10:59:03.496134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:03.496145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:03.498006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:03.499622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:03.501103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:03.536996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0] Write session: try to update token
2025-10-15T10:59:03.537051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:03.550013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:03.552061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:03.552645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:03.552663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:03.552675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:03.552736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:03.614984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:03.615037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:03.615055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:03.615090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:03.615136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401352145478627:6780]
2025-10-15T10:59:03.615166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401352145478627:6780]
2025-10-15T10:59:03.615191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401352145478627:6780]
2025-10-15T10:59:03.615343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:03.615395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:03.615403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:03.615421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:03.615430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:03.627557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:03.712814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId: src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:03.737273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:03.801433Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:03.802737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:03.802775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:03.803488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:03.803519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:03.804408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401349345786021:7236]
2025-10-15T10:59:03.804528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:03.803729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:03.811695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 630 reason: error at write: Disconnected sessionId: src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0
2025-10-15T10:59:03.812007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 630 sessionId: src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0 is DEAD
2025-10-15T10:59:03.819616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:03.819665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0] Write session will restart in 0.008631s
2025-10-15T10:59:03.819785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0] Write session: Do CDS request
2025-10-15T10:59:03.819824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:03.840882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:03.843599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:03.843635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 631
2025-10-15T10:59:03.847571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:03.847717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:03.847742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:03.847752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:03.849517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 631 sessionId:  describe result for acl check
2025-10-15T10:59:03.849641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:03.849653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:03.849662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:03.849678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401349345786077:7526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:03.852299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401349345786077:7526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:03.867796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401349345786077:7526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:03.878873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401349345786077:7526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:03.878922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401349345786077:7526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:03.878942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401349345786077:7526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:03.878980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:03.898558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:03.903678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401349345786257:7236]
2025-10-15T10:59:03.904783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:03.905446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:03.905468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:03.905497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:03.905677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:03.905805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401352145478851:6784]
2025-10-15T10:59:03.907254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:03.908625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:03.908861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:03.910221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:03.910576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:03.910585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:03.910594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:03.910602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:03.910608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:03.910616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:03.910625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:03.910633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:03.910640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:03.910648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:03.910655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:03.910662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.910668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.910675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.910728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:03.910854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:03.910910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:03.910974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:03.911027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:03.911084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:03.911134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:03.911184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:03.911237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:03.911290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:03.911340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:03.911406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.911456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.911507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.911556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:03.911632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:03.911700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:03.911758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:03.911811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:03.911872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:03.911920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:03.911977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:03.912030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:03.912087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:03.912136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:03.912195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:03.912248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:03.912307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:03.912354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:03.912409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:03.912465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:03.912526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:03.912573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:03.912634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:03.912681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:03.912737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:03.912786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.912843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.912892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.912946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.912996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.913050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.913591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:03.964394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:03.973198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:03.973245Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:03.973265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:03.973287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:03.973314Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 630 [2:7561401352145478851:6784]
2025-10-15T10:59:03.973374Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:03.973441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:03.973465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:03.973478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:03.973491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:03.973545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:03.973563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:03.973581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:03.974633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.974651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.974666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.974679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:03.974947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:03.974967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:03.975125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:03.975332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:03.976304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:03.976391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401349345786191:7526], now have 1 active actors on pipe
2025-10-15T10:59:03.976409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401349345786257:7236], now have 1 active actors on pipe
2025-10-15T10:59:03.976424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401349345786052:2467], now have 1 active actors on pipe
2025-10-15T10:59:03.976442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401352145478845:6784]
2025-10-15T10:59:03.976452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401352145478845:6784]
2025-10-15T10:59:03.976460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401352145478845:6784]
2025-10-15T10:59:03.976487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:03.976541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:03.976639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:03.976670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:03.976681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:03.976700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:03.976712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:03.976807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401352145478845:6784]
2025-10-15T10:59:03.976828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:03.976837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:03.976925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:03.976942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:03.977029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37f51f5a-b6f73366-3213c695-896ed26b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:03.977051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:03.977067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:03.977079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:03.977118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:03.977162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:03.977236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:03.979080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:03.979112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:03.979179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:03.976087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 630
2025-10-15T10:59:03.976187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 630, pipe: [1:7561401349345786257:7236]
2025-10-15T10:59:03.976268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 630
2025-10-15T10:59:03.980295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4a313d6-4b0ce1f1-14e68ee5-a2d0f2ad_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|37f51f5a-b6f73366-3213c695-896ed26b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:03.979546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 631 partition: 0 MaxSeqNo: 46 sessionId: src_id|37f51f5a-b6f73366-3213c695-896ed26b_0
2025-10-15T10:59:04.010599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f51f5a-b6f73366-3213c695-896ed26b_0] Write session: try to update token
2025-10-15T10:59:04.010659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f51f5a-b6f73366-3213c695-896ed26b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:04.055875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:04.055907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:04.055924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:04.055937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:04.055976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401352145478845:6784]
2025-10-15T10:59:04.056004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401352145478845:6784]
2025-10-15T10:59:04.056030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401352145478845:6784]
2025-10-15T10:59:04.056234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:04.056260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:04.057296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:04.058285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:04.058339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:04.058383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:04.107516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId: src_id|37f51f5a-b6f73366-3213c695-896ed26b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:04.132253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:04.206948Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:04.217984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:04.218031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:04.218097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:04.218112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:04.218155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401352145478845:6784]
2025-10-15T10:59:04.218464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:04.218722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:04.218899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:04.218910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401349345786257:7236]
2025-10-15T10:59:04.218932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:04.218990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:04.254036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 631 reason: error at write: Disconnected sessionId: src_id|37f51f5a-b6f73366-3213c695-896ed26b_0
2025-10-15T10:59:04.254436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 631 sessionId: src_id|37f51f5a-b6f73366-3213c695-896ed26b_0 is DEAD
2025-10-15T10:59:04.259594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f51f5a-b6f73366-3213c695-896ed26b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:04.259656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f51f5a-b6f73366-3213c695-896ed26b_0] Write session will restart in 0.007325s
2025-10-15T10:59:04.259812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f51f5a-b6f73366-3213c695-896ed26b_0] Write session: Do CDS request
2025-10-15T10:59:04.259857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f51f5a-b6f73366-3213c695-896ed26b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:04.272330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f51f5a-b6f73366-3213c695-896ed26b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:04.275079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:04.275112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 632
2025-10-15T10:59:04.275553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:04.275679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:04.275697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:04.275707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:04.277595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 632 sessionId:  describe result for acl check
2025-10-15T10:59:04.277679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:04.277686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:04.277692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:04.277706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401353640753612:7533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:04.280392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401353640753612:7533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:04.290894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401353640753612:7533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:04.302743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401353640753612:7533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:04.302784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401353640753612:7533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:04.302796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401353640753612:7533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:04.302819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:04.319921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401353640753789:7236]
2025-10-15T10:59:04.337366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:04.344960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:04.345648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:04.345678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:04.345718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:04.345975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:04.346156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401356440446384:6794]
2025-10-15T10:59:04.347844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:04.348847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:04.349050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:04.349945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:04.350214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:04.350229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:04.350236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:04.350244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:04.350252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:04.350260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:04.350267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:04.350275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:04.350283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:04.350289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:04.350296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:04.350303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.350310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.350317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.350368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:04.350480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:04.350531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:04.350589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:04.350642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:04.350695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:04.350748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:04.350800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:04.350848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:04.350902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:04.350952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:04.351004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.351055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.351107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.351156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:04.351228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:04.351294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:04.351372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:04.351427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:04.351492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:04.351545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:04.351605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:04.351659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:04.351719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:04.351765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:04.351824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:04.351877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:04.351938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:04.351987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:04.352045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:04.352097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:04.352161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:04.352211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:04.352272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:04.352325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:04.352384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:04.352435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.352496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.352546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.352605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.352656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.352716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.353154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:04.372981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:04.388362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:04.388412Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:04.388429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:04.388448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:04.388474Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 631 [2:7561401356440446384:6794]
2025-10-15T10:59:04.388526Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:04.388587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:04.388602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:04.388615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:04.388627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:04.388678Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:04.388700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:04.388723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:04.390369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.390402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.390415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.390428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:04.390704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:04.390723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.390871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.391034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.391209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:04.391261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401356440446379:6794]
2025-10-15T10:59:04.391270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401356440446379:6794]
2025-10-15T10:59:04.391282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401356440446379:6794]
2025-10-15T10:59:04.391322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:04.391404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:04.391414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:04.391428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:04.391933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 631, pipe: [1:7561401353640753789:7236]
2025-10-15T10:59:04.392018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:04.392077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 631
2025-10-15T10:59:04.392150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 631
2025-10-15T10:59:04.392193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:04.392216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:04.392264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401353640753789:7236], now have 1 active actors on pipe
2025-10-15T10:59:04.392294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401353640753750:7533], now have 1 active actors on pipe
2025-10-15T10:59:04.392320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401353640753584:2467], now have 1 active actors on pipe
2025-10-15T10:59:04.392433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401356440446379:6794]
2025-10-15T10:59:04.392468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:04.392701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:04.393406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:04.393437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:04.393528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:04.393566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:04.393586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:04.393595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:04.393632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:04.393679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:04.393731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:04.394590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:04.394616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:04.394682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:04.394985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 632 partition: 0 MaxSeqNo: 46 sessionId: src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0
2025-10-15T10:59:04.395935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f51f5a-b6f73366-3213c695-896ed26b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:04.427547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0] Write session: try to update token
2025-10-15T10:59:04.427608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:04.525746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:04.525788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:04.525801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:04.525878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:04.525901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:04.525917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:04.525926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:04.525963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401356440446379:6794]
2025-10-15T10:59:04.525991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401356440446379:6794]
2025-10-15T10:59:04.526021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401356440446379:6794]
2025-10-15T10:59:04.526234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:04.526264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:04.526283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:04.526319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:04.526363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:04.530695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:04.553533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId: src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:04.575791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:04.681533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:04.691833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:04.691890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:04.691969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:04.691984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:04.692031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401356440446379:6794]
2025-10-15T10:59:04.692217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:04.692664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:04.693409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:04.695577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401353640753789:7236]
2025-10-15T10:59:04.695694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:04.702199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 632 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0
2025-10-15T10:59:04.702557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 632 sessionId: src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0 is DEAD
2025-10-15T10:59:04.703749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:04.703832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0] Write session will restart in 0.008815s
2025-10-15T10:59:04.704065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0] Write session: Do CDS request
2025-10-15T10:59:04.704140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:04.720419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:04.723524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:04.723565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 633
2025-10-15T10:59:04.728956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:04.729241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:04.729271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:04.729292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:04.730864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 633 sessionId:  describe result for acl check
2025-10-15T10:59:04.730978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:04.730989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:04.730999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:04.731018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401353640753830:7540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:04.733915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401353640753830:7540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:04.742371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401353640753830:7540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:04.771932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401353640753830:7540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:04.771981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401353640753830:7540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:04.771999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401353640753830:7540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:04.772026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:04.790501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:04.795281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:04.796032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401353640754026:7236]
2025-10-15T10:59:04.796179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:04.796208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:04.796254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:04.796532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:04.796743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401356440446613:6801]
2025-10-15T10:59:04.798963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:04.801276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:04.801539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:04.802879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:04.803215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:04.803224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:04.803230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:04.803237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:04.803244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:04.803251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:04.803258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:04.803266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:04.803272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:04.803279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:04.803286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:04.803294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.803301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.803308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.803381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:04.803494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:04.803545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:04.803597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:04.803647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:04.803699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:04.803744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:04.803791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:04.803835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:04.803885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:04.803931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:04.803977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.804020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.804065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.804112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:04.804184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:04.804243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:04.804299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:04.804350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:04.804406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:04.804452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:04.804511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:04.804559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:04.804613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:04.804659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:04.804715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:04.804764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:04.804819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:04.804866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:04.804922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:04.804972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:04.805026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:04.805075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:04.805128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:04.805175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:04.805230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:04.805277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.805334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.805383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.805437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.805483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.805540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.806075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:04.829361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:04.883500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:04.883553Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:04.883568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:04.883586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:04.883610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 632 [2:7561401356440446613:6801]
2025-10-15T10:59:04.883657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:04.883714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:04.883728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:04.883739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:04.883750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:04.883801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:04.883823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:04.883844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:04.885538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.885555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.885570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.885582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:04.885851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:04.885883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:04.886000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:04.886130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:04.886272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:04.886326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401353640753988:7540], now have 1 active actors on pipe
2025-10-15T10:59:04.886342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401353640753812:2467], now have 1 active actors on pipe
2025-10-15T10:59:04.886358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401353640754026:7236], now have 1 active actors on pipe
2025-10-15T10:59:04.886376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401356440446608:6801]
2025-10-15T10:59:04.886386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401356440446608:6801]
2025-10-15T10:59:04.886396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401356440446608:6801]
2025-10-15T10:59:04.886427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:04.886476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:04.886490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:04.886502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:04.886504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:04.886657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:04.886669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:04.886761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401356440446608:6801]
2025-10-15T10:59:04.886785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:04.886810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:04.887842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 632
2025-10-15T10:59:04.887936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 632, pipe: [1:7561401353640754026:7236]
2025-10-15T10:59:04.888021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 632
2025-10-15T10:59:04.888332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:04.888363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:04.888443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:04.888485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:04.888505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:04.888515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:04.888553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:04.888599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:04.888634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:04.891251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:04.891279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:04.891336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:04.891674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 633 partition: 0 MaxSeqNo: 46 sessionId: src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0
2025-10-15T10:59:04.892473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e10a13e4-b76337f5-d4a8b725-5c99fd7c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:04.919795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0] Write session: try to update token
2025-10-15T10:59:04.919852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:05.014056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId: src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:05.015186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:05.015209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:05.015217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:05.015224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:05.015243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401356440446608:6801]
2025-10-15T10:59:05.015258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401356440446608:6801]
2025-10-15T10:59:05.015274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401356440446608:6801]
2025-10-15T10:59:05.015454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:05.015490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:05.015497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:05.015502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:05.015511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:05.015542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:05.015549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:05.015567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:05.017018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:05.036976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:05.170707Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:05.204718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:05.204767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:05.204839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:05.204853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:05.204891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401356440446608:6801]
2025-10-15T10:59:05.205046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:05.205593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:05.205627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:05.206674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:05.206999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401353640754026:7236]
2025-10-15T10:59:05.205644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:05.226777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 633 reason: error at write: Disconnected sessionId: src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0
2025-10-15T10:59:05.227173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 633 sessionId: src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0 is DEAD
2025-10-15T10:59:05.228202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:05.228278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0] Write session will restart in 0.005826s
2025-10-15T10:59:05.228477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0] Write session: Do CDS request
2025-10-15T10:59:05.228538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:05.239724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:05.239782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 634
2025-10-15T10:59:05.240123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:05.243574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:05.243750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:05.243767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:05.243778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:05.245074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 634 sessionId:  describe result for acl check
2025-10-15T10:59:05.245171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:05.245183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:05.245192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:05.245209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401357935721386:7552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:05.248171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401357935721386:7552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:05.257342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401357935721386:7552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:05.277914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401357935721386:7552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:05.277976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401357935721386:7552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:05.277997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401357935721386:7552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:05.278036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:05.311504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401357935721571:7236]
2025-10-15T10:59:05.324388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:05.329250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:05.330204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:05.330223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:05.330268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:05.330545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:05.330739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401360735414145:6806]
2025-10-15T10:59:05.333127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:05.334416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:05.334631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:05.335958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:05.336302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:05.336311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:05.336319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:05.336326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:05.336334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:05.336342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:05.336348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:05.336357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:05.336363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:05.336370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:05.336377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:05.336384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.336391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.336399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.336462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:05.336580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:05.336631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:05.336681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:05.336730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:05.336779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:05.336829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:05.336878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:05.336928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:05.336977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:05.337029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:05.337079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.337128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.337177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.337224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:05.337296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:05.337358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:05.337417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:05.337472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:05.337530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:05.337577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:05.337636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:05.337696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:05.337754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:05.337802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:05.338114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:05.338173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:05.338234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:05.338287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:05.338346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:05.338402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:05.338464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:05.338529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:05.338586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:05.338638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:05.338696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:05.338746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.338806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.338858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.338914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.338965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.339038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.339611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:05.357709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:05.367008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:05.367064Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:05.367085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:05.367106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:05.367137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 633 [2:7561401360735414145:6806]
2025-10-15T10:59:05.367195Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:05.367266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:05.367283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:05.367296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:05.367309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:05.367624Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:05.367652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:05.367684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:05.386734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 633
2025-10-15T10:59:05.386822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 633, pipe: [1:7561401357935721571:7236]
2025-10-15T10:59:05.386879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 633
2025-10-15T10:59:05.383672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.383699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.383709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.383719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:05.383977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:05.383995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.384129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.384306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.384540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:05.384612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401360735414140:6806]
2025-10-15T10:59:05.384626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401360735414140:6806]
2025-10-15T10:59:05.384639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401360735414140:6806]
2025-10-15T10:59:05.384670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:05.384740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:05.384928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:05.384946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:05.385071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401360735414140:6806]
2025-10-15T10:59:05.385090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:05.385354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:05.385367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:05.385379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:05.385402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:05.386389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401357935721370:2467], now have 1 active actors on pipe
2025-10-15T10:59:05.386417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401357935721571:7236], now have 1 active actors on pipe
2025-10-15T10:59:05.386441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401357935721483:7552], now have 1 active actors on pipe
2025-10-15T10:59:05.390372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 634 partition: 0 MaxSeqNo: 46 sessionId: src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0
2025-10-15T10:59:05.391270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50179ee2-bef7b27a-b7c242c9-67462dbc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:05.387973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:05.388010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:05.388089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:05.388124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:05.388145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:05.388157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:05.388201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:05.388255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:05.388306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:05.389862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:05.389897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:05.389973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:05.424875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0] Write session: try to update token
2025-10-15T10:59:05.424932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:05.551804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:05.551830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:05.551838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:05.551878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:05.551888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:05.551897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:05.551904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:05.551926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401360735414140:6806]
2025-10-15T10:59:05.551943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401360735414140:6806]
2025-10-15T10:59:05.551958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401360735414140:6806]
2025-10-15T10:59:05.552127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:05.552139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:05.552148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:05.552184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:05.552226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:05.553113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:05.564765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId: src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:05.583186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:05.698201Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:05.709859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:05.709926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:05.710007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:05.710022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:05.710060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401360735414140:6806]
2025-10-15T10:59:05.710508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:05.711437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:05.716340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:05.716507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401357935721571:7236]
2025-10-15T10:59:05.716578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:05.728611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 634 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0
2025-10-15T10:59:05.728887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 634 sessionId: src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0 is DEAD
2025-10-15T10:59:05.735078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:05.735117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0] Write session will restart in 0.009100s
2025-10-15T10:59:05.735208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0] Write session: Do CDS request
2025-10-15T10:59:05.735235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:05.752412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:05.752764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:05.752799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 635
2025-10-15T10:59:05.753087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:05.753183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:05.753197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:05.753206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:05.754161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 635 sessionId:  describe result for acl check
2025-10-15T10:59:05.754247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:05.754256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:05.754264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:05.754278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401357935721603:7557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:05.756316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401357935721603:7557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:05.763699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401357935721603:7557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:05.771767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401357935721603:7557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:05.771822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401357935721603:7557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:05.771843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401357935721603:7557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:05.771880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:05.816954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401357935721736:7236]
2025-10-15T10:59:05.853304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:05.855402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:05.856204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:05.856224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:05.856269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:05.856521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:05.856705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401360735414372:6815]
2025-10-15T10:59:05.859577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:05.860986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:05.861234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:05.862654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:05.863023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:05.863033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:05.863041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:05.863049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:05.863056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:05.863064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:05.863071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:05.863078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:05.863086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:05.863094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:05.863102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:05.863109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.863116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.863124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.863176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:05.863298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:05.863372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:05.863426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:05.863479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:05.863528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:05.863582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:05.863632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:05.863682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:05.863738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:05.863787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:05.863835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.863887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.863939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.863988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:05.864066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:05.864131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:05.864195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:05.864247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:05.864309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:05.865252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:05.865332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:05.865392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:05.865450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:05.865498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:05.865557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:05.865608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:05.865665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:05.865715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:05.865775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:05.865827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:05.865901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:05.865953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:05.866014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:05.866065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:05.866125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:05.866178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.866237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.866291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.866349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.866401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.866463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.867032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:05.902170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:05.920531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:05.920579Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:05.920597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:05.920618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:05.920643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 634 [2:7561401360735414372:6815]
2025-10-15T10:59:05.920695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:05.920759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:05.920774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:05.920789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:05.920801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:05.920856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:05.920880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:05.920902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:05.922727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.922758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.922771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.922782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:05.923053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:05.923077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:05.923225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:05.923434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:05.923696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:05.923789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401357935721736:7236], now have 1 active actors on pipe
2025-10-15T10:59:05.923820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401357935721633:7557], now have 1 active actors on pipe
2025-10-15T10:59:05.923841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401357935721589:2467], now have 1 active actors on pipe
2025-10-15T10:59:05.923867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401360735414367:6815]
2025-10-15T10:59:05.923884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401360735414367:6815]
2025-10-15T10:59:05.923898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401360735414367:6815]
2025-10-15T10:59:05.923935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:05.923986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:05.924001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:05.924015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:05.924028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:05.924210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:05.924237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:05.924363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401360735414367:6815]
2025-10-15T10:59:05.924390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:05.925271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 634
2025-10-15T10:59:05.925377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 634, pipe: [1:7561401357935721736:7236]
2025-10-15T10:59:05.925457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 634
2025-10-15T10:59:05.924448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:05.926813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:05.926850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:05.926932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:05.926967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:05.926990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:05.927003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:05.927045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:05.927093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:05.927143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:05.929538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:05.929578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:05.929662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:05.930103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 635 partition: 0 MaxSeqNo: 46 sessionId: src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0
2025-10-15T10:59:05.931416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab57866-91e2d15c-362a2e09-f0569b8f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:05.973761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0] Write session: try to update token
2025-10-15T10:59:05.973830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:06.051477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:06.051511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:06.051524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:06.051586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:06.051602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:06.051616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:06.051627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:06.051663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401360735414367:6815]
2025-10-15T10:59:06.051693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401360735414367:6815]
2025-10-15T10:59:06.051717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401360735414367:6815]
2025-10-15T10:59:06.051861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:06.051871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:06.051884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:06.051903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:06.051932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:06.052924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:06.143996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId: src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:06.166320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:06.231454Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:06.239557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:06.239608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:06.244091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:06.247856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401357935721736:7236]
2025-10-15T10:59:06.248018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:06.268943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 635 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0
2025-10-15T10:59:06.269301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 635 sessionId: src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0 is DEAD
2025-10-15T10:59:06.276492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:06.276545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0] Write session will restart in 0.005334s
2025-10-15T10:59:06.276663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0] Write session: Do CDS request
2025-10-15T10:59:06.276687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:06.288056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:06.290057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:06.291635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:06.291670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 636
2025-10-15T10:59:06.295601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:06.295793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:06.295818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:06.295829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:06.300333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 636 sessionId:  describe result for acl check
2025-10-15T10:59:06.300467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:06.300484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:06.300493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:06.300513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401362230689157:7568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:06.303313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401362230689157:7568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:06.311269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401362230689157:7568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:06.323547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401362230689157:7568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:06.323597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401362230689157:7568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:06.323617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401362230689157:7568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:06.323652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:06.348213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401362230689301:7236]
2025-10-15T10:59:06.375237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:06.377540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:06.378509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:06.378529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:06.378577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:06.378856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:06.379038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401365030381916:6824]
2025-10-15T10:59:06.381256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:06.382326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:06.382546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:06.383894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:06.384267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:06.384277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:06.384283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:06.384290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:06.384297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:06.384304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:06.384311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:06.384319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:06.384327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:06.384335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:06.384342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:06.384350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.384358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.384366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.384417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:06.384533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:06.384584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:06.384631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:06.384682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:06.384730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:06.384780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:06.384828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:06.384875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:06.384925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:06.384974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:06.385032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.385088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.385136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.385191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:06.385265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:06.385329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:06.385388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:06.385443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:06.385500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:06.385544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:06.385603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:06.385656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:06.385714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:06.385763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:06.385819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:06.385867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:06.385938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:06.385988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:06.386041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:06.386093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:06.386151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:06.386210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:06.386266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:06.386353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:06.386415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:06.386484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.386547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.386600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.386658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.386705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.386765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.387300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:06.424910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:06.436072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:06.436117Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:06.436136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:06.436155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:06.436179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 635 [2:7561401365030381916:6824]
2025-10-15T10:59:06.436230Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:06.436287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:06.436301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:06.436313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:06.436325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:06.436376Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:06.436406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:06.436429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:06.438062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.438091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.438105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.438116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:06.438392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:06.438415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.438555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.438746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.438986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:06.439087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401362230689301:7236], now have 1 active actors on pipe
2025-10-15T10:59:06.439118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401362230689153:2467], now have 1 active actors on pipe
2025-10-15T10:59:06.439140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401362230689227:7568], now have 1 active actors on pipe
2025-10-15T10:59:06.439166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401365030381911:6824]
2025-10-15T10:59:06.439186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401365030381911:6824]
2025-10-15T10:59:06.439199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401365030381911:6824]
2025-10-15T10:59:06.439240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:06.439322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:06.439411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:06.439428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:06.439441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:06.439653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:06.439678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:06.439807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401365030381911:6824]
2025-10-15T10:59:06.439847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:06.439904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:06.440747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:06.440783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:06.440857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|483efc55-60c5432c-bfecd487-fb8a1958_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:06.440904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:06.440924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:06.440934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:06.440973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:06.441019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:06.441066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:06.441727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:06.441757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:06.441838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:06.442922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90781e2c-ab8108fe-ed35d74c-4f8fd1e9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|483efc55-60c5432c-bfecd487-fb8a1958_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:06.439513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 635, pipe: [1:7561401362230689301:7236]
2025-10-15T10:59:06.439645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 635
2025-10-15T10:59:06.439729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 635
2025-10-15T10:59:06.442167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 636 partition: 0 MaxSeqNo: 46 sessionId: src_id|483efc55-60c5432c-bfecd487-fb8a1958_0
2025-10-15T10:59:06.475815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483efc55-60c5432c-bfecd487-fb8a1958_0] Write session: try to update token
2025-10-15T10:59:06.475876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483efc55-60c5432c-bfecd487-fb8a1958_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:06.503122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:06.503157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:06.503196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401365030381911:6824]
2025-10-15T10:59:06.503334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:06.503374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:06.505412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:06.507456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:06.520632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:06.555902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:06.557567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:06.557989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:06.558013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:06.558025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:06.558080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:06.632576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:06.632609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:06.632622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:06.632630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:06.632680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401365030381911:6824]
2025-10-15T10:59:06.632703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401365030381911:6824]
2025-10-15T10:59:06.632724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401365030381911:6824]
2025-10-15T10:59:06.632861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:06.632871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:06.632880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:06.632906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:06.632941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:06.634031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:06.637387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId: src_id|483efc55-60c5432c-bfecd487-fb8a1958_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:06.670321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:06.670533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:59:06.670578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-10-15T10:59:06.785859Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:06.787201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:06.787231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:06.788173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:06.789138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401362230689301:7236]
2025-10-15T10:59:06.789220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:06.789277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-10-15T10:59:06.789486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:06.846621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 636 reason: status is not ok: tablet will be restarted right now sessionId: src_id|483efc55-60c5432c-bfecd487-fb8a1958_0
2025-10-15T10:59:06.846998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 636 sessionId: src_id|483efc55-60c5432c-bfecd487-fb8a1958_0 is DEAD
2025-10-15T10:59:06.847622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483efc55-60c5432c-bfecd487-fb8a1958_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:06.847680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483efc55-60c5432c-bfecd487-fb8a1958_0] Write session will restart in 0.007874s
2025-10-15T10:59:06.847836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483efc55-60c5432c-bfecd487-fb8a1958_0] Write session: Do CDS request
2025-10-15T10:59:06.847875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483efc55-60c5432c-bfecd487-fb8a1958_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:06.868423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483efc55-60c5432c-bfecd487-fb8a1958_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:06.872565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:06.872605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 637
2025-10-15T10:59:06.872963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:06.873082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:06.873097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:06.873107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:06.874025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 637 sessionId:  describe result for acl check
2025-10-15T10:59:06.874095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:06.874102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:06.874107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:06.874118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401362230689486:7576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:06.875910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401362230689486:7576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:06.882345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401362230689486:7576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:06.888014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401362230689580:7236]
2025-10-15T10:59:06.890165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401362230689486:7576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:06.890208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401362230689486:7576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:06.890224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401362230689486:7576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:06.890251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:06.896926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:06.904061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:06.904834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:06.904847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:06.904879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:06.905097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:06.905238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401365030382143:6829]
2025-10-15T10:59:06.907061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:06.908109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:06.908342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:06.909578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:06.909932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:06.909952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:06.909958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:06.909964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:06.909972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:06.909978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:06.909985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:06.909991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:06.909997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:06.910004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:06.910012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:06.910018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.910026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.910032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.910083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:06.910189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:06.910239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:06.910276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:06.910311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:06.910357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:06.910396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:06.910434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:06.910480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:06.910519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:06.910560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:06.910597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.910631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.910664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.910693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:06.910739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:06.910779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:06.910817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:06.910849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:06.910887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:06.910915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:06.910964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:06.911011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:06.911063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:06.911105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:06.911158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:06.911207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:06.911261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:06.911308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:06.912126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:06.912191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:06.912255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:06.912302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:06.912359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:06.912412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:06.912479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:06.912538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.912580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.912635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.912690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.912726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.912764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.913163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:06.931085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:06.941632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:06.941681Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:06.941701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:06.941721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:06.941748Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 636 [2:7561401365030382143:6829]
2025-10-15T10:59:06.941791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:06.941837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:06.941847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:06.941857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:06.941865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:06.941912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:06.941931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:06.941951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:06.942785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.942794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.942806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.942817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:06.943057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:06.943069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:06.943161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:06.943283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:06.943495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:06.943554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401365030382138:6829]
2025-10-15T10:59:06.943568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401365030382138:6829]
2025-10-15T10:59:06.943580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401365030382138:6829]
2025-10-15T10:59:06.943608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:06.943680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:06.943692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:06.943703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:06.943822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:06.944011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 636, pipe: [1:7561401362230689580:7236]
2025-10-15T10:59:06.944124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 636
2025-10-15T10:59:06.944209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 636
2025-10-15T10:59:06.944011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:06.944039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:06.944084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401362230689580:7236], now have 1 active actors on pipe
2025-10-15T10:59:06.944106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401362230689586:7576], now have 1 active actors on pipe
2025-10-15T10:59:06.944126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401362230689378:2467], now have 1 active actors on pipe
2025-10-15T10:59:06.944228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401365030382138:6829]
2025-10-15T10:59:06.944259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:06.944293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:06.944744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:06.944774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:06.944883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:06.944915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:06.944931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:06.944942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:06.944975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:06.945016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:06.945132Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:59:06.945226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:06.945913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 11 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:59:06.946070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:59:06.947022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 637 partition: 0 MaxSeqNo: 46 sessionId: src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0
2025-10-15T10:59:06.946672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:06.946698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:06.946758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:06.947842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483efc55-60c5432c-bfecd487-fb8a1958_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:06.993130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0] Write session: try to update token
2025-10-15T10:59:06.993200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:07.119916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId: src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:07.123960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:07.123989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:07.123999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:07.124006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:07.124030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401365030382138:6829]
2025-10-15T10:59:07.124048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401365030382138:6829]
2025-10-15T10:59:07.124062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401365030382138:6829]
2025-10-15T10:59:07.124176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:07.124185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:07.124191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:07.124262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:07.124281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:07.126733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:07.127505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:07.127563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:07.127597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:07.146915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:07.260887Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:07.286479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:07.286519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:07.286571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:07.286585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:07.286622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401365030382138:6829]
2025-10-15T10:59:07.286857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:07.287172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:07.287123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:07.287122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401362230689580:7236]
2025-10-15T10:59:07.287164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:07.287212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:07.296436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:07.296475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0] Write session will restart in 0.008366s
2025-10-15T10:59:07.295637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 637 reason: error at write: Disconnected sessionId: src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0
2025-10-15T10:59:07.295969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 637 sessionId: src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0 is DEAD
2025-10-15T10:59:07.296572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0] Write session: Do CDS request
2025-10-15T10:59:07.296599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:07.313073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:07.315597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:07.315638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 638
2025-10-15T10:59:07.319565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:07.319708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:07.319722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:07.319731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:07.322739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 638 sessionId:  describe result for acl check
2025-10-15T10:59:07.322852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:07.322864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:07.322873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:07.322889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401366525656937:7581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:07.325806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401366525656937:7581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:07.331768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401366525656937:7581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:07.339139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401366525656937:7581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:07.339190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401366525656937:7581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:07.339207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401366525656937:7581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:07.339236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:07.387256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401366525657065:7236]
2025-10-15T10:59:07.416539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:07.418657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:07.419481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:07.419505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:07.419544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:07.419788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:07.419976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401369325349683:6840]
2025-10-15T10:59:07.422323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:07.423485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:07.423724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:07.424898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:07.425200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:07.425207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:07.425214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:07.425221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:07.425227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:07.425234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:07.425241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:07.425248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:07.425254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:07.425262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:07.425271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:07.425279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.425285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.425292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.425334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:07.425440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:07.425485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:07.425529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:07.425572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:07.425615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:07.425654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:07.425692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:07.425738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:07.425783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:07.425828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:07.425872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.425928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.425969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.426011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:07.426074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:07.426129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:07.426177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:07.426220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:07.426273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:07.426319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:07.426372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:07.426419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:07.426474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:07.426521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:07.426575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:07.426620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:07.426671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:07.426718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:07.426770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:07.426813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:07.426870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:07.426913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:07.426962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:07.427008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:07.427059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:07.427107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.427159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.427716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.427812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.427880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.427930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.428381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:07.454781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:07.465819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:07.465868Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:07.465887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:07.465920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:07.465948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 637 [2:7561401369325349683:6840]
2025-10-15T10:59:07.466005Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:07.466064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:07.466081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:07.466094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:07.466106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:07.466159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:07.466184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:07.466208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:07.478941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.478965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.478972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.478979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:07.479171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:07.479181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.479268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.479434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.479644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:07.479733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401366525656967:7581], now have 1 active actors on pipe
2025-10-15T10:59:07.479762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401366525656924:2467], now have 1 active actors on pipe
2025-10-15T10:59:07.479786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401366525657065:7236], now have 1 active actors on pipe
2025-10-15T10:59:07.479809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401369325349678:6840]
2025-10-15T10:59:07.479827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401369325349678:6840]
2025-10-15T10:59:07.479838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401369325349678:6840]
2025-10-15T10:59:07.479873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:07.479933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:07.479947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:07.479968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:07.479981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:07.480125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:07.480150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:07.480168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 637
2025-10-15T10:59:07.480270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401369325349678:6840]
2025-10-15T10:59:07.480264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 637, pipe: [1:7561401366525657065:7236]
2025-10-15T10:59:07.480302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:07.480370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:07.480342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 637
2025-10-15T10:59:07.480650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:07.480683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:07.480748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:07.480782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:07.480799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:07.480810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:07.480846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:07.480893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:07.480940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:07.481652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:07.481676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:07.481749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:07.482891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12475bc8-9eefdd70-3e6d6492-c284d330_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:07.482066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 638 partition: 0 MaxSeqNo: 46 sessionId: src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0
2025-10-15T10:59:07.516453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0] Write session: try to update token
2025-10-15T10:59:07.516513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:07.555380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:07.555411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:07.555424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:07.555435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:07.555470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401369325349678:6840]
2025-10-15T10:59:07.555494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401369325349678:6840]
2025-10-15T10:59:07.555516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401369325349678:6840]
2025-10-15T10:59:07.555656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:07.555684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:07.556505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:07.556542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:07.556567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:07.557704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:07.647847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId: src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:07.673118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:07.717635Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:07.722478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:07.722526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:07.727017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:07.723542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:07.723577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401366525657065:7236]
2025-10-15T10:59:07.723593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:07.723704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:07.738301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 638 reason: error at write: Disconnected sessionId: src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0
2025-10-15T10:59:07.738687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 638 sessionId: src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0 is DEAD
2025-10-15T10:59:07.739774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:07.739816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0] Write session will restart in 0.007971s
2025-10-15T10:59:07.739901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0] Write session: Do CDS request
2025-10-15T10:59:07.739926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:07.772456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:07.777765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:07.777805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 639
2025-10-15T10:59:07.778872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:07.779023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:07.779039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:07.779067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:07.780637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 639 sessionId:  describe result for acl check
2025-10-15T10:59:07.780737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:07.780752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:07.780760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:07.780777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401366525657186:7592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:07.782957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401366525657186:7592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:07.797131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401366525657186:7592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:07.812153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401366525657186:7592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:07.812211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401366525657186:7592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:07.812244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401366525657186:7592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:07.812282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:07.823453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401366525657318:7236]
2025-10-15T10:59:07.852605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:07.854337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:07.854944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:07.854958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:07.854988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:07.855150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:07.855259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401369325349920:6847]
2025-10-15T10:59:07.856651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:07.857347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:07.857479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:07.858365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:07.858593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:07.858604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:07.858608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:07.858613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:07.858617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:07.858622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:07.858626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:07.858630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:07.858634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:07.858639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:07.858643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:07.858646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.858651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.858654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.858684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:07.858787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:07.858817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:07.858849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:07.858878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:07.858910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:07.858938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:07.858967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:07.858996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:07.859027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:07.859075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:07.859109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.859140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.859168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.859192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:07.859237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:07.859272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:07.859307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:07.859337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:07.859389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:07.859417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:07.859452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:07.859482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:07.859517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:07.859544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:07.859577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:07.859606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:07.859639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:07.859679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:07.859725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:07.859753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:07.859788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:07.859815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:07.859849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:07.859877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:07.859912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:07.859940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.859973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.860002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.860036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.860065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.860100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.860438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:07.881107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:07.891495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:07.891533Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:07.891548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:07.891573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:07.891595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 638 [2:7561401369325349920:6847]
2025-10-15T10:59:07.891641Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:07.891701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:07.891714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:07.891724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:07.891735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:07.891788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:07.891809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:07.891828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:07.894644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 638, pipe: [1:7561401366525657318:7236]
2025-10-15T10:59:07.894748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 638
2025-10-15T10:59:07.894811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 638
2025-10-15T10:59:07.893733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.893751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.893758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.893765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:07.894030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:07.894046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:07.894170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:07.894331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:07.894581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:07.894653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401366525657318:7236], now have 1 active actors on pipe
2025-10-15T10:59:07.894675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401366525657275:7592], now have 1 active actors on pipe
2025-10-15T10:59:07.894695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401366525657156:2467], now have 1 active actors on pipe
2025-10-15T10:59:07.894715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401369325349915:6847]
2025-10-15T10:59:07.894729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401369325349915:6847]
2025-10-15T10:59:07.894742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401369325349915:6847]
2025-10-15T10:59:07.894777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:07.894841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:07.894998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:07.895014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:07.895078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:07.895089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:07.895100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:07.895117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401369325349915:6847]
2025-10-15T10:59:07.895136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:07.895173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:07.895248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:07.895268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:07.895371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:07.895399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:07.895414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:07.895423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:07.895454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:07.895490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:07.895532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:07.896395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:07.896423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:07.896484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:07.896781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 639 partition: 0 MaxSeqNo: 46 sessionId: src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0
2025-10-15T10:59:07.897981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e8a18ea-27424616-e9fc65d0-799f6cc7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:07.949197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0] Write session: try to update token
2025-10-15T10:59:07.949248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:08.039893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:08.039953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:08.039977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:08.040003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:08.040065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401369325349915:6847]
2025-10-15T10:59:08.040112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401369325349915:6847]
2025-10-15T10:59:08.040171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401369325349915:6847]
2025-10-15T10:59:08.040649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:08.040679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:08.040693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:08.040799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:08.040830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:08.043466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:08.043514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:08.043541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:08.044651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:08.105698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId: src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:08.140287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:08.203915Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:08.213205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:08.213257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:08.213321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:08.213336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:08.213381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401369325349915:6847]
2025-10-15T10:59:08.213704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:08.214823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:08.219436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401366525657318:7236]
2025-10-15T10:59:08.219618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:08.224036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:08.236105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:08.236154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0] Write session will restart in 0.008877s
2025-10-15T10:59:08.236292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0] Write session: Do CDS request
2025-10-15T10:59:08.236326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:08.233478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 639 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0
2025-10-15T10:59:08.233917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 639 sessionId: src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0 is DEAD
2025-10-15T10:59:08.256905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:08.260112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:08.260157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 640
2025-10-15T10:59:08.260639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:08.260801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:08.260842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:08.260854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:08.269355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 640 sessionId:  describe result for acl check
2025-10-15T10:59:08.269494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:08.269505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:08.269516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:08.269535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401370820624736:7600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:08.272928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401370820624736:7600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:08.285898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401370820624736:7600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:08.318931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401370820624771:7236]
2025-10-15T10:59:08.320640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401370820624736:7600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:08.320694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401370820624736:7600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:08.320723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401370820624736:7600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:08.320768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:08.466646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:08.471104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:08.472076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:08.472097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:08.472150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:08.472456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:08.472669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401373620317457:6852]
2025-10-15T10:59:08.475121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:08.476611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:08.476880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:08.478284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:08.478682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:08.478691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:08.478701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:08.478709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:08.478717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:08.478727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:08.478736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:08.478744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:08.478752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:08.478761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:08.478769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:08.478777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.478784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.478793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.478848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:08.478980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:08.479034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:08.479087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:08.479139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:08.479192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:08.479245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:08.479305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:08.479391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:08.479447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:08.479504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:08.479560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.479613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.479666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.479722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:08.479803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:08.479872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:08.479932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:08.479988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:08.480050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:08.480102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:08.480163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:08.480218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:08.480283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:08.480341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:08.480406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:08.480461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:08.480525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:08.480577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:08.480642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:08.480709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:08.480775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:08.480827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:08.482103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:08.482200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:08.482282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:08.482337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.482406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.482463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.482529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.482586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.482654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.483305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:08.513567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:08.523108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:08.523163Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:08.523182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:08.523205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:08.523234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 639 [2:7561401373620317457:6852]
2025-10-15T10:59:08.523294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:08.524255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:08.524285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:08.524300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:08.524312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:08.524376Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:08.524403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:08.524427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:08.539586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 639
2025-10-15T10:59:08.538221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.539588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 639
2025-10-15T10:59:08.539680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 639, pipe: [1:7561401370820624771:7236]
2025-10-15T10:59:08.538244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.538253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.538263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:08.538548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:08.538566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.539941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.540166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.540424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:08.540527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401370820624775:7600], now have 1 active actors on pipe
2025-10-15T10:59:08.540555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401370820624723:2467], now have 1 active actors on pipe
2025-10-15T10:59:08.540579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401370820624771:7236], now have 1 active actors on pipe
2025-10-15T10:59:08.540635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:08.540660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:08.540722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401373620317452:6852]
2025-10-15T10:59:08.540740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401373620317452:6852]
2025-10-15T10:59:08.540754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401373620317452:6852]
2025-10-15T10:59:08.540797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:08.540886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:08.541053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:08.541065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:08.541113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|894cd612-bcccdeaf-aace647-33d203f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:08.541138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:08.541151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:08.541158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:08.541187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:08.541225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:08.541351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401373620317452:6852]
2025-10-15T10:59:08.541366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:08.541398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:08.541479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:08.541494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:08.541506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:08.541531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:08.543994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:08.544048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:08.544149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:08.547664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 640 partition: 0 MaxSeqNo: 46 sessionId: src_id|894cd612-bcccdeaf-aace647-33d203f5_0
2025-10-15T10:59:08.548599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb7462c0-920bb4a2-6e0c518e-260b4da_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|894cd612-bcccdeaf-aace647-33d203f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:08.583453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|894cd612-bcccdeaf-aace647-33d203f5_0] Write session: try to update token
2025-10-15T10:59:08.583511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|894cd612-bcccdeaf-aace647-33d203f5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:08.629220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:08.629256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:08.629271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:08.629281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:08.629314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401373620317452:6852]
2025-10-15T10:59:08.629341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401373620317452:6852]
2025-10-15T10:59:08.629365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401373620317452:6852]
2025-10-15T10:59:08.629516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:08.629528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:08.629539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:08.629582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:08.629601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:08.629743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:08.629772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:08.629799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:08.632809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:08.679318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId: src_id|894cd612-bcccdeaf-aace647-33d203f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:08.736426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:08.790343Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:08.798195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:08.798227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:08.800014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:08.800070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:08.801496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:08.803547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:08.803800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401370820624771:7236]
2025-10-15T10:59:08.812336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 640 reason: error at write: Disconnected sessionId: src_id|894cd612-bcccdeaf-aace647-33d203f5_0
2025-10-15T10:59:08.812702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 640 sessionId: src_id|894cd612-bcccdeaf-aace647-33d203f5_0 is DEAD
2025-10-15T10:59:08.817781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894cd612-bcccdeaf-aace647-33d203f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:08.817826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894cd612-bcccdeaf-aace647-33d203f5_0] Write session will restart in 0.008784s
2025-10-15T10:59:08.817961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894cd612-bcccdeaf-aace647-33d203f5_0] Write session: Do CDS request
2025-10-15T10:59:08.817995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894cd612-bcccdeaf-aace647-33d203f5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:08.834421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|894cd612-bcccdeaf-aace647-33d203f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:08.839681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:08.839720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 641
2025-10-15T10:59:08.843619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:08.843803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:08.843820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:08.843836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:08.845340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 641 sessionId:  describe result for acl check
2025-10-15T10:59:08.845454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:08.845464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:08.845482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:08.845499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401370820624965:7605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:08.848462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401370820624965:7605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:08.884466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401370820624965:7605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:08.906938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401370820624965:7605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:08.906988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401370820624965:7605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:08.907007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401370820624965:7605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:08.907039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:08.907193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401370820625076:7236]
2025-10-15T10:59:08.954994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:08.969038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:08.970042Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:08.970075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:08.970117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:08.970381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:08.970563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401373620317693:6861]
2025-10-15T10:59:08.973055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:08.974034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:08.974236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:08.975537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:08.975851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:08.975860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:08.975866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:08.975873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:08.975880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:08.975887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:08.975893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:08.975899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:08.975905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:08.975911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:08.975918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:08.975926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.975932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.975939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.975983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:08.976088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:08.976136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:08.976182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:08.976226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:08.976272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:08.976318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:08.976365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:08.976409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:08.976452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:08.976498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:08.976541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.976582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.976628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.976672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:08.976733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:08.976789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:08.976840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:08.976891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:08.976943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:08.976987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:08.977037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:08.977087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:08.977139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:08.977182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:08.977235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:08.977281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:08.977333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:08.977380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:08.978392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:08.978464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:08.978536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:08.978589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:08.978650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:08.978704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:08.978764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:08.978815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.978876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:08.978928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.978981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:08.979033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.979089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:08.979632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:09.008126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:09.018591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:09.018638Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:09.018655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:09.018674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:09.018697Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 640 [2:7561401373620317693:6861]
2025-10-15T10:59:09.018747Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:09.018805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:09.018818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:09.018831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:09.018842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:09.018886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:09.018905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:09.018927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:09.021043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:09.021071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:09.021084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:09.021096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:09.021367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:09.021384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:09.021521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:09.021706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:09.021951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:09.022017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401373620317687:6861]
2025-10-15T10:59:09.022031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401373620317687:6861]
2025-10-15T10:59:09.022044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401373620317687:6861]
2025-10-15T10:59:09.022072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:09.022138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:09.022249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:09.022263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:09.022274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:09.022309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:09.022327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:09.022445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401370820625076:7236], now have 1 active actors on pipe
2025-10-15T10:59:09.022466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401370820624952:2467], now have 1 active actors on pipe
2025-10-15T10:59:09.022487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401370820625078:7605], now have 1 active actors on pipe
2025-10-15T10:59:09.022503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401373620317687:6861]
2025-10-15T10:59:09.022533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:09.023765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:09.022991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 640, pipe: [1:7561401370820625076:7236]
2025-10-15T10:59:09.023079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 640
2025-10-15T10:59:09.023133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 640
2025-10-15T10:59:09.024704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:09.024738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:09.024823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80b48097-97627459-89af9e43-69dd38ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:09.024854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:09.024871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:09.024881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:09.024913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:09.024951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:09.024994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:09.028778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:09.028808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:09.028878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:09.029333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 641 partition: 0 MaxSeqNo: 46 sessionId: src_id|80b48097-97627459-89af9e43-69dd38ee_0
2025-10-15T10:59:09.032916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|894cd612-bcccdeaf-aace647-33d203f5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|80b48097-97627459-89af9e43-69dd38ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:09.080462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:09.080493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:09.080529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401373620317687:6861]
2025-10-15T10:59:09.080656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:09.083505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:09.093063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b48097-97627459-89af9e43-69dd38ee_0] Write session: try to update token
2025-10-15T10:59:09.093106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b48097-97627459-89af9e43-69dd38ee_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:09.095059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:09.096648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:09.097991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:09.141507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:09.148937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:09.149439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:09.149449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:09.149457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:09.149495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:09.180894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId: src_id|80b48097-97627459-89af9e43-69dd38ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:09.194215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:09.194252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:09.194265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:09.194276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:09.194316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401373620317687:6861]
2025-10-15T10:59:09.194353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401373620317687:6861]
2025-10-15T10:59:09.194387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401373620317687:6861]
2025-10-15T10:59:09.194518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:09.194529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:09.194551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:09.194557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:09.194605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:09.199656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:09.206256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:09.355826Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:09.357866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:09.357896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:09.359187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:09.360387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401370820625076:7236]
2025-10-15T10:59:09.360523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:09.360642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:09.375765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 641 reason: status is not ok: tablet will be restarted right now sessionId: src_id|80b48097-97627459-89af9e43-69dd38ee_0
2025-10-15T10:59:09.376040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 641 sessionId: src_id|80b48097-97627459-89af9e43-69dd38ee_0 is DEAD
2025-10-15T10:59:09.379757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b48097-97627459-89af9e43-69dd38ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:09.379813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b48097-97627459-89af9e43-69dd38ee_0] Write session will restart in 0.008980s
2025-10-15T10:59:09.379958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b48097-97627459-89af9e43-69dd38ee_0] Write session: Do CDS request
2025-10-15T10:59:09.380008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b48097-97627459-89af9e43-69dd38ee_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:09.398918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:09.398955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 642
2025-10-15T10:59:09.399696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b48097-97627459-89af9e43-69dd38ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:09.401248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:09.401402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:09.401425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:09.401435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:09.402682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 642 sessionId:  describe result for acl check
2025-10-15T10:59:09.402792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:09.402803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:09.402813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:09.402830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401375115592524:7618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:09.405373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401375115592524:7618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:09.415299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401375115592524:7618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:09.432623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401375115592524:7618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:09.432676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401375115592524:7618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:09.432691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401375115592524:7618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:09.432723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:09.462299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401375115592644:7236]
2025-10-15T10:59:09.493878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:09.495439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:09.496211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:09.496231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:09.496269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:09.496495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:09.496663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401377915285240:6869]
2025-10-15T10:59:09.498712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:09.502975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:09.503181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:09.504405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:09.504716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:09.504724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:09.504730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:09.504738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:09.504744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:09.504750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:09.504757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:09.504764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:09.504770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:09.504779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:09.504787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:09.504794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:09.504800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:09.504808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:09.504853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:09.504957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:09.505004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:09.505050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:09.505096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:09.505140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:09.505183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:09.505225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:09.505268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:09.505314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:09.505358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:09.505405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:09.505448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:09.505493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:09.505537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:09.505600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:09.505658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:09.505713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:09.505761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:09.505812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:09.505858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:09.505909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:09.505971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:09.506026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:09.506072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:09.506126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:09.506174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:09.506225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:09.506268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:09.506323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:09.506372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:09.506424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:09.506471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:09.506524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:09.506570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:09.506620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:09.506664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:09.506713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:09.506757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:09.506808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:09.506853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:09.506906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:09.508563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:09.550494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:09.559593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:09.559633Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:09.559648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:09.559666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:09.559688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 641 [2:7561401377915285240:6869]
2025-10-15T10:59:09.559737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:09.559997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:09.560018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:09.560030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:09.560039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:09.560085Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:09.560105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:09.560123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:09.561975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:09.562001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:09.562016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:09.562027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:09.562289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:09.562313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:09.562437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:09.562581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:09.562782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:09.562860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401375115592644:7236], now have 1 active actors on pipe
2025-10-15T10:59:09.562884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401375115592512:2467], now have 1 active actors on pipe
2025-10-15T10:59:09.562903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401375115592589:7618], now have 1 active actors on pipe
2025-10-15T10:59:09.562927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401377915285235:6869]
2025-10-15T10:59:09.562940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401377915285235:6869]
2025-10-15T10:59:09.562952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401377915285235:6869]
2025-10-15T10:59:09.562988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:09.563060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:09.563151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:09.563171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:09.563181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:09.563239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:09.563255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:09.563375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401377915285235:6869]
2025-10-15T10:59:09.563400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:09.563554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:09.568470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 641, pipe: [1:7561401375115592644:7236]
2025-10-15T10:59:09.568590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 641
2025-10-15T10:59:09.568675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 641
2025-10-15T10:59:09.569959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:09.569996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:09.570075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:09.570111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:09.570128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:09.570137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:09.570170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:09.570209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:09.570256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:09.570950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:09.570977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:09.571051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:09.573327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b48097-97627459-89af9e43-69dd38ee_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 540 BytesWritten: 103628882 MessagesWritten: 46 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-15T10:59:09.573448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b48097-97627459-89af9e43-69dd38ee_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:09.571603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 642 partition: 0 MaxSeqNo: 46 sessionId: src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0
2025-10-15T10:59:09.615314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0] Write session: try to update token
2025-10-15T10:59:09.615387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:09.759219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:09.759255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:09.759271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:09.759283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:09.759319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401377915285235:6869]
2025-10-15T10:59:09.759362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401377915285235:6869]
2025-10-15T10:59:09.759390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401377915285235:6869]
2025-10-15T10:59:09.759563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:09.759586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:09.759597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:09.760836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:09.760870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:09.760892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:09.782211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:09.782259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:09.789283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:09.805423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId: src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:09.826499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:09.951446Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:09.952709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:09.952725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:09.952767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401377915285235:6869]
2025-10-15T10:59:09.952896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:09.952918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:09.953539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:09.953671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:09.955899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401375115592644:7236]
2025-10-15T10:59:09.956028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:09.956210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:10.009633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 642 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0
2025-10-15T10:59:10.009934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 642 sessionId: src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0 is DEAD
2025-10-15T10:59:10.015606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:10.015656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0] Write session will restart in 0.008496s
2025-10-15T10:59:10.015772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0] Write session: Do CDS request
2025-10-15T10:59:10.015810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:10.035635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:10.035661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 643
2025-10-15T10:59:10.036229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:10.040171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:10.040305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:10.040320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:10.040328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:10.041945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 643 sessionId:  describe result for acl check
2025-10-15T10:59:10.042067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:10.042076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:10.042084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:10.042100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401379410560154:7632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:10.044453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401379410560154:7632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:10.055806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401379410560154:7632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:10.055988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401379410560217:7236]
2025-10-15T10:59:10.069591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401379410560154:7632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:10.069635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401379410560154:7632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:10.069652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401379410560154:7632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:10.069680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:10.084667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:10.091878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:10.092729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:10.092749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:10.092789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:10.093039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:10.093218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401382210252768:6875]
2025-10-15T10:59:10.095687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:10.098876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:10.099112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:10.100347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:10.100674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:10.100683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:10.100689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:10.100697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:10.100704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:10.100711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:10.100717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:10.100724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:10.100731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:10.100736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:10.100743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:10.100750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.100758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.100766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.100811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:10.100919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:10.100967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:10.101015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:10.101058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:10.101099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:10.101141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:10.101181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:10.101221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:10.101264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:10.101306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:10.101348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.101388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.101427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.101468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:10.101530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:10.101580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:10.101628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:10.101675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:10.101726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:10.101767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:10.101815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:10.101859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:10.101908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:10.101966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:10.102017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:10.102063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:10.102113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:10.102154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:10.102200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:10.102244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:10.102294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:10.102337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:10.102386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:10.102425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:10.102475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:10.102516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.102564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.102609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.102657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.102700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.102749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.103205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:10.159920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:10.171047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:10.171094Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:10.171113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:10.171131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:10.171154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 642 [2:7561401382210252768:6875]
2025-10-15T10:59:10.171208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:10.171266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:10.171281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:10.171293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:10.171304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:10.171426Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:10.171456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:10.171477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:10.172501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.172517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.172533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.172546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:10.172803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:10.172821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.172959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.173138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.173367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:10.173430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401382210252762:6875]
2025-10-15T10:59:10.173445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401382210252762:6875]
2025-10-15T10:59:10.173458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401382210252762:6875]
2025-10-15T10:59:10.173498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:10.173563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:10.173732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:10.173748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:10.173853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401382210252762:6875]
2025-10-15T10:59:10.173871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:10.174237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:10.174249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:10.174259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:10.174281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:10.174860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401379410560217:7236], now have 1 active actors on pipe
2025-10-15T10:59:10.174884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401375115592763:2467], now have 1 active actors on pipe
2025-10-15T10:59:10.174904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401379410560272:7632], now have 1 active actors on pipe
2025-10-15T10:59:10.175617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 642, pipe: [1:7561401379410560217:7236]
2025-10-15T10:59:10.175714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 642
2025-10-15T10:59:10.175787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 642
2025-10-15T10:59:10.176790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:10.176824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:10.176892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1edd7cbc-e0c45575-8d519468-75a002c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:10.176925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:10.176942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:10.176958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:10.176990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:10.177028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:10.177069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:10.180528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:10.180583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:10.180682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:10.181180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 643 partition: 0 MaxSeqNo: 46 sessionId: src_id|1edd7cbc-e0c45575-8d519468-75a002c_0
2025-10-15T10:59:10.183600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7d16c3-edc7b68a-854ce975-bc21425a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1edd7cbc-e0c45575-8d519468-75a002c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:10.212912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1edd7cbc-e0c45575-8d519468-75a002c_0] Write session: try to update token
2025-10-15T10:59:10.212976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1edd7cbc-e0c45575-8d519468-75a002c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:10.230579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:10.230613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:10.230649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401382210252762:6875]
2025-10-15T10:59:10.230739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:10.242410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:10.245913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:10.247207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:10.248471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:10.249682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:10.255821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:10.256254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:10.272048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:10.272076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:10.272104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:10.358383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId: src_id|1edd7cbc-e0c45575-8d519468-75a002c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:10.436138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:10.456199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:10.456233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:10.456245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:10.456307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:10.456322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:10.456335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:10.456348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:10.456391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401382210252762:6875]
2025-10-15T10:59:10.456418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401382210252762:6875]
2025-10-15T10:59:10.456441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401382210252762:6875]
2025-10-15T10:59:10.456657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:10.456685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:10.456724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:10.456750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:10.457761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:10.459878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:10.459924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:10.459953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:10.493613Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 6 CurrentSessionLifetimeMs: 301785 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:59:10.623078Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:10.632153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:10.631529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:10.631567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:10.632892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401379410560217:7236]
2025-10-15T10:59:10.632994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:10.646158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edd7cbc-e0c45575-8d519468-75a002c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:10.646223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edd7cbc-e0c45575-8d519468-75a002c_0] Write session will restart in 0.008073s
2025-10-15T10:59:10.646383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edd7cbc-e0c45575-8d519468-75a002c_0] Write session: Do CDS request
2025-10-15T10:59:10.646432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edd7cbc-e0c45575-8d519468-75a002c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:10.645312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 643 reason: error at write: Disconnected sessionId: src_id|1edd7cbc-e0c45575-8d519468-75a002c_0
2025-10-15T10:59:10.645681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 643 sessionId: src_id|1edd7cbc-e0c45575-8d519468-75a002c_0 is DEAD
2025-10-15T10:59:10.660353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1edd7cbc-e0c45575-8d519468-75a002c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:10.662548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:10.662585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 644
2025-10-15T10:59:10.663028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:10.663142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:10.663157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:10.663166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:10.665189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 644 sessionId:  describe result for acl check
2025-10-15T10:59:10.665315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:10.665333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:10.665343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:10.665360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401379410560323:7637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:10.668078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401379410560323:7637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:10.678445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401379410560323:7637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:10.692154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401379410560323:7637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:10.692197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401379410560323:7637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:10.692213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401379410560323:7637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:10.692245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:10.736345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401379410560411:7236]
2025-10-15T10:59:10.793565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:10.799840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:10.800541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:10.800554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:10.800585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:10.800761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:10.800887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401382210253035:6884]
2025-10-15T10:59:10.803020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:10.804339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:10.804601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:10.806101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:10.806491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:10.806501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:10.806509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:10.806518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:10.806526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:10.806535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:10.806543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:10.806551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:10.806559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:10.806568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:10.806576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:10.806584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.806592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.806600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.806657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:10.806781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:10.806830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:10.806882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:10.806929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:10.806978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:10.807023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:10.807076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:10.807125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:10.807175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:10.807223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:10.807271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.807317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.807745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.807816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:10.807909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:10.807976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:10.808035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:10.808096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:10.808150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:10.808195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:10.808250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:10.808303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:10.808359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:10.808407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:10.808465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:10.808518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:10.808574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:10.808622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:10.808679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:10.808732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:10.808804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:10.808862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:10.808930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:10.808991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:10.809053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:10.809102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.809162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.809216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.809268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.809311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.809363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.809925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:10.835854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:10.863306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:10.863364Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:10.863379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:10.863394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:10.863417Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 643 [2:7561401382210253035:6884]
2025-10-15T10:59:10.863459Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:10.863509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:10.863522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:10.863533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:10.863544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:10.863586Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:10.863606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:10.863625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:10.864615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.864638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.864651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.864661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:10.864915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:10.864936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:10.865065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:10.865248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:10.865482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:10.865546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401382210253030:6884]
2025-10-15T10:59:10.865566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401382210253030:6884]
2025-10-15T10:59:10.865580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401382210253030:6884]
2025-10-15T10:59:10.865619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:10.865690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:10.865864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:10.865886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:10.866006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401382210253030:6884]
2025-10-15T10:59:10.866029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:10.866477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:10.866495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:10.866506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:10.866528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:10.868533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401379410560310:2467], now have 1 active actors on pipe
2025-10-15T10:59:10.868568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401379410560411:7236], now have 1 active actors on pipe
2025-10-15T10:59:10.868588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401379410560354:7637], now have 1 active actors on pipe
2025-10-15T10:59:10.868644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:10.868662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:10.868728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:10.868758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:10.868775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:10.868784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:10.868817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:10.868854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:10.868892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:10.867513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 643
2025-10-15T10:59:10.867608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 643, pipe: [1:7561401379410560411:7236]
2025-10-15T10:59:10.867679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 643
2025-10-15T10:59:10.875179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:10.875218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:10.875303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:10.880475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edd7cbc-e0c45575-8d519468-75a002c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:10.879572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 644 partition: 0 MaxSeqNo: 46 sessionId: src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0
2025-10-15T10:59:10.932566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0] Write session: try to update token
2025-10-15T10:59:10.932617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:11.029624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:11.029645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:11.029653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:11.029730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:11.029739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:11.029746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:11.029752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:11.029770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401382210253030:6884]
2025-10-15T10:59:11.029786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401382210253030:6884]
2025-10-15T10:59:11.029799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401382210253030:6884]
2025-10-15T10:59:11.030907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:11.030939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:11.030967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:11.043389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:11.043427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:11.044499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:11.077478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId: src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:11.101012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:11.192339Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:11.194226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:11.194242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:11.194281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401382210253030:6884]
2025-10-15T10:59:11.194410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:11.194434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:11.194757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:11.195847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:11.199957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:11.208414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 644 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0
2025-10-15T10:59:11.208652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 644 sessionId: src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0 is DEAD
2025-10-15T10:59:11.211600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:11.211661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0] Write session will restart in 0.008538s
2025-10-15T10:59:11.211769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0] Write session: Do CDS request
2025-10-15T10:59:11.211800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:11.231906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:11.242011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:11.242212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401379410560411:7236]
2025-10-15T10:59:11.242297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:11.242316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 645
2025-10-15T10:59:11.247290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:11.247459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:11.247482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:11.247493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:11.249060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 645 sessionId:  describe result for acl check
2025-10-15T10:59:11.249193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:11.249215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:11.249227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:11.249247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401383705527885:7648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:11.252238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401383705527885:7648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:11.263157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401383705527885:7648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:11.279027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401383705527885:7648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:11.279090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401383705527885:7648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:11.279104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401383705527885:7648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:11.279133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:11.310664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:11.317431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:11.318234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:11.318255Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:11.318285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:11.318459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:11.318575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401386505220557:6892]
2025-10-15T10:59:11.320837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:11.321755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:11.321954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:11.323250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:11.323631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:11.323649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:11.323656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:11.323664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:11.323670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:11.323677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:11.323683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:11.323689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:11.323696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:11.323705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:11.323713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:11.323720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.323726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.323733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.323776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:11.323880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:11.323927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:11.323971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:11.324014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:11.324060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:11.324104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:11.324147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:11.324202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:11.324251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:11.324301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:11.324350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.324399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.324449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.324494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:11.324558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:11.324620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:11.324675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:11.324728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:11.324783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:11.324829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:11.324884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:11.324935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:11.324985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:11.325029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:11.325076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:11.325120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:11.325174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:11.325215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:11.325266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:11.325311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:11.325357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:11.325398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:11.325449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:11.325492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:11.325543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:11.325587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.325639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.325685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.325734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.325779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.325839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.326431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:11.343681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401383705528101:7236]
2025-10-15T10:59:11.354313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:11.370990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:11.371924Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:11.371949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:11.371968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:11.371994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 644 [2:7561401386505220557:6892]
2025-10-15T10:59:11.372043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:11.372094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:11.372108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:11.372120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:11.372131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:11.372174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:11.372196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:11.372217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:11.396716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 644, pipe: [1:7561401383705528101:7236]
2025-10-15T10:59:11.396851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 644
2025-10-15T10:59:11.396963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 644
2025-10-15T10:59:11.396120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.396145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.396153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.396161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:11.396414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:11.396429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.396541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.396677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.396849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:11.396912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401383705527979:7648], now have 1 active actors on pipe
2025-10-15T10:59:11.396931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401383705527881:2467], now have 1 active actors on pipe
2025-10-15T10:59:11.396948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401383705528101:7236], now have 1 active actors on pipe
2025-10-15T10:59:11.396971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401386505220551:6892]
2025-10-15T10:59:11.396983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401386505220551:6892]
2025-10-15T10:59:11.396994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401386505220551:6892]
2025-10-15T10:59:11.397031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:11.397091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:11.397106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:11.397120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:11.397130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:11.397240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:11.397254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:11.397385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:11.397404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:11.397443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401386505220551:6892]
2025-10-15T10:59:11.397469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:11.397555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:11.397583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:11.397599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:11.397609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:11.397638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:11.397671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:11.397746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:11.398489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:11.399430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:11.399462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:11.399541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:11.399818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 645 partition: 0 MaxSeqNo: 46 sessionId: src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0
2025-10-15T10:59:11.403880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e31177-f3928072-c93d30ae-d1ad3b32_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:11.448474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0] Write session: try to update token
2025-10-15T10:59:11.448533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:11.517735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:11.517773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:11.517788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:11.517856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:11.517874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:11.517889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:11.517902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:11.517943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401386505220551:6892]
2025-10-15T10:59:11.517989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401386505220551:6892]
2025-10-15T10:59:11.518016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401386505220551:6892]
2025-10-15T10:59:11.518157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:11.518182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:11.518204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:11.518206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:11.518233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:11.519699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:11.575916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId: src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:11.596132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:11.672688Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:11.674503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:11.674537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:11.676348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:11.676430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:11.677242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:11.679221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:11.679535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401383705528101:7236]
2025-10-15T10:59:11.727676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 645 reason: error at write: Disconnected sessionId: src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0
2025-10-15T10:59:11.727986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 645 sessionId: src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0 is DEAD
2025-10-15T10:59:11.731438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:11.731515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0] Write session will restart in 0.008387s
2025-10-15T10:59:11.731700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0] Write session: Do CDS request
2025-10-15T10:59:11.731767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:11.745830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:11.746801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:11.746847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 646
2025-10-15T10:59:11.747211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:11.747377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:11.747395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:11.747405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:11.749155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 646 sessionId:  describe result for acl check
2025-10-15T10:59:11.749269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:11.749280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:11.749289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:11.749308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401383705528167:7656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:11.752801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401383705528167:7656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:11.766839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401383705528167:7656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:11.780167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401383705528278:7236]
2025-10-15T10:59:11.787654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401383705528167:7656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:11.787702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401383705528167:7656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:11.787720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401383705528167:7656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:11.787751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:11.797870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:11.804110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:11.804907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:11.804939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:11.804979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:11.805224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:11.805410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401386505220816:6896]
2025-10-15T10:59:11.807526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:11.808594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:11.808806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:11.810012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:11.810362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:11.810369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:11.810375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:11.810381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:11.810387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:11.810393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:11.810399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:11.810406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:11.810412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:11.810418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:11.810425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:11.810430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.810437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.810444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.810486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:11.810584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:11.810631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:11.810675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:11.810716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:11.810759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:11.810799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:11.810840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:11.810880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:11.810921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:11.810961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:11.811004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.811044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.811084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.811120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:11.811178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:11.811226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:11.811275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:11.811319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:11.811388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:11.811431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:11.811480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:11.811523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:11.811570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:11.811611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:11.811660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:11.811702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:11.811750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:11.811793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:11.811843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:11.811885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:11.811934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:11.811976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:11.812029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:11.812071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:11.812119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:11.812162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.812214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.812257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.812305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.812343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.812391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.812842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:11.842093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:11.854931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 645
2025-10-15T10:59:11.855036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 645
2025-10-15T10:59:11.855125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 645, pipe: [1:7561401383705528278:7236]
2025-10-15T10:59:11.852407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:11.852460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:11.852474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:11.852490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:11.852512Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 645 [2:7561401386505220816:6896]
2025-10-15T10:59:11.852558Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:11.852607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:11.852620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:11.852631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:11.852640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:11.852683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:11.852704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:11.852723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:11.854277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.854292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.854304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.854314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:11.854556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:11.854570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:11.854700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:11.854874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:11.855096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:11.855165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401383705528319:7656], now have 1 active actors on pipe
2025-10-15T10:59:11.855190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401383705528115:2467], now have 1 active actors on pipe
2025-10-15T10:59:11.855211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401383705528278:7236], now have 1 active actors on pipe
2025-10-15T10:59:11.855234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401386505220802:6896]
2025-10-15T10:59:11.855247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401386505220802:6896]
2025-10-15T10:59:11.855260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401386505220802:6896]
2025-10-15T10:59:11.855322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:11.855334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:11.855343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:11.856160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:11.856265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:11.856439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:11.856454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:11.856512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:11.856530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:11.856651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401386505220802:6896]
2025-10-15T10:59:11.856679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:11.856741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:11.856766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:11.856782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:11.856792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:11.856823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:11.856856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:11.856969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:11.857264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:11.857693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:11.857718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:11.857776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:11.858165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 646 partition: 0 MaxSeqNo: 46 sessionId: src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0
2025-10-15T10:59:11.859965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652b92dd-7effc4f2-66f4ab83-af582abb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:11.902827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0] Write session: try to update token
2025-10-15T10:59:11.902891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:11.994299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:11.994325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:11.994334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:11.994378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:11.994390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:11.994401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:11.994409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:11.994437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401386505220802:6896]
2025-10-15T10:59:11.994460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401386505220802:6896]
2025-10-15T10:59:11.994480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401386505220802:6896]
2025-10-15T10:59:11.994601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:11.994623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:11.995295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:11.995366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:11.995392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:12.008567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:12.030686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId: src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:12.052908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:12.148011Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:12.149964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:12.150014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:12.154874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:12.155054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401383705528278:7236]
2025-10-15T10:59:12.155139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:12.155154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:12.164049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:12.168986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 646 reason: error at write: Disconnected sessionId: src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0
2025-10-15T10:59:12.169435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 646 sessionId: src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0 is DEAD
2025-10-15T10:59:12.171790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:12.171828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0] Write session will restart in 0.008392s
2025-10-15T10:59:12.171957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0] Write session: Do CDS request
2025-10-15T10:59:12.172012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:12.192574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:12.193749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:12.193785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 647
2025-10-15T10:59:12.194253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:12.194367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:12.194381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:12.194391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:12.198099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 647 sessionId:  describe result for acl check
2025-10-15T10:59:12.198241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:12.198254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:12.198263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:12.198279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401388000495683:7661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:12.201488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401388000495683:7661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:12.222960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401388000495683:7661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:12.246435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401388000495683:7661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:12.246490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401388000495683:7661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:12.246508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401388000495683:7661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:12.246544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:12.255419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401388000495823:7236]
2025-10-15T10:59:12.285541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:12.288239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:12.289186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:12.289228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:12.289277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:12.289571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:12.289764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401390800188359:6906]
2025-10-15T10:59:12.292166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:12.293645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:12.293882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:12.295763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:12.296136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:12.296144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:12.296151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:12.296159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:12.296165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:12.296172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:12.296179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:12.296186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:12.296193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:12.296201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:12.296208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:12.296216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.296223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.296230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.296280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:12.296400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:12.296451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:12.296499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:12.296549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:12.296600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:12.296648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:12.296697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:12.296743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:12.296792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:12.296839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:12.296886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.296935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.296981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.297025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:12.297096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:12.297176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:12.297236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:12.297286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:12.297338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:12.297385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:12.297439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:12.297491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:12.297543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:12.297587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:12.297643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:12.297692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:12.297748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:12.297794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:12.297849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:12.297903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:12.297957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:12.298018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:12.298073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:12.298125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:12.298179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:12.298227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.298282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.298329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.298383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.298428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.298483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.300279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:12.322931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:12.334167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:12.334222Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:12.334243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:12.334266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:12.334294Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 646 [2:7561401390800188359:6906]
2025-10-15T10:59:12.334353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:12.334422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:12.334439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:12.334453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:12.334465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:12.334518Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:12.334545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:12.334571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:12.356402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.357548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.357562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.357573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:12.357861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:12.359143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 646
2025-10-15T10:59:12.357877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.358032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.359249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 646
2025-10-15T10:59:12.358211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.359321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 646, pipe: [1:7561401388000495823:7236]
2025-10-15T10:59:12.358444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:12.358517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401390800188354:6906]
2025-10-15T10:59:12.358534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401390800188354:6906]
2025-10-15T10:59:12.358549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401390800188354:6906]
2025-10-15T10:59:12.358595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:12.358668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:12.358815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:12.358828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:12.358841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:12.358842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:12.358859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:12.358997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401388000495794:7661], now have 1 active actors on pipe
2025-10-15T10:59:12.359018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401390800188354:6906]
2025-10-15T10:59:12.359039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:12.359054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:12.359124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401388000495665:2467], now have 1 active actors on pipe
2025-10-15T10:59:12.359146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401388000495823:7236], now have 1 active actors on pipe
2025-10-15T10:59:12.366203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:12.366251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:12.366361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:12.366399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:12.366418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:12.366431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:12.366474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:12.366521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:12.366575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:12.367774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:12.367803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:12.367871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:12.368247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 647 partition: 0 MaxSeqNo: 46 sessionId: src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0
2025-10-15T10:59:12.369008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10e8b85e-95df0b1b-fd3bcb1b-635cf2bf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
E1015 10:59:12.388145870  821865 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:59:12.389614Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:59:12.394108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0] Write session: try to update token
2025-10-15T10:59:12.394158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:12.522453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId: src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:12.544331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:12.544362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:12.544373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:12.544424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:12.544437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:12.544450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:12.544460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:12.544491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401390800188354:6906]
2025-10-15T10:59:12.544515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401390800188354:6906]
2025-10-15T10:59:12.544536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401390800188354:6906]
2025-10-15T10:59:12.544651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:12.544686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:12.544709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:12.544727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:12.544727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:12.545698Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:12.575019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:12.711261Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:12.736312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:12.736355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:12.736414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:12.736426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:12.736462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401390800188354:6906]
2025-10-15T10:59:12.736662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:12.736998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:12.736999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:12.737153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401388000495823:7236]
2025-10-15T10:59:12.737220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:12.746646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 647 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0
2025-10-15T10:59:12.746936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 647 sessionId: src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0 is DEAD
2025-10-15T10:59:12.748266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:12.748310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0] Write session will restart in 0.007300s
2025-10-15T10:59:12.748425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0] Write session: Do CDS request
2025-10-15T10:59:12.748461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:12.772855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:12.779217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:12.779253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 648
2025-10-15T10:59:12.791505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:12.791711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:12.791746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:12.791761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:12.796772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 648 sessionId:  describe result for acl check
2025-10-15T10:59:12.796882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:12.796900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:12.796909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:12.796924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401388000495938:7672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:12.799833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401388000495938:7672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:12.817580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401388000495938:7672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:12.837463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401388000496055:7236]
2025-10-15T10:59:12.841522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401388000495938:7672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:12.841562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401388000495938:7672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:12.841579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401388000495938:7672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:12.841608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:12.868290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:12.874336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:12.874951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:12.874962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:12.874986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:12.875169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:12.875280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401390800188605:6914]
2025-10-15T10:59:12.876703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:12.877640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:12.877808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:12.878645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:12.878887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:12.878901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:12.878908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:12.878915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:12.878922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:12.878929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:12.878936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:12.878942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:12.878948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:12.878953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:12.878960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:12.878967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.878972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.878978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.879021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:12.879125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:12.879171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:12.879223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:12.879273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:12.879325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:12.879438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:12.879488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:12.879534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:12.879583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:12.879631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:12.879680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.879732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.879779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.879825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:12.879903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:12.879963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:12.880021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:12.880076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:12.880132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:12.880184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:12.880243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:12.880296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:12.880354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:12.880415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:12.880472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:12.880522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:12.880578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:12.880629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:12.880682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:12.880736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:12.880791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:12.880841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:12.880900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:12.880950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:12.881004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:12.881054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.881112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.881158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.881216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.881262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.881318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.881699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:12.908181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:12.925893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:12.925937Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:12.925956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:12.925974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:12.926010Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 647 [2:7561401390800188605:6914]
2025-10-15T10:59:12.926061Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:12.926118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:12.926132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:12.926145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:12.926156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:12.926200Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:12.926220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:12.926241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:12.927308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.927323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.927336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.935400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:12.936131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 647, pipe: [1:7561401388000496055:7236]
2025-10-15T10:59:12.936248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 647
2025-10-15T10:59:12.936323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 647
2025-10-15T10:59:12.935776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:12.935807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:12.935955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:12.936143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:12.936368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:12.936443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401388000496055:7236], now have 1 active actors on pipe
2025-10-15T10:59:12.936467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401388000496067:7672], now have 1 active actors on pipe
2025-10-15T10:59:12.936489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401388000495913:2467], now have 1 active actors on pipe
2025-10-15T10:59:12.936510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401390800188600:6914]
2025-10-15T10:59:12.936525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401390800188600:6914]
2025-10-15T10:59:12.936537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401390800188600:6914]
2025-10-15T10:59:12.936579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:12.936637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:12.936648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:12.936653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:12.936676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:12.936817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:12.936834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:12.936953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401390800188600:6914]
2025-10-15T10:59:12.936972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:12.937020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:12.937060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:12.937079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:12.937179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7175a324-949e6cd1-72df06c6-79569003_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:12.937207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:12.937224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:12.937234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:12.937267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:12.937303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:12.937396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:12.941275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0142a19-9f20587c-397772e2-bfa6bee8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7175a324-949e6cd1-72df06c6-79569003_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:12.939213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:12.939243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:12.939318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:12.940425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 648 partition: 0 MaxSeqNo: 46 sessionId: src_id|7175a324-949e6cd1-72df06c6-79569003_0
2025-10-15T10:59:12.982520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7175a324-949e6cd1-72df06c6-79569003_0] Write session: try to update token
2025-10-15T10:59:12.982572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7175a324-949e6cd1-72df06c6-79569003_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:13.121901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:13.121935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:13.121950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:13.121962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:13.122004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401390800188600:6914]
2025-10-15T10:59:13.122029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401390800188600:6914]
2025-10-15T10:59:13.122053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401390800188600:6914]
2025-10-15T10:59:13.122203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:13.122202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:13.122215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:13.122225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:13.122242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:13.122274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:13.122302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:13.122315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:13.123232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:13.133447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId: src_id|7175a324-949e6cd1-72df06c6-79569003_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:13.154680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:13.267175Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:13.290341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:13.290395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:13.290474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:13.290488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:13.290530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401390800188600:6914]
2025-10-15T10:59:13.291642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:13.291697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:13.293043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:13.293242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:13.295687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401388000496055:7236]
2025-10-15T10:59:13.328694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 648 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7175a324-949e6cd1-72df06c6-79569003_0
2025-10-15T10:59:13.329098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 648 sessionId: src_id|7175a324-949e6cd1-72df06c6-79569003_0 is DEAD
2025-10-15T10:59:13.333663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7175a324-949e6cd1-72df06c6-79569003_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:13.333709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7175a324-949e6cd1-72df06c6-79569003_0] Write session will restart in 0.009298s
2025-10-15T10:59:13.333819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7175a324-949e6cd1-72df06c6-79569003_0] Write session: Do CDS request
2025-10-15T10:59:13.333852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7175a324-949e6cd1-72df06c6-79569003_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:13.354676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7175a324-949e6cd1-72df06c6-79569003_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:13.351652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:13.351692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 649
2025-10-15T10:59:13.359536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:13.359725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:13.359743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:13.359755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:13.362221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 649 sessionId:  describe result for acl check
2025-10-15T10:59:13.362329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:13.362340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:13.362350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:13.362369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401392295463513:7680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:13.365011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401392295463513:7680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:13.394633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401392295463513:7680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:13.398995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401392295463623:7236]
2025-10-15T10:59:13.414054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401392295463513:7680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:13.414103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401392295463513:7680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:13.414120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401392295463513:7680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:13.414176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:13.429243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:13.438679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:13.439786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:13.439821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:13.439872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:13.440169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:13.440351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401395095156144:6925]
2025-10-15T10:59:13.442579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:13.445439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:13.445694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:13.446943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:13.447291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:13.447299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:13.447306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:13.447312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:13.447319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:13.447324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:13.447330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:13.447337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:13.447388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:13.447397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:13.447405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:13.447412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.447420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:13.447427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:13.447476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:13.447583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:13.447620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:13.447653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:13.447698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:13.447745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:13.447787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:13.447820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:13.447862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:13.447926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:13.447974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:13.448028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.448081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:13.448120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:13.448148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:13.448201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:13.448256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:13.448301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:13.448337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:13.448375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:13.448405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:13.448445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:13.448489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:13.448539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:13.448582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:13.448628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:13.448678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:13.448730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:13.448774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:13.448824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:13.448867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:13.448912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:13.448954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:13.449005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:13.449041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:13.449089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:13.449130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.449182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.449228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:13.449274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:13.449304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:13.449339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:13.449701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:13.484882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:13.498614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:13.498860Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:13.498887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:13.498906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:13.498928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 648 [2:7561401395095156144:6925]
2025-10-15T10:59:13.498980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:13.499037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:13.499051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:13.499061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:13.499074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:13.499119Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:13.499140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:13.499160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:13.501195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.501221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:13.501236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:13.501246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:13.501517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:13.501533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.501664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:13.501863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:13.502090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:13.502165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401392295463623:7236], now have 1 active actors on pipe
2025-10-15T10:59:13.502186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401392295463684:7680], now have 1 active actors on pipe
2025-10-15T10:59:13.502205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401392295463479:2467], now have 1 active actors on pipe
2025-10-15T10:59:13.502226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401395095156139:6925]
2025-10-15T10:59:13.502239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401395095156139:6925]
2025-10-15T10:59:13.502250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401395095156139:6925]
2025-10-15T10:59:13.502287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:13.502354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:13.502518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:13.502535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:13.502642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401395095156139:6925]
2025-10-15T10:59:13.502661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:13.502879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:13.502890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:13.502901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:13.502919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:13.502612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 648, pipe: [1:7561401392295463623:7236]
2025-10-15T10:59:13.502713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 648
2025-10-15T10:59:13.502782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 648
2025-10-15T10:59:13.503911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:13.503938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:13.504005Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d27caecb-b7901ce-38e75b2b-6535420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:13.504043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:13.504062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:13.504071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:13.504100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:13.504137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:13.504180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:13.506808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:13.506834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:13.506896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:13.507237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 649 partition: 0 MaxSeqNo: 46 sessionId: src_id|d27caecb-b7901ce-38e75b2b-6535420_0
2025-10-15T10:59:13.511628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7175a324-949e6cd1-72df06c6-79569003_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d27caecb-b7901ce-38e75b2b-6535420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:13.551673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d27caecb-b7901ce-38e75b2b-6535420_0] Write session: try to update token
2025-10-15T10:59:13.551748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d27caecb-b7901ce-38e75b2b-6535420_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:13.599902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:13.599927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:13.599957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401395095156139:6925]
2025-10-15T10:59:13.600060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:13.600070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:13.600079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:13.600131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:13.600411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:13.602662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:13.603912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:13.608331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:13.609632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:13.611639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:13.611999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:13.655690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:13.655723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:13.655734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:13.655746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:13.655781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401395095156139:6925]
2025-10-15T10:59:13.655803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401395095156139:6925]
2025-10-15T10:59:13.655824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401395095156139:6925]
2025-10-15T10:59:13.655953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:13.655971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:13.656185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:13.656211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:13.656234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:13.658386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:13.723748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId: src_id|d27caecb-b7901ce-38e75b2b-6535420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:13.761443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:13.814355Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:13.815985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:13.816021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:13.816743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:13.820763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401392295463623:7236]
2025-10-15T10:59:13.820910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:13.821119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:13.830477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27caecb-b7901ce-38e75b2b-6535420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:13.830510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27caecb-b7901ce-38e75b2b-6535420_0] Write session will restart in 0.008598s
2025-10-15T10:59:13.830590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27caecb-b7901ce-38e75b2b-6535420_0] Write session: Do CDS request
2025-10-15T10:59:13.830616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27caecb-b7901ce-38e75b2b-6535420_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:13.829104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 649 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d27caecb-b7901ce-38e75b2b-6535420_0
2025-10-15T10:59:13.834269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 649 sessionId: src_id|d27caecb-b7901ce-38e75b2b-6535420_0 is DEAD
2025-10-15T10:59:13.852935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d27caecb-b7901ce-38e75b2b-6535420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:13.866172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:13.866205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 650
2025-10-15T10:59:13.869629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:13.869768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:13.869785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:13.869797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:13.871069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 650 sessionId:  describe result for acl check
2025-10-15T10:59:13.871168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:13.871186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:13.871195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:13.871209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401392295463752:7687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:13.873677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401392295463752:7687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:13.881544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401392295463752:7687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:13.906048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401392295463752:7687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:13.906091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401392295463752:7687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:13.906107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401392295463752:7687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:13.906133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:13.920898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401392295463862:7236]
2025-10-15T10:59:13.988781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:13.990956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:13.991781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:13.991799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:13.991842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:13.992076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:13.992254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401395095156409:6933]
2025-10-15T10:59:13.994414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:13.995480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:13.995709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:13.996966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:13.997271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:13.997279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:13.997286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:13.997293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:13.997299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:13.997306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:13.997313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:13.997320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:13.997326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:13.997332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:13.997339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:13.997345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.997352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:13.997358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:13.997400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:13.997499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:13.997546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:13.997589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:13.997633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:13.997678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:13.997722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:13.997782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:13.997828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:13.997872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:13.997917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:13.997960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.998004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:13.998063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:13.998105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:13.998163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:13.998217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:13.998266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:13.998312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:13.998367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:13.998411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:13.998458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:13.998503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:13.998554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:13.998598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:13.998649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:13.998692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:13.998744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:13.998787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:13.998838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:13.998888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:13.998936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:13.998976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:13.999027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:13.999072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:13.999124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:13.999166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.999217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:13.999261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:13.999313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:14.000069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.000135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.000640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:14.021360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:14.032307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:14.032349Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:14.032363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:14.032379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:14.032400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 649 [2:7561401395095156409:6933]
2025-10-15T10:59:14.032444Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:14.032495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:14.032508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:14.032519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:14.032529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:14.032572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:14.032593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:14.032612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:14.034279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:14.034295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:14.034308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.034317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:14.034570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:14.034584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:14.034711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:14.034885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.035612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:14.035686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401395095156404:6933]
2025-10-15T10:59:14.035701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401395095156404:6933]
2025-10-15T10:59:14.035711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401395095156404:6933]
2025-10-15T10:59:14.035751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:14.035826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:14.035992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:14.036014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:14.036119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401395095156404:6933]
2025-10-15T10:59:14.036138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:14.036466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:14.036492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:14.036504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:14.036530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:14.037387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401392295463829:7687], now have 1 active actors on pipe
2025-10-15T10:59:14.037422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401392295463723:2467], now have 1 active actors on pipe
2025-10-15T10:59:14.037444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401392295463862:7236], now have 1 active actors on pipe
2025-10-15T10:59:14.039524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 649
2025-10-15T10:59:14.039625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 649
2025-10-15T10:59:14.039689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 649, pipe: [1:7561401392295463862:7236]
2025-10-15T10:59:14.040387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:14.040432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:14.040537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|234c0d7b-20ca596d-f3800511-147c9f41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:14.040574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:14.040595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:14.040607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:14.040648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:14.040699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:14.040752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:14.041298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:14.041330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:14.041395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:14.041684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 650 partition: 0 MaxSeqNo: 46 sessionId: src_id|234c0d7b-20ca596d-f3800511-147c9f41_0
2025-10-15T10:59:14.042582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d27caecb-b7901ce-38e75b2b-6535420_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|234c0d7b-20ca596d-f3800511-147c9f41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:14.086307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|234c0d7b-20ca596d-f3800511-147c9f41_0] Write session: try to update token
2025-10-15T10:59:14.086348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|234c0d7b-20ca596d-f3800511-147c9f41_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:14.191033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:14.191058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:14.191069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:14.191075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:14.191097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401395095156404:6933]
2025-10-15T10:59:14.191115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401395095156404:6933]
2025-10-15T10:59:14.191131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401395095156404:6933]
2025-10-15T10:59:14.191235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:14.191243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:14.191250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:14.191319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:14.191328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:14.191333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:14.191373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:14.191400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:14.192351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:14.234731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId: src_id|234c0d7b-20ca596d-f3800511-147c9f41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:14.256636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:14.346699Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:14.363585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:14.363633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:14.363704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:14.363718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:14.363757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401395095156404:6933]
2025-10-15T10:59:14.364799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:14.365494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:14.365690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401392295463862:7236]
2025-10-15T10:59:14.364273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:14.364349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:14.371660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 650 reason: status is not ok: tablet will be restarted right now sessionId: src_id|234c0d7b-20ca596d-f3800511-147c9f41_0
2025-10-15T10:59:14.371953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 650 sessionId: src_id|234c0d7b-20ca596d-f3800511-147c9f41_0 is DEAD
2025-10-15T10:59:14.374607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234c0d7b-20ca596d-f3800511-147c9f41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:14.374681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234c0d7b-20ca596d-f3800511-147c9f41_0] Write session will restart in 0.009119s
2025-10-15T10:59:14.374845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234c0d7b-20ca596d-f3800511-147c9f41_0] Write session: Do CDS request
2025-10-15T10:59:14.374896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234c0d7b-20ca596d-f3800511-147c9f41_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:14.390918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:14.390946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 651
2025-10-15T10:59:14.391334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|234c0d7b-20ca596d-f3800511-147c9f41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:14.391859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:14.391996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:14.392012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:14.392024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:14.393300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 651 sessionId:  describe result for acl check
2025-10-15T10:59:14.393404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:14.393419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:14.393428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:14.393443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401396590431323:7704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:14.395920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401396590431323:7704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:14.407219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401396590431323:7704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:14.414953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401396590431323:7704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:14.414996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401396590431323:7704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:14.415015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401396590431323:7704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:14.415042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:14.467460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401396590431482:7236]
2025-10-15T10:59:14.506647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:14.511168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:14.512100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:14.512119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:14.512165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:14.512423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:14.512593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401399390123945:6938]
2025-10-15T10:59:14.514722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:14.515660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:14.515850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:14.517006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:14.517305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:14.517314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:14.517321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:14.517328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:14.517334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:14.517341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:14.517347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:14.517354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:14.517360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:14.517366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:14.517373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:14.517379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:14.517385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:14.517392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.517436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:14.517536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:14.517580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:14.517624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:14.517668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:14.517712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:14.517754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:14.517794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:14.517837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:14.517879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:14.517922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:14.517968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:14.518007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:14.518064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.518103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:14.518164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:14.518216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:14.518264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:14.518309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:14.518359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:14.518402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:14.518451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:14.518493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:14.518546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:14.518589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:14.518640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:14.518684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:14.518735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:14.518777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:14.518826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:14.518874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:14.518923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:14.518966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:14.519018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:14.519062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:14.519114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:14.519156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:14.519203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:14.519247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:14.519296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:14.519336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.520441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.520926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:14.548112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:14.559733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:14.559776Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:14.559793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:14.559812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:14.559838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 650 [2:7561401399390123945:6938]
2025-10-15T10:59:14.559885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:14.559938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:14.559951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:14.559962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:14.559972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:14.560017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:14.560036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:14.560056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:14.561706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:14.561722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:14.561734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.561745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:14.561999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:14.562025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:14.562158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:14.562335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:14.562556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:14.562614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401399390123940:6938]
2025-10-15T10:59:14.562627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401399390123940:6938]
2025-10-15T10:59:14.562639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401399390123940:6938]
2025-10-15T10:59:14.562948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:14.562960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:14.562970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:14.564525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:14.564615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:14.563916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 650
2025-10-15T10:59:14.564796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:14.564004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 650, pipe: [1:7561401396590431482:7236]
2025-10-15T10:59:14.564814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:14.564064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 650
2025-10-15T10:59:14.564860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401396590431357:7704], now have 1 active actors on pipe
2025-10-15T10:59:14.564882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401396590431482:7236], now have 1 active actors on pipe
2025-10-15T10:59:14.564903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401396590431310:2467], now have 1 active actors on pipe
2025-10-15T10:59:14.564946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:14.564967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:14.565092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401399390123940:6938]
2025-10-15T10:59:14.565121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:14.565188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25475f1-ad827353-d984081e-de59e420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:14.565215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:14.565232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:14.565241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:14.565273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:14.565309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:14.565428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:14.566167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:14.571107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:14.571137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:14.571191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:14.572269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234c0d7b-20ca596d-f3800511-147c9f41_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|25475f1-ad827353-d984081e-de59e420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:14.571552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 651 partition: 0 MaxSeqNo: 46 sessionId: src_id|25475f1-ad827353-d984081e-de59e420_0
2025-10-15T10:59:14.628418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25475f1-ad827353-d984081e-de59e420_0] Write session: try to update token
2025-10-15T10:59:14.628494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25475f1-ad827353-d984081e-de59e420_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:14.708642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:14.708671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:14.708682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:14.708734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:14.708748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:14.708759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:14.708770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:14.708802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401399390123940:6938]
2025-10-15T10:59:14.708826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401399390123940:6938]
2025-10-15T10:59:14.708848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401399390123940:6938]
2025-10-15T10:59:14.709022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:14.709053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:14.710370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:14.710413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:14.710441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:14.711988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:14.781891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId: src_id|25475f1-ad827353-d984081e-de59e420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:14.818917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:14.863766Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:14.893436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:14.893481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:14.893538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:14.893550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:14.893583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401399390123940:6938]
2025-10-15T10:59:14.893897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:14.894327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:14.894496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:14.894521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:14.895712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401396590431482:7236]
2025-10-15T10:59:14.895823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:14.903851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 651 reason: error at write: Disconnected sessionId: src_id|25475f1-ad827353-d984081e-de59e420_0
2025-10-15T10:59:14.904167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 651 sessionId: src_id|25475f1-ad827353-d984081e-de59e420_0 is DEAD
2025-10-15T10:59:14.904529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25475f1-ad827353-d984081e-de59e420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:14.904568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25475f1-ad827353-d984081e-de59e420_0] Write session will restart in 0.008130s
2025-10-15T10:59:14.904688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25475f1-ad827353-d984081e-de59e420_0] Write session: Do CDS request
2025-10-15T10:59:14.904750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25475f1-ad827353-d984081e-de59e420_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:14.926340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:14.926369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 652
2025-10-15T10:59:14.926694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25475f1-ad827353-d984081e-de59e420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:14.927224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:14.927373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:14.927397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:14.927410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:14.928629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 652 sessionId:  describe result for acl check
2025-10-15T10:59:14.928743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:14.928761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:14.928770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:14.928786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401396590431568:7709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:14.931307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401396590431568:7709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:14.943048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401396590431568:7709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:14.960887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401396590431568:7709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:14.960929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401396590431568:7709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:14.960945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401396590431568:7709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:14.960973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:14.996027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401396590431702:7236]
2025-10-15T10:59:15.024628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:15.027553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:15.028356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:15.028372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:15.028410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:15.028637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:15.028810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401403685091499:6948]
2025-10-15T10:59:15.030445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:15.031836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:15.032050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:15.033276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:15.033587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.033604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.033828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.033848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.033854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.033860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.033867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.033873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.033881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.033888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.033895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.033902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.033908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.033916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.033959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.034071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.034118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.034170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.034219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.034267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.034312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.034369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.034416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.034458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.034505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.034549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.034598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.034647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.034696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.034765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.034832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.034889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.034934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.034992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.035042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.035096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.035147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.035206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.035253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.035307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.035370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.035424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.035474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.035530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.035581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.035636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.035682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.035736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.035784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.035836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.035884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.035943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.035993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.036048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.036094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.036148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.036630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:15.082443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:15.092766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:15.092809Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:15.092823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:15.092840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:15.092861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 651 [2:7561401403685091499:6948]
2025-10-15T10:59:15.092907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:15.092954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:15.092967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:15.092978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:15.092989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:15.093029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:15.093048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:15.093066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:15.094810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.094838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.094851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.094862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:15.095109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:15.095131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.095250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.095488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 651, pipe: [1:7561401396590431702:7236]
2025-10-15T10:59:15.095488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 651
2025-10-15T10:59:15.095573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 651
2025-10-15T10:59:15.095438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.095657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:15.095730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401396590431599:7709], now have 1 active actors on pipe
2025-10-15T10:59:15.095752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401396590431702:7236], now have 1 active actors on pipe
2025-10-15T10:59:15.095773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401396590431555:2467], now have 1 active actors on pipe
2025-10-15T10:59:15.095793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401403685091494:6948]
2025-10-15T10:59:15.095806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401403685091494:6948]
2025-10-15T10:59:15.095817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401403685091494:6948]
2025-10-15T10:59:15.095852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:15.095937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:15.095947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:15.095956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:15.095966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:15.095980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:15.096013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:15.096178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:15.096194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:15.096320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:15.096345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:15.096361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:15.096370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:15.096399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:15.096430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:15.096465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401403685091494:6948]
2025-10-15T10:59:15.096493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:15.096528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:15.096561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:15.097295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:15.097322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:15.097376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:15.097699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 652 partition: 0 MaxSeqNo: 46 sessionId: src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0
2025-10-15T10:59:15.098533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25475f1-ad827353-d984081e-de59e420_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:15.140403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0] Write session: try to update token
2025-10-15T10:59:15.140463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:15.274073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:15.274127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:15.274154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:15.274174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:15.274227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401403685091494:6948]
2025-10-15T10:59:15.274272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401403685091494:6948]
2025-10-15T10:59:15.274319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401403685091494:6948]
2025-10-15T10:59:15.274640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:15.274675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:15.274694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:15.274757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:15.274790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:15.274973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:15.275006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:15.275049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:15.280205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:15.284233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId: src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:15.309814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:15.422461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:15.433303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:15.433346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:15.433413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:15.433427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:15.433461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401403685091494:6948]
2025-10-15T10:59:15.433624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:15.434116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:15.434081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401396590431702:7236]
2025-10-15T10:59:15.434204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:15.434216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:15.469849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 652 reason: error at write: Disconnected sessionId: src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0
2025-10-15T10:59:15.470142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 652 sessionId: src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0 is DEAD
2025-10-15T10:59:15.475606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:15.475644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0] Write session will restart in 0.009875s
2025-10-15T10:59:15.475805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0] Write session: Do CDS request
2025-10-15T10:59:15.475850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:15.480017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:15.490066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:15.495649Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:15.495675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 653
2025-10-15T10:59:15.495996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:15.496092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:15.496101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:15.496107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:15.497725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 653 sessionId:  describe result for acl check
2025-10-15T10:59:15.497827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:15.497838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:15.497847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:15.497862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401400885399229:7720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:15.500217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401400885399229:7720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:15.511680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401400885399229:7720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:15.524498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401400885399229:7720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:15.524530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401400885399229:7720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:15.524540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401400885399229:7720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:15.524559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:15.537927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:15.535576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401400885399356:7236]
2025-10-15T10:59:15.539250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:15.540011Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:15.540027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:15.540064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:15.540279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:15.540445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401403685091749:6955]
2025-10-15T10:59:15.542530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:15.543854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:15.544046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:15.545239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:15.545530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.545537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.545544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.545550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.545556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.545563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.545569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.545575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.545581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.545586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.545595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.545600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.545606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.545613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.545656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.545748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.545795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.545837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.545894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.545937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.545980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.546019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.546076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.546126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.546168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.546209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.546250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.546288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.546327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.546386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.546468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.546523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.546568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.546617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.546659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.546706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.546753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.546802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.546844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.546892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.546936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.546984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.547026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.547077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.547121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.547166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.547206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.547255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.547298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.547411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.547457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.547505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.547548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.547595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.547634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.547683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.548138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:15.565654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:15.575411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:15.575447Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:15.575462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:15.575479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:15.575500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 652 [2:7561401403685091749:6955]
2025-10-15T10:59:15.575545Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:15.575595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:15.575611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:15.575622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:15.575632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:15.575673Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:15.575695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:15.575713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:15.577361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.577384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.577396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.577407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:15.577638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:15.577654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.577775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.577930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.578157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:15.578226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401400885399351:7720], now have 1 active actors on pipe
2025-10-15T10:59:15.578247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401400885399356:7236], now have 1 active actors on pipe
2025-10-15T10:59:15.578266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401400885399163:2467], now have 1 active actors on pipe
2025-10-15T10:59:15.578307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:15.578323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:15.578352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401403685091744:6955]
2025-10-15T10:59:15.578364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401403685091744:6955]
2025-10-15T10:59:15.578377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401403685091744:6955]
2025-10-15T10:59:15.578409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:15.578429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:15.578457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:15.578467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:15.578483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:15.578634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:15.578648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:15.578701Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:15.578725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:15.578740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:15.578749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:15.578779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:15.578810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:15.578935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401403685091744:6955]
2025-10-15T10:59:15.577933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 652
2025-10-15T10:59:15.578011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 652, pipe: [1:7561401400885399356:7236]
2025-10-15T10:59:15.578090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 652
2025-10-15T10:59:15.578960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:15.578979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:15.579000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:15.579692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:15.579721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:15.579778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:15.580021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 653 partition: 0 MaxSeqNo: 46 sessionId: src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0
2025-10-15T10:59:15.581060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3381d91b-3443ba2c-5ed93e74-e557026d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:15.614663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0] Write session: try to update token
2025-10-15T10:59:15.614714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:15.671210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:15.671264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:15.671290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:15.671304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:15.671369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401403685091744:6955]
2025-10-15T10:59:15.671412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401403685091744:6955]
2025-10-15T10:59:15.671452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401403685091744:6955]
2025-10-15T10:59:15.671672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:15.671721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:15.672223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:15.672265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:15.672288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:15.673628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:15.747145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId: src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:15.771000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:15.816905Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:15.819124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:15.819160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:15.820170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:15.820212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:15.822000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401400885399356:7236]
2025-10-15T10:59:15.822250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:15.822729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:15.855595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 653 reason: error at write: Disconnected sessionId: src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0
2025-10-15T10:59:15.855882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 653 sessionId: src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0 is DEAD
2025-10-15T10:59:15.856419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:15.856531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0] Write session will restart in 0.006801s
2025-10-15T10:59:15.856728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0] Write session: Do CDS request
2025-10-15T10:59:15.856791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:15.870197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:15.869922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:15.869956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 654
2025-10-15T10:59:15.870773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:15.870883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:15.870897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:15.870904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:15.872524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 654 sessionId:  describe result for acl check
2025-10-15T10:59:15.872764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:15.872794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:15.872815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:15.872844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401400885399428:7728] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:15.876172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401400885399428:7728] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:15.889363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401400885399428:7728] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:15.903015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401400885399428:7728] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:15.903057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401400885399428:7728] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:15.903073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401400885399428:7728] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:15.903101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:15.921749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401400885399607:7236]
2025-10-15T10:59:15.930540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:15.932192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:15.932891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:15.932921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:15.932955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:15.933169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:15.933350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401403685092002:6960]
2025-10-15T10:59:15.935391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:15.936254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:15.936451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:15.937566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:15.937872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.937891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.937898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.937905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.937912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.937919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.937927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.937933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.937939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.937946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.937952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.937958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.937964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.937971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.938017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.938134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.938180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.938226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.938282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.938323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.938374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.938418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.938465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.938576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.938630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.938671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.938716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.938763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.938808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.938870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:15.938938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.938995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:15.939043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.939097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:15.939148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.939199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:15.939245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.939297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:15.939338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.939409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:15.939453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.939501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:15.939545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.939595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:15.939923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.939989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:15.940034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.940093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:15.940137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.940192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:15.940240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.940292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.940341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.940391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.940442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.940497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.941028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:15.963552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:15.972459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:15.972507Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:15.972522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:15.972540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:15.972563Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 653 [2:7561401403685092002:6960]
2025-10-15T10:59:15.972609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:15.972658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:15.972673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:15.972684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:15.972693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:15.972735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:15.972754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:15.972772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:15.974725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 653
2025-10-15T10:59:15.974751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 653
2025-10-15T10:59:15.974805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 653, pipe: [1:7561401400885399607:7236]
2025-10-15T10:59:15.974185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.974208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.974222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.974232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:15.974480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:15.974495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:15.974624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:15.974801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:15.975021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:15.975090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401400885399542:7728], now have 1 active actors on pipe
2025-10-15T10:59:15.975112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401400885399384:2467], now have 1 active actors on pipe
2025-10-15T10:59:15.975135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401400885399607:7236], now have 1 active actors on pipe
2025-10-15T10:59:15.975191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:15.975208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:15.975241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401403685091997:6960]
2025-10-15T10:59:15.975254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401403685091997:6960]
2025-10-15T10:59:15.975266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401403685091997:6960]
2025-10-15T10:59:15.975304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:15.975341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:15.975378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:15.975389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:15.975826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:15.976002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:15.976026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:15.976088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92af882b-426c154a-cdd76293-93868b04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:15.976114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:15.976132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:15.976152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:15.976186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:15.976223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:15.976353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401403685091997:6960]
2025-10-15T10:59:15.976381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:15.976413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:15.976422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:15.977138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:15.977166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:15.977223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:15.977516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 654 partition: 0 MaxSeqNo: 46 sessionId: src_id|92af882b-426c154a-cdd76293-93868b04_0
2025-10-15T10:59:15.978195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1756c11b-638c98ac-b61af3cb-1f3d1c1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|92af882b-426c154a-cdd76293-93868b04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:16.000217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92af882b-426c154a-cdd76293-93868b04_0] Write session: try to update token
2025-10-15T10:59:16.000271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92af882b-426c154a-cdd76293-93868b04_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:16.008696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:16.008736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:16.008778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401403685091997:6960]
2025-10-15T10:59:16.008912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:16.008925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:16.010903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:16.012278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:16.013630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:16.014990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:16.020046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:16.020477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:16.082706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:16.082742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:16.082753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:16.082816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:16.082831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:16.082843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:16.082853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:16.082892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401403685091997:6960]
2025-10-15T10:59:16.082918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401403685091997:6960]
2025-10-15T10:59:16.082942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401403685091997:6960]
2025-10-15T10:59:16.083079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:16.083103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:16.083110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:16.083125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:16.083128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:16.084179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:16.110090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId: src_id|92af882b-426c154a-cdd76293-93868b04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:16.135972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:16.235982Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:16.247648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:16.247693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:16.248467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:16.249490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:16.249740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:16.250014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401400885399607:7236]
2025-10-15T10:59:16.283305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 654 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92af882b-426c154a-cdd76293-93868b04_0
2025-10-15T10:59:16.283720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 654 sessionId: src_id|92af882b-426c154a-cdd76293-93868b04_0 is DEAD
2025-10-15T10:59:16.285387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92af882b-426c154a-cdd76293-93868b04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:16.285447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92af882b-426c154a-cdd76293-93868b04_0] Write session will restart in 0.008280s
2025-10-15T10:59:16.285603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92af882b-426c154a-cdd76293-93868b04_0] Write session: Do CDS request
2025-10-15T10:59:16.285648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92af882b-426c154a-cdd76293-93868b04_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:16.300181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:16.300234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 655
2025-10-15T10:59:16.300750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92af882b-426c154a-cdd76293-93868b04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:16.301862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:16.302079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:16.302115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:16.302131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:16.306233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 655 sessionId:  describe result for acl check
2025-10-15T10:59:16.306377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:16.306399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:16.306411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:16.306432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401405180366979:7733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:16.312015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401405180366979:7733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:16.323145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401405180366979:7733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:16.336562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401405180366979:7733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:16.336613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401405180366979:7733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:16.336628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401405180366979:7733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:16.336655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:16.349785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:16.350320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401405180367166:7236]
2025-10-15T10:59:16.351842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:16.352727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:16.352747Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:16.352795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:16.353067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:16.353264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401407980059547:6963]
2025-10-15T10:59:16.355888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:16.356953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:16.357202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:16.358584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:16.358945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:16.358965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:16.358973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:16.358980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:16.358987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:16.358995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:16.359002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:16.359009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:16.359017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:16.359025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:16.359032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:16.359040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.359048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.359055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.359106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:16.359222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:16.359272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:16.359323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:16.359395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:16.359446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:16.359495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:16.359547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:16.359595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:16.359646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:16.359693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:16.359739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.359785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.359833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.359880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:16.359955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:16.360017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:16.360074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:16.360125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:16.360181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:16.360227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:16.360283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:16.360333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:16.360388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:16.360434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:16.360492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:16.360545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:16.360598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:16.360648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:16.360703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:16.360756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:16.360814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:16.360861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:16.360916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:16.360964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:16.361019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:16.361064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.362207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.362274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.362337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.362387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.362444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.362994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:16.410362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:16.419410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:16.419465Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:16.419482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:16.419503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:16.419529Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 654 [2:7561401407980059547:6963]
2025-10-15T10:59:16.419583Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:16.419644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:16.419659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:16.419673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:16.419685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:16.419740Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:16.419763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:16.419785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:16.421326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.421355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.421369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.421382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:16.421656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:16.421683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.421806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.422008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.422266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:16.422345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401407980059538:6963]
2025-10-15T10:59:16.422365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401407980059538:6963]
2025-10-15T10:59:16.422377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401407980059538:6963]
2025-10-15T10:59:16.422421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:16.422496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:16.422676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:16.422698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:16.422815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401407980059538:6963]
2025-10-15T10:59:16.422838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:16.423078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:16.423098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:16.423108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:16.423130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:16.423966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 654, pipe: [1:7561401405180367166:7236]
2025-10-15T10:59:16.424083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 654
2025-10-15T10:59:16.424163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 654
2025-10-15T10:59:16.424629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401405180367166:7236], now have 1 active actors on pipe
2025-10-15T10:59:16.424673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401405180367163:7733], now have 1 active actors on pipe
2025-10-15T10:59:16.424695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401405180366926:2467], now have 1 active actors on pipe
2025-10-15T10:59:16.424758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:16.424788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:16.424871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|830433d7-30bf7e55-95e806a-58f870d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:16.424908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:16.424925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:16.424934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:16.424971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:16.425013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:16.425069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:16.425585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:16.425617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:16.425691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:16.426018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 655 partition: 0 MaxSeqNo: 46 sessionId: src_id|830433d7-30bf7e55-95e806a-58f870d_0
2025-10-15T10:59:16.426820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92af882b-426c154a-cdd76293-93868b04_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|830433d7-30bf7e55-95e806a-58f870d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:16.465532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:16.465565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:16.465599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401407980059538:6963]
2025-10-15T10:59:16.465714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:16.468462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:16.469623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:16.470816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:16.471961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:16.473128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:16.483549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:16.483938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:16.487282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830433d7-30bf7e55-95e806a-58f870d_0] Write session: try to update token
2025-10-15T10:59:16.487331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830433d7-30bf7e55-95e806a-58f870d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:16.541133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:16.541156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:16.541163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:16.541199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:16.541208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:16.541216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:16.541223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:16.541247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401407980059538:6963]
2025-10-15T10:59:16.541262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401407980059538:6963]
2025-10-15T10:59:16.541276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401407980059538:6963]
2025-10-15T10:59:16.541361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:16.541374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:16.542385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:16.543003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:16.543043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:16.543079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:16.603559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId: src_id|830433d7-30bf7e55-95e806a-58f870d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:16.624265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:16.679435Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:16.686266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:16.686313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:16.687407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401405180367166:7236]
2025-10-15T10:59:16.687516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:16.687825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:16.686988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:16.703895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 655 reason: status is not ok: tablet will be restarted right now sessionId: src_id|830433d7-30bf7e55-95e806a-58f870d_0
2025-10-15T10:59:16.704265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 655 sessionId: src_id|830433d7-30bf7e55-95e806a-58f870d_0 is DEAD
2025-10-15T10:59:16.704636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830433d7-30bf7e55-95e806a-58f870d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:16.704685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830433d7-30bf7e55-95e806a-58f870d_0] Write session will restart in 0.007224s
2025-10-15T10:59:16.704838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830433d7-30bf7e55-95e806a-58f870d_0] Write session: Do CDS request
2025-10-15T10:59:16.704888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830433d7-30bf7e55-95e806a-58f870d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:16.718509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:16.718548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 656
2025-10-15T10:59:16.718643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830433d7-30bf7e55-95e806a-58f870d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:16.719289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:16.719488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:16.719529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:16.719547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:16.721311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 656 sessionId:  describe result for acl check
2025-10-15T10:59:16.721448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:16.721476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:16.721486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:16.721518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401405180367195:7738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:16.724560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401405180367195:7738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:16.733038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401405180367195:7738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:16.748047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401405180367195:7738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:16.748100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401405180367195:7738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:16.748119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401405180367195:7738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:16.748151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:16.787134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401405180367283:7236]
2025-10-15T10:59:16.855638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:16.872527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:16.873428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:16.873465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:16.873513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:16.873802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:16.874007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401407980059812:6971]
2025-10-15T10:59:16.876209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:16.883966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:16.884161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:16.885066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:16.885381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:16.885390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:16.885398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:16.885405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:16.885412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:16.885421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:16.885428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:16.885436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:16.885443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:16.885450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:16.885458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:16.885465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.885472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.885479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.885529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:16.885631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:16.885668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:16.885701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:16.885734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:16.885768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:16.885819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:16.885864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:16.885899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:16.885932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:16.885965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:16.885999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.886033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.886079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.886110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:16.886160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:16.886202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:16.886242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:16.886276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:16.886315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:16.886351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:16.886397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:16.886440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:16.886478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:16.886516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:16.886555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:16.886590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:16.886630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:16.886661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:16.886699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:16.886732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:16.886771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:16.886803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:16.886841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:16.886885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:16.886926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:16.886958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.886996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.887029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.887066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.887096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.887135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.887523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:16.948123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:16.959081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:16.959115Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:16.959126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:16.959142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:16.959163Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 655 [2:7561401407980059812:6971]
2025-10-15T10:59:16.959200Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:16.959245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:16.959257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:16.959269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:16.959276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:16.959316Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:16.959335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:16.959482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:16.961118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.961129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.961137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.961145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:16.961334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:16.961345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:16.961449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:16.961568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:16.961710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:16.961757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401407980059807:6971]
2025-10-15T10:59:16.961773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401407980059807:6971]
2025-10-15T10:59:16.961787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401407980059807:6971]
2025-10-15T10:59:16.961821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:16.961871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:16.962005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:16.962018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:16.962120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401407980059807:6971]
2025-10-15T10:59:16.962132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:16.962380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:16.962389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:16.962396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:16.962411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:16.967561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 655
2025-10-15T10:59:16.969441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401405180367224:7738], now have 1 active actors on pipe
2025-10-15T10:59:16.967655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 655, pipe: [1:7561401405180367283:7236]
2025-10-15T10:59:16.969499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401405180367283:7236], now have 1 active actors on pipe
2025-10-15T10:59:16.967734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 655
2025-10-15T10:59:16.969524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401405180367182:2467], now have 1 active actors on pipe
2025-10-15T10:59:16.969580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:16.969603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:16.969698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:16.969733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:16.969752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:16.969763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:16.969805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:16.969855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:16.969906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:16.971286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:16.971308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:16.971399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:16.972507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830433d7-30bf7e55-95e806a-58f870d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:16.971720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 656 partition: 0 MaxSeqNo: 46 sessionId: src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0
2025-10-15T10:59:16.996602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0] Write session: try to update token
2025-10-15T10:59:16.996661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:17.052799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:17.052832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:17.052868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401407980059807:6971]
2025-10-15T10:59:17.052996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:17.054646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:17.059974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:17.061260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:17.062407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:17.063327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:17.065235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:17.065767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:17.065782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:17.065796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:17.065935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:17.094426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:17.094455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:17.094466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:17.094475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:17.094507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401407980059807:6971]
2025-10-15T10:59:17.094524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401407980059807:6971]
2025-10-15T10:59:17.094539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401407980059807:6971]
2025-10-15T10:59:17.094647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:17.094665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:17.095590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:17.095648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:17.095695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:17.096234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:17.138652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId: src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:17.159834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:17.244608Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:17.246663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:17.246712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:17.250438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:17.250429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:17.250464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:17.257770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401405180367283:7236]
2025-10-15T10:59:17.257859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:17.291474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:17.291538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0] Write session will restart in 0.009080s
2025-10-15T10:59:17.291695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0] Write session: Do CDS request
2025-10-15T10:59:17.290694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 656 reason: error at write: Disconnected sessionId: src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0
2025-10-15T10:59:17.291731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:17.290990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 656 sessionId: src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0 is DEAD
2025-10-15T10:59:17.310406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:17.315438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:17.315471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 657
2025-10-15T10:59:17.316664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:17.316822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:17.316848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:17.316858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:17.319195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 657 sessionId:  describe result for acl check
2025-10-15T10:59:17.319326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:17.319511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:17.319529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:17.319547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401409475334836:7752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:17.322191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401409475334836:7752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:17.332430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401409475334836:7752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:17.342999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401409475334836:7752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:17.343047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401409475334836:7752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:17.343064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401409475334836:7752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:17.343096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:17.356371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:17.357906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401409475334993:7236]
2025-10-15T10:59:17.364218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:17.365229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:17.365263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:17.365310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:17.365585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:17.365779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401412275027354:6980]
2025-10-15T10:59:17.368336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:17.369754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:17.369985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:17.371396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:17.371748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:17.371757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:17.371765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:17.371773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:17.371780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:17.371787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:17.371795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:17.371804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:17.371812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:17.371819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:17.371828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:17.371836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.371843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.371851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.371904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:17.372026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:17.372080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:17.372130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:17.372181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:17.372233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:17.372284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:17.372344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:17.372398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:17.372454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:17.372500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:17.372549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.372601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.373372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.373450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:17.373531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:17.373604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:17.373676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:17.373736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:17.373796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:17.373851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:17.373910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:17.373971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:17.374038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:17.374103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:17.374169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:17.374230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:17.374286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:17.374344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:17.374405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:17.374463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:17.374526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:17.374582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:17.374648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:17.374704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:17.374767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:17.374818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.374881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.374940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.375001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.375055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.375118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.375689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:17.399084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:17.409445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:17.409495Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:17.409513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:17.409534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:17.409560Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 656 [2:7561401412275027354:6980]
2025-10-15T10:59:17.409615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:17.409676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:17.409699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:17.409713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:17.409726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:17.409775Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:17.409800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:17.409823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:17.410822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.410847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.410861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.410873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:17.411148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:17.411174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.411332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.411559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.411812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:17.411907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401409475334993:7236], now have 1 active actors on pipe
2025-10-15T10:59:17.411940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401409475334989:7752], now have 1 active actors on pipe
2025-10-15T10:59:17.411963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401409475334744:2467], now have 1 active actors on pipe
2025-10-15T10:59:17.411994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401412275027348:6980]
2025-10-15T10:59:17.412014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401412275027348:6980]
2025-10-15T10:59:17.412027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401412275027348:6980]
2025-10-15T10:59:17.412060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:17.412137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:17.411989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 656, pipe: [1:7561401409475334993:7236]
2025-10-15T10:59:17.412012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 656
2025-10-15T10:59:17.412100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 656
2025-10-15T10:59:17.412332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:17.412355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:17.412395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:17.412410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:17.412424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:17.412474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401412275027348:6980]
2025-10-15T10:59:17.412506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:17.412509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:17.412613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:17.412642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:17.412755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:17.412795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:17.412819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:17.412844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:17.412881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:17.412925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:17.412995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:17.413817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:17.413847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:17.413930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:17.414234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 657 partition: 0 MaxSeqNo: 46 sessionId: src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0
2025-10-15T10:59:17.414972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc2f2a12-a39efc74-f305149a-318cb49d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:17.434054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0] Write session: try to update token
2025-10-15T10:59:17.434131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:17.552663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:17.552707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:17.552723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:17.552733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:17.552774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401412275027348:6980]
2025-10-15T10:59:17.552802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401412275027348:6980]
2025-10-15T10:59:17.552829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401412275027348:6980]
2025-10-15T10:59:17.553061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:17.553081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:17.553095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:17.553149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:17.553190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:17.553220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:17.553243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:17.553267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:17.554641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:17.560007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId: src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:17.589228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:17.698623Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:17.713086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:17.713140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:17.713212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:17.713228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:17.713274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401412275027348:6980]
2025-10-15T10:59:17.714102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:17.714844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:17.714462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:17.714632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401409475334993:7236]
2025-10-15T10:59:17.714710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:17.714724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:17.755195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 657 reason: error at write: Disconnected sessionId: src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0
2025-10-15T10:59:17.755700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 657 sessionId: src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0 is DEAD
2025-10-15T10:59:17.757370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:17.757443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0] Write session will restart in 0.006753s
2025-10-15T10:59:17.757604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0] Write session: Do CDS request
2025-10-15T10:59:17.757651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:17.770539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:17.770603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 658
2025-10-15T10:59:17.771943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:17.772538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:17.772749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:17.772765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:17.772776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:17.774300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 658 sessionId:  describe result for acl check
2025-10-15T10:59:17.774416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:17.774427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:17.774435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:17.774451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401409475335024:7757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:17.777065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401409475335024:7757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:17.785375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401409475335024:7757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:17.800930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401409475335024:7757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:17.800974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401409475335024:7757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:17.800990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401409475335024:7757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:17.801016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:17.815446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401409475335125:7236]
2025-10-15T10:59:17.887092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:17.890938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:17.891732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:17.891750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:17.891788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:17.892018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:17.892188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401412275027617:6984]
2025-10-15T10:59:17.894265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:17.896540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:17.896739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:17.897929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:17.898248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:17.898256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:17.898262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:17.898268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:17.898275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:17.898282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:17.898289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:17.898295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:17.898301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:17.898308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:17.898315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:17.898321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.898328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.898334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.898379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:17.898476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:17.898524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:17.898570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:17.898614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:17.898663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:17.898705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:17.898749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:17.898794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:17.898839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:17.898883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:17.898926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.898972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.899018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.899059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:17.899122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:17.899186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:17.899236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:17.899281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:17.899331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:17.899393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:17.899443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:17.899488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:17.899537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:17.899579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:17.899629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:17.899674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:17.899723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:17.899767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:17.899820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:17.899865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:17.899920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:17.899963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:17.900013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:17.900058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:17.900106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:17.900147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.900200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.900243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.900293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.900338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.900387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.900863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:17.928857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:17.946858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:17.946900Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:17.946916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:17.946932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:17.946953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 657 [2:7561401412275027617:6984]
2025-10-15T10:59:17.946997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:17.947047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:17.947061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:17.947072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:17.947082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:17.947126Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:17.947146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:17.947165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:17.948493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.948519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.948532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.948543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:17.948799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:17.948815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:17.948947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:17.949122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:17.949336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:17.949395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401412275027612:6984]
2025-10-15T10:59:17.949408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401412275027612:6984]
2025-10-15T10:59:17.949421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401412275027612:6984]
2025-10-15T10:59:17.949462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:17.949528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:17.949694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:17.949713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:17.949823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401412275027612:6984]
2025-10-15T10:59:17.949841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:17.951005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 657
2025-10-15T10:59:17.951087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 657, pipe: [1:7561401409475335125:7236]
2025-10-15T10:59:17.951155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 657
2025-10-15T10:59:17.950720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:17.950741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:17.950751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:17.950774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:17.951658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401409475335088:7757], now have 1 active actors on pipe
2025-10-15T10:59:17.951692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401409475335125:7236], now have 1 active actors on pipe
2025-10-15T10:59:17.951714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401409475335008:2467], now have 1 active actors on pipe
2025-10-15T10:59:17.951755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:17.951774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:17.951860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:17.951895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:17.951913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:17.951923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:17.951954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:17.951992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:17.952048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:17.960010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 658 partition: 0 MaxSeqNo: 46 sessionId: src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0
2025-10-15T10:59:17.959592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:17.959625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:17.959698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:17.960891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff10ac75-ca13def6-ff36deb7-1e5829ad_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:17.987318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0] Write session: try to update token
2025-10-15T10:59:17.987391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:18.044569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:18.044600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:18.044611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:18.044619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:18.044650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401412275027612:6984]
2025-10-15T10:59:18.044672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401412275027612:6984]
2025-10-15T10:59:18.044694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401412275027612:6984]
2025-10-15T10:59:18.044815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:18.044843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:18.044858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:18.044866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:18.044877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:18.045822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:18.102864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId: src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:18.126844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:18.192965Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:18.209452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:18.207991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:18.208027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:18.208071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:18.208080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:18.208107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401412275027612:6984]
2025-10-15T10:59:18.208470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:18.208531Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:18.215021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401409475335125:7236]
2025-10-15T10:59:18.215088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:18.220500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 658 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0
2025-10-15T10:59:18.220776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 658 sessionId: src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0 is DEAD
2025-10-15T10:59:18.223617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:18.223667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0] Write session will restart in 0.007844s
2025-10-15T10:59:18.223808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0] Write session: Do CDS request
2025-10-15T10:59:18.223853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:18.248162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:18.248192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 659
2025-10-15T10:59:18.252263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:18.253137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:18.253313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:18.253329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:18.253348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:18.255944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 659 sessionId:  describe result for acl check
2025-10-15T10:59:18.256089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:18.256133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:18.256153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:18.256183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401413770302573:7761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:18.260037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401413770302573:7761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:18.265719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401413770302573:7761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:18.290234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401413770302573:7761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:18.290282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401413770302573:7761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:18.290297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401413770302573:7761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:18.290326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:18.317566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401413770302783:7236]
2025-10-15T10:59:18.352150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:18.358338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:18.359129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:18.359147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:18.359186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:18.359453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:18.359626Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401416569995171:6994]
2025-10-15T10:59:18.361694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:18.363631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:18.363852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:18.365058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:18.365385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:18.365401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:18.365408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:18.365415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:18.365422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:18.365430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:18.365436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:18.365443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:18.365449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:18.365455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:18.365462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:18.365468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.365474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.365482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.365526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:18.365627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:18.365671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:18.365716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:18.365769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:18.365821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:18.365870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:18.365913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:18.365958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:18.366002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:18.366047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:18.366106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.366146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.366190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.366230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:18.366293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:18.366349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:18.366400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:18.366446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:18.366499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:18.366541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:18.366589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:18.366635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:18.366684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:18.366728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:18.366780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:18.366824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:18.366875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:18.366921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:18.366970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:18.367016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:18.367073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:18.367118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:18.367170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:18.367215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:18.367265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:18.367309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.367386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.367433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.367488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.367535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.367583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.368071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:18.397062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:18.408245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:18.408291Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:18.408308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:18.408324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:18.408348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 658 [2:7561401416569995171:6994]
2025-10-15T10:59:18.408390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:18.408443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:18.408457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:18.408471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:18.408749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:18.408810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:18.408830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:18.408850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:18.411189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.411213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.411227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.411238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:18.411529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:18.411546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.411673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.411842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.412054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:18.412133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401413770302558:2467], now have 1 active actors on pipe
2025-10-15T10:59:18.412157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401413770302783:7236], now have 1 active actors on pipe
2025-10-15T10:59:18.412177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401413770302668:7761], now have 1 active actors on pipe
2025-10-15T10:59:18.412200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401416569995165:6994]
2025-10-15T10:59:18.412213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401416569995165:6994]
2025-10-15T10:59:18.413319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 658
2025-10-15T10:59:18.413413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 658, pipe: [1:7561401413770302783:7236]
2025-10-15T10:59:18.413476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 658
2025-10-15T10:59:18.413700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401416569995165:6994]
2025-10-15T10:59:18.413749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:18.413830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:18.414000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:18.414018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:18.414090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:18.414110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:18.414246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401416569995165:6994]
2025-10-15T10:59:18.414267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:18.414330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be8e9a63-3afd1862-a6758736-bf6595da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:18.414358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:18.414376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:18.414385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:18.414417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:18.414454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:18.414582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:18.414989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:18.415007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:18.415018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:18.415040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:18.417097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:18.417129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:18.417194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:18.417503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 659 partition: 0 MaxSeqNo: 46 sessionId: src_id|be8e9a63-3afd1862-a6758736-bf6595da_0
2025-10-15T10:59:18.418297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff1fcc9-d24ee61a-b10d7fa2-c10011df_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|be8e9a63-3afd1862-a6758736-bf6595da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:18.454058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be8e9a63-3afd1862-a6758736-bf6595da_0] Write session: try to update token
2025-10-15T10:59:18.454121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be8e9a63-3afd1862-a6758736-bf6595da_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:18.542729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:18.542759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:18.542770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:18.542781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:18.542817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401416569995165:6994]
2025-10-15T10:59:18.542840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401416569995165:6994]
2025-10-15T10:59:18.542862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401416569995165:6994]
2025-10-15T10:59:18.543012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:18.543024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:18.543033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:18.543118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:18.543137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:18.545978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:18.546022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:18.546047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:18.548441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:18.594451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId: src_id|be8e9a63-3afd1862-a6758736-bf6595da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:18.632504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:18.716261Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:18.727260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:18.727309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:18.727390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:18.727403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:18.727441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401416569995165:6994]
2025-10-15T10:59:18.727685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:18.727994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:18.731532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401413770302783:7236]
2025-10-15T10:59:18.731638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:18.777011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 659 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be8e9a63-3afd1862-a6758736-bf6595da_0
2025-10-15T10:59:18.777305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 659 sessionId: src_id|be8e9a63-3afd1862-a6758736-bf6595da_0 is DEAD
2025-10-15T10:59:18.779858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be8e9a63-3afd1862-a6758736-bf6595da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:18.779886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be8e9a63-3afd1862-a6758736-bf6595da_0] Write session will restart in 0.005353s
2025-10-15T10:59:18.779978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be8e9a63-3afd1862-a6758736-bf6595da_0] Write session: Do CDS request
2025-10-15T10:59:18.780001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be8e9a63-3afd1862-a6758736-bf6595da_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:18.791815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be8e9a63-3afd1862-a6758736-bf6595da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:18.793501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:18.795582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:18.795609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 660
2025-10-15T10:59:18.795946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:18.796041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:18.796055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:18.796063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:18.797356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 660 sessionId:  describe result for acl check
2025-10-15T10:59:18.797446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:18.797455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:18.797465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:18.797480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401413770302852:7773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:18.799611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401413770302852:7773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:18.810441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401413770302852:7773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:18.822642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401413770302852:7773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:18.822683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401413770302852:7773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:18.822698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401413770302852:7773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:18.822726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:18.829932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401413770302935:7236]
2025-10-15T10:59:18.887389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:18.894344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:18.895126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:18.895151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:18.895180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:18.895416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:18.895547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401416569995429:7001]
2025-10-15T10:59:18.897162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:18.898382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:18.898624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:18.899906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:18.900251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:18.900269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:18.900275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:18.900281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:18.900288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:18.900294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:18.900301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:18.900307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:18.900314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:18.900319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:18.900326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:18.900332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.900339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.900345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.900391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:18.900491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:18.900538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:18.900584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:18.900626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:18.900671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:18.900716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:18.900773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:18.900815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:18.900859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:18.900905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:18.900949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.900994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.901406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.901483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:18.901558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:18.901634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:18.901695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:18.901758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:18.901832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:18.901879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:18.901932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:18.901977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:18.902029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:18.902074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:18.902137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:18.902183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:18.902243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:18.902285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:18.902365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:18.902419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:18.902481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:18.902526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:18.902577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:18.902625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:18.902678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:18.902721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.902778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.902824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.902879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.902922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.902998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.903521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:18.920124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:18.930349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:18.930391Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:18.930409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:18.930425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:18.930449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 659 [2:7561401416569995429:7001]
2025-10-15T10:59:18.930498Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:18.930551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:18.930565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:18.930577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:18.930587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:18.930632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:18.930652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:18.930671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:18.936701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.936731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.936746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.936756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:18.937009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:18.937033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:18.937167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:18.937354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:18.937333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 659
2025-10-15T10:59:18.937578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:18.937430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 659, pipe: [1:7561401413770302935:7236]
2025-10-15T10:59:18.937512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 659
2025-10-15T10:59:18.937655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401413770302848:2467], now have 1 active actors on pipe
2025-10-15T10:59:18.937683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401413770302935:7236], now have 1 active actors on pipe
2025-10-15T10:59:18.937702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401413770302915:7773], now have 1 active actors on pipe
2025-10-15T10:59:18.937747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401416569995424:7001]
2025-10-15T10:59:18.937765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401416569995424:7001]
2025-10-15T10:59:18.937778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401416569995424:7001]
2025-10-15T10:59:18.937810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:18.937853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:18.937874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:18.937884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:18.937885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:18.937903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:18.937944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:18.938120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:18.938142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:18.938278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aef48325-134d972e-d8ced1f0-da291c59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:18.938309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:18.938334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:18.938346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:18.938382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:18.938416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:18.938453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401416569995424:7001]
2025-10-15T10:59:18.938491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:18.938588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:18.938996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:18.945381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:18.945421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:18.945495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:18.947043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 660 partition: 0 MaxSeqNo: 46 sessionId: src_id|aef48325-134d972e-d8ced1f0-da291c59_0
2025-10-15T10:59:18.949295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be8e9a63-3afd1862-a6758736-bf6595da_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|aef48325-134d972e-d8ced1f0-da291c59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:19.001152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef48325-134d972e-d8ced1f0-da291c59_0] Write session: try to update token
2025-10-15T10:59:19.001205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef48325-134d972e-d8ced1f0-da291c59_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:19.111387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:19.111412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:19.111420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:19.111460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:19.111470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:19.111479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:19.111490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:19.111523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401416569995424:7001]
2025-10-15T10:59:19.111548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401416569995424:7001]
2025-10-15T10:59:19.111571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401416569995424:7001]
2025-10-15T10:59:19.111686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:19.111718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:19.111747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:19.111753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:19.111774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:19.121440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:19.140045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId: src_id|aef48325-134d972e-d8ced1f0-da291c59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:19.165890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:19.270838Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:19.298415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:19.298459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:19.298528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:19.298540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:19.298578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401416569995424:7001]
2025-10-15T10:59:19.298778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:19.299222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:19.299411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401413770302935:7236]
2025-10-15T10:59:19.299516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:19.299538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:19.299527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:19.309566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 660 reason: error at write: Disconnected sessionId: src_id|aef48325-134d972e-d8ced1f0-da291c59_0
2025-10-15T10:59:19.310721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 660 sessionId: src_id|aef48325-134d972e-d8ced1f0-da291c59_0 is DEAD
2025-10-15T10:59:19.312190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef48325-134d972e-d8ced1f0-da291c59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:19.312248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef48325-134d972e-d8ced1f0-da291c59_0] Write session will restart in 0.007437s
2025-10-15T10:59:19.312411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef48325-134d972e-d8ced1f0-da291c59_0] Write session: Do CDS request
2025-10-15T10:59:19.312473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef48325-134d972e-d8ced1f0-da291c59_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:19.325977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:19.326012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 661
2025-10-15T10:59:19.326798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef48325-134d972e-d8ced1f0-da291c59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:19.330956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:19.331094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:19.331118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:19.331127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:19.332780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 661 sessionId:  describe result for acl check
2025-10-15T10:59:19.332900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:19.332918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:19.332931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:19.332946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401418065270408:7782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:19.335177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401418065270408:7782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:19.342580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401418065270408:7782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:19.356649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401418065270408:7782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:19.356693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401418065270408:7782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:19.356709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401418065270408:7782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:19.356738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:19.399906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401418065270519:7236]
2025-10-15T10:59:19.484848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:19.491046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:19.492012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:19.492044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:19.492085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:19.492332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:19.492504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401420864962982:7009]
2025-10-15T10:59:19.494457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:19.496403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:19.496630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:19.497880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:19.498222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:19.498230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:19.498237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:19.498244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:19.498251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:19.498259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:19.498265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:19.498271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:19.498278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:19.498285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:19.498291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:19.498297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:19.498303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:19.498309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:19.498354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:19.498452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:19.498500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:19.498545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:19.498592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:19.498634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:19.498677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:19.498721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:19.498766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:19.498809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:19.498850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:19.498893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:19.498933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:19.498978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:19.499017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:19.499077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:19.499130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:19.499182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:19.499230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:19.499278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:19.499318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:19.500625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:19.500693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:19.500749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:19.500804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:19.500855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:19.500899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:19.500951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:19.501000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:19.501064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:19.501112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:19.501164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:19.501207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:19.501257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:19.501301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:19.501355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:19.501399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:19.501458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:19.501506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:19.501557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:19.501598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:19.501651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:19.502149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:19.540453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:19.553148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:19.553193Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:19.553208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:19.553226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:19.553250Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 660 [2:7561401420864962982:7009]
2025-10-15T10:59:19.553298Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:19.553345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:19.553358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:19.553370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:19.553380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:19.553423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:19.553442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:19.553461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:19.555377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:19.555392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:19.555405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:19.555415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:19.555686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:19.555702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:19.555836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:19.555998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 660
2025-10-15T10:59:19.556119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 660
2025-10-15T10:59:19.556206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 660, pipe: [1:7561401418065270519:7236]
2025-10-15T10:59:19.556021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:19.556246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:19.556321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401418065270440:7782], now have 1 active actors on pipe
2025-10-15T10:59:19.556344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401418065270395:2467], now have 1 active actors on pipe
2025-10-15T10:59:19.556366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401418065270519:7236], now have 1 active actors on pipe
2025-10-15T10:59:19.556411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:19.556431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:19.556468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401420864962976:7009]
2025-10-15T10:59:19.556482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401420864962976:7009]
2025-10-15T10:59:19.556493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401420864962976:7009]
2025-10-15T10:59:19.556533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:19.556558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:19.556573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:19.556593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:19.556598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:19.556757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:19.556772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:19.556829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:19.556857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:19.556878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:19.556889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:19.556920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:19.556959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:19.557093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401420864962976:7009]
2025-10-15T10:59:19.557121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:19.557145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:19.557164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:19.558650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 661 partition: 0 MaxSeqNo: 46 sessionId: src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0
2025-10-15T10:59:19.557812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:19.557845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:19.557908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:19.560626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef48325-134d972e-d8ced1f0-da291c59_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:19.624816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0] Write session: try to update token
2025-10-15T10:59:19.624885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:19.653728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:19.653758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:19.653772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:19.717949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:19.717985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:19.717997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:19.718007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:19.718040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401420864962976:7009]
2025-10-15T10:59:19.718064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401420864962976:7009]
2025-10-15T10:59:19.718084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401420864962976:7009]
2025-10-15T10:59:19.718240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:19.718266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:19.719504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:19.719560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:19.719592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:19.720678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:19.765183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId: src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:19.790065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:19.873041Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:19.875199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:19.875230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:19.878738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:19.879613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:19.879797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401418065270519:7236]
2025-10-15T10:59:19.879875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:19.889681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:19.889733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0] Write session will restart in 0.008594s
2025-10-15T10:59:19.889860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0] Write session: Do CDS request
2025-10-15T10:59:19.889907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:19.889035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 661 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0
2025-10-15T10:59:19.889279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 661 sessionId: src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0 is DEAD
2025-10-15T10:59:19.909725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:19.931718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:19.931761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 662
2025-10-15T10:59:19.935514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:19.935681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:19.935699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:19.935712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:19.937712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 662 sessionId:  describe result for acl check
2025-10-15T10:59:19.937833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:19.937844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:19.937855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:19.937875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401418065270698:7794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:19.940112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401418065270698:7794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:19.955765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401418065270698:7794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:19.977534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401418065270698:7794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:19.977595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401418065270698:7794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:19.977612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401418065270698:7794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:19.977648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:19.983906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401418065270844:7236]
2025-10-15T10:59:20.050892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:20.060411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:20.061423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:20.061443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:20.061492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:20.061789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:20.062023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401425159930552:7021]
2025-10-15T10:59:20.065326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:20.066425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:20.066679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:20.068081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:20.068465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:20.068484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:20.068493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:20.068501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:20.068508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:20.068515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:20.068523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:20.068531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:20.068538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:20.068545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:20.068553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:20.068559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.068566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.068573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.068624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:20.068745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:20.068797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:20.068850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:20.068898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:20.068946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:20.068995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:20.069043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:20.069089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:20.069138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:20.069188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:20.069240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.069290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.069338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.069383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:20.069455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:20.069517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:20.069578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:20.069631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:20.069689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:20.069739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:20.069796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:20.069848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:20.069901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:20.069948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:20.070005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:20.070054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:20.070124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:20.070174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:20.070233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:20.070287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:20.070359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:20.070423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:20.070491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:20.070551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:20.070614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:20.070671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.070739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.070802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.070871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.070934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.071000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.073663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:20.098748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:20.110362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:20.110413Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:20.110430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:20.110449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:20.110475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 661 [2:7561401425159930552:7021]
2025-10-15T10:59:20.110529Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:20.110590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:20.110606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:20.110619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:20.110630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:20.110682Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:20.110707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:20.110731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:20.112827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.112855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.112868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.112880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:20.113168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:20.113187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.113347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.113598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.113845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:20.113932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401418065270844:7236], now have 1 active actors on pipe
2025-10-15T10:59:20.113958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401418065270810:7794], now have 1 active actors on pipe
2025-10-15T10:59:20.113980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401418065270666:2467], now have 1 active actors on pipe
2025-10-15T10:59:20.114007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401425159930547:7021]
2025-10-15T10:59:20.114023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401425159930547:7021]
2025-10-15T10:59:20.114041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401425159930547:7021]
2025-10-15T10:59:20.114094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:20.114198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:20.114409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:20.114433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:20.114582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401425159930547:7021]
2025-10-15T10:59:20.114604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:20.115518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 661, pipe: [1:7561401418065270844:7236]
2025-10-15T10:59:20.115631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 661
2025-10-15T10:59:20.115715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 661
2025-10-15T10:59:20.115396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:20.115422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:20.115437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:20.115466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:20.116192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:20.116225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:20.116317Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:20.116351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:20.116370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:20.116384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:20.116436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:20.116484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:20.116535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:20.120101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:20.120137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:20.120198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:20.123725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 662 partition: 0 MaxSeqNo: 46 sessionId: src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0
2025-10-15T10:59:20.126602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb3f009-88e08fe5-fd7ab7f8-82f28fb4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:20.169597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0] Write session: try to update token
2025-10-15T10:59:20.169661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:20.213234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:20.213263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:20.213273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:20.213281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:20.213313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401425159930547:7021]
2025-10-15T10:59:20.213331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401425159930547:7021]
2025-10-15T10:59:20.213349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401425159930547:7021]
2025-10-15T10:59:20.213498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:20.213507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:20.213514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:20.213550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:20.213565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:20.215479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:20.215529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:20.215563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:20.217068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:20.324584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId: src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:20.352710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:20.372755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:20.374747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:20.374787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:20.375697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401418065270844:7236]
2025-10-15T10:59:20.375924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:20.375961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:20.378953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:20.385635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 662 reason: error at write: Disconnected sessionId: src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0
2025-10-15T10:59:20.386016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 662 sessionId: src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0 is DEAD
2025-10-15T10:59:20.387472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:20.387542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0] Write session will restart in 0.007761s
2025-10-15T10:59:20.387747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0] Write session: Do CDS request
2025-10-15T10:59:20.387815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:20.408982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:20.408047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:20.411738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:20.411782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 663
2025-10-15T10:59:20.412542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:20.412667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:20.412684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:20.412693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:20.414812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 663 sessionId:  describe result for acl check
2025-10-15T10:59:20.414902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:20.414910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:20.414917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:20.414933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401422360238248:7799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:20.419245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401422360238248:7799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:20.424919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401422360238248:7799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:20.454258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401422360238248:7799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:20.454308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401422360238248:7799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:20.454325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401422360238248:7799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:20.454358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:20.476090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401422360238479:7236]
2025-10-15T10:59:20.482329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:20.484384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:20.485407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:20.485440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:20.485493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:20.485809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:20.486017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401425159930802:7024]
2025-10-15T10:59:20.488315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:20.489554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:20.489811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:20.491235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:20.491671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:20.491679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:20.491687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:20.491695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:20.491703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:20.491710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:20.491718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:20.491725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:20.491733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:20.491740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:20.491747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:20.491755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.491763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.491770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.491821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:20.491964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:20.492017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:20.492067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:20.492117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:20.492184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:20.492236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:20.492295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:20.492346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:20.492391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:20.492438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:20.492498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.492547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.492598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.492652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:20.492726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:20.492793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:20.492853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:20.492909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:20.492969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:20.493017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:20.493073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:20.493128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:20.493187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:20.493235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:20.493291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:20.493343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:20.493398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:20.493449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:20.493508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:20.493559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:20.493617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:20.493668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:20.493729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:20.493783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:20.493837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:20.493886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.493945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.493996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.494057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.494104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.494179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.494726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:20.524324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:20.534613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:20.534666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:20.534687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:20.534711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:20.534737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 662 [2:7561401425159930802:7024]
2025-10-15T10:59:20.534798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:20.534871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:20.534888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:20.534901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:20.534914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:20.534966Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:20.534991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:20.535015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:20.536515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.536538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.536549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.536557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:20.536823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:20.536838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:20.536948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:20.537084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:20.537280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:20.537347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401425159930797:7024]
2025-10-15T10:59:20.537371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401425159930797:7024]
2025-10-15T10:59:20.537384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401425159930797:7024]
2025-10-15T10:59:20.537422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:20.537495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:20.537667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:20.537687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:20.537800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401425159930797:7024]
2025-10-15T10:59:20.537823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:20.538040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:20.538058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:20.538069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:20.538089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:20.538812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401422360238479:7236], now have 1 active actors on pipe
2025-10-15T10:59:20.538854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401422360238405:7799], now have 1 active actors on pipe
2025-10-15T10:59:20.538891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401422360238231:2467], now have 1 active actors on pipe
2025-10-15T10:59:20.539781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 662, pipe: [1:7561401422360238479:7236]
2025-10-15T10:59:20.539924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 662
2025-10-15T10:59:20.539923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 662
2025-10-15T10:59:20.540189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:20.540225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:20.540325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:20.540365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:20.540388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:20.540400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:20.540436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:20.540477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:20.540526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:20.543858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:20.543901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:20.543980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:20.548597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 663 partition: 0 MaxSeqNo: 46 sessionId: src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0
2025-10-15T10:59:20.550185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|134a69ec-3a46f9fa-4395b718-6fae5aef_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:20.600845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0] Write session: try to update token
2025-10-15T10:59:20.600901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:20.628391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:20.628425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:20.628463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401425159930797:7024]
2025-10-15T10:59:20.628585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:20.628641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:20.633056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:20.634227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:20.635513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:20.636678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:20.643082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:20.649046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:20.649080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:20.649092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:20.649157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:20.724148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:20.724188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:20.724200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:20.724211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:20.724255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401425159930797:7024]
2025-10-15T10:59:20.724282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401425159930797:7024]
2025-10-15T10:59:20.724302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401425159930797:7024]
2025-10-15T10:59:20.724431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:20.724459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:20.724465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:20.724483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:20.724491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:20.725534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:20.782235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId: src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:20.821807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:20.934094Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:20.938812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:20.938864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:20.941040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:20.944691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:20.944762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401422360238479:7236]
2025-10-15T10:59:20.944898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:21.012813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 663 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0
2025-10-15T10:59:21.013196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 663 sessionId: src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0 is DEAD
2025-10-15T10:59:21.015919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:21.015966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0] Write session will restart in 0.008672s
2025-10-15T10:59:21.016066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0] Write session: Do CDS request
2025-10-15T10:59:21.016094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:21.028697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:21.038842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:21.038885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 664
2025-10-15T10:59:21.043520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:21.043695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:21.043722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:21.043733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:21.045207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 664 sessionId:  describe result for acl check
2025-10-15T10:59:21.045329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:21.045347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:21.045358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:21.045376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401426655205885:7807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:21.045447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401426655205886:7236]
2025-10-15T10:59:21.048297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401426655205885:7807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:21.060448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401426655205885:7807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:21.084590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401426655205885:7807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:21.084647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401426655205885:7807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:21.084665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401426655205885:7807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:21.084697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:21.136919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:21.140672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:21.141500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:21.141518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:21.141557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:21.141798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:21.141970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401429454898369:7035]
2025-10-15T10:59:21.144142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:21.145280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:21.145458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:21.146691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:21.146991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:21.146997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:21.147003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:21.147009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:21.147015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:21.147022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:21.147028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:21.147035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:21.147040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:21.147048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:21.147055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:21.147061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.147067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.147074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.147121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:21.147221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:21.147266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:21.147309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:21.147395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:21.150051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:21.150148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:21.150195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:21.150244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:21.150294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:21.150341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:21.150386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.150431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.150474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.150521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:21.150588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:21.150644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:21.150698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:21.150744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:21.150797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:21.150844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:21.150896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:21.150945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:21.150999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:21.151044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:21.151095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:21.151141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:21.151190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:21.151235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:21.151307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:21.151370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:21.152307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:21.152383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:21.152442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:21.152491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:21.152545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:21.152592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.152642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.152689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.152739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.152786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.152839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.153335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:21.181088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:21.204564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:21.204613Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:21.204629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:21.204648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:21.204670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 663 [2:7561401429454898369:7035]
2025-10-15T10:59:21.204719Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:21.204773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:21.204787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:21.204798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:21.204809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:21.204850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:21.204869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:21.204889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:21.206438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.206453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.206466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.206478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:21.206731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:21.206746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.206883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.207064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.207296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:21.208305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 663
2025-10-15T10:59:21.208390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 663
2025-10-15T10:59:21.208451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 663, pipe: [1:7561401426655205886:7236]
2025-10-15T10:59:21.208292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401426655205982:7807], now have 1 active actors on pipe
2025-10-15T10:59:21.208341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401422360238498:2467], now have 1 active actors on pipe
2025-10-15T10:59:21.208362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401426655205886:7236], now have 1 active actors on pipe
2025-10-15T10:59:21.208388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401429454898364:7035]
2025-10-15T10:59:21.208403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401429454898364:7035]
2025-10-15T10:59:21.208414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401429454898364:7035]
2025-10-15T10:59:21.208452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:21.208497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:21.208512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:21.208523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:21.208530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:21.208732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:21.208750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:21.208879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:21.208899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:21.208928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401429454898364:7035]
2025-10-15T10:59:21.208956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:21.208974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:21.209080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:21.209107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:21.209124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:21.209133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:21.209164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:21.209202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:21.209390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:21.217603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:21.217645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:21.217715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:21.224279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 664 partition: 0 MaxSeqNo: 46 sessionId: src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0
2025-10-15T10:59:21.228034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d71fbf-9c6dde6-a8b7533b-b3895752_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:21.272392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0] Write session: try to update token
2025-10-15T10:59:21.272454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:21.407266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:21.407302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:21.407316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:21.407658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:21.407681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:21.407696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:21.407709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:21.407747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401429454898364:7035]
2025-10-15T10:59:21.407776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401429454898364:7035]
2025-10-15T10:59:21.407802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401429454898364:7035]
2025-10-15T10:59:21.408015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:21.408041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:21.408399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:21.408439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:21.408468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:21.415066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:21.418188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId: src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:21.440114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:21.588088Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:21.599536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:21.599591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:21.599668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:21.599682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:21.599728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401429454898364:7035]
2025-10-15T10:59:21.600080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:21.602394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:21.601101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401426655205886:7236]
2025-10-15T10:59:21.601201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:21.601215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:21.649887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:21.650333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 664 reason: error at write: Disconnected sessionId: src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0
2025-10-15T10:59:21.650689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 664 sessionId: src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0 is DEAD
2025-10-15T10:59:21.656107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:21.656168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0] Write session will restart in 0.007556s
2025-10-15T10:59:21.656318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0] Write session: Do CDS request
2025-10-15T10:59:21.656358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:21.670952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:21.676090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:21.676119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 665
2025-10-15T10:59:21.679577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:21.679718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:21.679734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:21.679744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:21.684695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 665 sessionId:  describe result for acl check
2025-10-15T10:59:21.684815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:21.684826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:21.684835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:21.684852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401426655206124:7819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:21.687536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401426655206124:7819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:21.700184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401426655206187:7236]
2025-10-15T10:59:21.704942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401426655206124:7819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:21.737286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401426655206124:7819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:21.737330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401426655206124:7819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:21.737346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401426655206124:7819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:21.737383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:21.785601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:21.796699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:21.797656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:21.797675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:21.797719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:21.797963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:21.798190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401429454898633:7043]
2025-10-15T10:59:21.800370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:21.801461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:21.801668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:21.803073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:21.803409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:21.803417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:21.803424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:21.803431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:21.803438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:21.803447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:21.803454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:21.803461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:21.803468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:21.803475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:21.803481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:21.803487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.803494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.803500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.803545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:21.803653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:21.803703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:21.803749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:21.803794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:21.803840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:21.803885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:21.803931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:21.803975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:21.804026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:21.804070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:21.804111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.804153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.804196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.804239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:21.804300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:21.804356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:21.804407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:21.804455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:21.804506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:21.804548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:21.804600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:21.804646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:21.804697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:21.804741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:21.804794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:21.804839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:21.804893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:21.804938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:21.804989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:21.805036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:21.805087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:21.805130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:21.805181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:21.805225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:21.805278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:21.805321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.805373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.805416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.805467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.805510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.805562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.806056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:21.844001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:21.858101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:21.858162Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:21.858178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:21.858197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:21.858221Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 664 [2:7561401429454898633:7043]
2025-10-15T10:59:21.858275Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:21.858331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:21.858346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:21.858359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:21.858370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:21.858420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:21.858444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:21.858467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:21.926400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.926432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.926441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.926452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:21.926714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:21.926731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:21.926858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:21.927020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:21.927243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:21.927323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401426655206260:7819], now have 1 active actors on pipe
2025-10-15T10:59:21.927637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401426655206094:2467], now have 1 active actors on pipe
2025-10-15T10:59:21.928275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 664
2025-10-15T10:59:21.928365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 664
2025-10-15T10:59:21.928442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 664, pipe: [1:7561401426655206187:7236]
2025-10-15T10:59:21.930561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 665 partition: 0 MaxSeqNo: 46 sessionId: src_id|5ec60a53-166666b2-8aefc064-c5633827_0
2025-10-15T10:59:21.927676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401426655206187:7236], now have 1 active actors on pipe
2025-10-15T10:59:21.927711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401429454898627:7043]
2025-10-15T10:59:21.927725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401429454898627:7043]
2025-10-15T10:59:21.927739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401429454898627:7043]
2025-10-15T10:59:21.927778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:21.927866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:21.928051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:21.928070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:21.928188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401429454898627:7043]
2025-10-15T10:59:21.928208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:21.928385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:21.928398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:21.928410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:21.928435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:21.929189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:21.929216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:21.929306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ec60a53-166666b2-8aefc064-c5633827_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:21.929350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:21.929371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:21.929382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:21.929417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:21.929460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:21.929509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:21.930095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:21.930120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:21.930217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:21.939582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c21ec45-c196fc24-f8a211c8-285efb27_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5ec60a53-166666b2-8aefc064-c5633827_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:21.959113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:21.959144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:21.959155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:21.976085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec60a53-166666b2-8aefc064-c5633827_0] Write session: try to update token
2025-10-15T10:59:21.976140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec60a53-166666b2-8aefc064-c5633827_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:22.040351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:22.040385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:22.040396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:22.040406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:22.040436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401429454898627:7043]
2025-10-15T10:59:22.040460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401429454898627:7043]
2025-10-15T10:59:22.040483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401429454898627:7043]
2025-10-15T10:59:22.040657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:22.040677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:22.041676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:22.043781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:22.043817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:22.043842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:22.147454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId: src_id|5ec60a53-166666b2-8aefc064-c5633827_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:22.174717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:22.179749Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:22.189081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:22.189127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:22.189182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:22.189194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:22.189232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401429454898627:7043]
2025-10-15T10:59:22.189620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:22.191381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:22.191504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:22.191527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:22.195531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:22.195752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401426655206187:7236]
2025-10-15T10:59:22.268647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec60a53-166666b2-8aefc064-c5633827_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:22.268706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec60a53-166666b2-8aefc064-c5633827_0] Write session will restart in 0.008962s
2025-10-15T10:59:22.268844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec60a53-166666b2-8aefc064-c5633827_0] Write session: Do CDS request
2025-10-15T10:59:22.268890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec60a53-166666b2-8aefc064-c5633827_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:22.267866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 665 reason: error at write: Disconnected sessionId: src_id|5ec60a53-166666b2-8aefc064-c5633827_0
2025-10-15T10:59:22.268148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 665 sessionId: src_id|5ec60a53-166666b2-8aefc064-c5633827_0 is DEAD
2025-10-15T10:59:22.283292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec60a53-166666b2-8aefc064-c5633827_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:22.283641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:22.283677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 666
2025-10-15T10:59:22.283978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:22.284104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:22.284121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:22.284132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:22.286597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 666 sessionId:  describe result for acl check
2025-10-15T10:59:22.286719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:22.286730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:22.286740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:22.286759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401430950173749:7826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:22.289040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401430950173749:7826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:22.296885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401430950173786:7236]
2025-10-15T10:59:22.299783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401430950173749:7826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:22.315698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401430950173749:7826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:22.315738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401430950173749:7826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:22.315758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401430950173749:7826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:22.315789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:22.348529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:22.352498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:22.353214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:22.353227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:22.353270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:22.353482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:22.353644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401433749866195:7049]
2025-10-15T10:59:22.355209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:22.357469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:22.357653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:22.359025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:22.359310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:22.359315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:22.359319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:22.359323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:22.359328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:22.359332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:22.359336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:22.359341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:22.359357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:22.359363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:22.359369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:22.359374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:22.359381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:22.359388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:22.359439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:22.359547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:22.359584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:22.359622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:22.359656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:22.359703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:22.359750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:22.359798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:22.359845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:22.359895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:22.359942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:22.359989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:22.360037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:22.360080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:22.360108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:22.360159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:22.360203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:22.360246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:22.360283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:22.360324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:22.360357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:22.360395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:22.360439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:22.360490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:22.360527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:22.360575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:22.360610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:22.360649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:22.360681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:22.360719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:22.360751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:22.360791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:22.360823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:22.360862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:22.360897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:22.360947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:22.360993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:22.361046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:22.361090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:22.361131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:22.361161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:22.361201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:22.361599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:22.381150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:22.390953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:22.390994Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:22.391007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:22.391028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:22.391055Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 665 [2:7561401433749866195:7049]
2025-10-15T10:59:22.391100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:22.391162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:22.391175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:22.391187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:22.391196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:22.391236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:22.391255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:22.391273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:22.392827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:22.392852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:22.392867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:22.392879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:22.393566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:22.393589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:22.393747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:22.393950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:22.394213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:22.394308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401430950173860:7826], now have 1 active actors on pipe
2025-10-15T10:59:22.394334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401430950173786:7236], now have 1 active actors on pipe
2025-10-15T10:59:22.394368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401430950173653:2467], now have 1 active actors on pipe
2025-10-15T10:59:22.394392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401433749866190:7049]
2025-10-15T10:59:22.394407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401433749866190:7049]
2025-10-15T10:59:22.394421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401433749866190:7049]
2025-10-15T10:59:22.394461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:22.394538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:22.394733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:22.395793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 665
2025-10-15T10:59:22.395874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 665, pipe: [1:7561401430950173786:7236]
2025-10-15T10:59:22.395943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 665
2025-10-15T10:59:22.394760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:22.394883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401433749866190:7049]
2025-10-15T10:59:22.394901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:22.395082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:22.395095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:22.395106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:22.395130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:22.398587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:22.398632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:22.398728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:22.398761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:22.398779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:22.398790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:22.398828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:22.398868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:22.398919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:22.399910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 666 partition: 0 MaxSeqNo: 46 sessionId: src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0
2025-10-15T10:59:22.399529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:22.399564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:22.399634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:22.401976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ec60a53-166666b2-8aefc064-c5633827_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:22.446436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0] Write session: try to update token
2025-10-15T10:59:22.446499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:22.535608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:22.535647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:22.535688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401433749866190:7049]
2025-10-15T10:59:22.535813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:22.535811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:22.535825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:22.535835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:22.535990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:22.539381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:22.540910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:22.541975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:22.543051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:22.545047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:22.570764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:22.570930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:22.570953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:22.570970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:22.570983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:22.571020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401433749866190:7049]
2025-10-15T10:59:22.571045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401433749866190:7049]
2025-10-15T10:59:22.571071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401433749866190:7049]
2025-10-15T10:59:22.571169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:22.571204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:22.571231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:22.584065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:22.584112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:22.585029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:22.588411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId: src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:22.633472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:22.788943Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:22.797318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:22.797368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:22.799504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:22.799530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:22.799528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:22.803535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401430950173786:7236]
2025-10-15T10:59:22.803618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:22.818126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 666 reason: error at write: Disconnected sessionId: src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0
2025-10-15T10:59:22.819178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:22.819244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0] Write session will restart in 0.005509s
2025-10-15T10:59:22.819343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0] Write session: Do CDS request
2025-10-15T10:59:22.819388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:22.818633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 666 sessionId: src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0 is DEAD
2025-10-15T10:59:22.843901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:22.843990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:22.844024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 667
2025-10-15T10:59:22.844484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:22.844612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:22.844633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:22.844642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:22.845991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 667 sessionId:  describe result for acl check
2025-10-15T10:59:22.846105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:22.846120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:22.846129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:22.846157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401430950173937:7832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:22.848891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401430950173937:7832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:22.857179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401430950173937:7832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:22.880569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401430950173937:7832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:22.880618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401430950173937:7832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:22.880637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401430950173937:7832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:22.880671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:22.907477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401430950174022:7236]
2025-10-15T10:59:23.010229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:23.017110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:23.018046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:23.018065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:23.018110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:23.018396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:23.018578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401438044833783:7057]
2025-10-15T10:59:23.020855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:23.021874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:23.022087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:23.023409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:23.023725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:23.023744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:23.023751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:23.023758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:23.023764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:23.023772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:23.023779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:23.023786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:23.023793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:23.023801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:23.023808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:23.023816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.023822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.023828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.023872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:23.023980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:23.024029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:23.024074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:23.024116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:23.024165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:23.024205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:23.024249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:23.024297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:23.024340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:23.024384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:23.024426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.024468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.024512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.024559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:23.024625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:23.024681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:23.024731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:23.024777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:23.024825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:23.024869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:23.024921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:23.024968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:23.025016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:23.025061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:23.025112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:23.025157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:23.025209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:23.025253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:23.025304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:23.025348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:23.025398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:23.025439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:23.025493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:23.025536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:23.025589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:23.025633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.025684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.025729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.025778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.025824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.025875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.026416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:23.050348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:23.060590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:23.060631Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:23.060648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:23.060667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:23.060693Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 666 [2:7561401438044833783:7057]
2025-10-15T10:59:23.060746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:23.060802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:23.060817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:23.060828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:23.060839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:23.060885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:23.060908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:23.060930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:23.062505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.063609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 666
2025-10-15T10:59:23.062520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.062534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.063702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 666, pipe: [1:7561401430950174022:7236]
2025-10-15T10:59:23.062545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:23.062810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:23.062827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.062968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.063154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.063785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 666
2025-10-15T10:59:23.063952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:23.064042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401430950173923:2467], now have 1 active actors on pipe
2025-10-15T10:59:23.064064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401430950174022:7236], now have 1 active actors on pipe
2025-10-15T10:59:23.064087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401430950173969:7832], now have 1 active actors on pipe
2025-10-15T10:59:23.064152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:23.064172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:23.064206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401438044833778:7057]
2025-10-15T10:59:23.064222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401438044833778:7057]
2025-10-15T10:59:23.064234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401438044833778:7057]
2025-10-15T10:59:23.064272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:23.064307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:23.064322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:23.064334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:23.064342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:23.064518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:23.064534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:23.064597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|859423ce-14aa9514-a6007993-61db766_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:23.064628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:23.064646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:23.064656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:23.064690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:23.064728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:23.064847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401438044833778:7057]
2025-10-15T10:59:23.064875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:23.064918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:23.065536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:23.071241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:23.071278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:23.071370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:23.075589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 667 partition: 0 MaxSeqNo: 46 sessionId: src_id|859423ce-14aa9514-a6007993-61db766_0
2025-10-15T10:59:23.076498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be10ab07-ef9f897-ac5a449c-c3493c3e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|859423ce-14aa9514-a6007993-61db766_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:23.105709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859423ce-14aa9514-a6007993-61db766_0] Write session: try to update token
2025-10-15T10:59:23.105771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859423ce-14aa9514-a6007993-61db766_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:23.251119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:23.251154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:23.251167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:23.251227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:23.251243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:23.251255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:23.251266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:23.251301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401438044833778:7057]
2025-10-15T10:59:23.251328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401438044833778:7057]
2025-10-15T10:59:23.251379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401438044833778:7057]
2025-10-15T10:59:23.251589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:23.251613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:23.251852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:23.251894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:23.251922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:23.252859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:23.291260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId: src_id|859423ce-14aa9514-a6007993-61db766_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:23.324589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:23.446679Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:23.458182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:23.458239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:23.458311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:23.458326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:23.458368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401438044833778:7057]
2025-10-15T10:59:23.458492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:23.458977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:23.463562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:23.477063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859423ce-14aa9514-a6007993-61db766_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:23.477132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859423ce-14aa9514-a6007993-61db766_0] Write session will restart in 0.006193s
2025-10-15T10:59:23.477297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859423ce-14aa9514-a6007993-61db766_0] Write session: Do CDS request
2025-10-15T10:59:23.477347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859423ce-14aa9514-a6007993-61db766_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:23.476222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 667 reason: status is not ok: tablet will be restarted right now sessionId: src_id|859423ce-14aa9514-a6007993-61db766_0
2025-10-15T10:59:23.476611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 667 sessionId: src_id|859423ce-14aa9514-a6007993-61db766_0 is DEAD
2025-10-15T10:59:23.489187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859423ce-14aa9514-a6007993-61db766_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:23.512566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:23.512706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401430950174022:7236]
2025-10-15T10:59:23.512772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:23.512786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 668
2025-10-15T10:59:23.516279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:23.516403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:23.516425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:23.516433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:23.518940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 668 sessionId:  describe result for acl check
2025-10-15T10:59:23.519109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:23.519124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:23.519133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:23.519149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401435245141518:7842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:23.527103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401435245141518:7842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:23.551507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401435245141518:7842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:23.575272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401435245141518:7842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:23.575309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401435245141518:7842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:23.575324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401435245141518:7842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:23.575366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:23.612528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401435245141753:7236]
2025-10-15T10:59:23.627624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:23.632997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:23.633812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:23.633844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:23.633954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:23.634242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:23.634433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401438044834038:7066]
2025-10-15T10:59:23.636554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:23.638054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:23.638274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:23.639459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:23.639773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:23.639792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:23.639799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:23.639806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:23.639812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:23.639819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:23.639825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:23.639831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:23.639839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:23.639845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:23.639852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:23.639859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.639865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.639872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.639915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:23.640020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:23.640064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:23.640107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:23.640150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:23.640194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:23.640241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:23.640280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:23.640320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:23.640364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:23.640406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:23.640445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.640489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.640534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.640575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:23.640635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:23.640688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:23.640736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:23.640780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:23.640826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:23.640867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:23.640917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:23.640963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:23.641014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:23.641057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:23.641105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:23.641150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:23.641199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:23.641241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:23.641285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:23.641327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:23.641373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:23.641412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:23.641458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:23.641504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:23.641550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:23.641591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.641639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.641697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.641755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.641794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.641841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.642362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:23.671023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:23.682769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:23.682815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:23.682831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:23.682850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:23.682873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 667 [2:7561401438044834038:7066]
2025-10-15T10:59:23.682928Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:23.682985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:23.682999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:23.683011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:23.683021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:23.683066Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:23.683086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:23.683108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:23.684481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.684504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.684517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.684528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:23.684782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:23.684799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:23.684927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:23.685096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:23.685307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:23.685368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401438044834031:7066]
2025-10-15T10:59:23.685381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401438044834031:7066]
2025-10-15T10:59:23.685393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401438044834031:7066]
2025-10-15T10:59:23.685430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:23.685489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:23.685643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:23.685661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:23.685765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401438044834031:7066]
2025-10-15T10:59:23.685783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:23.686342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:23.686360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:23.686369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:23.686387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:23.687243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401435245141753:7236], now have 1 active actors on pipe
2025-10-15T10:59:23.687273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401435245141642:7842], now have 1 active actors on pipe
2025-10-15T10:59:23.687293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401435245141503:2467], now have 1 active actors on pipe
2025-10-15T10:59:23.687512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 667, pipe: [1:7561401435245141753:7236]
2025-10-15T10:59:23.687600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 667
2025-10-15T10:59:23.687629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 667
2025-10-15T10:59:23.688148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:23.688179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:23.688259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de488eeb-84acea82-ca675ced-c845ffed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:23.688288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:23.688305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:23.688316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:23.688360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:23.688394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:23.688440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:23.689153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:23.689180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:23.689235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:23.689594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 668 partition: 0 MaxSeqNo: 46 sessionId: src_id|de488eeb-84acea82-ca675ced-c845ffed_0
2025-10-15T10:59:23.691936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859423ce-14aa9514-a6007993-61db766_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|de488eeb-84acea82-ca675ced-c845ffed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:23.725533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de488eeb-84acea82-ca675ced-c845ffed_0] Write session: try to update token
2025-10-15T10:59:23.725598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de488eeb-84acea82-ca675ced-c845ffed_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:23.841778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:23.841819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:23.841832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:23.841892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:23.841907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:23.841920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:23.841930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:23.841966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401438044834031:7066]
2025-10-15T10:59:23.841991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401438044834031:7066]
2025-10-15T10:59:23.842014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401438044834031:7066]
2025-10-15T10:59:23.842184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:23.842217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:23.843560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:23.843602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:23.843623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:23.845617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:23.913295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId: src_id|de488eeb-84acea82-ca675ced-c845ffed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:23.934390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:24.000621Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:24.002910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:24.002955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:24.006778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:24.005997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:24.006210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401435245141753:7236]
2025-10-15T10:59:24.006296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:24.006309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:24.029265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 668 reason: error at write: Disconnected sessionId: src_id|de488eeb-84acea82-ca675ced-c845ffed_0
2025-10-15T10:59:24.029534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 668 sessionId: src_id|de488eeb-84acea82-ca675ced-c845ffed_0 is DEAD
2025-10-15T10:59:24.035575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de488eeb-84acea82-ca675ced-c845ffed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:24.035618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de488eeb-84acea82-ca675ced-c845ffed_0] Write session will restart in 0.005448s
2025-10-15T10:59:24.035707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de488eeb-84acea82-ca675ced-c845ffed_0] Write session: Do CDS request
2025-10-15T10:59:24.035737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de488eeb-84acea82-ca675ced-c845ffed_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:24.052247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:24.052583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de488eeb-84acea82-ca675ced-c845ffed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:24.052290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 669
2025-10-15T10:59:24.055890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:24.056043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:24.056059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:24.056071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:24.057271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 669 sessionId:  describe result for acl check
2025-10-15T10:59:24.057378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:24.057388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:24.057397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:24.057413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401439540109086:7850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:24.060162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401439540109086:7850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:24.066356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401439540109086:7850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:24.075444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401439540109086:7850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:24.075486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401439540109086:7850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:24.075503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401439540109086:7850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:24.075537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:24.106111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401439540109234:7236]
2025-10-15T10:59:24.138917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:24.143235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:24.144085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:24.144116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:24.144156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:24.144400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:24.144584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401442339801609:7078]
2025-10-15T10:59:24.146846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:24.147816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:24.148082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:24.149373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:24.149729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:24.149748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:24.149755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:24.149763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:24.149771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:24.149778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:24.149786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:24.149794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:24.149801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:24.149808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:24.149815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:24.149823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.149830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.149837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.149885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:24.149996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:24.150045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:24.150094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:24.150141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:24.150202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:24.150263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:24.150309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:24.150358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:24.150406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:24.150456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:24.150502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.150549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.150598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.150643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:24.150710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:24.150767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:24.150823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:24.150875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:24.150931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:24.150980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:24.151036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:24.151085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:24.151142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:24.151189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:24.151244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:24.151294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:24.151821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:24.151889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:24.151953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:24.152005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:24.152067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:24.152114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:24.152171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:24.152221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:24.152277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:24.152324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.152381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.152432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.152486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.152534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.152589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.153136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:24.172441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:24.180736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:24.180776Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:24.180789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:24.180801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:24.180820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 668 [2:7561401442339801609:7078]
2025-10-15T10:59:24.180871Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:24.180928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:24.180942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:24.180954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:24.180966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:24.181015Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:24.181037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:24.181060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:24.182351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.182371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.182379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.182387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:24.182655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:24.182681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.182814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.182994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.183219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:24.182955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 668, pipe: [1:7561401439540109234:7236]
2025-10-15T10:59:24.183069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 668
2025-10-15T10:59:24.183308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401439540109234:7236], now have 1 active actors on pipe
2025-10-15T10:59:24.183147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 668
2025-10-15T10:59:24.183337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401439540109123:7850], now have 1 active actors on pipe
2025-10-15T10:59:24.183443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401439540109070:2467], now have 1 active actors on pipe
2025-10-15T10:59:24.183470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401442339801604:7078]
2025-10-15T10:59:24.183485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401442339801604:7078]
2025-10-15T10:59:24.183499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401442339801604:7078]
2025-10-15T10:59:24.183537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:24.183614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:24.183625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:24.183637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:24.183649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:24.183793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:24.183819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:24.183996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:24.184018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:24.184063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401442339801604:7078]
2025-10-15T10:59:24.184089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:24.184198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf913a2f-706732fa-20403f26-580881a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:24.184201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:24.184226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:24.184243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:24.184253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:24.184291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:24.184330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:24.184426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:24.185157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:24.185181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:24.185225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:24.185419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 669 partition: 0 MaxSeqNo: 46 sessionId: src_id|cf913a2f-706732fa-20403f26-580881a5_0
2025-10-15T10:59:24.186122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de488eeb-84acea82-ca675ced-c845ffed_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cf913a2f-706732fa-20403f26-580881a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:24.213565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf913a2f-706732fa-20403f26-580881a5_0] Write session: try to update token
2025-10-15T10:59:24.213626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf913a2f-706732fa-20403f26-580881a5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:24.297834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:24.297870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:24.297882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:24.297893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:24.297926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401442339801604:7078]
2025-10-15T10:59:24.297950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401442339801604:7078]
2025-10-15T10:59:24.297973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401442339801604:7078]
2025-10-15T10:59:24.298136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:24.298148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:24.298159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:24.298215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:24.298235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:24.299221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:24.299489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:24.299550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:24.299581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:24.346987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId: src_id|cf913a2f-706732fa-20403f26-580881a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:24.383982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:24.460834Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:24.462368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:24.462408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:24.465290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:24.467491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401439540109234:7236]
2025-10-15T10:59:24.467600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:24.469501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:24.482376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf913a2f-706732fa-20403f26-580881a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:24.482447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf913a2f-706732fa-20403f26-580881a5_0] Write session will restart in 0.007763s
2025-10-15T10:59:24.482649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf913a2f-706732fa-20403f26-580881a5_0] Write session: Do CDS request
2025-10-15T10:59:24.482712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf913a2f-706732fa-20403f26-580881a5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:24.480136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 669 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf913a2f-706732fa-20403f26-580881a5_0
2025-10-15T10:59:24.480497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 669 sessionId: src_id|cf913a2f-706732fa-20403f26-580881a5_0 is DEAD
2025-10-15T10:59:24.508551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf913a2f-706732fa-20403f26-580881a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:24.511844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:24.511888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 670
2025-10-15T10:59:24.512249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:24.512364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:24.512384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:24.512404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:24.514206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 670 sessionId:  describe result for acl check
2025-10-15T10:59:24.514389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:24.514401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:24.514411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:24.514425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401439540109342:7856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:24.516958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401439540109342:7856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:24.525202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401439540109342:7856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:24.542557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401439540109342:7856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:24.542595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401439540109342:7856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:24.542610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401439540109342:7856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:24.542637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:24.567506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401439540109446:7236]
2025-10-15T10:59:24.625936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:24.633177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:24.633785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:24.633796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:24.633829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:24.633976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:24.634081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401442339801877:7085]
2025-10-15T10:59:24.635508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:24.636309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:24.636469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:24.637617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:24.637912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:24.637917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:24.637921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:24.637926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:24.637929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:24.637933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:24.637937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:24.637943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:24.637947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:24.637951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:24.637956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:24.637960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.637965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.637969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.638001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:24.638078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:24.638109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:24.638140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:24.638203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:24.638243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:24.638281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:24.638311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:24.638341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:24.638372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:24.638401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:24.638430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.638465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.638496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.638521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:24.638562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:24.638597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:24.638633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:24.638663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:24.638698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:24.638726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:24.638761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:24.638795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:24.638839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:24.638873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:24.638911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:24.638941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:24.638987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:24.639030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:24.639079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:24.639128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:24.639178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:24.639222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:24.639273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:24.639319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:24.640090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:24.640153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.640209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.640258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.640319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.640363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.640416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.640914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:24.668509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:24.678948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:24.678982Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:24.678994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:24.679006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:24.679022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 669 [2:7561401442339801877:7085]
2025-10-15T10:59:24.679057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:24.679097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:24.679106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:24.679114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:24.679121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:24.679153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:24.679166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:24.679181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:24.680932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.680959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.680972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.680981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:24.681226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:24.681251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:24.681382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:24.681563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:24.681788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:24.681857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401442339801872:7085]
2025-10-15T10:59:24.681877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401442339801872:7085]
2025-10-15T10:59:24.681888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401442339801872:7085]
2025-10-15T10:59:24.681924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:24.681997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:24.682165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:24.682198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:24.682289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:24.682306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401442339801872:7085]
2025-10-15T10:59:24.682320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:24.682322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:24.682330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:24.682351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:24.682367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401439540109395:7856], now have 1 active actors on pipe
2025-10-15T10:59:24.682387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401439540109446:7236], now have 1 active actors on pipe
2025-10-15T10:59:24.682406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401439540109330:2467], now have 1 active actors on pipe
2025-10-15T10:59:24.683576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 669
2025-10-15T10:59:24.683662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 669, pipe: [1:7561401439540109446:7236]
2025-10-15T10:59:24.683736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 669
2025-10-15T10:59:24.683952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:24.683983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:24.684068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81cced89-62de33c2-61040111-78f3aaf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:24.684104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:24.684120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:24.684129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:24.684161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:24.684218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:24.684263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:24.687313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:24.687358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:24.687429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:24.688948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf913a2f-706732fa-20403f26-580881a5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|81cced89-62de33c2-61040111-78f3aaf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:24.687788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 670 partition: 0 MaxSeqNo: 46 sessionId: src_id|81cced89-62de33c2-61040111-78f3aaf3_0
2025-10-15T10:59:24.726602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81cced89-62de33c2-61040111-78f3aaf3_0] Write session: try to update token
2025-10-15T10:59:24.726662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81cced89-62de33c2-61040111-78f3aaf3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:24.850676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:24.850703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:24.850714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:24.850759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:24.850772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:24.850783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:24.850791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:24.850820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401442339801872:7085]
2025-10-15T10:59:24.850842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401442339801872:7085]
2025-10-15T10:59:24.850862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401442339801872:7085]
2025-10-15T10:59:24.850992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:24.851010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:24.851686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:24.851721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:24.851746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:24.852712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:24.859433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId: src_id|81cced89-62de33c2-61040111-78f3aaf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:24.885461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:24.991408Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:25.016916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:25.016951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:25.017004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:25.017015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:25.017044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401442339801872:7085]
2025-10-15T10:59:25.017250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:25.017539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:25.017376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:25.017397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:25.026410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 670 reason: error at write: Disconnected sessionId: src_id|81cced89-62de33c2-61040111-78f3aaf3_0
2025-10-15T10:59:25.026736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 670 sessionId: src_id|81cced89-62de33c2-61040111-78f3aaf3_0 is DEAD
2025-10-15T10:59:25.027753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cced89-62de33c2-61040111-78f3aaf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:25.027802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cced89-62de33c2-61040111-78f3aaf3_0] Write session will restart in 0.007323s
2025-10-15T10:59:25.027957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cced89-62de33c2-61040111-78f3aaf3_0] Write session: Do CDS request
2025-10-15T10:59:25.028001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cced89-62de33c2-61040111-78f3aaf3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:25.034038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401439540109446:7236]
2025-10-15T10:59:25.034209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:25.052318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81cced89-62de33c2-61040111-78f3aaf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:25.055633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:25.055668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 671
2025-10-15T10:59:25.056724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:25.056877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:25.056899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:25.056909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:25.058388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 671 sessionId:  describe result for acl check
2025-10-15T10:59:25.058512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:25.058529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:25.058539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:25.058559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401443835076940:7869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:25.061584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401443835076940:7869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:25.069549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401443835076940:7869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:25.086724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401443835076940:7869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:25.086765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401443835076940:7869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:25.086783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401443835076940:7869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:25.086814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:25.132165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:25.134113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:25.134188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401443835077169:7236]
2025-10-15T10:59:25.134996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:25.135026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:25.135070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:25.135286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:25.135473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401446634769445:7089]
2025-10-15T10:59:25.137443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:25.138439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:25.138674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:25.140087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:25.140424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:25.140434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:25.140441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:25.140447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:25.140454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:25.140463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:25.140469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:25.140476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:25.140485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:25.140491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:25.140499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:25.140505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.140513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.140520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.140573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:25.140698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:25.140747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:25.140800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:25.140849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:25.140901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:25.140948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:25.140995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:25.141040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:25.141090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:25.141138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:25.141183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.141230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.141277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.141323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:25.141395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:25.141455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:25.141511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:25.141563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:25.141616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:25.141663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:25.141719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:25.141768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:25.141838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:25.141884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:25.141948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:25.142002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:25.142068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:25.142114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:25.142191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:25.142246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:25.142308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:25.142365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:25.142423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:25.142477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:25.142543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:25.142599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.142660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.142713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.142771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.142823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.142883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.143456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:25.183683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:25.193292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:25.193352Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:25.193371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:25.193394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:25.193422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 670 [2:7561401446634769445:7089]
2025-10-15T10:59:25.193477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:25.193545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:25.193561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:25.193575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:25.193586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:25.193641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:25.193665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:25.193690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:25.194708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.194736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.194753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.194766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:25.195032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:25.195065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.195227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.195316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 670, pipe: [1:7561401443835077169:7236]
2025-10-15T10:59:25.195397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 670
2025-10-15T10:59:25.195501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.195444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 670
2025-10-15T10:59:25.195756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:25.195851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401443835077169:7236], now have 1 active actors on pipe
2025-10-15T10:59:25.195882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401443835076988:7869], now have 1 active actors on pipe
2025-10-15T10:59:25.195910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401443835076919:2467], now have 1 active actors on pipe
2025-10-15T10:59:25.195967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:25.195994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:25.196049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401446634769439:7089]
2025-10-15T10:59:25.196069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401446634769439:7089]
2025-10-15T10:59:25.196083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401446634769439:7089]
2025-10-15T10:59:25.196121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:25.196155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:25.196174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:25.196186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:25.196203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:25.196398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:25.196422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:25.196492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8eb419d-ada8d62-56884b63-e859ab05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:25.196530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:25.196549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:25.196559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:25.196597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:25.196640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:25.196778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401446634769439:7089]
2025-10-15T10:59:25.196812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:25.196834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:25.196861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:25.197370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:25.197398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:25.197464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:25.197760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 671 partition: 0 MaxSeqNo: 46 sessionId: src_id|c8eb419d-ada8d62-56884b63-e859ab05_0
2025-10-15T10:59:25.198544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81cced89-62de33c2-61040111-78f3aaf3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c8eb419d-ada8d62-56884b63-e859ab05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:25.223394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8eb419d-ada8d62-56884b63-e859ab05_0] Write session: try to update token
2025-10-15T10:59:25.223480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8eb419d-ada8d62-56884b63-e859ab05_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:25.226038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:25.226081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:25.226124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401446634769439:7089]
2025-10-15T10:59:25.226272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:25.226276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:25.228270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:25.229610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:25.230962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:25.232222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:25.233892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:25.234374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:25.310347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId: src_id|c8eb419d-ada8d62-56884b63-e859ab05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:25.327334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:25.327387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:25.327401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:25.327460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:25.327476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:25.327489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:25.327500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:25.327541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401446634769439:7089]
2025-10-15T10:59:25.327569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401446634769439:7089]
2025-10-15T10:59:25.327593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401446634769439:7089]
2025-10-15T10:59:25.327748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:25.327778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:25.328824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:25.329215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:25.329236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:25.329255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:25.336065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:25.473906Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:25.475122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:25.475152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:25.475966Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:25.476091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:25.476271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401443835077169:7236]
2025-10-15T10:59:25.476355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:25.476373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:25.516296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 671 reason: error at write: Disconnected sessionId: src_id|c8eb419d-ada8d62-56884b63-e859ab05_0
2025-10-15T10:59:25.516645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 671 sessionId: src_id|c8eb419d-ada8d62-56884b63-e859ab05_0 is DEAD
2025-10-15T10:59:25.517018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8eb419d-ada8d62-56884b63-e859ab05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:25.517056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8eb419d-ada8d62-56884b63-e859ab05_0] Write session will restart in 0.008221s
2025-10-15T10:59:25.517176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8eb419d-ada8d62-56884b63-e859ab05_0] Write session: Do CDS request
2025-10-15T10:59:25.517208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8eb419d-ada8d62-56884b63-e859ab05_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:25.532536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8eb419d-ada8d62-56884b63-e859ab05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:25.534637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:25.534660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 672
2025-10-15T10:59:25.535039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:25.535211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:25.535241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:25.535253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:25.537766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 672 sessionId:  describe result for acl check
2025-10-15T10:59:25.537945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:25.537965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:25.537983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:25.538008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401443835077241:7875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:25.542584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401443835077241:7875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:25.559984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401443835077241:7875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:25.574398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401443835077241:7875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:25.574440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401443835077241:7875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:25.574457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401443835077241:7875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:25.574487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:25.576517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401443835077427:7236]
2025-10-15T10:59:25.598952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:25.607419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:25.608346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:25.608382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:25.608431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:25.608713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:25.608918Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401446634769708:7093]
2025-10-15T10:59:25.611187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:25.612558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:25.612793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:25.614115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:25.614486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:25.614496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:25.614503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:25.614510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:25.614518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:25.614525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:25.614534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:25.614541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:25.614550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:25.614557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:25.614564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:25.614571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.614579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.614586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.614639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:25.614758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:25.614809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:25.614860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:25.614906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:25.614954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:25.615004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:25.615055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:25.615104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:25.615154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:25.615204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:25.615251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.615301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.615970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.616033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:25.616106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:25.616165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:25.616220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:25.616270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:25.616326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:25.616371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:25.616423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:25.616473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:25.616528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:25.616574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:25.616625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:25.616675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:25.616730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:25.616775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:25.616828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:25.616874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:25.616927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:25.616972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:25.617028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:25.617073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:25.617125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:25.617173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.617228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.617276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.617327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.617369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.617423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.617931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:25.640618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:25.650477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:25.650522Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:25.650539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:25.650556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:25.650580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 671 [2:7561401446634769708:7093]
2025-10-15T10:59:25.650634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:25.650691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:25.650706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:25.650720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:25.650732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:25.650783Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:25.650805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:25.650826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:25.652615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.652644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.652659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.652670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:25.652921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:25.652951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:25.653579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 671
2025-10-15T10:59:25.653681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 671, pipe: [1:7561401443835077427:7236]
2025-10-15T10:59:25.653752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 671
2025-10-15T10:59:25.653087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:25.653284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:25.653508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:25.653585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401443835077183:2467], now have 1 active actors on pipe
2025-10-15T10:59:25.653607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401443835077427:7236], now have 1 active actors on pipe
2025-10-15T10:59:25.653628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401443835077413:7875], now have 1 active actors on pipe
2025-10-15T10:59:25.653651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401446634769702:7093]
2025-10-15T10:59:25.653667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401446634769702:7093]
2025-10-15T10:59:25.653682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401446634769702:7093]
2025-10-15T10:59:25.653717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:25.653772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:25.653788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:25.653790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:25.653800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:25.653965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:25.653982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:25.654128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:25.654147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:25.654203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401446634769702:7093]
2025-10-15T10:59:25.654230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:25.654278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:25.654347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:25.654377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:25.654396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:25.654407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:25.654445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:25.654486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:25.654563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:25.657044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:25.657079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:25.657154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:25.658908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 672 partition: 0 MaxSeqNo: 46 sessionId: src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0
2025-10-15T10:59:25.661852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8eb419d-ada8d62-56884b63-e859ab05_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:25.690863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0] Write session: try to update token
2025-10-15T10:59:25.690921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:25.753112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:25.753151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:25.753165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:25.753174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:25.753207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401446634769702:7093]
2025-10-15T10:59:25.753231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401446634769702:7093]
2025-10-15T10:59:25.753251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401446634769702:7093]
2025-10-15T10:59:25.753420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:25.753455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:25.753471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:25.753483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:25.753484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:25.753494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:25.753541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:25.753561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:25.766410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:25.778578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId: src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:25.817427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:25.943178Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:25.964321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:25.964366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:25.964435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:25.964449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:25.964490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401446634769702:7093]
2025-10-15T10:59:25.964803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:25.965297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:25.965066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:25.965449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:25.965462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:25.965462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401443835077427:7236]
2025-10-15T10:59:25.975573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 672 reason: error at write: Disconnected sessionId: src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0
2025-10-15T10:59:25.975947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 672 sessionId: src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0 is DEAD
2025-10-15T10:59:25.977559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:25.977615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0] Write session will restart in 0.007440s
2025-10-15T10:59:25.977808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0] Write session: Do CDS request
2025-10-15T10:59:25.977838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:25.990527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:25.990556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 673
2025-10-15T10:59:25.991131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:25.991757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:25.992072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:25.992120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:25.992142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:25.994220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 673 sessionId:  describe result for acl check
2025-10-15T10:59:25.994329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:25.994346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:25.994356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:25.994371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401443835077474:7881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:25.997084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401443835077474:7881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:26.005429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401443835077474:7881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:26.016048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401443835077474:7881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:26.016088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401443835077474:7881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:26.016107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401443835077474:7881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:26.016141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:26.060477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:26.064379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:26.065258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:26.065297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:26.065341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:26.065540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401448130045001:7236]
2025-10-15T10:59:26.065614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:26.065814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401450929737289:7105]
2025-10-15T10:59:26.068406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:26.069482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:26.069721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:26.071138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:26.071526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.071545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.071553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.071561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.071568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.071577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.071584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.071591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.071599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.071607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.071614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.071621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.071628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.071636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.071688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.071806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.071859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.071910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.071958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.072021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.072081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.072138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.072192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.072249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.072303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.072354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.072411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.072469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.072524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.072596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.072668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.072728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.072782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.072849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.072896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.072956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.073014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.073074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.073126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.073181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.073235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.073294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.073349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.073401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.073460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.073517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.073573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.073635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.073690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.073749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.073800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.073857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.073905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.073959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.074007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.074061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.074601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:26.090959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:26.121854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:26.121902Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:26.121917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:26.121935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:26.121961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 672 [2:7561401450929737289:7105]
2025-10-15T10:59:26.122013Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:26.122070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:26.122085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:26.122099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:26.122111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:26.122161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:26.122185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:26.122224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:26.123930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.123961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.123976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.123987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:26.124258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:26.124286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.124430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.124624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.124866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:26.124966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401448130045001:7236], now have 1 active actors on pipe
2025-10-15T10:59:26.124998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401448130044808:7881], now have 1 active actors on pipe
2025-10-15T10:59:26.125024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401450929737284:7105]
2025-10-15T10:59:26.125046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401450929737284:7105]
2025-10-15T10:59:26.125060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401450929737284:7105]
2025-10-15T10:59:26.125100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:26.125166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:26.125171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401443835077460:2467], now have 1 active actors on pipe
2025-10-15T10:59:26.125191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:26.125204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:26.125205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:26.125104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 672
2025-10-15T10:59:26.125194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 672, pipe: [1:7561401448130045001:7236]
2025-10-15T10:59:26.125273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 672
2025-10-15T10:59:26.125388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:26.125411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:26.125577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:26.125607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:26.125640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401450929737284:7105]
2025-10-15T10:59:26.125667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:26.125694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:26.125785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52468f6e-26f58bf7-af67901a-1a41383e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:26.125824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:26.125843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:26.125855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:26.125890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:26.125938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:26.126031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:26.127095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:26.127128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:26.127215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:26.127554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 673 partition: 0 MaxSeqNo: 46 sessionId: src_id|52468f6e-26f58bf7-af67901a-1a41383e_0
2025-10-15T10:59:26.128528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a16bbde-f6d5ad93-ccb8ab21-7b036d69_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|52468f6e-26f58bf7-af67901a-1a41383e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:26.154295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52468f6e-26f58bf7-af67901a-1a41383e_0] Write session: try to update token
2025-10-15T10:59:26.154352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52468f6e-26f58bf7-af67901a-1a41383e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:26.235334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:26.236180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:26.236201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:26.236212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:26.236250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401450929737284:7105]
2025-10-15T10:59:26.236288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401450929737284:7105]
2025-10-15T10:59:26.236311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401450929737284:7105]
2025-10-15T10:59:26.236482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:26.236492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:26.236503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:26.236799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:26.236850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:26.236878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:26.247933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:26.247977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:26.249800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:26.256825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId: src_id|52468f6e-26f58bf7-af67901a-1a41383e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:26.277575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:26.396075Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:26.397982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:26.398015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:26.398064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401450929737284:7105]
2025-10-15T10:59:26.398235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:26.398269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:26.398450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:26.399974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:26.400130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401448130045001:7236]
2025-10-15T10:59:26.400219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:26.400230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:26.404018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:26.456005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 673 reason: error at write: Disconnected sessionId: src_id|52468f6e-26f58bf7-af67901a-1a41383e_0
2025-10-15T10:59:26.456387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 673 sessionId: src_id|52468f6e-26f58bf7-af67901a-1a41383e_0 is DEAD
2025-10-15T10:59:26.459581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52468f6e-26f58bf7-af67901a-1a41383e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:26.459641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52468f6e-26f58bf7-af67901a-1a41383e_0] Write session will restart in 0.007360s
2025-10-15T10:59:26.459789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52468f6e-26f58bf7-af67901a-1a41383e_0] Write session: Do CDS request
2025-10-15T10:59:26.459834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52468f6e-26f58bf7-af67901a-1a41383e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:26.473986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52468f6e-26f58bf7-af67901a-1a41383e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:26.479046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:26.479075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 674
2025-10-15T10:59:26.481501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:26.481656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:26.481671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:26.481681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:26.483172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 674 sessionId:  describe result for acl check
2025-10-15T10:59:26.483282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:26.483301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:26.483309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:26.483327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401448130045089:7891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:26.486029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401448130045089:7891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:26.493291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401448130045089:7891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:26.498960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401448130045185:7236]
2025-10-15T10:59:26.503518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401448130045089:7891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:26.503556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401448130045089:7891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:26.503585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401448130045089:7891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:26.503617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:26.526597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:26.532855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:26.533794Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:26.533826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:26.533869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:26.534155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:26.534382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401450929737542:7110]
2025-10-15T10:59:26.536585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:26.538102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:26.538390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:26.539824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:26.540149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.540159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.540166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.540174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.540181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.540188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.540195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.540203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.540210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.540216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.540223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.540229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.540235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.540244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.540293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.540398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.540442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.540484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.540529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.540576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.540617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.540662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.540706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.540748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.540790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.540833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.540876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.540918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.540975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.541040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.541094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.541145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.541189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.541241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.541285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.541335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.541379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.541428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.541468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.541517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.541561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.541612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.541654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.541704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.541749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.541799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.541841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.541892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.541935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.541985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.542028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.542076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.542118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.542165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.542220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.542272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.542745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:26.572852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:26.582699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:26.582760Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:26.582780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:26.582802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:26.582830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 673 [2:7561401450929737542:7110]
2025-10-15T10:59:26.582887Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:26.582953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:26.582970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:26.582984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:26.582997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:26.583052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:26.583078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:26.583101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:26.584103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.584129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.584144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.584157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:26.584428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:26.584452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.584603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.584815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.585074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:26.585152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401450929737537:7110]
2025-10-15T10:59:26.585175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401450929737537:7110]
2025-10-15T10:59:26.585189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401450929737537:7110]
2025-10-15T10:59:26.585228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:26.585305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:26.585511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:26.585536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:26.585609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:26.585631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:26.585643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:26.585681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401448130045185:7236], now have 1 active actors on pipe
2025-10-15T10:59:26.585707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401450929737537:7110]
2025-10-15T10:59:26.585726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:26.585732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:26.585763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401448130045227:7891], now have 1 active actors on pipe
2025-10-15T10:59:26.585787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401448130045031:2467], now have 1 active actors on pipe
2025-10-15T10:59:26.585790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 673, pipe: [1:7561401448130045185:7236]
2025-10-15T10:59:26.585835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 673
2025-10-15T10:59:26.585898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 673
2025-10-15T10:59:26.586085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:26.586124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:26.586214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:26.586256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:26.586277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:26.586290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:26.586328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:26.586376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:26.586428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:26.586885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:26.586921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:26.587000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:26.587413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 674 partition: 0 MaxSeqNo: 46 sessionId: src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0
2025-10-15T10:59:26.588252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52468f6e-26f58bf7-af67901a-1a41383e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:26.607397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0] Write session: try to update token
2025-10-15T10:59:26.607465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:26.615085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:26.615124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:26.615167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401450929737537:7110]
2025-10-15T10:59:26.615310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:26.615457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:26.617618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:26.619065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:26.620833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:26.622222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:26.624044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
E1015 10:59:26.634225314  821070 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:59:26.637221Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:59:26.654106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:26.679451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:26.679491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:26.679505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:26.679516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:26.679561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401450929737537:7110]
2025-10-15T10:59:26.679587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401450929737537:7110]
2025-10-15T10:59:26.679612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401450929737537:7110]
2025-10-15T10:59:26.679750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:26.679779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:26.679785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:26.679804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:26.679813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:26.682498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:26.701120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId: src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:26.734005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:26.834073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401448130045185:7236]
2025-10-15T10:59:26.834084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:26.834101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:26.834173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:26.829986Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:26.832302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:26.832334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:26.833031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:26.862290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 674 reason: error at write: Disconnected sessionId: src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0
2025-10-15T10:59:26.863047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:26.863107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0] Write session will restart in 0.007282s
2025-10-15T10:59:26.863279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0] Write session: Do CDS request
2025-10-15T10:59:26.863331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:26.862666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 674 sessionId: src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0 is DEAD
2025-10-15T10:59:26.875613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:26.875645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 675
2025-10-15T10:59:26.875763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:26.876268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:26.876416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:26.876436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:26.876453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:26.878021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 675 sessionId:  describe result for acl check
2025-10-15T10:59:26.878136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:26.878151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:26.878160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:26.878177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401448130045343:7900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:26.881163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401448130045343:7900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:26.890590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401448130045343:7900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:26.900271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401448130045343:7900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:26.900309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401448130045343:7900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:26.900326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401448130045343:7900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:26.900356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:26.924898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:26.926881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:26.927608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:26.927633Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:26.927669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:26.927883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:26.928027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401450929737803:7114]
2025-10-15T10:59:26.929716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:26.930589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:26.930789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:26.932000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:26.932290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.932305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.932309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.932313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.932317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.932322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.932326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.932330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.932334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.932338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.932343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.932346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.932351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.932354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.932387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.932464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.932497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.932528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.932558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.932591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.932620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.932650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.932679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.932708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.932739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.932774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.932810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.932840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.932866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.932913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:26.932956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.933000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:26.933034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.933072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:26.933105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.933141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:26.933172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.933215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:26.933245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.933283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:26.933312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.933346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:26.933374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.933413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:26.933444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.933479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:26.933512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.933552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:26.933585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.933626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:26.933676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.933715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:26.933749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.933786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:26.933830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.933869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:26.934235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:26.933898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401448130045568:7236]
2025-10-15T10:59:26.955801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:26.965585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:26.965638Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:26.965656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:26.965678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:26.965706Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 674 [2:7561401450929737803:7114]
2025-10-15T10:59:26.965761Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:26.965830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:26.965853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:26.965867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:26.965880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:26.965935Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:26.965966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:26.965993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:27.006655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.006687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.006698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.006709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:27.006978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:27.007005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.007133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.007296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.007293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 674
2025-10-15T10:59:27.007321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 674
2025-10-15T10:59:27.007385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 674, pipe: [1:7561401448130045568:7236]
2025-10-15T10:59:27.007639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:27.007725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401448130045478:7900], now have 1 active actors on pipe
2025-10-15T10:59:27.007747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401448130045317:2467], now have 1 active actors on pipe
2025-10-15T10:59:27.007766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401448130045568:7236], now have 1 active actors on pipe
2025-10-15T10:59:27.007811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:27.007831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:27.007885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401450929737798:7114]
2025-10-15T10:59:27.007899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401450929737798:7114]
2025-10-15T10:59:27.007911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401450929737798:7114]
2025-10-15T10:59:27.007949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:27.007988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:27.008002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:27.008015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:27.008021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:27.008196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:27.008210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:27.008270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:27.008299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:27.008315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:27.008324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:27.008358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:27.008403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:27.008529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401450929737798:7114]
2025-10-15T10:59:27.008559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:27.008573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:27.008602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:27.009307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:27.009336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:27.009399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:27.009669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 675 partition: 0 MaxSeqNo: 46 sessionId: src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0
2025-10-15T10:59:27.011909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3e18b2a-a20424f4-dd5b1db7-2f64a382_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:27.038911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:27.038955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:27.038988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401450929737798:7114]
2025-10-15T10:59:27.039100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:27.039162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:27.041135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:27.042492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:27.043406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0] Write session: try to update token
2025-10-15T10:59:27.043458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:27.043928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:27.045258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:27.047113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:27.047648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:27.104523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:27.104549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:27.104557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:27.104595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:27.104604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:27.104612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:27.104618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:27.104643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401450929737798:7114]
2025-10-15T10:59:27.104666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401450929737798:7114]
2025-10-15T10:59:27.104684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401450929737798:7114]
2025-10-15T10:59:27.104802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:27.104837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:27.104839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:27.104855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:27.104855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:27.106757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:27.128475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId: src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:27.148869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:27.246877Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:27.248738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:27.248784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:27.249429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:27.249492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:27.249430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:27.249457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:27.249599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401448130045568:7236]
2025-10-15T10:59:27.273051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 675 reason: error at write: Disconnected sessionId: src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0
2025-10-15T10:59:27.273371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 675 sessionId: src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0 is DEAD
2025-10-15T10:59:27.273773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:27.273834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0] Write session will restart in 0.007831s
2025-10-15T10:59:27.273981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0] Write session: Do CDS request
2025-10-15T10:59:27.274024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:27.289541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:27.295478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:27.295506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 676
2025-10-15T10:59:27.295845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:27.295956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:27.295971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:27.295991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:27.297448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 676 sessionId:  describe result for acl check
2025-10-15T10:59:27.297554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:27.297564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:27.297574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:27.297591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401452425012897:7904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:27.299953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401452425012897:7904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:27.307166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401452425012897:7904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:27.314381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401452425012897:7904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:27.314415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401452425012897:7904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:27.314430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401452425012897:7904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:27.314455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:27.349615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401452425013116:7236]
2025-10-15T10:59:27.373003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:27.380894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:27.381818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:27.381839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:27.381884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:27.382156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:27.382366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401455224705383:7124]
2025-10-15T10:59:27.385032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:27.386524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:27.386763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:27.388203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:27.388588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:27.388598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:27.388605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:27.388614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:27.388622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:27.388628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:27.388636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:27.388643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:27.388650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:27.388657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:27.388664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:27.388671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.388678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.388685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.388736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:27.388853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:27.388907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:27.388959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:27.389010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:27.389063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:27.389110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:27.389161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:27.389211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:27.389260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:27.389304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:27.389349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.389394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.389440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.389488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:27.389560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:27.389623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:27.389680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:27.389730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:27.389785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:27.389830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:27.389882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:27.389954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:27.390012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:27.390059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:27.390114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:27.390163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:27.390229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:27.390274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:27.390328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:27.390378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:27.390435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:27.390478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:27.390532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:27.390578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:27.390634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:27.390678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.390733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.390780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.390832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.390878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.390932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.391501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:27.411833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:27.422754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:27.422803Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:27.422823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:27.422843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:27.422869Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 675 [2:7561401455224705383:7124]
2025-10-15T10:59:27.422925Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:27.422988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:27.423004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:27.423017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:27.423029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:27.423080Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:27.423105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:27.423130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:27.425242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.425268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.425277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.425284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:27.425484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:27.425502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.425630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.425789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.425751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 675
2025-10-15T10:59:27.425807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 675, pipe: [1:7561401452425013116:7236]
2025-10-15T10:59:27.425868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 675
2025-10-15T10:59:27.425964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:27.426018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401452425012880:2467], now have 1 active actors on pipe
2025-10-15T10:59:27.426045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401452425013116:7236], now have 1 active actors on pipe
2025-10-15T10:59:27.426067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401452425012963:7904], now have 1 active actors on pipe
2025-10-15T10:59:27.426106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401455224705378:7124]
2025-10-15T10:59:27.426125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401455224705378:7124]
2025-10-15T10:59:27.426138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401455224705378:7124]
2025-10-15T10:59:27.426181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:27.426209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:27.426233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:27.426245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:27.426278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:27.426298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:27.426341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:27.426515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:27.426541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:27.426697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:27.426733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:27.426751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:27.426761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:27.426793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:27.426828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:27.426863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401455224705378:7124]
2025-10-15T10:59:27.426905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:27.426936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:27.426991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:27.427696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:27.427728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:27.427786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:27.428048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 676 partition: 0 MaxSeqNo: 46 sessionId: src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0
2025-10-15T10:59:27.428849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a239b2-fa1ea42c-ff5dc0a1-86135c89_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:27.450542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0] Write session: try to update token
2025-10-15T10:59:27.450598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:27.498859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:27.498909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:27.498963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401455224705378:7124]
2025-10-15T10:59:27.499132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:27.499136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:27.509316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:27.512256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:27.513745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:27.515091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:27.516997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:27.517656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:27.544452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:27.544512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:27.544525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:27.544584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:27.544610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:27.544623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:27.544634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:27.544685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401455224705378:7124]
2025-10-15T10:59:27.544713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401455224705378:7124]
2025-10-15T10:59:27.544735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401455224705378:7124]
2025-10-15T10:59:27.544865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:27.544881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:27.544901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:27.544901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:27.544940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:27.547228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:27.559574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId: src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:27.584182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:27.682602Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:27.684534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:27.684585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:27.685373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:27.685167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401452425013116:7236]
2025-10-15T10:59:27.685288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:27.685302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:27.739601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 676 reason: error at write: Disconnected sessionId: src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0
2025-10-15T10:59:27.739964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 676 sessionId: src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0 is DEAD
2025-10-15T10:59:27.744164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:27.744203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0] Write session will restart in 0.008777s
2025-10-15T10:59:27.744315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0] Write session: Do CDS request
2025-10-15T10:59:27.744348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:27.758191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:27.760554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:27.760696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:27.760713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 677
2025-10-15T10:59:27.762723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:27.762830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:27.762841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:27.762848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:27.764494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 677 sessionId:  describe result for acl check
2025-10-15T10:59:27.764609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:27.764621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:27.764630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:27.764645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401452425013319:7916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:27.766876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401452425013319:7916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:27.775999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401452425013319:7916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:27.783260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401452425013319:7916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:27.783302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401452425013319:7916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:27.783318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401452425013319:7916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:27.783364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:27.785294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401452425013416:7236]
2025-10-15T10:59:27.791875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:27.793790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:27.794554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:27.794580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:27.794617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:27.794850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:27.795028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401455224705656:7131]
2025-10-15T10:59:27.797290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:27.798399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:27.798614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:27.799774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:27.800088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:27.800106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:27.800113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:27.800119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:27.800125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:27.800131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:27.800138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:27.800144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:27.800151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:27.800157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:27.800164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:27.800171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.800178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.800185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.800228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:27.800328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:27.800374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:27.800415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:27.800456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:27.800507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:27.800554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:27.800601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:27.800647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:27.800694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:27.800744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:27.800788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.800832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.800878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.800919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:27.800983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:27.801045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:27.801101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:27.801151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:27.801221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:27.801269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:27.801326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:27.801377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:27.801431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:27.801478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:27.801534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:27.801584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:27.801639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:27.801687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:27.801741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:27.801790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:27.801842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:27.801886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:27.801940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:27.801987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:27.802042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:27.802085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.802141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.802185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.802245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.802288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.802337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.802804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:27.821288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:27.831167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:27.831206Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:27.831220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:27.831236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:27.831259Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 676 [2:7561401455224705656:7131]
2025-10-15T10:59:27.831302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:27.831366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:27.831377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:27.831387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:27.831396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:27.831438Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:27.831458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:27.831477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:27.833121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.833145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.833158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.833169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:27.833436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:27.833460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:27.833604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:27.833778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:27.833995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:27.834056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401452425013291:2467], now have 1 active actors on pipe
2025-10-15T10:59:27.833829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 676
2025-10-15T10:59:27.834074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401452425013414:7916], now have 1 active actors on pipe
2025-10-15T10:59:27.833961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 676
2025-10-15T10:59:27.834091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401452425013416:7236], now have 1 active actors on pipe
2025-10-15T10:59:27.834026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 676, pipe: [1:7561401452425013416:7236]
2025-10-15T10:59:27.834107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401455224705651:7131]
2025-10-15T10:59:27.834120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401455224705651:7131]
2025-10-15T10:59:27.834132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401455224705651:7131]
2025-10-15T10:59:27.834169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:27.834233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:27.834295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:27.834323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:27.834336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:27.834364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:27.834375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:27.834485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:27.834512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:27.834543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401455224705651:7131]
2025-10-15T10:59:27.834561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:27.834585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:27.834631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:27.834658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:27.834673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:27.834683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:27.834706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:27.834733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:27.834799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:27.837684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:27.837716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:27.837781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:27.838947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ff91afe-daab7e31-b3c03bc8-b5a5a7cc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:27.838137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 677 partition: 0 MaxSeqNo: 46 sessionId: src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0
2025-10-15T10:59:27.859566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0] Write session: try to update token
2025-10-15T10:59:27.859618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:27.933818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:27.933859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:27.933873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:27.933886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:27.933924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401455224705651:7131]
2025-10-15T10:59:27.933956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401455224705651:7131]
2025-10-15T10:59:27.933982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401455224705651:7131]
2025-10-15T10:59:27.934125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:27.934158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:27.934169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:27.934179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:27.934191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:27.934211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:27.954198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:27.954259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:27.960141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:27.977401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId: src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:27.999110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:28.110307Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:28.111981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:28.112014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:28.112065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401455224705651:7131]
2025-10-15T10:59:28.112266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:28.112300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:28.112481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:28.113024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401452425013416:7236]
2025-10-15T10:59:28.113146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:28.113144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:28.113297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:28.113318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:28.153938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 677 reason: error at write: Disconnected sessionId: src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0
2025-10-15T10:59:28.154255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 677 sessionId: src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0 is DEAD
2025-10-15T10:59:28.155619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:28.155681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0] Write session will restart in 0.005801s
2025-10-15T10:59:28.155857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0] Write session: Do CDS request
2025-10-15T10:59:28.155919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:28.176876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:28.180815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:28.180844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 678
2025-10-15T10:59:28.181172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:28.181313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:28.181330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:28.181339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:28.182842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 678 sessionId:  describe result for acl check
2025-10-15T10:59:28.182961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:28.182976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:28.182987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:28.183005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401456719980814:7923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:28.185830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401456719980814:7923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:28.196102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401456719980814:7923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:28.207316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401456719980814:7923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:28.207373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401456719980814:7923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:28.207391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401456719980814:7923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:28.207439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:28.212840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401456719980994:7236]
2025-10-15T10:59:28.227003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:28.232932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:28.233690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:28.233717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:28.233757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:28.234030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:28.234253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401459519673231:7137]
2025-10-15T10:59:28.236481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:28.237761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:28.238005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:28.239305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:28.239691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:28.239701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:28.239709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:28.239715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:28.239722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:28.239730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:28.239737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:28.239744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:28.239752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:28.239760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:28.239767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:28.239775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.239783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.239790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.239842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:28.239966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:28.240019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:28.240070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:28.240118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:28.240169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:28.240219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:28.240267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:28.240328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:28.240385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:28.240438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:28.240492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.240544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.240593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.240647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:28.240949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:28.241022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:28.241088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:28.241145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:28.241210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:28.241260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:28.241319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:28.241385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:28.241444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:28.241499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:28.241560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:28.241616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:28.241674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:28.241731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:28.241790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:28.241863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:28.241924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:28.241977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:28.242039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:28.242090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:28.242151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:28.242204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.242276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.242328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.242384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.242435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.242496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.242918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:28.262987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:28.272367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:28.272410Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:28.272424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:28.272440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:28.272462Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 677 [2:7561401459519673231:7137]
2025-10-15T10:59:28.272515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:28.272573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:28.272586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:28.272598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:28.272609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:28.272664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:28.272684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:28.272703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:28.289613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.289642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.289653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.289664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:28.289931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:28.289958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.290090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.290201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 677, pipe: [1:7561401456719980994:7236]
2025-10-15T10:59:28.290265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 677
2025-10-15T10:59:28.290322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 677
2025-10-15T10:59:28.290274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.290490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:28.290582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401456719980994:7236], now have 1 active actors on pipe
2025-10-15T10:59:28.290609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401456719980743:2467], now have 1 active actors on pipe
2025-10-15T10:59:28.290629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401456719980978:7923], now have 1 active actors on pipe
2025-10-15T10:59:28.290690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:28.290717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:28.290753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401459519673226:7137]
2025-10-15T10:59:28.290771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401459519673226:7137]
2025-10-15T10:59:28.290784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401459519673226:7137]
2025-10-15T10:59:28.290819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:28.290860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:28.290883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:28.290891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:28.290894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:28.291070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:28.291097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:28.291167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:28.291203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:28.291224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:28.291235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:28.291270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:28.291320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:28.291465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401459519673226:7137]
2025-10-15T10:59:28.291495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:28.291539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:28.291547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:28.292032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:28.292060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:28.292122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:28.292355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 678 partition: 0 MaxSeqNo: 46 sessionId: src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0
2025-10-15T10:59:28.293115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78bd7b0-d2eb5a5a-5df6a658-7e7b4658_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:28.328331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0] Write session: try to update token
2025-10-15T10:59:28.328422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:28.329107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:28.329140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:28.329167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401459519673226:7137]
2025-10-15T10:59:28.329264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:28.329320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:28.330919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:28.332014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:28.333132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:28.334257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:28.335877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:28.336278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:28.402777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:28.402817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:28.402834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:28.402847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:28.402890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401459519673226:7137]
2025-10-15T10:59:28.402917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401459519673226:7137]
2025-10-15T10:59:28.402942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401459519673226:7137]
2025-10-15T10:59:28.403116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:28.403117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:28.403129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:28.403142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:28.403174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:28.403191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:28.403207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:28.403214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:28.413445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId: src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:28.413887Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:28.442075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:28.557374Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:28.559565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:28.559603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:28.561376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:28.561401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:28.561533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401456719980994:7236]
2025-10-15T10:59:28.561648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:28.562394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:28.617662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 678 reason: error at write: Disconnected sessionId: src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0
2025-10-15T10:59:28.618060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 678 sessionId: src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0 is DEAD
2025-10-15T10:59:28.619671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:28.619720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0] Write session will restart in 0.007466s
2025-10-15T10:59:28.619867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0] Write session: Do CDS request
2025-10-15T10:59:28.619923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:28.636426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:28.636455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 679
2025-10-15T10:59:28.640127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:28.640727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:28.640887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:28.640907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:28.640917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:28.642257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 679 sessionId:  describe result for acl check
2025-10-15T10:59:28.642363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:28.642379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:28.642387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:28.642405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401456719981102:7929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:28.645142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401456719981102:7929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:28.659227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401456719981102:7929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:28.659875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401456719981198:7236]
2025-10-15T10:59:28.672381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401456719981102:7929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:28.672423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401456719981102:7929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:28.672441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401456719981102:7929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:28.672478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:28.679756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:28.685518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:28.686395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:28.686427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:28.686475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:28.686748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:28.686958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401459519673503:7145]
2025-10-15T10:59:28.688926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:28.689840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:28.690083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:28.691392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:28.691771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:28.691790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:28.691799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:28.691807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:28.691815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:28.691822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:28.691829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:28.691836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:28.691843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:28.691849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:28.691857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:28.691864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.691871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.691878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.691928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:28.692043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:28.692094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:28.692151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:28.692203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:28.692261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:28.692311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:28.692360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:28.692420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:28.692469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:28.692515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:28.692562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.692609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.692655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.692697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:28.692767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:28.692831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:28.692890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:28.692941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:28.692995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:28.693041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:28.693100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:28.693148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:28.693208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:28.693255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:28.693314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:28.693363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:28.693417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:28.693462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:28.693521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:28.693571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:28.693627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:28.693676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:28.693732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:28.693782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:28.693836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:28.693884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.693938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.693985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.694040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.694089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.694144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.694678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:28.714576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:28.733085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 678
2025-10-15T10:59:28.733168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 678, pipe: [1:7561401456719981198:7236]
2025-10-15T10:59:28.733253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 678
2025-10-15T10:59:28.729640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:28.729688Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:28.729706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:28.729727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:28.729754Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 678 [2:7561401459519673503:7145]
2025-10-15T10:59:28.729811Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:28.729881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:28.729900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:28.729913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:28.729925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:28.729979Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:28.730005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:28.730028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:28.732355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.732391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.732421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.732435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:28.732722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:28.732734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:28.732850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:28.733046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:28.733274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:28.733359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401456719981273:7929], now have 1 active actors on pipe
2025-10-15T10:59:28.733382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401456719981198:7236], now have 1 active actors on pipe
2025-10-15T10:59:28.733404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401456719981011:2467], now have 1 active actors on pipe
2025-10-15T10:59:28.733431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401459519673498:7145]
2025-10-15T10:59:28.733446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401459519673498:7145]
2025-10-15T10:59:28.733459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401459519673498:7145]
2025-10-15T10:59:28.733499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:28.733532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:28.733548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:28.733565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:28.733576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:28.733778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:28.733796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:28.733870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:28.733891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:28.734014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401459519673498:7145]
2025-10-15T10:59:28.734039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:28.734060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:28.734110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:28.734134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:28.734146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:28.734153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:28.734178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:28.734210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:28.734344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:28.735154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:28.735175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:28.735249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:28.735582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 679 partition: 0 MaxSeqNo: 46 sessionId: src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0
2025-10-15T10:59:28.739904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601fc855-76a58d8b-95b568fd-2b0cdc59_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:28.787565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0] Write session: try to update token
2025-10-15T10:59:28.787624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:28.859917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:28.859957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:28.859973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:28.859985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:28.860021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401459519673498:7145]
2025-10-15T10:59:28.860050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401459519673498:7145]
2025-10-15T10:59:28.860076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401459519673498:7145]
2025-10-15T10:59:28.860298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:28.860309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:28.860323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:28.860335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:28.860348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:28.860377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:28.860383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:28.860406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:28.861452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:28.893276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId: src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:28.912835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:29.009078Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:29.020470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:29.020533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:29.020614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:29.020629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:29.020675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401459519673498:7145]
2025-10-15T10:59:29.021497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:29.023765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:29.023818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:29.022227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:29.065821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:29.065980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 679 reason: error at write: Disconnected sessionId: src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0
2025-10-15T10:59:29.066347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 679 sessionId: src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0 is DEAD
2025-10-15T10:59:29.067919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:29.067953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0] Write session will restart in 0.005614s
2025-10-15T10:59:29.068049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0] Write session: Do CDS request
2025-10-15T10:59:29.068079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:29.068020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401456719981198:7236]
2025-10-15T10:59:29.080174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:29.093202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:29.093235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 680
2025-10-15T10:59:29.093673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:29.093793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:29.093812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:29.093822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:29.095280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 680 sessionId:  describe result for acl check
2025-10-15T10:59:29.095412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:29.095423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:29.095433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:29.095452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401461014948631:7939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:29.098223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401461014948631:7939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:29.112410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401461014948631:7939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:29.126027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401461014948631:7939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:29.126072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401461014948631:7939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:29.126089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401461014948631:7939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:29.126122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:29.162021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:29.165414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:29.166026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:29.166038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:29.166066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:29.166234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:29.166370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401463814641088:7153]
2025-10-15T10:59:29.167920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:29.168634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401461014948859:7236]
2025-10-15T10:59:29.168784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:29.169059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:29.169907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:29.170172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:29.170187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:29.170196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:29.170204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:29.170211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:29.170218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:29.170225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:29.170231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:29.170238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:29.170255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:29.170263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:29.170270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.170277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.170285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.170330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:29.170440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:29.170491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:29.170547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:29.170595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:29.170650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:29.170704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:29.170755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:29.170805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:29.170857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:29.170910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:29.170960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.171013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.171066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.171112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:29.171186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:29.171251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:29.171293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:29.171328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:29.171397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:29.171442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:29.171499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:29.171547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:29.171610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:29.171662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:29.171724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:29.171778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:29.171837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:29.171887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:29.171949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:29.172001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:29.172059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:29.172103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:29.172158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:29.172275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:29.172336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:29.172388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.172448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.172499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.172560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.172612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.172676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.173107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:29.189844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:29.218162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:29.218209Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:29.218225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:29.218254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:29.218278Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 679 [2:7561401463814641088:7153]
2025-10-15T10:59:29.218326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:29.218383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:29.218396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:29.218407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:29.218417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:29.218466Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:29.218488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:29.218510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:29.220454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.220480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.220492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.220502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:29.222157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 679
2025-10-15T10:59:29.220762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:29.222238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 679, pipe: [1:7561401461014948859:7236]
2025-10-15T10:59:29.220787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.222308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 679
2025-10-15T10:59:29.220920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.221094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.221308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:29.221379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401463814641083:7153]
2025-10-15T10:59:29.221392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401463814641083:7153]
2025-10-15T10:59:29.221404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401463814641083:7153]
2025-10-15T10:59:29.221451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:29.221527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:29.221575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:29.221587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:29.221597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:29.221707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:29.221725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:29.221845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401463814641083:7153]
2025-10-15T10:59:29.221865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:29.221876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:29.221963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401461014948603:2467], now have 1 active actors on pipe
2025-10-15T10:59:29.221986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401461014948859:7236], now have 1 active actors on pipe
2025-10-15T10:59:29.222008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401461014948758:7939], now have 1 active actors on pipe
2025-10-15T10:59:29.222766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:29.222790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:29.222856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:29.222880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:29.222892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:29.222900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:29.222928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:29.222960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:29.223009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:29.225796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:29.225832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:29.225911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:29.226320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 680 partition: 0 MaxSeqNo: 46 sessionId: src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0
2025-10-15T10:59:29.229134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fa2ea-3bad045d-a7a78b8b-97971829_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:29.257482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0] Write session: try to update token
2025-10-15T10:59:29.257543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:29.272486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:29.272529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:29.272569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401463814641083:7153]
2025-10-15T10:59:29.272707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:29.272709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:29.274617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:29.275922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:29.282237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:29.286283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:29.287917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:29.288390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:29.318936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:29.318968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:29.318992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:29.364327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:29.364359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:29.364371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:29.364382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:29.364418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401463814641083:7153]
2025-10-15T10:59:29.364442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401463814641083:7153]
2025-10-15T10:59:29.364463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401463814641083:7153]
2025-10-15T10:59:29.364591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:29.364593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:29.364613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:29.364633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:29.364664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:29.365606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:29.439174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId: src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:29.461292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:29.518491Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:29.520041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:29.520084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:29.520790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:29.523507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:29.523731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401461014948859:7236]
2025-10-15T10:59:29.523846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:29.548959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 680 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0
2025-10-15T10:59:29.549308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 680 sessionId: src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0 is DEAD
2025-10-15T10:59:29.551672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:29.551734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0] Write session will restart in 0.005603s
2025-10-15T10:59:29.551868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0] Write session: Do CDS request
2025-10-15T10:59:29.551903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:29.561620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:29.561656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 681
2025-10-15T10:59:29.561853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:29.562360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:29.562511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:29.562535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:29.562547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:29.563958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 681 sessionId:  describe result for acl check
2025-10-15T10:59:29.564083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:29.564101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:29.564111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:29.564130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401461014948905:7948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:29.567552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401461014948905:7948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:29.577887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401461014948905:7948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:29.592494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401461014948905:7948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:29.592536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401461014948905:7948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:29.592556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401461014948905:7948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:29.592591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:29.623946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401461014949089:7236]
2025-10-15T10:59:29.659275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:29.661283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:29.662190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:29.662208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:29.662263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:29.662517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:29.662699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401463814641357:7158]
2025-10-15T10:59:29.665131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:29.666225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:29.666466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:29.667941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:29.668307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:29.668327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:29.668336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:29.668345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:29.668353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:29.668359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:29.668366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:29.668373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:29.668380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:29.668387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:29.668394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:29.668400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.668408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.668415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.668465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:29.668589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:29.668640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:29.668698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:29.668753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:29.668810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:29.668860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:29.668914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:29.668970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:29.669029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:29.669079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:29.669132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.669186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.669238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.669291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:29.669373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:29.669443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:29.669508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:29.669567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:29.669629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:29.669678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:29.669736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:29.669796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:29.669853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:29.669905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:29.669970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:29.670022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:29.670083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:29.670137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:29.670199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:29.670268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:29.670332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:29.670386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:29.670449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:29.670505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:29.670570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:29.670618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.670678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.670734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.670791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.670845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.670905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.671695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:29.687078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:29.695975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:29.696022Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:29.696038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:29.696054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:29.696078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 680 [2:7561401463814641357:7158]
2025-10-15T10:59:29.696126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:29.696184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:29.696197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:29.696208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:29.696218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:29.696260Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:29.696279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:29.696298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:29.697171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.697186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.697198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.697209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:29.697416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:29.697426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:29.697529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:29.697669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:29.697861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:29.697932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401461014949089:7236], now have 1 active actors on pipe
2025-10-15T10:59:29.697955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401461014948967:7948], now have 1 active actors on pipe
2025-10-15T10:59:29.697978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401461014948888:2467], now have 1 active actors on pipe
2025-10-15T10:59:29.698000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401463814641352:7158]
2025-10-15T10:59:29.698013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401463814641352:7158]
2025-10-15T10:59:29.698026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401463814641352:7158]
2025-10-15T10:59:29.698064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:29.698122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:29.698302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:29.698318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:29.698405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:29.698409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401463814641352:7158]
2025-10-15T10:59:29.698424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:29.698420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:29.698440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:29.698467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:29.699183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:29.699215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:29.699291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8240e1f9-3e302b74-770e61b5-55056286_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:29.699324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:29.699356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:29.699367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:29.699398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:29.699439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:29.697929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 680
2025-10-15T10:59:29.698031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 680
2025-10-15T10:59:29.699486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:29.698129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 680, pipe: [1:7561401461014949089:7236]
2025-10-15T10:59:29.700113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:29.700149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:29.700236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:29.700687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 681 partition: 0 MaxSeqNo: 46 sessionId: src_id|8240e1f9-3e302b74-770e61b5-55056286_0
2025-10-15T10:59:29.703968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc9e9c4-d2ac5f2-186eb37c-b1cc0a57_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8240e1f9-3e302b74-770e61b5-55056286_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:29.739982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8240e1f9-3e302b74-770e61b5-55056286_0] Write session: try to update token
2025-10-15T10:59:29.740048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8240e1f9-3e302b74-770e61b5-55056286_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:29.796756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:29.796804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:29.796838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:29.796856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:29.796917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401463814641352:7158]
2025-10-15T10:59:29.796950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401463814641352:7158]
2025-10-15T10:59:29.796987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401463814641352:7158]
2025-10-15T10:59:29.797168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:29.797182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:29.797193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:29.797286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:29.797311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:29.797662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:29.797703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:29.797732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:29.798497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:29.869617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId: src_id|8240e1f9-3e302b74-770e61b5-55056286_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:29.893908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:29.945807Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:29.962192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:29.962235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:29.962309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:29.962324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:29.962357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401463814641352:7158]
2025-10-15T10:59:29.962453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:29.963003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:29.963534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401461014949089:7236]
2025-10-15T10:59:29.963650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:29.963669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:29.967529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:29.981201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 681 reason: error at write: Disconnected sessionId: src_id|8240e1f9-3e302b74-770e61b5-55056286_0
2025-10-15T10:59:29.981534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 681 sessionId: src_id|8240e1f9-3e302b74-770e61b5-55056286_0 is DEAD
2025-10-15T10:59:29.981967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8240e1f9-3e302b74-770e61b5-55056286_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:29.982014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8240e1f9-3e302b74-770e61b5-55056286_0] Write session will restart in 0.007567s
2025-10-15T10:59:29.982172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8240e1f9-3e302b74-770e61b5-55056286_0] Write session: Do CDS request
2025-10-15T10:59:29.982222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8240e1f9-3e302b74-770e61b5-55056286_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:29.997532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8240e1f9-3e302b74-770e61b5-55056286_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:29.997451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:29.997492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 682
2025-10-15T10:59:29.998127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:29.998289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:29.998320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:29.998331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:30.000019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 682 sessionId:  describe result for acl check
2025-10-15T10:59:30.000131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:30.000151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:30.000161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:30.000180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401461014949185:7954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:30.003054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401461014949185:7954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:30.011280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401461014949185:7954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:30.018395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401461014949185:7954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:30.018444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401461014949185:7954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:30.018463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401461014949185:7954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:30.018495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:30.063214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401465309916702:7236]
2025-10-15T10:59:30.077445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:30.082761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:30.083630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:30.083664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:30.083706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:30.083963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:30.084141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401468109608937:7166]
2025-10-15T10:59:30.086753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:30.088187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:30.088420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:30.089689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:30.090026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.090035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.090042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.090051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.090058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.090066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.090072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.090078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.090085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.090092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.090100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.090106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.090114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.090120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.090169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.090304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.090358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.090410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.090459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.090509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.090554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.090602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.090652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.090701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.090747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.090794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.090843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.090890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.090937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.091008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.091069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.091125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.091175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.091231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.091281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.091338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.092108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.092193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.092243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.092300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.092359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.092415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.092452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.092493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.092529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.092572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.092609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.092651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.092688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.092728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.092760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.092798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.092833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.092874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.092907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.092947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.093298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:30.116262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:30.125502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:30.125539Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:30.125552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:30.125566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:30.125592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 681 [2:7561401468109608937:7166]
2025-10-15T10:59:30.125646Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:30.125707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:30.125722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:30.125733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:30.125742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:30.125781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:30.125805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:30.125829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:30.127533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.127556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.127567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.127574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:30.127782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:30.127800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.127926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.128066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.128183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 681, pipe: [1:7561401465309916702:7236]
2025-10-15T10:59:30.128195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 681
2025-10-15T10:59:30.128287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 681
2025-10-15T10:59:30.128299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:30.128384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401461014949174:2467], now have 1 active actors on pipe
2025-10-15T10:59:30.128416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401465309916702:7236], now have 1 active actors on pipe
2025-10-15T10:59:30.128439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401465309916512:7954], now have 1 active actors on pipe
2025-10-15T10:59:30.128484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401468109608925:7166]
2025-10-15T10:59:30.128505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401468109608925:7166]
2025-10-15T10:59:30.128517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401468109608925:7166]
2025-10-15T10:59:30.128556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:30.128637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:30.128728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:30.128753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:30.128766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:30.128825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:30.128849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:30.128993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:30.129020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:30.129053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401468109608925:7166]
2025-10-15T10:59:30.129083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:30.129104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:30.129200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff3204fe-208db925-4667d919-9a693c33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:30.129236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:30.129258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:30.129269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:30.129317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:30.129375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:30.129467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:30.130110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:30.130135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:30.130217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:30.130526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 682 partition: 0 MaxSeqNo: 46 sessionId: src_id|ff3204fe-208db925-4667d919-9a693c33_0
2025-10-15T10:59:30.131482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8240e1f9-3e302b74-770e61b5-55056286_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ff3204fe-208db925-4667d919-9a693c33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:30.157119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3204fe-208db925-4667d919-9a693c33_0] Write session: try to update token
2025-10-15T10:59:30.157182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3204fe-208db925-4667d919-9a693c33_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:30.231190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:30.231226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:30.231239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:30.231251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:30.231287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401468109608925:7166]
2025-10-15T10:59:30.231313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401468109608925:7166]
2025-10-15T10:59:30.231337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401468109608925:7166]
2025-10-15T10:59:30.231489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:30.231542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:30.231574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:30.231585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:30.231594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:30.231607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:30.231656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:30.231677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:30.232659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:30.250679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId: src_id|ff3204fe-208db925-4667d919-9a693c33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:30.273580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:30.379862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:30.395943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:30.395989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:30.396057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:30.396075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:30.396112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401468109608925:7166]
2025-10-15T10:59:30.396276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:30.396663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:30.396647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:30.396657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401465309916702:7236]
2025-10-15T10:59:30.396680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:30.396745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:30.406204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 682 reason: error at write: Disconnected sessionId: src_id|ff3204fe-208db925-4667d919-9a693c33_0
2025-10-15T10:59:30.406567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 682 sessionId: src_id|ff3204fe-208db925-4667d919-9a693c33_0 is DEAD
2025-10-15T10:59:30.406935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3204fe-208db925-4667d919-9a693c33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:30.406998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3204fe-208db925-4667d919-9a693c33_0] Write session will restart in 0.006780s
2025-10-15T10:59:30.407172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3204fe-208db925-4667d919-9a693c33_0] Write session: Do CDS request
2025-10-15T10:59:30.407214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3204fe-208db925-4667d919-9a693c33_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:30.434869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:30.435057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3204fe-208db925-4667d919-9a693c33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:30.434913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 683
2025-10-15T10:59:30.435823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:30.436024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:30.436049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:30.436083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:30.438640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 683 sessionId:  describe result for acl check
2025-10-15T10:59:30.438824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:30.438854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:30.438870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:30.438899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401465309916758:7958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:30.441378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401465309916758:7958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:30.448578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401465309916758:7958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:30.458118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401465309916758:7958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:30.458161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401465309916758:7958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:30.458179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401465309916758:7958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:30.458215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:30.496875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401465309916950:7236]
2025-10-15T10:59:30.520541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:30.522326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:30.522942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:30.522954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:30.522982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:30.523193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:30.523315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401468109609221:7175]
2025-10-15T10:59:30.525015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:30.525808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:30.525957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:30.526889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:30.527147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.527152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.527156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.527161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.527165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.527170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.527174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.527179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.527184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.527188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.527193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.527197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.527202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.527206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.527241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.527336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.527413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.527461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.527509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.527553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.527598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.527655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.527700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.527762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.527810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.527859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.527906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.527952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.527994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.528070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.528128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.528197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.528247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.528302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.528348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.528404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.528450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.528505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.528551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.528625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.528676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.528727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.528772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.528825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.528872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.528927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.528972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.529030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.529080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.529130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.529175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.529229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.529276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.529331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.529379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.529434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.529968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:30.546305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:30.556135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:30.556173Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:30.556185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:30.556200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:30.556221Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 682 [2:7561401468109609221:7175]
2025-10-15T10:59:30.556261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:30.556310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:30.556321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:30.556332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:30.556341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:30.556378Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:30.556396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:30.556413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:30.557705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.557725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.557733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.557742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:30.558012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:30.558036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.558173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.558384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.558620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:30.558711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401465309916796:7958], now have 1 active actors on pipe
2025-10-15T10:59:30.558738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401465309916950:7236], now have 1 active actors on pipe
2025-10-15T10:59:30.558760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401465309916742:2467], now have 1 active actors on pipe
2025-10-15T10:59:30.558784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401468109609216:7175]
2025-10-15T10:59:30.558806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401468109609216:7175]
2025-10-15T10:59:30.558819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401468109609216:7175]
2025-10-15T10:59:30.558861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:30.558920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:30.558939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:30.558951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:30.558956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:30.559139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:30.559158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:30.559276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:30.559294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:30.559328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401468109609216:7175]
2025-10-15T10:59:30.559400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:30.559409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:30.559540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:30.559586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:30.559609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:30.559620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:30.559666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:30.559721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:30.559845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:30.558561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 682
2025-10-15T10:59:30.558641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 682, pipe: [1:7561401465309916950:7236]
2025-10-15T10:59:30.558713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 682
2025-10-15T10:59:30.560717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:30.560743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:30.560806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:30.562583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff3204fe-208db925-4667d919-9a693c33_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:30.561779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 683 partition: 0 MaxSeqNo: 46 sessionId: src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0
2025-10-15T10:59:30.593146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0] Write session: try to update token
2025-10-15T10:59:30.593207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:30.635261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:30.635300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:30.635314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:30.635325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:30.635381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401468109609216:7175]
2025-10-15T10:59:30.635411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401468109609216:7175]
2025-10-15T10:59:30.635435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401468109609216:7175]
2025-10-15T10:59:30.635590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:30.635600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:30.635623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:30.635642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:30.635679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:30.637367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:30.726042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId: src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:30.750720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:30.781153Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:30.782975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:30.783008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:30.787525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:30.787549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:30.802538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401465309916950:7236]
2025-10-15T10:59:30.803526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:30.802614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:30.803581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0] Write session will restart in 0.006605s
2025-10-15T10:59:30.802727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 683 reason: error at write: Disconnected sessionId: src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0
2025-10-15T10:59:30.803055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 683 sessionId: src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0 is DEAD
2025-10-15T10:59:30.803728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0] Write session: Do CDS request
2025-10-15T10:59:30.803769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:30.806888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:30.817501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:30.842093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:30.842122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 684
2025-10-15T10:59:30.842613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:30.842724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:30.842741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:30.842752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:30.845825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 684 sessionId:  describe result for acl check
2025-10-15T10:59:30.845941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:30.845951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:30.845961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:30.845978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401465309917111:7970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:30.848713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401465309917111:7970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:30.857757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401465309917111:7970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:30.867459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401465309917111:7970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:30.867501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401465309917111:7970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:30.867520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401465309917111:7970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:30.867556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:30.888311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:30.890329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:30.891082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:30.891110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:30.891149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:30.891395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:30.891580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401468109609484:7177]
2025-10-15T10:59:30.893853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:30.894952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:30.895154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:30.896349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:30.896676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.896693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.896699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.896706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.896712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.896719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.896727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.896733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.896740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.896746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.896753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.896760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.896766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.896772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.896816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.896915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.896961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.897013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.897063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.897112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.897160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.897209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.897258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.897308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.897356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.897400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.897446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.897493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.897537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.897603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:30.897662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.897717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:30.897764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.897817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:30.897864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.897921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:30.897970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.898024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:30.898072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.898125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:30.898173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.898225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:30.898287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.898338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:30.898388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.898443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:30.898491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.898544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:30.898594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.898644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:30.898691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.898745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.898792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.898847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.898893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.898944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.899670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:30.903219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401465309917295:7236]
2025-10-15T10:59:30.925679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:30.935943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:30.935996Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:30.936012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:30.936030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:30.936054Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 683 [2:7561401468109609484:7177]
2025-10-15T10:59:30.936103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:30.936165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:30.936181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:30.936192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:30.936203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:30.936244Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:30.936266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:30.936288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:30.959248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.959274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.959283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.959293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:30.959895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 683, pipe: [1:7561401465309917295:7236]
2025-10-15T10:59:30.959904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 683
2025-10-15T10:59:30.959991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 683
2025-10-15T10:59:30.959540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:30.959559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:30.959668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:30.959812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:30.959987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:30.960049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401465309917242:7970], now have 1 active actors on pipe
2025-10-15T10:59:30.960067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401465309917295:7236], now have 1 active actors on pipe
2025-10-15T10:59:30.960084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401465309917041:2467], now have 1 active actors on pipe
2025-10-15T10:59:30.960125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:30.960142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:30.960172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401468109609479:7177]
2025-10-15T10:59:30.960185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401468109609479:7177]
2025-10-15T10:59:30.960195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401468109609479:7177]
2025-10-15T10:59:30.960219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:30.960264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:30.960276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:30.960288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:30.960299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:30.960431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:30.960445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:30.960497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:30.960523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:30.960537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:30.960546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:30.960573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:30.960606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:30.960726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401468109609479:7177]
2025-10-15T10:59:30.960764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:30.960797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:30.960847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:30.962762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:30.962799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:30.962879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:30.967908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 684 partition: 0 MaxSeqNo: 46 sessionId: src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0
2025-10-15T10:59:30.968726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab78486-1f8f449f-c3caf88d-7f48bd60_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:30.988470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0] Write session: try to update token
2025-10-15T10:59:30.988525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:31.025482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:31.025520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:31.025533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:31.025545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:31.025585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401468109609479:7177]
2025-10-15T10:59:31.025611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401468109609479:7177]
2025-10-15T10:59:31.025644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401468109609479:7177]
2025-10-15T10:59:31.025782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:31.025802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:31.025953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:31.025990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:31.026015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:31.029391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:31.085066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId: src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:31.109425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:31.177286Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:31.178919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:31.178972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:31.180030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:31.180071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:31.181382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401465309917295:7236]
2025-10-15T10:59:31.181495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:31.189666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 684 reason: error at write: Disconnected sessionId: src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0
2025-10-15T10:59:31.190019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 684 sessionId: src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0 is DEAD
2025-10-15T10:59:31.193601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:31.193646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0] Write session will restart in 0.006862s
2025-10-15T10:59:31.193772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0] Write session: Do CDS request
2025-10-15T10:59:31.193806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:31.204442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:31.204923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:31.204952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 685
2025-10-15T10:59:31.205310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:31.205421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:31.205443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:31.205452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:31.206927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 685 sessionId:  describe result for acl check
2025-10-15T10:59:31.207040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:31.207062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:31.207073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:31.207087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401469604884632:7977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:31.209539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401469604884632:7977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:31.213812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:31.215518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401469604884632:7977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:31.227596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401469604884632:7977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:31.227649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401469604884632:7977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:31.227678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401469604884632:7977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:31.227724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:31.283444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401469604884876:7236]
2025-10-15T10:59:31.291044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:31.293050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:31.293798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:31.293826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:31.293864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:31.294110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:31.294301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401472404577067:7183]
2025-10-15T10:59:31.296380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:31.297296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:31.297533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:31.298699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:31.299018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:31.299040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:31.299046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:31.299053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:31.299059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:31.299065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:31.299073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:31.299079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:31.299086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:31.299093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:31.299100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:31.299107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.299115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.299121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.299164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:31.299266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:31.299308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:31.299341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:31.299403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:31.299439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:31.299474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:31.299515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:31.299556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:31.299599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:31.299642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:31.299686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.299740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.299780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.299820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:31.299890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:31.299943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:31.299993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:31.300038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:31.300088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:31.300132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:31.300184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:31.300228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:31.300275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:31.300318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:31.300365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:31.300413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:31.300458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:31.300500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:31.300550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:31.300592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:31.300642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:31.300686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:31.300737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:31.300778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:31.300825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:31.300865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.300917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.300961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.301010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.301053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.301103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.301575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:31.318321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:31.327426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:31.327467Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:31.327483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:31.327502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:31.327525Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 684 [2:7561401472404577067:7183]
2025-10-15T10:59:31.327576Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:31.327633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:31.327645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:31.327655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:31.327666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:31.327709Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:31.327742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:31.327760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:31.329013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.329028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.329042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.329054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:31.329318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:31.329335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.329466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.329650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.329836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:31.329882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401472404577062:7183]
2025-10-15T10:59:31.331454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 684
2025-10-15T10:59:31.329892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401472404577062:7183]
2025-10-15T10:59:31.329900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401472404577062:7183]
2025-10-15T10:59:31.331557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 684
2025-10-15T10:59:31.329928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:31.329972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:31.330096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:31.331634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 684, pipe: [1:7561401469604884876:7236]
2025-10-15T10:59:31.330106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:31.330186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401472404577062:7183]
2025-10-15T10:59:31.330197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:31.330391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:31.330402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:31.330413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:31.330433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:31.332174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401469604884672:7977], now have 1 active actors on pipe
2025-10-15T10:59:31.332221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401469604884618:2467], now have 1 active actors on pipe
2025-10-15T10:59:31.332242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401469604884876:7236], now have 1 active actors on pipe
2025-10-15T10:59:31.332288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:31.332309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:31.332393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:31.332424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:31.332441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:31.332450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:31.332483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:31.332520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:31.332568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:31.333353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:31.333382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:31.333439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:31.334000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 685 partition: 0 MaxSeqNo: 46 sessionId: src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0
2025-10-15T10:59:31.335575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8d4713c-e203ed9a-128c9d77-7fbe21ec_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:31.372420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0] Write session: try to update token
2025-10-15T10:59:31.372475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:31.424092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:31.424128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:31.424140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:31.424151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:31.424182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401472404577062:7183]
2025-10-15T10:59:31.424205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401472404577062:7183]
2025-10-15T10:59:31.424227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401472404577062:7183]
2025-10-15T10:59:31.424405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:31.424435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:31.426543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:31.427305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:31.427363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:31.427391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:31.484295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId: src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:31.505848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:31.573379Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:31.586430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:31.586481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:31.586539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:31.586552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:31.586589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401472404577062:7183]
2025-10-15T10:59:31.586887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:31.587426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:31.587648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:31.587673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:31.588654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:31.588877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401469604884876:7236]
2025-10-15T10:59:31.615106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 685 reason: error at write: Disconnected sessionId: src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0
2025-10-15T10:59:31.615440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 685 sessionId: src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0 is DEAD
2025-10-15T10:59:31.616094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:31.616148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0] Write session will restart in 0.008695s
2025-10-15T10:59:31.616286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0] Write session: Do CDS request
2025-10-15T10:59:31.616328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:31.632531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:31.635458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:31.635487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 686
2025-10-15T10:59:31.635837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:31.635935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:31.635949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:31.635958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:31.637119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 686 sessionId:  describe result for acl check
2025-10-15T10:59:31.637211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:31.637220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:31.637227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:31.637242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401469604884922:7983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:31.639759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401469604884922:7983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:31.661935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401469604884922:7983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:31.685398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401469604884922:7983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:31.685443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401469604884922:7983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:31.685457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401469604884922:7983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:31.685483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:31.688289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401469604885102:7236]
2025-10-15T10:59:31.716722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:31.724426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:31.725046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:31.725058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:31.725082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:31.725235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:31.725340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401472404577345:7191]
2025-10-15T10:59:31.726653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:31.727476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:31.727642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:31.728377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:31.728594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:31.728598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:31.728603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:31.728607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:31.728611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:31.728615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:31.728620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:31.728624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:31.728628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:31.728632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:31.728636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:31.728640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.728645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.728649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.728678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:31.728742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:31.728773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:31.728800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:31.728836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:31.728868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:31.728898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:31.728929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:31.728960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:31.728992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:31.729023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:31.729066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.729111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.729143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.729168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:31.729211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:31.729250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:31.729287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:31.729319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:31.729352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:31.729381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:31.729416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:31.729457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:31.729497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:31.729530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:31.729576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:31.729607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:31.729641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:31.729671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:31.729709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:31.729746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:31.729789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:31.729829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:31.729867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:31.729898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:31.729944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:31.729990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.730037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.730078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.730125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.730164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.730199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.730540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:31.748908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:31.759041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:31.759089Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:31.759105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:31.759121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:31.759143Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 685 [2:7561401472404577345:7191]
2025-10-15T10:59:31.759197Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:31.759246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:31.759259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:31.759270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:31.759279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:31.759322Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:31.759343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:31.759381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:31.760321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.760338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.760347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.760353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:31.760643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:31.760669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:31.760756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:31.760869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:31.761026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:31.761076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401469604885102:7236], now have 1 active actors on pipe
2025-10-15T10:59:31.761096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401469604884892:2467], now have 1 active actors on pipe
2025-10-15T10:59:31.761115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 685, pipe: [1:7561401469604885102:7236]
2025-10-15T10:59:31.761116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401469604885091:7983], now have 1 active actors on pipe
2025-10-15T10:59:31.761140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401472404577340:7191]
2025-10-15T10:59:31.761155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401472404577340:7191]
2025-10-15T10:59:31.761261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 685
2025-10-15T10:59:31.761168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401472404577340:7191]
2025-10-15T10:59:31.761200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:31.761226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:31.761237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:31.761248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:31.761362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 685
2025-10-15T10:59:31.761260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:31.761420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:31.761443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:31.761551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:31.761570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:31.761590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401472404577340:7191]
2025-10-15T10:59:31.761614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:31.761709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:31.761721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|246a3f20-fb357ed5-85e06609-339d54f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:31.761748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:31.761777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:31.761787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:31.761817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:31.761858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:31.761940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:31.762432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:31.762462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:31.762538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:31.762804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 686 partition: 0 MaxSeqNo: 46 sessionId: src_id|246a3f20-fb357ed5-85e06609-339d54f5_0
2025-10-15T10:59:31.763506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f8529a-f4048d0b-c8ccb495-dc109b70_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|246a3f20-fb357ed5-85e06609-339d54f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:31.784808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246a3f20-fb357ed5-85e06609-339d54f5_0] Write session: try to update token
2025-10-15T10:59:31.784860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246a3f20-fb357ed5-85e06609-339d54f5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:31.821735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:31.821803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:31.821830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:31.821871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:31.821947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401472404577340:7191]
2025-10-15T10:59:31.821982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401472404577340:7191]
2025-10-15T10:59:31.822004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401472404577340:7191]
2025-10-15T10:59:31.822114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:31.822152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:31.822179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:31.822185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:31.822198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:31.823258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:31.871871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId: src_id|246a3f20-fb357ed5-85e06609-339d54f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:31.892525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:31.963302Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:31.974634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:31.974678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:31.974734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:31.974748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:31.974786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401472404577340:7191]
2025-10-15T10:59:31.975026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:31.975295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401469604885102:7236]
2025-10-15T10:59:31.975383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:31.975390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:31.975483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:31.975501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:32.010554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 686 reason: error at write: Disconnected sessionId: src_id|246a3f20-fb357ed5-85e06609-339d54f5_0
2025-10-15T10:59:32.010847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 686 sessionId: src_id|246a3f20-fb357ed5-85e06609-339d54f5_0 is DEAD
2025-10-15T10:59:32.011789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246a3f20-fb357ed5-85e06609-339d54f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:32.011855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246a3f20-fb357ed5-85e06609-339d54f5_0] Write session will restart in 0.005410s
2025-10-15T10:59:32.011978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246a3f20-fb357ed5-85e06609-339d54f5_0] Write session: Do CDS request
2025-10-15T10:59:32.012018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246a3f20-fb357ed5-85e06609-339d54f5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:32.023318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|246a3f20-fb357ed5-85e06609-339d54f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:32.032276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:32.032307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 687
2025-10-15T10:59:32.032621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:32.032691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:32.032704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:32.032710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:32.033681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 687 sessionId:  describe result for acl check
2025-10-15T10:59:32.033787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:32.033797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:32.033805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:32.033819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401473899852584:7993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:32.036090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401473899852584:7993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:32.045120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401473899852584:7993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:32.056239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401473899852584:7993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:32.056276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401473899852584:7993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:32.056291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401473899852584:7993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:32.060902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:32.075387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401473899852764:7236]
2025-10-15T10:59:32.075730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:32.081917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:32.082769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:32.082799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:32.082839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:32.083071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:32.083253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401476699544929:7198]
2025-10-15T10:59:32.085376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:32.086317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:32.086505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:32.087780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:32.088088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:32.088107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:32.088113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:32.088120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:32.088126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:32.088133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:32.088139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:32.088145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:32.088151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:32.088157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:32.088163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:32.088168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.088174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.088181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.088222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:32.088318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:32.088362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:32.088403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:32.088443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:32.088494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:32.088540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:32.088586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:32.088631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:32.088673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:32.088718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:32.088763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.088809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.088853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.088911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:32.088975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:32.089032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:32.089085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:32.089136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:32.089189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:32.089235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:32.089286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:32.089334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:32.089389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:32.089430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:32.089478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:32.089528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:32.089582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:32.089629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:32.089684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:32.089731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:32.089785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:32.089831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:32.089883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:32.089929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:32.089981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:32.090029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.090075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.090116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.090168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.090214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.090265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.090729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:32.112802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:32.123862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:32.123903Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:32.123918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:32.123933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:32.123954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 686 [2:7561401476699544929:7198]
2025-10-15T10:59:32.123997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:32.124043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:32.124054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:32.124065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:32.124074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:32.124114Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:32.124134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:32.124152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:32.152985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.153015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.153040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.153049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:32.153290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:32.153310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.153666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 686
2025-10-15T10:59:32.153773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 686, pipe: [1:7561401473899852764:7236]
2025-10-15T10:59:32.153852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 686
2025-10-15T10:59:32.155665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 687 partition: 0 MaxSeqNo: 46 sessionId: src_id|86123ec3-684876ed-11b69531-ce9270f5_0
2025-10-15T10:59:32.156412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|246a3f20-fb357ed5-85e06609-339d54f5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|86123ec3-684876ed-11b69531-ce9270f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:32.153416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.153588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.153771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:32.153839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401469604885200:2467], now have 1 active actors on pipe
2025-10-15T10:59:32.153859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401473899852764:7236], now have 1 active actors on pipe
2025-10-15T10:59:32.153878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401473899852760:7993], now have 1 active actors on pipe
2025-10-15T10:59:32.153900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401476699544923:7198]
2025-10-15T10:59:32.153913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401476699544923:7198]
2025-10-15T10:59:32.153924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401476699544923:7198]
2025-10-15T10:59:32.153949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:32.153992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:32.154003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:32.154009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:32.154012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:32.154155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:32.154169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:32.154324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:32.154342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:32.154369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401476699544923:7198]
2025-10-15T10:59:32.154400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:32.154494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86123ec3-684876ed-11b69531-ce9270f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:32.154514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:32.154517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:32.154531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:32.154540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:32.154567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:32.154602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:32.154673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:32.155252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:32.155270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:32.155329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:32.179312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86123ec3-684876ed-11b69531-ce9270f5_0] Write session: try to update token
2025-10-15T10:59:32.179383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86123ec3-684876ed-11b69531-ce9270f5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:32.225136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:32.225175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:32.225191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:32.225204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:32.225242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401476699544923:7198]
2025-10-15T10:59:32.225269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401476699544923:7198]
2025-10-15T10:59:32.225297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401476699544923:7198]
2025-10-15T10:59:32.225438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:32.225482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:32.225487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:32.225502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:32.225513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:32.225515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:32.252322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:32.252373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:32.254257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:32.289380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId: src_id|86123ec3-684876ed-11b69531-ce9270f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:32.313845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:32.405656Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:32.406922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:32.406952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:32.406999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401476699544923:7198]
2025-10-15T10:59:32.407128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:32.407161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:32.407295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:32.408214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:32.407925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:32.407955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:32.408208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:32.408469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401473899852764:7236]
2025-10-15T10:59:32.437807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86123ec3-684876ed-11b69531-ce9270f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:32.437902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86123ec3-684876ed-11b69531-ce9270f5_0] Write session will restart in 0.008922s
2025-10-15T10:59:32.438127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86123ec3-684876ed-11b69531-ce9270f5_0] Write session: Do CDS request
2025-10-15T10:59:32.438199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86123ec3-684876ed-11b69531-ce9270f5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:32.437014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 687 reason: error at write: Disconnected sessionId: src_id|86123ec3-684876ed-11b69531-ce9270f5_0
2025-10-15T10:59:32.437368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 687 sessionId: src_id|86123ec3-684876ed-11b69531-ce9270f5_0 is DEAD
2025-10-15T10:59:32.454285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:32.454326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 688
2025-10-15T10:59:32.455277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86123ec3-684876ed-11b69531-ce9270f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:32.455837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:32.455969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:32.455985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:32.455996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:32.457584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 688 sessionId:  describe result for acl check
2025-10-15T10:59:32.457697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:32.457707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:32.457719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:32.457737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401473899852812:8000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:32.460795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401473899852812:8000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:32.470813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401473899852812:8000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:32.492697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401473899852812:8000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:32.492743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401473899852812:8000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:32.492759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401473899852812:8000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:32.492789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:32.508046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401473899853011:7236]
2025-10-15T10:59:32.528285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:32.535646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:32.536553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:32.536585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:32.536629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:32.536879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:32.537069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401476699545214:7204]
2025-10-15T10:59:32.539090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:32.540197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:32.540422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:32.541574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:32.541900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:32.541908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:32.541915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:32.541921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:32.541928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:32.541934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:32.541941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:32.541947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:32.541954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:32.541960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:32.541967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:32.541972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.541979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.541985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.542028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:32.542131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:32.542176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:32.542220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:32.542262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:32.542321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:32.542365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:32.542410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:32.542453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:32.542500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:32.542553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:32.542598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.542638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.542680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.542719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:32.542781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:32.542836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:32.542888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:32.542935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:32.542984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:32.543025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:32.543077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:32.543121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:32.543171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:32.543216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:32.543269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:32.543313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:32.544196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:32.544264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:32.544317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:32.544373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:32.544432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:32.544480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:32.544537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:32.544585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:32.544641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:32.544686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.544742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.544792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.544844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.544889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.544945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.545419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:32.563674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:32.573568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:32.573628Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:32.573648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:32.573670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:32.573698Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 687 [2:7561401476699545214:7204]
2025-10-15T10:59:32.573758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:32.573832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:32.573851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:32.573865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:32.573879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:32.573934Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:32.573958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:32.573985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:32.575177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.575194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.575210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.575222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:32.576345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 687
2025-10-15T10:59:32.576445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 687, pipe: [1:7561401473899853011:7236]
2025-10-15T10:59:32.576528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 687
2025-10-15T10:59:32.576187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:32.576222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:32.576373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:32.576594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:32.576848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:32.576935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401473899852796:2467], now have 1 active actors on pipe
2025-10-15T10:59:32.576961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401473899853011:7236], now have 1 active actors on pipe
2025-10-15T10:59:32.576987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401473899852909:8000], now have 1 active actors on pipe
2025-10-15T10:59:32.577014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401476699545209:7204]
2025-10-15T10:59:32.577029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401476699545209:7204]
2025-10-15T10:59:32.577044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401476699545209:7204]
2025-10-15T10:59:32.577086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:32.577162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:32.577360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:32.577379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:32.577521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401476699545209:7204]
2025-10-15T10:59:32.577542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:32.578195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:32.578216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:32.578227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:32.578257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:32.578529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:32.578555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:32.578632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:32.578665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:32.578684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:32.578696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:32.578734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:32.578789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:32.578841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:32.579703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:32.579744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:32.579812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:32.580192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 688 partition: 0 MaxSeqNo: 46 sessionId: src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0
2025-10-15T10:59:32.580968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86123ec3-684876ed-11b69531-ce9270f5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:32.605012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0] Write session: try to update token
2025-10-15T10:59:32.605074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:32.635087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:32.635129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:32.635168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401476699545209:7204]
2025-10-15T10:59:32.635297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:32.635304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:32.640668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:32.650203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:32.651933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:32.656420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:32.658002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:32.658345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:32.673802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:32.673836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:32.673850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:32.737734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId: src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:32.742557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:32.742584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:32.742593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:32.742600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:32.742639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401476699545209:7204]
2025-10-15T10:59:32.742663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401476699545209:7204]
2025-10-15T10:59:32.742683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401476699545209:7204]
2025-10-15T10:59:32.742791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:32.742800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:32.742812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:32.742832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:32.742867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:32.743628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:32.759121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:32.885814Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:32.887917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:32.887960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:32.891517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:32.891696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401473899853011:7236]
2025-10-15T10:59:32.891778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:32.891790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:32.890792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:32.903999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:32.904066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0] Write session will restart in 0.009291s
2025-10-15T10:59:32.904222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0] Write session: Do CDS request
2025-10-15T10:59:32.904270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:32.902388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 688 reason: error at write: Disconnected sessionId: src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0
2025-10-15T10:59:32.902763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 688 sessionId: src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0 is DEAD
2025-10-15T10:59:32.928415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:32.929346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:32.929374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 689
2025-10-15T10:59:32.931502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:32.931649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:32.931665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:32.931676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:32.934537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 689 sessionId:  describe result for acl check
2025-10-15T10:59:32.934799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:32.934828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:32.934849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:32.934868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401473899853098:8006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:32.939035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401473899853098:8006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:32.947486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401473899853098:8006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:32.968153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401473899853098:8006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:32.968194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401473899853098:8006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:32.968212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401473899853098:8006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:32.968243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:32.991860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401473899853236:7236]
2025-10-15T10:59:33.038873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:33.040983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:33.041770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:33.041797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:33.041838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:33.042081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:33.042266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401480994512794:7212]
2025-10-15T10:59:33.044396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:33.045435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:33.045640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:33.046842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:33.047151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.047168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.047177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.047185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.047191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.047198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.047205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.047212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.047218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.047224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.047232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.047240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.047246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.047253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.047297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.047425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.047472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.047519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.047571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.047622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.047682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.047732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.047779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.047830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.047879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.047926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.047975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.048023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.048068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.048135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.048197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.048254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.048304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.048362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.048415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.048468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.048522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.048578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.048622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.048675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.048723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.048772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.048814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.048866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.048917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.048976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.049022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.049078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.049125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.049183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.049232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.049284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.049329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.049379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.049423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.049473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.049959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:33.074947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:33.085303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:33.085355Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:33.085373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:33.085391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:33.085416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 688 [2:7561401480994512794:7212]
2025-10-15T10:59:33.085466Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:33.085522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:33.085536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:33.085548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:33.085559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:33.085610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:33.085633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:33.085656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:33.087509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.087533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.087543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.087551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:33.087813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:33.087839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.087978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.088099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 688
2025-10-15T10:59:33.088165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.088116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 688
2025-10-15T10:59:33.088180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 688, pipe: [1:7561401473899853236:7236]
2025-10-15T10:59:33.088401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:33.088496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401473899853085:2467], now have 1 active actors on pipe
2025-10-15T10:59:33.088526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401473899853139:8006], now have 1 active actors on pipe
2025-10-15T10:59:33.088549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401473899853236:7236], now have 1 active actors on pipe
2025-10-15T10:59:33.088576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401480994512789:7212]
2025-10-15T10:59:33.088590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401480994512789:7212]
2025-10-15T10:59:33.088603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401480994512789:7212]
2025-10-15T10:59:33.088635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:33.088658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:33.088672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:33.088682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:33.088708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:33.088884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:33.088901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:33.088957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:33.088988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:33.089127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401480994512789:7212]
2025-10-15T10:59:33.089158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:33.089173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:33.089235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:33.089272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:33.089294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:33.089304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:33.089339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:33.089386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:33.089522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:33.090231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:33.090270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:33.090356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:33.090851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 689 partition: 0 MaxSeqNo: 46 sessionId: src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0
2025-10-15T10:59:33.091643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c574fd9-1339c8ed-81f2bb11-6954ab4d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:33.117207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0] Write session: try to update token
2025-10-15T10:59:33.117266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:33.168726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:33.168767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:33.168781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:33.168791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:33.168828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401480994512789:7212]
2025-10-15T10:59:33.168856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401480994512789:7212]
2025-10-15T10:59:33.168902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401480994512789:7212]
2025-10-15T10:59:33.169026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:33.169064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:33.169066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:33.169089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:33.169093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:33.170438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:33.221875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId: src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:33.242554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:33.318668Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:33.325791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:33.325852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:33.326716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401473899853236:7236]
2025-10-15T10:59:33.326917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:33.327233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:33.327265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:33.330100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:33.345445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 689 reason: error at write: Disconnected sessionId: src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0
2025-10-15T10:59:33.345782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 689 sessionId: src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0 is DEAD
2025-10-15T10:59:33.347553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:33.347590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0] Write session will restart in 0.006004s
2025-10-15T10:59:33.347749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0] Write session: Do CDS request
2025-10-15T10:59:33.347808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:33.362414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:33.362243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:33.362280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 690
2025-10-15T10:59:33.363783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:33.363909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:33.363925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:33.363936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:33.365102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 690 sessionId:  describe result for acl check
2025-10-15T10:59:33.365185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:33.365195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:33.365205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:33.365221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401478194820680:8010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:33.369780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401478194820680:8010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:33.380751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401478194820680:8010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:33.395818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401478194820680:8010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:33.395859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401478194820680:8010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:33.395877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401478194820680:8010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:33.395910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:33.431617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401478194820901:7236]
2025-10-15T10:59:33.453950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:33.458907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:33.459798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:33.459827Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:33.459870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:33.460126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:33.460313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401480994513094:7221]
2025-10-15T10:59:33.462692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:33.463755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:33.463981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:33.465338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:33.465673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.465683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.465690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.465698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.465706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.465714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.465722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.465730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.465736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.465744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.465753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.465760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.465768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.465776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.465825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.465944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.465997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.466050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.466103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.466155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.466208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.466259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.466307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.466377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.466427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.466482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.466532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.466585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.466632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.466704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.466768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.466827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.466882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.466943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.466994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.467053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.467103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.467161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.467247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.467312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.467388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.467452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.467504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.467562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.467617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.467679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.467731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.467791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.467844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.467904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.467955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.468012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.468064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.468124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.468176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.468235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.468799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:33.496632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:33.506263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:33.506324Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:33.506343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:33.506364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:33.506389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 689 [2:7561401480994513094:7221]
2025-10-15T10:59:33.506442Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:33.506504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:33.506519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:33.506533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:33.506545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:33.506596Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:33.506621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:33.506645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:33.508299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.508330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.508345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.508357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:33.508641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:33.508667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.508810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.509005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.509245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:33.509326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401480994513089:7221]
2025-10-15T10:59:33.509349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401480994513089:7221]
2025-10-15T10:59:33.509363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401480994513089:7221]
2025-10-15T10:59:33.509404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:33.509476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:33.509662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:33.509672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:33.509687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:33.509688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:33.509700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:33.509861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401478194820749:8010], now have 1 active actors on pipe
2025-10-15T10:59:33.509894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401480994513089:7221]
2025-10-15T10:59:33.509915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:33.509945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:33.509997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401478194820664:2467], now have 1 active actors on pipe
2025-10-15T10:59:33.510020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401478194820901:7236], now have 1 active actors on pipe
2025-10-15T10:59:33.512465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 689
2025-10-15T10:59:33.512558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 689
2025-10-15T10:59:33.512631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 689, pipe: [1:7561401478194820901:7236]
2025-10-15T10:59:33.513886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:33.513929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:33.514021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:33.514060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:33.514084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:33.514095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:33.514139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:33.514194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:33.514250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:33.515222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:33.515249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:33.515315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:33.515747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 690 partition: 0 MaxSeqNo: 46 sessionId: src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0
2025-10-15T10:59:33.516529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b1ffad9-7c2acc7a-ca931ea1-5d6d0940_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:33.538793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0] Write session: try to update token
2025-10-15T10:59:33.538849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:33.604115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:33.604152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:33.604164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:33.604174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:33.604206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401480994513089:7221]
2025-10-15T10:59:33.604230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401480994513089:7221]
2025-10-15T10:59:33.604266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401480994513089:7221]
2025-10-15T10:59:33.604422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:33.604459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:33.604489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:33.604490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:33.604511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:33.605666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:33.622785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId: src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:33.644197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:33.749769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:33.761060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:33.761120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:33.761194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:33.761208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:33.761252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401480994513089:7221]
2025-10-15T10:59:33.761426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:33.761853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:33.761712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:33.761882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401478194820901:7236]
2025-10-15T10:59:33.761975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:33.761987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:33.788858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 690 reason: error at write: Disconnected sessionId: src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0
2025-10-15T10:59:33.789155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 690 sessionId: src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0 is DEAD
2025-10-15T10:59:33.791560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:33.791599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0] Write session will restart in 0.007157s
2025-10-15T10:59:33.791688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0] Write session: Do CDS request
2025-10-15T10:59:33.791713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:33.806359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:33.816053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:33.816087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 691
2025-10-15T10:59:33.816380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:33.816490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:33.816510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:33.816520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:33.817807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 691 sessionId:  describe result for acl check
2025-10-15T10:59:33.817923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:33.817939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:33.817949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:33.817967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401478194821009:8022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:33.820498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401478194821009:8022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:33.834471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401478194821009:8022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:33.849220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401478194821009:8022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:33.849261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401478194821009:8022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:33.849280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401478194821009:8022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:33.849308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:33.862273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401478194821236:7236]
2025-10-15T10:59:33.878352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:33.880530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:33.881360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:33.881379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:33.881426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:33.881694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:33.881885Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401480994513370:7223]
2025-10-15T10:59:33.884193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:33.886351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:33.886607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:33.887908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:33.888261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.888281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.888288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.888295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.888305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.888312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.888319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.888325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.888332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.888339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.888346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.888353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.888360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.888368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.888419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.888541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.888592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.888642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.888703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.888755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.888812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.888863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.888915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.888967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.889017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.889072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.889122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.889174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.889225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.889301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:33.889366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.889432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:33.889489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.889549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:33.889600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.889663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:33.889719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.889778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:33.889828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.889887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:33.889937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.889996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:33.890045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.890105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:33.890158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.890217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:33.890269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.890339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:33.890391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.890446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:33.890495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.890556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.890611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.890665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.890714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.890774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.891295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:33.907424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:33.916918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:33.916976Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:33.916994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:33.917018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:33.917045Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 690 [2:7561401480994513370:7223]
2025-10-15T10:59:33.917144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:33.917210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:33.917232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:33.917247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:33.917259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:33.917312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:33.917336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:33.917360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:33.919006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 690, pipe: [1:7561401478194821236:7236]
2025-10-15T10:59:33.919033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 690
2025-10-15T10:59:33.919114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 690
2025-10-15T10:59:33.918339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.918371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.918385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.918397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:33.918665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:33.918686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:33.918835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:33.919033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:33.919271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:33.919378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401478194821236:7236], now have 1 active actors on pipe
2025-10-15T10:59:33.919403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401478194821191:8022], now have 1 active actors on pipe
2025-10-15T10:59:33.919425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401478194820967:2467], now have 1 active actors on pipe
2025-10-15T10:59:33.919473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:33.919497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:33.919552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401480994513365:7223]
2025-10-15T10:59:33.919568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401480994513365:7223]
2025-10-15T10:59:33.919582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401480994513365:7223]
2025-10-15T10:59:33.919626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:33.919671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:33.919688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:33.919700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:33.919701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:33.919887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:33.919905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:33.919973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33c74654-d97dc06b-8fe673a2-283488bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:33.920004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:33.920023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:33.920034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:33.920072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:33.920114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:33.920250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401480994513365:7223]
2025-10-15T10:59:33.920284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:33.920303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:33.920330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:33.921176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:33.921209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:33.921273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:33.921625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 691 partition: 0 MaxSeqNo: 46 sessionId: src_id|33c74654-d97dc06b-8fe673a2-283488bb_0
2025-10-15T10:59:33.927587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8c427df-dcc4bf15-a03f60be-e38c166_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|33c74654-d97dc06b-8fe673a2-283488bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:33.969998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c74654-d97dc06b-8fe673a2-283488bb_0] Write session: try to update token
2025-10-15T10:59:33.970058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c74654-d97dc06b-8fe673a2-283488bb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:34.031402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:34.031441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:34.031457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:34.031467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:34.031501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401480994513365:7223]
2025-10-15T10:59:34.031525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401480994513365:7223]
2025-10-15T10:59:34.031545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401480994513365:7223]
2025-10-15T10:59:34.031693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:34.031731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:34.031758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:34.031768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:34.031780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:34.031792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:34.031837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:34.031857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:34.034512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:34.050434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId: src_id|33c74654-d97dc06b-8fe673a2-283488bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:34.071697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:34.173330Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:34.203979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:34.204019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:34.204078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:34.204093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:34.204126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401480994513365:7223]
2025-10-15T10:59:34.204348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:34.204642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:34.204802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401478194821236:7236]
2025-10-15T10:59:34.204908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:34.204995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:34.214669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 691 reason: status is not ok: tablet will be restarted right now sessionId: src_id|33c74654-d97dc06b-8fe673a2-283488bb_0
2025-10-15T10:59:34.215030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 691 sessionId: src_id|33c74654-d97dc06b-8fe673a2-283488bb_0 is DEAD
2025-10-15T10:59:34.215414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c74654-d97dc06b-8fe673a2-283488bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:34.215455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c74654-d97dc06b-8fe673a2-283488bb_0] Write session will restart in 0.007976s
2025-10-15T10:59:34.215546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c74654-d97dc06b-8fe673a2-283488bb_0] Write session: Do CDS request
2025-10-15T10:59:34.215574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c74654-d97dc06b-8fe673a2-283488bb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:34.230266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:34.230296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 692
2025-10-15T10:59:34.230485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c74654-d97dc06b-8fe673a2-283488bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:34.230979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:34.231148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:34.231191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:34.231207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:34.232532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 692 sessionId:  describe result for acl check
2025-10-15T10:59:34.232639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:34.232658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:34.232667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:34.232682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401482489788570:8028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:34.235518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401482489788570:8028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:34.241285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401482489788570:8028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:34.249563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401482489788570:8028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:34.249605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401482489788570:8028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:34.249623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401482489788570:8028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:34.249654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:34.305160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401482489788819:7236]
2025-10-15T10:59:34.321516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:34.329122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:34.329886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:34.329915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:34.329956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:34.330178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:34.330369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401485289480965:7229]
2025-10-15T10:59:34.332468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:34.334161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:34.334372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:34.335566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:34.335881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:34.335896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:34.335904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:34.335910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:34.335916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:34.335922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:34.335928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:34.335934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:34.335940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:34.335946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:34.335953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:34.335960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.335967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.335974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.336017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:34.336112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:34.336155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:34.336199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:34.336241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:34.336292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:34.336340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:34.336386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:34.336432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:34.336479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:34.336526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:34.336572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.336622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.336661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.336700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:34.336763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:34.336823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:34.336882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:34.336931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:34.336979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:34.337021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:34.337076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:34.337126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:34.337181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:34.337227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:34.337285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:34.337327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:34.337382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:34.337423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:34.337477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:34.337527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:34.337584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:34.337626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:34.337680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:34.337725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:34.337778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:34.337826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.337880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.337929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.337978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.338027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.338081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.338559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:34.362118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:34.383773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:34.383819Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:34.383833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:34.383849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:34.383871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 691 [2:7561401485289480965:7229]
2025-10-15T10:59:34.383916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:34.383961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:34.383976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:34.383987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:34.383997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:34.384040Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:34.384061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:34.384079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:34.385769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.385794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.385806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.385817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:34.386080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:34.386103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.386221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.386399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.386609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:34.386675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401485289480960:7229]
2025-10-15T10:59:34.386693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401485289480960:7229]
2025-10-15T10:59:34.386705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401485289480960:7229]
2025-10-15T10:59:34.386742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:34.386810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:34.386972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:34.386994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:34.387057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:34.387080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:34.387097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:34.387119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401485289480960:7229]
2025-10-15T10:59:34.387140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:34.387183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401482489788600:8028], now have 1 active actors on pipe
2025-10-15T10:59:34.387203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401482489788555:2467], now have 1 active actors on pipe
2025-10-15T10:59:34.387218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:34.387291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401482489788819:7236], now have 1 active actors on pipe
2025-10-15T10:59:34.387398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 691
2025-10-15T10:59:34.387421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 691
2025-10-15T10:59:34.387504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 691, pipe: [1:7561401482489788819:7236]
2025-10-15T10:59:34.387738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:34.387769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:34.387844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:34.387872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:34.387887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:34.387897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:34.387946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:34.387982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:34.388023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:34.388669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:34.388696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:34.388755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:34.389112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 692 partition: 0 MaxSeqNo: 46 sessionId: src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0
2025-10-15T10:59:34.389971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c74654-d97dc06b-8fe673a2-283488bb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:34.415303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0] Write session: try to update token
2025-10-15T10:59:34.415400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:34.438344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:34.438381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:34.438420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401485289480960:7229]
2025-10-15T10:59:34.438549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:34.439615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:34.441600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:34.447517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:34.458694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:34.467584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:34.471491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:34.472117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:34.506764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:34.506795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:34.506804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:34.528034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:34.528073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:34.528095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:34.528110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:34.528152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401485289480960:7229]
2025-10-15T10:59:34.528183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401485289480960:7229]
2025-10-15T10:59:34.528208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401485289480960:7229]
2025-10-15T10:59:34.528364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:34.528388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:34.531092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:34.531496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:34.531549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:34.531594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:34.532702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId: src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:34.553606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:34.672691Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:34.675027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:34.675071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:34.675698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:34.675785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:34.675705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401482489788819:7236]
2025-10-15T10:59:34.675727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:34.675779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:34.675907Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T10:59:34.676269Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 7 consumer shared/user session shared/user_1_7_4774374852114715437_v1 is DEAD
2025-10-15T10:59:34.676640Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T10:59:34.676642Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401280626301167:7233] disconnected; active server actors: 1
2025-10-15T10:59:34.676678Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401280626301167:7233] client user disconnected session shared/user_1_7_4774374852114715437_v1
2025-10-15T10:59:34.677280Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:59:34.677315Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:59:34.677359Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.009782s
2025-10-15T10:59:34.685765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 692 reason: error at write: Disconnected sessionId: src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0
2025-10-15T10:59:34.686047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 692 sessionId: src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0 is DEAD
2025-10-15T10:59:34.686501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:34.686562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0] Write session will restart in 0.008894s
2025-10-15T10:59:34.686738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0] Write session: Do CDS request
2025-10-15T10:59:34.686792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:34.691317Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T10:59:34.691860Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:59:34.691894Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 8
2025-10-15T10:59:34.692788Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 8 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:59:34.693077Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:59:34.693515Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 auth for : user
2025-10-15T10:59:34.694037Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 Handle describe topics response
2025-10-15T10:59:34.695505Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 auth is DEAD
2025-10-15T10:59:34.695623Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:59:34.696541Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:59:34.696818Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_8_10521366525245010318_v1
2025-10-15T10:59:34.696852Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:59:34.696858Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401482489788869:8036] connected; active server actors: 1
2025-10-15T10:59:34.696904Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561401482489788869:8036] session shared/user_1_8_10521366525245010318_v1
2025-10-15T10:59:34.696942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:59:34.696990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:59:34.697038Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:59:34.697031Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_8_10521366525245010318_v1" (Sender=[1:7561401482489788864:8036], Pipe=[1:7561401482489788869:8036], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:59:34.697072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:59:34.697123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:59:34.697180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_8_10521366525245010318_v1" (Sender=[1:7561401482489788864:8036], Pipe=[1:7561401482489788869:8036], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:59:34.697252Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_8_10521366525245010318_v1" sender [1:7561401482489788864:8036] lock partition 0 for ReadingSession "shared/user_1_8_10521366525245010318_v1" (Sender=[1:7561401482489788864:8036], Pipe=[1:7561401482489788869:8036], Partitions=[], ActiveFamilyCount=1) generation 1 step 8
2025-10-15T10:59:34.697306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:59:34.697332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000176s
2025-10-15T10:59:34.697413Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:59:34.698410Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 8 Session: "shared/user_1_8_10521366525245010318_v1" ClientId: "user" PipeClient { RawX1: 7561401482489788869 RawX2: 4503603922345828 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:59:34.698634Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 got read request: guid# d90a216-ee6e0f5-bb0b61c2-ca332be3
2025-10-15T10:59:34.698778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:59:34.702458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:34.702461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:34.702496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 693
2025-10-15T10:59:34.703139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:34.703339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:34.703381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:34.703395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:34.705405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 693 sessionId:  describe result for acl check
2025-10-15T10:59:34.705579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:34.705600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:34.705609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:34.705628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401482489788876:8040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:34.714667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401482489788876:8040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:34.722006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401482489788876:8040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:34.734003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401482489788876:8040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:34.734040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401482489788876:8040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:34.734056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401482489788876:8040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:34.734085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:34.766797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:34.768726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:34.769585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:34.769615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:34.769656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:34.769910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:34.770094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401485289481256:7237]
2025-10-15T10:59:34.772286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:34.773318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:34.773572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:34.774741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:34.774999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:34.775012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:34.775017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:34.775022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:34.775026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:34.775031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:34.775035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:34.775041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:34.775045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:34.775050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:34.775054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:34.775058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.775062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.775067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.775102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:34.775222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:34.775305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:34.775386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:34.775440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:34.775497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:34.775540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:34.775580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:34.775623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:34.775684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:34.775735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:34.775780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.775819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.775862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.775906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:34.775968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:34.776017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:34.776058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:34.776099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:34.776142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:34.776177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:34.776229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:34.776268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:34.776312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:34.776356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:34.776410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:34.776505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:34.776575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:34.776668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:34.776737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:34.776798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:34.776869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:34.776923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:34.776989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:34.777048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:34.777121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:34.777175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.777230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.777283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.777344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.777394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.777453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.778096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:34.818199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:34.825895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:34.825940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:34.825952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:34.825966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:34.825985Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 692 [2:7561401485289481256:7237]
2025-10-15T10:59:34.826024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:34.826073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:34.826085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:34.826096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:34.826104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:34.826148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:34.826166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:34.826183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:34.826987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.827013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.827027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.827039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:34.827308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:34.827330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:34.827492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:34.827703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:34.827758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 692
2025-10-15T10:59:34.827794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 692, pipe: [1:7561401482489788873:8039]
2025-10-15T10:59:34.827866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 692
2025-10-15T10:59:34.827950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:34.828037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401482489788873:8039], now have 1 active actors on pipe
2025-10-15T10:59:34.828064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401482489788967:8040], now have 1 active actors on pipe
2025-10-15T10:59:34.828085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401482489788852:2467], now have 1 active actors on pipe
2025-10-15T10:59:34.828128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401485289481251:7237]
2025-10-15T10:59:34.828147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401485289481251:7237]
2025-10-15T10:59:34.828160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401485289481251:7237]
2025-10-15T10:59:34.828193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:34.828247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:34.828284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:34.828297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:34.828297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:34.828317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:34.828345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_8_10521366525245010318_v1 on pipe: [1:7561401482489788873:8039]
2025-10-15T10:59:34.828390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:34.828400Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_8_10521366525245010318_v1:1 with generation 692
2025-10-15T10:59:34.828572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:34.828594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:34.828655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:34.828675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:34.828811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:34.828839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:34.828850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:34.828909Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_8_10521366525245010318_v1
2025-10-15T10:59:34.828927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:34.829038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401485289481251:7237]
2025-10-15T10:59:34.829068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:34.829104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:34.829143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:34.829175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:59:34.829234Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:59:34.836743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:59:34.836822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:59:34.836846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:34.836863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:34.836869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:34.836910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:34.836947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:34.836973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T10:59:34.837001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:59:34.837037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:34.837359Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760525974826 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:59:34.837405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T10:59:34.837587Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 sending to client partition status
2025-10-15T10:59:34.837749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:34.837779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:34.837843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:34.838151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 693 partition: 0 MaxSeqNo: 46 sessionId: src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0
2025-10-15T10:59:34.838734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5f12ccb-c123ea06-672098f5-5f9a706f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:34.857891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:34.857923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:34.857956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401485289481251:7237]
2025-10-15T10:59:34.858061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:34.858215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:34.861876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:34.863232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:34.863453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0] Write session: try to update token
2025-10-15T10:59:34.863514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:34.865415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:34.867037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:34.869144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:34.898455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:34.933386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:34.933429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:34.933449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:34.933462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:34.933504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401485289481251:7237]
2025-10-15T10:59:34.933531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401485289481251:7237]
2025-10-15T10:59:34.933557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401485289481251:7237]
2025-10-15T10:59:34.933701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:34.933734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:34.933745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:34.933748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:34.933761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:34.933774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:34.933808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:34.933828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:34.935957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:34.967840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId: src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:34.994378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:35.081216Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:35.083421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:35.083467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:35.084194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_8_10521366525245010318_v1
2025-10-15T10:59:35.084241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:35.084302Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_8_10521366525245010318_v1
2025-10-15T10:59:35.084375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:35.084528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401482489788873:8039]
2025-10-15T10:59:35.084602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:35.084613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:35.092789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 693 reason: error at write: Disconnected sessionId: src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0
2025-10-15T10:59:35.093020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 693 sessionId: src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0 is DEAD
2025-10-15T10:59:35.093407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:35.093458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0] Write session will restart in 0.009704s
2025-10-15T10:59:35.093607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0] Write session: Do CDS request
2025-10-15T10:59:35.093646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:35.120177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:35.126106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:35.126137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 694
2025-10-15T10:59:35.127528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:35.127639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:35.127653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:35.127662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:35.132234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 694 sessionId:  describe result for acl check
2025-10-15T10:59:35.132361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:35.132371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:35.132380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:35.132395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401486784756486:8050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:35.134663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401486784756486:8050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:35.151819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401486784756486:8050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:35.163898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401486784756486:8050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:35.163928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401486784756486:8050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:35.163939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401486784756486:8050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:35.163958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:35.184754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401486784756705:8039]
2025-10-15T10:59:35.201464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:35.203224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:35.204038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:35.204068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:35.204108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:35.204355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:35.204539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401489584448842:7245]
2025-10-15T10:59:35.206765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:35.207834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:35.208045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:35.209287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:35.209602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:35.209620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:35.209628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:35.209636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:35.209643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:35.209651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:35.209658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:35.209665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:35.209672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:35.209679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:35.209686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:35.209693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.209699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.209706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.209759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:35.209876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:35.209930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:35.209983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:35.210040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:35.210098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:35.210147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:35.210201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:35.210256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:35.210308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:35.210378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:35.210430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.210480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.210533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.210579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:35.210654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:35.210711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:35.210766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:35.210820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:35.210875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:35.210921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:35.210978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:35.211027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:35.211085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:35.211140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:35.211201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:35.211255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:35.211324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:35.211414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:35.211472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:35.211520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:35.211577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:35.211622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:35.211677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:35.211726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:35.211781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:35.211828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.211879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.211925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.211979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.212026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.212082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.212593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:35.228672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:35.238737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:35.238787Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:35.238805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:35.238826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:35.238852Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 693 [2:7561401489584448842:7245]
2025-10-15T10:59:35.238907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:35.238971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:35.238988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:35.239001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:35.239012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:35.239066Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:35.239104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:35.239128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:35.240252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.240279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.240293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.240308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:35.240593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:35.240622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.240775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.240984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.241057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 693
2025-10-15T10:59:35.241063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 693
2025-10-15T10:59:35.241149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 693, pipe: [1:7561401486784756705:8039]
2025-10-15T10:59:35.241248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:35.241351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401486784756604:8050], now have 1 active actors on pipe
2025-10-15T10:59:35.241384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401486784756451:2467], now have 1 active actors on pipe
2025-10-15T10:59:35.241407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401486784756705:8039], now have 1 active actors on pipe
2025-10-15T10:59:35.241478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:35.241512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:35.241550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401489584448836:7245]
2025-10-15T10:59:35.241572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401489584448836:7245]
2025-10-15T10:59:35.241587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401489584448836:7245]
2025-10-15T10:59:35.241630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:35.241714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:35.241713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:35.241729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:35.241744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:35.241914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:35.241939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:35.242013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9200f0b0-6544428f-c434da2f-370022e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:35.242052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:35.242075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:35.242087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:35.242128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:35.242176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:35.242317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401489584448836:7245]
2025-10-15T10:59:35.242368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:35.242419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:35.242421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:35.243189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:35.243239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:35.243309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:35.243745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 694 partition: 0 MaxSeqNo: 46 sessionId: src_id|9200f0b0-6544428f-c434da2f-370022e0_0
2025-10-15T10:59:35.244479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b624a19-fe968ea1-98b44383-f71d9bdb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9200f0b0-6544428f-c434da2f-370022e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:35.268422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9200f0b0-6544428f-c434da2f-370022e0_0] Write session: try to update token
2025-10-15T10:59:35.268490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9200f0b0-6544428f-c434da2f-370022e0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:35.339025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:35.339048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:35.339057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:35.339064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:35.339096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401489584448836:7245]
2025-10-15T10:59:35.339113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401489584448836:7245]
2025-10-15T10:59:35.339129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401489584448836:7245]
2025-10-15T10:59:35.339242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:35.339269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:35.339277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:35.339288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:35.339305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:35.340358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:35.376198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId: src_id|9200f0b0-6544428f-c434da2f-370022e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:35.396487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:35.494229Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:35.512967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:35.513028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:35.513105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:35.513122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:35.513170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401489584448836:7245]
2025-10-15T10:59:35.513538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:35.514641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:35.514248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:35.514284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:35.515784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:35.516002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401486784756705:8039]
2025-10-15T10:59:35.524206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 694 reason: error at write: Disconnected sessionId: src_id|9200f0b0-6544428f-c434da2f-370022e0_0
2025-10-15T10:59:35.524508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 694 sessionId: src_id|9200f0b0-6544428f-c434da2f-370022e0_0 is DEAD
2025-10-15T10:59:35.524969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200f0b0-6544428f-c434da2f-370022e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:35.525047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200f0b0-6544428f-c434da2f-370022e0_0] Write session will restart in 0.009384s
2025-10-15T10:59:35.525226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200f0b0-6544428f-c434da2f-370022e0_0] Write session: Do CDS request
2025-10-15T10:59:35.525282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200f0b0-6544428f-c434da2f-370022e0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:35.550111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9200f0b0-6544428f-c434da2f-370022e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:35.552985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:35.553011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 695
2025-10-15T10:59:35.559580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:35.559727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:35.559748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:35.559757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:35.567007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 695 sessionId:  describe result for acl check
2025-10-15T10:59:35.567132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:35.567142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:35.567152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:35.567168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401486784756761:8057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:35.569785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401486784756761:8057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:35.575316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401486784756761:8057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:35.583201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401486784756761:8057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:35.583238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401486784756761:8057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:35.583254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401486784756761:8057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:35.583281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:35.616377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401486784756935:8039]
2025-10-15T10:59:35.683757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:35.688700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:35.689622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:35.689661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:35.689709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:35.689991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:35.690194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401489584449124:7250]
2025-10-15T10:59:35.692538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:35.693778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:35.694031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:35.695398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:35.695755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:35.695766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:35.695773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:35.695782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:35.695790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:35.695799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:35.695807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:35.695815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:35.695823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:35.695830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:35.695838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:35.695846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.695853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.695860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.695911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:35.696032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:35.696082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:35.696135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:35.696183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:35.696233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:35.696283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:35.696333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:35.696382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:35.696431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:35.696483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:35.696533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.696581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.696631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.696680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:35.696754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:35.696816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:35.696873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:35.696927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:35.696986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:35.697033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:35.697094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:35.697145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:35.697202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:35.697252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:35.697311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:35.697361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:35.697415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:35.697463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:35.697525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:35.697574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:35.697630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:35.697680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:35.697737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:35.697784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:35.697840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:35.697887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.697943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.697994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.698050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.698095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.698154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.699990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:35.725013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:35.740562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:35.740609Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:35.740626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:35.740644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:35.740668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 694 [2:7561401489584449124:7250]
2025-10-15T10:59:35.740717Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:35.740770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:35.740784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:35.740796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:35.740807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:35.740848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:35.740870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:35.740890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:35.761167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.761544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.761570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.761579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:35.762096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 694, pipe: [1:7561401486784756935:8039]
2025-10-15T10:59:35.762112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 694
2025-10-15T10:59:35.762190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 694
2025-10-15T10:59:35.761865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:35.761890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:35.762004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:35.762153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:35.762369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:35.762444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401486784756745:2467], now have 1 active actors on pipe
2025-10-15T10:59:35.762466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401486784756935:8039], now have 1 active actors on pipe
2025-10-15T10:59:35.762485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401486784756799:8057], now have 1 active actors on pipe
2025-10-15T10:59:35.762507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401489584449119:7250]
2025-10-15T10:59:35.762519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401489584449119:7250]
2025-10-15T10:59:35.762530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401489584449119:7250]
2025-10-15T10:59:35.762567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:35.762634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:35.762661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:35.762673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:35.762683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:35.762793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:35.762809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:35.762957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:35.762975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:35.763004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401489584449119:7250]
2025-10-15T10:59:35.763034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:35.763061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:35.763127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:35.763154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:35.763170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:35.763179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:35.763210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:35.763244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:35.763323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:35.764282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:35.764315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:35.764375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:35.764675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 695 partition: 0 MaxSeqNo: 46 sessionId: src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0
2025-10-15T10:59:35.765350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200f0b0-6544428f-c434da2f-370022e0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:35.805717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0] Write session: try to update token
2025-10-15T10:59:35.805780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:35.848093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:35.848133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:35.848145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:35.848206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:35.848221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:35.848232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:35.848244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:35.848281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401489584449119:7250]
2025-10-15T10:59:35.848307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401489584449119:7250]
2025-10-15T10:59:35.848330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401489584449119:7250]
2025-10-15T10:59:35.848481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:35.848504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:35.848631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:35.848664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:35.848691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:35.860560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:35.916096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId: src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:35.936294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:36.014076Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:36.025486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:36.025535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:36.026309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:36.026387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401486784756935:8039]
2025-10-15T10:59:36.026548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:36.026569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:36.029979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:36.046681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 695 reason: error at write: Disconnected sessionId: src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0
2025-10-15T10:59:36.047071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 695 sessionId: src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0 is DEAD
2025-10-15T10:59:36.048140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:36.048203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0] Write session will restart in 0.005368s
2025-10-15T10:59:36.048331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0] Write session: Do CDS request
2025-10-15T10:59:36.048381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:36.062275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:36.062257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:36.062292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 696
2025-10-15T10:59:36.062868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:36.063018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:36.063042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:36.063064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:36.065211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 696 sessionId:  describe result for acl check
2025-10-15T10:59:36.065392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:36.065419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:36.065438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:36.065466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401491079724355:8063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:36.069021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401491079724355:8063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:36.076250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401491079724355:8063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:36.084914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401491079724355:8063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:36.084955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401491079724355:8063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:36.084973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401491079724355:8063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:36.085006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:36.127279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401491079724609:8039]
2025-10-15T10:59:36.148616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:36.152188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:36.153124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:36.153146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:36.153187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:36.153427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:36.153596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401493879416736:7259]
2025-10-15T10:59:36.155357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:36.156369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:36.156569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:36.157713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:36.158025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:36.158042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:36.158048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:36.158055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:36.158062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:36.158070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:36.158076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:36.158083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:36.158089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:36.158096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:36.158103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:36.158110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.158117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.158123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.158165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:36.158267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:36.158314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:36.158394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:36.158449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:36.158499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:36.158544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:36.158596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:36.158646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:36.158693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:36.158739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:36.158791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.158844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.158893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.158935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:36.159002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:36.159063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:36.159124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:36.159173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:36.159230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:36.159277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:36.159333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:36.159479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:36.159536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:36.159586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:36.159656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:36.159709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:36.159767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:36.159818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:36.159876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:36.159945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:36.160006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:36.160056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:36.160110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:36.160162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:36.160213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:36.160264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.160323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.160372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.160430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.160480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.160535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.161033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:36.178115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:36.186723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:36.186772Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:36.186789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:36.186807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:36.186830Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 695 [2:7561401493879416736:7259]
2025-10-15T10:59:36.186879Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:36.186937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:36.186950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:36.186963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:36.186973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:36.187016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:36.187036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:36.187054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:36.188065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.188090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.188103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.188114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:36.188375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:36.188402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.188536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.188733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.188674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 695, pipe: [1:7561401491079724609:8039]
2025-10-15T10:59:36.188790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 695
2025-10-15T10:59:36.188819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 695
2025-10-15T10:59:36.188965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:36.189046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401491079724609:8039], now have 1 active actors on pipe
2025-10-15T10:59:36.189076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401491079724391:8063], now have 1 active actors on pipe
2025-10-15T10:59:36.189098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401491079724341:2467], now have 1 active actors on pipe
2025-10-15T10:59:36.189142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:36.189181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:36.189234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401493879416724:7259]
2025-10-15T10:59:36.189254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401493879416724:7259]
2025-10-15T10:59:36.189267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401493879416724:7259]
2025-10-15T10:59:36.189294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:36.189349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:36.189352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:36.189368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:36.189379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:36.189515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:36.189534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:36.189575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:36.189593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:36.189605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:36.189613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:36.189636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:36.189661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:36.189746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401493879416724:7259]
2025-10-15T10:59:36.189767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:36.189780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:36.189796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:36.190218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:36.190247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:36.190290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:36.190634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 696 partition: 0 MaxSeqNo: 46 sessionId: src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0
2025-10-15T10:59:36.191339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd83371f-7c19431-734d5b2e-7b6565d2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:36.219419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0] Write session: try to update token
2025-10-15T10:59:36.219470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:36.235628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:36.235661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:36.235693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401493879416724:7259]
2025-10-15T10:59:36.235798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:36.236875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:36.241145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:36.273281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:36.289441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:36.290750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:36.294252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:36.294747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:36.294768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:36.294780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:36.294880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:36.317338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId: src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:36.344403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:36.344437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:36.344449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:36.344460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:36.344495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401493879416724:7259]
2025-10-15T10:59:36.344521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401493879416724:7259]
2025-10-15T10:59:36.344545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401493879416724:7259]
2025-10-15T10:59:36.344668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:36.344678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:36.344699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:36.344713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:36.344745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:36.348783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:36.352260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:36.488890Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:36.490927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:36.490972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:36.491939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401491079724609:8039]
2025-10-15T10:59:36.492068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:36.492081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:36.492312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:36.503910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:36.504466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 696 reason: error at write: Disconnected sessionId: src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0
2025-10-15T10:59:36.504822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 696 sessionId: src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0 is DEAD
2025-10-15T10:59:36.507835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:36.507880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0] Write session will restart in 0.009715s
2025-10-15T10:59:36.507990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0] Write session: Do CDS request
2025-10-15T10:59:36.508027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:36.528673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:36.534620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:36.534652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 697
2025-10-15T10:59:36.535044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:36.535166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:36.535189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:36.535198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:36.536571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 697 sessionId:  describe result for acl check
2025-10-15T10:59:36.536701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:36.536721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:36.536729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:36.536746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401491079724652:8073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:36.539318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401491079724652:8073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:36.543948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401491079724652:8073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:36.550197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401491079724652:8073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:36.550257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401491079724652:8073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:36.550277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401491079724652:8073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:36.550322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:36.591859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401491079724795:8039]
2025-10-15T10:59:36.644507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:36.647584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:36.648460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:36.648491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:36.648536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:36.648789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:36.648976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401493879417016:7267]
2025-10-15T10:59:36.651158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:36.652367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:36.652631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:36.653893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:36.654216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:36.654235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:36.654241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:36.654247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:36.654254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:36.654261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:36.654267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:36.654273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:36.654279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:36.654287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:36.654293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:36.654299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.654304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.654310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.654355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:36.654465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:36.654510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:36.654554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:36.654597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:36.654638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:36.654690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:36.654731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:36.654778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:36.654826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:36.654874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:36.654916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.654960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.655006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.655054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:36.655122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:36.655183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:36.655238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:36.655284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:36.655334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:36.655426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:36.655484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:36.655537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:36.655592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:36.655635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:36.655687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:36.655741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:36.655791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:36.655838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:36.655891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:36.655939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:36.655990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:36.656050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:36.656110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:36.656159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:36.656208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:36.656256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.656312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.656356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.656408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.656463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.656513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.656986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:36.669111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:59:36.669171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-15T10:59:36.680131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:36.689822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:36.689866Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:36.689884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:36.689900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:36.689923Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 696 [2:7561401493879417016:7267]
2025-10-15T10:59:36.689971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:36.690021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:36.690042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:36.690053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:36.690063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:36.690106Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:36.690132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:36.690157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:36.691861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.691900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.691915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.691926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:36.692217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:36.692242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:36.692382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:36.692575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:36.692532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 696, pipe: [1:7561401491079724795:8039]
2025-10-15T10:59:36.692634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 696
2025-10-15T10:59:36.692755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 696
2025-10-15T10:59:36.692816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:36.692904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401491079724795:8039], now have 1 active actors on pipe
2025-10-15T10:59:36.692931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401491079724687:8073], now have 1 active actors on pipe
2025-10-15T10:59:36.692954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401491079724642:2467], now have 1 active actors on pipe
2025-10-15T10:59:36.692979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401493879417011:7267]
2025-10-15T10:59:36.692994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401493879417011:7267]
2025-10-15T10:59:36.693006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401493879417011:7267]
2025-10-15T10:59:36.693034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:36.693097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:36.693111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:36.693123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:36.693134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:36.693270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:36.693290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:36.693423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:36.693448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:36.693529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401493879417011:7267]
2025-10-15T10:59:36.693563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:36.693629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:36.693685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b8011e0-ff94a380-7410110b-e7722018_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:36.693717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:36.693737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:36.693747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:36.693778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:36.693814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:36.693956Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:59:36.694094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:36.694573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 12 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:59:36.694728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:59:36.695460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:36.695488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:36.695557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:36.695847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 697 partition: 0 MaxSeqNo: 46 sessionId: src_id|6b8011e0-ff94a380-7410110b-e7722018_0
2025-10-15T10:59:36.696645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb0024fa-8c74a9a-edb55f36-ac57a5c6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6b8011e0-ff94a380-7410110b-e7722018_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:36.720720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8011e0-ff94a380-7410110b-e7722018_0] Write session: try to update token
2025-10-15T10:59:36.720783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8011e0-ff94a380-7410110b-e7722018_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:36.803612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:36.804274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:36.804296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:36.804355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:36.804369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:36.804383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:36.804392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:36.804426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401493879417011:7267]
2025-10-15T10:59:36.804468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401493879417011:7267]
2025-10-15T10:59:36.804500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401493879417011:7267]
2025-10-15T10:59:36.804628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:36.804650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:36.804658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:36.804722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:36.804758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:36.812169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:36.830534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId: src_id|6b8011e0-ff94a380-7410110b-e7722018_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:36.853100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:36.968955Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:36.970513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:36.970560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:36.971294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:36.971309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401491079724795:8039]
2025-10-15T10:59:36.971341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:36.971447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:36.971516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-15T10:59:36.975102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:37.025090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8011e0-ff94a380-7410110b-e7722018_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:37.025162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8011e0-ff94a380-7410110b-e7722018_0] Write session will restart in 0.005682s
2025-10-15T10:59:37.025313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8011e0-ff94a380-7410110b-e7722018_0] Write session: Do CDS request
2025-10-15T10:59:37.025365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8011e0-ff94a380-7410110b-e7722018_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:37.024330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 697 reason: error at write: Disconnected sessionId: src_id|6b8011e0-ff94a380-7410110b-e7722018_0
2025-10-15T10:59:37.024637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 697 sessionId: src_id|6b8011e0-ff94a380-7410110b-e7722018_0 is DEAD
2025-10-15T10:59:37.035510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8011e0-ff94a380-7410110b-e7722018_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:37.035365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:37.035403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 698
2025-10-15T10:59:37.035990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:37.036113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:37.036129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:37.036141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:37.037767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 698 sessionId:  describe result for acl check
2025-10-15T10:59:37.037878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:37.037889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:37.037898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:37.037918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401495374692355:8082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:37.042252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401495374692355:8082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:37.049345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401495374692355:8082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:37.062353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401495374692355:8082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:37.062415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401495374692355:8082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:37.062432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401495374692355:8082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:37.062463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:37.071486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401495374692525:8039]
2025-10-15T10:59:37.085976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:37.089862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:37.090814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:37.090844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:37.090893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:37.091167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:37.091385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401498174384600:7272]
2025-10-15T10:59:37.093434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:37.094724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:37.094959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:37.096270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:37.096650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:37.096669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:37.096676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:37.096684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:37.096690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:37.096698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:37.096705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:37.096711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:37.096719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:37.096727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:37.096734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:37.096741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.096747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.096754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.096803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:37.096920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:37.096971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:37.097020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:37.097080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:37.097137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:37.097190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:37.097245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:37.097303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:37.097353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:37.097405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:37.097458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.097510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.097565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.097618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:37.097694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:37.097760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:37.097826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:37.097882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:37.097942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:37.097995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:37.098058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:37.098120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:37.098185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:37.098240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:37.098299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:37.098355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:37.098431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:37.098487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:37.098548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:37.098606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:37.098666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:37.098721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:37.098785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:37.098839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:37.098898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:37.098953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.099015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.099070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.099131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.099184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.099244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.099741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:37.117784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:37.126336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:37.126397Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:37.126416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:37.126437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:37.126464Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 697 [2:7561401498174384600:7272]
2025-10-15T10:59:37.126522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:37.126588Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:37.126603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:37.126617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:37.126629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:37.126680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:37.126714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:37.126736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:37.149564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.149597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.149606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.149615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:37.149864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:37.149887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.150013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.150174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.150393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:37.150461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401498174384595:7272]
2025-10-15T10:59:37.150476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401498174384595:7272]
2025-10-15T10:59:37.150488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401498174384595:7272]
2025-10-15T10:59:37.150527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:37.150611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:37.150724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:37.150740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:37.150764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:37.150778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:37.150795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:37.150917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401498174384595:7272]
2025-10-15T10:59:37.150935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:37.150988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:37.151095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401495374692525:8039], now have 1 active actors on pipe
2025-10-15T10:59:37.151480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 697, pipe: [1:7561401495374692525:8039]
2025-10-15T10:59:37.151119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401491079724960:2467], now have 1 active actors on pipe
2025-10-15T10:59:37.151138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401495374692482:8082], now have 1 active actors on pipe
2025-10-15T10:59:37.151512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 697
2025-10-15T10:59:37.151599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 697
2025-10-15T10:59:37.151880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:37.151912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:37.152060Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:59:37.152165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c700ea42-d8784eab-788442a-8e54e2ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:37.152207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:37.152235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:37.152247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:37.152283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:37.152332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:37.152387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:37.153239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 13 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T10:59:37.153378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:59:37.159790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:37.159840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:37.159941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:37.163404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 698 partition: 0 MaxSeqNo: 46 sessionId: src_id|c700ea42-d8784eab-788442a-8e54e2ae_0
2025-10-15T10:59:37.164074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b8011e0-ff94a380-7410110b-e7722018_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c700ea42-d8784eab-788442a-8e54e2ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:37.188441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c700ea42-d8784eab-788442a-8e54e2ae_0] Write session: try to update token
2025-10-15T10:59:37.188492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c700ea42-d8784eab-788442a-8e54e2ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:37.271968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:37.271995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:37.272004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:37.272011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:37.272041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401498174384595:7272]
2025-10-15T10:59:37.272057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401498174384595:7272]
2025-10-15T10:59:37.272072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401498174384595:7272]
2025-10-15T10:59:37.272218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:37.272228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:37.272236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:37.272244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:37.272253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:37.272273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:37.272286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:37.272291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:37.273191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:37.287211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId: src_id|c700ea42-d8784eab-788442a-8e54e2ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:37.308178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:37.421350Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:37.433993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:37.434038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:37.434101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:37.434113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:37.434150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401498174384595:7272]
2025-10-15T10:59:37.434306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:37.434689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:37.436221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401495374692525:8039]
2025-10-15T10:59:37.436224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:37.436386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:37.463246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 698 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c700ea42-d8784eab-788442a-8e54e2ae_0
2025-10-15T10:59:37.463590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 698 sessionId: src_id|c700ea42-d8784eab-788442a-8e54e2ae_0 is DEAD
2025-10-15T10:59:37.463879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c700ea42-d8784eab-788442a-8e54e2ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:37.463922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c700ea42-d8784eab-788442a-8e54e2ae_0] Write session will restart in 0.007703s
2025-10-15T10:59:37.464091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c700ea42-d8784eab-788442a-8e54e2ae_0] Write session: Do CDS request
2025-10-15T10:59:37.464132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c700ea42-d8784eab-788442a-8e54e2ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:37.476122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c700ea42-d8784eab-788442a-8e54e2ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:37.479605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:37.479636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 699
2025-10-15T10:59:37.480971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:37.481096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:37.481117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:37.481127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:37.482618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 699 sessionId:  describe result for acl check
2025-10-15T10:59:37.482732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:37.482749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:37.482758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:37.482788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401495374692567:8086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:37.485387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401495374692567:8086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:37.492411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401495374692567:8086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:37.503482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401495374692567:8086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:37.503527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401495374692567:8086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:37.503544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401495374692567:8086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:37.503576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:37.536353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401495374692821:8039]
2025-10-15T10:59:37.552446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:37.554589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:37.555389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:37.555412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:37.555443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:37.555615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:37.555793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401498174384906:7283]
2025-10-15T10:59:37.557819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:37.558691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:37.558851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:37.559938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:37.560263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:37.560285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:37.560292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:37.560300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:37.560306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:37.560313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:37.560319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:37.560329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:37.560336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:37.560342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:37.560348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:37.560355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.560361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.560367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.560427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:37.560527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:37.560571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:37.560620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:37.560672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:37.560719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:37.560772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:37.560816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:37.560860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:37.560912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:37.560962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:37.561013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.561055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.561097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.561141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:37.561203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:37.561255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:37.561308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:37.561352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:37.561404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:37.561449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:37.561499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:37.561545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:37.561593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:37.561638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:37.561690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:37.561737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:37.561785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:37.561827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:37.561877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:37.561923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:37.561974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:37.562015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:37.562562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:37.562621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:37.562670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:37.562711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.562789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.562836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.562885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.562926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.562975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.563486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:37.584658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:37.594958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:37.595013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:37.595030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:37.595046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:37.595070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 698 [2:7561401498174384906:7283]
2025-10-15T10:59:37.595120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:37.595173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:37.595186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:37.595199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:37.595208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:37.595268Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:37.595288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:37.595306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:37.596839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.596866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.596878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.596888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:37.597115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:37.597142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:37.597273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:37.597465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:37.597462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 698
2025-10-15T10:59:37.597473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 698, pipe: [1:7561401495374692821:8039]
2025-10-15T10:59:37.597591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 698
2025-10-15T10:59:37.597693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:37.597777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401495374692551:2467], now have 1 active actors on pipe
2025-10-15T10:59:37.597802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401495374692821:8039], now have 1 active actors on pipe
2025-10-15T10:59:37.597824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401495374692641:8086], now have 1 active actors on pipe
2025-10-15T10:59:37.597893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:37.597920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:37.597955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401498174384901:7283]
2025-10-15T10:59:37.597969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401498174384901:7283]
2025-10-15T10:59:37.597981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401498174384901:7283]
2025-10-15T10:59:37.598024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:37.598095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:37.598264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:37.598280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:37.598328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:37.598344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:37.598345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:37.598356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:37.598387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:37.598403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:37.598413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:37.598445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:37.598483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:37.598591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401498174384901:7283]
2025-10-15T10:59:37.598620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:37.598635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:37.598654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:37.599078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:37.599101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:37.599156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:37.599755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 699 partition: 0 MaxSeqNo: 46 sessionId: src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0
2025-10-15T10:59:37.600456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c700ea42-d8784eab-788442a-8e54e2ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:37.620761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0] Write session: try to update token
2025-10-15T10:59:37.620812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:37.659300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:37.659341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:37.659397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401498174384901:7283]
2025-10-15T10:59:37.659524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:37.659733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:37.662170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:37.664443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:37.665658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:37.672382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:37.673939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:37.674485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:37.746874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:37.746911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:37.746921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:37.746972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:37.746985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:37.746998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:37.747006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:37.747041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401498174384901:7283]
2025-10-15T10:59:37.747065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401498174384901:7283]
2025-10-15T10:59:37.747088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401498174384901:7283]
2025-10-15T10:59:37.747196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:37.747207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:37.747223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:37.747233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:37.747263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:37.755759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:37.771651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId: src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:37.795026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:37.893343Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:37.895176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:37.895218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:37.895853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:37.895895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:37.895882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:37.906238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:37.906405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401495374692821:8039]
2025-10-15T10:59:37.906483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 699 reason: error at write: Disconnected sessionId: src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0
2025-10-15T10:59:37.906847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 699 sessionId: src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0 is DEAD
2025-10-15T10:59:37.907236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:37.907293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0] Write session will restart in 0.006290s
2025-10-15T10:59:37.907478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0] Write session: Do CDS request
2025-10-15T10:59:37.907524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:37.919333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:37.940984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:37.941012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 700
2025-10-15T10:59:37.941519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:37.941641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:37.941656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:37.941668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:37.943025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 700 sessionId:  describe result for acl check
2025-10-15T10:59:37.943130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:37.943143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:37.943152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:37.943170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401495374692881:8098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:37.945897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401495374692881:8098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:37.951968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401495374692881:8098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:37.965504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401495374692881:8098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:37.965550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401495374692881:8098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:37.965567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401495374692881:8098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:37.965600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:38.006336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401499669660432:8039]
2025-10-15T10:59:38.011617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:38.013520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:38.014306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:38.014340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:38.014395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:38.014640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:38.014832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401502469352498:7290]
2025-10-15T10:59:38.017002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:38.018146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:38.018406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:38.047213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:38.047858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:38.047880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:38.047888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:38.047894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:38.047902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:38.047908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:38.047914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:38.047921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:38.047929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:38.047935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:38.047941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:38.047948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.047955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.047962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.048014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:38.048137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:38.048180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:38.048227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:38.048272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:38.048325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:38.048366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:38.048412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:38.048461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:38.048510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:38.048556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:38.048599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.048645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.048691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.048733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:38.048808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:38.048870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:38.048923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:38.048975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:38.049024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:38.049069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:38.049123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:38.049170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:38.049224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:38.049269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:38.049319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:38.049367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:38.049420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:38.049467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:38.049520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:38.049568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:38.049625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:38.049673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:38.049726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:38.049779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:38.049833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:38.049883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.049932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.049977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.050034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.050082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.050133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.050641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:38.068142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:38.079107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:38.079152Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:38.079166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:38.079184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:38.079206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 699 [2:7561401502469352498:7290]
2025-10-15T10:59:38.079266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:38.079315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:38.079327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:38.079338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:38.079363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:38.079405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:38.079424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:38.079442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:38.081185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.081211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.081224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.081233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:38.081484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:38.081510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.081634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.081812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.082026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:38.082103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401502469352493:7290]
2025-10-15T10:59:38.082116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401502469352493:7290]
2025-10-15T10:59:38.082129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401502469352493:7290]
2025-10-15T10:59:38.082166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:38.082230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:38.082368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:38.082402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:38.082413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:38.082419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:38.082428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:38.082531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401502469352493:7290]
2025-10-15T10:59:38.082565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:38.082686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:38.083132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401495374692870:2467], now have 1 active actors on pipe
2025-10-15T10:59:38.083167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401499669660432:8039], now have 1 active actors on pipe
2025-10-15T10:59:38.082958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 699
2025-10-15T10:59:38.083187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401495374692969:8098], now have 1 active actors on pipe
2025-10-15T10:59:38.083073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 699, pipe: [1:7561401499669660432:8039]
2025-10-15T10:59:38.083153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 699
2025-10-15T10:59:38.083301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:38.083326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:38.083405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:38.083445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:38.083461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:38.083471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:38.083501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:38.083539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:38.083578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:38.084070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:38.084101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:38.084160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:38.084465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 700 partition: 0 MaxSeqNo: 46 sessionId: src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0
2025-10-15T10:59:38.085253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e05e749-5336b33e-ca0b9f9d-a4bbf385_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:38.106365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0] Write session: try to update token
2025-10-15T10:59:38.106437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:38.133905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:38.133965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:38.134034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401502469352493:7290]
2025-10-15T10:59:38.134220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:38.134223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:38.137112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:38.139166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:38.141426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:38.143455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:38.145063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:38.145738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:38.189451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId: src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:38.212443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:38.212483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:38.212496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:38.212508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:38.212548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401502469352493:7290]
2025-10-15T10:59:38.212574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401502469352493:7290]
2025-10-15T10:59:38.212597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401502469352493:7290]
2025-10-15T10:59:38.212741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:38.212762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:38.212778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:38.212789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:38.212806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:38.212814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:38.212858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:38.212881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:38.213906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:38.219959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:38.357808Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:38.359479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:38.359521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:38.359995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:38.360157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401499669660432:8039]
2025-10-15T10:59:38.360241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:38.360257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:38.360259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:38.409733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 700 reason: error at write: Disconnected sessionId: src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0
2025-10-15T10:59:38.410103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 700 sessionId: src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0 is DEAD
2025-10-15T10:59:38.412034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:38.412100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0] Write session will restart in 0.007071s
2025-10-15T10:59:38.412280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0] Write session: Do CDS request
2025-10-15T10:59:38.412324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:38.423141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:38.424007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:38.424037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 701
2025-10-15T10:59:38.424346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:38.424476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:38.424497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:38.424507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:38.427768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 701 sessionId:  describe result for acl check
2025-10-15T10:59:38.427886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:38.427903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:38.427914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:38.427933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401499669660523:8105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:38.430723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401499669660523:8105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:38.450562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401499669660523:8105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:38.461380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401499669660640:8039]
2025-10-15T10:59:38.472457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401499669660523:8105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:38.472501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401499669660523:8105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:38.472519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401499669660523:8105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:38.472552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:38.525201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:38.527949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:38.528795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:38.528814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:38.528859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:38.529153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:38.529338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401502469352800:7296]
2025-10-15T10:59:38.533472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:38.534830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:38.535077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:38.536451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:38.536783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:38.536791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:38.536799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:38.536806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:38.536813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:38.536819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:38.536826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:38.536834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:38.536841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:38.536849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:38.536856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:38.536863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.536870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.536878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.536929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:38.537048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:38.537100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:38.537150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:38.537197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:38.537248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:38.537293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:38.537340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:38.537387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:38.537436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:38.537483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:38.537528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.537573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.537619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.537669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:38.537737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:38.537800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:38.537860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:38.537911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:38.537968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:38.538016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:38.538072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:38.538122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:38.538179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:38.538226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:38.538282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:38.538331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:38.538384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:38.538449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:38.538503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:38.538553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:38.538607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:38.538656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:38.538709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:38.538759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:38.538818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:38.538867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.538920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.538967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.539024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.539082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.539145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.540916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:38.568751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:38.579310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:38.579390Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:38.579410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:38.579431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:38.579458Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 700 [2:7561401502469352800:7296]
2025-10-15T10:59:38.579515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:38.579583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:38.579599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:38.579613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:38.579624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:38.579676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:38.579699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:38.579723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:38.580731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.580759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.580773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.580784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:38.581056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:38.581074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:38.581233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:38.581434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:38.581680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:38.581751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401502469352795:7296]
2025-10-15T10:59:38.581768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401502469352795:7296]
2025-10-15T10:59:38.581783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401502469352795:7296]
2025-10-15T10:59:38.581830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:38.581905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:38.581986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:38.582000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:38.582012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:38.582099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:38.582117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:38.582238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401502469352795:7296]
2025-10-15T10:59:38.582261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:38.582312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:38.582353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401499669660686:8105], now have 1 active actors on pipe
2025-10-15T10:59:38.582420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401499669660640:8039], now have 1 active actors on pipe
2025-10-15T10:59:38.582442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401499669660466:2467], now have 1 active actors on pipe
2025-10-15T10:59:38.583343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:38.582608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 700
2025-10-15T10:59:38.583409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:38.582607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 700
2025-10-15T10:59:38.582680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 700, pipe: [1:7561401499669660640:8039]
2025-10-15T10:59:38.583509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:38.583554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:38.583578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:38.583591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:38.583642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:38.583688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:38.583751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:38.585111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:38.585153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:38.585226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:38.586371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf0e436-21c28a30-2a604d8d-5992d1d0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:38.585694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 701 partition: 0 MaxSeqNo: 46 sessionId: src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0
2025-10-15T10:59:38.613442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0] Write session: try to update token
2025-10-15T10:59:38.613510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:38.731874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:38.731913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:38.731923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:38.731982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:38.731998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:38.732011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:38.732022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:38.732059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401502469352795:7296]
2025-10-15T10:59:38.732086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401502469352795:7296]
2025-10-15T10:59:38.732110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401502469352795:7296]
2025-10-15T10:59:38.732275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:38.732272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:38.732300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:38.732330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:38.732366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:38.733209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:38.761574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId: src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:38.789584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:38.883919Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:38.886703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:38.886745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:38.891950Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:38.890934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:38.890980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:38.891245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401499669660640:8039]
2025-10-15T10:59:38.891344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:38.917900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 701 reason: error at write: Disconnected sessionId: src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0
2025-10-15T10:59:38.918177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 701 sessionId: src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0 is DEAD
2025-10-15T10:59:38.923729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:38.923805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0] Write session will restart in 0.009922s
2025-10-15T10:59:38.923998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0] Write session: Do CDS request
2025-10-15T10:59:38.924066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:38.938181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:38.938270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:38.938203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 702
2025-10-15T10:59:38.938784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:38.938929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:38.938960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:38.938972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:38.940503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 702 sessionId:  describe result for acl check
2025-10-15T10:59:38.940614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:38.940630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:38.940639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:38.940656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401499669660796:8111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:38.943061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401499669660796:8111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:38.956917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401499669660796:8111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:38.976046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401499669660796:8111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:38.976083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401499669660796:8111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:38.976100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401499669660796:8111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:38.976131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:38.991484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401499669661000:8039]
2025-10-15T10:59:39.014006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:39.022170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:39.023107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:39.023126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:39.023171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:39.023451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:39.023628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401506764320391:7304]
2025-10-15T10:59:39.026613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:39.033150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:39.033407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:39.034707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:39.035024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:39.035032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:39.035038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:39.035045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:39.035052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:39.035060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:39.035067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:39.035074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:39.035081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:39.035088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:39.035094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:39.035101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.035108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.035115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.035163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:39.035275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:39.035326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:39.035906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:39.035964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:39.036011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:39.036058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:39.036103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:39.036147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:39.036195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:39.036238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:39.036292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.036337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.036384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.036430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:39.036498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:39.036561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:39.036618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:39.036669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:39.036725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:39.036770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:39.036824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:39.036870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:39.036924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:39.036969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:39.037021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:39.037067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:39.037125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:39.037167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:39.037219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:39.037270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:39.037322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:39.037368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:39.037424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:39.037470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:39.037526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:39.037571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.037625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.037673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.037731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.037778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.037830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.038368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:39.062796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:39.073149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:39.073195Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:39.073211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:39.073228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:39.073254Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 701 [2:7561401506764320391:7304]
2025-10-15T10:59:39.073304Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:39.073356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:39.073370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:39.073382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:39.073393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:39.073439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:39.073462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:39.073491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:39.074471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.074497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.074510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.074522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:39.074776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:39.074802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.074939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.075126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.075487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:39.075565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401506764320386:7304]
2025-10-15T10:59:39.075580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401506764320386:7304]
2025-10-15T10:59:39.075592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401506764320386:7304]
2025-10-15T10:59:39.075633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:39.075712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:39.075809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:39.075825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:39.075837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:39.075906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:39.075930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:39.076101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401499669660921:8111], now have 1 active actors on pipe
2025-10-15T10:59:39.076126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401499669661000:8039], now have 1 active actors on pipe
2025-10-15T10:59:39.076147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401499669660773:2467], now have 1 active actors on pipe
2025-10-15T10:59:39.076166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401506764320386:7304]
2025-10-15T10:59:39.076195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:39.076326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 701
2025-10-15T10:59:39.076546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:39.076410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 701, pipe: [1:7561401499669661000:8039]
2025-10-15T10:59:39.076483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 701
2025-10-15T10:59:39.076869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:39.076904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:39.076977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:39.077009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:39.077029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:39.077039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:39.077076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:39.077116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:39.077188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:39.079652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 702 partition: 0 MaxSeqNo: 46 sessionId: src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0
2025-10-15T10:59:39.080392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b61bf61f-e3ea92cf-ca045e16-c793b64b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:39.079287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:39.079322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:39.079409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:39.110637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0] Write session: try to update token
2025-10-15T10:59:39.110696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:39.193022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId: src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:39.216131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:39.217607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:39.217643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:39.217705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:39.217720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:39.217734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:39.217767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:39.217800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401506764320386:7304]
2025-10-15T10:59:39.217826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401506764320386:7304]
2025-10-15T10:59:39.217852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401506764320386:7304]
2025-10-15T10:59:39.218057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:39.218079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:39.218222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:39.218255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:39.218286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:39.219773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:39.232383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:39.369535Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:39.381860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:39.381912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:39.381983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:39.381998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:39.382037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401506764320386:7304]
2025-10-15T10:59:39.382239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:39.382665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:39.382595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401499669661000:8039]
2025-10-15T10:59:39.382690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:39.382805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:39.382816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:39.399272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:39.399337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0] Write session will restart in 0.007188s
2025-10-15T10:59:39.395653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 702 reason: error at write: Disconnected sessionId: src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0
2025-10-15T10:59:39.399454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0] Write session: Do CDS request
2025-10-15T10:59:39.395963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 702 sessionId: src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0 is DEAD
2025-10-15T10:59:39.399490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:39.414999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:39.448648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:39.448672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 703
2025-10-15T10:59:39.449060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:39.449141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:39.449153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:39.449159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:39.452488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 703 sessionId:  describe result for acl check
2025-10-15T10:59:39.452617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:39.452636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:39.452645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:39.452662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401503964628479:8123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:39.455314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401503964628479:8123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:39.464944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401503964628479:8123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:39.477216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401503964628479:8123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:39.477260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401503964628479:8123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:39.477278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401503964628479:8123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:39.477311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:39.482983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401503964628653:8039]
2025-10-15T10:59:39.492148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:39.498865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:39.499744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:39.499784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:39.499830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:39.500076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:39.500290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401506764320704:7313]
2025-10-15T10:59:39.502606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:39.503629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:39.503823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:39.504891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:39.505183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:39.505191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:39.505197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:39.505203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:39.505210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:39.505215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:39.505222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:39.505228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:39.505235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:39.505242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:39.505249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:39.505256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.505263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.505270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.505316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:39.505412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:39.505460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:39.505508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:39.505552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:39.505599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:39.505642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:39.505684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:39.505729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:39.505772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:39.505817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:39.505863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.505913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.505958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.505999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:39.506057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:39.506112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:39.506163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:39.506230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:39.506288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:39.506332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:39.506384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:39.506446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:39.506497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:39.506549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:39.506605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:39.506651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:39.506702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:39.506746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:39.506800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:39.506848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:39.506897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:39.506942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:39.506995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:39.507038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:39.507087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:39.507131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.507194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.507246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.507295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.507338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.507414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.507911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:39.525234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:39.535121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:39.535156Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:39.535166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:39.535180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:39.535206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 702 [2:7561401506764320704:7313]
2025-10-15T10:59:39.535257Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:39.535312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:39.535326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:39.535338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:39.535365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:39.535409Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:39.535428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:39.535447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:39.543020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.543052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.543066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.543077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:39.543384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:39.543409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:39.543543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:39.543705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 702, pipe: [1:7561401503964628653:8039]
2025-10-15T10:59:39.543744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:39.543816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 702
2025-10-15T10:59:39.543888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 702
2025-10-15T10:59:39.543970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:39.544066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401503964628653:8039], now have 1 active actors on pipe
2025-10-15T10:59:39.544102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401503964628646:8123], now have 1 active actors on pipe
2025-10-15T10:59:39.544124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401503964628380:2467], now have 1 active actors on pipe
2025-10-15T10:59:39.544147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401506764320699:7313]
2025-10-15T10:59:39.544166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401506764320699:7313]
2025-10-15T10:59:39.544178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401506764320699:7313]
2025-10-15T10:59:39.544214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:39.544305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:39.544321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:39.544330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:39.544340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:39.544353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:39.544374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:39.544536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:39.544561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:39.544737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:39.544774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:39.544792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:39.544802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:39.544835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:39.544872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:39.544910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401506764320699:7313]
2025-10-15T10:59:39.544940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:39.545021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:39.545043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:39.545483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:39.545509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:39.545567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:39.545828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 703 partition: 0 MaxSeqNo: 46 sessionId: src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0
2025-10-15T10:59:39.546558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff7ab276-d3d1b074-a5eeee-43c32caf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:39.583482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:39.583517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:39.583551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401506764320699:7313]
2025-10-15T10:59:39.583667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:39.583674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:39.583855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0] Write session: try to update token
2025-10-15T10:59:39.583912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:39.585955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:39.587502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:39.588749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:39.589876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:39.591457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:39.591966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:39.635600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:39.635649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:39.635662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:39.694157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId: src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:39.699673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:39.699712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:39.699729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:39.699741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:39.699789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401506764320699:7313]
2025-10-15T10:59:39.699818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401506764320699:7313]
2025-10-15T10:59:39.699841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401506764320699:7313]
2025-10-15T10:59:39.699996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:39.700006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:39.700032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:39.700052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:39.700089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:39.701114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:39.719224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:39.843686Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:39.845173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:39.845215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:39.845981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:39.847533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401503964628653:8039]
2025-10-15T10:59:39.847535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:39.847574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:39.847674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:39.855371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 703 reason: error at write: Disconnected sessionId: src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0
2025-10-15T10:59:39.855725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 703 sessionId: src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0 is DEAD
2025-10-15T10:59:39.856176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:39.856250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0] Write session will restart in 0.009441s
2025-10-15T10:59:39.856458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0] Write session: Do CDS request
2025-10-15T10:59:39.856517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:39.872034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:39.872634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:39.872662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 704
2025-10-15T10:59:39.873261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:39.873514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:39.873552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:39.873571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:39.876815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 704 sessionId:  describe result for acl check
2025-10-15T10:59:39.876935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:39.876946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:39.876956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:39.876973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401503964628691:8131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:39.880215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401503964628691:8131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:39.885753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401503964628691:8131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:39.896142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401503964628691:8131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:39.896178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401503964628691:8131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:39.896194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401503964628691:8131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:39.896220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:39.947898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401503964628852:8039]
2025-10-15T10:59:39.990573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:39.998288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:39.999086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:39.999115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:39.999155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:39.999420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:39.999588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401506764320995:7317]
2025-10-15T10:59:40.001648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:40.002716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:40.002957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:40.004149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:40.004470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.004488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.004495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.004501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.004508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.004515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.004521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.004528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.004535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.004543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.004550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.004556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.004563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.004570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.004614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.004714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.004761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.004806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.004852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.004896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.004951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.004995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.005037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.005082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.005124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.005176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.005226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.005268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.005310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.005369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.005422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.005474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.005518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.005567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.005609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.005659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.005704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.005752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.005794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.005842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.005884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.005935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.005978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.006026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.006071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.006120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.006160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.006212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.006257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.006303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.006345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.006395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.006451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.006499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.006540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.006588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.007089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:40.027085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:40.037674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:40.037726Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:40.037746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:40.037766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:40.037796Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 703 [2:7561401506764320995:7317]
2025-10-15T10:59:40.037853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:40.037920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:40.037936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:40.037951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:40.037964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:40.038016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:40.038042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:40.038066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:40.039198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.039214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.039228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.039240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:40.039920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 703
2025-10-15T10:59:40.040028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 703
2025-10-15T10:59:40.040116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 703, pipe: [1:7561401503964628852:8039]
2025-10-15T10:59:40.040180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:40.040217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.040436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.040642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.040889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:40.040978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401503964628733:8131], now have 1 active actors on pipe
2025-10-15T10:59:40.041004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401503964628681:2467], now have 1 active actors on pipe
2025-10-15T10:59:40.041030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401503964628852:8039], now have 1 active actors on pipe
2025-10-15T10:59:40.041083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:40.041105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:40.041163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401506764320990:7317]
2025-10-15T10:59:40.041183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401506764320990:7317]
2025-10-15T10:59:40.041197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401506764320990:7317]
2025-10-15T10:59:40.041495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:40.041523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:40.041539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:40.041553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:40.041595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:40.041796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:40.041814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:40.041882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:40.041915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:40.041934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:40.041945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:40.041984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:40.042029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:40.042168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401506764320990:7317]
2025-10-15T10:59:40.042202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:40.042233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:40.042251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:40.043621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:40.043663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:40.043736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:40.044367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 704 partition: 0 MaxSeqNo: 46 sessionId: src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0
2025-10-15T10:59:40.045306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2086e000-5e2c3586-7aef852e-db5b2f81_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:40.073191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0] Write session: try to update token
2025-10-15T10:59:40.073247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:40.130124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:40.130162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:40.130177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:40.130186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:40.130224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401506764320990:7317]
2025-10-15T10:59:40.130250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401506764320990:7317]
2025-10-15T10:59:40.130275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401506764320990:7317]
2025-10-15T10:59:40.130497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:40.130519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:40.130681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:40.130712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:40.130736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:40.132947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:40.195076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId: src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:40.220298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:40.280503Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:40.291963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:40.292019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:40.292094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:40.292109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:40.292151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401506764320990:7317]
2025-10-15T10:59:40.292686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:40.292995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:40.294199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:40.294224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:40.295731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401503964628852:8039]
2025-10-15T10:59:40.295873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:40.303237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 704 reason: error at write: Disconnected sessionId: src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0
2025-10-15T10:59:40.304104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:40.304147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0] Write session will restart in 0.005421s
2025-10-15T10:59:40.304247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0] Write session: Do CDS request
2025-10-15T10:59:40.304276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:40.303620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 704 sessionId: src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0 is DEAD
2025-10-15T10:59:40.327754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:40.331471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:40.331501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 705
2025-10-15T10:59:40.335536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:40.335821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:40.335852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:40.335868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:40.339997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 705 sessionId:  describe result for acl check
2025-10-15T10:59:40.340127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:40.340139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:40.340148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:40.340167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401508259596303:8136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:40.343731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401508259596303:8136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:40.350465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401508259596303:8136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:40.371431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401508259596303:8136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:40.371469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401508259596303:8136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:40.371487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401508259596303:8136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:40.371521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:40.395387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401508259596441:8039]
2025-10-15T10:59:40.427536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:40.434159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:40.435104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:40.435125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:40.435172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:40.435478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:40.435657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401511059288603:7326]
2025-10-15T10:59:40.437932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:40.439506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:40.439763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:40.441215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:40.441558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.441567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.441574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.441581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.441590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.441598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.441605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.441611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.441618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.441626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.441632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.441640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.441646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.441653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.441700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.441809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.441858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.441904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.441949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.441997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.442046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.442092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.442140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.442186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.442231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.442276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.442320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.442365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.442409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.442491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.442549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.442606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.442656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.442714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.442763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.442817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.442869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.442927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.442972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.443027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.443074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.443128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.443175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.443232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.443280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.443333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.446329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.446437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.446493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.446548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.446598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.446651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.446699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.446756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.446802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.446854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.447400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:40.477909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:40.488053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:40.488109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:40.488128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:40.488146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:40.488171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 704 [2:7561401511059288603:7326]
2025-10-15T10:59:40.488221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:40.488282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:40.488298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:40.488311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:40.488321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:40.488371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:40.488395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:40.488417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:40.490035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.490050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.490064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.490076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:40.490356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:40.490374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.490528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.490720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.490974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:40.491049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401511059288598:7326]
2025-10-15T10:59:40.491064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401511059288598:7326]
2025-10-15T10:59:40.491079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401511059288598:7326]
2025-10-15T10:59:40.491126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:40.491206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:40.491482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:40.491496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:40.491506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:40.492568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 704, pipe: [1:7561401508259596441:8039]
2025-10-15T10:59:40.492762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:40.492659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 704
2025-10-15T10:59:40.492800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:40.492722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 704
2025-10-15T10:59:40.493001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401508259596441:8039], now have 1 active actors on pipe
2025-10-15T10:59:40.493037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401508259596360:8136], now have 1 active actors on pipe
2025-10-15T10:59:40.493060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401508259596289:2467], now have 1 active actors on pipe
2025-10-15T10:59:40.493082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401511059288598:7326]
2025-10-15T10:59:40.493109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:40.493805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:40.494073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:40.494112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:40.494191Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f77dc42e-9ad88d74-49828a21-35557364_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:40.494248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:40.494277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:40.494287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:40.494334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:40.494383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:40.494470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:40.496941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 705 partition: 0 MaxSeqNo: 46 sessionId: src_id|f77dc42e-9ad88d74-49828a21-35557364_0
2025-10-15T10:59:40.496538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:40.496574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:40.496657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:40.499908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|386f3b28-732c8573-6f9284b1-4e10aeff_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f77dc42e-9ad88d74-49828a21-35557364_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:40.539969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f77dc42e-9ad88d74-49828a21-35557364_0] Write session: try to update token
2025-10-15T10:59:40.540026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f77dc42e-9ad88d74-49828a21-35557364_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:40.591676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:40.591720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:40.591735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:40.591749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:40.591789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401511059288598:7326]
2025-10-15T10:59:40.591816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401511059288598:7326]
2025-10-15T10:59:40.591842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401511059288598:7326]
2025-10-15T10:59:40.592031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:40.592052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:40.592065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:40.592118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:40.592146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:40.593176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:40.593217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:40.593243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:40.595192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:40.667899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId: src_id|f77dc42e-9ad88d74-49828a21-35557364_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:40.688870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:40.739601Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:40.741677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:40.741707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:40.744205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401508259596441:8039]
2025-10-15T10:59:40.744335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:40.744356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:40.752532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 705 reason: error at write: Disconnected sessionId: src_id|f77dc42e-9ad88d74-49828a21-35557364_0
2025-10-15T10:59:40.752898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 705 sessionId: src_id|f77dc42e-9ad88d74-49828a21-35557364_0 is DEAD
2025-10-15T10:59:40.755833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77dc42e-9ad88d74-49828a21-35557364_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:40.755891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77dc42e-9ad88d74-49828a21-35557364_0] Write session will restart in 0.006649s
2025-10-15T10:59:40.756000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77dc42e-9ad88d74-49828a21-35557364_0] Write session: Do CDS request
2025-10-15T10:59:40.756040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77dc42e-9ad88d74-49828a21-35557364_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:40.766027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:40.772599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f77dc42e-9ad88d74-49828a21-35557364_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:40.790504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:40.790733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:40.790748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 706
2025-10-15T10:59:40.791211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:40.791361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:40.791384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:40.791394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:40.792701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 706 sessionId:  describe result for acl check
2025-10-15T10:59:40.792807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:40.792817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:40.792826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:40.792845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401508259596611:8147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:40.795917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401508259596611:8147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:40.802710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401508259596611:8147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:40.817085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401508259596611:8147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:40.817129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401508259596611:8147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:40.817145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401508259596611:8147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:40.817175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:40.842909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401508259596860:8039]
2025-10-15T10:59:40.858560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:40.868195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:40.868993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:40.869011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:40.869056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:40.869313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:40.869472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401511059288905:7334]
2025-10-15T10:59:40.871534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:40.872625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:40.872864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:40.873911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:40.874156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.874162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.874167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.874171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.874176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.874181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.874186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.874190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.874195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.874199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.874204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.874208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.874213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.874220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.874263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.874364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.874407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.874451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.874486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.874521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.874553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.874583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.874622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.874657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.874689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.874725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.874765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.874798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.874838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.874903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:40.874959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.875000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:40.875036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.875090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:40.875145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.875205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:40.875242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.875295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:40.875339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.875411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:40.875455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.875505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:40.875548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.875599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:40.875646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.875696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:40.875739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.875792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:40.875834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.875919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:40.875968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.876019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.876065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.876118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.876163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.876212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.876706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:40.894024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:40.906871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 705
2025-10-15T10:59:40.906958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 705
2025-10-15T10:59:40.907013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 705, pipe: [1:7561401508259596860:8039]
2025-10-15T10:59:40.903586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:40.903628Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:40.903639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:40.903659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:40.903686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 705 [2:7561401511059288905:7334]
2025-10-15T10:59:40.903737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:40.903799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:40.903814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:40.903827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:40.903839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:40.903891Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:40.903914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:40.903937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:40.905508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.905519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.905528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.905536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:40.905798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:40.905810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:40.905951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:40.906138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:40.906369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:40.906460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401508259596607:2467], now have 1 active actors on pipe
2025-10-15T10:59:40.906484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401508259596695:8147], now have 1 active actors on pipe
2025-10-15T10:59:40.906507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401508259596860:8039], now have 1 active actors on pipe
2025-10-15T10:59:40.906532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401511059288900:7334]
2025-10-15T10:59:40.906547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401511059288900:7334]
2025-10-15T10:59:40.906561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401511059288900:7334]
2025-10-15T10:59:40.906600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:40.906660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:40.906687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:40.906690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:40.906704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:40.906873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:40.906887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:40.906983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401511059288900:7334]
2025-10-15T10:59:40.907001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:40.907037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:40.910030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:40.910072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:40.910153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:40.910194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:40.910213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:40.910234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:40.910271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:40.910327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:40.910383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:40.910985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:40.911009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:40.911068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:40.911636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 706 partition: 0 MaxSeqNo: 46 sessionId: src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0
2025-10-15T10:59:40.912456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f77dc42e-9ad88d74-49828a21-35557364_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:40.940611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0] Write session: try to update token
2025-10-15T10:59:40.940681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:41.009667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:41.009703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:41.009740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401511059288900:7334]
2025-10-15T10:59:41.009865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:41.009923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:41.009936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:41.009947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:41.010011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:41.011705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:41.012777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:41.013923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:41.015077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:41.016723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:41.055271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:41.055494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:41.055520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:41.055534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:41.055545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:41.055578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401511059288900:7334]
2025-10-15T10:59:41.055602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401511059288900:7334]
2025-10-15T10:59:41.055624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401511059288900:7334]
2025-10-15T10:59:41.055780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:41.055810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:41.057060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:41.059651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:41.059710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:41.059739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:41.097712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId: src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:41.122174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:41.200243Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:41.201610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:41.201654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:41.202381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:41.205069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:41.207766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401508259596860:8039]
2025-10-15T10:59:41.207926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:41.251792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 706 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0
2025-10-15T10:59:41.252080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 706 sessionId: src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0 is DEAD
2025-10-15T10:59:41.252510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:41.252567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0] Write session will restart in 0.006766s
2025-10-15T10:59:41.252704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0] Write session: Do CDS request
2025-10-15T10:59:41.252773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:41.268588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:41.269081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:41.269108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 707
2025-10-15T10:59:41.271102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:41.271207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:41.271219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:41.271226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:41.272435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 707 sessionId:  describe result for acl check
2025-10-15T10:59:41.272536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:41.272546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:41.272554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:41.272570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401512554564240:8155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:41.275152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401512554564240:8155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:41.282358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401512554564240:8155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:41.301706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401512554564240:8155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:41.301742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401512554564240:8155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:41.301762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401512554564240:8155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:41.301790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:41.303634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401512554564383:8039]
2025-10-15T10:59:41.353735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:41.357889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:41.358855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:41.358889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:41.358937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:41.359206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:41.359428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401515354256510:7339]
2025-10-15T10:59:41.362033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:41.365759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:41.366019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:41.367420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:41.367777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:41.367797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:41.367805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:41.367812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:41.367819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:41.367826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:41.367834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:41.367842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:41.367849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:41.367856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:41.367863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:41.367871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.367880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.367887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.367940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:41.368059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:41.368108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:41.368157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:41.368218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:41.368275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:41.368326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:41.368379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:41.368432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:41.368491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:41.368541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:41.368589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.368642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.368694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.368750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:41.368826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:41.368890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:41.368956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:41.369011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:41.369070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:41.369122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:41.369183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:41.369240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:41.369303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:41.369353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:41.369413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:41.369467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:41.369528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:41.369581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:41.369639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:41.369694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:41.369757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:41.369809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:41.369883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:41.369939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:41.370001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:41.370049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.370112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.370165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.370226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.370283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.370340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.370892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:41.396316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:41.405520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:41.405580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:41.405599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:41.405620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:41.405646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 706 [2:7561401515354256510:7339]
2025-10-15T10:59:41.405702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:41.405764Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:41.405779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:41.405793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:41.405806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:41.405859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:41.405884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:41.405908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:41.406898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.406926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.406942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.406956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:41.407228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:41.407260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.407601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.407784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.407860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 706, pipe: [1:7561401512554564383:8039]
2025-10-15T10:59:41.407996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 706
2025-10-15T10:59:41.407994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:41.408090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401512554564383:8039], now have 1 active actors on pipe
2025-10-15T10:59:41.408115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401512554564215:2467], now have 1 active actors on pipe
2025-10-15T10:59:41.408101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 706
2025-10-15T10:59:41.408147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401512554564380:8155], now have 1 active actors on pipe
2025-10-15T10:59:41.408172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401515354256505:7339]
2025-10-15T10:59:41.408192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401515354256505:7339]
2025-10-15T10:59:41.408206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401515354256505:7339]
2025-10-15T10:59:41.408250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:41.408265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:41.408278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:41.408289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:41.408332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:41.408489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:41.408512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:41.408589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:41.408618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:41.408750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401515354256505:7339]
2025-10-15T10:59:41.408781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:41.408810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:41.408860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:41.408898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:41.408920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:41.408933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:41.408971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:41.409016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:41.409150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:41.409987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:41.410029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:41.410100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:41.410504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 707 partition: 0 MaxSeqNo: 46 sessionId: src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0
2025-10-15T10:59:41.411561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9a0e33-644e1adf-fb12113f-1e90e0eb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:41.458110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0] Write session: try to update token
2025-10-15T10:59:41.458174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:41.463691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:41.463734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:41.463778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401515354256505:7339]
2025-10-15T10:59:41.463916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:41.465696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:41.466761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:41.467497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:41.475872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:41.539402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:41.541150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:41.541652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:41.541675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:41.541687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:41.541831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:41.588379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:41.588432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:41.588449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:41.588462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:41.588518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401515354256505:7339]
2025-10-15T10:59:41.588553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401515354256505:7339]
2025-10-15T10:59:41.588582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401515354256505:7339]
2025-10-15T10:59:41.588858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:41.588899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:41.588928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:41.588745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:41.588997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:41.591003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:41.625592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId: src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:41.655584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:41.748752Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:41.753014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:41.753069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:41.753586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401512554564383:8039]
2025-10-15T10:59:41.753647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:41.753742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:41.754104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:41.753749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:41.779098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:41.779155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0] Write session will restart in 0.006589s
2025-10-15T10:59:41.779326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0] Write session: Do CDS request
2025-10-15T10:59:41.779384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:41.778343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 707 reason: error at write: Disconnected sessionId: src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0
2025-10-15T10:59:41.778713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 707 sessionId: src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0 is DEAD
2025-10-15T10:59:41.791618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:41.791673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 708
2025-10-15T10:59:41.792093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:41.792908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:41.793115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:41.793151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:41.793168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:41.795058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 708 sessionId:  describe result for acl check
2025-10-15T10:59:41.795170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:41.795187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:41.795196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:41.795214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401512554564525:8160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:41.798232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401512554564525:8160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:41.804490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401512554564525:8160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:41.810883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401512554564525:8160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:41.810925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401512554564525:8160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:41.810944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401512554564525:8160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:41.810974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:41.853885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401512554564685:8039]
2025-10-15T10:59:41.898837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:41.901925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:41.902800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:41.902819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:41.902861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:41.903120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:41.903304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401515354256812:7348]
2025-10-15T10:59:41.905519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:41.907228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:41.907421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:41.908453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:41.908812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:41.908833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:41.908840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:41.908847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:41.908853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:41.908858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:41.908862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:41.908868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:41.908872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:41.908876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:41.908881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:41.908886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.908891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.908894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.908928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:41.909019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:41.909069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:41.909118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:41.909161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:41.909199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:41.909247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:41.909298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:41.909348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:41.909408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:41.909458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:41.909508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.909557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.909605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.909656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:41.909729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:41.909794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:41.909855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:41.909908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:41.909968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:41.910016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:41.910074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:41.910127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:41.910184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:41.910232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:41.910289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:41.910338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:41.910396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:41.910455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:41.910495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:41.910542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:41.910586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:41.910622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:41.910664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:41.910696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:41.910737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:41.910781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.910822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.910860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.910911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.910960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.911016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.911543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:41.927971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:41.937332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:41.937383Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:41.937402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:41.937421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:41.937447Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 707 [2:7561401515354256812:7348]
2025-10-15T10:59:41.937498Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:41.937554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:41.937569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:41.937580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:41.937592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:41.937641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:41.937663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:41.937686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:41.940041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.940076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.940091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.940102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:41.940362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:41.940392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:41.940530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:41.940720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:41.940952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:41.941046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401512554564556:8160], now have 1 active actors on pipe
2025-10-15T10:59:41.941079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401512554564685:8039], now have 1 active actors on pipe
2025-10-15T10:59:41.941101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401512554564511:2467], now have 1 active actors on pipe
2025-10-15T10:59:41.941131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401515354256807:7348]
2025-10-15T10:59:41.941152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401515354256807:7348]
2025-10-15T10:59:41.941166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401515354256807:7348]
2025-10-15T10:59:41.941206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:41.941252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:41.941279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:41.941285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:41.941291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:41.941464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:41.941491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:41.941609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401515354256807:7348]
2025-10-15T10:59:41.941640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:41.941661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:41.943566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 707, pipe: [1:7561401512554564685:8039]
2025-10-15T10:59:41.943683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 707
2025-10-15T10:59:41.945678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 707
2025-10-15T10:59:41.945863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:41.945908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:41.945990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:41.946029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:41.946053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:41.946073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:41.946110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:41.946161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:41.946219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:41.946678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:41.946706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:41.946773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:41.947858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8bcf2bc-4f707269-f1ac70a4-e2b424e3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:41.947057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 708 partition: 0 MaxSeqNo: 46 sessionId: src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0
2025-10-15T10:59:41.974302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0] Write session: try to update token
2025-10-15T10:59:41.974365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:41.998040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:41.998079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:41.998113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401515354256807:7348]
2025-10-15T10:59:41.998238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:41.998286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:42.000074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:42.001411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:42.002694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:42.004096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:42.005753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:42.006182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:42.068441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:42.068482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:42.068493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:42.068551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:42.068565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:42.068576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:42.068587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:42.068625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401515354256807:7348]
2025-10-15T10:59:42.068654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401515354256807:7348]
2025-10-15T10:59:42.068676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401515354256807:7348]
2025-10-15T10:59:42.068841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:42.068869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:42.069874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:42.071434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:42.071495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:42.071529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:42.077503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId: src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:42.102984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:42.211777Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:42.213966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:42.213999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:42.214865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:42.215646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:42.215670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:42.263173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401512554564685:8039]
2025-10-15T10:59:42.263256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:42.263419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 708 reason: error at write: Disconnected sessionId: src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0
2025-10-15T10:59:42.263714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 708 sessionId: src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0 is DEAD
2025-10-15T10:59:42.271551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:42.271586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0] Write session will restart in 0.006350s
2025-10-15T10:59:42.271677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0] Write session: Do CDS request
2025-10-15T10:59:42.271703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:42.292224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:42.291625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:42.291662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 709
2025-10-15T10:59:42.292885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:42.293010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:42.293027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:42.293037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:42.296744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 709 sessionId:  describe result for acl check
2025-10-15T10:59:42.296871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:42.296882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:42.296891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:42.296908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401516849532253:8171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:42.299986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401516849532253:8171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:42.310496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401516849532253:8171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:42.319560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401516849532253:8171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:42.319606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401516849532253:8171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:42.319624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401516849532253:8171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:42.319659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:42.343273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:42.348991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:42.349773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:42.349806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:42.349846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:42.350078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:42.350265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401519649224418:7356]
2025-10-15T10:59:42.352385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:42.360926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:42.361268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:42.362630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:42.362984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:42.363003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:42.363011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:42.363020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:42.363026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:42.363034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:42.363040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:42.363048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:42.363056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:42.363063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:42.363071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:42.363078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.363086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.363092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.363143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:42.363261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:42.363312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:42.363676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:42.363747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:42.363817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:42.363878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:42.363925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:42.363981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:42.364042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:42.364100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:42.364148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.364198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.364246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.364296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:42.364368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:42.364431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:42.364490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:42.364543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:42.364616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:42.364665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:42.364724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:42.364774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:42.364830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:42.364889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:42.364945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:42.365006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:42.365075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:42.365128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:42.365198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:42.365256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:42.365410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:42.365479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:42.365545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:42.365601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:42.365664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:42.365715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.365779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.365836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.365897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.365951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.366013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.366571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:42.369328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401516849532425:8039]
2025-10-15T10:59:42.446900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:42.459987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:42.460038Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:42.460053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:42.460071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:42.460094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 708 [2:7561401519649224418:7356]
2025-10-15T10:59:42.460142Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:42.460194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:42.460207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:42.460220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:42.460230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:42.460272Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:42.460293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:42.460312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:42.462319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.462333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.462346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.462357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:42.462623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:42.462640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.462765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.462935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.463147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:42.463214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401516849532425:8039], now have 1 active actors on pipe
2025-10-15T10:59:42.463236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401516849532159:2467], now have 1 active actors on pipe
2025-10-15T10:59:42.463255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401516849532347:8171], now have 1 active actors on pipe
2025-10-15T10:59:42.463279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401519649224411:7356]
2025-10-15T10:59:42.463294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401519649224411:7356]
2025-10-15T10:59:42.463306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401519649224411:7356]
2025-10-15T10:59:42.463341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:42.463404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:42.463417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:42.463427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:42.464178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:42.464351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:42.464365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:42.464465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401519649224411:7356]
2025-10-15T10:59:42.464492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:42.464773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:42.466612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:42.466662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:42.466734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:42.466769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:42.466786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:42.466812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:42.466845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:42.466890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:42.466931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:42.465555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 708, pipe: [1:7561401516849532425:8039]
2025-10-15T10:59:42.465685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 708
2025-10-15T10:59:42.465778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 708
2025-10-15T10:59:42.467601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:42.467631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:42.467726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:42.469326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7f0996d-13ddbc7e-92a1d1c7-6698e2ab_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:42.468483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 709 partition: 0 MaxSeqNo: 46 sessionId: src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0
2025-10-15T10:59:42.499883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0] Write session: try to update token
2025-10-15T10:59:42.499955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:42.639849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:42.639881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:42.639892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:42.639943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:42.639956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:42.639969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:42.639979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:42.640010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401519649224411:7356]
2025-10-15T10:59:42.640033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401519649224411:7356]
2025-10-15T10:59:42.640056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401519649224411:7356]
2025-10-15T10:59:42.643466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:42.643498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:42.643524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:42.651071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId: src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:42.649781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:42.649833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:42.651729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:42.676977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1015 10:59:42.712603155  901239 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:59:42.722054Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:59:42.785679Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:42.787047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:42.787097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:42.787152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401519649224411:7356]
2025-10-15T10:59:42.787313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:42.787379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:42.787492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:42.788354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:42.788476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:42.788489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401516849532425:8039]
2025-10-15T10:59:42.788582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:42.805842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 709 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0
2025-10-15T10:59:42.806131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 709 sessionId: src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0 is DEAD
2025-10-15T10:59:42.808506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:42.808565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0] Write session will restart in 0.008540s
2025-10-15T10:59:42.808726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0] Write session: Do CDS request
2025-10-15T10:59:42.808771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:42.822066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:42.821996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:42.822022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 710
2025-10-15T10:59:42.822560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:42.822697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:42.822719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:42.822727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:42.824301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 710 sessionId:  describe result for acl check
2025-10-15T10:59:42.824435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:42.824459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:42.824476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:42.824498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401516849532464:8179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:42.828860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401516849532464:8179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:42.853706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401516849532464:8179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:42.881665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401516849532464:8179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:42.881705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401516849532464:8179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:42.881719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401516849532464:8179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:42.881749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:42.888298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401516849532549:8039]
2025-10-15T10:59:42.926422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:42.932460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:42.933269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:42.933297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:42.933337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:42.933574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:42.933738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401519649224724:7361]
2025-10-15T10:59:42.936071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:42.936954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:42.937154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:42.938334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:42.938659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:42.938668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:42.938675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:42.938681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:42.938687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:42.938693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:42.938700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:42.938706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:42.938712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:42.938718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:42.938726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:42.938731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.938738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.938744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.938789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:42.938891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:42.938938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:42.938985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:42.939028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:42.939091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:42.939136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:42.939180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:42.939222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:42.939266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:42.939310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:42.939374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.939417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.939465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.939507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:42.939565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:42.939622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:42.939675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:42.939720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:42.939771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:42.939814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:42.939864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:42.939910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:42.939960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:42.940004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:42.940076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:42.940124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:42.940186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:42.940229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:42.940280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:42.940326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:42.940376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:42.940417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:42.940469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:42.940515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:42.940564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:42.940608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.940660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:42.940704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.940753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:42.940796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.940848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:42.941342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:42.960539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:42.969965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:42.970013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:42.970030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:42.970048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:42.970070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 709 [2:7561401519649224724:7361]
2025-10-15T10:59:42.970123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:42.970227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:42.970242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:42.970254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:42.970266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:42.970312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:42.970343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:42.970364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:43.009136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.009166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.009177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.009186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:43.009614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 709, pipe: [1:7561401516849532549:8039]
2025-10-15T10:59:43.009428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:43.009677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 709
2025-10-15T10:59:43.009451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.009699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 709
2025-10-15T10:59:43.009566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.009714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.009899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:43.009977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401516849532549:8039], now have 1 active actors on pipe
2025-10-15T10:59:43.010006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401516849532529:8179], now have 1 active actors on pipe
2025-10-15T10:59:43.010023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401516849532449:2467], now have 1 active actors on pipe
2025-10-15T10:59:43.010062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:43.010079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:43.010123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401519649224719:7361]
2025-10-15T10:59:43.010141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401519649224719:7361]
2025-10-15T10:59:43.010152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401519649224719:7361]
2025-10-15T10:59:43.010186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:43.010210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:43.010224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:43.010235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:43.010246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:43.010396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:43.010418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:43.010483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:43.010514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:43.010527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:43.010537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:43.010565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:43.010601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:43.010715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401519649224719:7361]
2025-10-15T10:59:43.010751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:43.010789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:43.010803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:43.011211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:43.011236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:43.011289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:43.011630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 710 partition: 0 MaxSeqNo: 46 sessionId: src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0
2025-10-15T10:59:43.012293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc57d99a-a060cf0d-d7465b96-aa6768f6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:43.030887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0] Write session: try to update token
2025-10-15T10:59:43.030928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:43.038775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:43.038812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:43.038851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401519649224719:7361]
2025-10-15T10:59:43.038969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:43.038981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:43.041051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:43.042430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:43.044062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:43.045377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:43.047188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:43.047974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:43.070500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:43.070544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:43.070581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:43.109379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:43.109417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:43.109439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:43.109451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:43.109488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401519649224719:7361]
2025-10-15T10:59:43.109518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401519649224719:7361]
2025-10-15T10:59:43.109542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401519649224719:7361]
2025-10-15T10:59:43.109675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:43.109694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:43.109715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:43.109730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:43.109767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:43.110295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId: src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:43.110934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:43.131543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:43.246882Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:43.248672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:43.248709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:43.249397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:43.249189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401516849532549:8039]
2025-10-15T10:59:43.249220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:43.249234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:43.249266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:43.281064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 710 reason: error at write: Disconnected sessionId: src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0
2025-10-15T10:59:43.281366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 710 sessionId: src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0 is DEAD
2025-10-15T10:59:43.281739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:43.281796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0] Write session will restart in 0.009306s
2025-10-15T10:59:43.281950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0] Write session: Do CDS request
2025-10-15T10:59:43.282002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:43.295737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:43.297241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:43.297275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 711
2025-10-15T10:59:43.297659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:43.297766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:43.297781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:43.297790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:43.299033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 711 sessionId:  describe result for acl check
2025-10-15T10:59:43.299131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:43.299146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:43.299154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:43.299168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401521144500080:8184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:43.301423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401521144500080:8184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:43.308798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401521144500080:8184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:43.325311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401521144500080:8184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:43.325351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401521144500080:8184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:43.325366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401521144500080:8184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:43.325393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:43.349080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401521144500251:8039]
2025-10-15T10:59:43.375532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:43.378440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:43.379208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:43.379237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:43.379282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:43.379563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:43.379750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401523944192339:7370]
2025-10-15T10:59:43.381752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:43.382547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:43.382724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:43.383782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:43.384095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:43.384102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:43.384108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:43.384115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:43.384122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:43.384128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:43.384134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:43.384139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:43.384146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:43.384152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:43.384158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:43.384165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.384171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.384177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.384221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:43.384312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:43.384351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:43.384392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:43.384425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:43.384456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:43.384485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:43.384514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:43.384547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:43.384591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:43.384626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:43.384654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.384683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.384712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.384749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:43.384810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:43.384860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:43.384910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:43.384943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:43.384975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:43.385014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:43.385061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:43.385106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:43.385160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:43.385197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:43.385242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:43.385288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:43.385336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:43.385378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:43.385418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:43.385447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:43.385484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:43.385521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:43.385570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:43.385610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:43.385660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:43.385701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.385750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.385793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.385841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.385884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.385933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.386357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:43.404803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:43.419963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:43.420014Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:43.420031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:43.420051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:43.420074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 710 [2:7561401523944192339:7370]
2025-10-15T10:59:43.420121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:43.420176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:43.420189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:43.420201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:43.420210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:43.420255Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:43.420274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:43.420292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:43.422765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 710, pipe: [1:7561401521144500251:8039]
2025-10-15T10:59:43.422807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 710
2025-10-15T10:59:43.422854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 710
2025-10-15T10:59:43.422108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.422136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.422150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.422162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:43.422424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:43.422440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.422580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.422754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.422981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:43.423052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401521144500063:2467], now have 1 active actors on pipe
2025-10-15T10:59:43.423075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401521144500251:8039], now have 1 active actors on pipe
2025-10-15T10:59:43.423096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401521144500190:8184], now have 1 active actors on pipe
2025-10-15T10:59:43.423135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401523944192333:7370]
2025-10-15T10:59:43.423149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401523944192333:7370]
2025-10-15T10:59:43.423160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401523944192333:7370]
2025-10-15T10:59:43.423196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:43.423225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:43.423238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:43.423258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:43.423271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:43.423290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:43.423330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:43.424605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:43.424636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:43.424807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e11f56b8-7c350421-fec65faa-f716cadc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:43.424842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:43.424858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:43.424868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:43.424899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:43.424933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:43.424968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401523944192333:7370]
2025-10-15T10:59:43.424998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:43.425036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:43.425084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:43.426101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:43.426137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:43.426195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:43.427224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4bf06d-f4d86408-b40a4e6e-301c9ac9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e11f56b8-7c350421-fec65faa-f716cadc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:43.426517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 711 partition: 0 MaxSeqNo: 46 sessionId: src_id|e11f56b8-7c350421-fec65faa-f716cadc_0
2025-10-15T10:59:43.469248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11f56b8-7c350421-fec65faa-f716cadc_0] Write session: try to update token
2025-10-15T10:59:43.469299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11f56b8-7c350421-fec65faa-f716cadc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:43.565015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:43.565039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:43.565048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:43.565062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:43.565088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401523944192333:7370]
2025-10-15T10:59:43.565104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401523944192333:7370]
2025-10-15T10:59:43.565119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401523944192333:7370]
2025-10-15T10:59:43.565221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:43.565229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:43.565236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:43.565305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:43.565318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:43.565416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:43.565464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:43.565490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:43.573423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:43.575435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId: src_id|e11f56b8-7c350421-fec65faa-f716cadc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:43.612563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:43.716485Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:43.736457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:43.736502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:43.736557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:43.736569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:43.736603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401523944192333:7370]
2025-10-15T10:59:43.736977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:43.740150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:43.740421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401521144500251:8039]
2025-10-15T10:59:43.738627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:43.740562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:43.740581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:43.764305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 711 reason: error at write: Disconnected sessionId: src_id|e11f56b8-7c350421-fec65faa-f716cadc_0
2025-10-15T10:59:43.764611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 711 sessionId: src_id|e11f56b8-7c350421-fec65faa-f716cadc_0 is DEAD
2025-10-15T10:59:43.770238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11f56b8-7c350421-fec65faa-f716cadc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:43.770292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11f56b8-7c350421-fec65faa-f716cadc_0] Write session will restart in 0.008660s
2025-10-15T10:59:43.770434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11f56b8-7c350421-fec65faa-f716cadc_0] Write session: Do CDS request
2025-10-15T10:59:43.770485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11f56b8-7c350421-fec65faa-f716cadc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:43.795689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:43.795731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 712
2025-10-15T10:59:43.796217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11f56b8-7c350421-fec65faa-f716cadc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:43.799683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:43.799866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:43.799881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:43.799891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:43.801764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 712 sessionId:  describe result for acl check
2025-10-15T10:59:43.801873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:43.801884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:43.801894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:43.801908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401521144500402:8195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:43.804237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401521144500402:8195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:43.835339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401521144500402:8195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:43.840193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401521144500520:8039]
2025-10-15T10:59:43.858908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401521144500402:8195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:43.858947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401521144500402:8195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:43.858961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401521144500402:8195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:43.858990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:43.893043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:43.906956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:43.907761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:43.907789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:43.907830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:43.908062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:43.908244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401523944192649:7378]
2025-10-15T10:59:43.910262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:43.912218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:43.912512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:43.913886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:43.914250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:43.914271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:43.914279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:43.914287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:43.914294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:43.914302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:43.914309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:43.914316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:43.914324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:43.914331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:43.914338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:43.914346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.914353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.914361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.914409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:43.914534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:43.914586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:43.914645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:43.914704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:43.914750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:43.914798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:43.914846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:43.914892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:43.914942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:43.914989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:43.915037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.915083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.915129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.915175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:43.915245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:43.915305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:43.915374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:43.915425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:43.915480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:43.915528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:43.915585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:43.915636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:43.915692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:43.915737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:43.915791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:43.915837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:43.915894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:43.915938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:43.915990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:43.916041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:43.916095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:43.916139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:43.916192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:43.916241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:43.916295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:43.916340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.916392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.916439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.916494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.916542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.916599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.917033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:43.984897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:43.993941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:43.993998Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:43.994014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:43.994035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:43.994061Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 711 [2:7561401523944192649:7378]
2025-10-15T10:59:43.994119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:43.994188Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:43.994211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:43.994224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:43.994236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:43.994290Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:43.994319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:43.994343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:43.995306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.995334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.995363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.995376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:43.995641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:43.995669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:43.995825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:43.996034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:43.996301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:43.996383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401523944192643:7378]
2025-10-15T10:59:43.996403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401523944192643:7378]
2025-10-15T10:59:43.996417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401523944192643:7378]
2025-10-15T10:59:43.996460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:43.996544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:43.996745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:43.996769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:43.996896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401523944192643:7378]
2025-10-15T10:59:43.996920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:43.997166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:43.997184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:43.997197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:43.997223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:43.997929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401521144500571:8195], now have 1 active actors on pipe
2025-10-15T10:59:43.997964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401521144500520:8039], now have 1 active actors on pipe
2025-10-15T10:59:43.997988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401521144500378:2467], now have 1 active actors on pipe
2025-10-15T10:59:43.998548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:43.998585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:43.998686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de967435-21a1c4eb-806df002-12afd75a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:43.998721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:43.998739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:43.998769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:43.998828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:43.998880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:43.998946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:43.997862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 711
2025-10-15T10:59:43.997953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 711, pipe: [1:7561401521144500520:8039]
2025-10-15T10:59:43.998021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 711
2025-10-15T10:59:44.000044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:44.000089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:44.000169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:44.000830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 712 partition: 0 MaxSeqNo: 46 sessionId: src_id|de967435-21a1c4eb-806df002-12afd75a_0
2025-10-15T10:59:44.003884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11f56b8-7c350421-fec65faa-f716cadc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|de967435-21a1c4eb-806df002-12afd75a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:44.052325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de967435-21a1c4eb-806df002-12afd75a_0] Write session: try to update token
2025-10-15T10:59:44.052382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de967435-21a1c4eb-806df002-12afd75a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:44.180059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:44.180095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:44.180106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:44.180172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:44.180186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:44.180199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:44.180209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:44.180247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401523944192643:7378]
2025-10-15T10:59:44.180274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401523944192643:7378]
2025-10-15T10:59:44.180296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401523944192643:7378]
2025-10-15T10:59:44.180482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:44.180502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:44.180996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:44.181038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:44.181067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:44.183117Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:44.208836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId: src_id|de967435-21a1c4eb-806df002-12afd75a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:44.230348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:44.329739Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:44.340235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:44.340262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:44.340351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401521144500520:8039]
2025-10-15T10:59:44.340442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:44.339443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:44.339497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:44.339568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:44.339583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:44.339622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401523944192643:7378]
2025-10-15T10:59:44.339874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:44.340200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:44.396315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 712 reason: error at write: Disconnected sessionId: src_id|de967435-21a1c4eb-806df002-12afd75a_0
2025-10-15T10:59:44.396609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 712 sessionId: src_id|de967435-21a1c4eb-806df002-12afd75a_0 is DEAD
2025-10-15T10:59:44.397153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de967435-21a1c4eb-806df002-12afd75a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:44.397196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de967435-21a1c4eb-806df002-12afd75a_0] Write session will restart in 0.009825s
2025-10-15T10:59:44.397323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de967435-21a1c4eb-806df002-12afd75a_0] Write session: Do CDS request
2025-10-15T10:59:44.397365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de967435-21a1c4eb-806df002-12afd75a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:44.413137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de967435-21a1c4eb-806df002-12afd75a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:44.415220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:44.415249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 713
2025-10-15T10:59:44.415544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:44.415650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:44.415664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:44.415673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:44.416565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 713 sessionId:  describe result for acl check
2025-10-15T10:59:44.416657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:44.416672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:44.416681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:44.416696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401525439468106:8205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:44.418436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401525439468106:8205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:44.427180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401525439468106:8205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:44.440845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401525439468224:8039]
2025-10-15T10:59:44.442599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401525439468106:8205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:44.442644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401525439468106:8205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:44.442661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401525439468106:8205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:44.442692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:44.465121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:44.476583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:44.477285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:44.477314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:44.477346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:44.477535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:44.477658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401528239160260:7383]
2025-10-15T10:59:44.479088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:44.480097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:44.480253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:44.481476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:44.481847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:44.481856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:44.481863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:44.481870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:44.481878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:44.481885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:44.481892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:44.481900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:44.481907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:44.481931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:44.481939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:44.481947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.481955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.481962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.482012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:44.482126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:44.482172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:44.482212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:44.482246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:44.482285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:44.482329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:44.482370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:44.482418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:44.482468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:44.482520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:44.482557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.482591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.482628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.482667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:44.482738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:44.482786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:44.482842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:44.482893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:44.482952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:44.482998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:44.483051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:44.483091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:44.483130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:44.483164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:44.483212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:44.483247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:44.483287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:44.483329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:44.483432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:44.483482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:44.483524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:44.483559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:44.483603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:44.483635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:44.483677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:44.483720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.483759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.483794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.483841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.483877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.483929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.484396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:44.503293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:44.527538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:44.527581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:44.527596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:44.527612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:44.527634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 712 [2:7561401528239160260:7383]
2025-10-15T10:59:44.527682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:44.527734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:44.527748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:44.527759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:44.527770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:44.527812Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:44.527833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:44.527852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:44.529440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.529458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.529472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.529482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:44.529741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:44.529757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.529881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.530060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.530292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:44.530357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401528239160255:7383]
2025-10-15T10:59:44.530371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401528239160255:7383]
2025-10-15T10:59:44.530383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401528239160255:7383]
2025-10-15T10:59:44.530898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 712
2025-10-15T10:59:44.530413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:44.531010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 712
2025-10-15T10:59:44.530443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:44.530457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:44.531066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 712, pipe: [1:7561401525439468224:8039]
2025-10-15T10:59:44.530470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:44.530475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:44.530668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:44.530687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:44.530820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401525439468007:2467], now have 1 active actors on pipe
2025-10-15T10:59:44.530843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401525439468224:8039], now have 1 active actors on pipe
2025-10-15T10:59:44.530864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401525439468236:8205], now have 1 active actors on pipe
2025-10-15T10:59:44.530883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401528239160255:7383]
2025-10-15T10:59:44.530915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:44.530946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:44.531468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:44.531496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:44.531560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b1dac8a-5a0356f-5460986e-4e664537_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:44.531587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:44.531604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:44.531613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:44.531646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:44.531681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:44.531722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:44.532370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:44.532395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:44.532448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:44.532903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 713 partition: 0 MaxSeqNo: 46 sessionId: src_id|5b1dac8a-5a0356f-5460986e-4e664537_0
2025-10-15T10:59:44.533553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de967435-21a1c4eb-806df002-12afd75a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5b1dac8a-5a0356f-5460986e-4e664537_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:44.555691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1dac8a-5a0356f-5460986e-4e664537_0] Write session: try to update token
2025-10-15T10:59:44.555749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1dac8a-5a0356f-5460986e-4e664537_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:44.575018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:44.575053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:44.575088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401528239160255:7383]
2025-10-15T10:59:44.575206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:44.575452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:44.582021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:44.587792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:44.596640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:44.604950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:44.620488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:44.673985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:44.674021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:44.674031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:44.674124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:44.692366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId: src_id|5b1dac8a-5a0356f-5460986e-4e664537_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:44.698168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:44.698210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:44.698222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:44.698233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:44.698272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401528239160255:7383]
2025-10-15T10:59:44.698300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401528239160255:7383]
2025-10-15T10:59:44.698324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401528239160255:7383]
2025-10-15T10:59:44.698453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:44.698454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:44.698474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:44.698500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:44.698535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:44.699974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:44.722986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:44.839253Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:44.843038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:44.843076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:44.843521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:44.843537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401525439468224:8039]
2025-10-15T10:59:44.843643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:44.843665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:44.843781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:44.869724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 713 reason: error at write: Disconnected sessionId: src_id|5b1dac8a-5a0356f-5460986e-4e664537_0
2025-10-15T10:59:44.870404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1dac8a-5a0356f-5460986e-4e664537_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:44.870443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1dac8a-5a0356f-5460986e-4e664537_0] Write session will restart in 0.007603s
2025-10-15T10:59:44.870544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1dac8a-5a0356f-5460986e-4e664537_0] Write session: Do CDS request
2025-10-15T10:59:44.870571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1dac8a-5a0356f-5460986e-4e664537_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:44.870095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 713 sessionId: src_id|5b1dac8a-5a0356f-5460986e-4e664537_0 is DEAD
2025-10-15T10:59:44.884624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1dac8a-5a0356f-5460986e-4e664537_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:44.884900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:44.884935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 714
2025-10-15T10:59:44.885290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:44.885451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:44.885484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:44.885495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:44.886868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 714 sessionId:  describe result for acl check
2025-10-15T10:59:44.886989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:44.887008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:44.887018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:44.887036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401525439468335:8210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:44.891009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401525439468335:8210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:44.897970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401525439468335:8210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:44.911140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401525439468335:8210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:44.911179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401525439468335:8210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:44.911197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401525439468335:8210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:44.911227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:44.943979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401525439468576:8039]
2025-10-15T10:59:44.973075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:44.977884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:44.978770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:44.978800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:44.978843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:44.979086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:44.979396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401528239160577:7392]
2025-10-15T10:59:44.981539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:44.984414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:44.984647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:44.985956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:44.986264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:44.986272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:44.986280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:44.986286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:44.986293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:44.986300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:44.986306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:44.986312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:44.986320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:44.986326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:44.986332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:44.986338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.986344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.986349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.986391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:44.986511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:44.986555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:44.986594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:44.986632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:44.986675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:44.986737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:44.986780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:44.986819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:44.986861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:44.986900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:44.986940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.986979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.987019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.987060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:44.987138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:44.987193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:44.987241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:44.987283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:44.987331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:44.988277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:44.988352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:44.988402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:44.988458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:44.988509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:44.988560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:44.988600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:44.988645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:44.988682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:44.988739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:44.988782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:44.988829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:44.988867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:44.988911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:44.988950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:44.988992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:44.989030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.989075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:44.989114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.989159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:44.989194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.989239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:44.989669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:45.010082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:45.020017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:45.020071Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:45.020088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:45.020106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:45.020130Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 713 [2:7561401528239160577:7392]
2025-10-15T10:59:45.020182Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:45.020240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:45.020254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:45.020267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:45.020277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:45.020327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:45.020349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:45.020370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:45.021959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.021990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.022003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.022016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:45.022295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:45.022321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.022474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.022692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.022941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:45.023018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401528239160561:7392]
2025-10-15T10:59:45.023040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401528239160561:7392]
2025-10-15T10:59:45.023052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401528239160561:7392]
2025-10-15T10:59:45.023094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:45.023175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:45.023450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:45.023474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:45.023487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:45.023671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:45.023698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:45.023848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401525439468576:8039], now have 1 active actors on pipe
2025-10-15T10:59:45.023880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401525439468309:2467], now have 1 active actors on pipe
2025-10-15T10:59:45.023907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401525439468435:8210], now have 1 active actors on pipe
2025-10-15T10:59:45.023933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401528239160561:7392]
2025-10-15T10:59:45.023961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:45.023981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:45.024474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:45.024508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:45.024594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56f582bc-dae37f91-d8797282-8d948003_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:45.024633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:45.024655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:45.024666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:45.024703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:45.024750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:45.024805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:45.026349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:45.026377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:45.026444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:45.023848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 713
2025-10-15T10:59:45.023943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 713
2025-10-15T10:59:45.024124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 713, pipe: [1:7561401525439468576:8039]
2025-10-15T10:59:45.026710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 714 partition: 0 MaxSeqNo: 46 sessionId: src_id|56f582bc-dae37f91-d8797282-8d948003_0
2025-10-15T10:59:45.027499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b1dac8a-5a0356f-5460986e-4e664537_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|56f582bc-dae37f91-d8797282-8d948003_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:45.061943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56f582bc-dae37f91-d8797282-8d948003_0] Write session: try to update token
2025-10-15T10:59:45.062005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56f582bc-dae37f91-d8797282-8d948003_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:45.095709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:45.095749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:45.095785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401528239160561:7392]
2025-10-15T10:59:45.095921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:45.096186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:45.099775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:45.102444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:45.103916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:45.109834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:45.111842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:45.112380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:45.120676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:45.120732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:45.120752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:45.178387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:45.178432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:45.178449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:45.178462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:45.178526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401528239160561:7392]
2025-10-15T10:59:45.178554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401528239160561:7392]
2025-10-15T10:59:45.178578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401528239160561:7392]
2025-10-15T10:59:45.178744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:45.178776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:45.178780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:45.178819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:45.178857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:45.180088Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:45.190527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId: src_id|56f582bc-dae37f91-d8797282-8d948003_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:45.213990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:45.325839Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:45.328161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:45.328205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:45.332283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:45.332793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:45.332937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:45.332949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:45.386415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f582bc-dae37f91-d8797282-8d948003_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:45.386476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f582bc-dae37f91-d8797282-8d948003_0] Write session will restart in 0.008961s
2025-10-15T10:59:45.386660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f582bc-dae37f91-d8797282-8d948003_0] Write session: Do CDS request
2025-10-15T10:59:45.386721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f582bc-dae37f91-d8797282-8d948003_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:45.385341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 714 reason: error at write: Disconnected sessionId: src_id|56f582bc-dae37f91-d8797282-8d948003_0
2025-10-15T10:59:45.385699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 714 sessionId: src_id|56f582bc-dae37f91-d8797282-8d948003_0 is DEAD
2025-10-15T10:59:45.402621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56f582bc-dae37f91-d8797282-8d948003_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:45.404991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401525439468576:8039]
2025-10-15T10:59:45.405038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:45.405052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 715
2025-10-15T10:59:45.407754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:45.407899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:45.407917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:45.407929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:45.409762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 715 sessionId:  describe result for acl check
2025-10-15T10:59:45.409868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:45.409879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:45.409888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:45.409904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401529734435969:8221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:45.413723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401529734435969:8221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:45.435952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401529734435969:8221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:45.448929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401529734435969:8221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:45.448966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401529734435969:8221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:45.448984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401529734435969:8221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:45.449017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:45.490062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:45.500354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:45.501277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:45.501298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:45.501347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:45.501627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:45.501822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401532534128194:7400]
2025-10-15T10:59:45.504273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:45.505148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401529734436237:8039]
2025-10-15T10:59:45.505705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:45.505936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:45.507254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:45.507632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:45.507641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:45.507648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:45.507655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:45.507662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:45.507670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:45.507677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:45.507684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:45.507690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:45.507697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:45.507706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:45.507713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.507721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.507728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.507780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:45.507893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:45.507945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:45.507995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:45.508041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:45.508090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:45.508142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:45.508190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:45.508239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:45.508291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:45.508341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:45.508392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.508442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.508489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.508534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:45.508618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:45.508687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:45.508746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:45.508797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:45.508853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:45.508902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:45.508981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:45.509039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:45.509109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:45.509165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:45.509228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:45.509277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:45.509334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:45.509377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:45.509434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:45.509484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:45.509540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:45.509588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:45.509646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:45.509692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:45.509747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:45.509792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.509846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.509903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.509958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.510006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.510062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.510611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:45.538372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:45.565740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:45.565795Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:45.565814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:45.565834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:45.565860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 714 [2:7561401532534128194:7400]
2025-10-15T10:59:45.565915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:45.565983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:45.565999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:45.566012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:45.566024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:45.566075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:45.566099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:45.566123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:45.567240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.567272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.567286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.567298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:45.567594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:45.567620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.567770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.567979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.568235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:45.568330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401529734436237:8039], now have 1 active actors on pipe
2025-10-15T10:59:45.568357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401529734436115:8221], now have 1 active actors on pipe
2025-10-15T10:59:45.568381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401529734435937:2467], now have 1 active actors on pipe
2025-10-15T10:59:45.568407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401532534128188:7400]
2025-10-15T10:59:45.568422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401532534128188:7400]
2025-10-15T10:59:45.568437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401532534128188:7400]
2025-10-15T10:59:45.568478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:45.568526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:45.568542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:45.568554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:45.568559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:45.568755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:45.568775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:45.568901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401532534128188:7400]
2025-10-15T10:59:45.568929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:45.568950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:45.571672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 714, pipe: [1:7561401529734436237:8039]
2025-10-15T10:59:45.571703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 714
2025-10-15T10:59:45.571785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 714
2025-10-15T10:59:45.572536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:45.572579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:45.572666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:45.572700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:45.572718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:45.572730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:45.572772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:45.572828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:45.572912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:45.579107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:45.579170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:45.579281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:45.583801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 715 partition: 0 MaxSeqNo: 46 sessionId: src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0
2025-10-15T10:59:45.586204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56f582bc-dae37f91-d8797282-8d948003_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:45.606259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0] Write session: try to update token
2025-10-15T10:59:45.606328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:45.703089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:45.703134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:45.703148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:45.703169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:45.703206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401532534128188:7400]
2025-10-15T10:59:45.703298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401532534128188:7400]
2025-10-15T10:59:45.703336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401532534128188:7400]
2025-10-15T10:59:45.703650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:45.703677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:45.703689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:45.703749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:45.703772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:45.703896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:45.703939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:45.703980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:45.704932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId: src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:45.705285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:45.728610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:45.848991Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:45.859613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:45.859672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:45.859752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:45.859767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:45.859811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401532534128188:7400]
2025-10-15T10:59:45.860007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:45.860250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:45.860286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:45.860300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:45.860434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:45.860466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401529734436237:8039]
2025-10-15T10:59:45.897454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:45.897539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0] Write session will restart in 0.005407s
2025-10-15T10:59:45.897708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0] Write session: Do CDS request
2025-10-15T10:59:45.897763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:45.896757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 715 reason: error at write: Disconnected sessionId: src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0
2025-10-15T10:59:45.897063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 715 sessionId: src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0 is DEAD
2025-10-15T10:59:45.907569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:45.907416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:45.907455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 716
2025-10-15T10:59:45.908066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:45.908186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:45.908207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:45.908216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:45.909340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 716 sessionId:  describe result for acl check
2025-10-15T10:59:45.909440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:45.909455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:45.909465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:45.909480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401529734436289:8229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:45.911919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401529734436289:8229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:45.922042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401529734436289:8229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:45.930811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401529734436289:8229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:45.930857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401529734436289:8229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:45.930872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401529734436289:8229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:45.930899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:45.960281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401529734436539:8039]
2025-10-15T10:59:45.961457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:45.963321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:45.964093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:45.964123Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:45.964162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:45.964384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:45.964568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401532534128491:7405]
2025-10-15T10:59:45.966559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:45.967485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:45.967676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:45.968768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:45.969062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:45.969078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:45.969085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:45.969091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:45.969096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:45.969103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:45.969111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:45.969117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:45.969123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:45.969129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:45.969136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:45.969142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.969149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.969155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.969195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:45.969293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:45.969338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:45.969383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:45.969426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:45.969480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:45.969527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:45.969576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:45.969623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:45.969670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:45.969717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:45.969763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.969808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.969848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.969892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:45.969959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:45.970015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:45.970073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:45.970116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:45.970168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:45.970213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:45.970266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:45.970315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:45.970369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:45.970412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:45.970466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:45.970528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:45.970582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:45.970631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:45.970683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:45.970730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:45.970787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:45.970829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:45.970882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:45.970933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:45.970988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:45.971035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.971088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:45.971129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.971179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:45.971225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.971277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:45.971768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:45.988656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:46.018012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:46.018051Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:46.018066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:46.018081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:46.018104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 715 [2:7561401532534128491:7405]
2025-10-15T10:59:46.018147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:46.018192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:46.018205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:46.018217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:46.018227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:46.018273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:46.018297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:46.018314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:46.019779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.019804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.019816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.019825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:46.020055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:46.020081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.020205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.020372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.020335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 715
2025-10-15T10:59:46.020440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 715, pipe: [1:7561401529734436539:8039]
2025-10-15T10:59:46.020524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 715
2025-10-15T10:59:46.020587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:46.020661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401529734436250:2467], now have 1 active actors on pipe
2025-10-15T10:59:46.020688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401529734436539:8039], now have 1 active actors on pipe
2025-10-15T10:59:46.020707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401529734436420:8229], now have 1 active actors on pipe
2025-10-15T10:59:46.020744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401532534128486:7405]
2025-10-15T10:59:46.020762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401532534128486:7405]
2025-10-15T10:59:46.020774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401532534128486:7405]
2025-10-15T10:59:46.020807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:46.020836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:46.020858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:46.020869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:46.020874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:46.021030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:46.021050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:46.021094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:46.021115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:46.021217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401532534128486:7405]
2025-10-15T10:59:46.021246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:46.021266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:46.021314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:46.021339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:46.021363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:46.021372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:46.021398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:46.021433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:46.021543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:46.021838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:46.021861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:46.021908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:46.022183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 716 partition: 0 MaxSeqNo: 46 sessionId: src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0
2025-10-15T10:59:46.022921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad2796-3520b919-bc99c78e-2fb21b7c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:46.044243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0] Write session: try to update token
2025-10-15T10:59:46.044313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:46.054437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:46.054476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:46.054523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401532534128486:7405]
2025-10-15T10:59:46.054641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:46.054649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:46.057833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:46.059771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:46.061559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:46.063114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:46.065030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:46.066894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:46.120531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:46.120569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:46.120581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:46.144921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId: src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:46.145598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:46.145634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:46.145648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:46.145660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:46.145705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401532534128486:7405]
2025-10-15T10:59:46.145732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401532534128486:7405]
2025-10-15T10:59:46.145758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401532534128486:7405]
2025-10-15T10:59:46.145920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:46.145953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:46.146264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:46.146314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:46.146345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:46.147044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:46.166884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:46.292503Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:46.294706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:46.294755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:46.295337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401529734436539:8039]
2025-10-15T10:59:46.295445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:46.295508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:46.295507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:46.295546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:46.305192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 716 reason: error at write: Disconnected sessionId: src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0
2025-10-15T10:59:46.305496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 716 sessionId: src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0 is DEAD
2025-10-15T10:59:46.306599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:46.306634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0] Write session will restart in 0.008707s
2025-10-15T10:59:46.306720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0] Write session: Do CDS request
2025-10-15T10:59:46.306749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:46.327279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:46.327123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:46.327150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 717
2025-10-15T10:59:46.327949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:46.328059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:46.328078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:46.328088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:46.329342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 717 sessionId:  describe result for acl check
2025-10-15T10:59:46.329444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:46.329464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:46.329473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:46.329488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401534029403880:8234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:46.331957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401534029403880:8234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:46.340828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401534029403880:8234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:46.351043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401534029403880:8234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:46.351080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401534029403880:8234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:46.351097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401534029403880:8234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:46.351126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:46.395512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401534029404037:8039]
2025-10-15T10:59:46.448373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:46.450880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:46.451742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:46.451772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:46.451819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:46.452107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:46.452305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401536829096129:7414]
2025-10-15T10:59:46.454605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:46.457576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:46.457855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:46.459153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:46.459641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:46.459661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:46.459669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:46.459677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:46.459685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:46.459692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:46.459699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:46.459706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:46.459713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:46.459719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:46.459726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:46.459734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.459742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.459749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.459802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:46.459907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:46.459958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:46.460005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:46.460052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:46.460100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:46.460160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:46.460212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:46.460263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:46.460319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:46.460366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:46.460410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.460455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.460506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.460556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:46.460623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:46.460679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:46.460743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:46.460794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:46.460848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:46.460891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:46.460944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:46.461002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:46.461057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:46.461112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:46.461172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:46.461225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:46.461285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:46.461337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:46.461394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:46.461449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:46.461506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:46.461554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:46.461610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:46.461665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:46.461723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:46.461777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.461837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.461891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.461951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.461999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.462057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.462607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:46.489891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:46.501041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:46.501092Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:46.501108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:46.501128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:46.501153Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 716 [2:7561401536829096129:7414]
2025-10-15T10:59:46.501206Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:46.501263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:46.501279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:46.501292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:46.501304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:46.501348Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:46.501370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:46.501393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:46.503293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.503310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.503325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.503335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:46.505231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 716, pipe: [1:7561401534029404037:8039]
2025-10-15T10:59:46.504287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:46.505342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 716
2025-10-15T10:59:46.504328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.504436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.504571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.504716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:46.504771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401534029404037:8039], now have 1 active actors on pipe
2025-10-15T10:59:46.504786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401534029403912:8234], now have 1 active actors on pipe
2025-10-15T10:59:46.505411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 716
2025-10-15T10:59:46.504800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401534029403867:2467], now have 1 active actors on pipe
2025-10-15T10:59:46.504815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401536829096124:7414]
2025-10-15T10:59:46.504826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401536829096124:7414]
2025-10-15T10:59:46.504834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401536829096124:7414]
2025-10-15T10:59:46.504868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:46.504914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:46.504927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:46.504936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:46.504953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:46.505072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:46.505083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:46.505162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401536829096124:7414]
2025-10-15T10:59:46.505183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:46.505215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:46.505613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:46.505637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:46.505714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f17b464-9d905d24-8c64fcba-c561495d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:46.505744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:46.505774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:46.505785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:46.505817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:46.505861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:46.505915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:46.506426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:46.506455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:46.506547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:46.511739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 717 partition: 0 MaxSeqNo: 46 sessionId: src_id|4f17b464-9d905d24-8c64fcba-c561495d_0
2025-10-15T10:59:46.512810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970c19d8-a579bc06-ab7ce90-b344ecb4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4f17b464-9d905d24-8c64fcba-c561495d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:46.543437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f17b464-9d905d24-8c64fcba-c561495d_0] Write session: try to update token
2025-10-15T10:59:46.543497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f17b464-9d905d24-8c64fcba-c561495d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:46.569851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:46.569880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:46.569903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401536829096124:7414]
2025-10-15T10:59:46.570000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:46.570061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:46.577749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:46.581029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:46.583817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:46.585076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:46.590360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:46.590960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:46.623108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:46.623146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:46.623158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:46.623211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:46.623226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:46.623241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:46.623251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:46.623290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401536829096124:7414]
2025-10-15T10:59:46.623316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401536829096124:7414]
2025-10-15T10:59:46.623337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401536829096124:7414]
2025-10-15T10:59:46.623476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:46.623504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:46.624540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:46.627467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:46.627510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:46.627537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:46.637680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId: src_id|4f17b464-9d905d24-8c64fcba-c561495d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:46.659001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:46.761518Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:46.763647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:46.763689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:46.764321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401534029404037:8039]
2025-10-15T10:59:46.764425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:46.764441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:46.764469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:46.818218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:46.818340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 717 reason: error at write: Disconnected sessionId: src_id|4f17b464-9d905d24-8c64fcba-c561495d_0
2025-10-15T10:59:46.818626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 717 sessionId: src_id|4f17b464-9d905d24-8c64fcba-c561495d_0 is DEAD
2025-10-15T10:59:46.818983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f17b464-9d905d24-8c64fcba-c561495d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:46.819015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f17b464-9d905d24-8c64fcba-c561495d_0] Write session will restart in 0.008519s
2025-10-15T10:59:46.819137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f17b464-9d905d24-8c64fcba-c561495d_0] Write session: Do CDS request
2025-10-15T10:59:46.819177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f17b464-9d905d24-8c64fcba-c561495d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:46.831656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f17b464-9d905d24-8c64fcba-c561495d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:46.831592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:46.831619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 718
2025-10-15T10:59:46.832172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:46.832280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:46.832299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:46.832309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:46.833683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 718 sessionId:  describe result for acl check
2025-10-15T10:59:46.833792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:46.833813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:46.833821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:46.833837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401534029404296:8245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:46.836203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401534029404296:8245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:46.845362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401534029404296:8245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:46.852759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401534029404296:8245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:46.852801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401534029404296:8245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:46.852817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401534029404296:8245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:46.852847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:46.864445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401534029404472:8039]
2025-10-15T10:59:46.870405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:46.871938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:46.872666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:46.872694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:46.872733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:46.872952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:46.873128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401536829096425:7422]
2025-10-15T10:59:46.875212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:46.876110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:46.876336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:46.877575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:46.877928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:46.877951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:46.877958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:46.877966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:46.877972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:46.877978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:46.877985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:46.877992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:46.877999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:46.878005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:46.878012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:46.878019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.878025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.878032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.878079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:46.878182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:46.878229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:46.878273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:46.878331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:46.878382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:46.878432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:46.878502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:46.878567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:46.878623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:46.878668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:46.878719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.878765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.878811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.878859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:46.878927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:46.878988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:46.879048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:46.879100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:46.879158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:46.879212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:46.879264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:46.879322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:46.879402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:46.879454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:46.879513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:46.879565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:46.879620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:46.879670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:46.879727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:46.879780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:46.879833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:46.879882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:46.879938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:46.879988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:46.880047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:46.880097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.880155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.880214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.880267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.880319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.880375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.880859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:46.896721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:46.907063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:46.907124Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:46.907140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:46.907159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:46.907184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 717 [2:7561401536829096425:7422]
2025-10-15T10:59:46.907231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:46.907286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:46.907300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:46.907313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:46.907323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:46.907386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:46.907407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:46.907427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:46.944847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.944881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.944894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.944903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:46.945162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:46.945185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:46.945312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:46.945423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 717, pipe: [1:7561401534029404472:8039]
2025-10-15T10:59:46.945488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:46.945458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 717
2025-10-15T10:59:46.945547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 717
2025-10-15T10:59:46.945716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:46.945793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401534029404472:8039], now have 1 active actors on pipe
2025-10-15T10:59:46.945818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401534029404223:2467], now have 1 active actors on pipe
2025-10-15T10:59:46.945836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401534029404450:8245], now have 1 active actors on pipe
2025-10-15T10:59:46.945895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:46.945919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:46.945953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401536829096420:7422]
2025-10-15T10:59:46.945965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401536829096420:7422]
2025-10-15T10:59:46.945976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401536829096420:7422]
2025-10-15T10:59:46.946012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:46.946048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:46.946072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:46.946081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:46.946083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:46.946233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:46.946253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:46.946309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:46.946343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:46.946364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:46.946373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:46.946403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:46.946442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:46.946562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401536829096420:7422]
2025-10-15T10:59:46.946590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:46.946627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:46.946626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:46.947171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:46.947198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:46.947254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:46.947584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 718 partition: 0 MaxSeqNo: 46 sessionId: src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0
2025-10-15T10:59:46.948406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f17b464-9d905d24-8c64fcba-c561495d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:46.968947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0] Write session: try to update token
2025-10-15T10:59:46.968992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:46.979102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:46.979133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:46.979172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401536829096420:7422]
2025-10-15T10:59:46.979273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:46.979280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:46.982407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:46.984299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:46.985679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:46.987083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:46.989166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:46.989783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:47.035660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:47.035692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:47.035702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:47.035754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:47.035770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:47.035783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:47.035792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:47.035828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401536829096420:7422]
2025-10-15T10:59:47.035852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401536829096420:7422]
2025-10-15T10:59:47.035874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401536829096420:7422]
2025-10-15T10:59:47.036008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:47.036018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:47.036037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:47.036056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:47.036086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:47.037417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:47.056164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId: src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:47.080325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:47.172112Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:47.173917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:47.173947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:47.174306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:47.174349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401534029404472:8039]
2025-10-15T10:59:47.174436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:47.174458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:47.174693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:47.216138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 718 reason: error at write: Disconnected sessionId: src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0
2025-10-15T10:59:47.216439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 718 sessionId: src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0 is DEAD
2025-10-15T10:59:47.216820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:47.216867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0] Write session will restart in 0.009823s
2025-10-15T10:59:47.216979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0] Write session: Do CDS request
2025-10-15T10:59:47.217024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:47.230999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:47.231118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:47.231044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 719
2025-10-15T10:59:47.231587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:47.231677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:47.231686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:47.231693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:47.232847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 719 sessionId:  describe result for acl check
2025-10-15T10:59:47.232951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:47.232958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:47.232965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:47.232977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401538324371899:8253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:47.235604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401538324371899:8253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:47.244697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401538324371899:8253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:47.254822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401538324371899:8253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:47.254867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401538324371899:8253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:47.254884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401538324371899:8253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:47.254917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:47.274607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401538324372103:8039]
2025-10-15T10:59:47.278204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:47.280045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:47.280968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:47.281008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:47.281053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:47.281325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:47.281530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401541124064027:7426]
2025-10-15T10:59:47.283821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:47.286176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:47.286435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:47.287823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:47.288213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:47.288233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:47.288242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:47.288250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:47.288258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:47.288266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:47.288274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:47.288282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:47.288289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:47.288296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:47.288303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:47.288311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.288318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.288326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.288378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:47.288508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:47.288562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:47.288613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:47.288674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:47.288732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:47.288785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:47.288837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:47.288887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:47.288941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:47.288994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:47.289049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.289104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.289149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.289210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:47.289287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:47.289357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:47.289415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:47.289472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:47.289532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:47.289581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:47.289643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:47.289699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:47.289758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:47.289811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:47.289872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:47.289926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:47.289987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:47.290042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:47.290103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:47.290155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:47.290215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:47.290263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:47.290324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:47.290377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:47.290439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:47.290488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.290558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.290612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.290672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.290723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.290782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.291322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:47.321454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:47.330852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:47.330920Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:47.330938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:47.330957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:47.330980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 718 [2:7561401541124064027:7426]
2025-10-15T10:59:47.331029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:47.331088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:47.331101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:47.331114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:47.331125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:47.331172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:47.331193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:47.331213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:47.332202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.332234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.332248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.332259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:47.332563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:47.332591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.332879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 718
2025-10-15T10:59:47.332983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 718
2025-10-15T10:59:47.332707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.332977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 718, pipe: [1:7561401538324372103:8039]
2025-10-15T10:59:47.332854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.333082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:47.333166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401538324372103:8039], now have 1 active actors on pipe
2025-10-15T10:59:47.333197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401538324371811:2467], now have 1 active actors on pipe
2025-10-15T10:59:47.333212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401538324372058:8253], now have 1 active actors on pipe
2025-10-15T10:59:47.333250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:47.333265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:47.333290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401541124064022:7426]
2025-10-15T10:59:47.333301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401541124064022:7426]
2025-10-15T10:59:47.333308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401541124064022:7426]
2025-10-15T10:59:47.333337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:47.333388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:47.333392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:47.333408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:47.333421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:47.333532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:47.333552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:47.333592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11974e7-b8a27df2-52b50cba-c2152b91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:47.333611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:47.333621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:47.333627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:47.333650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:47.333675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:47.333773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401541124064022:7426]
2025-10-15T10:59:47.333807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:47.333837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:47.333852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:47.334371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:47.334412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:47.334493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:47.334823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 719 partition: 0 MaxSeqNo: 46 sessionId: src_id|11974e7-b8a27df2-52b50cba-c2152b91_0
2025-10-15T10:59:47.335617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c5018a-1c4ae97b-7ab0dca5-cd1af175_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|11974e7-b8a27df2-52b50cba-c2152b91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:47.356534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11974e7-b8a27df2-52b50cba-c2152b91_0] Write session: try to update token
2025-10-15T10:59:47.356597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11974e7-b8a27df2-52b50cba-c2152b91_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:47.363271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:47.363320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:47.363378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401541124064022:7426]
2025-10-15T10:59:47.363507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:47.363523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:47.365292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:47.366703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:47.367801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:47.368928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:47.370353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:47.370892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:47.426734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:47.426780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:47.426797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:47.426819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:47.426864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401541124064022:7426]
2025-10-15T10:59:47.426894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401541124064022:7426]
2025-10-15T10:59:47.426922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401541124064022:7426]
2025-10-15T10:59:47.427082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:47.427100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:47.427125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:47.427138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:47.427182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:47.430264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:47.438899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId: src_id|11974e7-b8a27df2-52b50cba-c2152b91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:47.471932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:47.584213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:47.586661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:47.586706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:47.587362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401538324372103:8039]
2025-10-15T10:59:47.587392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:47.587469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:47.587476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:47.591994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:47.608096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 719 reason: error at write: Disconnected sessionId: src_id|11974e7-b8a27df2-52b50cba-c2152b91_0
2025-10-15T10:59:47.608403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 719 sessionId: src_id|11974e7-b8a27df2-52b50cba-c2152b91_0 is DEAD
2025-10-15T10:59:47.608941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11974e7-b8a27df2-52b50cba-c2152b91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:47.608996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11974e7-b8a27df2-52b50cba-c2152b91_0] Write session will restart in 0.008610s
2025-10-15T10:59:47.609146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11974e7-b8a27df2-52b50cba-c2152b91_0] Write session: Do CDS request
2025-10-15T10:59:47.609193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11974e7-b8a27df2-52b50cba-c2152b91_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:47.622424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11974e7-b8a27df2-52b50cba-c2152b91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:47.622504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:47.622540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 720
2025-10-15T10:59:47.622955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:47.623068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:47.623091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:47.623101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:47.624262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 720 sessionId:  describe result for acl check
2025-10-15T10:59:47.624365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:47.624383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:47.624391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:47.624406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401538324372133:8258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:47.626723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401538324372133:8258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:47.631861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401538324372133:8258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:47.639542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401538324372133:8258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:47.639580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401538324372133:8258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:47.639595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401538324372133:8258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:47.639621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:47.687766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401538324372353:8039]
2025-10-15T10:59:47.712760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:47.714503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:47.715271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:47.715306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:47.715368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:47.715608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:47.715809Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401541124064354:7436]
2025-10-15T10:59:47.718119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:47.719260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:47.719563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:47.721143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:47.721487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:47.721510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:47.721525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:47.721551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:47.721567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:47.721582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:47.721601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:47.721616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:47.721631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:47.721645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:47.721666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:47.721682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.721701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.721716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.721809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:47.721930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:47.721990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:47.722038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:47.722099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:47.722144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:47.722188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:47.722232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:47.722276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:47.722322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:47.722369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:47.722412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.722455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.722498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.722561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:47.722679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:47.722793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:47.722888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:47.722938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:47.723005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:47.723049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:47.723103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:47.723150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:47.723202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:47.723246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:47.723299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:47.723343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:47.724135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:47.724203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:47.724255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:47.724307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:47.724367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:47.724415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:47.724474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:47.724527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:47.724587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:47.724637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.724693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.724738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.724793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.724844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.724903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.725428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:47.742403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:47.767995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:47.768046Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:47.768061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:47.768077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:47.768098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 719 [2:7561401541124064354:7436]
2025-10-15T10:59:47.768141Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:47.768193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:47.768205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:47.768215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:47.768224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:47.768264Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:47.768284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:47.768302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:47.770030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.770058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.770071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.770081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:47.770654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 719, pipe: [1:7561401538324372353:8039]
2025-10-15T10:59:47.770682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 719
2025-10-15T10:59:47.770767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 719
2025-10-15T10:59:47.770342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:47.770369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:47.770497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:47.770685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:47.770898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:47.770968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401538324372165:8258], now have 1 active actors on pipe
2025-10-15T10:59:47.770989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401538324372353:8039], now have 1 active actors on pipe
2025-10-15T10:59:47.771010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401538324372118:2467], now have 1 active actors on pipe
2025-10-15T10:59:47.771053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:47.771073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:47.771104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401541124064349:7436]
2025-10-15T10:59:47.771116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401541124064349:7436]
2025-10-15T10:59:47.771127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401541124064349:7436]
2025-10-15T10:59:47.771167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:47.771212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:47.771238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:47.771245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:47.771249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:47.771429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:47.771455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:47.771511Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1bd50cb-5e208750-68b136b6-c90173db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:47.771542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:47.771562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:47.771571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:47.771604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:47.771643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:47.771766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401541124064349:7436]
2025-10-15T10:59:47.771797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:47.771838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:47.771843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:47.772342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:47.772369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:47.772426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:47.772714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 720 partition: 0 MaxSeqNo: 46 sessionId: src_id|c1bd50cb-5e208750-68b136b6-c90173db_0
2025-10-15T10:59:47.773445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11974e7-b8a27df2-52b50cba-c2152b91_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c1bd50cb-5e208750-68b136b6-c90173db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:47.793924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bd50cb-5e208750-68b136b6-c90173db_0] Write session: try to update token
2025-10-15T10:59:47.793988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bd50cb-5e208750-68b136b6-c90173db_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:47.812769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:47.812808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:47.812840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401541124064349:7436]
2025-10-15T10:59:47.812937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:47.812967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:47.814994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:47.816451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:47.817909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:47.820002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:47.823025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:47.823602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:47.874260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId: src_id|c1bd50cb-5e208750-68b136b6-c90173db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:47.878518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:47.878561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:47.878574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:47.878583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:47.878616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401541124064349:7436]
2025-10-15T10:59:47.878641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401541124064349:7436]
2025-10-15T10:59:47.878663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401541124064349:7436]
2025-10-15T10:59:47.878776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:47.878799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:47.878810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:47.878820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:47.878832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:47.878857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:47.878860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:47.878874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:47.888021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:47.904386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:48.028053Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:48.029974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:48.030019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:48.030553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:48.030751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:48.030723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:48.030742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:48.041791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 720 reason: error at write: Disconnected sessionId: src_id|c1bd50cb-5e208750-68b136b6-c90173db_0
2025-10-15T10:59:48.042126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 720 sessionId: src_id|c1bd50cb-5e208750-68b136b6-c90173db_0 is DEAD
2025-10-15T10:59:48.042627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bd50cb-5e208750-68b136b6-c90173db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:48.042716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bd50cb-5e208750-68b136b6-c90173db_0] Write session will restart in 0.005243s
2025-10-15T10:59:48.042900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bd50cb-5e208750-68b136b6-c90173db_0] Write session: Do CDS request
2025-10-15T10:59:48.042946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bd50cb-5e208750-68b136b6-c90173db_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:48.053425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bd50cb-5e208750-68b136b6-c90173db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:48.058040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401538324372353:8039]
2025-10-15T10:59:48.058152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:48.058165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 721
2025-10-15T10:59:48.058550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:48.058676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:48.058695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:48.058716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:48.059961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 721 sessionId:  describe result for acl check
2025-10-15T10:59:48.060057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:48.060067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:48.060074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:48.060086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401542619339771:8269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:48.062132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401542619339771:8269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:48.071247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401542619339771:8269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:48.089688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401542619339771:8269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:48.089735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401542619339771:8269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:48.089752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401542619339771:8269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:48.089785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:48.139542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:48.141709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:48.142482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:48.142513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:48.142566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:48.142802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:48.142985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401545419031966:7443]
2025-10-15T10:59:48.145034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:48.145967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:48.146206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:48.147520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:48.147839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:48.147857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:48.147865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:48.147872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:48.147880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:48.147888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:48.147894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:48.147902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:48.147909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:48.147917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:48.147924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:48.147931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.147938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.147946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.147995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:48.148109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:48.148158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:48.148209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:48.148265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:48.148318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:48.148371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:48.148428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:48.148480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:48.148537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:48.148584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:48.148638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.148684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.148738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.148787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:48.148863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:48.148933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:48.148997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:48.149052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:48.149115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:48.149168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:48.149224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:48.149279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:48.149340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:48.149396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:48.149456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:48.149524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:48.149588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:48.149640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:48.149704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:48.149761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:48.149823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:48.149879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:48.149940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:48.149994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:48.150055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:48.150102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.150163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.150218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.150279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.150333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.150392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.150943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:48.157336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401542619340052:8039]
2025-10-15T10:59:48.169922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:48.179314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:48.179384Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:48.179397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:48.179417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:48.179443Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 720 [2:7561401545419031966:7443]
2025-10-15T10:59:48.179497Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:48.179557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:48.179572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:48.179583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:48.179592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:48.179631Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:48.179649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:48.179671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:48.181249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.181278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.181292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.181306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:48.181541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:48.181565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.181710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.181906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.181880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 720, pipe: [1:7561401542619340052:8039]
2025-10-15T10:59:48.182001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 720
2025-10-15T10:59:48.182092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 720
2025-10-15T10:59:48.182150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:48.182236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401542619340052:8039], now have 1 active actors on pipe
2025-10-15T10:59:48.182266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401542619339756:2467], now have 1 active actors on pipe
2025-10-15T10:59:48.182289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401542619339837:8269], now have 1 active actors on pipe
2025-10-15T10:59:48.182332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401545419031961:7443]
2025-10-15T10:59:48.182353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401545419031961:7443]
2025-10-15T10:59:48.182367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401545419031961:7443]
2025-10-15T10:59:48.182407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:48.182463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:48.182491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:48.182492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:48.182505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:48.182511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:48.182565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:48.182712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:48.182731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:48.182880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:48.182908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:48.182920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:48.182926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:48.182952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:48.182983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:48.183014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401545419031961:7443]
2025-10-15T10:59:48.183053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:48.183089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:48.183123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:48.183564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:48.183593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:48.183650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:48.183921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 721 partition: 0 MaxSeqNo: 46 sessionId: src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0
2025-10-15T10:59:48.184748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1bd50cb-5e208750-68b136b6-c90173db_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:48.206129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0] Write session: try to update token
2025-10-15T10:59:48.206195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:48.257313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:48.257352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:48.257390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401545419031961:7443]
2025-10-15T10:59:48.257526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:48.257593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:48.260283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:48.262054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:48.263190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:48.264328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:48.266059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:48.301485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:48.301662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:48.301686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:48.301699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:48.301755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:48.301778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:48.301793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:48.301806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:48.301851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401545419031961:7443]
2025-10-15T10:59:48.301886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401545419031961:7443]
2025-10-15T10:59:48.301912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401545419031961:7443]
2025-10-15T10:59:48.302055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:48.302067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:48.302091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:48.302111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:48.302140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:48.308405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:48.315146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId: src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:48.337262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:48.450921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:48.452355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:48.452397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:48.453165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401542619340052:8039]
2025-10-15T10:59:48.453265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:48.453382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:48.453393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:48.456052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:48.492082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 721 reason: error at write: Disconnected sessionId: src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0
2025-10-15T10:59:48.492407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 721 sessionId: src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0 is DEAD
2025-10-15T10:59:48.492843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:48.492890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0] Write session will restart in 0.009095s
2025-10-15T10:59:48.493045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0] Write session: Do CDS request
2025-10-15T10:59:48.493090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:48.506758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:48.510210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:48.510246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 722
2025-10-15T10:59:48.510602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:48.510735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:48.510757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:48.510768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:48.512868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 722 sessionId:  describe result for acl check
2025-10-15T10:59:48.512985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:48.513005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:48.513014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:48.513029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401542619340125:8276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:48.515600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401542619340125:8276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:48.524956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401542619340125:8276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:48.533799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401542619340125:8276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:48.533837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401542619340125:8276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:48.533854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401542619340125:8276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:48.533883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:48.552930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401542619340325:8039]
2025-10-15T10:59:48.575753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:48.578684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:48.579526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:48.579560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:48.579601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:48.579855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:48.580043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401545419032278:7448]
2025-10-15T10:59:48.582187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:48.583262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:48.583509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:48.584839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:48.585194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:48.585218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:48.585225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:48.585233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:48.585240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:48.585246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:48.585252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:48.585258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:48.585265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:48.585273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:48.585280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:48.585287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.585294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.585301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.585348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:48.585453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:48.585509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:48.585557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:48.585601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:48.585660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:48.585719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:48.585783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:48.585835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:48.585887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:48.585950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:48.586001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.586052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.586101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.586151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:48.586220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:48.586281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:48.586341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:48.586394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:48.586453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:48.586507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:48.586579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:48.586631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:48.586688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:48.586739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:48.586795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:48.586847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:48.586902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:48.586964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:48.587021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:48.587069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:48.587124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:48.587176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:48.587234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:48.587283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:48.587340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:48.587501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.587562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.587615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.587669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.587718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.587774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.588281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:48.611177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:48.621484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:48.621539Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:48.621557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:48.621575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:48.621599Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 721 [2:7561401545419032278:7448]
2025-10-15T10:59:48.621650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:48.621707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:48.621720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:48.621733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:48.621744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:48.621789Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:48.621809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:48.621829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:48.639962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.639996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.640004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.640013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:48.640605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 721
2025-10-15T10:59:48.640694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 721, pipe: [1:7561401542619340325:8039]
2025-10-15T10:59:48.640770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 721
2025-10-15T10:59:48.643387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 722 partition: 0 MaxSeqNo: 46 sessionId: src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0
2025-10-15T10:59:48.640871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:48.640899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:48.641007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:48.641165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:48.641344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:48.641381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401542619340077:2467], now have 1 active actors on pipe
2025-10-15T10:59:48.641401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401542619340325:8039], now have 1 active actors on pipe
2025-10-15T10:59:48.641420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401542619340250:8276], now have 1 active actors on pipe
2025-10-15T10:59:48.641506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:48.641525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:48.641554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401545419032273:7448]
2025-10-15T10:59:48.641565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401545419032273:7448]
2025-10-15T10:59:48.641578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401545419032273:7448]
2025-10-15T10:59:48.641615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:48.641649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:48.641666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:48.641674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:48.641677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:48.641824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:48.641841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:48.641897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:48.641921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:48.641936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:48.641945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:48.641974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:48.642009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:48.642113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401545419032273:7448]
2025-10-15T10:59:48.644179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be1ab4a-fd549a12-1d7bba92-65ade73b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:48.642144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:48.642182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:48.642236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:48.643010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:48.643039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:48.643116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:48.669079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0] Write session: try to update token
2025-10-15T10:59:48.669145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:48.709082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:48.709126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:48.709143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:48.709157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:48.709197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401545419032273:7448]
2025-10-15T10:59:48.709228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401545419032273:7448]
2025-10-15T10:59:48.709257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401545419032273:7448]
2025-10-15T10:59:48.709439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:48.709466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:48.709509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:48.709548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:48.709570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:48.712951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:48.789190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId: src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:48.812705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:48.861134Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:48.865310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:48.865362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:48.868300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:48.868470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401542619340325:8039]
2025-10-15T10:59:48.868562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:48.868575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:48.868605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:48.883327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 722 reason: error at write: Disconnected sessionId: src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0
2025-10-15T10:59:48.884264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 722 sessionId: src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0 is DEAD
2025-10-15T10:59:48.887863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:48.887917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0] Write session will restart in 0.008414s
2025-10-15T10:59:48.888054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0] Write session: Do CDS request
2025-10-15T10:59:48.888102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:48.905142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:48.904772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:48.904814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 723
2025-10-15T10:59:48.905894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:48.906086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:48.906112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:48.906133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:48.908072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 723 sessionId:  describe result for acl check
2025-10-15T10:59:48.908182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:48.908194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:48.908203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:48.908219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401542619340401:8281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:48.910392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401542619340401:8281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:48.922921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401542619340401:8281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:48.934371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401542619340401:8281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:48.934413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401542619340401:8281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:48.934429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401542619340401:8281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:48.934459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:48.969133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401542619340509:8039]
2025-10-15T10:59:49.035467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:49.044203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:49.045002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:49.045031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:49.045068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:49.045290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:49.045465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401549713999902:7455]
2025-10-15T10:59:49.047918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:49.048826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:49.049010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:49.050227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:49.050515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:49.050534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:49.050541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:49.050561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:49.050568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:49.050575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:49.050582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:49.050590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:49.050598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:49.050604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:49.050611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:49.050618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.050624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.050629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.050681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:49.050783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:49.050828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:49.050872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:49.050912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:49.050958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:49.051003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:49.051046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:49.051085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:49.051139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:49.051178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:49.051226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.051269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.051320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.051377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:49.051441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:49.051493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:49.051546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:49.051593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:49.051644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:49.051686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:49.051749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:49.051795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:49.051846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:49.051889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:49.051940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:49.051983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:49.052032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:49.052074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:49.052125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:49.052171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:49.052220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:49.052262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:49.052317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:49.052361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:49.052411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:49.052454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.052505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.052551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.052602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.052645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.052699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.053188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:49.072625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:49.084053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:49.084093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:49.084107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:49.084122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:49.084142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 722 [2:7561401549713999902:7455]
2025-10-15T10:59:49.084188Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:49.084234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:49.084247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:49.084256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:49.084265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:49.084307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:49.084324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:49.084343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:49.087154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.087169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.087181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.087192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:49.089182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:49.089218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.089356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.089536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.089746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:49.089823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401542619340447:8281], now have 1 active actors on pipe
2025-10-15T10:59:49.089845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401542619340387:2467], now have 1 active actors on pipe
2025-10-15T10:59:49.089865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401542619340509:8039], now have 1 active actors on pipe
2025-10-15T10:59:49.089886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401549713999897:7455]
2025-10-15T10:59:49.089902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401549713999897:7455]
2025-10-15T10:59:49.089915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401549713999897:7455]
2025-10-15T10:59:49.089956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:49.090024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:49.090197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:49.090215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:49.090328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401549713999897:7455]
2025-10-15T10:59:49.090349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:49.088479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 722
2025-10-15T10:59:49.088569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 722
2025-10-15T10:59:49.088639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 722, pipe: [1:7561401542619340509:8039]
2025-10-15T10:59:49.091001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:49.091023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:49.091033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:49.091054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:49.092231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:49.092268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:49.092348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:49.092387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:49.092402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:49.092412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:49.092451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:49.092487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:49.092531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:49.099926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:49.099965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:49.100048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:49.100526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 723 partition: 0 MaxSeqNo: 46 sessionId: src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0
2025-10-15T10:59:49.103964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4346a553-f5dadd7a-2f13bf60-901b1442_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:49.147031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0] Write session: try to update token
2025-10-15T10:59:49.147079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:49.230316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:49.230348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:49.230358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:49.230365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:49.230388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401549713999897:7455]
2025-10-15T10:59:49.230417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401549713999897:7455]
2025-10-15T10:59:49.230430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401549713999897:7455]
2025-10-15T10:59:49.230533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:49.230540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:49.230547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:49.230625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:49.230644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:49.230711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:49.230748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:49.230774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:49.231610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:49.284723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId: src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:49.306297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:49.393008Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:49.404194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:49.404253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:49.404325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:49.404339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:49.404382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401549713999897:7455]
2025-10-15T10:59:49.404583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:49.405797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:49.409591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:49.438354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:49.438436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0] Write session will restart in 0.005398s
2025-10-15T10:59:49.438662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0] Write session: Do CDS request
2025-10-15T10:59:49.438716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:49.437565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 723 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0
2025-10-15T10:59:49.437913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 723 sessionId: src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0 is DEAD
2025-10-15T10:59:49.451733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:49.458608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401542619340509:8039]
2025-10-15T10:59:49.458695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:49.458816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:49.458829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 724
2025-10-15T10:59:49.459496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:49.459730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:49.459758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:49.459769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:49.463836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 724 sessionId:  describe result for acl check
2025-10-15T10:59:49.463948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:49.463965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:49.463975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:49.463992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401546914308055:8294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:49.466663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401546914308055:8294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:49.483477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401546914308055:8294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:49.503888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401546914308055:8294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:49.503937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401546914308055:8294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:49.503955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401546914308055:8294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:49.503985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:49.557527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401546914308326:8039]
2025-10-15T10:59:49.561475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:49.574007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:49.574846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:49.574879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:49.574914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:49.575146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:49.575328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401549714000234:7465]
2025-10-15T10:59:49.577403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:49.582932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:49.583247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:49.584607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:49.584941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:49.584950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:49.584957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:49.584965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:49.584971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:49.584977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:49.584985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:49.584991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:49.584998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:49.585005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:49.585012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:49.585018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.585024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.585031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.585076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:49.585189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:49.585243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:49.585289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:49.585332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:49.585374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:49.585430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:49.585470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:49.585511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:49.585550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:49.585597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:49.585639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.585680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.585719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.585758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:49.585826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:49.585878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:49.585927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:49.585967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:49.586013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:49.586052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:49.586099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:49.586138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:49.586184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:49.586222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:49.586280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:49.586324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:49.586370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:49.586410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:49.586466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:49.586515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:49.586574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:49.586615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:49.586666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:49.586707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:49.586756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:49.586799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.586871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.586922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.586975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.587019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.587085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.588779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:49.617734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:49.633102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:49.633154Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:49.633170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:49.633187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:49.633211Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 723 [2:7561401549714000234:7465]
2025-10-15T10:59:49.633259Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:49.633314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:49.633328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:49.633339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:49.633348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:49.633391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:49.633422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:49.633440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:49.635885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.635908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.635921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.635932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:49.636214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:49.636232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:49.636368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:49.636555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:49.636780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:49.636842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401549714000220:7465]
2025-10-15T10:59:49.636856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401549714000220:7465]
2025-10-15T10:59:49.636869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401549714000220:7465]
2025-10-15T10:59:49.636908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:49.636977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:49.637144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:49.637162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:49.637269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401549714000220:7465]
2025-10-15T10:59:49.637286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:49.638309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:49.638330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:49.638341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:49.638362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:49.639556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 723, pipe: [1:7561401546914308326:8039]
2025-10-15T10:59:49.639659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 723
2025-10-15T10:59:49.639724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 723
2025-10-15T10:59:49.643676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401546914308326:8039], now have 1 active actors on pipe
2025-10-15T10:59:49.643727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401546914308177:8294], now have 1 active actors on pipe
2025-10-15T10:59:49.643749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401546914308041:2467], now have 1 active actors on pipe
2025-10-15T10:59:49.643827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:49.643852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:49.643967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:49.644015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:49.644034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:49.644046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:49.644087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:49.644140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:49.644196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:49.647889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:49.647936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:49.648016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:49.651676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 724 partition: 0 MaxSeqNo: 46 sessionId: src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0
2025-10-15T10:59:49.655868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a672962e-2fb7a644-5f49fea6-2ddb5621_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:49.715206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0] Write session: try to update token
2025-10-15T10:59:49.715257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:49.805600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:49.805633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:49.805645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:49.805705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:49.805718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:49.805730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:49.805740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:49.805773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401549714000220:7465]
2025-10-15T10:59:49.805797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401549714000220:7465]
2025-10-15T10:59:49.805817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401549714000220:7465]
2025-10-15T10:59:49.805986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:49.806004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:49.807192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:49.807238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:49.807266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:49.807929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:49.916387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId: src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:49.938795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:49.979941Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:50.004881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:50.004942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:50.005002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:50.005017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:50.005062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401549714000220:7465]
2025-10-15T10:59:50.005268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:50.005594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401546914308326:8039]
2025-10-15T10:59:50.005713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:50.005726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:50.006048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:50.005594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:50.024753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 724 reason: error at write: Disconnected sessionId: src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0
2025-10-15T10:59:50.025133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 724 sessionId: src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0 is DEAD
2025-10-15T10:59:50.025540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:50.025604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0] Write session will restart in 0.009103s
2025-10-15T10:59:50.025796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0] Write session: Do CDS request
2025-10-15T10:59:50.025838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:50.040416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:50.040447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 725
2025-10-15T10:59:50.040554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:50.041067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:50.041201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:50.041224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:50.041234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:50.042639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 725 sessionId:  describe result for acl check
2025-10-15T10:59:50.042753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:50.042774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:50.042785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:50.042803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401551209275687:8303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:50.045652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401551209275687:8303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:50.048172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:50.050232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:50.051067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:50.051088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:50.051131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:50.051423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:50.052268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401551209275687:8303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:50.051605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401554008967606:7470]
2025-10-15T10:59:50.053940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:50.054793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:50.055026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:50.056371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:50.056713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.056732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.056741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.056749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.056758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.056765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.056772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.056779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.056787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.056795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.056804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.056812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.056818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.056825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.056881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.057002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.057054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.057114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.057170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.057230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.057284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.057345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.057693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.057777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.057833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.057890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.057947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.058000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.058072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.058154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.058223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.058286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.058340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.058401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.058459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.058520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.058587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.058646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.058697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.058757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.058809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.058868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.058925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.058986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.059046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.059106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.059157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.059215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.059274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.059332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.059405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.059470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.059532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.059591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.059652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.059719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.060286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:50.060366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401551209275687:8303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:50.060407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401551209275687:8303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:50.060425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401551209275687:8303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:50.060461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:50.077165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:50.087029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:50.087088Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:50.087107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:50.087127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:50.087156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 724 [2:7561401554008967606:7470]
2025-10-15T10:59:50.087213Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:50.087280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:50.087295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:50.087310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:50.087323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:50.087435Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:50.087469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:50.087493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:50.105958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401551209275724:8039]
2025-10-15T10:59:50.126774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.126808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.126818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.126828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:50.127097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:50.127123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.127248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.127743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.127900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 724
2025-10-15T10:59:50.127947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:50.128035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401551209275655:2467], now have 1 active actors on pipe
2025-10-15T10:59:50.128062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401551209275724:8039], now have 1 active actors on pipe
2025-10-15T10:59:50.128081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401551209275720:8303], now have 1 active actors on pipe
2025-10-15T10:59:50.128107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401554008967601:7470]
2025-10-15T10:59:50.128120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401554008967601:7470]
2025-10-15T10:59:50.127998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 724, pipe: [1:7561401551209275724:8039]
2025-10-15T10:59:50.128131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401554008967601:7470]
2025-10-15T10:59:50.128083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 724
2025-10-15T10:59:50.128165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:50.128238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:50.128287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:50.128302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:50.128313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:50.128410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:50.128432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:50.128589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:50.128616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:50.128645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401554008967601:7470]
2025-10-15T10:59:50.128669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:50.128693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:50.128778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:50.128814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:50.128836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:50.128846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:50.128883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:50.128928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:50.129014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:50.129614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:50.129640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:50.129699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:50.130005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 725 partition: 0 MaxSeqNo: 46 sessionId: src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0
2025-10-15T10:59:50.130890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfee1519-8dc05172-cd127f85-2c1e820c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:50.151717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0] Write session: try to update token
2025-10-15T10:59:50.151779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:50.183070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:50.183115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:50.183129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:50.183142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:50.183181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401554008967601:7470]
2025-10-15T10:59:50.183214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401554008967601:7470]
2025-10-15T10:59:50.183242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401554008967601:7470]
2025-10-15T10:59:50.183394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:50.183431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:50.183461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:50.191539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:50.191584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:50.191598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:50.191656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:50.191680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:50.192686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:50.265798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId: src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:50.284344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:50.350255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:50.352628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:50.352675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:50.356841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:50.356303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:50.356328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401551209275724:8039]
2025-10-15T10:59:50.356427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:50.356439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:50.366965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 725 reason: error at write: Disconnected sessionId: src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0
2025-10-15T10:59:50.367244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 725 sessionId: src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0 is DEAD
2025-10-15T10:59:50.368054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:50.368093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0] Write session will restart in 0.007889s
2025-10-15T10:59:50.368203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0] Write session: Do CDS request
2025-10-15T10:59:50.368235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:50.389290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:50.388019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:50.388067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 726
2025-10-15T10:59:50.389942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:50.390070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:50.390086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:50.390099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:50.392281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 726 sessionId:  describe result for acl check
2025-10-15T10:59:50.392478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:50.392500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:50.392517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:50.392550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401551209275750:8307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:50.396348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401551209275750:8307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:50.402474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401551209275750:8307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:50.415231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401551209275750:8307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:50.415271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401551209275750:8307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:50.415286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401551209275750:8307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:50.415315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:50.420266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:50.425070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:50.425846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:50.425878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:50.425920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:50.426163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:50.426348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401554008967679:7479]
2025-10-15T10:59:50.428497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:50.429740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:50.430003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:50.431194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:50.431560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.431580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.431588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.431594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.431601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.431607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.431613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.431619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.431625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.431631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.431639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.431646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.431652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.431658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.431702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.431804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.431851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.431904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.431947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.431993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.432036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.432079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.432121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.432164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.432207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.432248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.432292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.432334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.432376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.432435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.432487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.432539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.432583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.432632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.432673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.432725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.432774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.432824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.432868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.432917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.432961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.433014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.433058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.433110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.433155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.433205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.433250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.433304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.433349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.433401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.433444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.433496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.433539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.433590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.433631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.433682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.434153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:50.459508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401551209275791:8039]
2025-10-15T10:59:50.467735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:50.477230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:50.477280Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:50.477295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:50.477312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:50.477333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 725 [2:7561401554008967679:7479]
2025-10-15T10:59:50.477380Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:50.480528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 725, pipe: [1:7561401551209275791:8039]
2025-10-15T10:59:50.477433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:50.480573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 725
2025-10-15T10:59:50.480625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 725
2025-10-15T10:59:50.477446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:50.477458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:50.477468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:50.477509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:50.477528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:50.477546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:50.479029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.479043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.479054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.479065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:50.479304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:50.479319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.479458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.479618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.479825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:50.479890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401554008967674:7479]
2025-10-15T10:59:50.479903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401554008967674:7479]
2025-10-15T10:59:50.479915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401554008967674:7479]
2025-10-15T10:59:50.479954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:50.480023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:50.480067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:50.480080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:50.480099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:50.480182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:50.480197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:50.480308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401554008967674:7479]
2025-10-15T10:59:50.480330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:50.480352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:50.480423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401551209275791:8039], now have 1 active actors on pipe
2025-10-15T10:59:50.480446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401551209275784:8307], now have 1 active actors on pipe
2025-10-15T10:59:50.480465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401551209275736:2467], now have 1 active actors on pipe
2025-10-15T10:59:50.480884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:50.480909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:50.480984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:50.481006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:50.481017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:50.481023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:50.481045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:50.481074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:50.481103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:50.481521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:50.481540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:50.481615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:50.482100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 726 partition: 0 MaxSeqNo: 46 sessionId: src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0
2025-10-15T10:59:50.482802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75252e6-a8b992d5-41a8353d-59ea37e0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:50.514534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0] Write session: try to update token
2025-10-15T10:59:50.514601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:50.613198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:50.613236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:50.613248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:50.613257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:50.613290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401554008967674:7479]
2025-10-15T10:59:50.613314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401554008967674:7479]
2025-10-15T10:59:50.613337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401554008967674:7479]
2025-10-15T10:59:50.613523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:50.613541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:50.613553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:50.613591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:50.613608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:50.614937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:50.615922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:50.615968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:50.615996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:50.633813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId: src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:50.655811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:50.758306Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:50.770569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:50.770633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:50.770694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:50.770708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:50.770747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401554008967674:7479]
2025-10-15T10:59:50.770990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:50.771311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:50.771553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401551209275791:8039]
2025-10-15T10:59:50.771657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:50.771672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:50.775253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:50.783443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:50.783511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0] Write session will restart in 0.009092s
2025-10-15T10:59:50.783627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0] Write session: Do CDS request
2025-10-15T10:59:50.783682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:50.782696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 726 reason: error at write: Disconnected sessionId: src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0
2025-10-15T10:59:50.782988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 726 sessionId: src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0 is DEAD
2025-10-15T10:59:50.799383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:50.799431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 727
2025-10-15T10:59:50.799665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:50.804121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:50.804237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:50.804249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:50.804257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:50.805712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 727 sessionId:  describe result for acl check
2025-10-15T10:59:50.805832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:50.805843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:50.805852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:50.805871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401551209275822:8312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:50.808753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401551209275822:8312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:50.818012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401551209275822:8312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:50.828879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:50.831804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401551209275822:8312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:50.831853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401551209275822:8312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:50.831871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401551209275822:8312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:50.831905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:50.832906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:50.833764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:50.833798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:50.833843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:50.834116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:50.834304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401554008967766:7487]
2025-10-15T10:59:50.836266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:50.837123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:50.837321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:50.838363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:50.838660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.838677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.838684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.838689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.838694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.838700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.838706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.838712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.838718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.838725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.838731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.838737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.838744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.838751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.838795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.838896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.838943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.838988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.839046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.839139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.839248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.839338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.839407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.839453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.839495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.839537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.839602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.839647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.839687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.839742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:50.839793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.839844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:50.839888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.839938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:50.839980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.840028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:50.840071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.840119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:50.840170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.840251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:50.840352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.840420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:50.840467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.840507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:50.840562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.840606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:50.840637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.840670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:50.840701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.840734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:50.840763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.840812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.840853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.840902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.840942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.840989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.841521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:50.870449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401551209275859:8039]
2025-10-15T10:59:50.868075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:50.879021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:50.879080Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:50.879100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:50.879122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:50.879151Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 726 [2:7561401554008967766:7487]
2025-10-15T10:59:50.879209Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:50.879276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:50.879292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:50.879306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:50.879318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:50.879656Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:50.879694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:50.879717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:50.880741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.880765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.880780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.880793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:50.881077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:50.881095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:50.881247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:50.881443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:50.881692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:50.881773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401551209275859:8039], now have 1 active actors on pipe
2025-10-15T10:59:50.881799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401554008967760:7487]
2025-10-15T10:59:50.881813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401554008967760:7487]
2025-10-15T10:59:50.881827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401554008967760:7487]
2025-10-15T10:59:50.881870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:50.881941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401551209275853:8312], now have 1 active actors on pipe
2025-10-15T10:59:50.881966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401551209275808:2467], now have 1 active actors on pipe
2025-10-15T10:59:50.882001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:50.882198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:50.882216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:50.882340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401554008967760:7487]
2025-10-15T10:59:50.882360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:50.882425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 726
2025-10-15T10:59:50.882411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 726, pipe: [1:7561401551209275859:8039]
2025-10-15T10:59:50.882523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 726
2025-10-15T10:59:50.882611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:50.882634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:50.882646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:50.882672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:50.883731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:50.883761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:50.883853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:50.883886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:50.883905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:50.883927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:50.883973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:50.884037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:50.884092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:50.886097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:50.886131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:50.886206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:50.887461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a93cdbfc-cdd8d768-6ee7f5c0-7e102198_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:50.886590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 727 partition: 0 MaxSeqNo: 46 sessionId: src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0
2025-10-15T10:59:50.916212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0] Write session: try to update token
2025-10-15T10:59:50.916273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:50.987157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:50.987210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:50.987223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:50.987233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:50.987271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401554008967760:7487]
2025-10-15T10:59:50.987296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401554008967760:7487]
2025-10-15T10:59:50.987320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401554008967760:7487]
2025-10-15T10:59:50.987461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:50.987525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:50.987560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:50.987595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:50.987608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:50.987620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:50.987678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:50.987707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:50.989925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:51.028252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId: src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:51.050571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:51.138179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:51.150243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:51.150298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:51.150392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:51.150406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:51.150444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401554008967760:7487]
2025-10-15T10:59:51.150670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:51.151451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:51.155686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401551209275859:8039]
2025-10-15T10:59:51.155858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:51.167188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:51.167320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 727 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0
2025-10-15T10:59:51.167655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 727 sessionId: src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0 is DEAD
2025-10-15T10:59:51.171130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:51.171185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0] Write session will restart in 0.009754s
2025-10-15T10:59:51.171330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0] Write session: Do CDS request
2025-10-15T10:59:51.171388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:51.189636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:51.189694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 728
2025-10-15T10:59:51.189921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:51.190831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:51.191066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:51.191122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:51.191140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:51.193304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:51.194324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 728 sessionId:  describe result for acl check
2025-10-15T10:59:51.194489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:51.194511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:51.194520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:51.194537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401555504243217:8323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:51.197063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401555504243217:8323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:51.197910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:51.198830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:51.198863Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:51.198908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:51.199156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:51.199335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401558303935121:7489]
2025-10-15T10:59:51.202017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401555504243217:8323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:51.201484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:51.202357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:51.202571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:51.203831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:51.204123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.204130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.204138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.204145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.204151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.204157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.204163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.204171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.204178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.204184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.204190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.204197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.204203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.204211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.204252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.204355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.204400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.204445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.204488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.204541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.204602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.204646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.204700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.204747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.204789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.204835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.204880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.204925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.204963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.205025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.205081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.205130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.205175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.205228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.205271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.205321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.205368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.205418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.205461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.205522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.205573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.205631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.205679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.205740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.205792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.205846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.205894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.205961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.206016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.206081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.206128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.206189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.206242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.206297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.206346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.206401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.206927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:51.210084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401555504243217:8323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:51.210135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401555504243217:8323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:51.210151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401555504243217:8323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:51.210181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:51.231946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:51.240611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:51.240662Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:51.240680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:51.240698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:51.240721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 727 [2:7561401558303935121:7489]
2025-10-15T10:59:51.240771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:51.240826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:51.240840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:51.240853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:51.240866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:51.240914Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:51.240939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:51.240963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:51.242371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.242393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.242402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.242410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:51.242613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:51.242630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.242754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.242919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.242958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 727
2025-10-15T10:59:51.243048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 727
2025-10-15T10:59:51.243163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:51.243262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401555504243250:8323], now have 1 active actors on pipe
2025-10-15T10:59:51.243294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401555504243200:2467], now have 1 active actors on pipe
2025-10-15T10:59:51.243339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:51.243387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:51.243427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401558303935116:7489]
2025-10-15T10:59:51.243446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401558303935116:7489]
2025-10-15T10:59:51.243457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401558303935116:7489]
2025-10-15T10:59:51.243483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:51.243555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:51.243732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:51.243730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:51.243746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:51.243756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:51.243757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:51.243814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:51.243841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:51.243858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:51.243868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:51.243902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:51.243949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:51.244084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401558303935116:7489]
2025-10-15T10:59:51.244119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:51.244165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:51.244171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:51.245021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:51.245057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:51.245123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:51.245434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 728 partition: 0 MaxSeqNo: 46 sessionId: src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0
2025-10-15T10:59:51.246206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d5b0f7b-dd2a2f0d-6947eac-c5236752_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:51.255926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401555504243257:8039]
2025-10-15T10:59:51.256592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401555504243257:8039], now have 1 active actors on pipe
2025-10-15T10:59:51.256710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 727, pipe: [1:7561401555504243257:8039]
2025-10-15T10:59:51.264768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0] Write session: try to update token
2025-10-15T10:59:51.264823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:51.275471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:51.275516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:51.275557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401558303935116:7489]
2025-10-15T10:59:51.275699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:51.277540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:51.278547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:51.279685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:51.279827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:51.281137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:51.288809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:51.289294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:51.362129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId: src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:51.369784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:51.369812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:51.369824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:51.369892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:51.369906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:51.369921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:51.369933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:51.369970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401558303935116:7489]
2025-10-15T10:59:51.369996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401558303935116:7489]
2025-10-15T10:59:51.370018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401558303935116:7489]
2025-10-15T10:59:51.370156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:51.370192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:51.370188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:51.370232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:51.370274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:51.371386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:51.386648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:51.506767Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:51.522242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:51.522282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:51.523277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:51.523306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:51.524615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401555504243257:8039]
2025-10-15T10:59:51.524793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:51.526701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:51.531858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 728 reason: error at write: Disconnected sessionId: src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0
2025-10-15T10:59:51.532243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 728 sessionId: src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0 is DEAD
2025-10-15T10:59:51.535921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:51.535959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0] Write session will restart in 0.006276s
2025-10-15T10:59:51.536068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0] Write session: Do CDS request
2025-10-15T10:59:51.536103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:51.552625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:51.552995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:51.553023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 729
2025-10-15T10:59:51.553317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:51.553421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:51.553444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:51.553453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:51.554340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 729 sessionId:  describe result for acl check
2025-10-15T10:59:51.554438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:51.554454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:51.554464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:51.554478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401555504243294:8330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:51.556662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401555504243294:8330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:51.562748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:51.563230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401555504243294:8330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:51.572155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:51.572982Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:51.575047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401555504243294:8330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:51.573000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:51.573039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:51.575088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401555504243294:8330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:51.573267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:51.575103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401555504243294:8330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:51.573427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401558303935190:7494]
2025-10-15T10:59:51.575132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:51.579595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:51.580614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:51.580813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:51.582037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:51.582349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.582357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.582364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.582371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.582377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.582383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.582390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.582396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.582402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.582408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.582414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.582420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.582426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.582432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.582472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.582570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.582631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.582684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.582733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.582833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.582945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.583075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.583175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.583276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.583404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.583514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.583626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.583757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.583849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.583999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.584153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.584261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.584312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.584365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.584410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.584463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.584510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.584561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.584603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.584656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.584700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.584749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.584791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.584838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.584887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.584939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.584983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.585033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.585079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.585128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.585171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.585224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.585269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.585317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.585361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.585410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.585893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:51.612294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:51.624127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401555504243336:8039]
2025-10-15T10:59:51.622929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:51.622974Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:51.622990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:51.623008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:51.623032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 728 [2:7561401558303935190:7494]
2025-10-15T10:59:51.623080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:51.623142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:51.623157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:51.623169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:51.623179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:51.623223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:51.623244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:51.623265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:51.624918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.624935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.624947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.624957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:51.625221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:51.625238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.625367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.625538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.625767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:51.625831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401558303935185:7494]
2025-10-15T10:59:51.625846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401558303935185:7494]
2025-10-15T10:59:51.625857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401558303935185:7494]
2025-10-15T10:59:51.625895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:51.625964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:51.626123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:51.626148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:51.626740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 728
2025-10-15T10:59:51.626256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401558303935185:7494]
2025-10-15T10:59:51.626275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:51.626443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:51.626457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:51.627143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 728
2025-10-15T10:59:51.627243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 728, pipe: [1:7561401555504243336:8039]
2025-10-15T10:59:51.626468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:51.626487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:51.626959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401555504243278:2467], now have 1 active actors on pipe
2025-10-15T10:59:51.626982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401555504243331:8330], now have 1 active actors on pipe
2025-10-15T10:59:51.627002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401555504243336:8039], now have 1 active actors on pipe
2025-10-15T10:59:51.629804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:51.629844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:51.629912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:51.629945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:51.629968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:51.629980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:51.630014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:51.630058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:51.630110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:51.631085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:51.631115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:51.631181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:51.631549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 729 partition: 0 MaxSeqNo: 46 sessionId: src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0
2025-10-15T10:59:51.635602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62212ef-140c1500-495f4bff-fbffe7e4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:51.685131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:51.685166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:51.685205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401558303935185:7494]
2025-10-15T10:59:51.685341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:51.685362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:51.692080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:51.693332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:51.694693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:51.696118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0] Write session: try to update token
2025-10-15T10:59:51.696176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:51.698179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:51.702713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:51.703318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:51.750208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:51.750242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:51.750254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:51.750314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:51.750329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:51.750344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:51.750356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:51.750394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401558303935185:7494]
2025-10-15T10:59:51.750424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401558303935185:7494]
2025-10-15T10:59:51.750448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401558303935185:7494]
2025-10-15T10:59:51.750604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:51.750628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:51.750715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:51.750762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:51.750790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:51.752382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:51.803458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId: src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:51.826790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:51.902855Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:51.906985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:51.907021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:51.907721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401555504243336:8039]
2025-10-15T10:59:51.907755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:51.907771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:51.907817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:51.907708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:51.935007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 729 reason: error at write: Disconnected sessionId: src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0
2025-10-15T10:59:51.935244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 729 sessionId: src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0 is DEAD
2025-10-15T10:59:51.936525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:51.936557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0] Write session will restart in 0.007043s
2025-10-15T10:59:51.936625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0] Write session: Do CDS request
2025-10-15T10:59:51.936665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:51.951018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:51.951264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:51.951315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 730
2025-10-15T10:59:51.951699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:51.951858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:51.951876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:51.951887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:51.954857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 730 sessionId:  describe result for acl check
2025-10-15T10:59:51.954986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:51.954999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:51.955006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:51.955019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401555504243372:8335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:51.957038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401555504243372:8335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:51.962825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401555504243372:8335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:51.964557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:51.969798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:51.970613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:51.970642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:51.970685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:51.970928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:51.970544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401555504243372:8335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:51.970588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401555504243372:8335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:51.970620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401555504243372:8335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:51.970653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:51.971108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401558303935277:7503]
2025-10-15T10:59:51.973234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:51.974269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:51.974459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:51.976146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:51.976463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.976471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.976478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.976484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.976491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.976496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.976502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.976507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.976513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.976520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.976527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.976533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.976539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.976545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.976585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.976682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.976724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.976769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.976809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.976851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.976891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.976930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.976970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.977013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.977054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.977094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.977134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.977173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.977212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.977270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:51.977320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.977368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:51.977411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.977458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:51.977501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.977548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:51.977593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.977640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:51.977682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.977733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:51.977776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.977822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:51.977863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.977914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:51.977957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.978008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:51.978048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.978098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:51.978137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.978188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:51.978229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.978276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:51.978318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.978368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:51.978409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.978454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:51.978913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:52.005832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:52.008085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401559799210705:8039]
2025-10-15T10:59:52.016016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:52.016055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:52.016071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:52.016088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:52.016110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 729 [2:7561401558303935277:7503]
2025-10-15T10:59:52.016155Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:52.016208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:52.016221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:52.016231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:52.016240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:52.016286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:52.016306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:52.016323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:52.017908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.017935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.017948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.017958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:52.018215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:52.018239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.018363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.018533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.018763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:52.018840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401555504243402:8335], now have 1 active actors on pipe
2025-10-15T10:59:52.018781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 729
2025-10-15T10:59:52.018869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401555504243347:2467], now have 1 active actors on pipe
2025-10-15T10:59:52.018889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401559799210705:8039], now have 1 active actors on pipe
2025-10-15T10:59:52.018885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 729
2025-10-15T10:59:52.018910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401558303935272:7503]
2025-10-15T10:59:52.018927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401558303935272:7503]
2025-10-15T10:59:52.018939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401558303935272:7503]
2025-10-15T10:59:52.018960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 729, pipe: [1:7561401559799210705:8039]
2025-10-15T10:59:52.018987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:52.019027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:52.019050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:52.019061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:52.019063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:52.019222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:52.019247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:52.019374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401558303935272:7503]
2025-10-15T10:59:52.019408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:52.019477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:52.019503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:52.019521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:52.019655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:52.019689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:52.019709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:52.019719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:52.019749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:52.019788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:52.019854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:52.020606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:52.020631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:52.020693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:52.021425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 730 partition: 0 MaxSeqNo: 46 sessionId: src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0
2025-10-15T10:59:52.022193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6dbfe6-1cf4fb0c-f2940fa3-4c53cdb8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:52.041575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0] Write session: try to update token
2025-10-15T10:59:52.041636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:52.149636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:52.149669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:52.149684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:52.149695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:52.149733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401558303935272:7503]
2025-10-15T10:59:52.149758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401558303935272:7503]
2025-10-15T10:59:52.149783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401558303935272:7503]
2025-10-15T10:59:52.149899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:52.149943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:52.149951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:52.149965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:52.149970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:52.149977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:52.150079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:52.150102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:52.151874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId: src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:52.151332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:52.173544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:52.295461Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:52.305860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:52.305915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:52.305995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:52.306011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:52.306058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401558303935272:7503]
2025-10-15T10:59:52.306281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:52.306887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:52.307121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:52.307151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:52.307558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:52.307795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401559799210705:8039]
2025-10-15T10:59:52.316371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 730 reason: error at write: Disconnected sessionId: src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0
2025-10-15T10:59:52.316675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 730 sessionId: src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0 is DEAD
2025-10-15T10:59:52.323578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:52.323625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0] Write session will restart in 0.006581s
2025-10-15T10:59:52.323736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0] Write session: Do CDS request
2025-10-15T10:59:52.323766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:52.339428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:52.339626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:52.339657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 731
2025-10-15T10:59:52.343498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:52.343664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:52.343689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:52.343701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:52.345085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 731 sessionId:  describe result for acl check
2025-10-15T10:59:52.345205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:52.345222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:52.345232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:52.345250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401559799210748:8340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:52.348157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401559799210748:8340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:52.363775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401559799210748:8340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:52.369309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:52.378897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:52.380088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401559799210748:8340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:52.380135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401559799210748:8340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:52.380151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401559799210748:8340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:52.380181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:52.379805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:52.379830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:52.379871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:52.380135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:52.380321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401562598902655:7511]
2025-10-15T10:59:52.382502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:52.383449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:52.383658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:52.384981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:52.385315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:52.385332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:52.385339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:52.385346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:52.385353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:52.385361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:52.385369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:52.385376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:52.385381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:52.385388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:52.385395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:52.385402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.385409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.385416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.385464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:52.385570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:52.385617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:52.385665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:52.385711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:52.385756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:52.385822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:52.385873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:52.385920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:52.385966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:52.386013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:52.386059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.386105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.386153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.386198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:52.386272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:52.386329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:52.386385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:52.386433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:52.386484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:52.386530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:52.386587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:52.386648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:52.386713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:52.386759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:52.386813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:52.386862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:52.386915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:52.386962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:52.387017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:52.387067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:52.387120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:52.387178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:52.387233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:52.387282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:52.387336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:52.387396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.387451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.387503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.387558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.387603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.387655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.388037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:52.406772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:52.407418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401559799210806:8039]
2025-10-15T10:59:52.416407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:52.416448Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:52.416459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:52.416471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:52.416491Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 730 [2:7561401562598902655:7511]
2025-10-15T10:59:52.416535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:52.416574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:52.416585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:52.416593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:52.416601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:52.416633Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:52.416650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:52.416665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:52.423715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.423735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.423745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.423753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:52.423978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:52.423997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.424104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.424245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.424430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:52.424497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401562598902650:7511]
2025-10-15T10:59:52.424514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401562598902650:7511]
2025-10-15T10:59:52.424524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401562598902650:7511]
2025-10-15T10:59:52.424555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:52.424619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:52.424771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:52.424788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:52.424890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401562598902650:7511]
2025-10-15T10:59:52.424909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:52.425130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:52.425148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:52.425157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:52.425181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:52.425751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 730
2025-10-15T10:59:52.425833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 730, pipe: [1:7561401559799210806:8039]
2025-10-15T10:59:52.425896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 730
2025-10-15T10:59:52.427293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401559799210734:2467], now have 1 active actors on pipe
2025-10-15T10:59:52.427332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401559799210806:8039], now have 1 active actors on pipe
2025-10-15T10:59:52.427369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401559799210791:8340], now have 1 active actors on pipe
2025-10-15T10:59:52.427430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:52.427454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:52.427523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:52.427556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:52.427571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:52.427581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:52.427612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:52.427653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:52.427702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:52.428534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:52.428561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:52.428633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:52.428959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 731 partition: 0 MaxSeqNo: 46 sessionId: src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0
2025-10-15T10:59:52.431546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|914a2c7a-ce3f140d-7d9542d5-26b51095_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:52.474120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0] Write session: try to update token
2025-10-15T10:59:52.474189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:52.516656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:52.516709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:52.516733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:52.516752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:52.516809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401562598902650:7511]
2025-10-15T10:59:52.516851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401562598902650:7511]
2025-10-15T10:59:52.516899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401562598902650:7511]
2025-10-15T10:59:52.517145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:52.517172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:52.517189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:52.517266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:52.517297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:52.518030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:52.518108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:52.518156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:52.519665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:52.576646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId: src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:52.607659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:52.675771Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:52.677951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:52.677983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:52.679292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:52.682351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:52.679576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401559799210806:8039]
2025-10-15T10:59:52.679708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:52.679728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:52.709248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 731 reason: error at write: Disconnected sessionId: src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0
2025-10-15T10:59:52.709582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 731 sessionId: src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0 is DEAD
2025-10-15T10:59:52.711651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:52.711715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0] Write session will restart in 0.005208s
2025-10-15T10:59:52.711857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0] Write session: Do CDS request
2025-10-15T10:59:52.711902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:52.718836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:52.722813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:52.722842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 732
2025-10-15T10:59:52.722937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:52.723472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:52.723613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:52.723635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:52.723644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:52.724499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:52.725578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:52.725613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:52.725664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:52.725965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:52.726181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401562598902720:7513]
2025-10-15T10:59:52.724873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 732 sessionId:  describe result for acl check
2025-10-15T10:59:52.724979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:52.724989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:52.724998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:52.725015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401559799210844:8351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:52.728495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:52.730216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:52.728423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401559799210844:8351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:52.730452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:52.734106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:52.734514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:52.734544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:52.734551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:52.734557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:52.734562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:52.734568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:52.734574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:52.734580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:52.734586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:52.734593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:52.734599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:52.734620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.734626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.734633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.734676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:52.734787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:52.734829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:52.734868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:52.734907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:52.734946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:52.734986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:52.735028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:52.735066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:52.735105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:52.735146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:52.735182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.735219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.735278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.734868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401559799210844:8351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:52.735374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:52.735446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:52.735564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:52.735677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:52.735725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:52.735774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:52.735822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:52.735888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:52.735933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:52.735979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:52.736022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:52.736071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:52.736110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:52.736155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:52.736194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:52.736236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:52.736278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:52.736325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:52.736366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:52.736412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:52.736482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:52.736590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:52.736681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.736800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.736848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.736893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.736933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.736992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.737429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:52.752165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401559799210844:8351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:52.752214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401559799210844:8351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:52.752230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401559799210844:8351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:52.752260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:52.765253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:52.778914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 731
2025-10-15T10:59:52.779016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 731
2025-10-15T10:59:52.775492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:52.775544Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:52.775562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:52.775583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:52.775609Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 731 [2:7561401562598902720:7513]
2025-10-15T10:59:52.775663Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:52.775728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:52.775744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:52.775757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:52.775769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:52.775821Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:52.775843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:52.775868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:52.777701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.777718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.777733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.777745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:52.778017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:52.778036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:52.778187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:52.778380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:52.778631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:52.778718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401559799210876:8351], now have 1 active actors on pipe
2025-10-15T10:59:52.778743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401559799210818:2467], now have 1 active actors on pipe
2025-10-15T10:59:52.778770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401562598902713:7513]
2025-10-15T10:59:52.778785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401562598902713:7513]
2025-10-15T10:59:52.779590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401559799210878:8039]
2025-10-15T10:59:52.778799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401562598902713:7513]
2025-10-15T10:59:52.778881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:52.778895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:52.778906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:52.780675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 731, pipe: [1:7561401559799210878:8039]
2025-10-15T10:59:52.779762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:52.779861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:52.780057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:52.780075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:52.780144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:52.780168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:52.780313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401562598902713:7513]
2025-10-15T10:59:52.780348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:52.780432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:52.780435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:52.780465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:52.780483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:52.780494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:52.780531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:52.780573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:52.780766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401559799210878:8039], now have 1 active actors on pipe
2025-10-15T10:59:52.780794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:52.781988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:52.782018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:52.782112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:52.782379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 732 partition: 0 MaxSeqNo: 46 sessionId: src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0
2025-10-15T10:59:52.783162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b88969b4-c6f947f0-86ba32de-5ffeed31_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:52.817801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0] Write session: try to update token
2025-10-15T10:59:52.817842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:52.850898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:52.850931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:52.850944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:52.850955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:52.850986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401562598902713:7513]
2025-10-15T10:59:52.851012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401562598902713:7513]
2025-10-15T10:59:52.851037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401562598902713:7513]
2025-10-15T10:59:52.851185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:52.851210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:52.851231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:52.851232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:52.851263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:52.852309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:52.909832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId: src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:52.931721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:52.995917Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:53.005872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:53.005916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:53.005975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:53.005989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:53.006027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401562598902713:7513]
2025-10-15T10:59:53.006257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:53.006597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:53.007376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:53.007453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:53.007729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401559799210878:8039]
2025-10-15T10:59:53.035991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:53.041742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:53.042481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 732 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0
2025-10-15T10:59:53.042776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 732 sessionId: src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0 is DEAD
2025-10-15T10:59:53.042849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:53.042880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:53.042922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:53.043394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:53.043607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401566893870098:7518]
2025-10-15T10:59:53.043737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:53.043777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0] Write session will restart in 0.007836s
2025-10-15T10:59:53.043866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0] Write session: Do CDS request
2025-10-15T10:59:53.043900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:53.047782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:53.048717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:53.048949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:53.050103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:53.050351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.050362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.050366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.050370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.050375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.050380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.050384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.050388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.050392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.050396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.050400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.050403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.050408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.050412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.050441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.050512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.050542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.050571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.050600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.050644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.050671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.050696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.050720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.050744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.050770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.050794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.050819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.050844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.050867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.050904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.050938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.050970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.050996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.051026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.051049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.051080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.051105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.051135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.051169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.051199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.051222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.051255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.051278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.051306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.051331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.051388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.051425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.051467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.051495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.051524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.051553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.051583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.051606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.051640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.051662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.051688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.051947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:53.056804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:53.059593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:53.059637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 733
2025-10-15T10:59:53.060099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:53.060334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:53.060360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:53.060377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:53.062908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 733 sessionId:  describe result for acl check
2025-10-15T10:59:53.063020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:53.063038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:53.063048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:53.063064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401564094178231:8358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:53.065599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401564094178231:8358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:53.072840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:53.073026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401564094178231:8358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:53.079860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401564094178231:8358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:53.079898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401564094178231:8358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:53.079915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401564094178231:8358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:53.079943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:53.082966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:53.083009Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:53.083025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:53.083040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:53.083062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 732 [2:7561401566893870098:7518]
2025-10-15T10:59:53.083107Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:53.083152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:53.083162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:53.083171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:53.083179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:53.083207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:53.083226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:53.083245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:53.084196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.084211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.084219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.084227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:53.084465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:53.084492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.084602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.084677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 732
2025-10-15T10:59:53.084681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 732
2025-10-15T10:59:53.084781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.085022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:53.085091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401564094178268:8358], now have 1 active actors on pipe
2025-10-15T10:59:53.085114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401564094178197:2467], now have 1 active actors on pipe
2025-10-15T10:59:53.085149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401566893870093:7518]
2025-10-15T10:59:53.085164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401566893870093:7518]
2025-10-15T10:59:53.085177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401566893870093:7518]
2025-10-15T10:59:53.085211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:53.085239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:53.085250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:53.085261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:53.085277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:53.085446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:53.085463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:53.085602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:53.085626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:53.085655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401566893870093:7518]
2025-10-15T10:59:53.085687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:53.085760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:53.085812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:53.085837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:53.085854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:53.085863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:53.085906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:53.085941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:53.086016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:53.086636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:53.086663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:53.086721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:53.086937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 733 partition: 0 MaxSeqNo: 46 sessionId: src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0
2025-10-15T10:59:53.087620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc75032b-a638a83b-9d1dcfb5-cfef2d4c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:53.106267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0] Write session: try to update token
2025-10-15T10:59:53.106325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:53.108472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401564094178274:8039], now have 1 active actors on pipe
2025-10-15T10:59:53.107835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401564094178274:8039]
2025-10-15T10:59:53.108495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 732, pipe: [1:7561401564094178274:8039]
2025-10-15T10:59:53.160397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:53.160426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:53.160439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:53.160449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:53.160483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401566893870093:7518]
2025-10-15T10:59:53.160508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401566893870093:7518]
2025-10-15T10:59:53.160532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401566893870093:7518]
2025-10-15T10:59:53.160713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:53.160745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:53.160750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:53.160809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:53.160846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:53.161760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:53.225225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId: src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:53.244853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:53.307099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:53.319149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:53.319198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:53.319362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:53.319376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:53.319416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401566893870093:7518]
2025-10-15T10:59:53.319902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:53.321037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:53.321064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:53.321132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:53.321361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401564094178274:8039]
2025-10-15T10:59:53.320942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:53.338764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 733 reason: error at write: Disconnected sessionId: src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0
2025-10-15T10:59:53.339368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 733 sessionId: src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0 is DEAD
2025-10-15T10:59:53.340509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:53.340585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0] Write session will restart in 0.005586s
2025-10-15T10:59:53.340781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0] Write session: Do CDS request
2025-10-15T10:59:53.340843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:53.354641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:53.354684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 734
2025-10-15T10:59:53.354816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:53.355606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:53.355854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:53.355899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:53.355912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:53.357986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 734 sessionId:  describe result for acl check
2025-10-15T10:59:53.358091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:53.358117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:53.358125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:53.358141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401564094178299:8363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:53.360762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401564094178299:8363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:53.365368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401564094178299:8363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:53.366391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:53.370300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:53.371209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:53.371242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:53.371288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:53.371422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401564094178299:8363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:53.371457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401564094178299:8363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:53.371473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401564094178299:8363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:53.371500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:53.371587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:53.371800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401566893870180:7527]
2025-10-15T10:59:53.374234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:53.375186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:53.375443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:53.377412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:53.377841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.377862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.377871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.377878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.377887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.377894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.377901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.377910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.377918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.377924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.377932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.377939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.377948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.377955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.378008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.378131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.378184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.378238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.378312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.378373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.378431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.378497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.378548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.378613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.378688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.378745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.378801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.378859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.378919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.378999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.379078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.379153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.379207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.379269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.379318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.379732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.379802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.379861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.379911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.380002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.380073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.380133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.380183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.380252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.380309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.380368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.380423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.380486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.380537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.380608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.380662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.380725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.380778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.380840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.380890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.380953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.381547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:53.405423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:53.415621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:53.415673Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:53.415694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:53.415716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:53.415747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 733 [2:7561401566893870180:7527]
2025-10-15T10:59:53.415803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:53.415872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:53.415888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:53.415900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:53.415912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:53.415964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:53.415988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:53.416011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:53.418649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 733
2025-10-15T10:59:53.418663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 733
2025-10-15T10:59:53.418100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.418130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.418145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.418159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:53.418444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:53.418465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.418625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.418844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.419100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:53.419185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401564094178340:8363], now have 1 active actors on pipe
2025-10-15T10:59:53.419211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401564094178283:2467], now have 1 active actors on pipe
2025-10-15T10:59:53.419266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:53.419290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:53.419664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401566893870175:7527]
2025-10-15T10:59:53.419688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401566893870175:7527]
2025-10-15T10:59:53.419704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401566893870175:7527]
2025-10-15T10:59:53.419747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:53.419796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:53.419814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:53.419824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:53.419831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:53.420025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:53.420042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:53.420109Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:53.420142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:53.420162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:53.420173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:53.420211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:53.420255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:53.420392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401566893870175:7527]
2025-10-15T10:59:53.420422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:53.420469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:53.420587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:53.421191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:53.421219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:53.421290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:53.421756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 734 partition: 0 MaxSeqNo: 46 sessionId: src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0
2025-10-15T10:59:53.422727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88841b2b-ee204d67-e49f2d35-61aa8164_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:53.423101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401564094178349:8039], now have 1 active actors on pipe
2025-10-15T10:59:53.422192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401564094178349:8039]
2025-10-15T10:59:53.423292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 733, pipe: [1:7561401564094178349:8039]
2025-10-15T10:59:53.452177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0] Write session: try to update token
2025-10-15T10:59:53.452230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:53.538020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:53.538054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:53.538068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:53.538079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:53.538110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401566893870175:7527]
2025-10-15T10:59:53.538135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401566893870175:7527]
2025-10-15T10:59:53.538158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401566893870175:7527]
2025-10-15T10:59:53.538355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:53.538366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:53.538376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:53.538416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:53.538432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:53.539303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:53.539362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:53.539397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:53.539466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:53.579175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId: src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:53.606366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:53.681300Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:53.691057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:53.691110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:53.691192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:53.691210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:53.691259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401566893870175:7527]
2025-10-15T10:59:53.692202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:53.692324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401564094178349:8039]
2025-10-15T10:59:53.692381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:53.692403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:53.691592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:53.692008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:53.701918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 734 reason: error at write: Disconnected sessionId: src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0
2025-10-15T10:59:53.702174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 734 sessionId: src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0 is DEAD
2025-10-15T10:59:53.703762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:53.703822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0] Write session will restart in 0.006567s
2025-10-15T10:59:53.703984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0] Write session: Do CDS request
2025-10-15T10:59:53.704038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:53.717544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:53.717576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 735
2025-10-15T10:59:53.717936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:53.718453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:53.718577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:53.718598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:53.718607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:53.719745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 735 sessionId:  describe result for acl check
2025-10-15T10:59:53.719858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:53.719869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:53.719878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:53.719894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401564094178369:8368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:53.723983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401564094178369:8368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:53.735196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401564094178369:8368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:53.749794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:53.754796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:53.755112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401564094178369:8368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:53.755365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401564094178369:8368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:53.755386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401564094178369:8368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:53.755420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:53.755929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:53.755958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:53.756003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:53.756265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:53.756506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401566893870277:7534]
2025-10-15T10:59:53.758892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:53.760275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:53.760514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:53.761810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:53.762141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.762158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.762165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.762174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.762181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.762189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.762197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.762204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.762210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.762218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.762225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.762232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.762240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.762247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.762298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.762415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.762470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.762526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.762579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.762665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.762715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.762764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.762821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.762878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.762932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.762985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.763040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.763094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.763150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.763228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:53.763300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.763374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:53.763429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.763484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:53.763541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.763608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:53.763663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.763721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:53.763769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.763826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:53.763884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.763944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:53.763998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.764056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:53.764107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.764169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:53.764221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.764282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:53.764335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.764392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:53.764444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.764504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.764560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.764621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.764676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.764737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.765278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:53.792385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401564094178422:8039]
2025-10-15T10:59:53.804234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:53.819046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:53.819093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:53.819113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:53.819136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:53.819164Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 734 [2:7561401566893870277:7534]
2025-10-15T10:59:53.819220Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:53.819287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:53.819302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:53.819316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:53.819327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:53.819394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:53.819416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:53.819441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:53.821185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.821212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.821228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.821240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:53.823474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 734, pipe: [1:7561401564094178422:8039]
2025-10-15T10:59:53.823579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 734
2025-10-15T10:59:53.821529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:53.823653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 734
2025-10-15T10:59:53.821558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:53.821712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:53.821911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:53.822158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:53.822242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401564094178422:8039], now have 1 active actors on pipe
2025-10-15T10:59:53.822268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401564094178358:2467], now have 1 active actors on pipe
2025-10-15T10:59:53.822293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401564094178416:8368], now have 1 active actors on pipe
2025-10-15T10:59:53.822318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401566893870270:7534]
2025-10-15T10:59:53.822336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401566893870270:7534]
2025-10-15T10:59:53.822350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401566893870270:7534]
2025-10-15T10:59:53.822394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:53.822439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:53.822467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:53.822469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:53.822480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:53.822679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:53.822695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:53.822816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401566893870270:7534]
2025-10-15T10:59:53.822848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:53.823014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:53.824284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:53.824319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:53.824404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c96a9085-a2436abf-640c6d9b-cd992477_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:53.824435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:53.824454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:53.824465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:53.824516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:53.824560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:53.824605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:53.827847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:53.827891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:53.827979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:53.830457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 735 partition: 0 MaxSeqNo: 46 sessionId: src_id|c96a9085-a2436abf-640c6d9b-cd992477_0
2025-10-15T10:59:53.831244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|687b4218-1876c6ae-9085506e-afe7e1a6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c96a9085-a2436abf-640c6d9b-cd992477_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:53.862228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a9085-a2436abf-640c6d9b-cd992477_0] Write session: try to update token
2025-10-15T10:59:53.862277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a9085-a2436abf-640c6d9b-cd992477_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:53.976581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:53.976624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:53.976633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:53.976684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:53.976697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:53.976711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:53.976721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:53.976754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401566893870270:7534]
2025-10-15T10:59:53.976778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401566893870270:7534]
2025-10-15T10:59:53.976802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401566893870270:7534]
2025-10-15T10:59:53.976946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:53.976978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:53.976989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:53.977002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:53.977010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:53.978317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:53.991416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId: src_id|c96a9085-a2436abf-640c6d9b-cd992477_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:54.015242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:54.132786Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:54.144385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:54.144428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:54.144490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:54.144502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:54.144535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401566893870270:7534]
2025-10-15T10:59:54.145575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401564094178422:8039]
2025-10-15T10:59:54.145660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:54.145799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:54.145811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:54.144962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:54.145808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:54.186212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 735 reason: error at write: Disconnected sessionId: src_id|c96a9085-a2436abf-640c6d9b-cd992477_0
2025-10-15T10:59:54.186967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a9085-a2436abf-640c6d9b-cd992477_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:54.187042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a9085-a2436abf-640c6d9b-cd992477_0] Write session will restart in 0.009955s
2025-10-15T10:59:54.187207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a9085-a2436abf-640c6d9b-cd992477_0] Write session: Do CDS request
2025-10-15T10:59:54.187257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a9085-a2436abf-640c6d9b-cd992477_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:54.186576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 735 sessionId: src_id|c96a9085-a2436abf-640c6d9b-cd992477_0 is DEAD
2025-10-15T10:59:54.195981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:54.197665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:54.198548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:54.198582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:54.198659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:54.198943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:54.199148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401571188837638:7537]
2025-10-15T10:59:54.204724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:54.206374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:54.206812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:54.208065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:54.208093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 736
2025-10-15T10:59:54.209975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a9085-a2436abf-640c6d9b-cd992477_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:54.210928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:54.211075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:54.208493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:54.211091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:54.211102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:54.208853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:54.208861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:54.208869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:54.208876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:54.208884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:54.208891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:54.208898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:54.208906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:54.208914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:54.208921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:54.208929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:54.208935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.208943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.208950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.209001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:54.209118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:54.209171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:54.209218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:54.209269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:54.209316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:54.209365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:54.209416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:54.209463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:54.209521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:54.209569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:54.209618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.209665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.209714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.209757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:54.209876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:54.209943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:54.210003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:54.210054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:54.210114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:54.210164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:54.210223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:54.210276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:54.210332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:54.210378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:54.210438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:54.210489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:54.210544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:54.210594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:54.210665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:54.210716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:54.210776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:54.210824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:54.210880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:54.210932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:54.210987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:54.211035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.211089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.211141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.211198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.211248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.211303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.212942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:54.212647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 736 sessionId:  describe result for acl check
2025-10-15T10:59:54.212751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:54.212762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:54.212771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:54.212787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401568389145794:8379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:54.215608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401568389145794:8379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:54.222602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401568389145794:8379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:54.235133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:54.244173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401568389145794:8379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:54.244253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401568389145794:8379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:54.244295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401568389145794:8379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:54.244344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:54.246723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401568389145826:8039]
2025-10-15T10:59:54.247534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:54.247575Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:54.247591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:54.247610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:54.247635Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 735 [2:7561401571188837638:7537]
2025-10-15T10:59:54.247687Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:54.251466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 735, pipe: [1:7561401568389145826:8039]
2025-10-15T10:59:54.251584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 735
2025-10-15T10:59:54.251655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 735
2025-10-15T10:59:54.247744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:54.247765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:54.247778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:54.247789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:54.247839Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:54.247861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:54.247884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:54.249574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.249591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.249605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.249617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:54.249886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:54.249904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.250050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.250243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.250483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:54.250553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401571188837633:7537]
2025-10-15T10:59:54.250569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401571188837633:7537]
2025-10-15T10:59:54.250582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401571188837633:7537]
2025-10-15T10:59:54.250739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:54.250752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:54.250763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:54.253441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:54.253545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:54.253739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:54.253763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:54.253811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401568389145826:8039], now have 1 active actors on pipe
2025-10-15T10:59:54.253837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401568389145824:8379], now have 1 active actors on pipe
2025-10-15T10:59:54.253861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401568389145760:2467], now have 1 active actors on pipe
2025-10-15T10:59:54.253914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:54.253936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:54.254081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401571188837633:7537]
2025-10-15T10:59:54.254114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:54.254185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:54.254244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:54.254267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:54.254279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:54.254318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:54.254360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:54.254502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:54.255526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:54.258724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 736 partition: 0 MaxSeqNo: 46 sessionId: src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0
2025-10-15T10:59:54.257782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:54.257816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:54.257875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:54.259846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c96a9085-a2436abf-640c6d9b-cd992477_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:54.290976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0] Write session: try to update token
2025-10-15T10:59:54.291046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:54.396762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:54.396790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:54.396800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:54.396810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:54.396839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401571188837633:7537]
2025-10-15T10:59:54.396858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401571188837633:7537]
2025-10-15T10:59:54.396875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401571188837633:7537]
2025-10-15T10:59:54.396996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:54.397006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:54.397014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:54.397100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:54.397117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:54.397908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:54.399582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:54.399656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:54.399690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:54.418261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId: src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:54.450414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:54.547724Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
E1015 10:59:54.564970677  904517 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T10:59:54.567511Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T10:59:54.572805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401568389145826:8039]
2025-10-15T10:59:54.572893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:54.572906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:54.572919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:54.572092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:54.572129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:54.572182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:54.572192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:54.572223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401571188837633:7537]
2025-10-15T10:59:54.572408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:54.572639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:54.581539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 736 reason: error at write: Disconnected sessionId: src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0
2025-10-15T10:59:54.581832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 736 sessionId: src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0 is DEAD
2025-10-15T10:59:54.582260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:54.582290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0] Write session will restart in 0.007741s
2025-10-15T10:59:54.582359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0] Write session: Do CDS request
2025-10-15T10:59:54.582388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:54.594586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:54.594618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 737
2025-10-15T10:59:54.594797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:54.595332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:54.595471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:54.595486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:54.595495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:54.596938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 737 sessionId:  describe result for acl check
2025-10-15T10:59:54.597045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:54.597056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:54.597065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:54.597082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401568389145862:8388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:54.605125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401568389145862:8388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:54.617762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401568389145862:8388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:54.624904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:54.631425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401568389145862:8388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:54.631463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401568389145862:8388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:54.631479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401568389145862:8388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:54.631509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:54.631670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:54.632463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:54.632483Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:54.632524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:54.632766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:54.632937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401571188837721:7542]
2025-10-15T10:59:54.634992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:54.635930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:54.636146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:54.637431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:54.637757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:54.637765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:54.637773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:54.637780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:54.637787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:54.637794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:54.637801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:54.637808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:54.637814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:54.637821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:54.637828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:54.637834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.637842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.637847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.637894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:54.638003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:54.638054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:54.638100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:54.638145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:54.638192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:54.638237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:54.638283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:54.638327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:54.638386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:54.638434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:54.638481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.638528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.638572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.638616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:54.638697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:54.638755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:54.638810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:54.638857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:54.638910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:54.638956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:54.639008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:54.639058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:54.639108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:54.639152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:54.639206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:54.639254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:54.639306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:54.640233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:54.640313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:54.640374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:54.640437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:54.640482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:54.640537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:54.640586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:54.640640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:54.640684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.640737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.640785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.640842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.640889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.640942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.641450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:54.670716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:54.675894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401568389145918:8039]
2025-10-15T10:59:54.680763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:54.680805Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:54.680822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:54.680840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:54.680863Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 736 [2:7561401571188837721:7542]
2025-10-15T10:59:54.680913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:54.680967Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:54.680981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:54.680993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:54.681005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:54.681054Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:54.681076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:54.681099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:54.682734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.682763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.682776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.682787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:54.683060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:54.683077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:54.683214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:54.683615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:54.683609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 736
2025-10-15T10:59:54.683703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 736
2025-10-15T10:59:54.683768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 736, pipe: [1:7561401568389145918:8039]
2025-10-15T10:59:54.683857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:54.683952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401568389145850:2467], now have 1 active actors on pipe
2025-10-15T10:59:54.683983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401568389145918:8039], now have 1 active actors on pipe
2025-10-15T10:59:54.684004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401568389145912:8388], now have 1 active actors on pipe
2025-10-15T10:59:54.684030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401571188837711:7542]
2025-10-15T10:59:54.684045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401571188837711:7542]
2025-10-15T10:59:54.684059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401571188837711:7542]
2025-10-15T10:59:54.684098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:54.684142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:54.684159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:54.684172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:54.684173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:54.684349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:54.684365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:54.684438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:54.684458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:54.684580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401571188837711:7542]
2025-10-15T10:59:54.684609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:54.684642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:54.684684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:54.684716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:54.684735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:54.684745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:54.684780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:54.684823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:54.684949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:54.685352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:54.685373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:54.685448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:54.685737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 737 partition: 0 MaxSeqNo: 46 sessionId: src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0
2025-10-15T10:59:54.687887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8106fbdb-4b6ebf15-3d2734b8-25edb1b8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:54.707657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0] Write session: try to update token
2025-10-15T10:59:54.707719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:54.758318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:54.758360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:54.758393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401571188837711:7542]
2025-10-15T10:59:54.758512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:54.758527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:54.760627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:54.761957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:54.763279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:54.772472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:54.785064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:54.786004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:54.786040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:54.786064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:54.786150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:54.836333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId: src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:54.867278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:54.867442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:54.867460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:54.867479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:54.867515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401571188837711:7542]
2025-10-15T10:59:54.867542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401571188837711:7542]
2025-10-15T10:59:54.867573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401571188837711:7542]
2025-10-15T10:59:54.867682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:54.867716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:54.867727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:54.867755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:54.867756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:54.868751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:54.890806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:55.018108Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:55.022584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:55.022633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:55.023458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:55.027735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:55.027990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401568389145918:8039]
2025-10-15T10:59:55.028097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:55.066755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 737 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0
2025-10-15T10:59:55.067075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 737 sessionId: src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0 is DEAD
2025-10-15T10:59:55.067861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:55.067889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0] Write session will restart in 0.005130s
2025-10-15T10:59:55.067974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0] Write session: Do CDS request
2025-10-15T10:59:55.067999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:55.079305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:55.079343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 738
2025-10-15T10:59:55.079625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:55.080222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:55.080368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:55.080390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:55.080400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:55.082043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 738 sessionId:  describe result for acl check
2025-10-15T10:59:55.082160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:55.082171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:55.082180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:55.082199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401572684113245:8393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:55.084920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401572684113245:8393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:55.092280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401572684113245:8393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:55.099953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:55.100858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401572684113245:8393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:55.100899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401572684113245:8393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:55.100916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401572684113245:8393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:55.100944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:55.102303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:55.103145Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:55.103185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:55.103228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:55.103494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:55.103723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401575483805112:7551]
2025-10-15T10:59:55.105843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:55.107130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:55.107361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:55.108587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:55.108903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.108924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.108931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.108937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.108945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.108952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.108958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.108964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.108970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.108976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.108984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.108990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.109002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.109014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.109057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.109158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.109205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.109251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.109302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.109347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.109391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.109444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.109509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.109555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.109597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.109638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.109681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.109734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.109786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.109867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.109933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.109995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.110050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.110100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.110143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.110211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.110271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.110332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.110380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.110441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.110495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.110563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.110613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.110688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.110741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.110811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.110863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.110923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.110968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.111022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.111068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.111119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.111165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.111215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.111275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.111328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.111837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:55.128164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401572684113307:8039]
2025-10-15T10:59:55.131377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:55.141234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:55.141281Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:55.141299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:55.141315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:55.141338Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 737 [2:7561401575483805112:7551]
2025-10-15T10:59:55.141387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:55.141441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:55.141453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:55.141465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:55.141477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:55.141520Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:55.141540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:55.141560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:55.142983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.143596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 737
2025-10-15T10:59:55.143608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 737, pipe: [1:7561401572684113307:8039]
2025-10-15T10:59:55.143703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 737
2025-10-15T10:59:55.142998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.143012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.143022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:55.143279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:55.143296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.143810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.143998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.144255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:55.144332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401572684113290:8393], now have 1 active actors on pipe
2025-10-15T10:59:55.144355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401572684113226:2467], now have 1 active actors on pipe
2025-10-15T10:59:55.144375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401572684113307:8039], now have 1 active actors on pipe
2025-10-15T10:59:55.144425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:55.144444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:55.144494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401575483805103:7551]
2025-10-15T10:59:55.144509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401575483805103:7551]
2025-10-15T10:59:55.144521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401575483805103:7551]
2025-10-15T10:59:55.144561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:55.144610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:55.144624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:55.144626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:55.144640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:55.144791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:55.144807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:55.144863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:55.144894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:55.144910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:55.144919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:55.144951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:55.144987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:55.145103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401575483805103:7551]
2025-10-15T10:59:55.145135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:55.145151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:55.145177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:55.145709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:55.145746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:55.145822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:55.146503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 738 partition: 0 MaxSeqNo: 46 sessionId: src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0
2025-10-15T10:59:55.147883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac084b4e-71164cce-ceb515d3-29b9c9a3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:55.190658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:55.190691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:55.190732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401575483805103:7551]
2025-10-15T10:59:55.190865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:55.190869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:55.198522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:55.199253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0] Write session: try to update token
2025-10-15T10:59:55.199310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:55.201474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:55.206451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:55.208013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:55.209837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:55.210426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:55.243539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:55.243585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:55.243603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:55.318163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:55.318198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:55.318212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:55.318223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:55.318264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401575483805103:7551]
2025-10-15T10:59:55.318291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401575483805103:7551]
2025-10-15T10:59:55.318317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401575483805103:7551]
2025-10-15T10:59:55.318473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:55.318498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:55.318643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:55.318699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:55.318728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:55.332357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:55.362183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId: src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:55.381937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:55.478072Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:55.480195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:55.480227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:55.481527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:55.482627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401572684113307:8039]
2025-10-15T10:59:55.482792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:55.483047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:55.491023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 738 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0
2025-10-15T10:59:55.500784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 738 sessionId: src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0 is DEAD
2025-10-15T10:59:55.503699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:55.503789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0] Write session will restart in 0.009783s
2025-10-15T10:59:55.503968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0] Write session: Do CDS request
2025-10-15T10:59:55.504028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:55.523076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:55.543272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:55.549856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:55.549887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 739
2025-10-15T10:59:55.546049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:55.547208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:55.547229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:55.547283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:55.547601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:55.547803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401575483805197:7559]
2025-10-15T10:59:55.550553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:55.551592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:55.551742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:55.551765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:55.551774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:55.552909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 739 sessionId:  describe result for acl check
2025-10-15T10:59:55.553016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:55.553031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:55.553042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:55.553056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401572684113370:8404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:55.551616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:55.551852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:55.553141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:55.553477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.553486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.553494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.553503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.553510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.553517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.553524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.553532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.553539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.553547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.553555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.553562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.553569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.553577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.553627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.553747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.553801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.553852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.553897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.553944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.553988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.554038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.554087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.554136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.554184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.554232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.554282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.554330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.554379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.554454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.554518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.554578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.554629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.554697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.554731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.554769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.555306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401572684113370:8404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:55.555413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.555491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.555548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.555612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.555665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.555725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.555780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.555840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.555893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.555955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.556007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.556067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.556122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.556182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.556232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.556290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.556344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.556401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.556453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.556510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.556929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:55.560963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401572684113370:8404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:55.574265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401572684113370:8404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:55.574308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401572684113370:8404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:55.574324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401572684113370:8404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:55.574353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:55.581358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:55.583870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401572684113402:8039]
2025-10-15T10:59:55.591976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:55.592010Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:55.592024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:55.592038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:55.592056Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 738 [2:7561401575483805197:7559]
2025-10-15T10:59:55.592097Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:55.592149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:55.592162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:55.592172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:55.592183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:55.592225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:55.592245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:55.592262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:55.594139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.594165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.594180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.594193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:55.594422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:55.594444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.594578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.594764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.594999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:55.595088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401572684113402:8039], now have 1 active actors on pipe
2025-10-15T10:59:55.595117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401572684113334:2467], now have 1 active actors on pipe
2025-10-15T10:59:55.595141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401572684113400:8404], now have 1 active actors on pipe
2025-10-15T10:59:55.595171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401575483805192:7559]
2025-10-15T10:59:55.595191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401575483805192:7559]
2025-10-15T10:59:55.595206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401575483805192:7559]
2025-10-15T10:59:55.595250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:55.595334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:55.595507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:55.595535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:55.595548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:55.595947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:55.595971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:55.596120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:55.596145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:55.596180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401575483805192:7559]
2025-10-15T10:59:55.596211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:55.596315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd610de6-69808929-d49b3f3f-b918aebf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:55.596350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:55.596368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:55.596379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:55.596416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:55.596468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:55.596556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:55.596725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:55.594951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 738, pipe: [1:7561401572684113402:8039]
2025-10-15T10:59:55.598096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:55.595033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 738
2025-10-15T10:59:55.595089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 738
2025-10-15T10:59:55.598126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:55.598225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:55.598628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 739 partition: 0 MaxSeqNo: 46 sessionId: src_id|cd610de6-69808929-d49b3f3f-b918aebf_0
2025-10-15T10:59:55.599972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a91ea37-cecc98e1-caef79d-5b0e6162_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cd610de6-69808929-d49b3f3f-b918aebf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:55.645323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd610de6-69808929-d49b3f3f-b918aebf_0] Write session: try to update token
2025-10-15T10:59:55.645390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd610de6-69808929-d49b3f3f-b918aebf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:55.699606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:55.699641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:55.699657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:55.699671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:55.699711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401575483805192:7559]
2025-10-15T10:59:55.699741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401575483805192:7559]
2025-10-15T10:59:55.699767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401575483805192:7559]
2025-10-15T10:59:55.699898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:55.699937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:55.699951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:55.699954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:55.699964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:55.699988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:55.700015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:55.700047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:55.704530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:55.837394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId: src_id|cd610de6-69808929-d49b3f3f-b918aebf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:55.856818Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:55.860372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401572684113402:8039]
2025-10-15T10:59:55.860543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:55.869621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:55.869649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:55.884058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 739 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|cd610de6-69808929-d49b3f3f-b918aebf_0
2025-10-15T10:59:55.884400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 739 sessionId: src_id|cd610de6-69808929-d49b3f3f-b918aebf_0 is DEAD
2025-10-15T10:59:55.887654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd610de6-69808929-d49b3f3f-b918aebf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T10:59:55.887727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd610de6-69808929-d49b3f3f-b918aebf_0] Write session will restart in 0.007536s
2025-10-15T10:59:55.887917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd610de6-69808929-d49b3f3f-b918aebf_0] Write session: Do CDS request
2025-10-15T10:59:55.887967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd610de6-69808929-d49b3f3f-b918aebf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:55.902318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd610de6-69808929-d49b3f3f-b918aebf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:55.903536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:55.903570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 740
2025-10-15T10:59:55.903848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:55.903967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:55.903989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:55.904000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:55.905250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 740 sessionId:  describe result for acl check
2025-10-15T10:59:55.905360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:55.905370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:55.905379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:55.905396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401572684113458:8412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:55.908043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401572684113458:8412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:55.912965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:55.916459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401572684113458:8412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:55.918275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:55.919178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:55.919206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:55.919248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:55.919523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:55.919706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401575483805289:7564]
2025-10-15T10:59:55.921647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:55.923014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401572684113458:8412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:55.923054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401572684113458:8412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:55.922619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:55.923071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401572684113458:8412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:55.922838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:55.923103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:55.924082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:55.924394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.924403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.924409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.924415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.924423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.924430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.924438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.924445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.924451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.924458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.924465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.924472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.924479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.924485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.924529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.924635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.924678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.924723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.924764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.924807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.924853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.924898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.924942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.924989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.925033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.925078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.925122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.925167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.925211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.925276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:55.925333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.925384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:55.925432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.925485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:55.925527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.925583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:55.925633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.925690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:55.925735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.925790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:55.925839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.925894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:55.925940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.925990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:55.926036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.926086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:55.926126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.926174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:55.926222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.926275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:55.926319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.926375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.926421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.926476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.926519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.926571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.927076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:55.947479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:55.956974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:55.957013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:55.957031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:55.957050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:55.957076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 739 [2:7561401575483805289:7564]
2025-10-15T10:59:55.957127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:55.957186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:55.957200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:55.957212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:55.957224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:55.957272Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:55.957295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:55.957317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:55.958401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.958416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.958433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.958445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:55.958719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:55.958746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:55.958895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:55.959093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:55.959231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 739
2025-10-15T10:59:55.959331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 739
2025-10-15T10:59:55.959327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:55.959427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401572684113489:8412], now have 1 active actors on pipe
2025-10-15T10:59:55.959457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401572684113425:2467], now have 1 active actors on pipe
2025-10-15T10:59:55.959483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401575483805283:7564]
2025-10-15T10:59:55.959499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401575483805283:7564]
2025-10-15T10:59:55.959512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401575483805283:7564]
2025-10-15T10:59:55.959549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:55.959597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:55.959606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:55.959614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:55.959622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:55.959812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:55.959828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:55.959968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:55.959990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:55.960036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401575483805283:7564]
2025-10-15T10:59:55.960064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:55.960173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:55.960203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:55.960221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:55.961292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401572684113499:8039]
2025-10-15T10:59:55.960232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:55.960271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:55.960310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:55.960392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:55.960490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:55.963045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:55.963073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:55.963149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:55.964310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 740 partition: 0 MaxSeqNo: 46 sessionId: src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0
2025-10-15T10:59:55.964787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401572684113499:8039], now have 1 active actors on pipe
2025-10-15T10:59:55.965134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd610de6-69808929-d49b3f3f-b918aebf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:55.964897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 739, pipe: [1:7561401572684113499:8039]
2025-10-15T10:59:55.997808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0] Write session: try to update token
2025-10-15T10:59:55.997872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:56.145746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId: src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:56.164856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:56.164887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:56.164898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:56.165023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:56.165037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:56.165050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:56.165061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:56.165094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401575483805283:7564]
2025-10-15T10:59:56.165120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401575483805283:7564]
2025-10-15T10:59:56.165144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401575483805283:7564]
2025-10-15T10:59:56.166396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:56.166440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:56.166470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:56.171432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:56.193892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:56.193931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:56.194910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:56.340468Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:56.342115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:56.342139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:56.342171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:56.342181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:56.342207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401575483805283:7564]
2025-10-15T10:59:56.342375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:56.343459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:56.343508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:56.343524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:56.343706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401572684113499:8039]
2025-10-15T10:59:56.344162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:56.354965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 740 reason: error at write: Disconnected sessionId: src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0
2025-10-15T10:59:56.355332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 740 sessionId: src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0 is DEAD
2025-10-15T10:59:56.355712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:56.355756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0] Write session will restart in 0.005668s
2025-10-15T10:59:56.355886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0] Write session: Do CDS request
2025-10-15T10:59:56.355929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:56.373228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:56.373284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 741
2025-10-15T10:59:56.373482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:56.374200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:56.374411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:56.374450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:56.374466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:56.376337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 741 sessionId:  describe result for acl check
2025-10-15T10:59:56.376465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:56.376476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:56.376486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:56.376504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401576979080831:8417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:56.378531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401576979080831:8417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:56.387208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401576979080831:8417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:56.400417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401576979080831:8417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:56.401375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:56.400460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401576979080831:8417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:56.400476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401576979080831:8417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:56.400508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:56.409917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:56.410786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:56.410806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:56.410854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:56.411114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:56.411292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401579778772673:7572]
2025-10-15T10:59:56.413003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:56.414577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:56.414774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:56.415744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:56.415999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:56.416013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:56.416021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:56.416028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:56.416035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:56.416042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:56.416049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:56.416055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:56.416062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:56.416070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:56.416077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:56.416083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.416091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.416097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.416144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:56.416253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:56.416299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:56.416350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:56.416401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:56.416450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:56.416500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:56.416549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:56.416597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:56.416651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:56.416700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:56.416751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.416801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.416851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.416897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:56.416968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:56.417031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:56.417091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:56.417144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:56.417202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:56.417251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:56.417307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:56.417358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:56.417414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:56.417462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:56.417521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:56.417571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:56.417626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:56.417676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:56.417729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:56.417777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:56.417830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:56.417872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:56.417928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:56.417976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:56.418030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:56.418076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.418130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.418174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.418223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.418267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.418314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.418847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:56.443558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401576979080888:8039]
2025-10-15T10:59:56.450921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:56.460802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:56.460845Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:56.460866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:56.460888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:56.460914Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 740 [2:7561401579778772673:7572]
2025-10-15T10:59:56.460967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:56.461026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:56.461042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:56.461056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:56.461067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:56.461118Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:56.461141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:56.461163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:56.462876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.462905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.462918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.462930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:56.463205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:56.463229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.463603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 740, pipe: [1:7561401576979080888:8039]
2025-10-15T10:59:56.463620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 740
2025-10-15T10:59:56.463720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 740
2025-10-15T10:59:56.463527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.463719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.463948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:56.464033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401576979080888:8039], now have 1 active actors on pipe
2025-10-15T10:59:56.464056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401576979080818:2467], now have 1 active actors on pipe
2025-10-15T10:59:56.464078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401576979080881:8417], now have 1 active actors on pipe
2025-10-15T10:59:56.464141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:56.464162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:56.464197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401579778772667:7572]
2025-10-15T10:59:56.464211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401579778772667:7572]
2025-10-15T10:59:56.464225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401579778772667:7572]
2025-10-15T10:59:56.464266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:56.464301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:56.464316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:56.464328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:56.464340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:56.464524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:56.464543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:56.464611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5307895-c124c3d-d21e0c82-e61548d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:56.464643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:56.464661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:56.464671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:56.464706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:56.464749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:56.464886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401579778772667:7572]
2025-10-15T10:59:56.464926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:56.464953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:56.464974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:56.465901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:56.465924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:56.465988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:56.467578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae6a24-c149442a-2219f951-a36cf2ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f5307895-c124c3d-d21e0c82-e61548d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:56.466722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 741 partition: 0 MaxSeqNo: 46 sessionId: src_id|f5307895-c124c3d-d21e0c82-e61548d4_0
2025-10-15T10:59:56.498447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5307895-c124c3d-d21e0c82-e61548d4_0] Write session: try to update token
2025-10-15T10:59:56.498511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5307895-c124c3d-d21e0c82-e61548d4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:56.587159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:56.587191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:56.587204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:56.587212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:56.587243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401579778772667:7572]
2025-10-15T10:59:56.587259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401579778772667:7572]
2025-10-15T10:59:56.587272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401579778772667:7572]
2025-10-15T10:59:56.587404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:56.587434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:56.587447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:56.587458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:56.587459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:56.587467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:56.587570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:56.587589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:56.588378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:56.657383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId: src_id|f5307895-c124c3d-d21e0c82-e61548d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:56.678716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:56.731152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:56.747252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:56.747308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:56.747422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:56.747439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:56.747485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401579778772667:7572]
2025-10-15T10:59:56.747757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:56.748103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:56.749334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401576979080888:8039]
2025-10-15T10:59:56.749521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:56.749796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:56.756765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 741 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f5307895-c124c3d-d21e0c82-e61548d4_0
2025-10-15T10:59:56.756921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 741 sessionId: src_id|f5307895-c124c3d-d21e0c82-e61548d4_0 is DEAD
2025-10-15T10:59:56.768056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5307895-c124c3d-d21e0c82-e61548d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:56.768114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5307895-c124c3d-d21e0c82-e61548d4_0] Write session will restart in 0.008926s
2025-10-15T10:59:56.768216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5307895-c124c3d-d21e0c82-e61548d4_0] Write session: Do CDS request
2025-10-15T10:59:56.768249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5307895-c124c3d-d21e0c82-e61548d4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:56.788643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5307895-c124c3d-d21e0c82-e61548d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:56.795591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:56.795618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 742
2025-10-15T10:59:56.796027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:56.796185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:56.796202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:56.796213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:56.797655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 742 sessionId:  describe result for acl check
2025-10-15T10:59:56.797769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:56.797780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:56.797789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:56.797807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401576979080920:8422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:56.800171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401576979080920:8422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:56.812007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401576979080920:8422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:56.817049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:56.822093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:56.822963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:56.822997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:56.823040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:56.823286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:56.823501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401579778772765:7580]
2025-10-15T10:59:56.826158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:56.827271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:56.827577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:56.829125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:56.829438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:56.829446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:56.829453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:56.829461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:56.829468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:56.829474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:56.829481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:56.829488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:56.829495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:56.829502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:56.829508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:56.829515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.829523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.829529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.829583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:56.829691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:56.829739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:56.829784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:56.829855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:56.829902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:56.829946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:56.829989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:56.830039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:56.830087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:56.830130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:56.830173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.830225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.830272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.830315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:56.830386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:56.830441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:56.830491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:56.830547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:56.830599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:56.830646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:56.830728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:56.830776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:56.830830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:56.830883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:56.830938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:56.830985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:56.831034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:56.831077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:56.831129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:56.831174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:56.831231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:56.831278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:56.831328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:56.834113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:56.834185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:56.834230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.834278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.834324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.834374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.834415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.834464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.834957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:56.832529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401576979080920:8422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:56.832574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401576979080920:8422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:56.832590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401576979080920:8422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:56.832628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:56.850372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401576979080978:8039]
2025-10-15T10:59:56.855886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:56.868489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:56.868542Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:56.868559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:56.868578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:56.868599Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 741 [2:7561401579778772765:7580]
2025-10-15T10:59:56.868645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:56.868694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:56.868707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:56.868718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:56.868728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:56.868770Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:56.868791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:56.868809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:56.870526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.870541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.870554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.870564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:56.870836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:56.870853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:56.870981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:56.871158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:56.872470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:56.872562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401576979080978:8039], now have 1 active actors on pipe
2025-10-15T10:59:56.872585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401576979080970:8422], now have 1 active actors on pipe
2025-10-15T10:59:56.872605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401576979080901:2467], now have 1 active actors on pipe
2025-10-15T10:59:56.872648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:56.872666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:56.872712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401579778772759:7580]
2025-10-15T10:59:56.872724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401579778772759:7580]
2025-10-15T10:59:56.872736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401579778772759:7580]
2025-10-15T10:59:56.872773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:56.872828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:56.872836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:56.872849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:56.872860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:56.873005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:56.873027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:56.873078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c003f47-c416fd69-734cc648-51266264_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:56.873109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:56.873128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:56.873137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:56.873167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:56.873203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:56.873320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401579778772759:7580]
2025-10-15T10:59:56.873349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:56.873387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:56.873408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:56.872166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 741, pipe: [1:7561401576979080978:8039]
2025-10-15T10:59:56.872265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 741
2025-10-15T10:59:56.872341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 741
2025-10-15T10:59:56.875902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:56.875932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:56.875997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:56.876362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 742 partition: 0 MaxSeqNo: 46 sessionId: src_id|c003f47-c416fd69-734cc648-51266264_0
2025-10-15T10:59:56.879609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5307895-c124c3d-d21e0c82-e61548d4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c003f47-c416fd69-734cc648-51266264_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:56.927702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c003f47-c416fd69-734cc648-51266264_0] Write session: try to update token
2025-10-15T10:59:56.927766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c003f47-c416fd69-734cc648-51266264_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:57.001062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:57.001093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:57.001104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:57.001114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:57.001146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401579778772759:7580]
2025-10-15T10:59:57.001169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401579778772759:7580]
2025-10-15T10:59:57.001191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401579778772759:7580]
2025-10-15T10:59:57.001350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:57.001395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:57.001401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:57.001406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:57.001417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:57.001434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:57.001457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:57.001476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:57.002491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:57.060587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId: src_id|c003f47-c416fd69-734cc648-51266264_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:57.083950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:57.143740Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:57.169844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:57.169884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:57.169945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:57.169959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:57.169998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401579778772759:7580]
2025-10-15T10:59:57.170440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:57.170746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:57.171964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401576979080978:8039]
2025-10-15T10:59:57.172111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:57.186882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 742 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c003f47-c416fd69-734cc648-51266264_0
2025-10-15T10:59:57.187218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 742 sessionId: src_id|c003f47-c416fd69-734cc648-51266264_0 is DEAD
2025-10-15T10:59:57.190117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003f47-c416fd69-734cc648-51266264_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:57.190186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003f47-c416fd69-734cc648-51266264_0] Write session will restart in 0.006422s
2025-10-15T10:59:57.190340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003f47-c416fd69-734cc648-51266264_0] Write session: Do CDS request
2025-10-15T10:59:57.190390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003f47-c416fd69-734cc648-51266264_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:57.203002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c003f47-c416fd69-734cc648-51266264_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:57.225151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:57.225296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:57.225308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 743
2025-10-15T10:59:57.225804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:57.225916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:57.225930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:57.225939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:57.226538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:57.227669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 743 sessionId:  describe result for acl check
2025-10-15T10:59:57.227771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:57.227783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:57.227792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:57.227807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401581274048347:8433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:57.230275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401581274048347:8433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:57.232791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:57.236219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401581274048347:8433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:57.233869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:57.233897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:57.233941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:57.234211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:57.234415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401584073740148:7583]
2025-10-15T10:59:57.236611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:57.237941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:57.238169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:57.239426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:57.239739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:57.239748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:57.239755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:57.239762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:57.239770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:57.239776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:57.239784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:57.239791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:57.239797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:57.239804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:57.239812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:57.239819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.239825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.239832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.239880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:57.239993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:57.240042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:57.240087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:57.240133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:57.240180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:57.240226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:57.240273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:57.240318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:57.240365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:57.240409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:57.240453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.240498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.240542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.240584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:57.240648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:57.240705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:57.240759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:57.240808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:57.240863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:57.240909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:57.240963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:57.241009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:57.241064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:57.241111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:57.241166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:57.241213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:57.241266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:57.241312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:57.241366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:57.241412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:57.241465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:57.241511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:57.241565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:57.241611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:57.241665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:57.241725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.241785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.241833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.241888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.241932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.241987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.242476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:57.250356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401581274048347:8433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:57.250397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401581274048347:8433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:57.250413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401581274048347:8433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:57.250441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:57.272453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401581274048382:8039]
2025-10-15T10:59:57.271952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:57.283670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:57.283721Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:57.283740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:57.283760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:57.283786Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 742 [2:7561401584073740148:7583]
2025-10-15T10:59:57.283838Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:57.283901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:57.283914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:57.283927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:57.283938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:57.283983Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:57.284005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:57.284026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:57.285938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.285963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.285979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.285994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:57.286294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:57.286319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.287074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 742, pipe: [1:7561401581274048382:8039]
2025-10-15T10:59:57.287169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 742
2025-10-15T10:59:57.287245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 742
2025-10-15T10:59:57.286458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.286660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.286897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:57.286976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401581274048382:8039], now have 1 active actors on pipe
2025-10-15T10:59:57.287001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401581274048342:2467], now have 1 active actors on pipe
2025-10-15T10:59:57.287023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401581274048380:8433], now have 1 active actors on pipe
2025-10-15T10:59:57.287045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401584073740142:7583]
2025-10-15T10:59:57.287060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401584073740142:7583]
2025-10-15T10:59:57.287073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401584073740142:7583]
2025-10-15T10:59:57.287119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:57.287166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:57.287180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:57.287193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:57.287205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:57.287682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:57.287701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:57.287865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:57.287896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:57.287934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401584073740142:7583]
2025-10-15T10:59:57.287969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:57.288007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:57.288074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:57.288100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:57.288116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:57.288126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:57.288168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:57.288205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:57.288284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:57.289010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:57.289036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:57.289096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:57.289409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 743 partition: 0 MaxSeqNo: 46 sessionId: src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0
2025-10-15T10:59:57.295582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c003f47-c416fd69-734cc648-51266264_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:57.335210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0] Write session: try to update token
2025-10-15T10:59:57.335278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:57.435108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:57.435147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:57.435160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:57.435169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:57.435205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401584073740142:7583]
2025-10-15T10:59:57.435229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401584073740142:7583]
2025-10-15T10:59:57.435251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401584073740142:7583]
2025-10-15T10:59:57.435411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:57.435445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:57.435472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:57.435509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:57.435532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:57.435543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:57.435596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:57.435618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:57.436672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:57.452520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId: src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:57.474625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:57.578193Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:57.595006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:57.595058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:57.595141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:57.595159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:57.595210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401584073740142:7583]
2025-10-15T10:59:57.595447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:57.596097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401581274048382:8039]
2025-10-15T10:59:57.596189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:57.596321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:57.596343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:57.596082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:57.602874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 743 reason: error at write: Disconnected sessionId: src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0
2025-10-15T10:59:57.603245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 743 sessionId: src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0 is DEAD
2025-10-15T10:59:57.607579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:57.607642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0] Write session will restart in 0.009601s
2025-10-15T10:59:57.607816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0] Write session: Do CDS request
2025-10-15T10:59:57.607880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:57.624383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:57.624629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:57.624425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 744
2025-10-15T10:59:57.628298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:57.628559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:57.628592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:57.628611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:57.631124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 744 sessionId:  describe result for acl check
2025-10-15T10:59:57.631298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:57.631316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:57.631326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:57.631369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401581274048417:8440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:57.635286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401581274048417:8440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:57.642580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401581274048417:8440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:57.652761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401581274048417:8440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:57.652808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401581274048417:8440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:57.652826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401581274048417:8440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:57.652859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:57.653144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:57.657590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:57.658434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:57.658460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:57.658497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:57.658715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:57.658864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401584073740236:7588]
2025-10-15T10:59:57.660737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:57.661751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:57.661976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:57.663272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:57.663643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:57.663662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:57.663669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:57.663676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:57.663683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:57.663690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:57.663698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:57.663705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:57.663711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:57.663718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:57.663725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:57.663733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.663742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.663750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.663801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:57.663913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:57.663965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:57.664017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:57.664074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:57.664137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:57.664186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:57.664239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:57.664294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:57.664351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:57.664403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:57.664457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.664507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.664560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.664620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:57.664695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:57.664763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:57.664820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:57.664873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:57.664948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:57.664994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:57.665049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:57.665099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:57.665154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:57.665202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:57.665258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:57.665307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:57.665360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:57.665407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:57.665465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:57.665514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:57.666191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:57.666263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:57.666324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:57.666381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:57.666444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:57.666495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.666556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.666616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.666679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.666757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.666811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.667287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:57.689066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:57.695930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401581274048478:8039]
2025-10-15T10:59:57.704750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:57.704793Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:57.704810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:57.704832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:57.704860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 743 [2:7561401584073740236:7588]
2025-10-15T10:59:57.704916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:57.704977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:57.704997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:57.705011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:57.705022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:57.705076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:57.705107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:57.705131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:57.706179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.706196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.706210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.706222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:57.706482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:57.706509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:57.706662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:57.706877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:57.708206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 743
2025-10-15T10:59:57.708299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 743
2025-10-15T10:59:57.708361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 743, pipe: [1:7561401581274048478:8039]
2025-10-15T10:59:57.707127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:57.707220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401581274048403:2467], now have 1 active actors on pipe
2025-10-15T10:59:57.707248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401581274048478:8039], now have 1 active actors on pipe
2025-10-15T10:59:57.707270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401581274048471:8440], now have 1 active actors on pipe
2025-10-15T10:59:57.707296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401584073740228:7588]
2025-10-15T10:59:57.707311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401584073740228:7588]
2025-10-15T10:59:57.707328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401584073740228:7588]
2025-10-15T10:59:57.707387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:57.707477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:57.707670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:57.707689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:57.707732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:57.707749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:57.707760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:57.707810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401584073740228:7588]
2025-10-15T10:59:57.707837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:57.707845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:57.709214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:57.709246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:57.709330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:57.709363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:57.709383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:57.709394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:57.709431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:57.709473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:57.709518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:57.713169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e046b0-3f49bc8c-f335f85a-a6b4cab6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:57.711881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:57.711917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:57.711991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:57.712300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 744 partition: 0 MaxSeqNo: 46 sessionId: src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0
2025-10-15T10:59:57.752912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0] Write session: try to update token
2025-10-15T10:59:57.752972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:57.870452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:57.870490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:57.870503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:57.870515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:57.870547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401584073740228:7588]
2025-10-15T10:59:57.870574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401584073740228:7588]
2025-10-15T10:59:57.870599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401584073740228:7588]
2025-10-15T10:59:57.870737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:57.870774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:57.870786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:57.870791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:57.870803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:57.870815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:57.870906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:57.870930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:57.872887Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:57.894091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId: src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:57.925396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:58.027391Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:58.041037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:58.041089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:58.041164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:58.041178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:58.041221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401584073740228:7588]
2025-10-15T10:59:58.041479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:58.042455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:58.043545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:58.043735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401581274048478:8039]
2025-10-15T10:59:58.043769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:58.072694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:58.072764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0] Write session will restart in 0.005929s
2025-10-15T10:59:58.072961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0] Write session: Do CDS request
2025-10-15T10:59:58.073019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:58.071989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 744 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0
2025-10-15T10:59:58.072354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 744 sessionId: src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0 is DEAD
2025-10-15T10:59:58.086566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:58.087662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:58.087693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 745
2025-10-15T10:59:58.088015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:58.088140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:58.088157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:58.088168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:58.089896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 745 sessionId:  describe result for acl check
2025-10-15T10:59:58.090005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:58.090016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:58.090026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:58.090047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401585569015824:8445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:58.092772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401585569015824:8445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:58.099036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401585569015824:8445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:58.105858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:58.109532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:58.110398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:58.110417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:58.110458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:58.110721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:58.111307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401588368707629:7597]
2025-10-15T10:59:58.113578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401585569015824:8445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:58.113626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401585569015824:8445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:58.113645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401585569015824:8445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:58.113679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:58.113600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:58.114747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:58.114995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:58.116059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:58.116371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.116376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.116382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.116386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.116390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.116394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.116399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.116403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.116411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.116415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.116420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.116424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.116428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.116433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.116478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.116567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.116611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.116657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.116694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.116726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.116758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.116788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.116820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.116852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.116885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.116916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.116952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.116992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.117020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.117065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.117105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.117140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.117176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.117212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.117241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.117277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.117308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.117346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.117375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.117409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.117440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.117488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.117520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.117570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.117616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.117668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.117713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.117764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.117800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.117834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.117864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.117899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.117931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.117970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.118009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.118044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.118424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:58.144361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401585569015874:8039]
2025-10-15T10:59:58.144511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:58.153998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:58.154040Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:58.154057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:58.154076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:58.154102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 744 [2:7561401588368707629:7597]
2025-10-15T10:59:58.154155Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:58.154219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:58.154243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:58.154258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:58.154270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:58.154321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:58.154346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:58.154369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:58.156753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 744, pipe: [1:7561401585569015874:8039]
2025-10-15T10:59:58.156884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 744
2025-10-15T10:59:58.156973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 744
2025-10-15T10:59:58.155629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.155652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.155666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.155679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:58.155985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:58.156005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.156160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.156361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.156635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:58.156721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401585569015874:8039], now have 1 active actors on pipe
2025-10-15T10:59:58.156746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401585569015789:2467], now have 1 active actors on pipe
2025-10-15T10:59:58.156770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401585569015855:8445], now have 1 active actors on pipe
2025-10-15T10:59:58.156800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401588368707624:7597]
2025-10-15T10:59:58.156815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401588368707624:7597]
2025-10-15T10:59:58.156829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401588368707624:7597]
2025-10-15T10:59:58.156872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:58.156910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:58.156924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:58.156945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:58.156951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:58.157142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:58.157159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:58.157291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401588368707624:7597]
2025-10-15T10:59:58.157313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:58.157328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:58.157444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:58.157465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:58.157579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:58.157613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:58.157632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:58.157643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:58.157685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:58.157727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:58.157799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:58.158890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:58.158933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:58.159022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:58.159754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 745 partition: 0 MaxSeqNo: 46 sessionId: src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0
2025-10-15T10:59:58.163565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b50b74-4e5965dd-b7123828-2f3bfe20_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:58.203253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0] Write session: try to update token
2025-10-15T10:59:58.203314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:58.272338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:58.272396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:58.272429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:58.272458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:58.272534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401588368707624:7597]
2025-10-15T10:59:58.272596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401588368707624:7597]
2025-10-15T10:59:58.272652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401588368707624:7597]
2025-10-15T10:59:58.272813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:58.272853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:58.272887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:58.272919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:58.272949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:58.272976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:58.273180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:58.273219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:58.285891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:58.377160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId: src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:58.402583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:58.436463Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:58.455927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:58.455973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:58.456032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:58.456045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:58.456083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401588368707624:7597]
2025-10-15T10:59:58.456324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:58.457255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:58.459539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:58.459755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:59:58.505655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401585569015874:8039]
2025-10-15T10:59:58.505733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 745 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0
2025-10-15T10:59:58.505950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 745 sessionId: src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0 is DEAD
2025-10-15T10:59:58.507922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T10:59:58.508004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0] Write session will restart in 0.006764s
2025-10-15T10:59:58.508225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0] Write session: Do CDS request
2025-10-15T10:59:58.508273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:58.513828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:58.518664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:58.519592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:58.519621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:58.519662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:58.519945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:58.520131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401588368707726:7605]
2025-10-15T10:59:58.522433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:58.524570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:58.525285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:58.525312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 746
2025-10-15T10:59:58.526894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:58.527048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:58.528333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:58.528687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.528698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.528706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.528713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.528720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.528727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.528733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.528739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.528747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.528754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.528761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.528771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.528777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.528784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.528832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.528939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.528987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.529032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.529077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.529125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.529170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.529217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.529272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.529317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.529362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.529405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.529449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.529493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.529536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.529598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.529655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.529711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.529761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.529040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:58.529169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:58.529184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:58.529194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:58.530796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 746 sessionId:  describe result for acl check
2025-10-15T10:59:58.530898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:58.530908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:58.530917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:58.530932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401585569015941:8456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:58.533359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401585569015941:8456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:58.535586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.535643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.535685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.535718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.535754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.535785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.535823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.535855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.535890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.535920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.535956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.535989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.536024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.536054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.536093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.536136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.536181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.536211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.536245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.536276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.536309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.536336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.536368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.536664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:58.538843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401585569015941:8456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:58.547684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401585569015941:8456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:58.547723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401585569015941:8456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:58.547739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401585569015941:8456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:58.547768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:58.555544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:58.565951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:58.565987Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:58.566003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:58.566019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:58.566041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 745 [2:7561401588368707726:7605]
2025-10-15T10:59:58.566087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:58.566142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:58.566155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:58.566166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:58.566176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:58.566218Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:58.566238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:58.566255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:58.568142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.568165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.568179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.568189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:58.568443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:58.568462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.568596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.568781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.569015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:58.569083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401588368707721:7605]
2025-10-15T10:59:58.569097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401588368707721:7605]
2025-10-15T10:59:58.569110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401588368707721:7605]
2025-10-15T10:59:58.569148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:58.569214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:58.569391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:58.569420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:58.569535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401588368707721:7605]
2025-10-15T10:59:58.569553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:58.569760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:58.569773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:58.569785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:58.569805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:58.571614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 745
2025-10-15T10:59:58.571708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 745
2025-10-15T10:59:58.572569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401585569015971:8456], now have 1 active actors on pipe
2025-10-15T10:59:58.572606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401585569015901:2467], now have 1 active actors on pipe
2025-10-15T10:59:58.572675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:58.572694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:58.572762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d37535-5c77c867-1d654109-624a78d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:58.572789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:58.572806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:58.572815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:58.572846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:58.572885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:58.572921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:58.574259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 746 partition: 0 MaxSeqNo: 46 sessionId: src_id|1d37535-5c77c867-1d654109-624a78d4_0
2025-10-15T10:59:58.573820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:58.573865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:58.573919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:58.575052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4abc03f2-293ade97-9c04a850-ecd82d1b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1d37535-5c77c867-1d654109-624a78d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:58.607218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401585569015978:8039]
2025-10-15T10:59:58.610035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401585569015978:8039], now have 1 active actors on pipe
2025-10-15T10:59:58.610263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 745, pipe: [1:7561401585569015978:8039]
2025-10-15T10:59:58.613344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d37535-5c77c867-1d654109-624a78d4_0] Write session: try to update token
2025-10-15T10:59:58.613393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d37535-5c77c867-1d654109-624a78d4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:58.651747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:58.651776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:58.651791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:58.651804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:58.651844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401588368707721:7605]
2025-10-15T10:59:58.651871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401588368707721:7605]
2025-10-15T10:59:58.651892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401588368707721:7605]
2025-10-15T10:59:58.652053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:58.652075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:58.655328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:58.655390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:58.655427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:58.656920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:58.746388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId: src_id|1d37535-5c77c867-1d654109-624a78d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:58.768783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:58.807990Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:58.810168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:58.810200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:58.811571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:58.814293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:58.811615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:58.820950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401585569015978:8039]
2025-10-15T10:59:58.839675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:58.845270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d37535-5c77c867-1d654109-624a78d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:58.845339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d37535-5c77c867-1d654109-624a78d4_0] Write session will restart in 0.007172s
2025-10-15T10:59:58.845521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d37535-5c77c867-1d654109-624a78d4_0] Write session: Do CDS request
2025-10-15T10:59:58.845580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d37535-5c77c867-1d654109-624a78d4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:58.844489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 746 reason: error at write: Disconnected sessionId: src_id|1d37535-5c77c867-1d654109-624a78d4_0
2025-10-15T10:59:58.844811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 746 sessionId: src_id|1d37535-5c77c867-1d654109-624a78d4_0 is DEAD
2025-10-15T10:59:58.866888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d37535-5c77c867-1d654109-624a78d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:58.867329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:58.867465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 747
2025-10-15T10:59:58.867904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:58.868011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:58.868026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:58.868036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:58.869654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 747 sessionId:  describe result for acl check
2025-10-15T10:59:58.869765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:58.869777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:58.869787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:58.869802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401585569016030:8464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:58.872698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401585569016030:8464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:58.878114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:58.882839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:58.883677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:58.883696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:58.883736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:58.883973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:58.884150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401588368707811:7607]
2025-10-15T10:59:58.886037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:58.887231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401585569016030:8464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:58.887504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:58.887689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:58.888767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:58.889071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.889089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.889095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.889102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.889107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.889114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.889121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.889127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.889134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.889139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.889145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.889152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.889158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.889164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.889205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.889295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.889337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.889376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.889415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.889455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.889492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.889531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.889568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.889609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.889646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.889684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.889742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.889786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.889827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.889887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:58.889940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.889994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:58.890041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.890089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:58.890129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.890173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:58.890216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.890262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:58.890301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.890347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:58.890395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.890446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:58.890488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.890533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:58.890571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.890618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:58.890655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.890700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:58.890755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.890802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:58.890842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.890887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.890929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.890976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.891015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.891060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.892847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:58.904069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401585569016030:8464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:58.904111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401585569016030:8464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:58.904130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401585569016030:8464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:58.904164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:58.912039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:58.920639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:58.920682Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:58.920697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:58.920715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:58.920737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 746 [2:7561401588368707811:7607]
2025-10-15T10:59:58.920784Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:58.920838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:58.920852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:58.920862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:58.920873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:58.920915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:58.920933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:58.920952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:58.921925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.921940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.922105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401585569016069:8039]
2025-10-15T10:59:58.921953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.921964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:58.922201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:58.922218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:58.922339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:58.922507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:58.922733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:58.922803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401588368707805:7607]
2025-10-15T10:59:58.922816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401588368707805:7607]
2025-10-15T10:59:58.922828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401588368707805:7607]
2025-10-15T10:59:58.922856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:58.922921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:58.923061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:58.923078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:58.923079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:58.923093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:58.923094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:58.923193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401588368707805:7607]
2025-10-15T10:59:58.923212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:58.923234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:58.923289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401585569016068:8464], now have 1 active actors on pipe
2025-10-15T10:59:58.923311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401585569015987:2467], now have 1 active actors on pipe
2025-10-15T10:59:58.923331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401585569016069:8039], now have 1 active actors on pipe
2025-10-15T10:59:58.924651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:58.923700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 746
2025-10-15T10:59:58.924682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:58.924754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:58.923797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 746
2025-10-15T10:59:58.924779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:58.923876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 746, pipe: [1:7561401585569016069:8039]
2025-10-15T10:59:58.924794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:58.924802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:58.924833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:58.924869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:58.924911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:58.925627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:58.925648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:58.925705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:58.926087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 747 partition: 0 MaxSeqNo: 46 sessionId: src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0
2025-10-15T10:59:58.927002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d37535-5c77c867-1d654109-624a78d4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:58.963760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0] Write session: try to update token
2025-10-15T10:59:58.963820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:59.013191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:59.013229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:59.013246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:59.013260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:59.013298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401588368707805:7607]
2025-10-15T10:59:59.013324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401588368707805:7607]
2025-10-15T10:59:59.013351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401588368707805:7607]
2025-10-15T10:59:59.013508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:59.013534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:59.014565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:59.015470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:59.015518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:59.015554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:59.091619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId: src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:59.117657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:59.177671Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:59.190679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:59.190730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:59.190823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401585569016069:8039]
2025-10-15T10:59:59.190919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:59.189100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:59.189135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:59.193274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:59.211136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 747 reason: error at write: Disconnected sessionId: src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0
2025-10-15T10:59:59.211777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:59.211816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0] Write session will restart in 0.006029s
2025-10-15T10:59:59.211943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0] Write session: Do CDS request
2025-10-15T10:59:59.212005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:59.211692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 747 sessionId: src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0 is DEAD
2025-10-15T10:59:59.224836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:59.224864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 748
2025-10-15T10:59:59.225098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:59.225762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:59.225882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:59.225897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:59.225907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:59.227106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 748 sessionId:  describe result for acl check
2025-10-15T10:59:59.227220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:59.227236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:59.227248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:59.227268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401589863983428:8469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:59.229759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401589863983428:8469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:59.241505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:59.245065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401589863983428:8469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:59.244271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:59.245232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:59.245252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:59.245298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:59.245580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:59.245782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401592663675212:7618]
2025-10-15T10:59:59.248113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:59.249302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:59.252513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401589863983428:8469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:59.249521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:59.252552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401589863983428:8469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:59.250828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:59.252571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401589863983428:8469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:59.252602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:59.251167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:59.251176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:59.251182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:59.251189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:59.251196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:59.251202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:59.251208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:59.251216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:59.251223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:59.251230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:59.251237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:59.251244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.251250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.251257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.251305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:59.251441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:59.251496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:59.251545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:59.251589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:59.251639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:59.251689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:59.251734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:59.251781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:59.251826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:59.251873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:59.251918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.251969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.252015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.252061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:59.252128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:59.252188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:59.252243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:59.252293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:59.252350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:59.252398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:59.252456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:59.253459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:59.253529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:59.253577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:59.253634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:59.253681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:59.253735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:59.253781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:59.253836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:59.253885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:59.253937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:59.253984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:59.254041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:59.254088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:59.254147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:59.254191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.254244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.254291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.254347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.254390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.254445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.254972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:59.284773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:59.290900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401589863983470:8039]
2025-10-15T10:59:59.293608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:59.293644Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:59.293657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:59.293672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:59.293692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 747 [2:7561401592663675212:7618]
2025-10-15T10:59:59.293741Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:59.293792Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:59.293804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:59.293815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:59.293824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:59.293872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:59.293894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:59.293912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:59.296099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.296126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.296140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.296154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:59.296415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:59.296427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.296543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.296746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.296975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:59.297061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401589863983470:8039], now have 1 active actors on pipe
2025-10-15T10:59:59.297083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401589863983390:2467], now have 1 active actors on pipe
2025-10-15T10:59:59.297106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401589863983466:8469], now have 1 active actors on pipe
2025-10-15T10:59:59.297132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401592663675207:7618]
2025-10-15T10:59:59.297149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401592663675207:7618]
2025-10-15T10:59:59.297161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401592663675207:7618]
2025-10-15T10:59:59.297203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:59.297247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:59.297263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:59.297281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:59.297285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:59.297471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:59.297494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:59.297629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401592663675207:7618]
2025-10-15T10:59:59.297660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:59.297703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:59.298200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 747, pipe: [1:7561401589863983470:8039]
2025-10-15T10:59:59.298299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 747
2025-10-15T10:59:59.298378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 747
2025-10-15T10:59:59.301364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:59.301400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:59.301489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfa566c1-d984308b-6a11be49-f569240c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:59.301525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:59.301545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:59.301556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:59.301596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:59.301645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:59.301691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:59.302211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:59.302238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:59.302300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:59.302579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 748 partition: 0 MaxSeqNo: 46 sessionId: src_id|dfa566c1-d984308b-6a11be49-f569240c_0
2025-10-15T10:59:59.303325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6ad8fb7-b75495e7-8ca0b664-e6f6b0c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dfa566c1-d984308b-6a11be49-f569240c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:59.329694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa566c1-d984308b-6a11be49-f569240c_0] Write session: try to update token
2025-10-15T10:59:59.329746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa566c1-d984308b-6a11be49-f569240c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:59.398650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:59.398681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:59.398694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:59.398706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:59.398751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401592663675207:7618]
2025-10-15T10:59:59.398777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401592663675207:7618]
2025-10-15T10:59:59.398800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401592663675207:7618]
2025-10-15T10:59:59.399001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:59.399022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:59.399034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:59.399077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:59.399098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:59.400220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:59.401284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:59.401336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:59.401369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:59.455369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId: src_id|dfa566c1-d984308b-6a11be49-f569240c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:59.476741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:59:59.544642Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T10:59:59.563537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:59.563581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:59.563642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:59.563655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:59.563690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401592663675207:7618]
2025-10-15T10:59:59.563845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:59.564215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401589863983470:8039]
2025-10-15T10:59:59.564276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T10:59:59.564316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T10:59:59.564480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T10:59:59.564494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T10:59:59.573305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 748 reason: error at write: Disconnected sessionId: src_id|dfa566c1-d984308b-6a11be49-f569240c_0
2025-10-15T10:59:59.573678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 748 sessionId: src_id|dfa566c1-d984308b-6a11be49-f569240c_0 is DEAD
2025-10-15T10:59:59.576039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa566c1-d984308b-6a11be49-f569240c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T10:59:59.576090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa566c1-d984308b-6a11be49-f569240c_0] Write session will restart in 0.005629s
2025-10-15T10:59:59.576265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa566c1-d984308b-6a11be49-f569240c_0] Write session: Do CDS request
2025-10-15T10:59:59.576321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa566c1-d984308b-6a11be49-f569240c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T10:59:59.592216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:59:59.592257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 749
2025-10-15T10:59:59.593173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa566c1-d984308b-6a11be49-f569240c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:59.594439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:59:59.594587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T10:59:59.594604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:59:59.594614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:59:59.596765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 749 sessionId:  describe result for acl check
2025-10-15T10:59:59.596891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:59:59.596916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:59:59.596926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:59:59.596945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401589863983491:8475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:59:59.599806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401589863983491:8475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:59:59.606854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401589863983491:8475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:59:59.616840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401589863983491:8475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:59:59.616883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401589863983491:8475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:59:59.616900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401589863983491:8475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:59:59.616928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:59:59.638710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:59:59.640499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:59:59.641282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:59:59.641307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T10:59:59.641340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:59:59.641559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:59:59.641737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401592663675312:7621]
2025-10-15T10:59:59.644028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T10:59:59.644977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T10:59:59.645195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T10:59:59.646448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T10:59:59.646797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:59.646815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:59.646822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:59.646828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:59.646834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:59.646841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:59.646849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:59.646856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:59.646864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:59.646870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:59.646877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:59.646882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.646889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.646895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.646944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:59.647050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:59.647097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:59.647143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:59.647185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:59.647242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:59.647322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:59.647399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:59.647448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:59.647500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:59.647551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:59.647601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.647656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.647702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.647752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:59.647820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T10:59:59.647884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:59.647944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T10:59:59.647999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:59.648055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T10:59:59.648109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:59.648178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T10:59:59.648229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:59.648291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T10:59:59.648341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:59.648401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T10:59:59.648456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:59.648510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T10:59:59.648564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:59.648620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T10:59:59.648673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:59.648737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T10:59:59.648789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:59.648848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T10:59:59.648902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:59.648962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T10:59:59.649014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.649073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.649126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.649186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.649237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.649293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.649795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T10:59:59.665208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401589863983564:8039]
2025-10-15T10:59:59.670008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T10:59:59.685529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T10:59:59.685566Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T10:59:59.685576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:59:59.685588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:59:59.685604Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 748 [2:7561401592663675312:7621]
2025-10-15T10:59:59.685640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T10:59:59.685696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T10:59:59.685711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:59.685724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:59.685736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:59.685769Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T10:59:59.685784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:59:59.685800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:59:59.686664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.686680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.686688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.686695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T10:59:59.686906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T10:59:59.686925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T10:59:59.687041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T10:59:59.687184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T10:59:59.687454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T10:59:59.687430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 748
2025-10-15T10:59:59.687535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401589863983481:2467], now have 1 active actors on pipe
2025-10-15T10:59:59.687555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 748
2025-10-15T10:59:59.687564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401589863983528:8475], now have 1 active actors on pipe
2025-10-15T10:59:59.687585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401589863983564:8039], now have 1 active actors on pipe
2025-10-15T10:59:59.687604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401592663675307:7621]
2025-10-15T10:59:59.687619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401592663675307:7621]
2025-10-15T10:59:59.687618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 748, pipe: [1:7561401589863983564:8039]
2025-10-15T10:59:59.687627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401592663675307:7621]
2025-10-15T10:59:59.687652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T10:59:59.687701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T10:59:59.687701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T10:59:59.687715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T10:59:59.687736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T10:59:59.687851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T10:59:59.687867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:59:59.687926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:59.687949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:59.688033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401592663675307:7621]
2025-10-15T10:59:59.688056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T10:59:59.688073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T10:59:59.688121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:59:59.688144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:59.688156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:59.688162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:59:59.688184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:59.688212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:59:59.688317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:59.688804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:59:59.688829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:59:59.688886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:59:59.689248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 749 partition: 0 MaxSeqNo: 46 sessionId: src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0
2025-10-15T10:59:59.690161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfa566c1-d984308b-6a11be49-f569240c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:59:59.709353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0] Write session: try to update token
2025-10-15T10:59:59.709417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T10:59:59.722263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T10:59:59.722301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:59.722344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401592663675307:7621]
2025-10-15T10:59:59.722484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:59:59.722943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T10:59:59.732077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T10:59:59.740830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:59.742591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:59.743706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T10:59:59.745173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T10:59:59.745541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T10:59:59.787468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:59:59.787515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:59:59.787528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:59:59.855867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T10:59:59.855901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T10:59:59.855915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T10:59:59.855926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T10:59:59.855969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401592663675307:7621]
2025-10-15T10:59:59.855999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401592663675307:7621]
2025-10-15T10:59:59.856022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401592663675307:7621]
2025-10-15T10:59:59.856151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T10:59:59.856186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T10:59:59.856190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T10:59:59.856215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T10:59:59.856216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T10:59:59.857192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T10:59:59.862790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId: src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:59:59.881949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:00.000714Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:00.002891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:00.002936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:00.004602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401589863983564:8039]
2025-10-15T11:00:00.004674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:00.004853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:00.003698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:00.056721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 749 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0
2025-10-15T11:00:00.057103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 749 sessionId: src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0 is DEAD
2025-10-15T11:00:00.059980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:00.060048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0] Write session will restart in 0.009845s
2025-10-15T11:00:00.060196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0] Write session: Do CDS request
2025-10-15T11:00:00.060241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:00.066354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:00.075888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:00.076892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:00.076934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:00.076990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:00.077322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:00.077618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401596958642688:7628]
2025-10-15T11:00:00.078929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:00.080549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:00.082446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:00.082758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:00.084543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:00.084971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.084984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.084991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.084998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.085006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.085019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.085031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.085038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.085056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.085072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.085081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.085087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.085094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.085101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.085174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.085311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.085381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.085442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.085493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.085542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.085592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.085643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.085689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.085737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.085782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.085828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.085874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.085918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.085961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.086024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.086080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.086135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.086184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.086234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.086281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.086335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.086391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.086451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.086498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.086549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.086597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.086650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.086695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.086767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.086819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.086871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.086917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.086968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.087017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.087072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.087119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.087170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.087220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.087268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.087313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.087486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.088164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:00.091799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:00.091832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 750
2025-10-15T11:00:00.092657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:00.092809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:00.092840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:00.092851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:00.094200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 750 sessionId:  describe result for acl check
2025-10-15T11:00:00.094325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:00.094345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:00.094355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:00.094374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401594158950937:8486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:00.097188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401594158950937:8486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:00.103882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401594158950937:8486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:00.104213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401594158950956:8039]
2025-10-15T11:00:00.111651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:00.120775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401594158950937:8486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:00.120806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401594158950937:8486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:00.120822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401594158950937:8486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:00.120857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:00.121657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:00.121696Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:00.121712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:00.121736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:00.121760Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 749 [2:7561401596958642688:7628]
2025-10-15T11:00:00.121811Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:00.121866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:00.121890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:00.121903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:00.121915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:00.121964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:00.121988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:00.122009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:00.123133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.123149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.123165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.123178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:00.123856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 749
2025-10-15T11:00:00.123947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 749, pipe: [1:7561401594158950956:8039]
2025-10-15T11:00:00.124021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 749
2025-10-15T11:00:00.124239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:00.124267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.124413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.124604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.124834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:00.124915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401594158950887:2467], now have 1 active actors on pipe
2025-10-15T11:00:00.124938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401594158950956:8039], now have 1 active actors on pipe
2025-10-15T11:00:00.124960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401594158950966:8486], now have 1 active actors on pipe
2025-10-15T11:00:00.125007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:00.125029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:00.125083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401596958642683:7628]
2025-10-15T11:00:00.125098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401596958642683:7628]
2025-10-15T11:00:00.125111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401596958642683:7628]
2025-10-15T11:00:00.125148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:00.125221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:00.125414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:00.125432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:00.125498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a513a69f-5476ce05-d6e6a882-480c251_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:00.125529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:00.125547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:00.125558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:00.125595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:00.125640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:00.125764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401596958642683:7628]
2025-10-15T11:00:00.125783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:00.125826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:00.125924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:00.125951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:00.125962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:00.125991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:00.126711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:00.126765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:00.126843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:00.127372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 750 partition: 0 MaxSeqNo: 46 sessionId: src_id|a513a69f-5476ce05-d6e6a882-480c251_0
2025-10-15T11:00:00.131563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c788f83-8acd8e6f-2cf83163-8dcbecbf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a513a69f-5476ce05-d6e6a882-480c251_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:00.157555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a513a69f-5476ce05-d6e6a882-480c251_0] Write session: try to update token
2025-10-15T11:00:00.157610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a513a69f-5476ce05-d6e6a882-480c251_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:00.228154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:00.228201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:00.228221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:00.228241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:00.228289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401596958642683:7628]
2025-10-15T11:00:00.228330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401596958642683:7628]
2025-10-15T11:00:00.228372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401596958642683:7628]
2025-10-15T11:00:00.228528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:00.228571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:00.228603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:00.228652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:00.228673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:00.228694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:00.228761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:00.228793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:00.235990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:00.287647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId: src_id|a513a69f-5476ce05-d6e6a882-480c251_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:00.309196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:00.397657Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:00.413886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:00.413943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:00.414020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:00.414036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:00.414081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401596958642683:7628]
2025-10-15T11:00:00.414450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:00.414881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:00.414951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:00.414976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:00.415081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401594158950956:8039]
2025-10-15T11:00:00.415211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:00.428000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 750 reason: error at write: Disconnected sessionId: src_id|a513a69f-5476ce05-d6e6a882-480c251_0
2025-10-15T11:00:00.428336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 750 sessionId: src_id|a513a69f-5476ce05-d6e6a882-480c251_0 is DEAD
2025-10-15T11:00:00.431670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a513a69f-5476ce05-d6e6a882-480c251_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:00.431740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a513a69f-5476ce05-d6e6a882-480c251_0] Write session will restart in 0.008162s
2025-10-15T11:00:00.431921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a513a69f-5476ce05-d6e6a882-480c251_0] Write session: Do CDS request
2025-10-15T11:00:00.431976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a513a69f-5476ce05-d6e6a882-480c251_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:00.448663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a513a69f-5476ce05-d6e6a882-480c251_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:00.450657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:00.450690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 751
2025-10-15T11:00:00.451041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:00.451186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:00.451210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:00.451221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:00.452675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 751 sessionId:  describe result for acl check
2025-10-15T11:00:00.452797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:00.452816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:00.452833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:00.452853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401594158951021:8494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:00.456938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401594158951021:8494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:00.463927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401594158951021:8494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:00.474548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:00.477353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:00.477421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401594158951021:8494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:00.477471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401594158951021:8494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:00.477490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401594158951021:8494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:00.477523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:00.478211Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:00.478246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:00.478291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:00.478567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:00.478781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401596958642792:7633]
2025-10-15T11:00:00.481702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:00.482828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:00.483065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:00.484434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:00.484769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.484790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.484798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.484806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.484814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.484821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.484830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.484836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.484843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.484852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.484860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.484868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.484875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.484883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.484937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.485059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.485113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.485163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.485210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.485254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.485298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.485345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.485395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.485446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.485499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.485547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.485596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.485647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.485694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.485765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.485827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.485884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.485934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.485992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.486037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.486093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.486141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.486194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.486241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.486299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.486351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.486408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.486470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.486533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.486593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.486658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.486713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.486785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.486838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.486900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.486955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.487014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.487068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.487129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.487183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.487244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.487664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:00.507051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:00.515478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401594158951085:8039]
2025-10-15T11:00:00.527302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:00.527344Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:00.527378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:00.527400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:00.527426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 750 [2:7561401596958642792:7633]
2025-10-15T11:00:00.527483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:00.527546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:00.527560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:00.527574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:00.527587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:00.527638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:00.527663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:00.529281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 750, pipe: [1:7561401594158951085:8039]
2025-10-15T11:00:00.529405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 750
2025-10-15T11:00:00.529488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 750
2025-10-15T11:00:00.527687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:00.528674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.528691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.528706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.528718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:00.528989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:00.529007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.529158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.529359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.529606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:00.529687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401594158951005:2467], now have 1 active actors on pipe
2025-10-15T11:00:00.529714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401594158951085:8039], now have 1 active actors on pipe
2025-10-15T11:00:00.529737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401594158951080:8494], now have 1 active actors on pipe
2025-10-15T11:00:00.529767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401596958642786:7633]
2025-10-15T11:00:00.529782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401596958642786:7633]
2025-10-15T11:00:00.529798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401596958642786:7633]
2025-10-15T11:00:00.529830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:00.529857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:00.529870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:00.529882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:00.529904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:00.530094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:00.530112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:00.530167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:00.530189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:00.530329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401596958642786:7633]
2025-10-15T11:00:00.530364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:00.530401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:00.530436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4de90884-5112a066-fb37637c-d9a14dbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:00.530467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:00.530487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:00.530499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:00.530535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:00.530577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:00.530721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:00.531389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:00.531411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:00.531480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:00.531756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 751 partition: 0 MaxSeqNo: 46 sessionId: src_id|4de90884-5112a066-fb37637c-d9a14dbf_0
2025-10-15T11:00:00.532666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a513a69f-5476ce05-d6e6a882-480c251_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4de90884-5112a066-fb37637c-d9a14dbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:00.552741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4de90884-5112a066-fb37637c-d9a14dbf_0] Write session: try to update token
2025-10-15T11:00:00.552805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4de90884-5112a066-fb37637c-d9a14dbf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:00.605225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:00.605262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:00.605277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:00.605290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:00.605326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401596958642786:7633]
2025-10-15T11:00:00.605356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401596958642786:7633]
2025-10-15T11:00:00.605382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401596958642786:7633]
2025-10-15T11:00:00.605498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:00.605557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:00.605590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:00.605592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:00.605619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:00.606638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:00.634897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId: src_id|4de90884-5112a066-fb37637c-d9a14dbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:00.662692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:00.755693Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:00.782485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:00.782538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:00.782605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:00.782619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:00.782663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401596958642786:7633]
2025-10-15T11:00:00.782840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:00.783257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:00.783363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:00.783392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:00.783535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:00.783772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401594158951085:8039]
2025-10-15T11:00:00.793467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 751 reason: error at write: Disconnected sessionId: src_id|4de90884-5112a066-fb37637c-d9a14dbf_0
2025-10-15T11:00:00.793840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 751 sessionId: src_id|4de90884-5112a066-fb37637c-d9a14dbf_0 is DEAD
2025-10-15T11:00:00.794281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de90884-5112a066-fb37637c-d9a14dbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:00.794332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de90884-5112a066-fb37637c-d9a14dbf_0] Write session will restart in 0.007527s
2025-10-15T11:00:00.794481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de90884-5112a066-fb37637c-d9a14dbf_0] Write session: Do CDS request
2025-10-15T11:00:00.794534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de90884-5112a066-fb37637c-d9a14dbf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:00.806881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:00.806926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 752
2025-10-15T11:00:00.807092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4de90884-5112a066-fb37637c-d9a14dbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:00.807719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:00.807908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:00.807933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:00.807949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:00.809341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 752 sessionId:  describe result for acl check
2025-10-15T11:00:00.809457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:00.809474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:00.809484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:00.809503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401594158951109:8499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:00.812992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401594158951109:8499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:00.820716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401594158951109:8499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:00.829978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401594158951109:8499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:00.830023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401594158951109:8499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:00.830040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401594158951109:8499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:00.830073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:00.844077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:00.847078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:00.847959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:00.847987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:00.848031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:00.848297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:00.848477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401596958642889:7642]
2025-10-15T11:00:00.850751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:00.851899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:00.852134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:00.853563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:00.853925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.853941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.853949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.853957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.853964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.853973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.853980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.853988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.853995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.854001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.854008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.854015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.854023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.854030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.854081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.854195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.854244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.854297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.854350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.854407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.854460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.854512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.854565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.854619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.854672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.854719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.854779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.854826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.854870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.854939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:00.855005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.855069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:00.855118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.855187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:00.855235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.855291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:00.855339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.855409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:00.855454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.855511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:00.855556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.855610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:00.855655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.855711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:00.855762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.855818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:00.855865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.855919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:00.855974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.856031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:00.856084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.856144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.856200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.856255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.856307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.856366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.857131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:00.876977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:00.883038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401594158951177:8039]
2025-10-15T11:00:00.888495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:00.888542Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:00.888561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:00.888582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:00.888608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 751 [2:7561401596958642889:7642]
2025-10-15T11:00:00.888672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:00.888749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:00.888769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:00.888782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:00.888800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:00.888867Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:00.888896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:00.888926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:00.890668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.890708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.890724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.890750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:00.891076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:00.891095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:00.891286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:00.891685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 751
2025-10-15T11:00:00.891802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 751
2025-10-15T11:00:00.891809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 751, pipe: [1:7561401594158951177:8039]
2025-10-15T11:00:00.891768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:00.892042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:00.892127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401594158951095:2467], now have 1 active actors on pipe
2025-10-15T11:00:00.892152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401594158951177:8039], now have 1 active actors on pipe
2025-10-15T11:00:00.892174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401594158951143:8499], now have 1 active actors on pipe
2025-10-15T11:00:00.892239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:00.892261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:00.892299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401596958642884:7642]
2025-10-15T11:00:00.892314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401596958642884:7642]
2025-10-15T11:00:00.892328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401596958642884:7642]
2025-10-15T11:00:00.892369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:00.892398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:00.892412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:00.892424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:00.892441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:00.892624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:00.892649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:00.892718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:00.892751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:00.892774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:00.892785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:00.892821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:00.892868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:00.893006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401596958642884:7642]
2025-10-15T11:00:00.893041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:00.893071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:00.893092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:00.893589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:00.893616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:00.893682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:00.894021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 752 partition: 0 MaxSeqNo: 46 sessionId: src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0
2025-10-15T11:00:00.894843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4de90884-5112a066-fb37637c-d9a14dbf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:00.926226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0] Write session: try to update token
2025-10-15T11:00:00.926287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:00.976309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:00.976348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:00.976364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:00.976375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:00.976418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401596958642884:7642]
2025-10-15T11:00:00.976447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401596958642884:7642]
2025-10-15T11:00:00.976472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401596958642884:7642]
2025-10-15T11:00:00.976601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:00.976633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:00.976650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:00.976658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:00.976680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:00.977816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:01.071228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId: src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:01.092196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:01.145784Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:01.147924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:01.147966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:01.148712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:01.148845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401594158951177:8039]
2025-10-15T11:00:01.148946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:01.148974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:01.163593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 752 reason: error at write: Disconnected sessionId: src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0
2025-10-15T11:00:01.163893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 752 sessionId: src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0 is DEAD
2025-10-15T11:00:01.164610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:01.164641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0] Write session will restart in 0.009845s
2025-10-15T11:00:01.164736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0] Write session: Do CDS request
2025-10-15T11:00:01.164764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:01.179491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:01.179469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:01.179499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 753
2025-10-15T11:00:01.181813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:01.181963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:01.181984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:01.181994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:01.183295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 753 sessionId:  describe result for acl check
2025-10-15T11:00:01.183426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:01.183442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:01.183450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:01.183466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401598453918509:8503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:01.185894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401598453918509:8503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:01.192031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401598453918509:8503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:01.192371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:01.210172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401598453918509:8503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:01.210214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401598453918509:8503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:01.210230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401598453918509:8503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:01.210258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:01.218465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:01.229547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:01.230452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:01.230472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:01.230512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:01.230773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:01.230958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401601253610300:7645]
2025-10-15T11:00:01.233211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:01.234554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:01.234822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:01.236162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:01.236500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:01.236509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:01.236517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:01.236526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:01.236534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:01.236542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:01.236550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:01.236558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:01.236566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:01.236573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:01.236581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:01.236587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.236595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.236602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.236653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:01.236789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:01.236845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:01.236900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:01.236950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:01.237004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:01.237053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:01.237104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:01.237156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:01.237207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:01.237259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:01.237308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.237362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.237417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.237465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:01.237543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:01.237606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:01.237670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:01.237726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:01.237784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:01.237835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:01.237893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:01.237947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:01.238005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:01.238054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:01.238112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:01.238162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:01.238220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:01.238270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:01.238331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:01.238383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:01.238442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:01.238494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:01.238555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:01.238604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:01.238663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:01.238712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.238785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.238836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.238895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.238943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.239002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.239580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:01.249222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401598453918585:8039]
2025-10-15T11:00:01.260524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:01.270724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:01.270789Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:01.270810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:01.270832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:01.270862Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 752 [2:7561401601253610300:7645]
2025-10-15T11:00:01.270924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:01.270999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:01.271017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:01.271032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:01.271045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:01.273042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 752, pipe: [1:7561401598453918585:8039]
2025-10-15T11:00:01.273171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 752
2025-10-15T11:00:01.273314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 752
2025-10-15T11:00:01.271100Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:01.271135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:01.271163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:01.272241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.272259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.272274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.272287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:01.272575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:01.272596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.272755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.272965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.273217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:01.273303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401598453918585:8039], now have 1 active actors on pipe
2025-10-15T11:00:01.273330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401598453918566:8503], now have 1 active actors on pipe
2025-10-15T11:00:01.273356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401598453918489:2467], now have 1 active actors on pipe
2025-10-15T11:00:01.273382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401601253610295:7645]
2025-10-15T11:00:01.273397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401601253610295:7645]
2025-10-15T11:00:01.273412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401601253610295:7645]
2025-10-15T11:00:01.273446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:01.273457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:01.273467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:01.273475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:01.273523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:01.273714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:01.273732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:01.273796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:01.273819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:01.273972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401601253610295:7645]
2025-10-15T11:00:01.274008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:01.274031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:01.274082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:01.274115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:01.274134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:01.274144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:01.274183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:01.274228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:01.274407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:01.276037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:01.276067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:01.276144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:01.276580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 753 partition: 0 MaxSeqNo: 46 sessionId: src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0
2025-10-15T11:00:01.277383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6ad7e24-70d5af07-d2cf2fe1-51809a7e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:01.301335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0] Write session: try to update token
2025-10-15T11:00:01.301398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:01.383769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:01.383807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:01.383821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:01.383834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:01.383873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401601253610295:7645]
2025-10-15T11:00:01.383901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401601253610295:7645]
2025-10-15T11:00:01.383925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401601253610295:7645]
2025-10-15T11:00:01.384050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:01.384081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:01.384105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:01.384159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:01.384171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:01.384182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:01.384232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:01.384252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:01.385194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:01.394297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId: src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:01.415845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:01.582832Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:01.602006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:01.602051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:01.602124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:01.602137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:01.602176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401601253610295:7645]
2025-10-15T11:00:01.602478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:01.602793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:01.603760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401598453918585:8039]
2025-10-15T11:00:01.603847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:01.611953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 753 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0
2025-10-15T11:00:01.612280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 753 sessionId: src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0 is DEAD
2025-10-15T11:00:01.619571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:01.619620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0] Write session will restart in 0.008568s
2025-10-15T11:00:01.619726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0] Write session: Do CDS request
2025-10-15T11:00:01.619757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:01.640518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:01.656107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:01.656643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:01.656665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 754
2025-10-15T11:00:01.659591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:01.659731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:01.659747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:01.659757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:01.661397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 754 sessionId:  describe result for acl check
2025-10-15T11:00:01.661511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:01.661521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:01.661531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:01.661548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401598453918634:8515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:01.664311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401598453918634:8515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:01.674809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401598453918634:8515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:01.681665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:01.687851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401598453918634:8515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:01.687890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401598453918634:8515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:01.687910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401598453918634:8515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:01.687940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:01.691791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:01.692707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:01.692743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:01.692791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:01.693066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:01.693268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401601253610387:7653]
2025-10-15T11:00:01.695797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:01.701296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:01.701508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:01.702421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:01.702651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:01.702665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:01.702670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:01.702675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:01.702681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:01.702685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:01.702691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:01.702696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:01.702701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:01.702706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:01.702713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:01.702718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.702723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.702729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.702782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:01.702868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:01.702903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:01.702938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:01.702973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:01.703008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:01.703042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:01.703078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:01.703111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:01.703145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:01.703179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:01.703221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.703255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.703292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.703327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:01.703418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:01.703488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:01.703555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:01.703610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:01.703797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401598453918690:8039]
2025-10-15T11:00:01.703678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:01.703738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:01.703812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:01.703873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:01.703932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:01.703979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:01.704037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:01.704091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:01.704148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:01.704195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:01.704254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:01.704305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:01.704363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:01.704423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:01.704480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:01.704529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:01.704583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:01.704628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.704684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.704729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.704783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.704829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.704885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.705415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:01.722793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:01.742097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:01.742151Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:01.742168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:01.742187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:01.742213Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 753 [2:7561401601253610387:7653]
2025-10-15T11:00:01.742267Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:01.742332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:01.742349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:01.742362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:01.742374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:01.742428Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:01.742452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:01.742476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:01.747181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 753
2025-10-15T11:00:01.745057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.745087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.745103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.747291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 753, pipe: [1:7561401598453918690:8039]
2025-10-15T11:00:01.745115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:01.747402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 753
2025-10-15T11:00:01.745403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:01.745420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:01.745569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:01.745758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:01.745977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:01.746059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401598453918690:8039], now have 1 active actors on pipe
2025-10-15T11:00:01.746083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401598453918686:8515], now have 1 active actors on pipe
2025-10-15T11:00:01.746106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401598453918619:2467], now have 1 active actors on pipe
2025-10-15T11:00:01.746132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401601253610380:7653]
2025-10-15T11:00:01.746147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401601253610380:7653]
2025-10-15T11:00:01.746161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401601253610380:7653]
2025-10-15T11:00:01.746204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:01.746284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:01.746467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:01.746484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:01.746481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:01.746500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:01.746512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:01.746605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401601253610380:7653]
2025-10-15T11:00:01.746632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:01.746682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:01.751840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:01.751877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:01.751949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:01.751980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:01.751996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:01.752006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:01.752040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:01.752077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:01.752117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:01.757325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:01.757364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:01.757444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:01.757939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 754 partition: 0 MaxSeqNo: 46 sessionId: src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0
2025-10-15T11:00:01.763603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df5c2b1b-a967ef02-762f30b6-2c1a8f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:01.803185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0] Write session: try to update token
2025-10-15T11:00:01.803239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:01.810260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:01.810283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:01.810304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401601253610380:7653]
2025-10-15T11:00:01.810386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:01.810432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:01.812103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:01.813219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:01.814764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:01.816093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:01.817866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:01.818306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:01.888568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:01.888603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:01.888615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:01.888679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:01.888693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:01.888706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:01.888718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:01.888755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401601253610380:7653]
2025-10-15T11:00:01.888784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401601253610380:7653]
2025-10-15T11:00:01.888811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401601253610380:7653]
2025-10-15T11:00:01.888947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:01.888965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:01.889080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:01.889110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:01.889148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:01.893222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:01.927528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId: src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:01.948509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:02.047332Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:02.049081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:02.049120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:02.050371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401598453918690:8039]
2025-10-15T11:00:02.050468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:02.050475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:02.051470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:02.050018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:02.091823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 754 reason: error at write: Disconnected sessionId: src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0
2025-10-15T11:00:02.092111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 754 sessionId: src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0 is DEAD
2025-10-15T11:00:02.094908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:02.095019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0] Write session will restart in 0.005751s
2025-10-15T11:00:02.095122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0] Write session: Do CDS request
2025-10-15T11:00:02.095148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:02.106676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:02.108211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:02.108416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:02.108445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 755
2025-10-15T11:00:02.108809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:02.108753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:02.108908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:02.108932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:02.108944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:02.109543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:02.109572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:02.109610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:02.109838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:02.110027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401605548577777:7657]
2025-10-15T11:00:02.110339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 755 sessionId:  describe result for acl check
2025-10-15T11:00:02.110454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:02.110486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:02.110496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:02.110515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401602748886065:8522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:02.112238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:02.113105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401602748886065:8522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:02.118141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:02.118400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:02.119682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:02.120014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.120034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.120040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.120047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.120054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.120061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.120068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.120075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.120081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.120088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.120095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.120103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.120109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.120116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.120171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.120278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.120327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.120375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.120431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.120486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.120535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.120583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.120634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.120686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.120737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.120787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.120838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.120890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.120934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.121006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.121068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.121127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.121181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.121237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.121286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.121343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.121395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.121455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.121507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.121562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.121616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.121672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.121720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.121778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.121831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.121891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.121940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.121996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.122046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.122100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.122146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.122202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.122250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.122305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.122352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.122406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.121866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401602748886065:8522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:02.122904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:02.134248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401602748886065:8522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:02.134292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401602748886065:8522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:02.134310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401602748886065:8522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:02.134353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:02.142969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:02.150799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401602748886101:8039]
2025-10-15T11:00:02.153283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:02.153327Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:02.153343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:02.153362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:02.153384Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 754 [2:7561401605548577777:7657]
2025-10-15T11:00:02.153454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:02.153510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:02.153524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:02.153536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:02.153547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:02.153590Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:02.153610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:02.153629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:02.177728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.177757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.177778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.177787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:02.178687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 754
2025-10-15T11:00:02.178808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 754
2025-10-15T11:00:02.178884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 754, pipe: [1:7561401602748886101:8039]
2025-10-15T11:00:02.178069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:02.178091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.178232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.178387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.178598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:02.178681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401602748886098:8522], now have 1 active actors on pipe
2025-10-15T11:00:02.178703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401602748886017:2467], now have 1 active actors on pipe
2025-10-15T11:00:02.178727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401602748886101:8039], now have 1 active actors on pipe
2025-10-15T11:00:02.178750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401605548577772:7657]
2025-10-15T11:00:02.178776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401605548577772:7657]
2025-10-15T11:00:02.178789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401605548577772:7657]
2025-10-15T11:00:02.178827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:02.178897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:02.178939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:02.178953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:02.178963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:02.179056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:02.179075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:02.179188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401605548577772:7657]
2025-10-15T11:00:02.179207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:02.179490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:02.180104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:02.180136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:02.180223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:02.180253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:02.180268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:02.180278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:02.180310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:02.180347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:02.180405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:02.181972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:02.181997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:02.182058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:02.182401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 755 partition: 0 MaxSeqNo: 46 sessionId: src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0
2025-10-15T11:00:02.183170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594cf0ea-a6d8a49a-9a48ddf3-fcc5f1c6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:02.220603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0] Write session: try to update token
2025-10-15T11:00:02.220659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:02.254310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:02.263442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:02.263476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:02.263487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:02.263524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401605548577772:7657]
2025-10-15T11:00:02.263550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401605548577772:7657]
2025-10-15T11:00:02.263573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401605548577772:7657]
2025-10-15T11:00:02.263733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:02.263751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:02.263762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:02.263806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:02.263827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:02.267495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:02.267551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:02.267583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:02.273941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:02.356488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId: src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:02.376548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:02.441446Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:02.443753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:02.443794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:02.448091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:02.448051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401602748886101:8039]
2025-10-15T11:00:02.448211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:02.448225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:02.453530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:02.463749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 755 reason: error at write: Disconnected sessionId: src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0
2025-10-15T11:00:02.464116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 755 sessionId: src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0 is DEAD
2025-10-15T11:00:02.470201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:02.470243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0] Write session will restart in 0.009344s
2025-10-15T11:00:02.470349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0] Write session: Do CDS request
2025-10-15T11:00:02.470391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:02.487471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:02.487884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:02.487915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 756
2025-10-15T11:00:02.488351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:02.488472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:02.488488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:02.488497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:02.490088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 756 sessionId:  describe result for acl check
2025-10-15T11:00:02.490207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:02.490218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:02.490228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:02.490247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401602748886138:8527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:02.493498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401602748886138:8527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:02.506927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401602748886138:8527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:02.527361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401602748886138:8527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:02.527404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401602748886138:8527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:02.527424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401602748886138:8527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:02.527459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:02.533499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:02.535861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:02.536694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:02.536714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:02.536757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:02.537019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:02.537215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401605548577891:7666]
2025-10-15T11:00:02.539761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:02.545746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:02.546010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:02.548059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401602748886207:8039]
2025-10-15T11:00:02.547293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:02.547631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.547639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.547645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.547651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.547657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.547663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.547680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.547688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.547694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.547699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.547706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.547712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.547719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.547725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.547770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.547874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.547924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.547969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.548009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.548053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.548095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.548137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.548179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.548223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.548263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.548304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.548345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.548389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.548428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.548488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.548542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.548592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.548633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.548682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.548724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.548771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.548813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.548861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.548905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.548954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.548994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.549043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.549085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.549131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.549175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.549222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.549269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.549317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.549361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.549408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.549451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.549498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.549539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.549588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.549628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.549672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.550123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:02.572245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:02.581717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:02.581759Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:02.581775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:02.581794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:02.581906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 755 [2:7561401605548577891:7666]
2025-10-15T11:00:02.581956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:02.582013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:02.582027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:02.582038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:02.582050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:02.582091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:02.582110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:02.582130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:02.584635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 755, pipe: [1:7561401602748886207:8039]
2025-10-15T11:00:02.584746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 755
2025-10-15T11:00:02.584822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 755
2025-10-15T11:00:02.584088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.584110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.584123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.584133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:02.584387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:02.584402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.584532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.584703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.584915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:02.584989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401602748886207:8039], now have 1 active actors on pipe
2025-10-15T11:00:02.585010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401602748886202:8527], now have 1 active actors on pipe
2025-10-15T11:00:02.585031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401602748886126:2467], now have 1 active actors on pipe
2025-10-15T11:00:02.585054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401605548577885:7666]
2025-10-15T11:00:02.585066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401605548577885:7666]
2025-10-15T11:00:02.585078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401605548577885:7666]
2025-10-15T11:00:02.585117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:02.585180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:02.585329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:02.585342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:02.585351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:02.585353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:02.585368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:02.585469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401605548577885:7666]
2025-10-15T11:00:02.585494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:02.585551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:02.585571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:02.585648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:02.585684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f442f53-592dff1c-62e0778e-a8a9223_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:02.585709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:02.585727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:02.585735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:02.585757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:02.585783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:02.585824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:02.586677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:02.586699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:02.586774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:02.587037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 756 partition: 0 MaxSeqNo: 46 sessionId: src_id|4f442f53-592dff1c-62e0778e-a8a9223_0
2025-10-15T11:00:02.587948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ce987d-59ffb1fc-7792c0d4-a8b832fe_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4f442f53-592dff1c-62e0778e-a8a9223_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:02.619553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f442f53-592dff1c-62e0778e-a8a9223_0] Write session: try to update token
2025-10-15T11:00:02.619620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f442f53-592dff1c-62e0778e-a8a9223_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:02.720544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:02.720570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:02.720580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:02.720631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:02.720644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:02.720655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:02.720664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:02.720691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401605548577885:7666]
2025-10-15T11:00:02.720714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401605548577885:7666]
2025-10-15T11:00:02.720733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401605548577885:7666]
2025-10-15T11:00:02.720906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:02.720925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:02.721963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:02.723433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:02.723478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:02.723508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:02.729797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId: src_id|4f442f53-592dff1c-62e0778e-a8a9223_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:02.769955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:02.856657Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:02.866704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:02.869675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:02.871039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401602748886207:8039]
2025-10-15T11:00:02.871109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:02.871146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:02.871159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:02.869798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:02.869817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:02.869856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401605548577885:7666]
2025-10-15T11:00:02.870210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:02.872181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:02.908950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 756 reason: error at write: Disconnected sessionId: src_id|4f442f53-592dff1c-62e0778e-a8a9223_0
2025-10-15T11:00:02.909215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 756 sessionId: src_id|4f442f53-592dff1c-62e0778e-a8a9223_0 is DEAD
2025-10-15T11:00:02.911671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f442f53-592dff1c-62e0778e-a8a9223_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:02.911702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f442f53-592dff1c-62e0778e-a8a9223_0] Write session will restart in 0.005189s
2025-10-15T11:00:02.911785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f442f53-592dff1c-62e0778e-a8a9223_0] Write session: Do CDS request
2025-10-15T11:00:02.911810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f442f53-592dff1c-62e0778e-a8a9223_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:02.923237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f442f53-592dff1c-62e0778e-a8a9223_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:02.925822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:02.925851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 757
2025-10-15T11:00:02.926163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:02.926254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:02.926266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:02.926274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:02.927297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 757 sessionId:  describe result for acl check
2025-10-15T11:00:02.927399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:02.927410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:02.927418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:02.927431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401602748886287:8538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:02.929819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401602748886287:8538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:02.933718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:02.935794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401602748886287:8538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:02.941109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:02.941848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:02.941874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:02.941907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:02.942139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:02.942304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401605548577997:7674]
2025-10-15T11:00:02.942229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401602748886287:8538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:02.942269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401602748886287:8538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:02.942283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401602748886287:8538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:02.942309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:02.944320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:02.947951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:02.948179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:02.949536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:02.950841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.950863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.950870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.950877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.950884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.950891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.950898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.950905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.950913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.950920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.950927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.950933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.950940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.950947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.950994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.951098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.951146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.951192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.951236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.951289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.951336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.951400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.951444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.951488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.951533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.951589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.951632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.951675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.951721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.951785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:02.951842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.951895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:02.952272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.952340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:02.952385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.952441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:02.952493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.952543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:02.952593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.952651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:02.952700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.952754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:02.952804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.952857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:02.952921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.952974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:02.953016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.953075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:02.953121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.953172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:02.953213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.953264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.953308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.953359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.953404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.953456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.953912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:02.971735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:02.972274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401602748886324:8039]
2025-10-15T11:00:02.988207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:02.988255Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:02.988270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:02.988286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:02.988309Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 756 [2:7561401605548577997:7674]
2025-10-15T11:00:02.988353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:02.988422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:02.988436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:02.988447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:02.988458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:02.988503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:02.988524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:02.988545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:02.990220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.990246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.990260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.990270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:02.990532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:02.990554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:02.990636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:02.991264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 756
2025-10-15T11:00:02.991368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 756
2025-10-15T11:00:02.991434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 756, pipe: [1:7561401602748886324:8039]
2025-10-15T11:00:02.991451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:02.991717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:02.991796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401602748886318:8538], now have 1 active actors on pipe
2025-10-15T11:00:02.991817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401602748886227:2467], now have 1 active actors on pipe
2025-10-15T11:00:02.991838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401602748886324:8039], now have 1 active actors on pipe
2025-10-15T11:00:02.991893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:02.991926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:02.991963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401605548577992:7674]
2025-10-15T11:00:02.991975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401605548577992:7674]
2025-10-15T11:00:02.991988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401605548577992:7674]
2025-10-15T11:00:02.992022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:02.992087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:02.992192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:02.992210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:02.992221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:02.992252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:02.992268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:02.992332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:02.992366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:02.992387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:02.992398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:02.992430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:02.992464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:02.992583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401605548577992:7674]
2025-10-15T11:00:02.992617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:02.992657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:02.993146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:02.993411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:02.993435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:02.993495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:02.993874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 757 partition: 0 MaxSeqNo: 46 sessionId: src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0
2025-10-15T11:00:02.994745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f442f53-592dff1c-62e0778e-a8a9223_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:03.026714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0] Write session: try to update token
2025-10-15T11:00:03.026762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:03.053541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:03.053572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:03.053587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:03.053598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:03.053628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401605548577992:7674]
2025-10-15T11:00:03.053654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401605548577992:7674]
2025-10-15T11:00:03.053677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401605548577992:7674]
2025-10-15T11:00:03.053827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:03.053836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:03.053858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:03.053886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:03.053926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:03.055175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:03.115426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId: src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:03.149148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:03.216568Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:03.218468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:03.218501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:03.221507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:03.221532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:03.221689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:03.245469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:03.245603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401602748886324:8039]
2025-10-15T11:00:03.245661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 757 reason: error at write: Disconnected sessionId: src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0
2025-10-15T11:00:03.245949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 757 sessionId: src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0 is DEAD
2025-10-15T11:00:03.247864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:03.247891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0] Write session will restart in 0.009954s
2025-10-15T11:00:03.247975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0] Write session: Do CDS request
2025-10-15T11:00:03.248002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:03.264263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:03.264291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 758
2025-10-15T11:00:03.264615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:03.267770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:03.267885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:03.267900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:03.267909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:03.269070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 758 sessionId:  describe result for acl check
2025-10-15T11:00:03.269170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:03.269180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:03.269188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:03.269201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401607043853682:8542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:03.271480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401607043853682:8542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:03.276026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:03.277210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401607043853682:8542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:03.279168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:03.279960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:03.279990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:03.280030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:03.280278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:03.280437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401609843545395:7677]
2025-10-15T11:00:03.283503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:03.284578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401607043853682:8542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:03.284613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401607043853682:8542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:03.284628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401607043853682:8542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:03.284653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:03.286627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:03.286863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:03.288006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:03.288316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:03.288332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:03.288338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:03.288345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:03.288351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:03.288359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:03.288364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:03.288370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:03.288376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:03.288382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:03.288389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:03.288395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.288401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.288408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.288453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:03.288549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:03.288590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:03.288629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:03.288671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:03.288711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:03.288753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:03.288795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:03.288837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:03.288880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:03.288921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:03.288962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.289002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.289041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.289083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:03.289139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:03.289188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:03.289235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:03.289276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:03.289319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:03.289357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:03.289415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:03.289463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:03.289510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:03.289548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:03.289609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:03.289653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:03.289700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:03.289737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:03.289783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:03.289827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:03.289873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:03.289909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:03.289957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:03.289996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:03.290055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:03.290098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.290145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.290187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.290235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.290277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.290330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.290804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:03.309126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:03.318713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:03.318751Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:03.318767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:03.318804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:03.318831Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 757 [2:7561401609843545395:7677]
2025-10-15T11:00:03.318879Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:03.318930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:03.318944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:03.318958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:03.318967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:03.319008Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:03.319025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:03.319044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:03.320318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.320340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.320353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.320363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:03.320614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:03.320637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.320772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.320951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.321164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:03.321247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401607043853717:8542], now have 1 active actors on pipe
2025-10-15T11:00:03.321279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401607043853635:2467], now have 1 active actors on pipe
2025-10-15T11:00:03.321300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401609843545390:7677]
2025-10-15T11:00:03.321314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401609843545390:7677]
2025-10-15T11:00:03.321325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401609843545390:7677]
2025-10-15T11:00:03.321360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:03.321404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:03.321418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:03.321421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:03.321429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:03.321573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:03.321589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:03.321692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401609843545390:7677]
2025-10-15T11:00:03.321710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:03.321721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:03.321816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:03.321835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:03.321927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58f1941f-33f7b020-4838b17c-9e933531_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:03.321953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:03.321968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:03.321977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:03.322007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:03.322040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:03.322094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:03.321583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 757
2025-10-15T11:00:03.321611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 757
2025-10-15T11:00:03.324807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:03.324839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:03.324907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:03.325200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 758 partition: 0 MaxSeqNo: 46 sessionId: src_id|58f1941f-33f7b020-4838b17c-9e933531_0
2025-10-15T11:00:03.327961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f1c780-1a2f0f91-833f0d43-2ffa3863_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|58f1941f-33f7b020-4838b17c-9e933531_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:03.347464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401607043853735:8039]
2025-10-15T11:00:03.349768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 757, pipe: [1:7561401607043853735:8039]
2025-10-15T11:00:03.348491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401607043853735:8039], now have 1 active actors on pipe
2025-10-15T11:00:03.354966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f1941f-33f7b020-4838b17c-9e933531_0] Write session: try to update token
2025-10-15T11:00:03.355021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f1941f-33f7b020-4838b17c-9e933531_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:03.422305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:03.422353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:03.422370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:03.422383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:03.422424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401609843545390:7677]
2025-10-15T11:00:03.422453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401609843545390:7677]
2025-10-15T11:00:03.422481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401609843545390:7677]
2025-10-15T11:00:03.422632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:03.422680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:03.422727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:03.422744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:03.422759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:03.422785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:03.422838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:03.422874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:03.424092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:03.478992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId: src_id|58f1941f-33f7b020-4838b17c-9e933531_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:03.503710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:03.578979Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:03.590643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:03.590687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:03.590751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:03.590766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:03.590811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401609843545390:7677]
2025-10-15T11:00:03.591797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401607043853735:8039]
2025-10-15T11:00:03.591867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:03.591996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:03.592011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:03.590947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:03.591633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:03.630292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 758 reason: error at write: Disconnected sessionId: src_id|58f1941f-33f7b020-4838b17c-9e933531_0
2025-10-15T11:00:03.630602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 758 sessionId: src_id|58f1941f-33f7b020-4838b17c-9e933531_0 is DEAD
2025-10-15T11:00:03.631625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f1941f-33f7b020-4838b17c-9e933531_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:03.631688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f1941f-33f7b020-4838b17c-9e933531_0] Write session will restart in 0.005417s
2025-10-15T11:00:03.631839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f1941f-33f7b020-4838b17c-9e933531_0] Write session: Do CDS request
2025-10-15T11:00:03.631891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f1941f-33f7b020-4838b17c-9e933531_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:03.641729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f1941f-33f7b020-4838b17c-9e933531_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:03.643476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:03.643505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 759
2025-10-15T11:00:03.643905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:03.644222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:03.644248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:03.644259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:03.645614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 759 sessionId:  describe result for acl check
2025-10-15T11:00:03.645732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:03.645752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:03.645762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:03.645781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401607043853805:8550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:03.648004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401607043853805:8550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:03.646693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:03.652099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:03.652997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:03.653017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:03.653063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:03.653332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:03.653522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401609843545493:7682]
2025-10-15T11:00:03.655953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:03.656836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:03.657079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:03.658374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:03.658710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:03.658719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:03.658726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:03.658734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:03.658742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:03.658748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:03.658755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:03.658763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:03.658771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:03.658791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:03.658799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:03.658806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.658813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.658819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.658866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:03.658980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:03.659032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:03.659082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:03.659127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:03.659174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:03.659219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:03.659264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:03.659312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:03.659374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:03.659421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:03.659468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.659512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.659557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.659604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:03.659675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:03.659737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:03.659792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:03.659843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:03.659897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:03.660116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401607043853805:8550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:03.659946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:03.659998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:03.660048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:03.660101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:03.660144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:03.660199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:03.660247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:03.660300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:03.660347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:03.660431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:03.660481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:03.660536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:03.660584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:03.660640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:03.660690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:03.660745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:03.660790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.660846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.660892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.660945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.660992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.661050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.661563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:03.673376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401607043853805:8550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:03.673416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401607043853805:8550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:03.673433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401607043853805:8550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:03.673461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:03.681300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:03.689173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:03.689223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:03.689241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:03.689261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:03.689286Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 758 [2:7561401609843545493:7682]
2025-10-15T11:00:03.689342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:03.689405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:03.689422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:03.689435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:03.689446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:03.689499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:03.689532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:03.689557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:03.690437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.690459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.690474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.690486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:03.690720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:03.690746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:03.690908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:03.691673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 758
2025-10-15T11:00:03.691787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 758
2025-10-15T11:00:03.691108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:03.691392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:03.691493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401607043853840:8550], now have 1 active actors on pipe
2025-10-15T11:00:03.691521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401607043853750:2467], now have 1 active actors on pipe
2025-10-15T11:00:03.691548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401609843545488:7682]
2025-10-15T11:00:03.691563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401609843545488:7682]
2025-10-15T11:00:03.691578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401609843545488:7682]
2025-10-15T11:00:03.691618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:03.691697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:03.691876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:03.691894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:03.692020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401609843545488:7682]
2025-10-15T11:00:03.692039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:03.692110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:03.692127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:03.692138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:03.692164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:03.692519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:03.692546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:03.692635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:03.692683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:03.692702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:03.692714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:03.692750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:03.692794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:03.692856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:03.692138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401607043853842:8039]
2025-10-15T11:00:03.694051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 758, pipe: [1:7561401607043853842:8039]
2025-10-15T11:00:03.693904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:03.693944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:03.693992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401607043853842:8039], now have 1 active actors on pipe
2025-10-15T11:00:03.694047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:03.698469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 759 partition: 0 MaxSeqNo: 46 sessionId: src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0
2025-10-15T11:00:03.699261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f1941f-33f7b020-4838b17c-9e933531_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:03.733351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0] Write session: try to update token
2025-10-15T11:00:03.733407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:03.787872Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:03.787911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:03.787945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401609843545488:7682]
2025-10-15T11:00:03.788070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:03.791471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:03.803539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:03.809197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:03.813950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:03.875277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId: src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:03.881397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:03.882910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:03.883344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:03.883385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:03.883396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:03.883529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:03.901375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:03.913490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:03.913534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:03.913570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:03.913580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:03.913592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:03.913601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:03.913627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401609843545488:7682]
2025-10-15T11:00:03.913644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401609843545488:7682]
2025-10-15T11:00:03.913658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401609843545488:7682]
2025-10-15T11:00:03.913806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:03.913826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:03.913833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:03.913874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:03.913906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:03.914698Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:04.055421Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:04.059731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T11:00:04.062453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:04.062779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:04.062968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401607043853842:8039]
2025-10-15T11:00:04.143159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:04.149647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:04.150439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:04.150456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:04.150493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:04.150712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:04.150893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401614138512894:7690]
2025-10-15T11:00:04.153279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:04.154796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:04.154933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:04.155937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:04.156224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:04.156231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:04.156237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:04.156243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:04.156248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:04.156254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:04.156260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:04.156266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:04.156272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:04.156277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:04.156284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:04.156290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.156296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.156302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.156338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:04.156408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:04.156438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:04.156466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:04.156494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:04.156523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:04.156551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:04.156580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:04.156607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:04.156637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:04.156662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:04.156691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.156726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.156765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.156798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:04.156840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:04.156873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:04.156906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:04.156934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:04.156967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:04.156993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:04.157026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:04.157079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:04.157118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:04.157147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:04.157179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:04.157206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:04.157237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:04.157264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:04.157295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:04.157327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:04.157359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:04.157386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:04.157424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:04.157484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:04.157545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:04.157599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.157664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.157710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.157766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.157816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.157869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.158387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:04.162988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401611338821210:8039]
2025-10-15T11:00:04.167452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:04.167483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:04.167567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 759 reason: error at write: Disconnected sessionId: src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0
2025-10-15T11:00:04.167872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 759 sessionId: src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0 is DEAD
2025-10-15T11:00:04.171569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:04.171621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0] Write session will restart in 0.008923s
2025-10-15T11:00:04.171708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0] Write session: Do CDS request
2025-10-15T11:00:04.171733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:04.186117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:04.191603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:04.191638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 760
2025-10-15T11:00:04.195567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:04.195721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:04.195746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:04.195756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:04.197079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 760 sessionId:  describe result for acl check
2025-10-15T11:00:04.197199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:04.197220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:04.197229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:04.197251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401611338821214:8555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:04.199826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401611338821214:8555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:04.206163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:04.212287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401611338821214:8555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:04.220568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401611338821214:8555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:04.220608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401611338821214:8555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:04.220622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401611338821214:8555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:04.220650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:04.230648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:04.230694Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:04.230711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:04.230730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:04.230752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 759 [2:7561401614138512894:7690]
2025-10-15T11:00:04.230816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:04.230876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:04.230890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:04.230902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:04.230912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:04.230955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:04.230976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:04.230995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:04.232380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.232403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.232417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.232428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:04.232677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:04.232692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.232822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.233004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.233225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:04.233286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401614138512888:7690]
2025-10-15T11:00:04.233300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401614138512888:7690]
2025-10-15T11:00:04.233313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401614138512888:7690]
2025-10-15T11:00:04.233350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:04.233416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:04.233583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:04.233599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:04.233701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401614138512888:7690]
2025-10-15T11:00:04.233718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:04.234327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:04.234345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:04.234356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:04.234376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:04.235211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401611338821243:8555], now have 1 active actors on pipe
2025-10-15T11:00:04.235178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 759
2025-10-15T11:00:04.235241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401611338821210:8039], now have 1 active actors on pipe
2025-10-15T11:00:04.235261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401611338821151:2467], now have 1 active actors on pipe
2025-10-15T11:00:04.235175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 759, pipe: [1:7561401611338821210:8039]
2025-10-15T11:00:04.235250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 759
2025-10-15T11:00:04.235595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:04.235621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:04.235685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:04.235714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:04.235731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:04.235740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:04.235773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:04.235806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:04.235844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:04.236451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:04.236471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:04.236527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:04.236803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 760 partition: 0 MaxSeqNo: 46 sessionId: src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0
2025-10-15T11:00:04.237393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|903d6f0c-55ec21ec-7fc3b3fd-f0f05004_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:04.257023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0] Write session: try to update token
2025-10-15T11:00:04.257076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:04.353780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:04.353802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:04.353809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:04.353847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:04.353857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:04.353866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:04.353874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:04.353894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401614138512888:7690]
2025-10-15T11:00:04.353908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401614138512888:7690]
2025-10-15T11:00:04.353923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401614138512888:7690]
2025-10-15T11:00:04.353984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:04.354001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:04.354020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:04.389782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId: src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:04.394152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:04.394194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:04.395499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:04.412162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:04.540642Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:04.552086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:04.552118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:04.552157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401614138512888:7690]
2025-10-15T11:00:04.552285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:04.552307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:04.552583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:04.553275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:04.553317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:04.553708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:04.563164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 760 reason: error at write: Disconnected sessionId: src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0
2025-10-15T11:00:04.563457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 760 sessionId: src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0 is DEAD
2025-10-15T11:00:04.567752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:04.567786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0] Write session will restart in 0.005260s
2025-10-15T11:00:04.567874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0] Write session: Do CDS request
2025-10-15T11:00:04.567906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:04.578941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:04.612166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401611338821210:8039]
2025-10-15T11:00:04.612256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:04.612371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:04.612390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 761
2025-10-15T11:00:04.615563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:04.615692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:04.615706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:04.615715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:04.616931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 761 sessionId:  describe result for acl check
2025-10-15T11:00:04.617047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:04.617068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:04.619434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:04.617077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:04.617093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401611338821335:8568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:04.619798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401611338821335:8568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:04.627151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:04.627999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:04.628018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:04.628214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:04.628475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:04.628664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401614138513017:7698]
2025-10-15T11:00:04.630937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:04.632745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:04.632949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:04.634191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:04.634500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:04.634509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:04.634516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:04.634522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:04.634528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:04.634535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:04.634542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:04.634548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:04.634555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:04.634561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:04.634568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:04.634574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.634581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.634589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.634633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:04.634739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:04.634785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:04.634848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:04.634893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:04.634938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:04.634984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:04.635030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:04.635074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:04.635123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:04.635171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:04.635216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.635263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.635308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.635367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:04.635436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:04.635491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:04.635547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:04.635594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:04.635646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:04.635688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:04.635737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:04.635786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:04.635837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:04.635881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:04.635935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:04.635980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:04.636031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:04.636076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:04.636127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:04.636173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:04.637293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:04.637372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:04.637436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:04.637484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:04.637539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:04.637585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.637636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.637682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.637734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.637777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.637829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.638325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:04.635684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401611338821335:8568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:04.649132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401611338821335:8568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:04.649179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401611338821335:8568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:04.649199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401611338821335:8568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:04.649232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:04.657464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:04.682384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:04.682427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:04.682441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:04.682456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:04.682478Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 760 [2:7561401614138513017:7698]
2025-10-15T11:00:04.682524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:04.682572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:04.682587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:04.682597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:04.682606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:04.682649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:04.682668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:04.682686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:04.684562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.684583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.684595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.684604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:04.684858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:04.684875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:04.685002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:04.685172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:04.685394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:04.685455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401614138513012:7698]
2025-10-15T11:00:04.685468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401614138513012:7698]
2025-10-15T11:00:04.685481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401614138513012:7698]
2025-10-15T11:00:04.685521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:04.685583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:04.685746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:04.685768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:04.685875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401614138513012:7698]
2025-10-15T11:00:04.685893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:04.686417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:04.686437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:04.686449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:04.686472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:04.686907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401611338821368:8568], now have 1 active actors on pipe
2025-10-15T11:00:04.686931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401611338821328:2467], now have 1 active actors on pipe
2025-10-15T11:00:04.687130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 760
2025-10-15T11:00:04.687243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 760
2025-10-15T11:00:04.687860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:04.687910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:04.688016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:04.688048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:04.688062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:04.688070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:04.688112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:04.688231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:04.688292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:04.688858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:04.688886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:04.688956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:04.689213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 761 partition: 0 MaxSeqNo: 46 sessionId: src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0
2025-10-15T11:00:04.690057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7e468b3-ee6dfef1-e3d8b472-a6a23927_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:04.712960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401611338821376:8039], now have 1 active actors on pipe
2025-10-15T11:00:04.712313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401611338821376:8039]
2025-10-15T11:00:04.713434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 760, pipe: [1:7561401611338821376:8039]
2025-10-15T11:00:04.723219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0] Write session: try to update token
2025-10-15T11:00:04.723286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:04.774229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:04.774274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:04.774288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:04.774298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:04.774341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401614138513012:7698]
2025-10-15T11:00:04.774367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401614138513012:7698]
2025-10-15T11:00:04.774389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401614138513012:7698]
2025-10-15T11:00:04.774518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:04.774550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:04.774570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:04.774576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:04.774593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:04.775817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:04.853876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId: src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:04.881648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:04.926486Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:04.928456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:04.928500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:04.929836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:04.929846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:04.929882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:04.930145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401611338821376:8039]
2025-10-15T11:00:04.932506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:04.957628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 761 reason: error at write: Disconnected sessionId: src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0
2025-10-15T11:00:04.958015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 761 sessionId: src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0 is DEAD
2025-10-15T11:00:04.960444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:04.960483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0] Write session will restart in 0.009681s
2025-10-15T11:00:04.960585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0] Write session: Do CDS request
2025-10-15T11:00:04.960617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:04.976518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:04.976553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 762
2025-10-15T11:00:04.980201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:04.980856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:04.981014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:04.981040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:04.981049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:04.982538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 762 sessionId:  describe result for acl check
2025-10-15T11:00:04.982647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:04.982667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:04.982679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:04.982696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401611338821433:8576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:04.985279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401611338821433:8576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:04.991028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401611338821433:8576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:05.000122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:05.002263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401611338821433:8576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:05.002308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401611338821433:8576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:05.002325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401611338821433:8576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:05.002357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:05.005294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:05.006180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:05.006210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:05.006253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:05.006499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:05.006633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401618433480414:7703]
2025-10-15T11:00:05.008151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:05.009112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:05.009289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:05.010448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:05.010763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.010778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.010785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.010792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.010810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.010817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.010824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.010833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.010841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.010849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.010857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.010863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.010871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.010877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.010925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.011039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.011093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.011152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.011200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.011248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.011297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.011343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.011409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.011457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.011499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.011553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.011602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.011649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.011695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.011763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.011825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.011881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.011927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.011982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.012030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.012083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.012134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.012182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.012222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.012261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.012295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.012333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.012365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.012410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.012449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.012500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.012532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.012569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.012611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.012651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.012686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.012733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.012772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.012812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.012843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.012881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.013289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:05.029919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401615633788783:8039]
2025-10-15T11:00:05.041662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:05.050351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:05.050400Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:05.050420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:05.050442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:05.050470Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 761 [2:7561401618433480414:7703]
2025-10-15T11:00:05.050528Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:05.050590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:05.050606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:05.050620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:05.050633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:05.050688Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:05.050713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:05.050739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:05.052981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 761, pipe: [1:7561401615633788783:8039]
2025-10-15T11:00:05.053002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 761
2025-10-15T11:00:05.053106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 761
2025-10-15T11:00:05.052159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.052184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.052201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.052214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:05.052520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:05.052542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.052716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.052938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.053207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:05.053303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401615633788778:8576], now have 1 active actors on pipe
2025-10-15T11:00:05.053330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401611338821393:2467], now have 1 active actors on pipe
2025-10-15T11:00:05.053357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401615633788783:8039], now have 1 active actors on pipe
2025-10-15T11:00:05.053386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401614138513113:7703]
2025-10-15T11:00:05.053402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401614138513113:7703]
2025-10-15T11:00:05.053418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401614138513113:7703]
2025-10-15T11:00:05.053465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:05.053549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:05.053753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:05.053773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:05.053905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401614138513113:7703]
2025-10-15T11:00:05.053926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:05.054412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:05.054428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:05.054440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:05.054467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:05.055058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:05.055093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:05.055190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0675369-47c5e326-b64ddf05-97f671a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:05.055225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:05.055243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:05.055256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:05.055298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:05.055370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:05.055428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:05.056253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:05.056282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:05.056350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:05.056778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 762 partition: 0 MaxSeqNo: 46 sessionId: src_id|c0675369-47c5e326-b64ddf05-97f671a3_0
2025-10-15T11:00:05.057592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de74f69e-e1489160-4daf17f3-7376ba0e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c0675369-47c5e326-b64ddf05-97f671a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:05.087018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0675369-47c5e326-b64ddf05-97f671a3_0] Write session: try to update token
2025-10-15T11:00:05.087071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0675369-47c5e326-b64ddf05-97f671a3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:05.092077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:05.092110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:05.092146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401614138513113:7703]
2025-10-15T11:00:05.092265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:05.092280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:05.094137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:05.095444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:05.096614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:05.102867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:05.105646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:05.106073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:05.151181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:05.151210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:05.151220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:05.179498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:05.179536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:05.179550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:05.179560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:05.179594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401614138513113:7703]
2025-10-15T11:00:05.179617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401614138513113:7703]
2025-10-15T11:00:05.179640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401614138513113:7703]
2025-10-15T11:00:05.179760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:05.179769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:05.179790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:05.179798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:05.179828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:05.183019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:05.206970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId: src_id|c0675369-47c5e326-b64ddf05-97f671a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:05.228837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:05.322830Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:05.324787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:05.324823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:05.325547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:05.325559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:05.325573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:05.325747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401615633788783:8039]
2025-10-15T11:00:05.325490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:05.334653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 762 reason: error at write: Disconnected sessionId: src_id|c0675369-47c5e326-b64ddf05-97f671a3_0
2025-10-15T11:00:05.334960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 762 sessionId: src_id|c0675369-47c5e326-b64ddf05-97f671a3_0 is DEAD
2025-10-15T11:00:05.335956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0675369-47c5e326-b64ddf05-97f671a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:05.335994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0675369-47c5e326-b64ddf05-97f671a3_0] Write session will restart in 0.005205s
2025-10-15T11:00:05.336103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0675369-47c5e326-b64ddf05-97f671a3_0] Write session: Do CDS request
2025-10-15T11:00:05.336138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0675369-47c5e326-b64ddf05-97f671a3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:05.372316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0675369-47c5e326-b64ddf05-97f671a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:05.379622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:05.379652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 763
2025-10-15T11:00:05.379984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:05.380101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:05.380116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:05.380125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:05.381600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 763 sessionId:  describe result for acl check
2025-10-15T11:00:05.381715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:05.381734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:05.381744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:05.381762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401615633788811:8580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:05.384859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401615633788811:8580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:05.393285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401615633788811:8580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:05.400921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401615633788811:8580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:05.400958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401615633788811:8580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:05.400973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401615633788811:8580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:05.400996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:05.406192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:05.409763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:05.410482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:05.410521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:05.410562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:05.410791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:05.410976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401618433480536:7712]
2025-10-15T11:00:05.413031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:05.413999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:05.414273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
E1015 11:00:05.415615758  821071 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:00:05.415678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:05.416076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.416096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.416104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.416111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.416118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.416126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.416132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.416139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.416146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.416153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.416161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.416168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.416175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.416183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.416232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.416349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.416399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.416455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.416510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.416565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.416615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.416670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.416722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.416776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.416829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.416882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.416933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.416985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.417034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.417109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.417177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.417244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.417302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.417363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.417955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.418031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.418099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.418169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.418231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.418291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.418345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.418409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.418462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.418524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.418581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.418642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.418696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.418756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.418821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.418881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.418933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.418995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.419054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.419115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.419167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.420257Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:00:05.419228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.419768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:05.427776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401615633788889:8039]
2025-10-15T11:00:05.437995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:05.454215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:05.454267Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:05.454287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:05.454309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:05.454335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 762 [2:7561401618433480536:7712]
2025-10-15T11:00:05.454392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:05.454457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:05.454473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:05.454486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:05.454498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:05.454552Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:05.454576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:05.454600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:05.456919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.456952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.456969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.456980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:05.457267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:05.457287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.457448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.457650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.457916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:05.457993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401618433480530:7712]
2025-10-15T11:00:05.458009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401618433480530:7712]
2025-10-15T11:00:05.458021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401618433480530:7712]
2025-10-15T11:00:05.458066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:05.458150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:05.458352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:05.458371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:05.458372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:05.458387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:05.458399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:05.458502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401618433480530:7712]
2025-10-15T11:00:05.458522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:05.458616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:05.458760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401615633788889:8039], now have 1 active actors on pipe
2025-10-15T11:00:05.458789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401615633788882:8580], now have 1 active actors on pipe
2025-10-15T11:00:05.458844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401615633788798:2467], now have 1 active actors on pipe
2025-10-15T11:00:05.460731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:05.460771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:05.460878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:05.460917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:05.460936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:05.460948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:05.460991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:05.461043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:05.461097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:05.461840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:05.461866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:05.461938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:05.459961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 762, pipe: [1:7561401615633788889:8039]
2025-10-15T11:00:05.460077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 762
2025-10-15T11:00:05.460143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 762
2025-10-15T11:00:05.462313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 763 partition: 0 MaxSeqNo: 46 sessionId: src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0
2025-10-15T11:00:05.463829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0675369-47c5e326-b64ddf05-97f671a3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:05.523389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0] Write session: try to update token
2025-10-15T11:00:05.523445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:05.616577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:05.616603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:05.616613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:05.616696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:05.616709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:05.616721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:05.616730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:05.616757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401618433480530:7712]
2025-10-15T11:00:05.616778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401618433480530:7712]
2025-10-15T11:00:05.616798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401618433480530:7712]
2025-10-15T11:00:05.619503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:05.619554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:05.619595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:05.632612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:05.632648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:05.633671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:05.702523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId: src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:05.722357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:05.792147Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:05.793974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:05.793991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:05.794033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401618433480530:7712]
2025-10-15T11:00:05.794166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:05.794189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:05.794324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:05.794943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:05.794975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:05.795508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401615633788889:8039]
2025-10-15T11:00:05.795569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:05.794959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:05.810855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 763 reason: error at write: Disconnected sessionId: src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0
2025-10-15T11:00:05.811418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:05.811465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0] Write session will restart in 0.007655s
2025-10-15T11:00:05.811567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0] Write session: Do CDS request
2025-10-15T11:00:05.811597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:05.813952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 763 sessionId: src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0 is DEAD
2025-10-15T11:00:05.824294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:05.830551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:05.830583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 764
2025-10-15T11:00:05.831228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:05.831377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:05.831405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:05.831419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:05.832825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 764 sessionId:  describe result for acl check
2025-10-15T11:00:05.832931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:05.832957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:05.832967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:05.832984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401615633788941:8590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:05.835508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401615633788941:8590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:05.843719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401615633788941:8590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:05.860918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401615633788941:8590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:05.860972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401615633788941:8590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:05.860991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401615633788941:8590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:05.861025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:05.872622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:05.876624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:05.877404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:05.877421Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:05.877459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:05.877683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:05.877856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401618433480650:7720]
2025-10-15T11:00:05.880375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:05.881340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:05.881540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:05.882764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:05.883105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.883114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.883121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.883128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.883134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.883142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.883148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.883155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.883162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.883168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.883176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.883185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.883191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.883198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.883244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.883379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.883430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.883483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.883531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.883579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.883623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.883670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.883720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.883771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.883820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.883864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.883910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.883955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.883997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.884064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:05.884122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.884178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:05.884229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.884283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:05.884328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.884382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:05.884428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.884484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:05.884531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.884584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:05.884636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.884688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:05.884734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.884784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:05.884835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.884889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:05.884931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.884984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:05.885028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.885080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:05.885123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.885177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.885224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.885278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.885322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.885373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.885879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:05.897056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401615633789019:8039]
2025-10-15T11:00:05.906503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:05.916673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:05.916719Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:05.916733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:05.916750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:05.916772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 763 [2:7561401618433480650:7720]
2025-10-15T11:00:05.916819Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:05.916875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:05.916889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:05.916899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:05.916910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:05.916952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:05.916972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:05.916991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:05.918611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.918637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.918651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.918662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:05.918913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:05.918936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:05.919065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:05.919247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:05.919641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:05.919722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401615633789019:8039], now have 1 active actors on pipe
2025-10-15T11:00:05.919752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401615633788916:2467], now have 1 active actors on pipe
2025-10-15T11:00:05.919772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401615633789010:8590], now have 1 active actors on pipe
2025-10-15T11:00:05.919805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401618433480645:7720]
2025-10-15T11:00:05.919819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401618433480645:7720]
2025-10-15T11:00:05.919830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401618433480645:7720]
2025-10-15T11:00:05.919867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:05.919917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:05.919933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:05.919941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:05.919944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:05.920106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:05.920129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:05.920233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401618433480645:7720]
2025-10-15T11:00:05.920215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 763, pipe: [1:7561401615633789019:8039]
2025-10-15T11:00:05.920333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 763
2025-10-15T11:00:05.920419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 763
2025-10-15T11:00:05.920264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:05.920276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:05.921471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:05.921504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:05.921585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8a6773c-5083bc9a-58419c02-aebde117_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:05.921622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:05.921639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:05.921649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:05.921680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:05.921716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:05.921773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:05.922183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:05.922215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:05.922291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:05.922602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 764 partition: 0 MaxSeqNo: 46 sessionId: src_id|c8a6773c-5083bc9a-58419c02-aebde117_0
2025-10-15T11:00:05.923506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|765ea716-cd4fd8ed-de2f9674-d1ae31ac_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c8a6773c-5083bc9a-58419c02-aebde117_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:05.968541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a6773c-5083bc9a-58419c02-aebde117_0] Write session: try to update token
2025-10-15T11:00:05.968595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a6773c-5083bc9a-58419c02-aebde117_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:06.028559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:06.028593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:06.028633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401618433480645:7720]
2025-10-15T11:00:06.028789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:06.028826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:06.028839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:06.028850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:06.028914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:06.030617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:06.032011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:06.040376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:06.047042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:06.048750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:06.096591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId: src_id|c8a6773c-5083bc9a-58419c02-aebde117_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:06.117747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:06.117906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:06.117923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:06.117940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:06.117952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:06.117995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401618433480645:7720]
2025-10-15T11:00:06.118024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401618433480645:7720]
2025-10-15T11:00:06.118050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401618433480645:7720]
2025-10-15T11:00:06.118200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:06.118200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:06.118225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:06.118246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:06.118286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:06.119308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:06.161207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:06.297601Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:06.299116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:06.299150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:06.300201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401615633789019:8039]
2025-10-15T11:00:06.300289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:06.300403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:06.300426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:06.300739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:06.326397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 764 reason: error at write: Disconnected sessionId: src_id|c8a6773c-5083bc9a-58419c02-aebde117_0
2025-10-15T11:00:06.326666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 764 sessionId: src_id|c8a6773c-5083bc9a-58419c02-aebde117_0 is DEAD
2025-10-15T11:00:06.332055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a6773c-5083bc9a-58419c02-aebde117_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:06.332117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a6773c-5083bc9a-58419c02-aebde117_0] Write session will restart in 0.006918s
2025-10-15T11:00:06.332234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a6773c-5083bc9a-58419c02-aebde117_0] Write session: Do CDS request
2025-10-15T11:00:06.332267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a6773c-5083bc9a-58419c02-aebde117_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:06.343778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a6773c-5083bc9a-58419c02-aebde117_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:06.343875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:06.343910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 765
2025-10-15T11:00:06.344532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:06.344692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:06.344720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:06.344731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:06.346483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 765 sessionId:  describe result for acl check
2025-10-15T11:00:06.346615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:06.346636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:06.346647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:06.346667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401619928756374:8599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:06.349587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401619928756374:8599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:06.358597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401619928756374:8599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:06.361749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:06.366871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:06.367707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:06.367740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:06.367776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:06.368011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:06.368205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401622728448061:7725]
2025-10-15T11:00:06.370306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:06.371423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:06.371721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:06.372929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:06.373277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:06.373299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:06.373306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:06.373313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:06.373320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:06.373327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:06.373333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:06.373339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:06.373346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:06.373353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:06.373360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:06.373367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.373373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.373381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.373426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:06.373530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:06.373577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:06.373624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:06.373673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:06.373717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:06.373764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:06.373822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:06.373868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:06.373915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:06.373957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:06.374001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.374046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.374092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.374139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:06.374215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:06.374271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:06.374325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:06.374370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:06.374436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:06.374493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:06.374548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:06.374597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:06.374651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:06.374696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:06.374746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:06.374793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:06.374861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:06.374906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:06.374972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:06.375017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:06.375067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:06.375118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:06.375172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:06.375221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:06.375276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:06.375329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.375402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.375455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.375517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.375567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.375624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.376105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:06.379788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401619928756374:8599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:06.379830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401619928756374:8599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:06.379846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401619928756374:8599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:06.379879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:06.393997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:06.400311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401619928756440:8039]
2025-10-15T11:00:06.403834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:06.403878Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:06.403893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:06.403911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:06.403934Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 764 [2:7561401622728448061:7725]
2025-10-15T11:00:06.403984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:06.404039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:06.404052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:06.404065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:06.404075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:06.404123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:06.404154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:06.404175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:06.405792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 764
2025-10-15T11:00:06.406088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 764, pipe: [1:7561401619928756440:8039]
2025-10-15T11:00:06.406186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 764
2025-10-15T11:00:06.405229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.405255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.405269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.405281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:06.405545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:06.405563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.405705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.405888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.406124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:06.406210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401619928756438:8599], now have 1 active actors on pipe
2025-10-15T11:00:06.406235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401619928756348:2467], now have 1 active actors on pipe
2025-10-15T11:00:06.406258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401619928756440:8039], now have 1 active actors on pipe
2025-10-15T11:00:06.406282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401622728448056:7725]
2025-10-15T11:00:06.406298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401622728448056:7725]
2025-10-15T11:00:06.406311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401622728448056:7725]
2025-10-15T11:00:06.406350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:06.406418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:06.406530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:06.406543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:06.406555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:06.406589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:06.406605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:06.406734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:06.406753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:06.406796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401622728448056:7725]
2025-10-15T11:00:06.406838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:06.406939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:06.406965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:06.406982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:06.406992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:06.407024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:06.407060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:06.407143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:06.407249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:06.411185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:06.411223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:06.411298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:06.412426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a6773c-5083bc9a-58419c02-aebde117_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:06.411618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 765 partition: 0 MaxSeqNo: 46 sessionId: src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0
2025-10-15T11:00:06.456858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0] Write session: try to update token
2025-10-15T11:00:06.456914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:06.468617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:06.468649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:06.468683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401622728448056:7725]
2025-10-15T11:00:06.468774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:06.468793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:06.470434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:06.471585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:06.472743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:06.473909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:06.476225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:06.476661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:06.504663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:06.504712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:06.504732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:06.559679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId: src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:06.585348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:06.585379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:06.585390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:06.585400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:06.585434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401622728448056:7725]
2025-10-15T11:00:06.585459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401622728448056:7725]
2025-10-15T11:00:06.585480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401622728448056:7725]
2025-10-15T11:00:06.585609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:06.585629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:06.586512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:06.586533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:06.586552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:06.584257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:06.586943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:06.670248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T11:00:06.670301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-10-15T11:00:06.724886Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:06.726546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:06.726576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:06.727433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:06.728047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:06.727497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-10-15T11:00:06.727632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401619928756440:8039]
2025-10-15T11:00:06.727705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:06.727716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:06.747924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 765 reason: error at write: Disconnected sessionId: src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0
2025-10-15T11:00:06.753711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 765 sessionId: src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0 is DEAD
2025-10-15T11:00:06.755577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:06.755632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0] Write session will restart in 0.008123s
2025-10-15T11:00:06.755767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0] Write session: Do CDS request
2025-10-15T11:00:06.755802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:06.769405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:06.771721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:06.771754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 766
2025-10-15T11:00:06.772257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:06.772362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:06.772377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:06.772387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:06.774269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 766 sessionId:  describe result for acl check
2025-10-15T11:00:06.774361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:06.774372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:06.774381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:06.774398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401619928756481:8605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:06.776955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401619928756481:8605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:06.802479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401619928756481:8605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:06.819853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:06.820616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401619928756481:8605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:06.820659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401619928756481:8605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:06.820676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401619928756481:8605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:06.820708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:06.823915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:06.824720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:06.824751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:06.824796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:06.825064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:06.825324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401622728448176:7731]
2025-10-15T11:00:06.831134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:06.827430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401619928756556:8039]
2025-10-15T11:00:06.832533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:06.832779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:06.834131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:06.834490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:06.834507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:06.834514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:06.834521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:06.834529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:06.834537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:06.834544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:06.834551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:06.834559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:06.834566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:06.834572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:06.834579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.834587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.834595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.834640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:06.834757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:06.834809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:06.834875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:06.834938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:06.834985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:06.835040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:06.835086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:06.835136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:06.835184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:06.835234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:06.835279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.835326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.835675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.835735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:06.835808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:06.835868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:06.835926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:06.835980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:06.836035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:06.836084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:06.836140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:06.836189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:06.836245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:06.836289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:06.836346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:06.836395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:06.836469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:06.836516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:06.836572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:06.836624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:06.836682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:06.836729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:06.836784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:06.836832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:06.836890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:06.836938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.836995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.837044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.837098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.837144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.837198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.837742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:06.858800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:06.869349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:06.870520Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:06.870555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:06.870574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:06.870599Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 765 [2:7561401622728448176:7731]
2025-10-15T11:00:06.870652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:06.870709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:06.870729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:06.870743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:06.870753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:06.870807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:06.870848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:06.870872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:06.872483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.872514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.872527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.872539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:06.872856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:06.872876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:06.873022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:06.873216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:06.873470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:06.873554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401619928756556:8039], now have 1 active actors on pipe
2025-10-15T11:00:06.873579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401619928756553:8605], now have 1 active actors on pipe
2025-10-15T11:00:06.873602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401619928756465:2467], now have 1 active actors on pipe
2025-10-15T11:00:06.873627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401622728448170:7731]
2025-10-15T11:00:06.873643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401622728448170:7731]
2025-10-15T11:00:06.873656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401622728448170:7731]
2025-10-15T11:00:06.873697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:06.873733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:06.873749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:06.873761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:06.873792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:06.873168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 765, pipe: [1:7561401619928756556:8039]
2025-10-15T11:00:06.873813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:06.873913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:06.873281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 765
2025-10-15T11:00:06.874099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:06.873395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 765
2025-10-15T11:00:06.874117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:06.874300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:06.874335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:06.874353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:06.874364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:06.874404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:06.874446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:06.874586Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:00:06.874664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401622728448170:7731]
2025-10-15T11:00:06.874696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:06.874761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:06.874801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:06.876336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:06.876370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:06.876458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:06.876410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 14 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:00:06.876545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:00:06.877063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 766 partition: 0 MaxSeqNo: 46 sessionId: src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0
2025-10-15T11:00:06.877999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86bb4c7-737b619-5f8ae6cc-988fe2fb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:06.907765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0] Write session: try to update token
2025-10-15T11:00:06.907828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:06.971259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:06.971295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:06.971308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:07.001964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:07.002005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:07.002042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401622728448170:7731]
2025-10-15T11:00:07.002173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:07.003829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:07.008323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:07.009791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:07.011282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:07.016222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:07.018216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:07.024095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:07.089890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId: src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:07.100210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:07.100244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:07.100257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:07.100305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:07.100318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:07.100329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:07.100341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:07.100377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401622728448170:7731]
2025-10-15T11:00:07.100400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401622728448170:7731]
2025-10-15T11:00:07.100422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401622728448170:7731]
2025-10-15T11:00:07.100542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:07.100560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:07.101492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:07.101536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:07.101564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:07.101693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:07.115041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:07.239280Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:07.252571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:07.252620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:07.253869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:07.254957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401619928756556:8039]
2025-10-15T11:00:07.255107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:07.255663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:07.264274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 766 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0
2025-10-15T11:00:07.264625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 766 sessionId: src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0 is DEAD
2025-10-15T11:00:07.267700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:07.267749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0] Write session will restart in 0.005540s
2025-10-15T11:00:07.267948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0] Write session: Do CDS request
2025-10-15T11:00:07.268001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:07.282521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:07.282549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 767
2025-10-15T11:00:07.282926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:07.287959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:07.288094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:07.288109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:07.288118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:07.289432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 767 sessionId:  describe result for acl check
2025-10-15T11:00:07.289543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:07.289553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:07.289561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:07.289576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401624223723900:8611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:07.292137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401624223723900:8611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:07.298234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401624223723900:8611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:07.304313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401624223723900:8611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:07.304351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401624223723900:8611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:07.304369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401624223723900:8611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:07.304396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:07.314642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:07.319069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:07.319949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:07.319983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:07.320022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:07.320247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:07.320421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401627023415600:7739]
2025-10-15T11:00:07.322423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:07.323199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:07.323421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:07.324689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:07.324981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:07.324997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:07.325003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:07.325009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:07.325016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:07.325022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:07.325028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:07.325042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:07.325048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:07.325054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:07.325061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:07.325067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.325074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.325081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.325120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:07.325216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:07.325256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:07.325293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:07.325332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:07.325373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:07.325420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:07.325463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:07.325509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:07.325550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:07.325588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:07.325629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.325672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.325714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.325750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:07.325808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:07.325858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:07.325904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:07.325944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:07.325992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:07.326032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:07.326078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:07.326119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:07.326164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:07.326205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:07.326251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:07.326294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:07.326343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:07.326381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:07.326427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:07.326469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:07.326514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:07.326555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:07.326602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:07.326641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:07.326687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:07.326725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.326767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.326809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.326869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.326907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.326954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.328253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:07.346565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:07.355514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401624223723990:8039]
2025-10-15T11:00:07.364223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:07.364262Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:07.364276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:07.364292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:07.364313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 766 [2:7561401627023415600:7739]
2025-10-15T11:00:07.364358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:07.364408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:07.364420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:07.364431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:07.364440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:07.364482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:07.364500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:07.364519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:07.365974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.365999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.366011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.366022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:07.366279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:07.366302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.366433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.366608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.366852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:07.366927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401627023415595:7739]
2025-10-15T11:00:07.366946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401627023415595:7739]
2025-10-15T11:00:07.366959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401627023415595:7739]
2025-10-15T11:00:07.366996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:07.367063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:07.367235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:07.367251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:07.367379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:07.367392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:07.367403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:07.367496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401627023415595:7739]
2025-10-15T11:00:07.367520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:07.367566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401624223723881:2467], now have 1 active actors on pipe
2025-10-15T11:00:07.367590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401624223723990:8039], now have 1 active actors on pipe
2025-10-15T11:00:07.367612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401624223723940:8611], now have 1 active actors on pipe
2025-10-15T11:00:07.368048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:07.371554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 766
2025-10-15T11:00:07.371635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 766, pipe: [1:7561401624223723990:8039]
2025-10-15T11:00:07.371692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 766
2025-10-15T11:00:07.372048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:07.372090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:07.372160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9848bef-131e0f96-5ef39982-2f718b60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:07.372189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:07.372205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:07.372216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:07.372250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:07.372289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:07.372332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:07.379787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:07.379825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:07.379909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:07.380376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 767 partition: 0 MaxSeqNo: 46 sessionId: src_id|b9848bef-131e0f96-5ef39982-2f718b60_0
2025-10-15T11:00:07.385581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77c38ac-8491e2d0-1328bd69-4e985cf5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b9848bef-131e0f96-5ef39982-2f718b60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:07.424418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9848bef-131e0f96-5ef39982-2f718b60_0] Write session: try to update token
2025-10-15T11:00:07.424477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9848bef-131e0f96-5ef39982-2f718b60_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:07.496912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:07.496952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:07.496965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:07.496975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:07.497008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401627023415595:7739]
2025-10-15T11:00:07.497031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401627023415595:7739]
2025-10-15T11:00:07.497052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401627023415595:7739]
2025-10-15T11:00:07.497155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:07.497197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:07.497225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:07.507718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:07.507750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:07.507762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:07.507812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:07.507836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:07.520175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:07.592236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId: src_id|b9848bef-131e0f96-5ef39982-2f718b60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:07.615535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:07.682774Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:07.706372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:07.706418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:07.706483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:07.706497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:07.706539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401627023415595:7739]
2025-10-15T11:00:07.707100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:07.708226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401624223723990:8039]
2025-10-15T11:00:07.708322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:07.708334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:07.707556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:07.716366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 767 reason: error at write: Disconnected sessionId: src_id|b9848bef-131e0f96-5ef39982-2f718b60_0
2025-10-15T11:00:07.716711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 767 sessionId: src_id|b9848bef-131e0f96-5ef39982-2f718b60_0 is DEAD
2025-10-15T11:00:07.719634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9848bef-131e0f96-5ef39982-2f718b60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:07.719691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9848bef-131e0f96-5ef39982-2f718b60_0] Write session will restart in 0.007652s
2025-10-15T11:00:07.719849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9848bef-131e0f96-5ef39982-2f718b60_0] Write session: Do CDS request
2025-10-15T11:00:07.719891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9848bef-131e0f96-5ef39982-2f718b60_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:07.735722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9848bef-131e0f96-5ef39982-2f718b60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:07.759746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:07.759899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:07.759920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 768
2025-10-15T11:00:07.763765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:07.763926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:07.763948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:07.763958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:07.765238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 768 sessionId:  describe result for acl check
2025-10-15T11:00:07.765343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:07.765361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:07.765370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:07.765386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401624223724042:8621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:07.768427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401624223724042:8621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:07.774700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401624223724042:8621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:07.783095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:07.785144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401624223724042:8621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:07.785181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401624223724042:8621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:07.785197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401624223724042:8621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:07.785223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:07.788709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:07.789576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:07.789595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:07.789639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:07.789877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:07.790044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401627023415710:7747]
2025-10-15T11:00:07.792110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:07.793124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:07.793306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:07.794414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:07.794722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:07.794741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:07.794747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:07.794759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:07.794768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:07.794774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:07.794780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:07.794786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:07.794791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:07.794799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:07.794805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:07.794812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.794818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.794824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.794883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:07.794982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:07.795022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:07.795064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:07.795103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:07.795142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:07.795186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:07.795228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:07.795266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:07.795307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:07.795367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:07.795405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.795442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.795480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.795518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:07.795574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:07.795634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:07.795682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:07.795722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:07.795767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:07.795804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:07.795850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:07.795901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:07.795951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:07.795989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:07.796035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:07.796075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:07.796130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:07.796172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:07.796232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:07.796275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:07.796326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:07.796373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:07.796424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:07.796470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:07.796522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:07.796565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.796610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.796655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.796706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.796748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.796798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.797269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:07.807377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401624223724122:8039]
2025-10-15T11:00:07.814192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:07.823623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:07.823668Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:07.823685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:07.823703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:07.823727Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 767 [2:7561401627023415710:7747]
2025-10-15T11:00:07.823771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:07.823822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:07.823836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:07.823848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:07.823858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:07.823898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:07.823919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:07.823937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:07.825142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.825175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.825189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.825202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:07.825524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:07.825552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:07.825938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 767
2025-10-15T11:00:07.826032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 767
2025-10-15T11:00:07.826044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 767, pipe: [1:7561401624223724122:8039]
2025-10-15T11:00:07.825830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:07.826089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:07.826341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:07.826438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401624223724026:2467], now have 1 active actors on pipe
2025-10-15T11:00:07.826467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401624223724116:8621], now have 1 active actors on pipe
2025-10-15T11:00:07.826492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401624223724122:8039], now have 1 active actors on pipe
2025-10-15T11:00:07.826558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:07.826587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:07.826626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401627023415697:7747]
2025-10-15T11:00:07.826646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401627023415697:7747]
2025-10-15T11:00:07.826660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401627023415697:7747]
2025-10-15T11:00:07.826703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:07.826806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:07.827131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:07.827164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:07.827240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:07.827278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:07.827302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:07.827315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:07.827377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:07.827425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:07.827567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401627023415697:7747]
2025-10-15T11:00:07.827587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:07.827634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:07.827724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:07.827747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:07.827765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:07.827816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:07.828438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:07.828472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:07.828550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:07.831828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9848bef-131e0f96-5ef39982-2f718b60_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:07.829252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 768 partition: 0 MaxSeqNo: 46 sessionId: src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0
2025-10-15T11:00:07.851643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0] Write session: try to update token
2025-10-15T11:00:07.851713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:07.902305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:07.902341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:07.902380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401627023415697:7747]
2025-10-15T11:00:07.902479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:07.902511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:07.905262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:07.913076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:07.915038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:07.920688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:07.922260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:07.922582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:07.924037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:07.924065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:07.924083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:07.971898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId: src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:07.997916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:07.997954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:07.997968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:07.997980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:07.998019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401627023415697:7747]
2025-10-15T11:00:07.998185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401627023415697:7747]
2025-10-15T11:00:07.998220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401627023415697:7747]
2025-10-15T11:00:07.998357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:07.998383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:07.998523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:07.998555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:07.998584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:07.999815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:08.003771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:08.139584Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:08.140948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:08.140977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:08.143666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:08.143878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:08.143899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:08.142568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:08.147934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401624223724122:8039]
2025-10-15T11:00:08.159125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:08.159183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0] Write session will restart in 0.008272s
2025-10-15T11:00:08.159330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0] Write session: Do CDS request
2025-10-15T11:00:08.159383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:08.158263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 768 reason: error at write: Disconnected sessionId: src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0
2025-10-15T11:00:08.158539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 768 sessionId: src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0 is DEAD
2025-10-15T11:00:08.172504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:08.172451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:08.172483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 769
2025-10-15T11:00:08.172996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:08.173242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:08.173295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:08.173316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:08.175043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 769 sessionId:  describe result for acl check
2025-10-15T11:00:08.175202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:08.175239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:08.175256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:08.175292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401628518691447:8628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:08.178919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401628518691447:8628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:08.185163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401628518691447:8628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:08.207798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401628518691447:8628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:08.207835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401628518691447:8628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:08.207851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401628518691447:8628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:08.207880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:08.208735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:08.213203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:08.213908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:08.213939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:08.213980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:08.214171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:08.214324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401631318383107:7751]
2025-10-15T11:00:08.216233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:08.217271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:08.217456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:08.218406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:08.218641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:08.218656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:08.218664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:08.218669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:08.218673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:08.218679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:08.218682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:08.218687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:08.218691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:08.218695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:08.218700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:08.218704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.218708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.218713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.218747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:08.218834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:08.218887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:08.218931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:08.218974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:08.219005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:08.219037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:08.219068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:08.219115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:08.219157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:08.219200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:08.219250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.219297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.219344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.219405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:08.219465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:08.219525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:08.219585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:08.219633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:08.219693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:08.219742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:08.219795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:08.219842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:08.219896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:08.219942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:08.219997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:08.220045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:08.220097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:08.220130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:08.220178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:08.220215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:08.220253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:08.220288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:08.220326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:08.220359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:08.220401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:08.220440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.220480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.220512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.220548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.220580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.220617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.221209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:08.237393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:08.246278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:08.246314Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:08.246328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:08.246341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:08.246359Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 768 [2:7561401631318383107:7751]
2025-10-15T11:00:08.246393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:08.246431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:08.246440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:08.246448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:08.246454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:08.246484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:08.246499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:08.246514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:08.247320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.247342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.247430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.247444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:08.248112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 768
2025-10-15T11:00:08.248222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 768
2025-10-15T11:00:08.248271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401628518691533:8039]
2025-10-15T11:00:08.248695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 768, pipe: [1:7561401628518691533:8039]
2025-10-15T11:00:08.247650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:08.247673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.247798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.247968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.248179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:08.248248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401628518691526:8628], now have 1 active actors on pipe
2025-10-15T11:00:08.248270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401628518691431:2467], now have 1 active actors on pipe
2025-10-15T11:00:08.248292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401631318383100:7751]
2025-10-15T11:00:08.248303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401631318383100:7751]
2025-10-15T11:00:08.248314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401631318383100:7751]
2025-10-15T11:00:08.248342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:08.248386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:08.248394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:08.248401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:08.248403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:08.248562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:08.248576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:08.248624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:08.248642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:08.248766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401628518691533:8039], now have 1 active actors on pipe
2025-10-15T11:00:08.248782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401631318383100:7751]
2025-10-15T11:00:08.248811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:08.248816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:08.248872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:08.248899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:08.248914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:08.248924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:08.248952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:08.248983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:08.249107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:08.250610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:08.250629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:08.250686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:08.250952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 769 partition: 0 MaxSeqNo: 46 sessionId: src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0
2025-10-15T11:00:08.252395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0520da-eef31827-17fb8f6-de3b0a4e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:08.272426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0] Write session: try to update token
2025-10-15T11:00:08.272481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:08.384569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:08.384605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:08.384619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:08.384631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:08.384664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401631318383100:7751]
2025-10-15T11:00:08.384690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401631318383100:7751]
2025-10-15T11:00:08.384714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401631318383100:7751]
2025-10-15T11:00:08.384862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:08.384872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:08.384883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:08.384894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:08.384912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:08.384943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:08.384983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:08.385002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:08.385940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:08.415464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId: src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:08.436809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:08.534191Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:08.554070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:08.554117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:08.554179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:08.554194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:08.554232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401631318383100:7751]
2025-10-15T11:00:08.554448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:08.554826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:08.554907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401628518691533:8039]
2025-10-15T11:00:08.555017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:08.555031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:08.557770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:08.564653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 769 reason: error at write: Disconnected sessionId: src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0
2025-10-15T11:00:08.565044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 769 sessionId: src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0 is DEAD
2025-10-15T11:00:08.567750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:08.567780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0] Write session will restart in 0.006740s
2025-10-15T11:00:08.567850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0] Write session: Do CDS request
2025-10-15T11:00:08.567870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:08.579035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:08.579067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 770
2025-10-15T11:00:08.579552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:08.580089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:08.580222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:08.580249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:08.580260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:08.581651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 770 sessionId:  describe result for acl check
2025-10-15T11:00:08.581765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:08.581782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:08.581791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:08.581805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401628518691567:8633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:08.584267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401628518691567:8633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:08.606097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401628518691567:8633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:08.620920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401628518691567:8633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:08.620964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401628518691567:8633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:08.620982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401628518691567:8633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:08.621012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:08.630371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:08.632877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:08.633709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:08.633742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:08.633787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:08.634040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:08.634225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401631318383232:7760]
2025-10-15T11:00:08.636476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:08.637379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:08.637591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:08.638830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:08.639180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:08.639201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:08.639208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:08.639214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:08.639221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:08.639228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:08.639235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:08.639241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:08.639249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:08.639256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:08.639263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:08.639269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.639276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.639282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.639329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:08.639461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:08.639510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:08.639559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:08.639608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:08.639655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:08.639713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:08.639764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:08.639811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:08.639865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:08.639914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:08.639966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.640019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.640070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.640120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:08.640195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:08.640258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:08.640318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:08.640372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:08.640432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:08.640485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:08.640549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:08.640599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:08.640659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:08.640709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:08.640768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:08.640821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:08.640882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:08.640934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:08.640994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:08.641049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:08.641106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:08.641156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:08.641216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:08.641268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:08.641328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:08.641377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.641437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.641525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.641595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.641640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.641696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.642206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:08.655493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401628518691654:8039]
2025-10-15T11:00:08.662695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:08.678921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:08.678955Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:08.678966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:08.678982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:08.679004Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 769 [2:7561401631318383232:7760]
2025-10-15T11:00:08.679045Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:08.679099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:08.679114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:08.679127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:08.679138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:08.679196Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:08.679221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:08.679244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:08.680859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.680882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.680896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.680909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:08.681135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:08.681152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:08.681256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:08.681398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:08.681566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:08.681624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401631318383227:7760]
2025-10-15T11:00:08.681640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401631318383227:7760]
2025-10-15T11:00:08.681650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401631318383227:7760]
2025-10-15T11:00:08.681680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:08.681732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:08.681876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:08.681892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:08.681989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401631318383227:7760]
2025-10-15T11:00:08.682001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:08.682278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:08.682286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:08.682295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:08.682311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:08.683358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401628518691646:8633], now have 1 active actors on pipe
2025-10-15T11:00:08.683387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401628518691557:2467], now have 1 active actors on pipe
2025-10-15T11:00:08.683404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401628518691654:8039], now have 1 active actors on pipe
2025-10-15T11:00:08.683441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:08.683458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:08.683525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:08.683550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:08.683563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:08.683571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:08.683599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:08.683633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:08.683680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:08.682620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 769
2025-10-15T11:00:08.682705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 769
2025-10-15T11:00:08.684936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:08.684967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:08.685049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:08.684159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 769, pipe: [1:7561401628518691654:8039]
2025-10-15T11:00:08.685438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 770 partition: 0 MaxSeqNo: 46 sessionId: src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0
2025-10-15T11:00:08.687905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|564cb49-b3ae2c8-cb40a379-e8a365ee_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:08.720183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0] Write session: try to update token
2025-10-15T11:00:08.720248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:08.807583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:08.807615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:08.807626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:08.807635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:08.807666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401631318383227:7760]
2025-10-15T11:00:08.807689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401631318383227:7760]
2025-10-15T11:00:08.807712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401631318383227:7760]
2025-10-15T11:00:08.807831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:08.807871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:08.807908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:08.807936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:08.807949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:08.807959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:08.808006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:08.808034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:08.809057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:08.821769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId: src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:08.845582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:08.959301Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:08.970851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:08.970932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:08.971019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:08.971036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:08.971081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401631318383227:7760]
2025-10-15T11:00:08.971288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:08.972648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401628518691654:8039]
2025-10-15T11:00:08.972776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:08.972789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:08.972144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:09.025116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:09.025265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 770 reason: error at write: Disconnected sessionId: src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0
2025-10-15T11:00:09.025601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 770 sessionId: src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0 is DEAD
2025-10-15T11:00:09.027930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:09.027964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0] Write session will restart in 0.007741s
2025-10-15T11:00:09.028067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0] Write session: Do CDS request
2025-10-15T11:00:09.028096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:09.038682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:09.041141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:09.042752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:09.042757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:09.042787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 771
2025-10-15T11:00:09.043258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:09.043419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:09.043450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:09.043462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:09.043678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:09.043710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:09.043754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:09.044038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:09.044238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401635613350650:7768]
2025-10-15T11:00:09.044796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 771 sessionId:  describe result for acl check
2025-10-15T11:00:09.044909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:09.044925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:09.044936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:09.044955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401632813659045:8644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:09.046568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:09.047910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401632813659045:8644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:09.050904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:09.051173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:09.054341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401632813659045:8644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:09.052603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:09.052997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.053007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.053015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.053023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.053032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.053041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.053049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.053056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.053065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.053073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.053081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.053089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.053096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.053104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.053156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.053280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.053332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.053391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.053461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.053513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.053564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.053611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.053662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.053723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.053773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.053822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.053873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.053925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.053972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.054045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.054108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.054169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.054223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.054282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.054332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.054392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.054449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.054509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.054558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.054616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.054667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.054726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.054777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.054839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.054909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.056075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.056162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.056346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.056409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.056471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.056521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.056580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.056633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.056690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.056743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.056818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.057390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:09.071182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401632813659045:8644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:09.071229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401632813659045:8644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:09.071248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401632813659045:8644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:09.071285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:09.071968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401632813659077:8039]
2025-10-15T11:00:09.083134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:09.092491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:09.092540Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:09.092560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:09.092579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:09.092608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 770 [2:7561401635613350650:7768]
2025-10-15T11:00:09.092664Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:09.092729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:09.092743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:09.092757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:09.092769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:09.092822Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:09.092856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:09.092880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:09.094598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.094625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.094641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.094653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:09.094989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:09.095042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.095498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 770, pipe: [1:7561401632813659077:8039]
2025-10-15T11:00:09.095216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.095618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 770
2025-10-15T11:00:09.095450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.095712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 770
2025-10-15T11:00:09.095689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:09.095795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401632813659076:8644], now have 1 active actors on pipe
2025-10-15T11:00:09.095821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401632813659077:8039], now have 1 active actors on pipe
2025-10-15T11:00:09.095846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401632813659038:2467], now have 1 active actors on pipe
2025-10-15T11:00:09.095873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401635613350644:7768]
2025-10-15T11:00:09.095888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401635613350644:7768]
2025-10-15T11:00:09.095902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401635613350644:7768]
2025-10-15T11:00:09.095945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:09.096026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:09.096030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:09.096042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:09.096054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:09.096239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:09.096264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:09.096357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:09.096385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:09.096531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401635613350644:7768]
2025-10-15T11:00:09.096564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:09.096653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35244afd-a4bf96c7-ed575152-ea578675_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:09.096690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:09.096710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:09.096721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:09.096759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:09.096805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:09.096932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:09.097029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:09.099883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:09.099915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:09.100005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:09.100492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 771 partition: 0 MaxSeqNo: 46 sessionId: src_id|35244afd-a4bf96c7-ed575152-ea578675_0
2025-10-15T11:00:09.101374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fc6e2bd-d15d9f57-25c031ed-1b9a2611_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|35244afd-a4bf96c7-ed575152-ea578675_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:09.156888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35244afd-a4bf96c7-ed575152-ea578675_0] Write session: try to update token
2025-10-15T11:00:09.156957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35244afd-a4bf96c7-ed575152-ea578675_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:09.237054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId: src_id|35244afd-a4bf96c7-ed575152-ea578675_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:09.270053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:09.270102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:09.270120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:09.270201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:09.270227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:09.270256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:09.270278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:09.270330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401635613350644:7768]
2025-10-15T11:00:09.270372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401635613350644:7768]
2025-10-15T11:00:09.270407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401635613350644:7768]
2025-10-15T11:00:09.270553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:09.270611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:09.270643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:09.270653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:09.270677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:09.271689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:09.274875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:09.420893Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:09.444332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:09.444389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:09.444468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:09.444483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:09.444531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401635613350644:7768]
2025-10-15T11:00:09.444880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:09.445584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:09.445742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:09.445757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:09.447802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401632813659077:8039]
2025-10-15T11:00:09.453248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:09.498806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 771 reason: error at write: Disconnected sessionId: src_id|35244afd-a4bf96c7-ed575152-ea578675_0
2025-10-15T11:00:09.499201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 771 sessionId: src_id|35244afd-a4bf96c7-ed575152-ea578675_0 is DEAD
2025-10-15T11:00:09.499906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35244afd-a4bf96c7-ed575152-ea578675_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:09.499969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35244afd-a4bf96c7-ed575152-ea578675_0] Write session will restart in 0.009053s
2025-10-15T11:00:09.500140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35244afd-a4bf96c7-ed575152-ea578675_0] Write session: Do CDS request
2025-10-15T11:00:09.500192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35244afd-a4bf96c7-ed575152-ea578675_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:09.516818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35244afd-a4bf96c7-ed575152-ea578675_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:09.519490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:09.519523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 772
2025-10-15T11:00:09.523497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:09.523659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:09.523675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:09.523685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:09.523851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:09.525023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 772 sessionId:  describe result for acl check
2025-10-15T11:00:09.525145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:09.525157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:09.525166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:09.525185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401632813659174:8653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:09.530363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:09.531310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:09.531331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:09.531400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:09.531708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:09.531891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401635613350773:7773]
2025-10-15T11:00:09.534026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:09.532311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401632813659174:8653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:09.537020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:09.537335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:09.538697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:09.539106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.539116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.539124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.539131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.539139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.539147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.539155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.539162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.539170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.539178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.539186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.539193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.539200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.539207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.539260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.539413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.539469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.539522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.539575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.539625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.539673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.539723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.539774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.539824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.539873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.539923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.539972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.540021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.540074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.540149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.540215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.540289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.540340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.540397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.540445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.543667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401632813659187:8039]
2025-10-15T11:00:09.540499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.540553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.540611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.540658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.540714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.540762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.540822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.540876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.540932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.540984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.541043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.541090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.541147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.541199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.541255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.541303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.541363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.541412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.541472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.541524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.541579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.542154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:09.553065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401632813659174:8653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:09.566736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401632813659174:8653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:09.566776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401632813659174:8653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:09.566795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401632813659174:8653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:09.566829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:09.572728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:09.610633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:09.610695Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:09.610716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:09.610738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:09.610765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 771 [2:7561401635613350773:7773]
2025-10-15T11:00:09.610824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:09.610905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:09.610922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:09.610936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:09.610949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:09.611004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:09.611037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:09.613983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 771
2025-10-15T11:00:09.614013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 771, pipe: [1:7561401632813659187:8039]
2025-10-15T11:00:09.614082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 771
2025-10-15T11:00:09.611063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:09.613142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.613160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.613176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.613189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:09.613486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:09.613506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.613668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.613877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.614123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:09.614210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401632813659222:8653], now have 1 active actors on pipe
2025-10-15T11:00:09.614235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401632813659187:8039], now have 1 active actors on pipe
2025-10-15T11:00:09.614260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401632813659107:2467], now have 1 active actors on pipe
2025-10-15T11:00:09.614287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401635613350768:7773]
2025-10-15T11:00:09.614305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401635613350768:7773]
2025-10-15T11:00:09.614319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401635613350768:7773]
2025-10-15T11:00:09.614365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:09.614404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:09.614431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:09.614443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:09.614446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:09.614639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:09.614660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:09.614817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:09.614840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:09.614906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401635613350768:7773]
2025-10-15T11:00:09.614938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:09.614982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:09.615056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:09.615089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:09.615108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:09.615119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:09.615157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:09.615200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:09.615288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:09.616177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:09.616211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:09.616283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:09.616704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 772 partition: 0 MaxSeqNo: 46 sessionId: src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0
2025-10-15T11:00:09.623520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35244afd-a4bf96c7-ed575152-ea578675_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 522 BytesWritten: 103628882 MessagesWritten: 46 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-15T11:00:09.623663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35244afd-a4bf96c7-ed575152-ea578675_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:09.654455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0] Write session: try to update token
2025-10-15T11:00:09.654525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:09.730972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:09.731007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:09.731018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:09.731028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:09.731059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401635613350768:7773]
2025-10-15T11:00:09.731084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401635613350768:7773]
2025-10-15T11:00:09.731106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401635613350768:7773]
2025-10-15T11:00:09.731240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:09.731289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:09.731290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:09.731307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:09.731317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:09.731320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:09.751915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:09.751959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:09.756133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:09.785511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId: src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:09.805756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:09.905019Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:09.906976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:09.907006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:09.907057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401635613350768:7773]
2025-10-15T11:00:09.907177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:09.907217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:09.907251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:09.907851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401632813659187:8039]
2025-10-15T11:00:09.907906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:09.907926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:09.907959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:09.907921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:09.942006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 772 reason: error at write: Disconnected sessionId: src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0
2025-10-15T11:00:09.942356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 772 sessionId: src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0 is DEAD
2025-10-15T11:00:09.945397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:09.945439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0] Write session will restart in 0.007933s
2025-10-15T11:00:09.945541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0] Write session: Do CDS request
2025-10-15T11:00:09.945570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:09.958554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:09.958583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 773
2025-10-15T11:00:09.958784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:09.959493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:09.959747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:09.959786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:09.959803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:09.962314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 773 sessionId:  describe result for acl check
2025-10-15T11:00:09.962509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:09.962529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:09.962553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:09.962584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401632813659301:8664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:09.965830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401632813659301:8664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:09.974150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:09.975985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401632813659301:8664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:09.983881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:09.984765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:09.984783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:09.984825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:09.985091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:09.985270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401635613350891:7782]
2025-10-15T11:00:09.987681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:09.988434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401632813659301:8664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:09.988480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401632813659301:8664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:09.988498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401632813659301:8664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:09.988529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:09.988824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:09.989060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:09.990343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:09.990677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.990686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.990694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.990701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.990709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.990716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.990724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.990730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.990736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.990742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.990750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.990756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.990763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.990770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.990818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.990954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.991003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.991049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.991097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.991144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.991188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.991234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.991279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.991328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.991392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.991439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.991482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.991540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.991589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.991656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:09.991715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.991772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:09.991822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.991877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:09.991920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.991973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:09.992020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.992074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:09.992120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.992174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:09.992224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.992277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:09.992325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.992377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:09.992425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.992481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:09.992527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.992582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:09.992628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.992681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:09.992725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.992780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:09.992827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.992880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:09.992926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.992977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:09.993484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:10.011518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401637108626638:8039]
2025-10-15T11:00:10.020917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:10.031097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:10.031141Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:10.031161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:10.031179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:10.031205Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 772 [2:7561401635613350891:7782]
2025-10-15T11:00:10.031258Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:10.031318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:10.031333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:10.031567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:10.031594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:10.031647Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:10.031670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:10.031692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:10.042468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.042504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.042516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.042527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:10.042798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:10.042830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.042987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.043178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.043332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 772
2025-10-15T11:00:10.043392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 772
2025-10-15T11:00:10.043439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 772, pipe: [1:7561401637108626638:8039]
2025-10-15T11:00:10.043521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:10.043616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401632813659240:2467], now have 1 active actors on pipe
2025-10-15T11:00:10.043649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401632813659338:8664], now have 1 active actors on pipe
2025-10-15T11:00:10.043672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401637108626638:8039], now have 1 active actors on pipe
2025-10-15T11:00:10.043735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:10.043755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:10.043792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401635613350886:7782]
2025-10-15T11:00:10.043807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401635613350886:7782]
2025-10-15T11:00:10.043820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401635613350886:7782]
2025-10-15T11:00:10.043857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:10.043901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:10.043915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:10.043926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:10.043933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:10.044116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:10.044133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:10.044203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:10.044235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:10.044257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:10.044267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:10.044306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:10.044351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:10.044481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401635613350886:7782]
2025-10-15T11:00:10.044514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:10.044561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:10.044583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:10.045981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:10.046015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:10.046104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:10.046508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 773 partition: 0 MaxSeqNo: 46 sessionId: src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0
2025-10-15T11:00:10.047449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b7c285d-2a5e14fa-895c2241-cb6ca22a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:10.084874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:10.084912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:10.084953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401635613350886:7782]
2025-10-15T11:00:10.085086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:10.085095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:10.092010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0] Write session: try to update token
2025-10-15T11:00:10.092073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:10.097096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:10.104655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:10.111974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:10.120415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:10.128619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:10.129208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:10.130739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:10.130761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:10.130772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:10.184587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:10.184620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:10.184634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:10.184647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:10.184686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401635613350886:7782]
2025-10-15T11:00:10.184713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401635613350886:7782]
2025-10-15T11:00:10.184738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401635613350886:7782]
2025-10-15T11:00:10.184832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:10.184880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:10.184885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:10.184905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:10.184914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:10.188933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:10.212933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId: src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:10.234092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:10.334143Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:10.336561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:10.336604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:10.337289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:10.337165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401637108626638:8039]
2025-10-15T11:00:10.337293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:10.337305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:10.364893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:10.365997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:10.366060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0] Write session will restart in 0.006334s
2025-10-15T11:00:10.366226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0] Write session: Do CDS request
2025-10-15T11:00:10.366271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:10.365033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 773 reason: error at write: Disconnected sessionId: src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0
2025-10-15T11:00:10.365368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 773 sessionId: src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0 is DEAD
2025-10-15T11:00:10.384122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:10.387061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:10.387094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 774
2025-10-15T11:00:10.388101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:10.388222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:10.388240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:10.388249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:10.389917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 774 sessionId:  describe result for acl check
2025-10-15T11:00:10.390025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:10.390034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:10.390043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:10.390059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401637108626723:8674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:10.392774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401637108626723:8674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:10.400838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401637108626723:8674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:10.405928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:10.412126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:10.413020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:10.413040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:10.413083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:10.413361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:10.413553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401639908318323:7790]
2025-10-15T11:00:10.415763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:10.416943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401637108626723:8674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:10.416984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401637108626723:8674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:10.417002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401637108626723:8674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:10.417033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:10.416844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:10.417082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:10.418536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:10.418903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:10.418912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:10.418921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:10.418929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:10.418936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:10.418944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:10.418953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:10.418961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:10.418968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:10.418976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:10.418985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:10.418992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.419000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.419007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.419057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:10.419170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:10.419221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:10.419269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:10.419317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:10.419388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:10.419437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:10.419484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:10.419532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:10.419577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:10.419622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:10.419668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.419715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.419765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.419809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:10.419877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:10.419936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:10.419982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:10.420012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:10.420048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:10.420077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:10.420114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:10.420144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:10.420180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:10.420213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:10.420246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:10.420276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:10.420314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:10.420343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:10.420379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:10.420408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:10.420444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:10.420472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:10.420509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:10.420539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:10.420574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:10.420603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.420638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.420668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.420703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.420730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.420773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.421151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:10.437512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401637108626767:8039]
2025-10-15T11:00:10.451814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:10.462053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:10.462104Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:10.462123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:10.462142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:10.462169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 773 [2:7561401639908318323:7790]
2025-10-15T11:00:10.462223Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:10.462285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:10.462300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:10.462314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:10.462327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:10.462380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:10.462403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:10.462427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:10.464643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.464675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.464688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.464700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:10.464997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:10.465017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.465165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.465360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.465624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:10.465704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401639908318317:7790]
2025-10-15T11:00:10.465721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401639908318317:7790]
2025-10-15T11:00:10.465734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401639908318317:7790]
2025-10-15T11:00:10.465780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:10.465860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:10.465897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:10.465915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:10.465928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:10.466053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:10.466071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:10.466201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401639908318317:7790]
2025-10-15T11:00:10.466224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:10.466259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:10.466318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401637108626767:8039], now have 1 active actors on pipe
2025-10-15T11:00:10.466343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401637108626763:8674], now have 1 active actors on pipe
2025-10-15T11:00:10.466374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401637108626679:2467], now have 1 active actors on pipe
2025-10-15T11:00:10.466639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 773, pipe: [1:7561401637108626767:8039]
2025-10-15T11:00:10.466750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 773
2025-10-15T11:00:10.466830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 773
2025-10-15T11:00:10.468285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:10.468330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:10.468424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:10.468462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:10.468487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:10.468500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:10.468540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:10.468600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:10.468656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:10.473934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:10.473990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:10.474091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:10.477600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 774 partition: 0 MaxSeqNo: 46 sessionId: src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0
2025-10-15T11:00:10.478636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd65057c-8f3d0119-83a19a1b-d7f1c01b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:10.520832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0] Write session: try to update token
2025-10-15T11:00:10.520895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:10.638882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:10.638932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:10.638945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:10.639070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:10.639085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:10.639098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:10.639109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:10.639142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401639908318317:7790]
2025-10-15T11:00:10.639169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401639908318317:7790]
2025-10-15T11:00:10.639195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401639908318317:7790]
2025-10-15T11:00:10.639373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:10.639410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:10.639438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:10.668896Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 7 CurrentSessionLifetimeMs: 361961 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T11:00:10.676652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:10.676696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:10.683320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:10.688209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId: src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:10.711244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:10.838141Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:10.839916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:10.839945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:10.839997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401639908318317:7790]
2025-10-15T11:00:10.840150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:10.840149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:10.840185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:10.840781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:10.840729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401637108626767:8039]
2025-10-15T11:00:10.840814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:10.840821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:10.843527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:10.900058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 774 reason: error at write: Disconnected sessionId: src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0
2025-10-15T11:00:10.900384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 774 sessionId: src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0 is DEAD
2025-10-15T11:00:10.904020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:10.904061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0] Write session will restart in 0.008036s
2025-10-15T11:00:10.904169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0] Write session: Do CDS request
2025-10-15T11:00:10.904198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:10.911572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:10.919884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:10.922147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:10.923002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:10.923048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:10.923038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 775
2025-10-15T11:00:10.923082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:10.923127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:10.923418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:10.927322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:10.923588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401639908318439:7795]
2025-10-15T11:00:10.925046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:10.926483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:10.926696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:10.927481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:10.927504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:10.927513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:10.928862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 775 sessionId:  describe result for acl check
2025-10-15T11:00:10.928963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:10.928975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:10.928988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:10.929005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401637108626877:8683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:10.927929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:10.928270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:10.928278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:10.928286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:10.928293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:10.928299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:10.928307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:10.928314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:10.928321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:10.928329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:10.931587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401637108626877:8683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:10.928336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:10.928345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:10.928352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.928359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.928366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.928413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:10.928521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:10.928573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:10.928623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:10.928668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:10.928718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:10.928764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:10.928813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:10.928859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:10.928909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:10.928958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:10.929010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.929055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.929099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.929139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:10.929202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:10.929260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:10.929319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:10.929369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:10.929425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:10.929471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:10.929525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:10.929572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:10.929627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:10.929671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:10.929726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:10.929772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:10.929824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:10.929871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:10.929921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:10.929970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:10.930024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:10.930069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:10.930122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:10.930168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:10.930221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:10.930266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.930316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.930360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.930411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.930466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.930518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.931015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:10.937878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401637108626877:8683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:10.940963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401637108626903:8039]
2025-10-15T11:00:10.948315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:10.948731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401637108626877:8683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:10.948774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401637108626877:8683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:10.948790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401637108626877:8683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:10.948819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:10.957467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:10.957515Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:10.957532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:10.957551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:10.957574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 774 [2:7561401639908318439:7795]
2025-10-15T11:00:10.957634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:10.957691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:10.957706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:10.957718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:10.957730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:10.957775Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:10.957794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:10.957815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:10.973065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 774, pipe: [1:7561401637108626903:8039]
2025-10-15T11:00:10.973126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 774
2025-10-15T11:00:10.973159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 774
2025-10-15T11:00:10.974994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 775 partition: 0 MaxSeqNo: 46 sessionId: src_id|4d512848-129b902f-809dd06f-8bf32fe_0
2025-10-15T11:00:10.972467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.972489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.972495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.972502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:10.972733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:10.972748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:10.972861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:10.973005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:10.973183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:10.973246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401637108626903:8039], now have 1 active actors on pipe
2025-10-15T11:00:10.973265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401637108626908:8683], now have 1 active actors on pipe
2025-10-15T11:00:10.973283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401637108626806:2467], now have 1 active actors on pipe
2025-10-15T11:00:10.973304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401639908318434:7795]
2025-10-15T11:00:10.973315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401639908318434:7795]
2025-10-15T11:00:10.973325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401639908318434:7795]
2025-10-15T11:00:10.973359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:10.975741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277aed7-1e3e6c0d-5cb29238-f3841c68_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4d512848-129b902f-809dd06f-8bf32fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:10.973386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:10.973396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:10.973416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:10.973420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:10.973570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:10.973584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:10.973710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:10.973727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:10.973764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401639908318434:7795]
2025-10-15T11:00:10.973789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:10.973811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:10.973874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d512848-129b902f-809dd06f-8bf32fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:10.973900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:10.973912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:10.973932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:10.973972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:10.974005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:10.974085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:10.974639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:10.974657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:10.974709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:10.996342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d512848-129b902f-809dd06f-8bf32fe_0] Write session: try to update token
2025-10-15T11:00:10.996412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d512848-129b902f-809dd06f-8bf32fe_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:11.043298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:11.043339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:11.043391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:11.043404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:11.043445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401639908318434:7795]
2025-10-15T11:00:11.043479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401639908318434:7795]
2025-10-15T11:00:11.043510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401639908318434:7795]
2025-10-15T11:00:11.043689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:11.043721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:11.044796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:11.047480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:11.047530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:11.047563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:11.116079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId: src_id|4d512848-129b902f-809dd06f-8bf32fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:11.151934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:11.202849Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:11.204250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:11.204277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:11.207011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:11.207216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401637108626903:8039]
2025-10-15T11:00:11.207322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:11.207335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:11.210691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:11.251919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 775 reason: error at write: Disconnected sessionId: src_id|4d512848-129b902f-809dd06f-8bf32fe_0
2025-10-15T11:00:11.252294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 775 sessionId: src_id|4d512848-129b902f-809dd06f-8bf32fe_0 is DEAD
2025-10-15T11:00:11.255866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d512848-129b902f-809dd06f-8bf32fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:11.255948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d512848-129b902f-809dd06f-8bf32fe_0] Write session will restart in 0.006294s
2025-10-15T11:00:11.256153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d512848-129b902f-809dd06f-8bf32fe_0] Write session: Do CDS request
2025-10-15T11:00:11.256226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d512848-129b902f-809dd06f-8bf32fe_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:11.272979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d512848-129b902f-809dd06f-8bf32fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:11.273795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:11.273838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 776
2025-10-15T11:00:11.274325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:11.274505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:11.274529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:11.274539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:11.276510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 776 sessionId:  describe result for acl check
2025-10-15T11:00:11.276605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:11.276612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:11.276619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:11.276631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401641403594280:8687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:11.278805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401641403594280:8687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:11.287965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401641403594280:8687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:11.293743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:11.298982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:11.299773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:11.301684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401641403594280:8687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:11.301730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401641403594280:8687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:11.301749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401641403594280:8687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:11.301782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:11.303265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:11.303336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:11.303710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:11.303929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401644203285841:7797]
2025-10-15T11:00:11.306078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:11.307307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:11.307935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401641403594322:8039]
2025-10-15T11:00:11.307527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:11.308718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:11.309060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:11.309070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:11.309077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:11.309085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:11.309092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:11.309100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:11.309107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:11.309113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:11.309120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:11.309127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:11.309134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:11.309140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.309147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.309155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.309206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:11.309322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:11.309372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:11.309420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:11.309466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:11.309516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:11.309566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:11.309617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:11.309665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:11.309716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:11.309750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:11.309786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.309832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.309868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.309902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:11.309972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:11.310032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:11.310103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:11.310140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:11.310195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:11.310244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:11.310305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:11.310360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:11.310406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:11.310441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:11.310485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:11.310529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:11.310585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:11.310634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:11.310684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:11.310721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:11.310763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:11.310795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:11.310846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:11.310884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:11.310942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:11.310979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.311034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.311069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.311126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.311160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.311201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.313066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:11.332589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:11.344232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:11.344276Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:11.344293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:11.344311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:11.344335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 775 [2:7561401644203285841:7797]
2025-10-15T11:00:11.344386Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:11.344444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:11.344459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:11.344471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:11.344483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:11.344536Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:11.344559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:11.344583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:11.346270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.347228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.347259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.347271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:11.347595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:11.347621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.347759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.347942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.348166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:11.348250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401641403594318:8687], now have 1 active actors on pipe
2025-10-15T11:00:11.348275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401641403594322:8039], now have 1 active actors on pipe
2025-10-15T11:00:11.348296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401641403594221:2467], now have 1 active actors on pipe
2025-10-15T11:00:11.348322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401644203285835:7797]
2025-10-15T11:00:11.348337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401644203285835:7797]
2025-10-15T11:00:11.348349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401644203285835:7797]
2025-10-15T11:00:11.348391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:11.348430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:11.348446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:11.348466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:11.348467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:11.348643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:11.348671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:11.348817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:11.348845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:11.348892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401644203285835:7797]
2025-10-15T11:00:11.348925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:11.349041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|450de327-92159444-5227971-3f12ce8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:11.349078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:11.349099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:11.349111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:11.349147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:11.349190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:11.349273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:11.349381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:11.351114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:11.351157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:11.351232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:11.348147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 775
2025-10-15T11:00:11.348214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 775, pipe: [1:7561401641403594322:8039]
2025-10-15T11:00:11.348265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 775
2025-10-15T11:00:11.357668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d512848-129b902f-809dd06f-8bf32fe_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|450de327-92159444-5227971-3f12ce8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:11.356753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 776 partition: 0 MaxSeqNo: 46 sessionId: src_id|450de327-92159444-5227971-3f12ce8d_0
2025-10-15T11:00:11.391193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450de327-92159444-5227971-3f12ce8d_0] Write session: try to update token
2025-10-15T11:00:11.391255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450de327-92159444-5227971-3f12ce8d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:11.467539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:11.467575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:11.467591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:11.467603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:11.467641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401644203285835:7797]
2025-10-15T11:00:11.467669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401644203285835:7797]
2025-10-15T11:00:11.467694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401644203285835:7797]
2025-10-15T11:00:11.467856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:11.467875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:11.467888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:11.467988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:11.468016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:11.471075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:11.471126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:11.471156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:11.484420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:11.531515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId: src_id|450de327-92159444-5227971-3f12ce8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:11.575322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:11.637916Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:11.661323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:11.661374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:11.661434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:11.661449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:11.661491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401644203285835:7797]
2025-10-15T11:00:11.662039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:11.662799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401641403594322:8039]
2025-10-15T11:00:11.662876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:11.662877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:11.662893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:11.664883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:11.672029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 776 reason: error at write: Disconnected sessionId: src_id|450de327-92159444-5227971-3f12ce8d_0
2025-10-15T11:00:11.672370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 776 sessionId: src_id|450de327-92159444-5227971-3f12ce8d_0 is DEAD
2025-10-15T11:00:11.675935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450de327-92159444-5227971-3f12ce8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:11.675972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450de327-92159444-5227971-3f12ce8d_0] Write session will restart in 0.008500s
2025-10-15T11:00:11.676075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450de327-92159444-5227971-3f12ce8d_0] Write session: Do CDS request
2025-10-15T11:00:11.676105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450de327-92159444-5227971-3f12ce8d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:11.690784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|450de327-92159444-5227971-3f12ce8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:11.691737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:11.691808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 777
2025-10-15T11:00:11.695683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:11.695914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:11.695943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:11.695961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:11.697954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 777 sessionId:  describe result for acl check
2025-10-15T11:00:11.698077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:11.698089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:11.698100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:11.698119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401641403594360:8693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:11.701646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401641403594360:8693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:11.713339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401641403594360:8693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:11.753077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401641403594360:8693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:11.753120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401641403594360:8693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:11.753141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401641403594360:8693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:11.753172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:11.765080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401641403594462:8039]
2025-10-15T11:00:11.767390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:11.776373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:11.777238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:11.777268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:11.777307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:11.777539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:11.777713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401644203285980:7806]
2025-10-15T11:00:11.779755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:11.782996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:11.783210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:11.784402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:11.784695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:11.784703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:11.784710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:11.784718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:11.784724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:11.784731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:11.784737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:11.784743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:11.784749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:11.784756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:11.784763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:11.784770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.784783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.784803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.784852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:11.784956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:11.785005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:11.785048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:11.785094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:11.785138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:11.785180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:11.785221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:11.785265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:11.785310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:11.785351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:11.785390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.785430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.785470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.785511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:11.785568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:11.785623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:11.785677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:11.785723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:11.785779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:11.785822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:11.785872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:11.785921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:11.785974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:11.786014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:11.786066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:11.786113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:11.786159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:11.786200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:11.786252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:11.786306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:11.786362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:11.786410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:11.786459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:11.786503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:11.786554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:11.786594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.786648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.786693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.786742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.786783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.786836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.787296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:11.824836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:11.849624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:11.849671Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:11.849688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:11.849706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:11.849729Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 776 [2:7561401644203285980:7806]
2025-10-15T11:00:11.849778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:11.849829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:11.849845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:11.849857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:11.849869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:11.849923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:11.849945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:11.849967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:11.851705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.851735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.851749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.851763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:11.852044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:11.852072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:11.852213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:11.852409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:11.852641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:11.852733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401644203285974:7806]
2025-10-15T11:00:11.852754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401644203285974:7806]
2025-10-15T11:00:11.852768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401644203285974:7806]
2025-10-15T11:00:11.852796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:11.852869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:11.852940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:11.852960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:11.852971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:11.853046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:11.853071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:11.853214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401641403594462:8039], now have 1 active actors on pipe
2025-10-15T11:00:11.853245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401641403594449:8693], now have 1 active actors on pipe
2025-10-15T11:00:11.853266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401641403594346:2467], now have 1 active actors on pipe
2025-10-15T11:00:11.853292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401644203285974:7806]
2025-10-15T11:00:11.853319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:11.853849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:11.856034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:11.856076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:11.856169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7015595e-77aac2da-60586f69-c1553692_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:11.856209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:11.856231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:11.856242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:11.856279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:11.856332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:11.856387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:11.855512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 776, pipe: [1:7561401641403594462:8039]
2025-10-15T11:00:11.855646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 776
2025-10-15T11:00:11.855715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 776
2025-10-15T11:00:11.859790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:11.859845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:11.859926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:11.862121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|450de327-92159444-5227971-3f12ce8d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7015595e-77aac2da-60586f69-c1553692_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:11.861368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 777 partition: 0 MaxSeqNo: 46 sessionId: src_id|7015595e-77aac2da-60586f69-c1553692_0
2025-10-15T11:00:11.898889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7015595e-77aac2da-60586f69-c1553692_0] Write session: try to update token
2025-10-15T11:00:11.899004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7015595e-77aac2da-60586f69-c1553692_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:11.903270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:11.903306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:11.903361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401644203285974:7806]
2025-10-15T11:00:11.903494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:11.903544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:11.905857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:11.907504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:11.909034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:11.910651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:11.912787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:11.936499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:12.010596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId: src_id|7015595e-77aac2da-60586f69-c1553692_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:12.017078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:12.017108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:12.017120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:12.017179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:12.017193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:12.017204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:12.017214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:12.017252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401644203285974:7806]
2025-10-15T11:00:12.017279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401644203285974:7806]
2025-10-15T11:00:12.017305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401644203285974:7806]
2025-10-15T11:00:12.017424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:12.017445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:12.017457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:12.017467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:12.017485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:12.018945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:12.033033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:12.180412Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:12.182278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:12.182320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:12.182917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:12.183036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401641403594462:8039]
2025-10-15T11:00:12.183132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:12.192814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 777 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7015595e-77aac2da-60586f69-c1553692_0
2025-10-15T11:00:12.193245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 777 sessionId: src_id|7015595e-77aac2da-60586f69-c1553692_0 is DEAD
2025-10-15T11:00:12.195330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7015595e-77aac2da-60586f69-c1553692_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:12.195404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7015595e-77aac2da-60586f69-c1553692_0] Write session will restart in 0.007362s
2025-10-15T11:00:12.195541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7015595e-77aac2da-60586f69-c1553692_0] Write session: Do CDS request
2025-10-15T11:00:12.195583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7015595e-77aac2da-60586f69-c1553692_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:12.211780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:12.213189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7015595e-77aac2da-60586f69-c1553692_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:12.212999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:12.213026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 778
2025-10-15T11:00:12.213702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:12.213833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:12.213850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:12.213861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:12.215571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 778 sessionId:  describe result for acl check
2025-10-15T11:00:12.215750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:12.215775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:12.215791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:12.215824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401645698561795:8703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:12.225961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401645698561795:8703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:12.235730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401645698561795:8703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:12.252579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401645698561795:8703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:12.252627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401645698561795:8703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:12.252645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401645698561795:8703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:12.252679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:12.253773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:12.259221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:12.260041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:12.260078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:12.260127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:12.260385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:12.260593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401648498253408:7814]
2025-10-15T11:00:12.262771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:12.263710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:12.263921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:12.265208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:12.265531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:12.265541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:12.265547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:12.265554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:12.265562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:12.265569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:12.265575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:12.265582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:12.265588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:12.265596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:12.265602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:12.265609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.265616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.265623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.265666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:12.265773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:12.265821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:12.265870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:12.265918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:12.265964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:12.266011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:12.266058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:12.266108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:12.266157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:12.266206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:12.266251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.266297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.266342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.266385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:12.266450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:12.266507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:12.266566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:12.266614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:12.266665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:12.266709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:12.266762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:12.266810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:12.266864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:12.266927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:12.266978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:12.267022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:12.267072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:12.267113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:12.267167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:12.267213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:12.267263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:12.267306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:12.268320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:12.268385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:12.268446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:12.268490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.268542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.268586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.268636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.268678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.268726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.269215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:12.283261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401645698561902:8039]
2025-10-15T11:00:12.288262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:12.299596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:12.299627Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:12.299637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:12.299649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:12.299666Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 777 [2:7561401648498253408:7814]
2025-10-15T11:00:12.299699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:12.299742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:12.299752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:12.299761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:12.299768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:12.299801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:12.299816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:12.299832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:12.301798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.301813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.301824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.301834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:12.302100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:12.302116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.302251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.302428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.302649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:12.302724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401645698561902:8039], now have 1 active actors on pipe
2025-10-15T11:00:12.302748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401645698561896:8703], now have 1 active actors on pipe
2025-10-15T11:00:12.302768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401645698561788:2467], now have 1 active actors on pipe
2025-10-15T11:00:12.302790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401648498253402:7814]
2025-10-15T11:00:12.302804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401648498253402:7814]
2025-10-15T11:00:12.302815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401648498253402:7814]
2025-10-15T11:00:12.302856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:12.302876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:12.302886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:12.302893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:12.302935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:12.303123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:12.303140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:12.303265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401648498253402:7814]
2025-10-15T11:00:12.303325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:12.304313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:12.304437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:12.304458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:12.304571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:12.304600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:12.304616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:12.304627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:12.304658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:12.304694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:12.304752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:12.306587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:12.306616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:12.306703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:12.303384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 777, pipe: [1:7561401645698561902:8039]
2025-10-15T11:00:12.303515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 777
2025-10-15T11:00:12.303597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 777
2025-10-15T11:00:12.307125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 778 partition: 0 MaxSeqNo: 46 sessionId: src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0
2025-10-15T11:00:12.311467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7015595e-77aac2da-60586f69-c1553692_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:12.354887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0] Write session: try to update token
2025-10-15T11:00:12.354961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:12.442432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:12.442469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:12.442482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:12.442492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:12.442524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401648498253402:7814]
2025-10-15T11:00:12.442548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401648498253402:7814]
2025-10-15T11:00:12.442573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401648498253402:7814]
2025-10-15T11:00:12.442695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:12.442722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:12.442733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:12.442740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:12.442744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:12.442767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:12.442840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:12.442859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:12.444029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:12.469070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId: src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:12.491494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:12.593585Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:12.622717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401645698561902:8039]
2025-10-15T11:00:12.620478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:12.620529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:12.620596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:12.620610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:12.620652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401648498253402:7814]
2025-10-15T11:00:12.620984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:12.621278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:12.623012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:12.623603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:12.634803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 778 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0
2025-10-15T11:00:12.635114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 778 sessionId: src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0 is DEAD
2025-10-15T11:00:12.636687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:12.636749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0] Write session will restart in 0.008161s
2025-10-15T11:00:12.636917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0] Write session: Do CDS request
2025-10-15T11:00:12.636972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:12.649645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:12.651937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:12.651976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 779
2025-10-15T11:00:12.652537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:12.652693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:12.652717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:12.652728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:12.654080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 779 sessionId:  describe result for acl check
2025-10-15T11:00:12.654186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:12.654197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:12.654205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:12.654223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401645698561928:8710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:12.659089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401645698561928:8710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:12.685504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401645698561928:8710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:12.692497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:12.696340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401645698561928:8710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:12.696383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401645698561928:8710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:12.696400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401645698561928:8710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:12.696428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:12.698581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:12.699520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:12.699552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:12.699596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:12.699863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:12.700068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401648498253531:7819]
2025-10-15T11:00:12.702461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:12.703415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:12.703643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:12.705061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:12.705423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:12.705441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:12.705449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:12.705456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:12.705465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:12.705473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:12.705482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:12.705489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:12.705497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:12.705504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:12.705511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:12.705518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.705525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.705532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.705587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:12.705722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:12.705776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:12.705842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:12.705903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:12.705964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:12.706021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:12.706077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:12.706135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:12.706190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:12.706245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:12.706298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.706354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.706411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.706466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:12.706546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:12.706617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:12.706684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:12.706746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:12.707007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:12.707075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:12.707142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:12.707205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:12.707273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:12.707331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:12.707410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:12.707472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:12.707538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:12.707594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:12.707660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:12.707721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:12.707789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:12.707847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:12.707915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:12.707972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:12.708037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:12.708093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.708160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.708217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.708283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.708343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.708409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.708974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:12.723067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401645698562034:8039]
2025-10-15T11:00:12.727239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:12.736987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:12.737038Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:12.737059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:12.737078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:12.737105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 778 [2:7561401648498253531:7819]
2025-10-15T11:00:12.737161Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:12.737229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:12.737246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:12.737260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:12.737273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:12.737322Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:12.737349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:12.737373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:12.745965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 778
2025-10-15T11:00:12.746068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 778
2025-10-15T11:00:12.746139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 778, pipe: [1:7561401645698562034:8039]
2025-10-15T11:00:12.745262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.745296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.745312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.745326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:12.745624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:12.745644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:12.745803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:12.746000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:12.746247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:12.746332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401645698562028:8710], now have 1 active actors on pipe
2025-10-15T11:00:12.746355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401645698561914:2467], now have 1 active actors on pipe
2025-10-15T11:00:12.746379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401645698562034:8039], now have 1 active actors on pipe
2025-10-15T11:00:12.746406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401648498253525:7819]
2025-10-15T11:00:12.746423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401648498253525:7819]
2025-10-15T11:00:12.746436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401648498253525:7819]
2025-10-15T11:00:12.746469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:12.746505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:12.746520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:12.746534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:12.746547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:12.746742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:12.746761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:12.746837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:12.746859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:12.746998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401648498253525:7819]
2025-10-15T11:00:12.747033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:12.747068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:12.747111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6534b79e-df438168-c959bed9-bae3dbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:12.747145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:12.747165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:12.747176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:12.747214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:12.747259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:12.748563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:12.750802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:12.750841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:12.750932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:12.751267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 779 partition: 0 MaxSeqNo: 46 sessionId: src_id|6534b79e-df438168-c959bed9-bae3dbc_0
2025-10-15T11:00:12.752243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1220e90-6f1dd98c-d7ded74e-7dd7bae3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6534b79e-df438168-c959bed9-bae3dbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:12.772228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6534b79e-df438168-c959bed9-bae3dbc_0] Write session: try to update token
2025-10-15T11:00:12.772293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6534b79e-df438168-c959bed9-bae3dbc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:12.805209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:12.805271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:12.805296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:12.805319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:12.805377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401648498253525:7819]
2025-10-15T11:00:12.805432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401648498253525:7819]
2025-10-15T11:00:12.805473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401648498253525:7819]
2025-10-15T11:00:12.805628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:12.805698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:12.805703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:12.805735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:12.805761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:12.810956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:12.868764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId: src_id|6534b79e-df438168-c959bed9-bae3dbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:12.890006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:12.960638Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:12.965958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:12.966003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:12.967509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:12.967540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:12.967548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:12.967795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401645698562034:8039]
2025-10-15T11:00:12.969825Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:12.977187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 779 reason: error at write: Disconnected sessionId: src_id|6534b79e-df438168-c959bed9-bae3dbc_0
2025-10-15T11:00:12.977536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 779 sessionId: src_id|6534b79e-df438168-c959bed9-bae3dbc_0 is DEAD
2025-10-15T11:00:12.979960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6534b79e-df438168-c959bed9-bae3dbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:12.980026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6534b79e-df438168-c959bed9-bae3dbc_0] Write session will restart in 0.008548s
2025-10-15T11:00:12.980193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6534b79e-df438168-c959bed9-bae3dbc_0] Write session: Do CDS request
2025-10-15T11:00:12.980245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6534b79e-df438168-c959bed9-bae3dbc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:12.992925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6534b79e-df438168-c959bed9-bae3dbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:12.994552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:12.994587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 780
2025-10-15T11:00:12.994949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:12.995042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:12.995053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:12.995060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:12.996486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 780 sessionId:  describe result for acl check
2025-10-15T11:00:12.996609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:12.996625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:12.996634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:12.996651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401645698562059:8716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:13.000580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401645698562059:8716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:13.010621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401645698562059:8716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:13.023897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401645698562059:8716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:13.023943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401645698562059:8716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:13.023961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401645698562059:8716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:13.023991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:13.028865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:13.033115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:13.033968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:13.033985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:13.034028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:13.034272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:13.034449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401652793220954:7828]
2025-10-15T11:00:13.036641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:13.037515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:13.037735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:13.039005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:13.039314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.039323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.039330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.039337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.039362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.039370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.039377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.039384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.039391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.039398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.039405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.039413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.039421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.039429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.039475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.039584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.039633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.039678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.039724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.039770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.039814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.039859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.039906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.039952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.039994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.040039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.040084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.040128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.040170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.040238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.040296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.040349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.040400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.040454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.040495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.040547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.040619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.040677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.040721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.040774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.040819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.040875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.040921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.040975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.041016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.041775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.041822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.041861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.041897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.041932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.041969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.042012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.042049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.042087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.042118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.042157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.042510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:13.060186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:13.070098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:13.070148Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:13.070165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:13.070184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:13.070207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 779 [2:7561401652793220954:7828]
2025-10-15T11:00:13.070261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:13.070321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:13.070336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:13.070349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:13.070361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:13.070410Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:13.070433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:13.070458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:13.071654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401649993529450:8039]
2025-10-15T11:00:13.079007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.079037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.079052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.079064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:13.079307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:13.079330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.079470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.079665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.079861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:13.079926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401649993529450:8039], now have 1 active actors on pipe
2025-10-15T11:00:13.079948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401645698562046:2467], now have 1 active actors on pipe
2025-10-15T11:00:13.079963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401649993529439:8716], now have 1 active actors on pipe
2025-10-15T11:00:13.079981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401652793220949:7828]
2025-10-15T11:00:13.079992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401652793220949:7828]
2025-10-15T11:00:13.080001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401652793220949:7828]
2025-10-15T11:00:13.080035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:13.080082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:13.080097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:13.080109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:13.080111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:13.080261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:13.080285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:13.080429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:13.080455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:13.080489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401652793220949:7828]
2025-10-15T11:00:13.080517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:13.080566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:13.080645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:13.080681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:13.080700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:13.080711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:13.080750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:13.080799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:13.080908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:13.081343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:13.081365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:13.081424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:13.082410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6534b79e-df438168-c959bed9-bae3dbc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:13.079782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 779
2025-10-15T11:00:13.079907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 779, pipe: [1:7561401649993529450:8039]
2025-10-15T11:00:13.079984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 779
2025-10-15T11:00:13.081715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 780 partition: 0 MaxSeqNo: 46 sessionId: src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0
2025-10-15T11:00:13.103503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0] Write session: try to update token
2025-10-15T11:00:13.103560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:13.188053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:13.188083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:13.188093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:13.188101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:13.188126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401652793220949:7828]
2025-10-15T11:00:13.188145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401652793220949:7828]
2025-10-15T11:00:13.188163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401652793220949:7828]
2025-10-15T11:00:13.188283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:13.188292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:13.188300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:13.188295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:13.188334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:13.188377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:13.188389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:13.188407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:13.189652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:13.197324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId: src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:13.217019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:13.344844Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:13.366757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:13.366800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:13.366860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:13.366875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:13.366915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401652793220949:7828]
2025-10-15T11:00:13.367319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:13.368188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:13.368864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401649993529450:8039]
2025-10-15T11:00:13.368973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:13.369079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:13.389402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:13.389479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0] Write session will restart in 0.005667s
2025-10-15T11:00:13.389636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0] Write session: Do CDS request
2025-10-15T11:00:13.389695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:13.388633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 780 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0
2025-10-15T11:00:13.388993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 780 sessionId: src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0 is DEAD
2025-10-15T11:00:13.410366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:13.416839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:13.416871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 781
2025-10-15T11:00:13.417364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:13.417465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:13.417478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:13.417488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:13.419273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 781 sessionId:  describe result for acl check
2025-10-15T11:00:13.419383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:13.419393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:13.419402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:13.419418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401649993529512:8726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:13.422092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401649993529512:8726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:13.434209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401649993529512:8726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:13.444239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:13.443712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401649993529512:8726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:13.443763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401649993529512:8726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:13.443784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401649993529512:8726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:13.443824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:13.446224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:13.447160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:13.447178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:13.447226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:13.447497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:13.447676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401652793221095:7836]
2025-10-15T11:00:13.449772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:13.450697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:13.450899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:13.452194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:13.452498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.452506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.452513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.452519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.452525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.452531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.452538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.452545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.452552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.452559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.452566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.452573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.452579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.452585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.452629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.452730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.452776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.452823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.452866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.452908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.452949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.452989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.453031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.453078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.453123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.453165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.453207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.453252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.453290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.453351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.453407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.453457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.453506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.453557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.453601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.453651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.453696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.453746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.453787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.453836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.453882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.453932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.453974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.454023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.454068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.454117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.454160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.454210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.454253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.454301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.454343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.454396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.454438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.454486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.454528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.454576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.455057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:13.462923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401649993529585:8039]
2025-10-15T11:00:13.478031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:13.494887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:13.494940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:13.494952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:13.494967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:13.494985Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 780 [2:7561401652793221095:7836]
2025-10-15T11:00:13.495023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:13.495074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:13.495085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:13.495095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:13.495104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:13.495141Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:13.495158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:13.495177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:13.498012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 780, pipe: [1:7561401649993529585:8039]
2025-10-15T11:00:13.498117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 780
2025-10-15T11:00:13.498183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 780
2025-10-15T11:00:13.496776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.496796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.496806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.496814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:13.497070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:13.497088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.497239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.497436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.497666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:13.497749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401649993529578:8726], now have 1 active actors on pipe
2025-10-15T11:00:13.497774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401649993529479:2467], now have 1 active actors on pipe
2025-10-15T11:00:13.497794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401649993529585:8039], now have 1 active actors on pipe
2025-10-15T11:00:13.497819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401652793221089:7836]
2025-10-15T11:00:13.497833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401652793221089:7836]
2025-10-15T11:00:13.497846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401652793221089:7836]
2025-10-15T11:00:13.497888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:13.497962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:13.498147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:13.498165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:13.498286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401652793221089:7836]
2025-10-15T11:00:13.498306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:13.498322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:13.498335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:13.498346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:13.498370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:13.498883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:13.498909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:13.499017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:13.499051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:13.499069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:13.499080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:13.499116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:13.499159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:13.499210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:13.499697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:13.499710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:13.499757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:13.499978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 781 partition: 0 MaxSeqNo: 46 sessionId: src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0
2025-10-15T11:00:13.502031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a176a11a-8933d065-a31a03e3-9b6d48b6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:13.538484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:13.538663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:13.538703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401652793221089:7836]
2025-10-15T11:00:13.538820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:13.539079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:13.545664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:13.565455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0] Write session: try to update token
2025-10-15T11:00:13.565518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:13.566126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:13.576126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:13.577861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:13.580090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:13.580619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:13.615789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:13.615837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:13.615851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:13.615926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:13.615943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:13.615956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:13.615966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:13.616023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401652793221089:7836]
2025-10-15T11:00:13.616048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401652793221089:7836]
2025-10-15T11:00:13.616079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401652793221089:7836]
2025-10-15T11:00:13.616202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:13.616231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:13.616244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:13.616254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:13.616269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:13.617638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:13.680278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId: src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:13.712266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:13.769478Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:13.771016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:13.771051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:13.772257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:13.773146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:13.773682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:13.774324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401649993529585:8039]
2025-10-15T11:00:13.834409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 781 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0
2025-10-15T11:00:13.834708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 781 sessionId: src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0 is DEAD
2025-10-15T11:00:13.839412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:13.839460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0] Write session will restart in 0.006134s
2025-10-15T11:00:13.839569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0] Write session: Do CDS request
2025-10-15T11:00:13.839601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:13.854811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:13.855328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:13.855372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 782
2025-10-15T11:00:13.856266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:13.856411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:13.856431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:13.856442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:13.858000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 782 sessionId:  describe result for acl check
2025-10-15T11:00:13.858105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:13.858122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:13.858131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:13.858146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401649993529699:8735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:13.860614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401649993529699:8735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:13.867222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:13.868613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401649993529699:8735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:13.874503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401649993529724:8039]
2025-10-15T11:00:13.874709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:13.875690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:13.875720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:13.875767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:13.876073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:13.876264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401652793221219:7841]
2025-10-15T11:00:13.878560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:13.880149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:13.880399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:13.881647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:13.881970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.881978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.881985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.881991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.881998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.882004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.882011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.882018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.882027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.882034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.882040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.882045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.882052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.882058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.882101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.882203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.882252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.882299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.882341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.882387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.882431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.882477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.882521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.882568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.882613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.882658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.882700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.882744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.882785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.882848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:13.882900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.882968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:13.883016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.883065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:13.883113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.883166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:13.883212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.883265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:13.883312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.883905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:13.883956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.884010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:13.884053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.884102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:13.884148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.884203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:13.884247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.884300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:13.884345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.884394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:13.884440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.884492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.884539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.884592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.884635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.884688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.886853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401649993529699:8735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:13.886892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401649993529699:8735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:13.886918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401649993529699:8735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:13.886956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:13.885168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:13.926309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:13.942262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 781
2025-10-15T11:00:13.942360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 781, pipe: [1:7561401649993529724:8039]
2025-10-15T11:00:13.942433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 781
2025-10-15T11:00:13.939832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:13.939879Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:13.939896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:13.939915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:13.939938Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 781 [2:7561401652793221219:7841]
2025-10-15T11:00:13.939991Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:13.940047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:13.940061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:13.940072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:13.940083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:13.940128Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:13.940149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:13.940169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:13.941211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.941227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.941241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.941251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:13.941517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:13.941534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:13.941670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:13.941847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:13.942068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:13.942142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401649993529622:2467], now have 1 active actors on pipe
2025-10-15T11:00:13.942165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401649993529724:8039], now have 1 active actors on pipe
2025-10-15T11:00:13.942185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401649993529735:8735], now have 1 active actors on pipe
2025-10-15T11:00:13.942207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401652793221213:7841]
2025-10-15T11:00:13.942222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401652793221213:7841]
2025-10-15T11:00:13.942236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401652793221213:7841]
2025-10-15T11:00:13.942273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:13.942344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:13.942508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:13.942523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:13.942563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:13.942579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:13.942590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:13.942629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401652793221213:7841]
2025-10-15T11:00:13.942651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:13.942671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:13.942762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:13.942780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:13.942898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:13.942948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:13.942968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:13.942978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:13.943010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:13.943043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:13.943120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:13.946480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:13.946518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:13.946590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:13.947428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 782 partition: 0 MaxSeqNo: 46 sessionId: src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0
2025-10-15T11:00:13.948544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e7678-c35e60f-bbe8f0bf-a125c9cb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:13.987208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0] Write session: try to update token
2025-10-15T11:00:13.987265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:14.054679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:14.054706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:14.054719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:14.054728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:14.054756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401652793221213:7841]
2025-10-15T11:00:14.054779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401652793221213:7841]
2025-10-15T11:00:14.054799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401652793221213:7841]
2025-10-15T11:00:14.054963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:14.054983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:14.054994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:14.055081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:14.055105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:14.055689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:14.055732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:14.055756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:14.057104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:14.116595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId: src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:14.137648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:14.205377Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:14.215387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:14.215433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:14.215494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:14.215508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:14.215547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401652793221213:7841]
2025-10-15T11:00:14.215718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:14.216209Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:14.216134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401649993529724:8039]
2025-10-15T11:00:14.216233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:14.216245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:14.218648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:14.255200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 782 reason: error at write: Disconnected sessionId: src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0
2025-10-15T11:00:14.255495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 782 sessionId: src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0 is DEAD
2025-10-15T11:00:14.255849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:14.255883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0] Write session will restart in 0.008736s
2025-10-15T11:00:14.255984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0] Write session: Do CDS request
2025-10-15T11:00:14.256017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:14.272701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:14.272751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 783
2025-10-15T11:00:14.273143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:14.273866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:14.273998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:14.274013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:14.274023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:14.275509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 783 sessionId:  describe result for acl check
2025-10-15T11:00:14.275618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:14.275634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:14.275644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:14.275660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401654288497083:8742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:14.278111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401654288497083:8742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:14.283416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401654288497083:8742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:14.292473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401654288497083:8742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:14.292509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401654288497083:8742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:14.292526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401654288497083:8742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:14.292554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:14.299823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:14.302262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:14.303032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:14.303049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:14.303087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:14.303321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:14.303520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401657088188628:7843]
2025-10-15T11:00:14.305831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:14.306763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:14.306983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:14.308166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:14.308474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:14.308481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:14.308489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:14.308496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:14.308502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:14.308508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:14.308514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:14.308520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:14.308527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:14.308533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:14.308539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:14.308545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.308552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.308559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.308604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:14.308703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:14.308749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:14.308792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:14.308848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:14.308892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:14.308934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:14.308978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:14.309021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:14.309066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:14.309108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:14.309153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.309196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.309240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.309292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:14.309356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:14.309426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:14.309479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:14.309529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:14.309599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:14.309640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:14.309694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:14.309742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:14.309792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:14.309845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:14.309897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:14.309945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:14.309998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:14.310043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:14.310095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:14.310142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:14.310195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:14.310254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:14.310307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:14.310351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:14.310402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:14.310447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.310495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.310540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.310593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.310636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.310688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.311183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:14.315480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401654288497161:8039]
2025-10-15T11:00:14.329743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:14.340384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:14.340424Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:14.340440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:14.340457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:14.340481Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 782 [2:7561401657088188628:7843]
2025-10-15T11:00:14.340530Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:14.340580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:14.340593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:14.340605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:14.340616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:14.340660Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:14.340682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:14.340701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:14.352375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.352402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.352412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.352421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:14.352664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:14.352677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.352795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.352955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.353158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:14.353216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401657088188623:7843]
2025-10-15T11:00:14.353229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401657088188623:7843]
2025-10-15T11:00:14.353240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401657088188623:7843]
2025-10-15T11:00:14.353277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:14.353333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:14.353337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:14.353356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:14.353366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:14.353498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:14.353513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:14.353633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401654288497161:8039], now have 1 active actors on pipe
2025-10-15T11:00:14.353664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401654288497152:8742], now have 1 active actors on pipe
2025-10-15T11:00:14.353683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401654288497048:2467], now have 1 active actors on pipe
2025-10-15T11:00:14.353700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401657088188623:7843]
2025-10-15T11:00:14.353724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:14.353812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:14.354806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 782, pipe: [1:7561401654288497161:8039]
2025-10-15T11:00:14.354913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 782
2025-10-15T11:00:14.354990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 782
2025-10-15T11:00:14.355472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:14.355503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:14.355594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:14.355624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:14.355639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:14.355649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:14.355683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:14.355754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:14.355805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:14.358610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:14.358635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:14.358697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:14.359664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 783 partition: 0 MaxSeqNo: 46 sessionId: src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0
2025-10-15T11:00:14.367531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704bfbb-9ef03db5-721cabe3-981d9eb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:14.412168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0] Write session: try to update token
2025-10-15T11:00:14.412253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:14.413450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:14.413484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:14.413517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401657088188623:7843]
2025-10-15T11:00:14.413608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:14.413624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:14.415923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:14.423953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:14.432366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:14.439878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:14.444819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:14.445316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:14.445328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:14.445339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:14.445394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:14.575894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:14.575925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:14.575937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:14.575992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:14.576002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:14.576011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:14.576017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:14.576042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401657088188623:7843]
2025-10-15T11:00:14.576058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401657088188623:7843]
2025-10-15T11:00:14.576073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401657088188623:7843]
2025-10-15T11:00:14.576166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:14.576179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:14.576202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:14.576243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:14.576270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:14.576977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:14.618279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId: src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:14.660659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:14.721355Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:14.730105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:14.730149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:14.731996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:14.734192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:14.763285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:14.764671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401654288497161:8039]
2025-10-15T11:00:14.764776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 783 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0
2025-10-15T11:00:14.765111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 783 sessionId: src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0 is DEAD
2025-10-15T11:00:14.771942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:14.772036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0] Write session will restart in 0.005436s
2025-10-15T11:00:14.772221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0] Write session: Do CDS request
2025-10-15T11:00:14.772270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:14.802803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:14.828848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:14.828884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 784
2025-10-15T11:00:14.835309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:14.835527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:14.835545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:14.835556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:14.837094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 784 sessionId:  describe result for acl check
2025-10-15T11:00:14.837227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:14.837239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:14.837249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:14.837267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401654288497277:8756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:14.840472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401654288497277:8756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:14.858062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401654288497277:8756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:14.858985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:14.866187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401654288497303:8039]
2025-10-15T11:00:14.866783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:14.867852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:14.867898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:14.867968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:14.868296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:14.868492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401657088188770:7853]
2025-10-15T11:00:14.870987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:14.872317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:14.872559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:14.873634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:14.873968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:14.873976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:14.873982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:14.873989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:14.873996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:14.874003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:14.874010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:14.874016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:14.874022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:14.874029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:14.874037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:14.874043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.874050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.874057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.874105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:14.874217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:14.874265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:14.874310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:14.874353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:14.874401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:14.874446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:14.874492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:14.874537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:14.874582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:14.874628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:14.874674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.874720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.874765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.874825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:14.874898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:14.874988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:14.875034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:14.875066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:14.875108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:14.875137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:14.875173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:14.875204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:14.875240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:14.875270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:14.875305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:14.875335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:14.875406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:14.875453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:14.875506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:14.875556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:14.875608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:14.875658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:14.875706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:14.875740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:14.875791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:14.875837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.875895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.875943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.875995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.876052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.876106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.876620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:14.877157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401654288497277:8756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:14.877198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401654288497277:8756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:14.877215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401654288497277:8756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:14.877246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:14.901878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:14.911175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:14.911361Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:14.911380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:14.911394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:14.911416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 783 [2:7561401657088188770:7853]
2025-10-15T11:00:14.911467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:14.911512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:14.911522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:14.911531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:14.911540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:14.911578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:14.911595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:14.911615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:14.913586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.913602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.913616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.913625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:14.913887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:14.913898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:14.914029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:14.914151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:14.914317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:14.914364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401657088188764:7853]
2025-10-15T11:00:14.914374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401657088188764:7853]
2025-10-15T11:00:14.914383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401657088188764:7853]
2025-10-15T11:00:14.914414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:14.914477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:14.914622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:14.914635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:14.914731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401657088188764:7853]
2025-10-15T11:00:14.914743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:14.915594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:14.915621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:14.915634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:14.915662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:14.916254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401654288497303:8039], now have 1 active actors on pipe
2025-10-15T11:00:14.916287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401654288497313:8756], now have 1 active actors on pipe
2025-10-15T11:00:14.916307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401654288497196:2467], now have 1 active actors on pipe
2025-10-15T11:00:14.917538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:14.917572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:14.917658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:14.917692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:14.917711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:14.917723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:14.917773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:14.917819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:14.917879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:14.916833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 783, pipe: [1:7561401654288497303:8039]
2025-10-15T11:00:14.916939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 783
2025-10-15T11:00:14.917022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 783
2025-10-15T11:00:14.920826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:14.920859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:14.920936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:14.921407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 784 partition: 0 MaxSeqNo: 46 sessionId: src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0
2025-10-15T11:00:14.923854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b594b01d-7c437df6-909ad2eb-b2b15b70_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:14.985327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0] Write session: try to update token
2025-10-15T11:00:14.985382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:15.009728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:15.009764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:15.009799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401657088188764:7853]
2025-10-15T11:00:15.009914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:15.011693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:15.012233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:15.028315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:15.040330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:15.056650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:15.075056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:15.079987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:15.080018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:15.080031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:15.080164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:15.132576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:15.132606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:15.132620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:15.132629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:15.132661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401657088188764:7853]
2025-10-15T11:00:15.132681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401657088188764:7853]
2025-10-15T11:00:15.132697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401657088188764:7853]
2025-10-15T11:00:15.132808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:15.132827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:15.132843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:15.132888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:15.136796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId: src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:15.132936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:15.133917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:15.161236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:15.284111Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:15.302250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:15.302299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:15.303057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:15.307823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401654288497303:8039]
2025-10-15T11:00:15.307994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:15.311744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:15.321549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 784 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0
2025-10-15T11:00:15.321855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 784 sessionId: src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0 is DEAD
2025-10-15T11:00:15.325943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:15.326001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0] Write session will restart in 0.008921s
2025-10-15T11:00:15.326145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0] Write session: Do CDS request
2025-10-15T11:00:15.326190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:15.348152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:15.348517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:15.348550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 785
2025-10-15T11:00:15.348993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:15.349106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:15.349127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:15.349136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:15.350402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 785 sessionId:  describe result for acl check
2025-10-15T11:00:15.350517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:15.350536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:15.350551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:15.350569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401658583464653:8763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:15.354064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401658583464653:8763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:15.366871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401658583464653:8763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:15.381488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401658583464653:8763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:15.381532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401658583464653:8763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:15.381550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401658583464653:8763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:15.381584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:15.399482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:15.402971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:15.403873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:15.403899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:15.403957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:15.404221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:15.404410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401661383156221:7860]
2025-10-15T11:00:15.406430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:15.407589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:15.407834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:15.408922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:15.409195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:15.409211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:15.409219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:15.409227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:15.409234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:15.409241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:15.409249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:15.409256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:15.409263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:15.409272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:15.409278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:15.409285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.409293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.409300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.409350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:15.409469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:15.409520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:15.409579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:15.409635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:15.409691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:15.409744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:15.409801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:15.409852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:15.409905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:15.409960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:15.410013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.410064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.410113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.410162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:15.410240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:15.410308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:15.410367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:15.410423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:15.410486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:15.410538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:15.410598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:15.410655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:15.410729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:15.410779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:15.410841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:15.410896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:15.410874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401658583464749:8039]
2025-10-15T11:00:15.410969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:15.411022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:15.411083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:15.411138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:15.411198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:15.411250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:15.411310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:15.411699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:15.411773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:15.411831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.411900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.411958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.412027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.412080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.412141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.412670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:15.429023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:15.452855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:15.452906Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:15.452923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:15.452942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:15.452968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 784 [2:7561401661383156221:7860]
2025-10-15T11:00:15.453023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:15.453081Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:15.453095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:15.453108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:15.453121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:15.453169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:15.453193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:15.453212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:15.453974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.453998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.454012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.454025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:15.454245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:15.454262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.454372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.454520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.454696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:15.454750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401661383156216:7860]
2025-10-15T11:00:15.454764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401661383156216:7860]
2025-10-15T11:00:15.454774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401661383156216:7860]
2025-10-15T11:00:15.454807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:15.454882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:15.454932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:15.454944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:15.454955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:15.455093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:15.455117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:15.455241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401661383156216:7860]
2025-10-15T11:00:15.455271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:15.455283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:15.455322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401658583464627:2467], now have 1 active actors on pipe
2025-10-15T11:00:15.455341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401658583464749:8039], now have 1 active actors on pipe
2025-10-15T11:00:15.455410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401658583464719:8763], now have 1 active actors on pipe
2025-10-15T11:00:15.455487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 784, pipe: [1:7561401658583464749:8039]
2025-10-15T11:00:15.455503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 784
2025-10-15T11:00:15.455601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 784
2025-10-15T11:00:15.456106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:15.456140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:15.456220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:15.456260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:15.456280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:15.456292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:15.456327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:15.456372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:15.456432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:15.459461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:15.459509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:15.459592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:15.463132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 785 partition: 0 MaxSeqNo: 46 sessionId: src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0
2025-10-15T11:00:15.464036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cb76c0-cb7aef39-1cae60c9-b294571b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:15.516890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0] Write session: try to update token
2025-10-15T11:00:15.516948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:15.564616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:15.564652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:15.564665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:15.564727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:15.564746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:15.564765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:15.564777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:15.564814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401661383156216:7860]
2025-10-15T11:00:15.564843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401661383156216:7860]
2025-10-15T11:00:15.564870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401661383156216:7860]
2025-10-15T11:00:15.564978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:15.565022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:15.565053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:15.583678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:15.583726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:15.585220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
E1015 11:00:15.651666373  822181 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:00:15.711459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId: src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:15.758669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:15.761573Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:15.763076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:15.763116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:15.765090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:15.765229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401658583464749:8039]
2025-10-15T11:00:15.765297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:15.765308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:15.770424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:15.797481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 785 reason: error at write: Disconnected sessionId: src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0
2025-10-15T11:00:15.797871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 785 sessionId: src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0 is DEAD
2025-10-15T11:00:15.807542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:15.807582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0] Write session will restart in 0.008734s
2025-10-15T11:00:15.807680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0] Write session: Do CDS request
2025-10-15T11:00:15.807709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:15.822894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:15.822929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 786
2025-10-15T11:00:15.824146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:15.827499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:15.827666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:15.827689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:15.827700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:15.829119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 786 sessionId:  describe result for acl check
2025-10-15T11:00:15.829247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:15.829266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:15.829276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:15.829294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401658583464797:8769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:15.832490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401658583464797:8769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:15.856583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401658583464797:8769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:15.868742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401658583464846:8039]
2025-10-15T11:00:15.885491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401658583464797:8769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:15.885539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401658583464797:8769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:15.885558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401658583464797:8769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:15.885589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:15.911895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:15.917277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:15.918136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:15.918155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:15.918194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:15.918470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:15.918640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401661383156342:7866]
2025-10-15T11:00:15.920758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:15.921841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:15.922055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:15.923201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:15.923530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:15.923538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:15.923545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:15.923552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:15.923559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:15.923566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:15.923572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:15.923578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:15.923585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:15.923591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:15.923597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:15.923603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.923610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.923616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.923661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:15.923766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:15.923812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:15.923857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:15.923902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:15.923948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:15.923989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:15.924039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:15.924081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:15.924127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:15.924169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:15.924214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.924257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.924300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.924342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:15.924404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:15.924456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:15.924510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:15.924557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:15.924608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:15.924653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:15.924703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:15.924748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:15.924795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:15.924836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:15.924886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:15.924930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:15.926589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:15.926671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:15.926725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:15.926773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:15.926825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:15.926869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:15.926921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:15.926980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:15.927032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:15.927077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.927129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.927173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.927223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.927269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.927320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.927825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:15.950183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:15.959895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:15.959959Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:15.959977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:15.960000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:15.960029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 785 [2:7561401661383156342:7866]
2025-10-15T11:00:15.960090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:15.960163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:15.960182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:15.960196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:15.960210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:15.960265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:15.960293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:15.960319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:15.961566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.961583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.961598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.961613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:15.961885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:15.961906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:15.962062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:15.962262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:15.962515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:15.962594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401661383156337:7866]
2025-10-15T11:00:15.962610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401661383156337:7866]
2025-10-15T11:00:15.962627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401661383156337:7866]
2025-10-15T11:00:15.962779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:15.962792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:15.962804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:15.963472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 785
2025-10-15T11:00:15.963476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 785
2025-10-15T11:00:15.963563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 785, pipe: [1:7561401658583464846:8039]
2025-10-15T11:00:15.966072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:15.966214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:15.966427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:15.966453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:15.966515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401658583464888:8769], now have 1 active actors on pipe
2025-10-15T11:00:15.966539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401658583464846:8039], now have 1 active actors on pipe
2025-10-15T11:00:15.966562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401658583464762:2467], now have 1 active actors on pipe
2025-10-15T11:00:15.966615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:15.966637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:15.966785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401661383156337:7866]
2025-10-15T11:00:15.966817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:15.966887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:15.966888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:15.966919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:15.966938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:15.966948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:15.966999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:15.967044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:15.967171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:15.967954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:15.967996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:15.968075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:15.968594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 786 partition: 0 MaxSeqNo: 46 sessionId: src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0
2025-10-15T11:00:15.971858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|458fc8a1-7001f038-2e93a888-3ab6ddd5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:16.006667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0] Write session: try to update token
2025-10-15T11:00:16.006717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:16.069098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:16.069132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:16.069146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:16.069160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:16.069198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401661383156337:7866]
2025-10-15T11:00:16.069228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401661383156337:7866]
2025-10-15T11:00:16.069245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401661383156337:7866]
2025-10-15T11:00:16.069360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:16.069371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:16.069378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:16.069418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:16.069625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:16.079472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:16.079680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:16.080563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:16.081121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:16.167475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId: src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:16.204962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:16.241448Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:16.243819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:16.243865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:16.247969Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:16.247991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:16.248165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:16.248181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:16.251711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401658583464846:8039]
2025-10-15T11:00:16.260449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 786 reason: error at write: Disconnected sessionId: src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0
2025-10-15T11:00:16.260817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 786 sessionId: src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0 is DEAD
2025-10-15T11:00:16.263564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:16.263609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0] Write session will restart in 0.006826s
2025-10-15T11:00:16.263744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0] Write session: Do CDS request
2025-10-15T11:00:16.263773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:16.277984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:16.283525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:16.283557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 787
2025-10-15T11:00:16.287508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:16.287668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:16.287690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:16.287701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:16.293173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 787 sessionId:  describe result for acl check
2025-10-15T11:00:16.293296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:16.293312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:16.293324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:16.293343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401662878432218:8773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:16.300567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401662878432218:8773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:16.315446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401662878432218:8773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:16.345502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401662878432218:8773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:16.345551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401662878432218:8773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:16.345570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401662878432218:8773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:16.345604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:16.351935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401662878432319:8039]
2025-10-15T11:00:16.366596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:16.368353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:16.369163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:16.369183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:16.369226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:16.369467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:16.369662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401665678123770:7874]
2025-10-15T11:00:16.372133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:16.376548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:16.376777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:16.378097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:16.378437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:16.378446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:16.378453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:16.378461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:16.378469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:16.378477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:16.378485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:16.378492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:16.378500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:16.378507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:16.378514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:16.378521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.378533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.378545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.378595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:16.378710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:16.378759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:16.378811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:16.378860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:16.378909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:16.378956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:16.379017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:16.379076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:16.379124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:16.379171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:16.379218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.379271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.379317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.379380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:16.379458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:16.379519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:16.379574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:16.379624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:16.379680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:16.379737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:16.379794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:16.379842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:16.379898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:16.379951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:16.380007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:16.380056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:16.380111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:16.380169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:16.380227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:16.380281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:16.380338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:16.380384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:16.380444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:16.380496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:16.380550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:16.380600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.380656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.380704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.380761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.380805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.380860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.381385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:16.409040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:16.421365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:16.421421Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:16.421439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:16.421456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:16.421481Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 786 [2:7561401665678123770:7874]
2025-10-15T11:00:16.421531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:16.421588Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:16.421603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:16.421614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:16.421626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:16.421678Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:16.421701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:16.421724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:16.424019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.424050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.424064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.424075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:16.424347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:16.424375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.424515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.424698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.424933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:16.425042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401662878432319:8039], now have 1 active actors on pipe
2025-10-15T11:00:16.425081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401662878432208:2467], now have 1 active actors on pipe
2025-10-15T11:00:16.425103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401662878432302:8773], now have 1 active actors on pipe
2025-10-15T11:00:16.425129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401665678123765:7874]
2025-10-15T11:00:16.425144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401665678123765:7874]
2025-10-15T11:00:16.425159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401665678123765:7874]
2025-10-15T11:00:16.425190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:16.425265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:16.425267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:16.425286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:16.425300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:16.425449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:16.425468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:16.425543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:16.425562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:16.425708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401665678123765:7874]
2025-10-15T11:00:16.425735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:16.425810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:16.425828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:16.425841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:16.425860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:16.425870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:16.425906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:16.425949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:16.426080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:16.424748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 786, pipe: [1:7561401662878432319:8039]
2025-10-15T11:00:16.424859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 786
2025-10-15T11:00:16.424947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 786
2025-10-15T11:00:16.432726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:16.432778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:16.432869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:16.434150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 787 partition: 0 MaxSeqNo: 46 sessionId: src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0
2025-10-15T11:00:16.435901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90d34a24-ab2f89c1-dade1fbd-1496b701_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:16.555059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0] Write session: try to update token
2025-10-15T11:00:16.555131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:16.570169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:16.570208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:16.570222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:16.570285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:16.570303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:16.570317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:16.570330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:16.570370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401665678123765:7874]
2025-10-15T11:00:16.570398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401665678123765:7874]
2025-10-15T11:00:16.570424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401665678123765:7874]
2025-10-15T11:00:16.570626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:16.570650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:16.571873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:16.574398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:16.574458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:16.574487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:16.714292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId: src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:16.729718Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:16.769369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:16.769407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:16.769456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401665678123765:7874]
2025-10-15T11:00:16.769827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:16.783820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401662878432319:8039]
2025-10-15T11:00:16.783916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:16.784083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:16.784103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:16.852079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 787 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0
2025-10-15T11:00:16.852341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 787 sessionId: src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0 is DEAD
2025-10-15T11:00:16.856099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T11:00:16.856170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0] Write session will restart in 0.005454s
2025-10-15T11:00:16.856341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0] Write session: Do CDS request
2025-10-15T11:00:16.856390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:16.872040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:16.875447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:16.875481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 788
2025-10-15T11:00:16.875886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:16.876019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:16.876036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:16.876046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:16.877540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 788 sessionId:  describe result for acl check
2025-10-15T11:00:16.877662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:16.877673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:16.877682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:16.877699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401662878432444:8785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:16.880786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401662878432444:8785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:16.880209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:16.883794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401662878432460:8039]
2025-10-15T11:00:16.886033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:16.886932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:16.886952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:16.887011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:16.887270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:16.887498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401665678123918:7883]
2025-10-15T11:00:16.889202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:16.894740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401662878432444:8785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:16.894699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:16.894961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:16.896263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:16.896592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:16.896601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:16.896608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:16.896615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:16.896622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:16.896629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:16.896636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:16.896643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:16.896649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:16.896656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:16.896664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:16.896671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.896678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.896685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.896730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:16.896834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:16.896880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:16.896923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:16.896966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:16.897038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:16.897092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:16.897135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:16.897181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:16.897230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:16.897273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:16.897316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.897360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.897409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.897450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:16.897514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:16.897578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:16.897633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:16.897680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:16.897733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:16.897778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:16.897827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:16.897872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:16.897926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:16.897975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:16.898061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:16.898125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:16.898187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:16.898236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:16.898290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:16.898337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:16.898390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:16.898434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:16.898486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:16.898530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:16.898582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:16.898626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.898694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.898744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.898795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.898838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.898890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.900223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:16.904945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401662878432444:8785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:16.904992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401662878432444:8785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:16.905011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401662878432444:8785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:16.905044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:16.923646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:16.933375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:16.933423Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:16.933440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:16.933460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:16.933485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 787 [2:7561401665678123918:7883]
2025-10-15T11:00:16.933535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:16.933591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:16.933606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:16.933618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:16.933630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:16.933680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:16.933704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:16.933727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:16.936099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.936126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.936141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.936152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:16.936420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:16.936439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:16.936580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:16.936761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:16.936992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:16.937065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401665678123913:7883]
2025-10-15T11:00:16.937080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401665678123913:7883]
2025-10-15T11:00:16.937094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401665678123913:7883]
2025-10-15T11:00:16.937129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:16.937180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:16.937313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:16.937330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:16.937346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:16.937360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:16.937374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:16.937432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401662878432354:2467], now have 1 active actors on pipe
2025-10-15T11:00:16.937445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401665678123913:7883]
2025-10-15T11:00:16.937461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:16.937519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:16.938191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401662878432479:8785], now have 1 active actors on pipe
2025-10-15T11:00:16.938214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401662878432460:8039], now have 1 active actors on pipe
2025-10-15T11:00:16.939212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:16.939255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:16.939336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:16.939383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:16.938916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 787
2025-10-15T11:00:16.939415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:16.939431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:16.939031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 787
2025-10-15T11:00:16.939471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:16.939086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 787, pipe: [1:7561401662878432460:8039]
2025-10-15T11:00:16.939523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:16.939589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:16.940281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:16.940307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:16.940423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:16.940879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 788 partition: 0 MaxSeqNo: 46 sessionId: src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0
2025-10-15T11:00:16.948085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bac3458-afc2fc48-8d539a2b-e96a36de_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:16.990369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0] Write session: try to update token
2025-10-15T11:00:16.990435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:17.102185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:17.102217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:17.102228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:17.102288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:17.102311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:17.102323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:17.102333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:17.102366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401665678123913:7883]
2025-10-15T11:00:17.102389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401665678123913:7883]
2025-10-15T11:00:17.102411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401665678123913:7883]
2025-10-15T11:00:17.102589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:17.102608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:17.103486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:17.103533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:17.103566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:17.103954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:17.112269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId: src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:17.136035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:17.256289Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:17.275728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:17.275776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:17.275847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:17.275861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:17.275904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401665678123913:7883]
2025-10-15T11:00:17.276200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:17.280322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:17.280373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:17.277057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:17.282091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401662878432460:8039]
2025-10-15T11:00:17.282252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:17.307165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:17.307275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0] Write session will restart in 0.007432s
2025-10-15T11:00:17.307456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0] Write session: Do CDS request
2025-10-15T11:00:17.307490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:17.306227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 788 reason: error at write: Disconnected sessionId: src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0
2025-10-15T11:00:17.306571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 788 sessionId: src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0 is DEAD
2025-10-15T11:00:17.324234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:17.324610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:17.324641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 789
2025-10-15T11:00:17.325302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:17.325428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:17.325444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:17.325455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:17.327975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 789 sessionId:  describe result for acl check
2025-10-15T11:00:17.328094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:17.328105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:17.328115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:17.328133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401667173399826:8792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:17.330962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401667173399826:8792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:17.347750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401667173399826:8792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:17.359263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401667173399826:8792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:17.359305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401667173399826:8792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:17.359322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401667173399826:8792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:17.359377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:17.360996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:17.364508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:17.365420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:17.365442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:17.365491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:17.365769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:17.365934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401669973091343:7887]
2025-10-15T11:00:17.367609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:17.368665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:17.368804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:17.369697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:17.369908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:17.369914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:17.369918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:17.369923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:17.369928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:17.369932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:17.369937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:17.369942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:17.369947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:17.369952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:17.369956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:17.369961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.369967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.369972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.370008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:17.370091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:17.370126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:17.370158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:17.370193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:17.370227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:17.370262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:17.370295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:17.370327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:17.370360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:17.370394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:17.370428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.370459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.370492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.370519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:17.370566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:17.370606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:17.370644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:17.370677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:17.370712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:17.370744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:17.370781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:17.370812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:17.370848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:17.370879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:17.370915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:17.370945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:17.370981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:17.371031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:17.371067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:17.371097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:17.371133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:17.371163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:17.371199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:17.371229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:17.371267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:17.371298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.371333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.371385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.371423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.371451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.371488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.372002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:17.380196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401667173399920:8039]
2025-10-15T11:00:17.396653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:17.405698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:17.405754Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:17.405773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:17.405794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:17.405823Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 788 [2:7561401669973091343:7887]
2025-10-15T11:00:17.405879Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:17.405945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:17.405962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:17.405975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:17.405987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:17.406037Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:17.406061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:17.406085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:17.423693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.423728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.423740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.423751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:17.424031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:17.424058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.424202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.424401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.424898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 788, pipe: [1:7561401667173399920:8039]
2025-10-15T11:00:17.425011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 788
2025-10-15T11:00:17.425083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 788
2025-10-15T11:00:17.424643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:17.424740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401667173399920:8039], now have 1 active actors on pipe
2025-10-15T11:00:17.424763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401667173399913:8792], now have 1 active actors on pipe
2025-10-15T11:00:17.424785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401667173399801:2467], now have 1 active actors on pipe
2025-10-15T11:00:17.424812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401669973091337:7887]
2025-10-15T11:00:17.424827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401669973091337:7887]
2025-10-15T11:00:17.424840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401669973091337:7887]
2025-10-15T11:00:17.424880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:17.424919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:17.424936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:17.424949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:17.424957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:17.425148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:17.425166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:17.425291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401669973091337:7887]
2025-10-15T11:00:17.425310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:17.425373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:17.425436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:17.425458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:17.425564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:17.425595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:17.425614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:17.425625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:17.425662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:17.425703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:17.425752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:17.426839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:17.426875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:17.426959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:17.427232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 789 partition: 0 MaxSeqNo: 46 sessionId: src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0
2025-10-15T11:00:17.428061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3ef0eea-53ea5bf7-691569eb-b949ccad_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:17.464661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0] Write session: try to update token
2025-10-15T11:00:17.464726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:17.500438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:17.500478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:17.500507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:17.500525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:17.500579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401669973091337:7887]
2025-10-15T11:00:17.500609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401669973091337:7887]
2025-10-15T11:00:17.500635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401669973091337:7887]
2025-10-15T11:00:17.500821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:17.500846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:17.501982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:17.502018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:17.502017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:17.502050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:17.573557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId: src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:17.606405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:17.649741Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:17.651295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:17.651317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:17.652854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401667173399920:8039]
2025-10-15T11:00:17.653018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:17.653246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:17.653271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:17.654803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:17.677351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:17.677438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0] Write session will restart in 0.006639s
2025-10-15T11:00:17.677660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0] Write session: Do CDS request
2025-10-15T11:00:17.677732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:17.676525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 789 reason: error at write: Disconnected sessionId: src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0
2025-10-15T11:00:17.676895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 789 sessionId: src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0 is DEAD
2025-10-15T11:00:17.690266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:17.690301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 790
2025-10-15T11:00:17.692000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:17.692571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:17.692713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:17.692737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:17.692748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:17.694205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 790 sessionId:  describe result for acl check
2025-10-15T11:00:17.694318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:17.694329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:17.694338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:17.694356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401667173399947:8797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:17.697018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401667173399947:8797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:17.713346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401667173399947:8797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:17.729467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401667173399947:8797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:17.729514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401667173399947:8797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:17.729532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401667173399947:8797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:17.729562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:17.753134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401667173400045:8039]
2025-10-15T11:00:17.756013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:17.763952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:17.764948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:17.764967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:17.765006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:17.765300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:17.765486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401669973091491:7896]
2025-10-15T11:00:17.767927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:17.771701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:17.771963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:17.773308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:17.773666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:17.773683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:17.773692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:17.773700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:17.773707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:17.773715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:17.773721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:17.773729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:17.773736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:17.773743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:17.773751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:17.773757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.773765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.773771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.773819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:17.773927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:17.773972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:17.774018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:17.774062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:17.774116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:17.774169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:17.774220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:17.774273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:17.774325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:17.774374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:17.774421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.774470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.774520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.774565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:17.774633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:17.774695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:17.774753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:17.774804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:17.774862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:17.774912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:17.774970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:17.775037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:17.775094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:17.775142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:17.775195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:17.775246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:17.775301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:17.775369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:17.775431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:17.775487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:17.775549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:17.775600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:17.775656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:17.775706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:17.775763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:17.775814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.775874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.775924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.775981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.776031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.776087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.776619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:17.805093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:17.815319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:17.815757Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:17.815781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:17.815799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:17.815824Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 789 [2:7561401669973091491:7896]
2025-10-15T11:00:17.815877Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:17.815936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:17.815950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:17.815963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:17.815974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:17.816024Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:17.816045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:17.816069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:17.817666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.817683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.817696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.817707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:17.817970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:17.817987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:17.818130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:17.818321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:17.818548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:17.818615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401669973091486:7896]
2025-10-15T11:00:17.818629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401669973091486:7896]
2025-10-15T11:00:17.819382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 789, pipe: [1:7561401667173400045:8039]
2025-10-15T11:00:17.818643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401669973091486:7896]
2025-10-15T11:00:17.818776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:17.819506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 789
2025-10-15T11:00:17.818789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:17.819555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 789
2025-10-15T11:00:17.818801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:17.819390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:17.819494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:17.819699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:17.819727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:17.819775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401667173400045:8039], now have 1 active actors on pipe
2025-10-15T11:00:17.819807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401667173400019:8797], now have 1 active actors on pipe
2025-10-15T11:00:17.819833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401667173399928:2467], now have 1 active actors on pipe
2025-10-15T11:00:17.819988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:17.820013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:17.820047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401669973091486:7896]
2025-10-15T11:00:17.820078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:17.820110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:17.820198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:17.820229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:17.820247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:17.820258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:17.820296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:17.820336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:17.820416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:17.827843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:17.827889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:17.827979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:17.831595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 790 partition: 0 MaxSeqNo: 46 sessionId: src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0
2025-10-15T11:00:17.835869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df0bf0fd-52a97b9c-cdbf58e7-83eddcec_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:17.880986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0] Write session: try to update token
2025-10-15T11:00:17.881043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:17.981091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:17.981121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:17.981128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:17.981166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:17.981175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:17.981184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:17.981192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:17.981212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401669973091486:7896]
2025-10-15T11:00:17.981228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401669973091486:7896]
2025-10-15T11:00:17.981241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401669973091486:7896]
2025-10-15T11:00:17.981373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:17.981400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:17.981405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:17.981413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:17.981445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:17.982288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:18.007505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId: src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:18.036100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:18.126037Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:18.141103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:18.141149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:18.141212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:18.141225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:18.141261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401669973091486:7896]
2025-10-15T11:00:18.141546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:18.142360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:18.143389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401667173400045:8039]
2025-10-15T11:00:18.143539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:18.162789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:18.162916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 790 reason: status is not ok: tablet will be restarted right now sessionId: src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0
2025-10-15T11:00:18.163202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 790 sessionId: src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0 is DEAD
2025-10-15T11:00:18.163598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:18.163657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0] Write session will restart in 0.008165s
2025-10-15T11:00:18.163799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0] Write session: Do CDS request
2025-10-15T11:00:18.163844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:18.176397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:18.182940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:18.182972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 791
2025-10-15T11:00:18.183427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:18.183537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:18.183551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:18.183561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:18.184657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 791 sessionId:  describe result for acl check
2025-10-15T11:00:18.184744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:18.184754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:18.184763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:18.184779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401671468367405:8808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:18.187319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401671468367405:8808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:18.196054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401671468367405:8808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:18.205836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401671468367405:8808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:18.205873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401671468367405:8808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:18.205888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401671468367405:8808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:18.205915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:18.219248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:18.227409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:18.228259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:18.228286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:18.228324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:18.228536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:18.228696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401674268058927:7904]
2025-10-15T11:00:18.230635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:18.231655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:18.231845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:18.233020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:18.233319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:18.233337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:18.233344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:18.233352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:18.233359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:18.233365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:18.233371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:18.233377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:18.233383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:18.233389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:18.233395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:18.233401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.233406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.233413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.233454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:18.233547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:18.233589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:18.233631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:18.233670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:18.233726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:18.233768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:18.233818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:18.233864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:18.233912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:18.233960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:18.234003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.234049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.234095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.234131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:18.234194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:18.234251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:18.234323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:18.234376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:18.234426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:18.234478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:18.234529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:18.234580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:18.234631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:18.234672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:18.234720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:18.234762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:18.234809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:18.234851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:18.234900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:18.234943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:18.234990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:18.235043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:18.235100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:18.235148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:18.235202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:18.235247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.235300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.235829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.235912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.235966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.236018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.236545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:18.243438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401671468367508:8039]
2025-10-15T11:00:18.264700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:18.276477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:18.276516Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:18.276530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:18.276545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:18.276567Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 790 [2:7561401674268058927:7904]
2025-10-15T11:00:18.276614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:18.276657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:18.276670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:18.276679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:18.276689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:18.276730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:18.276764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:18.276783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:18.278311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.278333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.278345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.278357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:18.279226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 790
2025-10-15T11:00:18.279308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 790
2025-10-15T11:00:18.279377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 790, pipe: [1:7561401671468367508:8039]
2025-10-15T11:00:18.278621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:18.278642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.278762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.278937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.279155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:18.279229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401671468367474:8808], now have 1 active actors on pipe
2025-10-15T11:00:18.279250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401671468367508:8039], now have 1 active actors on pipe
2025-10-15T11:00:18.279268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401671468367393:2467], now have 1 active actors on pipe
2025-10-15T11:00:18.279289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401674268058921:7904]
2025-10-15T11:00:18.279301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401674268058921:7904]
2025-10-15T11:00:18.279312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401674268058921:7904]
2025-10-15T11:00:18.279365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:18.279427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:18.279469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:18.279480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:18.279491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:18.279608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:18.279624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:18.279747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:18.279760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:18.279780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401674268058921:7904]
2025-10-15T11:00:18.279802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:18.279826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:18.279898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:18.279925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:18.279940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:18.279949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:18.279980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:18.280012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:18.280081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:18.283472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:18.283506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:18.283568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:18.289308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 791 partition: 0 MaxSeqNo: 46 sessionId: src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0
2025-10-15T11:00:18.290415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706e1fb8-caeb71dd-e13672f6-88d81649_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:18.345418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0] Write session: try to update token
2025-10-15T11:00:18.345475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:18.403140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:18.403161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:18.403169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:18.403204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:18.403214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:18.403222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:18.403229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:18.403249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401674268058921:7904]
2025-10-15T11:00:18.403265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401674268058921:7904]
2025-10-15T11:00:18.403279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401674268058921:7904]
2025-10-15T11:00:18.403428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:18.403468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:18.403520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:18.403567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:18.403590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:18.410372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:18.500482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId: src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:18.521590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:18.599526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:18.601055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:18.601082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:18.603934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401671468367508:8039]
2025-10-15T11:00:18.604041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:18.604178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:18.604200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:18.610728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 791 reason: error at write: Disconnected sessionId: src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0
2025-10-15T11:00:18.611049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 791 sessionId: src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0 is DEAD
2025-10-15T11:00:18.611444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:18.611484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0] Write session will restart in 0.009647s
2025-10-15T11:00:18.611592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0] Write session: Do CDS request
2025-10-15T11:00:18.611623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:18.628434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:18.628404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:18.628444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 792
2025-10-15T11:00:18.629107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:18.629330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:18.629375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:18.629397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:18.627690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:18.631651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 792 sessionId:  describe result for acl check
2025-10-15T11:00:18.631751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:18.631761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:18.631770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:18.631785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401671468367541:8815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:18.633956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401671468367541:8815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:18.642652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401671468367541:8815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:18.650981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401671468367541:8815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:18.651029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401671468367541:8815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:18.651045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401671468367541:8815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:18.651073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:18.690359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:18.693889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:18.694835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:18.694854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:18.694899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:18.695192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:18.695397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401674268059070:7909]
2025-10-15T11:00:18.697722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:18.699125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:18.699380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:18.700705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:18.701637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401671468367653:8039]
2025-10-15T11:00:18.701039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:18.701050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:18.701058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:18.701066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:18.701074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:18.701081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:18.701090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:18.701098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:18.701106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:18.701114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:18.701122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:18.701129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.701137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.701145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.701199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:18.701327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:18.701383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:18.701437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:18.701486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:18.701537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:18.701587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:18.701638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:18.701685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:18.701735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:18.701786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:18.701833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.701883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.701934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.701983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:18.702056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:18.702124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:18.702185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:18.702237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:18.702297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:18.702346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:18.702403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:18.702455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:18.702512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:18.702561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:18.702619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:18.702669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:18.702728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:18.702774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:18.702836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:18.702890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:18.702949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:18.703001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:18.703073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:18.703129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:18.703189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:18.703238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.703295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.703399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.703462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.703510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.703571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.704109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:18.718463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:18.726709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:18.726760Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:18.726777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:18.726796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:18.726821Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 791 [2:7561401674268059070:7909]
2025-10-15T11:00:18.726872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:18.726929Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:18.726943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:18.726956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:18.726968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:18.727026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:18.727046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:18.727068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:18.728410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.728438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.728454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.728465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:18.728725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:18.728748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:18.728877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:18.729278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 791, pipe: [1:7561401671468367653:8039]
2025-10-15T11:00:18.729420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 791
2025-10-15T11:00:18.729535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 791
2025-10-15T11:00:18.729057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:18.729297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:18.729372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401671468367576:8815], now have 1 active actors on pipe
2025-10-15T11:00:18.729397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401671468367653:8039], now have 1 active actors on pipe
2025-10-15T11:00:18.729418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401671468367532:2467], now have 1 active actors on pipe
2025-10-15T11:00:18.729443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401674268059065:7909]
2025-10-15T11:00:18.729457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401674268059065:7909]
2025-10-15T11:00:18.729469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401674268059065:7909]
2025-10-15T11:00:18.729508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:18.729557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:18.729574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:18.729577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:18.729586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:18.729744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:18.729762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:18.729874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401674268059065:7909]
2025-10-15T11:00:18.729902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:18.729914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:18.729973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:18.729992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:18.730162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:18.730198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:18.730215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:18.730224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:18.730254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:18.730291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:18.730384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:18.731029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:18.731059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:18.731118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:18.731366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 792 partition: 0 MaxSeqNo: 46 sessionId: src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0
2025-10-15T11:00:18.732020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|302f8ae8-16a039a3-e9b172e0-d3d142c5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:18.757299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0] Write session: try to update token
2025-10-15T11:00:18.757354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:18.876881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:18.876933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:18.876950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:18.876965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:18.877007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401674268059065:7909]
2025-10-15T11:00:18.877036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401674268059065:7909]
2025-10-15T11:00:18.877062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401674268059065:7909]
2025-10-15T11:00:18.877275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:18.877303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:18.877316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:18.877381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:18.877406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:18.877517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:18.877555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:18.877605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:18.878910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId: src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:18.881414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:18.907465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:19.038980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:19.039045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:19.035854Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:19.037292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:19.037317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:19.041257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:19.043780Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T11:00:19.042692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401671468367653:8039]
2025-10-15T11:00:19.042775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:19.042879Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T11:00:19.043385Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 8 consumer shared/user session shared/user_1_8_10521366525245010318_v1 is DEAD
2025-10-15T11:00:19.043892Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401482489788869:8036] disconnected; active server actors: 1
2025-10-15T11:00:19.044408Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T11:00:19.044437Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T11:00:19.044496Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.005887s
2025-10-15T11:00:19.043930Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401482489788869:8036] client user disconnected session shared/user_1_8_10521366525245010318_v1
2025-10-15T11:00:19.059466Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T11:00:19.059509Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 9
2025-10-15T11:00:19.061507Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T11:00:19.062392Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 9 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T11:00:19.062724Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T11:00:19.063149Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 auth for : user
2025-10-15T11:00:19.063610Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 Handle describe topics response
2025-10-15T11:00:19.063716Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 auth is DEAD
2025-10-15T11:00:19.063791Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 auth ok: topics# 1, initDone# 0
2025-10-15T11:00:19.064772Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T11:00:19.065153Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_9_15124978577476656889_v1
2025-10-15T11:00:19.065201Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T11:00:19.065409Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T11:00:19.065391Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401675763334988:8821] connected; active server actors: 1
2025-10-15T11:00:19.065593Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561401675763334988:8821] session shared/user_1_9_15124978577476656889_v1
2025-10-15T11:00:19.065634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T11:00:19.065674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T11:00:19.065706Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_9_15124978577476656889_v1" (Sender=[1:7561401675763334983:8821], Pipe=[1:7561401675763334988:8821], Partitions=[], ActiveFamilyCount=0)
2025-10-15T11:00:19.065726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T11:00:19.065768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T11:00:19.065808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_9_15124978577476656889_v1" (Sender=[1:7561401675763334983:8821], Pipe=[1:7561401675763334988:8821], Partitions=[], ActiveFamilyCount=0)
2025-10-15T11:00:19.065854Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_9_15124978577476656889_v1" sender [1:7561401675763334983:8821] lock partition 0 for ReadingSession "shared/user_1_9_15124978577476656889_v1" (Sender=[1:7561401675763334983:8821], Pipe=[1:7561401675763334988:8821], Partitions=[], ActiveFamilyCount=1) generation 1 step 9
2025-10-15T11:00:19.065892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T11:00:19.065915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000129s
2025-10-15T11:00:19.065980Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T11:00:19.066632Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 9 Session: "shared/user_1_9_15124978577476656889_v1" ClientId: "user" PipeClient { RawX1: 7561401675763334988 RawX2: 4503603922346613 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T11:00:19.066761Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 got read request: guid# eb527b52-9212448-d0f18d1b-85fb4dbb
2025-10-15T11:00:19.066829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T11:00:19.070267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 792 reason: error at write: Disconnected sessionId: src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0
2025-10-15T11:00:19.071083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:19.071173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0] Write session will restart in 0.009779s
2025-10-15T11:00:19.070496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 792 sessionId: src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0 is DEAD
2025-10-15T11:00:19.071397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0] Write session: Do CDS request
2025-10-15T11:00:19.071440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:19.086203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:19.085594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:19.085625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 793
2025-10-15T11:00:19.086819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:19.086963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:19.086979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:19.086991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:19.088570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 793 sessionId:  describe result for acl check
2025-10-15T11:00:19.088690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:19.088711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:19.088721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:19.088740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401675763335036:8825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:19.091644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401675763335036:8825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:19.099404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401675763335036:8825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:19.103945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:19.111271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:19.112201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:19.112242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:19.112285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:19.112347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401675763335036:8825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:19.112386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401675763335036:8825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:19.112401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401675763335036:8825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:19.112430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:19.112526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:19.112696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401678563026498:7912]
2025-10-15T11:00:19.114674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:19.115405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:19.115677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:19.116795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:19.117077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.117085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.117090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.117097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.117102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.117108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.117114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.117120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.117126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.117132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.117138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.117145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.117151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.117156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.117198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.117289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.117332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.117374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.117413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.117452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.117490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.117529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.117568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.117610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.117649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.117689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.117729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.117768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.117804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.117859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.117906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.117955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.117999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.118045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.118087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.118132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.118173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.118222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.118261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.118308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.118350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.118394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.118432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.118477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.118518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.118563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.118602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.118648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.118690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.118736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.118776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.118823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.118886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.118933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.118971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.119030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.119511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:19.138797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:19.151513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:19.151560Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:19.151576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:19.151592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:19.151613Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 792 [2:7561401678563026498:7912]
2025-10-15T11:00:19.151659Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:19.151706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:19.151720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:19.151730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:19.151740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:19.151784Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:19.151804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:19.155256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 792
2025-10-15T11:00:19.155370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 792
2025-10-15T11:00:19.152136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:19.153813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.153829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.153842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.153854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:19.154103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:19.155474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 792, pipe: [1:7561401675763334992:8824]
2025-10-15T11:00:19.154119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.154248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.154442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.154665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:19.154730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401678563026493:7912]
2025-10-15T11:00:19.154741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401678563026493:7912]
2025-10-15T11:00:19.154753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401678563026493:7912]
2025-10-15T11:00:19.154782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:19.154846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:19.154875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:19.154888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:19.154898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:19.155013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:19.155044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:19.155169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401675763335102:8825], now have 1 active actors on pipe
2025-10-15T11:00:19.155192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401675763334978:2467], now have 1 active actors on pipe
2025-10-15T11:00:19.155211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401675763334992:8824], now have 1 active actors on pipe
2025-10-15T11:00:19.155226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401678563026493:7912]
2025-10-15T11:00:19.155257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:19.155712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:19.156002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:19.156034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:19.156132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:19.156146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:19.156173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_9_15124978577476656889_v1 on pipe: [1:7561401675763334992:8824]
2025-10-15T11:00:19.156234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:19.156261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:19.156277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:19.156286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:19.156315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:19.156348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:19.156391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:19.156410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:19.156419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:19.156472Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_9_15124978577476656889_v1
2025-10-15T11:00:19.156483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:19.156605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:19.156652Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T11:00:19.157036Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_9_15124978577476656889_v1:1 with generation 792
2025-10-15T11:00:19.158251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:19.158275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:19.158333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:19.158663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 793 partition: 0 MaxSeqNo: 46 sessionId: src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0
2025-10-15T11:00:19.159486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf28c08-77532a15-b1e6f7ff-b938d164_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:19.161478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T11:00:19.161550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T11:00:19.161571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:19.161581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:19.161590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:19.161615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T11:00:19.161644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T11:00:19.162084Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760526019156 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T11:00:19.162124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T11:00:19.162191Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 sending to client partition status
2025-10-15T11:00:19.194687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0] Write session: try to update token
2025-10-15T11:00:19.194733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:19.232343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:19.232692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:19.232713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:19.232723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:19.232754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401678563026493:7912]
2025-10-15T11:00:19.232777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401678563026493:7912]
2025-10-15T11:00:19.232798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401678563026493:7912]
2025-10-15T11:00:19.233055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:19.233096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:19.233466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:19.233504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:19.233530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:19.237614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:19.289291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId: src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:19.313003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:19.378637Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:19.399919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:19.399928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:19.399940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:19.400082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401675763334992:8824]
2025-10-15T11:00:19.399328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:19.399395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:19.399454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:19.399466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:19.399503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401678563026493:7912]
2025-10-15T11:00:19.399654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:19.400047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_9_15124978577476656889_v1
2025-10-15T11:00:19.400090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:19.410808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 793 reason: error at write: Disconnected sessionId: src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0
2025-10-15T11:00:19.411473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:19.411531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0] Write session will restart in 0.007802s
2025-10-15T11:00:19.411676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0] Write session: Do CDS request
2025-10-15T11:00:19.411728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:19.411110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 793 sessionId: src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0 is DEAD
2025-10-15T11:00:19.424600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:19.424677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:19.424707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 794
2025-10-15T11:00:19.425318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:19.425424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:19.425438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:19.425446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:19.426776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 794 sessionId:  describe result for acl check
2025-10-15T11:00:19.426891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:19.426909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:19.426917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:19.426932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401675763335135:8831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:19.429146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401675763335135:8831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:19.436799Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_9_15124978577476656889_v1
2025-10-15T11:00:19.442209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401675763335135:8831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:19.456749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401675763335135:8831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:19.456786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401675763335135:8831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:19.456802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401675763335135:8831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:19.456830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:19.472368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:19.473915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:19.474575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:19.474605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:19.474642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:19.474849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:19.475014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401678563026646:7920]
2025-10-15T11:00:19.477008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:19.479060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:19.479261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:19.480387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:19.480685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.480692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.480698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.480704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.480711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.480716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.480722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.480727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.480734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.480739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.480745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.480751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.480758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.480765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.480808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.480905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.480946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.480992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.481033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.481074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.481113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.481153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.481192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.481233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.481272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.481313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.481351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.481392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.481427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.481485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.481536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.481585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.481628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.481677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.481718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.481767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.481808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.481859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.481898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.481944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.481983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.482029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.482067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.482114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.482157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.482204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.482243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.482293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.482335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.482383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.483479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.483543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.483601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.483649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.483690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.483748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.484204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:19.503457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401675763335251:8824]
2025-10-15T11:00:19.510530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:19.520761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:19.520798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:19.520812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:19.520828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:19.520847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 793 [2:7561401678563026646:7920]
2025-10-15T11:00:19.520890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:19.520939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:19.520950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:19.520962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:19.520971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:19.521011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:19.521033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:19.521050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:19.523485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.523508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.523520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.523531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:19.523759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:19.523773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.523888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.524046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.524243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:19.524303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401678563026641:7920]
2025-10-15T11:00:19.524329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401678563026641:7920]
2025-10-15T11:00:19.524342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401678563026641:7920]
2025-10-15T11:00:19.524368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:19.524431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:19.524579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:19.524580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:19.524592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:19.524592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:19.524603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:19.524716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401675763335251:8824], now have 1 active actors on pipe
2025-10-15T11:00:19.524749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401675763335195:8831], now have 1 active actors on pipe
2025-10-15T11:00:19.524773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401675763335123:2467], now have 1 active actors on pipe
2025-10-15T11:00:19.524789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401678563026641:7920]
2025-10-15T11:00:19.524821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:19.524946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:19.525548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 793, pipe: [1:7561401675763335251:8824]
2025-10-15T11:00:19.525588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 793
2025-10-15T11:00:19.525651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 793
2025-10-15T11:00:19.526584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:19.526617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:19.526693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bda7264-e10dff00-52161bc8-234270d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:19.526726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:19.526743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:19.526752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:19.526783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:19.526815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:19.526859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:19.531067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:19.531101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:19.531168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:19.531471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 794 partition: 0 MaxSeqNo: 46 sessionId: src_id|3bda7264-e10dff00-52161bc8-234270d4_0
2025-10-15T11:00:19.535619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc909595-4a0fe01e-be84ba72-44cb2604_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3bda7264-e10dff00-52161bc8-234270d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:19.596333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bda7264-e10dff00-52161bc8-234270d4_0] Write session: try to update token
2025-10-15T11:00:19.596392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bda7264-e10dff00-52161bc8-234270d4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:19.648445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:19.648476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:19.648486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:19.648549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:19.648562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:19.648575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:19.648586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:19.648620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401678563026641:7920]
2025-10-15T11:00:19.648646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401678563026641:7920]
2025-10-15T11:00:19.648668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401678563026641:7920]
2025-10-15T11:00:19.648796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:19.648816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:19.648968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:19.648994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:19.649013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:19.656942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:19.735117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId: src_id|3bda7264-e10dff00-52161bc8-234270d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:19.766900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:19.811846Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:19.816817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401675763335251:8824]
2025-10-15T11:00:19.816955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:19.816970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:19.813760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:19.813799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:19.817616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:19.894861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 794 reason: error at write: Disconnected sessionId: src_id|3bda7264-e10dff00-52161bc8-234270d4_0
2025-10-15T11:00:19.895610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bda7264-e10dff00-52161bc8-234270d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:19.895655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bda7264-e10dff00-52161bc8-234270d4_0] Write session will restart in 0.008931s
2025-10-15T11:00:19.895762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bda7264-e10dff00-52161bc8-234270d4_0] Write session: Do CDS request
2025-10-15T11:00:19.895794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bda7264-e10dff00-52161bc8-234270d4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:19.897672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 794 sessionId: src_id|3bda7264-e10dff00-52161bc8-234270d4_0 is DEAD
2025-10-15T11:00:19.914748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bda7264-e10dff00-52161bc8-234270d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:19.913489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:19.919686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401675763335358:8824]
2025-10-15T11:00:19.919742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:19.919755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 795
2025-10-15T11:00:19.920438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:19.920552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:19.920566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:19.920575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:19.922916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 795 sessionId:  describe result for acl check
2025-10-15T11:00:19.923002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:19.923012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:19.923022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:19.923050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401675763335371:8843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:19.925585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401675763335371:8843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:19.927509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:19.930569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:19.931306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:19.931323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:19.931377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:19.931600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:19.931796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401678563026793:7929]
2025-10-15T11:00:19.933970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:19.934754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:19.934932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:19.938602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401675763335371:8843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:19.936120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:19.936429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.936444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.936453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.936460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.936467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.936473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.936479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.936486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.936493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.936502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.936508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.936515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.936521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.936527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.936573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.936673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.936721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.936768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.936814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.936863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.936912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.936962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.937010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.937057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.937102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.937146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.937188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.937231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.937270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.937334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:19.937389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.937442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:19.937491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.937542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:19.937585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.937636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:19.937684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.937736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:19.937778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.937832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:19.937878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.937928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:19.937971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.938024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:19.938072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.938125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:19.938167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.938218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:19.938265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.938316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:19.938358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.938410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:19.938455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.938505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:19.938549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.938599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:19.939094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:19.960461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401675763335371:8843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:19.960507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401675763335371:8843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:19.960527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401675763335371:8843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:19.960561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:19.965409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:19.976889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:19.976933Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:19.976948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:19.976966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:19.976987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 794 [2:7561401678563026793:7929]
2025-10-15T11:00:19.977034Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:19.977084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:19.977097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:19.977107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:19.977116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:19.977160Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:19.977178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:19.977196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:20.001997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.002030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.002042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.002051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:20.002280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:20.002301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.002412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.002581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.002984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 794
2025-10-15T11:00:20.003090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 794, pipe: [1:7561401675763335358:8824]
2025-10-15T11:00:20.003165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 794
2025-10-15T11:00:20.002782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:20.002865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401675763335352:2467], now have 1 active actors on pipe
2025-10-15T11:00:20.002886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401675763335358:8824], now have 1 active actors on pipe
2025-10-15T11:00:20.002903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401675763335405:8843], now have 1 active actors on pipe
2025-10-15T11:00:20.002924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401678563026788:7929]
2025-10-15T11:00:20.002936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401678563026788:7929]
2025-10-15T11:00:20.002947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401678563026788:7929]
2025-10-15T11:00:20.002980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:20.003022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:20.003047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:20.003052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:20.003057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:20.003205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:20.003220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:20.003314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401678563026788:7929]
2025-10-15T11:00:20.003337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:20.003369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:20.003796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:20.003825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:20.003996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ed01702-6494d644-71f39c42-a6f4128e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:20.004025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:20.004041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:20.004050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:20.004078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:20.004111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:20.004170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:20.005158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:20.005182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:20.005238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:20.006715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 795 partition: 0 MaxSeqNo: 46 sessionId: src_id|9ed01702-6494d644-71f39c42-a6f4128e_0
2025-10-15T11:00:20.007564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bda7264-e10dff00-52161bc8-234270d4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9ed01702-6494d644-71f39c42-a6f4128e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:20.060713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed01702-6494d644-71f39c42-a6f4128e_0] Write session: try to update token
2025-10-15T11:00:20.060783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed01702-6494d644-71f39c42-a6f4128e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:20.126549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:20.126582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:20.126593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:20.126698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:20.126712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:20.126725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:20.126736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:20.126766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401678563026788:7929]
2025-10-15T11:00:20.126791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401678563026788:7929]
2025-10-15T11:00:20.126812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401678563026788:7929]
2025-10-15T11:00:20.126926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:20.126957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:20.126987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:20.150543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:20.150583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:20.151662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:20.223495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId: src_id|9ed01702-6494d644-71f39c42-a6f4128e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:20.243913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:20.297577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:20.298919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:20.298936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:20.298977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401678563026788:7929]
2025-10-15T11:00:20.299129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:20.299128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:20.299152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:20.299797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:20.301445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:20.301656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:20.301677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401675763335358:8824]
2025-10-15T11:00:20.311599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 795 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ed01702-6494d644-71f39c42-a6f4128e_0
2025-10-15T11:00:20.311992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 795 sessionId: src_id|9ed01702-6494d644-71f39c42-a6f4128e_0 is DEAD
2025-10-15T11:00:20.312353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed01702-6494d644-71f39c42-a6f4128e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:20.312420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed01702-6494d644-71f39c42-a6f4128e_0] Write session will restart in 0.007245s
2025-10-15T11:00:20.312584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed01702-6494d644-71f39c42-a6f4128e_0] Write session: Do CDS request
2025-10-15T11:00:20.312666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed01702-6494d644-71f39c42-a6f4128e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:20.325216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed01702-6494d644-71f39c42-a6f4128e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:20.327660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:20.327696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 796
2025-10-15T11:00:20.335510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:20.335687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:20.335705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:20.335718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:20.337677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 796 sessionId:  describe result for acl check
2025-10-15T11:00:20.337851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:20.337872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:20.337892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:20.337928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401680058302743:8850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:20.341914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401680058302743:8850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:20.362318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401680058302743:8850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:20.376973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401680058302743:8850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:20.377018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401680058302743:8850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:20.377035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401680058302743:8850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:20.377067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:20.378546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:20.381096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:20.382000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:20.382029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:20.382078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:20.382333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:20.382526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401682857994224:7933]
2025-10-15T11:00:20.384868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:20.388694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:20.389005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:20.390197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:20.390533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:20.390541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:20.390549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:20.390557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:20.390564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:20.390572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:20.390580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:20.390588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:20.390595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:20.390603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:20.390611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:20.390618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.390624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.390631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.390679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:20.390797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:20.390846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:20.390895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:20.390941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:20.390989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:20.391047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:20.391095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:20.391141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:20.391188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:20.391231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:20.391278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.391326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.393583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.393663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:20.393748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:20.393815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:20.393880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:20.393933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:20.393988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:20.394038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:20.394098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:20.394152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:20.394234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:20.394282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:20.394341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:20.394394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:20.394453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:20.394505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:20.394566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:20.394619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:20.394677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:20.394724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:20.394785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:20.394837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:20.394893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:20.394942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.395002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.395064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.395123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.395170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.395227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.395784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:20.411559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401680058302853:8824]
2025-10-15T11:00:20.412124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:20.421044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:20.421097Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:20.421115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:20.421136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:20.421165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 795 [2:7561401682857994224:7933]
2025-10-15T11:00:20.421243Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:20.421310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:20.421333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:20.421346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:20.421358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:20.421410Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:20.421441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:20.421470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:20.422281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.422306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.422319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.422332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:20.422572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:20.422595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.423104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 795
2025-10-15T11:00:20.423193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 795, pipe: [1:7561401680058302853:8824]
2025-10-15T11:00:20.423278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 795
2025-10-15T11:00:20.425290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.425476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.425709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:20.425843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401680058302847:8850], now have 1 active actors on pipe
2025-10-15T11:00:20.425871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401680058302853:8824], now have 1 active actors on pipe
2025-10-15T11:00:20.425895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401680058302727:2467], now have 1 active actors on pipe
2025-10-15T11:00:20.425954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:20.425980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:20.426041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401682857994218:7933]
2025-10-15T11:00:20.426057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401682857994218:7933]
2025-10-15T11:00:20.426071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401682857994218:7933]
2025-10-15T11:00:20.426123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:20.426181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:20.426201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:20.426213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:20.426217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:20.426416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:20.426435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:20.426502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54149819-7da21198-894906e5-9b836c40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:20.426544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:20.426564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:20.426575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:20.426614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:20.426661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:20.426806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401682857994218:7933]
2025-10-15T11:00:20.426837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:20.426875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:20.426885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:20.428509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:20.428559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:20.428646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:20.428996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 796 partition: 0 MaxSeqNo: 46 sessionId: src_id|54149819-7da21198-894906e5-9b836c40_0
2025-10-15T11:00:20.430969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed01702-6494d644-71f39c42-a6f4128e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|54149819-7da21198-894906e5-9b836c40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:20.461879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54149819-7da21198-894906e5-9b836c40_0] Write session: try to update token
2025-10-15T11:00:20.461951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54149819-7da21198-894906e5-9b836c40_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:20.542950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:20.542990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:20.543007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:20.543019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:20.543069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401682857994218:7933]
2025-10-15T11:00:20.543099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401682857994218:7933]
2025-10-15T11:00:20.543125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401682857994218:7933]
2025-10-15T11:00:20.543276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:20.543315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:20.543343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:20.543380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:20.543394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:20.543406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:20.543457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:20.543480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:20.544365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:20.621139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId: src_id|54149819-7da21198-894906e5-9b836c40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:20.641851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:20.706123Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:20.719473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:20.719495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:20.717949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:20.718006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:20.718084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:20.718099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:20.718142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401682857994218:7933]
2025-10-15T11:00:20.718380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:20.718794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:20.723318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401680058302853:8824]
2025-10-15T11:00:20.723512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:20.728824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 796 reason: error at write: Disconnected sessionId: src_id|54149819-7da21198-894906e5-9b836c40_0
2025-10-15T11:00:20.729161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 796 sessionId: src_id|54149819-7da21198-894906e5-9b836c40_0 is DEAD
2025-10-15T11:00:20.730956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54149819-7da21198-894906e5-9b836c40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:20.730993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54149819-7da21198-894906e5-9b836c40_0] Write session will restart in 0.009572s
2025-10-15T11:00:20.731130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54149819-7da21198-894906e5-9b836c40_0] Write session: Do CDS request
2025-10-15T11:00:20.731165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54149819-7da21198-894906e5-9b836c40_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:20.752849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54149819-7da21198-894906e5-9b836c40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:20.755269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:20.755333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 797
2025-10-15T11:00:20.755900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:20.756121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:20.756159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:20.756177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:20.762478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 797 sessionId:  describe result for acl check
2025-10-15T11:00:20.762602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:20.762613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:20.762624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:20.762640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401680058302873:8855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:20.765650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401680058302873:8855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:20.781868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401680058302873:8855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:20.796981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401680058302873:8855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:20.797044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401680058302873:8855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:20.797064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401680058302873:8855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:20.797099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:20.825719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401680058302975:8824]
2025-10-15T11:00:20.842228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:20.853672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:20.854588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:20.854608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:20.854652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:20.854946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:20.855243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401682857994379:7942]
2025-10-15T11:00:20.857925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:20.859441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:20.859718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:20.860997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:20.861344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:20.861363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:20.861371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:20.861378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:20.861385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:20.861392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:20.861400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:20.861407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:20.861413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:20.861420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:20.861440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:20.861448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.861454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.861462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.861510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:20.861618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:20.861668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:20.861718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:20.861773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:20.861829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:20.861880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:20.861931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:20.861984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:20.862038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:20.862089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:20.862141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.862191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.862241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.862289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:20.862362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:20.862429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:20.862491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:20.862544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:20.862602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:20.862651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:20.862712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:20.862763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:20.862825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:20.862871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:20.862925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:20.862975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:20.863030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:20.863089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:20.863148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:20.863199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:20.863252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:20.863300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:20.863654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:20.863718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:20.863772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:20.863825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.863887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.863933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.863991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.864048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.864107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.864631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:20.895664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:20.905614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:20.905662Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:20.905680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:20.905697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:20.905721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 796 [2:7561401682857994379:7942]
2025-10-15T11:00:20.905771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:20.905823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:20.905837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:20.905850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:20.905862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:20.905905Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:20.905927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:20.905947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:20.917276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.917305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.917316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.917327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:20.917571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:20.917592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:20.917713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:20.917870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:20.918079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:20.918142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401682857994373:7942]
2025-10-15T11:00:20.918157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401682857994373:7942]
2025-10-15T11:00:20.918169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401682857994373:7942]
2025-10-15T11:00:20.918206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:20.918273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:20.918438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:20.918452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:20.918560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401682857994373:7942]
2025-10-15T11:00:20.918576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:20.918606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:20.918619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401680058302908:8855], now have 1 active actors on pipe
2025-10-15T11:00:20.918620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:20.918631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:20.918653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:20.918672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401680058302866:2467], now have 1 active actors on pipe
2025-10-15T11:00:20.918691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401680058302975:8824], now have 1 active actors on pipe
2025-10-15T11:00:20.919711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 796
2025-10-15T11:00:20.919801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 796
2025-10-15T11:00:20.919871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 796, pipe: [1:7561401680058302975:8824]
2025-10-15T11:00:20.920336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:20.920373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:20.920457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:20.920491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:20.920506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:20.920516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:20.920549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:20.920584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:20.920628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:20.921770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:20.921801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:20.922121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 797 partition: 0 MaxSeqNo: 46 sessionId: src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0
2025-10-15T11:00:20.921859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:20.923924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54149819-7da21198-894906e5-9b836c40_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:20.980978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0] Write session: try to update token
2025-10-15T11:00:20.981031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:20.990409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:20.990447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:20.990479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401682857994373:7942]
2025-10-15T11:00:20.990595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:20.991448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:21.002941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:21.016291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:21.036165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:21.044321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:21.048307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:21.049113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:21.049137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:21.049157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:21.049207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:21.094339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:21.094373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:21.094385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:21.094395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:21.094428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401682857994373:7942]
2025-10-15T11:00:21.094454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401682857994373:7942]
2025-10-15T11:00:21.094477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401682857994373:7942]
2025-10-15T11:00:21.094595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:21.094615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:21.094806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:21.094836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:21.094863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:21.095687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:21.163691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId: src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:21.185429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:21.252888Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:21.286073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:21.286118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:21.291603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:21.291630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:21.292055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:21.305279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:21.305315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0] Write session will restart in 0.007330s
2025-10-15T11:00:21.305403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0] Write session: Do CDS request
2025-10-15T11:00:21.305430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:21.303453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 797 reason: error at write: Disconnected sessionId: src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0
2025-10-15T11:00:21.303772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 797 sessionId: src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0 is DEAD
2025-10-15T11:00:21.324682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:21.343549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:21.343679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401680058302975:8824]
2025-10-15T11:00:21.343752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:21.343764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 798
2025-10-15T11:00:21.344763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:21.344874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:21.344887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:21.344897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:21.346121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 798 sessionId:  describe result for acl check
2025-10-15T11:00:21.346239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:21.346249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:21.346259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:21.346275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401684353270346:8866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:21.348766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401684353270346:8866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:21.355649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401684353270346:8866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:21.369554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401684353270346:8866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:21.369594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401684353270346:8866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:21.369611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401684353270346:8866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:21.369638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:21.388333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:21.390012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:21.390602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:21.390615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:21.390640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:21.390803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:21.390910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401687152961823:7950]
2025-10-15T11:00:21.392443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:21.395881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:21.396067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:21.396998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:21.397248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:21.397263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:21.397271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:21.397277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:21.397283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:21.397289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:21.397296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:21.397301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:21.397308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:21.397315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:21.397321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:21.397327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.397333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.397338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.397381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:21.397478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:21.397524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:21.397566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:21.397620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:21.397655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:21.397684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:21.397714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:21.397742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:21.397959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:21.398009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:21.398055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.398102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.398149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.398192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:21.398258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:21.398316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:21.398375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:21.398425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:21.398480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:21.398524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:21.398579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:21.398629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:21.398685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:21.398731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:21.398785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:21.398833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:21.398886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:21.398936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:21.398989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:21.399041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:21.399104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:21.399145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:21.399195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:21.399240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:21.399280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:21.399310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.399363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.399407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.399452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.399480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.399514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.399854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:21.418177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:21.426826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:21.426867Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:21.426883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:21.426901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:21.426922Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 797 [2:7561401687152961823:7950]
2025-10-15T11:00:21.426970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:21.427020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:21.427031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:21.427042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:21.427061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:21.427104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:21.427132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:21.427152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:21.428572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.428589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.428598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.428604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:21.428843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:21.428858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.428978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.429141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.429349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:21.429421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401684353270429:8866], now have 1 active actors on pipe
2025-10-15T11:00:21.429441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401684353270342:2467], now have 1 active actors on pipe
2025-10-15T11:00:21.429463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401687152961818:7950]
2025-10-15T11:00:21.429477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401687152961818:7950]
2025-10-15T11:00:21.429489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401687152961818:7950]
2025-10-15T11:00:21.429526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:21.429588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:21.429768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:21.429786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:21.429895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401687152961818:7950]
2025-10-15T11:00:21.429908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:21.429913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:21.429921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:21.429932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:21.429953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:21.429688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 797
2025-10-15T11:00:21.429776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 797
2025-10-15T11:00:21.430676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:21.430703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:21.430782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:21.430809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:21.430825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:21.430834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:21.430865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:21.430900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:21.430944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:21.441860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 798 partition: 0 MaxSeqNo: 46 sessionId: src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0
2025-10-15T11:00:21.442571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d8b703-696927c4-e4f092d-9b4c68ed_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:21.441284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:21.441323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:21.441393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:21.443579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401684353270466:8824], now have 1 active actors on pipe
2025-10-15T11:00:21.442714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401684353270466:8824]
2025-10-15T11:00:21.443717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 797, pipe: [1:7561401684353270466:8824]
2025-10-15T11:00:21.478849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0] Write session: try to update token
2025-10-15T11:00:21.478899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:21.527422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:21.527463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:21.527477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:21.609408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:21.609450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:21.609468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:21.609483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:21.609523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401687152961818:7950]
2025-10-15T11:00:21.609552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401687152961818:7950]
2025-10-15T11:00:21.609581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401687152961818:7950]
2025-10-15T11:00:21.609745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:21.609771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:21.609792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:21.609840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:21.609874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:21.610916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:21.684906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId: src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:21.710382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:21.826793Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:21.828631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:21.828676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:21.833321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:21.833366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:21.835302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:21.835572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401684353270466:8824]
2025-10-15T11:00:21.839544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 798 reason: error at write: Disconnected sessionId: src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0
2025-10-15T11:00:21.839943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 798 sessionId: src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0 is DEAD
2025-10-15T11:00:21.840723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:21.840760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0] Write session will restart in 0.005979s
2025-10-15T11:00:21.840868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0] Write session: Do CDS request
2025-10-15T11:00:21.840901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:21.866243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:21.872693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:21.873282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:21.873336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 799
2025-10-15T11:00:21.873909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:21.874104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:21.874140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:21.874161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:21.876118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 799 sessionId:  describe result for acl check
2025-10-15T11:00:21.876233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:21.876242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:21.876252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:21.876268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401684353270499:8874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:21.879787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401684353270499:8874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:21.905958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401684353270499:8874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:21.925162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401684353270499:8874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:21.925203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401684353270499:8874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:21.925221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401684353270499:8874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:21.925250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:21.928506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:21.934137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401684353270607:8824]
2025-10-15T11:00:21.933752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:21.934477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:21.934495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:21.934535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:21.934742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:21.934883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401687152961975:7956]
2025-10-15T11:00:21.937120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:21.938529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:21.938771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:21.939952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:21.940226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:21.940241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:21.940249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:21.940256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:21.940264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:21.940271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:21.940278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:21.940285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:21.940292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:21.940300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:21.940307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:21.940315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.940322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.940328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.940379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:21.940509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:21.940559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:21.940616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:21.940669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:21.940725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:21.940781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:21.940833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:21.940887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:21.940939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:21.940994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:21.941050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.941101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.941153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.941200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:21.941274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:21.941338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:21.941401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:21.941456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:21.941516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:21.941567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:21.941627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:21.941681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:21.941742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:21.941796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:21.941856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:21.941911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:21.941971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:21.942023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:21.942081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:21.942135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:21.942192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:21.942246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:21.942306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:21.942358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:21.942418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:21.942466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.942524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.942575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.942631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.942684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.942740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.943184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:21.964332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:21.978377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:21.978427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:21.978445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:21.978468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:21.978495Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 798 [2:7561401687152961975:7956]
2025-10-15T11:00:21.978552Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:21.978617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:21.978631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:21.978644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:21.978656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:21.978708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:21.978732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:21.978758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:21.980465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.980497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.980512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.980525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:21.980821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:21.980842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:21.980993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:21.981190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:21.981423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:21.981499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401687152961970:7956]
2025-10-15T11:00:21.981515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401687152961970:7956]
2025-10-15T11:00:21.981529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401687152961970:7956]
2025-10-15T11:00:21.981572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:21.981653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:21.981846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:21.981863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:21.982018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401687152961970:7956]
2025-10-15T11:00:21.982039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:21.982298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:21.982311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:21.982323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:21.982346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:21.984062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401684353270603:8874], now have 1 active actors on pipe
2025-10-15T11:00:21.984112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401684353270484:2467], now have 1 active actors on pipe
2025-10-15T11:00:21.984137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401684353270607:8824], now have 1 active actors on pipe
2025-10-15T11:00:21.983659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 798
2025-10-15T11:00:21.983770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 798
2025-10-15T11:00:21.983839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 798, pipe: [1:7561401684353270607:8824]
2025-10-15T11:00:21.987858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:21.987914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:21.988030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:21.988080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:21.988100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:21.988111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:21.988161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:21.988210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:21.988269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:21.989769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:21.989798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:21.989870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:21.990265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 799 partition: 0 MaxSeqNo: 46 sessionId: src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0
2025-10-15T11:00:21.992295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b81e5f4-83de3424-853d5468-8f24d2a2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:22.032494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0] Write session: try to update token
2025-10-15T11:00:22.032561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:22.032446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:22.032481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:22.032519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401687152961970:7956]
2025-10-15T11:00:22.032626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:22.033787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:22.041353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:22.053999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:22.073866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:22.075210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:22.076815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:22.077210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:22.084408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:22.084434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:22.084445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:22.130270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:22.130300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:22.130313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:22.130323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:22.130360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401687152961970:7956]
2025-10-15T11:00:22.130385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401687152961970:7956]
2025-10-15T11:00:22.130410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401687152961970:7956]
2025-10-15T11:00:22.130545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:22.130557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:22.130570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:22.130584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:22.130634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:22.134367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:22.197823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId: src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:22.231144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:22.279293Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:22.284213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:22.284260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:22.286046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:22.286078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:22.288782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:22.289041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401684353270607:8824]
2025-10-15T11:00:22.291976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:22.305167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:22.305249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0] Write session will restart in 0.009854s
2025-10-15T11:00:22.305444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0] Write session: Do CDS request
2025-10-15T11:00:22.305490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:22.304134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 799 reason: error at write: Disconnected sessionId: src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0
2025-10-15T11:00:22.304493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 799 sessionId: src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0 is DEAD
2025-10-15T11:00:22.330741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:22.331691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:22.331731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 800
2025-10-15T11:00:22.332087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:22.332224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:22.332243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:22.332256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:22.333711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 800 sessionId:  describe result for acl check
2025-10-15T11:00:22.333829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:22.333842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:22.333854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:22.333873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401688648237949:8879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:22.336984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401688648237949:8879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:22.343598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401688648237949:8879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:22.352550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401688648237949:8879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:22.352606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401688648237949:8879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:22.352623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401688648237949:8879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:22.352651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:22.387455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401688648238050:8824]
2025-10-15T11:00:22.414808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:22.429399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:22.430048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:22.430069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:22.430098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:22.430261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:22.430377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401691447929417:7964]
2025-10-15T11:00:22.431766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:22.432939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:22.433138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:22.434315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:22.434625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:22.434633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:22.434639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:22.434647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:22.434655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:22.434661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:22.434667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:22.434673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:22.434678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:22.434686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:22.434692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:22.434698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.434705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.434712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.434756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:22.434854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:22.434900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:22.434943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:22.434986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:22.435030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:22.435089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:22.435133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:22.435175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:22.435220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:22.435263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:22.435307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.435341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.435384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.435411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:22.435475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:22.435531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:22.435582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:22.435631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:22.435681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:22.435723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:22.435771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:22.435817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:22.435868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:22.435909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:22.435962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:22.436006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:22.436052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:22.436095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:22.436144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:22.436190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:22.436241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:22.436282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:22.436337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:22.436380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:22.436431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:22.436473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.436524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.436567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.436617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.436657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.436709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.437174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:22.462397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:22.506460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:22.506503Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:22.506517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:22.506534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:22.506554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 799 [2:7561401691447929417:7964]
2025-10-15T11:00:22.506596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:22.506643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:22.506658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:22.506669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:22.506678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:22.506720Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:22.506739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:22.506756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:22.512802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.512835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.512847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.512858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:22.513128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:22.513143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.513276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.513449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.513662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:22.513727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401691447929412:7964]
2025-10-15T11:00:22.513742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401691447929412:7964]
2025-10-15T11:00:22.513754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401691447929412:7964]
2025-10-15T11:00:22.513796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:22.513863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:22.514027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:22.514045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:22.514146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401691447929412:7964]
2025-10-15T11:00:22.514163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:22.515028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:22.515052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:22.515061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:22.515105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:22.516336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401688648238050:8824], now have 1 active actors on pipe
2025-10-15T11:00:22.516362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401688648237983:8879], now have 1 active actors on pipe
2025-10-15T11:00:22.516386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401688648237936:2467], now have 1 active actors on pipe
2025-10-15T11:00:22.517261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 799, pipe: [1:7561401688648238050:8824]
2025-10-15T11:00:22.517368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 799
2025-10-15T11:00:22.517433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 799
2025-10-15T11:00:22.518043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:22.518081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:22.518163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|358f9647-f365308c-e6c9b622-cde203f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:22.518193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:22.518211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:22.518222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:22.518255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:22.518294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:22.518342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:22.526949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:22.526990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:22.527062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:22.535028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f1cb33-d484410c-e8d7c3ea-a676f25f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|358f9647-f365308c-e6c9b622-cde203f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:22.532818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 800 partition: 0 MaxSeqNo: 46 sessionId: src_id|358f9647-f365308c-e6c9b622-cde203f9_0
2025-10-15T11:00:22.579137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|358f9647-f365308c-e6c9b622-cde203f9_0] Write session: try to update token
2025-10-15T11:00:22.579189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|358f9647-f365308c-e6c9b622-cde203f9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:22.622088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:22.622121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:22.622131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:22.622182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:22.622194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:22.622206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:22.622215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:22.622245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401691447929412:7964]
2025-10-15T11:00:22.622267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401691447929412:7964]
2025-10-15T11:00:22.622288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401691447929412:7964]
2025-10-15T11:00:22.622477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:22.622506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:22.622710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:22.622743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:22.622767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:22.624344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:22.702559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId: src_id|358f9647-f365308c-e6c9b622-cde203f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:22.725678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:22.768906Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:22.782071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:22.782115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:22.782173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:22.782187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:22.782227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401691447929412:7964]
2025-10-15T11:00:22.782731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:22.783699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:22.805016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:22.805162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401688648238050:8824]
2025-10-15T11:00:22.805228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:22.833782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 800 reason: status is not ok: tablet will be restarted right now sessionId: src_id|358f9647-f365308c-e6c9b622-cde203f9_0
2025-10-15T11:00:22.834098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 800 sessionId: src_id|358f9647-f365308c-e6c9b622-cde203f9_0 is DEAD
2025-10-15T11:00:22.835878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|358f9647-f365308c-e6c9b622-cde203f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:22.835917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|358f9647-f365308c-e6c9b622-cde203f9_0] Write session will restart in 0.007262s
2025-10-15T11:00:22.836009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|358f9647-f365308c-e6c9b622-cde203f9_0] Write session: Do CDS request
2025-10-15T11:00:22.836036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|358f9647-f365308c-e6c9b622-cde203f9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:22.860502Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:22.860530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 801
2025-10-15T11:00:22.863933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|358f9647-f365308c-e6c9b622-cde203f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:22.866769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:22.866901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:22.866916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:22.866924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:22.869606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 801 sessionId:  describe result for acl check
2025-10-15T11:00:22.869721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:22.869731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:22.869741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:22.869758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401688648238188:8890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:22.872270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401688648238188:8890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:22.879203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401688648238188:8890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:22.884279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:22.888168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:22.888358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401688648238188:8890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:22.888396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401688648238188:8890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:22.888411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401688648238188:8890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:22.888438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:22.889160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:22.889192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:22.889239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:22.889482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:22.889649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401691447929578:7973]
2025-10-15T11:00:22.891896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:22.893085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:22.893277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:22.894489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:22.894799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:22.894807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:22.894814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:22.894820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:22.894826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:22.894832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:22.894839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:22.894846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:22.894853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:22.894860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:22.894867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:22.894874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.894880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.894888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.894930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:22.895026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:22.895069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:22.895124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:22.895167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:22.895212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:22.895256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:22.895303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:22.895365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:22.895411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:22.895454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:22.895494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.895539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.895583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.895627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:22.895689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:22.895741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:22.895795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:22.895842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:22.895892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:22.895936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:22.895987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:22.896033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:22.896085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:22.896132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:22.896185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:22.897442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:22.897521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:22.897574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:22.897626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:22.897676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:22.897731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:22.897786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:22.897837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:22.897880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:22.897930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:22.897975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.898026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.898072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.898123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.898170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.898220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.899039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:22.904284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401688648238226:8824]
2025-10-15T11:00:22.928948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:22.939498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:22.939544Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:22.939561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:22.939579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:22.939602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 800 [2:7561401691447929578:7973]
2025-10-15T11:00:22.939649Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:22.939705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:22.939719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:22.939732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:22.939742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:22.939786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:22.939806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:22.939848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:22.984433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.984458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.984467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.984477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:22.984720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:22.984743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:22.984853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:22.984997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:22.985176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:22.985236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401691447929573:7973]
2025-10-15T11:00:22.985249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401691447929573:7973]
2025-10-15T11:00:22.985259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401691447929573:7973]
2025-10-15T11:00:22.985294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:22.985351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:22.985503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:22.985518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:22.985608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:22.985621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:22.985625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401691447929573:7973]
2025-10-15T11:00:22.985632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:22.985640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:22.985654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:22.986570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401688648238226:8824], now have 1 active actors on pipe
2025-10-15T11:00:22.986605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401688648238099:2467], now have 1 active actors on pipe
2025-10-15T11:00:22.986624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401688648238220:8890], now have 1 active actors on pipe
2025-10-15T11:00:22.987204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 800, pipe: [1:7561401688648238226:8824]
2025-10-15T11:00:22.987297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 800
2025-10-15T11:00:22.987380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 800
2025-10-15T11:00:22.990343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:22.990383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:22.990469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:22.990507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:22.990524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:22.990535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:22.990566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:22.990603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:22.990647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:22.995906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:22.995952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:22.996028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:22.999616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 801 partition: 0 MaxSeqNo: 46 sessionId: src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0
2025-10-15T11:00:23.003135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|358f9647-f365308c-e6c9b622-cde203f9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:23.036489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0] Write session: try to update token
2025-10-15T11:00:23.036546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:23.054704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:23.054737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:23.054749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:23.054800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:23.054814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:23.054848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401691447929573:7973]
2025-10-15T11:00:23.054951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:23.054974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:23.056740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:23.057932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:23.059095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:23.062706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:23.064742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:23.065200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:23.177524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:23.177564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:23.177580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:23.177591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:23.177636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401691447929573:7973]
2025-10-15T11:00:23.177663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401691447929573:7973]
2025-10-15T11:00:23.177687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401691447929573:7973]
2025-10-15T11:00:23.177868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:23.177893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:23.177906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:23.177961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:23.177984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:23.179272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:23.179323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:23.179366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:23.184369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:23.203011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId: src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:23.227399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:23.346590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:23.348137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:23.348172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:23.352538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:23.353055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:23.353203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:23.353215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:23.353816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401688648238226:8824]
2025-10-15T11:00:23.406816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 801 reason: error at write: Disconnected sessionId: src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0
2025-10-15T11:00:23.407189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 801 sessionId: src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0 is DEAD
2025-10-15T11:00:23.407566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:23.407609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0] Write session will restart in 0.006326s
2025-10-15T11:00:23.407709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0] Write session: Do CDS request
2025-10-15T11:00:23.407743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:23.422056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:23.423948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:23.423988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 802
2025-10-15T11:00:23.424446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:23.424572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:23.424589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:23.424599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:23.427291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 802 sessionId:  describe result for acl check
2025-10-15T11:00:23.427418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:23.427435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:23.427445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:23.427462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401692943205654:8898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:23.431889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401692943205654:8898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:23.436519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:23.440178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401692943205654:8898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:23.440771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:23.441496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:23.441508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:23.441547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:23.441737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:23.441893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401695742897015:7977]
2025-10-15T11:00:23.443326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:23.446372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401692943205654:8898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:23.446416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401692943205654:8898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:23.446432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401692943205654:8898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:23.446458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:23.444330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:23.444501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:23.445343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:23.445600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:23.445606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:23.445610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:23.445614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:23.445617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:23.445623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:23.445630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:23.445635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:23.445642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:23.445649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:23.445655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:23.445660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.445666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.445672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.445713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:23.445786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:23.445816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:23.445844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:23.445875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:23.445912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:23.445947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:23.445982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:23.446019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:23.446054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:23.446096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:23.446131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.446172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.446213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.446243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:23.446285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:23.446319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:23.446366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:23.446411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:23.446458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:23.446498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:23.446548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:23.446591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:23.446639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:23.446678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:23.446727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:23.446768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:23.446814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:23.446852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:23.446898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:23.446940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:23.446989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:23.447030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:23.447081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:23.447137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:23.447185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:23.447513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.447583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.447639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.447696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.447737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.447788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.448256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:23.452360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401692943205691:8824]
2025-10-15T11:00:23.476077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:23.485358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:23.485404Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:23.485420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:23.485438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:23.485459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 801 [2:7561401695742897015:7977]
2025-10-15T11:00:23.485508Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:23.485563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:23.485576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:23.485588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:23.485599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:23.485643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:23.485662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:23.485683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:23.486625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.486641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.486654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.486664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:23.487423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:23.487454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.487585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.487504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 801, pipe: [1:7561401692943205691:8824]
2025-10-15T11:00:23.487767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.487623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 801
2025-10-15T11:00:23.487694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 801
2025-10-15T11:00:23.487992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:23.488065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401692943205691:8824], now have 1 active actors on pipe
2025-10-15T11:00:23.488093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401692943205688:8898], now have 1 active actors on pipe
2025-10-15T11:00:23.488119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401692943205559:2467], now have 1 active actors on pipe
2025-10-15T11:00:23.488164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:23.488189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:23.488236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401695742897010:7977]
2025-10-15T11:00:23.488250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401695742897010:7977]
2025-10-15T11:00:23.488261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401695742897010:7977]
2025-10-15T11:00:23.488296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:23.488327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:23.488339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:23.488350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:23.488360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:23.488521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:23.488536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:23.488593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:23.488617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:23.488634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:23.488645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:23.488674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:23.488706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:23.488814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401695742897010:7977]
2025-10-15T11:00:23.488840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:23.488863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:23.488880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:23.491729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:23.491760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:23.491826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:23.492882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e1f107-36858da-c1dc5d09-8fd38d18_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:23.492110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 802 partition: 0 MaxSeqNo: 46 sessionId: src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0
2025-10-15T11:00:23.548614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0] Write session: try to update token
2025-10-15T11:00:23.548683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:23.580828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:23.580872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:23.580916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401695742897010:7977]
2025-10-15T11:00:23.581056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:23.583480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:23.590790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:23.591930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:23.592856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:23.593780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:23.595149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:23.599333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:23.599370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:23.599383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:23.599446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:23.676783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:23.676823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:23.676834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:23.676843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:23.676878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401695742897010:7977]
2025-10-15T11:00:23.676901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401695742897010:7977]
2025-10-15T11:00:23.676930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401695742897010:7977]
2025-10-15T11:00:23.677070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:23.677089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:23.679716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:23.679799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:23.679850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:23.692071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:23.708760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId: src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:23.730228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:23.834542Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:23.837442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:23.837486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:23.838079Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:23.838166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:23.838194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:23.839747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401692943205691:8824]
2025-10-15T11:00:23.839863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:23.849787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 802 reason: error at write: Disconnected sessionId: src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0
2025-10-15T11:00:23.850166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 802 sessionId: src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0 is DEAD
2025-10-15T11:00:23.851617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:23.851658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0] Write session will restart in 0.007732s
2025-10-15T11:00:23.851750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0] Write session: Do CDS request
2025-10-15T11:00:23.851778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:23.875545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:23.875576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 803
2025-10-15T11:00:23.875972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:23.878940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:23.879123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:23.879138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:23.879155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:23.880288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 803 sessionId:  describe result for acl check
2025-10-15T11:00:23.880443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:23.880470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:23.880487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:23.880522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401692943205717:8903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:23.883422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401692943205717:8903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:23.890638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401692943205717:8903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:23.905552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401692943205717:8903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:23.905595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401692943205717:8903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:23.905614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401692943205717:8903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:23.905642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:23.939956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401692943205800:8824]
2025-10-15T11:00:23.973907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:23.975917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:23.976602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:23.976630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:23.976667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:23.976878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:23.977074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401695742897183:7987]
2025-10-15T11:00:23.979109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:23.980604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:23.980819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:23.981990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:23.982276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:23.982283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:23.982290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:23.982298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:23.982304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:23.982310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:23.982317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:23.982324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:23.982330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:23.982337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:23.982343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:23.982348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.982354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.982361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.982403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:23.982498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:23.982542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:23.982585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:23.982628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:23.982671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:23.982713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:23.982754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:23.982795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:23.982837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:23.982878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:23.982921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.982964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.983006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.983040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:23.983115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:23.983167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:23.983218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:23.983265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:23.983316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:23.984067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:23.984130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:23.984179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:23.984228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:23.984271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:23.984322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:23.984368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:23.984419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:23.984461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:23.984513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:23.984562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:23.984611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:23.984652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:23.984703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:23.984747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:23.984797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:23.984842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.984889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:23.984931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.984982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:23.985025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.985076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:23.985543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:24.012530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:24.026645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:24.026778Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:24.026801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:24.026821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:24.026841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 802 [2:7561401695742897183:7987]
2025-10-15T11:00:24.026885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:24.026933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:24.026946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:24.026956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:24.026966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:24.027005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:24.027026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:24.027044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:24.030842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 802
2025-10-15T11:00:24.030923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 802, pipe: [1:7561401692943205800:8824]
2025-10-15T11:00:24.030983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 802
2025-10-15T11:00:24.029688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.029711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.029725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.029734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:24.029980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:24.029997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.030124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.030292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.030500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:24.030583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401692943205702:2467], now have 1 active actors on pipe
2025-10-15T11:00:24.030604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401692943205800:8824], now have 1 active actors on pipe
2025-10-15T11:00:24.030623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401692943205746:8903], now have 1 active actors on pipe
2025-10-15T11:00:24.030644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401695742897178:7987]
2025-10-15T11:00:24.030659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401695742897178:7987]
2025-10-15T11:00:24.030672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401695742897178:7987]
2025-10-15T11:00:24.030705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:24.030770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:24.030926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:24.030940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:24.031038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401695742897178:7987]
2025-10-15T11:00:24.031056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:24.031621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:24.031641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:24.031652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:24.031672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:24.032403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:24.032432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:24.032499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:24.032525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:24.032554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:24.032564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:24.032596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:24.032642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:24.032683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:24.037157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:24.037194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:24.037266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:24.037618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 803 partition: 0 MaxSeqNo: 46 sessionId: src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0
2025-10-15T11:00:24.039128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bca2dc2-8a4aa840-15e0f8c2-81bd7f83_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:24.087077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0] Write session: try to update token
2025-10-15T11:00:24.087147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:24.136011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:24.136045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:24.136056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:24.136065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:24.136098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401695742897178:7987]
2025-10-15T11:00:24.136132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401695742897178:7987]
2025-10-15T11:00:24.136154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401695742897178:7987]
2025-10-15T11:00:24.136258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:24.136288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:24.136295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:24.136306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:24.136311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:24.136315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:24.136397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:24.136415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:24.137838Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:24.205383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId: src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:24.231948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:24.295931Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:24.319679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:24.317575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:24.317624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:24.317704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:24.317718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:24.317757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401695742897178:7987]
2025-10-15T11:00:24.317949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:24.318312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:24.355137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:24.358571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:24.358630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0] Write session will restart in 0.005700s
2025-10-15T11:00:24.358776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0] Write session: Do CDS request
2025-10-15T11:00:24.358817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:24.355571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401692943205800:8824]
2025-10-15T11:00:24.355639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 803 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0
2025-10-15T11:00:24.355936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 803 sessionId: src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0 is DEAD
2025-10-15T11:00:24.372813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:24.373309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:24.373503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 804
2025-10-15T11:00:24.377404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:24.377558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:24.377590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:24.377600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:24.379869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 804 sessionId:  describe result for acl check
2025-10-15T11:00:24.379980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:24.379990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:24.379999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:24.380016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401697238173214:8914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:24.382501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401697238173214:8914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:24.397022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401697238173214:8914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:24.406890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401697238173214:8914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:24.406941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401697238173214:8914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:24.406956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401697238173214:8914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:24.406983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:24.407912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:24.412524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:24.413273Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:24.413289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:24.413322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:24.413536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:24.413713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401700037864633:7994]
2025-10-15T11:00:24.415863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:24.417460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:24.417649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:24.418818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:24.419086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:24.419095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:24.419114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:24.419121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:24.419128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:24.419135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:24.419140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:24.419147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:24.419154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:24.419161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:24.419168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:24.419176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.419183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.419189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.419234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:24.419336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:24.419402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:24.419466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:24.419511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:24.419555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:24.419599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:24.419640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:24.419681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:24.419725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:24.419770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:24.419813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.419857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.419899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.419939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:24.419999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:24.420057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:24.420109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:24.420157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:24.420210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:24.420255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:24.420306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:24.420350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:24.420399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:24.420442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:24.420492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:24.420538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:24.420588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:24.420630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:24.420679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:24.420724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:24.420774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:24.420817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:24.420867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:24.420910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:24.420958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:24.421000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.421049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.421096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.421147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.421190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.421240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.421713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:24.447863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:24.457843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:24.457896Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:24.457912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:24.457930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:24.457954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 803 [2:7561401700037864633:7994]
2025-10-15T11:00:24.458004Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:24.458058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:24.458078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:24.458091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:24.458102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:24.458144Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:24.458165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:24.458184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:24.455487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401697238173315:8824]
2025-10-15T11:00:24.472456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.472488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.472500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.472509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:24.472798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:24.472813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.472936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.473098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.473300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:24.473377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401697238173315:8824], now have 1 active actors on pipe
2025-10-15T11:00:24.473400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401697238173181:2467], now have 1 active actors on pipe
2025-10-15T11:00:24.473420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401697238173309:8914], now have 1 active actors on pipe
2025-10-15T11:00:24.473442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401700037864627:7994]
2025-10-15T11:00:24.473455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401700037864627:7994]
2025-10-15T11:00:24.473466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401700037864627:7994]
2025-10-15T11:00:24.473508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:24.473575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:24.473739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:24.473756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:24.473863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401700037864627:7994]
2025-10-15T11:00:24.473881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:24.474638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:24.474660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:24.474670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:24.474693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:24.475123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:24.475149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:24.475213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a55f6611-618e82e6-e63ae583-723f50e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:24.473648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 803
2025-10-15T11:00:24.475241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:24.475258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:24.473731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 803
2025-10-15T11:00:24.475268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:24.473788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 803, pipe: [1:7561401697238173315:8824]
2025-10-15T11:00:24.475316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:24.475374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:24.475444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:24.477025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:24.477054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:24.477119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:24.478239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d1a3293-4d1810ee-6ab66340-f2b1846a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a55f6611-618e82e6-e63ae583-723f50e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:24.477484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 804 partition: 0 MaxSeqNo: 46 sessionId: src_id|a55f6611-618e82e6-e63ae583-723f50e3_0
2025-10-15T11:00:24.515263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a55f6611-618e82e6-e63ae583-723f50e3_0] Write session: try to update token
2025-10-15T11:00:24.515408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a55f6611-618e82e6-e63ae583-723f50e3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:24.564945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:24.564979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:24.564992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:24.565043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:24.565058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:24.565071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:24.565083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:24.565116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401700037864627:7994]
2025-10-15T11:00:24.565146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401700037864627:7994]
2025-10-15T11:00:24.565171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401700037864627:7994]
2025-10-15T11:00:24.565299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:24.565323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:24.566355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:24.566696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:24.566727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:24.566754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:24.653616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId: src_id|a55f6611-618e82e6-e63ae583-723f50e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:24.677344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:24.717885Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:24.719315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:24.719368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:24.722960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:24.721077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401697238173315:8824]
2025-10-15T11:00:24.721224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:24.721419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:24.721440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:24.762919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 804 reason: error at write: Disconnected sessionId: src_id|a55f6611-618e82e6-e63ae583-723f50e3_0
2025-10-15T11:00:24.763220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 804 sessionId: src_id|a55f6611-618e82e6-e63ae583-723f50e3_0 is DEAD
2025-10-15T11:00:24.763568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55f6611-618e82e6-e63ae583-723f50e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:24.763635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55f6611-618e82e6-e63ae583-723f50e3_0] Write session will restart in 0.007458s
2025-10-15T11:00:24.763788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55f6611-618e82e6-e63ae583-723f50e3_0] Write session: Do CDS request
2025-10-15T11:00:24.763838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55f6611-618e82e6-e63ae583-723f50e3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:24.776638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a55f6611-618e82e6-e63ae583-723f50e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:24.776580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:24.776614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 805
2025-10-15T11:00:24.777199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:24.777314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:24.777335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:24.777344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:24.780065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 805 sessionId:  describe result for acl check
2025-10-15T11:00:24.780175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:24.780192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:24.780201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:24.780217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401697238173343:8923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:24.782575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401697238173343:8923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:24.797456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401697238173343:8923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:24.813322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401697238173343:8923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:24.813373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401697238173343:8923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:24.813393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401697238173343:8923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:24.813429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:24.821090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401697238173450:8824]
2025-10-15T11:00:24.830588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:24.834817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:24.835520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:24.835532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:24.835563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:24.835721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:24.835847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401700037864783:7999]
2025-10-15T11:00:24.838028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:24.840036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:24.840258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:24.841450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:24.841771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:24.841780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:24.841787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:24.841793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:24.841799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:24.841806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:24.841812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:24.841817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:24.841823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:24.841830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:24.841835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:24.841843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.841850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.841857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.841902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:24.842001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:24.842046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:24.842089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:24.842128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:24.842174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:24.842218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:24.842263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:24.842307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:24.842352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:24.842393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:24.842437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.842482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.842523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.842565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:24.842625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:24.842679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:24.842728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:24.842771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:24.842820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:24.842862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:24.842921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:24.842967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:24.843017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:24.843058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:24.843117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:24.843161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:24.843208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:24.843260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:24.843310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:24.843460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:24.843519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:24.843565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:24.843617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:24.843662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:24.843712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:24.843754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.843804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.843857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.843911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.843958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.844004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.844471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:24.859751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:24.873777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:24.873820Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:24.873836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:24.873856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:24.873880Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 804 [2:7561401700037864783:7999]
2025-10-15T11:00:24.873930Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:24.873981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:24.873995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:24.874007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:24.874017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:24.874064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:24.874085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:24.874103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:24.875733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.875758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.875773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.875783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:24.876042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:24.876066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:24.876195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:24.876417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 804, pipe: [1:7561401697238173450:8824]
2025-10-15T11:00:24.876544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 804
2025-10-15T11:00:24.876648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 804
2025-10-15T11:00:24.876382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:24.876606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:24.876677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401697238173450:8824], now have 1 active actors on pipe
2025-10-15T11:00:24.876698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401697238173325:2467], now have 1 active actors on pipe
2025-10-15T11:00:24.876719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401697238173435:8923], now have 1 active actors on pipe
2025-10-15T11:00:24.876744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401700037864778:7999]
2025-10-15T11:00:24.876757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401700037864778:7999]
2025-10-15T11:00:24.876769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401700037864778:7999]
2025-10-15T11:00:24.876798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:24.876865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:24.876864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:24.876877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:24.876889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:24.877022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:24.877037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:24.877175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:24.877194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:24.877220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401700037864778:7999]
2025-10-15T11:00:24.877246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:24.877289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:24.877341Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:24.877367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:24.877383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:24.877392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:24.877423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:24.877456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:24.877536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:24.883766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:24.883804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:24.883874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:24.884247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 805 partition: 0 MaxSeqNo: 46 sessionId: src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0
2025-10-15T11:00:24.887538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a55f6611-618e82e6-e63ae583-723f50e3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:24.924177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0] Write session: try to update token
2025-10-15T11:00:24.924234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:24.969257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:24.969292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:24.969305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:24.969315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:24.969345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401700037864778:7999]
2025-10-15T11:00:24.969363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401700037864778:7999]
2025-10-15T11:00:24.969379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401700037864778:7999]
2025-10-15T11:00:24.969477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:24.969492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:24.969634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:24.969688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:24.969724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:24.986120Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:25.057267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId: src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:25.085342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:25.136613Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:25.138553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:25.138591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:25.140734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:25.140855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:25.140864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401697238173450:8824]
2025-10-15T11:00:25.140878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:25.149028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 805 reason: error at write: Disconnected sessionId: src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0
2025-10-15T11:00:25.149308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 805 sessionId: src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0 is DEAD
2025-10-15T11:00:25.151552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:25.151606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0] Write session will restart in 0.007126s
2025-10-15T11:00:25.151737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0] Write session: Do CDS request
2025-10-15T11:00:25.151782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:25.159324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:25.168331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:25.168359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 806
2025-10-15T11:00:25.172142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:25.172672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:25.172789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:25.172809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:25.172817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:25.177079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 806 sessionId:  describe result for acl check
2025-10-15T11:00:25.177232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:25.177261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:25.177278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:25.177304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401701533140796:8928] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:25.180106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401701533140796:8928] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:25.194940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401701533140796:8928] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:25.211345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401701533140796:8928] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:25.211408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401701533140796:8928] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:25.211424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401701533140796:8928] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:25.211452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:25.237595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:25.240923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401701533140916:8824]
2025-10-15T11:00:25.251933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:25.252703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:25.252717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:25.252752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:25.253001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:25.253176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401704332832232:8008]
2025-10-15T11:00:25.255037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:25.260150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:25.260355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:25.261417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:25.261733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:25.261750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:25.261756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:25.261761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:25.261767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:25.261774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:25.261780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:25.261786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:25.261791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:25.261797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:25.261803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:25.261810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.261815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.261821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.261858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:25.261944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:25.261988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:25.262027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:25.262064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:25.262102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:25.262140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:25.262186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:25.262223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:25.262264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:25.262303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:25.262340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.262376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.262417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.262453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:25.262508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:25.262554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:25.262601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:25.262643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:25.262689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:25.262728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:25.262774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:25.262814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:25.262857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:25.262892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:25.262937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:25.262976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:25.263020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:25.263056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:25.263100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:25.263151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:25.263197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:25.263234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:25.263280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:25.263317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:25.263994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:25.264052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.264100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.264146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.264199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.264244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.264296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.264810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:25.297226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:25.307340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:25.307401Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:25.307415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:25.307431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:25.307453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 805 [2:7561401704332832232:8008]
2025-10-15T11:00:25.307496Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:25.307547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:25.307561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:25.307571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:25.307582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:25.307623Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:25.307643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:25.307661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:25.309195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.309208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.309221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.309231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:25.309854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 805, pipe: [1:7561401701533140916:8824]
2025-10-15T11:00:25.309954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 805
2025-10-15T11:00:25.310019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 805
2025-10-15T11:00:25.310317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:25.310343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.310459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.310615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.310819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:25.310854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401701533140916:8824], now have 1 active actors on pipe
2025-10-15T11:00:25.310876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401701533140875:8928], now have 1 active actors on pipe
2025-10-15T11:00:25.310895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401701533140781:2467], now have 1 active actors on pipe
2025-10-15T11:00:25.310949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401704332832226:8008]
2025-10-15T11:00:25.310961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401704332832226:8008]
2025-10-15T11:00:25.310971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401704332832226:8008]
2025-10-15T11:00:25.311003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:25.311064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:25.311220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:25.311235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:25.311333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401704332832226:8008]
2025-10-15T11:00:25.311364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:25.311670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:25.311683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:25.311693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:25.311711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:25.312341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:25.312370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:25.312431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:25.312458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:25.312474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:25.312483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:25.312512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:25.312546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:25.312583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:25.313283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:25.313303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:25.313354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:25.313654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 806 partition: 0 MaxSeqNo: 46 sessionId: src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0
2025-10-15T11:00:25.315536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecfbca89-c2f9cc87-a6f70c9a-11e047eb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:25.366875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0] Write session: try to update token
2025-10-15T11:00:25.366928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:25.442443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:25.442474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:25.442486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:25.442536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:25.442548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:25.442561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:25.442570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:25.442600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401704332832226:8008]
2025-10-15T11:00:25.442624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401704332832226:8008]
2025-10-15T11:00:25.442644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401704332832226:8008]
2025-10-15T11:00:25.442762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:25.442781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:25.443470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:25.443501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:25.443526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:25.443961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:25.537179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId: src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:25.561189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:25.600373Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:25.602352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:25.602377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:25.604287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:25.604622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401701533140916:8824]
2025-10-15T11:00:25.604767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:25.604787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:25.606725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:25.675452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 806 reason: error at write: Disconnected sessionId: src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0
2025-10-15T11:00:25.675756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 806 sessionId: src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0 is DEAD
E1015 11:00:25.680438483  821271 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-15T11:00:25.683413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:25.683448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0] Write session will restart in 0.009574s
2025-10-15T11:00:25.683535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0] Write session: Do CDS request
2025-10-15T11:00:25.683563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:25.700513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:25.700557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 807
2025-10-15T11:00:25.700968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:25.701423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:25.701546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:25.701562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:25.701572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:25.703248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 807 sessionId:  describe result for acl check
2025-10-15T11:00:25.703375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:25.703386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:25.703396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:25.703412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401701533141046:8939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:25.705975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401701533141048:8824]
2025-10-15T11:00:25.706080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401701533141046:8939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:25.715674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401701533141046:8939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:25.719562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:25.726603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401701533141046:8939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:25.726646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401701533141046:8939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:25.726663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401701533141046:8939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:25.726686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:25.725601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:25.726470Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:25.726490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:25.726535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:25.726814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:25.727002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401704332832399:8016]
2025-10-15T11:00:25.729362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:25.730482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:25.730711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:25.732233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:25.732593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:25.732602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:25.732610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:25.732618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:25.732626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:25.732634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:25.732641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:25.732650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:25.732657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:25.732664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:25.732673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:25.732680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.732688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.732696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.732747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:25.732865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:25.732916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:25.732967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:25.733014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:25.733066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:25.733114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:25.733164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:25.733213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:25.733260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:25.733309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:25.733356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.733405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.733452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.733498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:25.733570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:25.733633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:25.733692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:25.733744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:25.733805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:25.733856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:25.733913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:25.733964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:25.734021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:25.734071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:25.734129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:25.734179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:25.734237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:25.734288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:25.734344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:25.734397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:25.734456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:25.734505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:25.734563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:25.734611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:25.734668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:25.734717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.734775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.734822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.734877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.734924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.734982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.736718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:25.758922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:25.777357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:25.777395Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:25.777410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:25.777430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:25.777453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 806 [2:7561401704332832399:8016]
2025-10-15T11:00:25.777502Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:25.777545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:25.777555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:25.777569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:25.777577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:25.777606Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:25.777623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:25.777644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:25.790747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.790981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.791001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.791012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:25.791329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:25.791355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:25.791471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:25.791628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:25.791842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:25.791922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401701533141078:8939], now have 1 active actors on pipe
2025-10-15T11:00:25.791943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401701533140945:2467], now have 1 active actors on pipe
2025-10-15T11:00:25.791963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401701533141048:8824], now have 1 active actors on pipe
2025-10-15T11:00:25.791987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401704332832393:8016]
2025-10-15T11:00:25.792001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401704332832393:8016]
2025-10-15T11:00:25.792014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401704332832393:8016]
2025-10-15T11:00:25.792053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:25.792108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:25.792123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:25.792124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:25.792135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:25.792283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:25.792299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:25.792409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401704332832393:8016]
2025-10-15T11:00:25.792439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:25.792467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:25.794429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:25.794461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:25.794547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:25.794581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:25.794603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:25.794613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:25.794644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:25.794679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:25.794718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:25.795252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:25.795278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:25.795360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:25.793890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 806
2025-10-15T11:00:25.793977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 806
2025-10-15T11:00:25.794034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 806, pipe: [1:7561401701533141048:8824]
2025-10-15T11:00:25.796603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|312d0aa5-e3ad123c-23fd1edc-f923c78c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:25.795920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 807 partition: 0 MaxSeqNo: 46 sessionId: src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0
2025-10-15T11:00:25.822132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0] Write session: try to update token
2025-10-15T11:00:25.822186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:25.849354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:25.849386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:25.849430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401704332832393:8016]
2025-10-15T11:00:25.849547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:25.851259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:25.851488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:25.854225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:25.855605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:25.857534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:25.861255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:25.864695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:25.879675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:25.879703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:25.879721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:25.979535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId: src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:26.006282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:26.006316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:26.006329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:26.006380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:26.006393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:26.006405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:26.006414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:26.006449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401704332832393:8016]
2025-10-15T11:00:26.006473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401704332832393:8016]
2025-10-15T11:00:26.006497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401704332832393:8016]
2025-10-15T11:00:26.006627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:26.006646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:26.007765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:26.007803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:26.007828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:26.008283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:26.022195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:26.163337Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:26.164641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:26.164663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:26.165459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:26.166491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:26.166918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:26.167170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401701533141048:8824]
2025-10-15T11:00:26.175007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 807 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0
2025-10-15T11:00:26.175667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:26.175701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0] Write session will restart in 0.005471s
2025-10-15T11:00:26.175800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0] Write session: Do CDS request
2025-10-15T11:00:26.175846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:26.175638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 807 sessionId: src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0 is DEAD
2025-10-15T11:00:26.208551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:26.209843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:26.209870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 808
2025-10-15T11:00:26.210223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:26.210322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:26.210335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:26.210343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:26.211737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 808 sessionId:  describe result for acl check
2025-10-15T11:00:26.211839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:26.211848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:26.211856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:26.211870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401705828108434:8947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:26.215058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401705828108434:8947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:26.244272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401705828108434:8947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:26.270389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401705828108533:8824]
2025-10-15T11:00:26.271212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401705828108434:8947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:26.271242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401705828108434:8947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:26.271261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401705828108434:8947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:26.271293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:26.295305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:26.305784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:26.306593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:26.306622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:26.306665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:26.306903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:26.307092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401708627799845:8021]
2025-10-15T11:00:26.309702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:26.310827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:26.311049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:26.312350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:26.312672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:26.312691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:26.312699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:26.312705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:26.312712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:26.312719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:26.312726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:26.312734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:26.312741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:26.312747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:26.312754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:26.312761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.312768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.312775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.312821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:26.312924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:26.312973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:26.313022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:26.313076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:26.313124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:26.313174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:26.313222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:26.313268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:26.313320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:26.313371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:26.313421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.313470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.313520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.313567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:26.313635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:26.313696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:26.313752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:26.313808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:26.313867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:26.313911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:26.313965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:26.314011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:26.314063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:26.314105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:26.314160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:26.314204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:26.314254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:26.314297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:26.314349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:26.314399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:26.314451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:26.314496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:26.314549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:26.314595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:26.314650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:26.314692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.314746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.314792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.314841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.314885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.314935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.315456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:26.336590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:26.347624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:26.347665Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:26.347682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:26.347701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:26.347728Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 807 [2:7561401708627799845:8021]
2025-10-15T11:00:26.347782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:26.347841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:26.347856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:26.347869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:26.347879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:26.347925Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:26.347945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:26.347964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:26.348922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.348937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.348950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.348963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:26.349221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:26.349237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.349376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.349565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.349804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:26.349867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401708627799838:8021]
2025-10-15T11:00:26.349880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401708627799838:8021]
2025-10-15T11:00:26.349894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401708627799838:8021]
2025-10-15T11:00:26.349935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:26.350004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:26.350176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:26.350193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:26.350300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401708627799838:8021]
2025-10-15T11:00:26.350318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:26.351407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:26.351432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:26.351443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:26.351467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:26.352974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 807, pipe: [1:7561401705828108533:8824]
2025-10-15T11:00:26.353112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 807
2025-10-15T11:00:26.353205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 807
2025-10-15T11:00:26.353854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401705828108533:8824], now have 1 active actors on pipe
2025-10-15T11:00:26.353886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401705828108415:2467], now have 1 active actors on pipe
2025-10-15T11:00:26.353910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401705828108536:8947], now have 1 active actors on pipe
2025-10-15T11:00:26.357653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:26.357678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:26.358811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 808 partition: 0 MaxSeqNo: 46 sessionId: src_id|11006504-6b5fc564-fe096369-31c83040_0
2025-10-15T11:00:26.359586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bc3f7d-2a1a964c-2d4690b1-75a27d52_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|11006504-6b5fc564-fe096369-31c83040_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:26.357753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11006504-6b5fc564-fe096369-31c83040_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:26.357796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:26.357812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:26.357823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:26.357859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:26.357897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:26.357940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:26.358466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:26.358483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:26.358540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:26.391774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11006504-6b5fc564-fe096369-31c83040_0] Write session: try to update token
2025-10-15T11:00:26.391826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11006504-6b5fc564-fe096369-31c83040_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:26.439335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:26.439382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:26.439393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:26.439403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:26.439431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401708627799838:8021]
2025-10-15T11:00:26.439454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401708627799838:8021]
2025-10-15T11:00:26.439476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401708627799838:8021]
2025-10-15T11:00:26.439651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:26.439670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:26.440650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:26.440708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:26.440743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:26.440769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:26.502081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId: src_id|11006504-6b5fc564-fe096369-31c83040_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:26.520735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:26.607327Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:26.634339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:26.634381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:26.634440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:26.634452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:26.634488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401708627799838:8021]
2025-10-15T11:00:26.635193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:26.637854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:26.636694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401705828108533:8824]
2025-10-15T11:00:26.636768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:26.636866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:26.636877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:26.662189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 808 reason: error at write: Disconnected sessionId: src_id|11006504-6b5fc564-fe096369-31c83040_0
2025-10-15T11:00:26.662467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 808 sessionId: src_id|11006504-6b5fc564-fe096369-31c83040_0 is DEAD
2025-10-15T11:00:26.663590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11006504-6b5fc564-fe096369-31c83040_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:26.663641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11006504-6b5fc564-fe096369-31c83040_0] Write session will restart in 0.005118s
2025-10-15T11:00:26.663794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11006504-6b5fc564-fe096369-31c83040_0] Write session: Do CDS request
2025-10-15T11:00:26.663831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11006504-6b5fc564-fe096369-31c83040_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:26.678625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11006504-6b5fc564-fe096369-31c83040_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:26.679013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:26.679045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 809
2025-10-15T11:00:26.679731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:26.679854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:26.679876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:26.679899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:26.681179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 809 sessionId:  describe result for acl check
2025-10-15T11:00:26.681294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:26.681310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:26.681320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:26.681336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401705828108581:8951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:26.687958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401705828108581:8951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:26.698556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401705828108581:8951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:26.707686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401705828108581:8951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:26.707726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401705828108581:8951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:26.707740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401705828108581:8951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:26.707766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:26.717725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:26.723195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:26.724062Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:26.724080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:26.724121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:26.724358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:26.724535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401708627800010:8030]
2025-10-15T11:00:26.726580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:26.727682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:26.727877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:26.730044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:26.730372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:26.730381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:26.730388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:26.730393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:26.730399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:26.730405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:26.730411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:26.730418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:26.730424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:26.730431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:26.730437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:26.730443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.730449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.730457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.730496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:26.730587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:26.730631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:26.730671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:26.730713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:26.730757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:26.730799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:26.730840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:26.730881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:26.730924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:26.730966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:26.731009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.731050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.731091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.731128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:26.731199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:26.731251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:26.731305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:26.731368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:26.731421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:26.731461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:26.731510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:26.731558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:26.731609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:26.731654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:26.731703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:26.731744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:26.731797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:26.731850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:26.731903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:26.731949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:26.731997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:26.732042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:26.732091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:26.732133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:26.732181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:26.732221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.732270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.732310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.732358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.732396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.732445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.732891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:26.739455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401705828108705:8824]
2025-10-15T11:00:26.763876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:26.786519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:26.786561Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:26.786575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:26.786590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:26.786613Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 808 [2:7561401708627800010:8030]
2025-10-15T11:00:26.786661Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:26.786710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:26.786724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:26.786736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:26.786746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:26.786790Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:26.786809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:26.786829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:26.788631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.788657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.788670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.788680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:26.788916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:26.788931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:26.790173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:26.790350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:26.790556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:26.790630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401705828108566:2467], now have 1 active actors on pipe
2025-10-15T11:00:26.790654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401705828108696:8951], now have 1 active actors on pipe
2025-10-15T11:00:26.790676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401705828108705:8824], now have 1 active actors on pipe
2025-10-15T11:00:26.790698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401708627800005:8030]
2025-10-15T11:00:26.790713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401708627800005:8030]
2025-10-15T11:00:26.790725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401708627800005:8030]
2025-10-15T11:00:26.790757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:26.790820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:26.790979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:26.790994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:26.791094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401708627800005:8030]
2025-10-15T11:00:26.791112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:26.791574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:26.791593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:26.791603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:26.791623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:26.792415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:26.792441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:26.792501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4350d56a-911ebc1-1a282581-2a6150b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:26.792528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:26.792543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:26.792557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:26.792596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:26.792632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:26.792673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:26.790470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 808
2025-10-15T11:00:26.790571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 808
2025-10-15T11:00:26.790625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 808, pipe: [1:7561401705828108705:8824]
2025-10-15T11:00:26.793322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:26.793345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:26.793398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:26.794751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 809 partition: 0 MaxSeqNo: 46 sessionId: src_id|4350d56a-911ebc1-1a282581-2a6150b_0
2025-10-15T11:00:26.798909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11006504-6b5fc564-fe096369-31c83040_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4350d56a-911ebc1-1a282581-2a6150b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:26.851727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4350d56a-911ebc1-1a282581-2a6150b_0] Write session: try to update token
2025-10-15T11:00:26.851781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4350d56a-911ebc1-1a282581-2a6150b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:26.927666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:26.927698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:26.927708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:26.927759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:26.927771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:26.927784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:26.927795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:26.927825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401708627800005:8030]
2025-10-15T11:00:26.927848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401708627800005:8030]
2025-10-15T11:00:26.927870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401708627800005:8030]
2025-10-15T11:00:26.927996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:26.928015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:26.928259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:26.928300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:26.928327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:26.934081Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:27.023441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId: src_id|4350d56a-911ebc1-1a282581-2a6150b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:27.058084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:27.098812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:27.100895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:27.100935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:27.104937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:27.103699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:27.104021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:27.104042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:27.182545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401705828108705:8824]
2025-10-15T11:00:27.182650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 809 reason: error at write: Disconnected sessionId: src_id|4350d56a-911ebc1-1a282581-2a6150b_0
2025-10-15T11:00:27.182977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 809 sessionId: src_id|4350d56a-911ebc1-1a282581-2a6150b_0 is DEAD
2025-10-15T11:00:27.184853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4350d56a-911ebc1-1a282581-2a6150b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:27.184911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4350d56a-911ebc1-1a282581-2a6150b_0] Write session will restart in 0.007584s
2025-10-15T11:00:27.185041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4350d56a-911ebc1-1a282581-2a6150b_0] Write session: Do CDS request
2025-10-15T11:00:27.185076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4350d56a-911ebc1-1a282581-2a6150b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:27.199998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4350d56a-911ebc1-1a282581-2a6150b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:27.200014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:27.200047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 810
2025-10-15T11:00:27.200421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:27.200532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:27.200553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:27.200561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:27.203817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 810 sessionId:  describe result for acl check
2025-10-15T11:00:27.203915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:27.203930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:27.203940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:27.203954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401710123076145:8963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:27.206292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401710123076145:8963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:27.212561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401710123076145:8963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:27.226667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:27.229162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401710123076145:8963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:27.229200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401710123076145:8963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:27.229215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401710123076145:8963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:27.229243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:27.231461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:27.232345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:27.232372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:27.232416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:27.232665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:27.232848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401712922767466:8038]
2025-10-15T11:00:27.234906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:27.235737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:27.235957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:27.237140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:27.237445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:27.237461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:27.237468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:27.237475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:27.237480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:27.237488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:27.237495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:27.237501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:27.237508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:27.237514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:27.237521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:27.237528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.237535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.237542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.237583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:27.237697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:27.237743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:27.237791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:27.237846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:27.237894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:27.237940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:27.237987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:27.238033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:27.238084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:27.238126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:27.238169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.238212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.238265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.238308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:27.238373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:27.238422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:27.238478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:27.238525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:27.238580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:27.238626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:27.238678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:27.238725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:27.238776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:27.238821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:27.238873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:27.238919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:27.238970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:27.239013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:27.239065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:27.239117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:27.239182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:27.239227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:27.239281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:27.239328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:27.239802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:27.239858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.239923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.239972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.240034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.240095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.240151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.240626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:27.273010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:27.282657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:27.282698Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:27.282712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:27.282729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:27.282749Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 809 [2:7561401712922767466:8038]
2025-10-15T11:00:27.282791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:27.282839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:27.282775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401710123076184:8824]
2025-10-15T11:00:27.282851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:27.282862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:27.282871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:27.282911Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:27.282930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:27.282949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:27.284661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.284696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.284709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.284719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:27.285124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 809
2025-10-15T11:00:27.285189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 809, pipe: [1:7561401710123076184:8824]
2025-10-15T11:00:27.285270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 809
2025-10-15T11:00:27.284953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:27.284974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.285099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.285260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.285460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:27.285518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401710123076177:8963], now have 1 active actors on pipe
2025-10-15T11:00:27.285531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401710123076184:8824], now have 1 active actors on pipe
2025-10-15T11:00:27.285560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401710123076042:2467], now have 1 active actors on pipe
2025-10-15T11:00:27.285602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:27.285619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:27.285641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401712922767460:8038]
2025-10-15T11:00:27.285649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401712922767460:8038]
2025-10-15T11:00:27.285656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401712922767460:8038]
2025-10-15T11:00:27.285679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:27.285724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:27.285870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:27.285879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:27.285929Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:27.285949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:27.285956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:27.285962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:27.285967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:27.285971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:27.285974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:27.286003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:27.286035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:27.286137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401712922767460:8038]
2025-10-15T11:00:27.286161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:27.286168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:27.286200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:27.291629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:27.291663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:27.291726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:27.292013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 810 partition: 0 MaxSeqNo: 46 sessionId: src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0
2025-10-15T11:00:27.292705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4350d56a-911ebc1-1a282581-2a6150b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:27.318782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:27.318812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:27.318846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401712922767460:8038]
2025-10-15T11:00:27.318933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:27.323007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:27.332484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:27.336996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0] Write session: try to update token
2025-10-15T11:00:27.337051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:27.352079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:27.359763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:27.361464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:27.383756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:27.384329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:27.384353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:27.384371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:27.384444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:27.499603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:27.499636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:27.499647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:27.499701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:27.499715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:27.499726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:27.499737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:27.499774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401712922767460:8038]
2025-10-15T11:00:27.499799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401712922767460:8038]
2025-10-15T11:00:27.499821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401712922767460:8038]
2025-10-15T11:00:27.499953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:27.499983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:27.500078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:27.500110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:27.500137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:27.504349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:27.527948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId: src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:27.575235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:27.684186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:27.685516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:27.685545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:27.687613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:27.687642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:27.690702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401710123076184:8824]
2025-10-15T11:00:27.690817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:27.686778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:27.698412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 810 reason: error at write: Disconnected sessionId: src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0
2025-10-15T11:00:27.699882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 810 sessionId: src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0 is DEAD
2025-10-15T11:00:27.703980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:27.704062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0] Write session will restart in 0.009552s
2025-10-15T11:00:27.704236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0] Write session: Do CDS request
2025-10-15T11:00:27.704294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:27.724678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:27.726742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:27.726776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 811
2025-10-15T11:00:27.727052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:27.727174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:27.727190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:27.727200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:27.728391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 811 sessionId:  describe result for acl check
2025-10-15T11:00:27.728506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:27.728516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:27.728526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:27.728541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401710123076225:8971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:27.730893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401710123076225:8971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:27.740172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401710123076225:8971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:27.747503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401710123076225:8971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:27.747542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401710123076225:8971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:27.747558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401710123076225:8971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:27.747587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:27.791487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401710123076342:8824]
2025-10-15T11:00:27.799531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:27.804292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:27.805151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:27.805169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:27.805215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:27.805475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:27.805662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401712922767629:8043]
2025-10-15T11:00:27.807838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:27.808571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:27.808767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:27.809778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:27.810070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:27.810089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:27.810097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:27.810104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:27.810111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:27.810119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:27.810127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:27.810134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:27.810139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:27.810143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:27.810149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:27.810153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.810158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.810163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.810198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:27.810287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:27.810322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:27.810357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:27.810393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:27.810428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:27.810463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:27.810507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:27.810556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:27.810600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:27.810637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:27.810673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.810707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.810741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.810771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:27.810821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:27.810864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:27.810907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:27.810954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:27.811000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:27.811032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:27.811079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:27.811124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:27.811180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:27.811213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:27.811251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:27.811284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:27.811320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:27.811382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:27.811423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:27.811457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:27.811502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:27.811534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:27.811585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:27.811628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:27.811675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:27.811720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.811764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.811800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.811839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.811871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.811911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.812369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:27.840755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:27.852123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 810
2025-10-15T11:00:27.852192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 810
2025-10-15T11:00:27.852205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 810, pipe: [1:7561401710123076342:8824]
2025-10-15T11:00:27.849353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:27.849390Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:27.849403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:27.849419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:27.849439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 810 [2:7561401712922767629:8043]
2025-10-15T11:00:27.849478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:27.849533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:27.849547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:27.849558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:27.849570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:27.849620Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:27.849637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:27.849656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:27.850772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.850783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.850793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.850800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:27.851068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:27.851085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:27.851248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:27.851478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:27.851746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:27.851834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401710123076268:8971], now have 1 active actors on pipe
2025-10-15T11:00:27.851859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401710123076207:2467], now have 1 active actors on pipe
2025-10-15T11:00:27.851885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401710123076342:8824], now have 1 active actors on pipe
2025-10-15T11:00:27.851911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401712922767624:8043]
2025-10-15T11:00:27.851927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401712922767624:8043]
2025-10-15T11:00:27.851940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401712922767624:8043]
2025-10-15T11:00:27.851981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:27.852062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:27.852258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:27.852277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:27.852411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401712922767624:8043]
2025-10-15T11:00:27.852433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:27.852647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:27.852660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:27.852671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:27.852695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:27.853693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:27.853732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:27.853832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5e928af-fd7a262b-5c890871-c0de7286_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:27.853865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:27.853884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:27.853895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:27.853937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:27.853983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:27.854039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:27.854549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:27.854569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:27.854637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:27.855243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 811 partition: 0 MaxSeqNo: 46 sessionId: src_id|f5e928af-fd7a262b-5c890871-c0de7286_0
2025-10-15T11:00:27.859892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2fd98a-e7845d83-cd5ee31f-463c196f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f5e928af-fd7a262b-5c890871-c0de7286_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:27.922846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e928af-fd7a262b-5c890871-c0de7286_0] Write session: try to update token
2025-10-15T11:00:27.922897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e928af-fd7a262b-5c890871-c0de7286_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:28.004059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:28.004093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:28.004106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:28.004167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:28.004184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:28.004199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:28.004211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:28.004248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401712922767624:8043]
2025-10-15T11:00:28.004277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401712922767624:8043]
2025-10-15T11:00:28.004304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401712922767624:8043]
2025-10-15T11:00:28.004506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:28.004527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:28.005534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:28.006455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:28.006489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:28.006521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:28.046847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId: src_id|f5e928af-fd7a262b-5c890871-c0de7286_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:28.083626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:28.198106Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:28.222945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:28.222992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:28.223056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:28.223072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:28.223115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401712922767624:8043]
2025-10-15T11:00:28.223606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:28.224324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:28.224367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:28.224448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:28.224661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401710123076342:8824]
2025-10-15T11:00:28.224810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:28.233745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 811 reason: error at write: Disconnected sessionId: src_id|f5e928af-fd7a262b-5c890871-c0de7286_0
2025-10-15T11:00:28.234114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 811 sessionId: src_id|f5e928af-fd7a262b-5c890871-c0de7286_0 is DEAD
2025-10-15T11:00:28.235534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e928af-fd7a262b-5c890871-c0de7286_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:28.235586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e928af-fd7a262b-5c890871-c0de7286_0] Write session will restart in 0.006813s
2025-10-15T11:00:28.235698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e928af-fd7a262b-5c890871-c0de7286_0] Write session: Do CDS request
2025-10-15T11:00:28.235739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e928af-fd7a262b-5c890871-c0de7286_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:28.248348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:28.248402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 812
2025-10-15T11:00:28.250195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e928af-fd7a262b-5c890871-c0de7286_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:28.251149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:28.251405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:28.251424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:28.251435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:28.253607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 812 sessionId:  describe result for acl check
2025-10-15T11:00:28.253719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:28.253731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:28.253740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:28.253758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401714418043684:8976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:28.256662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401714418043684:8976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:28.266629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401714418043684:8976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:28.274385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401714418043684:8976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:28.274426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401714418043684:8976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:28.274443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401714418043684:8976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:28.274470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:28.324753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401714418043808:8824]
2025-10-15T11:00:28.332155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:28.339859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:28.341065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:28.341087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:28.341134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:28.341396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:28.341579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401717217735084:8052]
2025-10-15T11:00:28.343769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:28.346397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:28.346606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:28.347885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:28.348209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:28.348217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:28.348223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:28.348231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:28.348238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:28.348245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:28.348252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:28.348258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:28.348265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:28.348273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:28.348280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:28.348287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.348293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.348301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.348344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:28.348451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:28.348502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:28.348551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:28.348597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:28.348644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:28.348691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:28.348735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:28.348781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:28.348830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:28.348875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:28.348922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.348969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.349016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.349055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:28.349123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:28.349181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:28.349239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:28.349285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:28.349338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:28.349383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:28.349437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:28.349484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:28.349538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:28.349583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:28.349635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:28.349683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:28.349735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:28.349782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:28.349832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:28.349879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:28.349932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:28.349975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:28.350027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:28.350075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:28.350127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:28.350172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.350225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.350273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.350326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.350369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.350420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.350924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:28.380650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:28.395549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:28.395597Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:28.395613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:28.395631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:28.395655Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 811 [2:7561401717217735084:8052]
2025-10-15T11:00:28.395704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:28.395758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:28.395772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:28.395784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:28.395794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:28.395842Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:28.395862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:28.395883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:28.401077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 811
2025-10-15T11:00:28.397673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.401184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 811
2025-10-15T11:00:28.401248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 811, pipe: [1:7561401714418043808:8824]
2025-10-15T11:00:28.397705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.397719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.397730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:28.398003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:28.398020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.398160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.398343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.398579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:28.398643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401717217735079:8052]
2025-10-15T11:00:28.398658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401717217735079:8052]
2025-10-15T11:00:28.398671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401717217735079:8052]
2025-10-15T11:00:28.398710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:28.398773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:28.398950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:28.398967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:28.399080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401717217735079:8052]
2025-10-15T11:00:28.399098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:28.399339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:28.399369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:28.399383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:28.399405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:28.402687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401714418043718:8976], now have 1 active actors on pipe
2025-10-15T11:00:28.402724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401714418043673:2467], now have 1 active actors on pipe
2025-10-15T11:00:28.402744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401714418043808:8824], now have 1 active actors on pipe
2025-10-15T11:00:28.402789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:28.402810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:28.402889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:28.402917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:28.402934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:28.402944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:28.402975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:28.403012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:28.403054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:28.408462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:28.408501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:28.408583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:28.412489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5e928af-fd7a262b-5c890871-c0de7286_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:28.411734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 812 partition: 0 MaxSeqNo: 46 sessionId: src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0
2025-10-15T11:00:28.465808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0] Write session: try to update token
2025-10-15T11:00:28.465871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:28.630180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:28.630215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:28.630226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:28.630335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:28.630348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:28.630360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:28.630368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:28.630400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401717217735079:8052]
2025-10-15T11:00:28.630425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401717217735079:8052]
2025-10-15T11:00:28.630447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401717217735079:8052]
2025-10-15T11:00:28.635483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:28.635523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:28.635552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:28.660268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:28.660311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:28.661222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:28.683977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId: src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:28.703931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:28.814308Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:28.816391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:28.816414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:28.816448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401717217735079:8052]
2025-10-15T11:00:28.816566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:28.816591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:28.816789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:28.817493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:28.819546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:28.858499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:28.858650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401714418043808:8824]
2025-10-15T11:00:28.858717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 812 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0
2025-10-15T11:00:28.859061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 812 sessionId: src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0 is DEAD
2025-10-15T11:00:28.859607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:28.859647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0] Write session will restart in 0.006525s
2025-10-15T11:00:28.859746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0] Write session: Do CDS request
2025-10-15T11:00:28.859777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:28.876692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:28.876510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:28.876553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 813
2025-10-15T11:00:28.879789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:28.879945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:28.879960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:28.879971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:28.882391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 813 sessionId:  describe result for acl check
2025-10-15T11:00:28.882513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:28.882524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:28.882533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:28.882549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401714418043892:8987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:28.885310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401714418043892:8987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:28.902391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401714418043892:8987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:28.914462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401714418043892:8987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:28.914505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401714418043892:8987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:28.914523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401714418043892:8987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:28.914557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:28.929133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:28.932648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:28.933529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:28.933558Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:28.933602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:28.933860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:28.934054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401717217735258:8060]
2025-10-15T11:00:28.936508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:28.938182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:28.938420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:28.939754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:28.940068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:28.940077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:28.940084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:28.940091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:28.940098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:28.940105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:28.940112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:28.940119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:28.940126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:28.940133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:28.940140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:28.940148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.940155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.940161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.940208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:28.940317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:28.940366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:28.940415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:28.940462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:28.940509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:28.940554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:28.940601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:28.940644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:28.940694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:28.940740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:28.940786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.940834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.940879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.940923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:28.940990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:28.941049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:28.941108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:28.941157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:28.941212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:28.941261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:28.941315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:28.941370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:28.941496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:28.941544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:28.941599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:28.941645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:28.941701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:28.941745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:28.941802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:28.941852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:28.941909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:28.941956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:28.942011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:28.942058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:28.942114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:28.942161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.942217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:28.942265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.942321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:28.942365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.942417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:28.942980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:28.962795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:28.962779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401714418043983:8824]
2025-10-15T11:00:28.972162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:28.972214Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:28.972231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:28.972249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:28.972275Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 812 [2:7561401717217735258:8060]
2025-10-15T11:00:28.972330Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:28.972393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:28.972415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:28.972428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:28.972441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:28.972496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:28.972523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:28.972547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:29.001344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.001375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.001388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.001400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:29.001713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:29.001738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.001901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.002081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.002297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:29.002386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401714418043983:8824], now have 1 active actors on pipe
2025-10-15T11:00:29.002415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401714418043852:2467], now have 1 active actors on pipe
2025-10-15T11:00:29.002435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401714418043974:8987], now have 1 active actors on pipe
2025-10-15T11:00:29.002460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401717217735253:8060]
2025-10-15T11:00:29.002483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401717217735253:8060]
2025-10-15T11:00:29.002497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401717217735253:8060]
2025-10-15T11:00:29.002533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:29.002610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:29.002617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:29.002631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:29.002645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:29.002794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:29.002816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:29.002982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:29.003010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:29.003042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401717217735253:8060]
2025-10-15T11:00:29.003075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:29.003095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:29.003206Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:29.003247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:29.003271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:29.003292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:29.003340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:29.001840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 812, pipe: [1:7561401714418043983:8824]
2025-10-15T11:00:29.003415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:29.002081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 812
2025-10-15T11:00:29.002184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 812
2025-10-15T11:00:29.003526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:29.004332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:29.004365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:29.004436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:29.004713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 813 partition: 0 MaxSeqNo: 46 sessionId: src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0
2025-10-15T11:00:29.005574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5a91141-87aad6c7-e68aca95-330b7ff5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:29.030648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0] Write session: try to update token
2025-10-15T11:00:29.030708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:29.129610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId: src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:29.157991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:29.159705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:29.159737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:29.159746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:29.159802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:29.159816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:29.159829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:29.159838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:29.159881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401717217735253:8060]
2025-10-15T11:00:29.159905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401717217735253:8060]
2025-10-15T11:00:29.159929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401717217735253:8060]
2025-10-15T11:00:29.160082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:29.160128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:29.160165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:29.160165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:29.160190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:29.160224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:29.160244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:29.161143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:29.306771Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:29.317558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:29.317597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:29.317650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401717217735253:8060]
2025-10-15T11:00:29.318128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:29.319035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:29.319325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:29.319474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:29.319494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:29.320841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401714418043983:8824]
2025-10-15T11:00:29.360132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 813 reason: error at write: Disconnected sessionId: src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0
2025-10-15T11:00:29.360419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 813 sessionId: src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0 is DEAD
2025-10-15T11:00:29.363984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:29.364013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0] Write session will restart in 0.006981s
2025-10-15T11:00:29.364102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0] Write session: Do CDS request
2025-10-15T11:00:29.364128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:29.378805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:29.381429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:29.381459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 814
2025-10-15T11:00:29.381891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:29.382044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:29.382070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:29.382082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:29.383559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 814 sessionId:  describe result for acl check
2025-10-15T11:00:29.383681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:29.383701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:29.383711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:29.383729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401718713011334:8995] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:29.386224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401718713011334:8995] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:29.392097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401718713011334:8995] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:29.403171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401718713011334:8995] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:29.403223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401718713011334:8995] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:29.403239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401718713011334:8995] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:29.403267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:29.418857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401718713011421:8824]
2025-10-15T11:00:29.453426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:29.458378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:29.459391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:29.459415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:29.459469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:29.459766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:29.459984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401721512702710:8065]
2025-10-15T11:00:29.463614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:29.464775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:29.465024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:29.466406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:29.466760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:29.466770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:29.466778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:29.466786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:29.466794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:29.466803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:29.466812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:29.466819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:29.466827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:29.466835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:29.466843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:29.466851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.466859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.466866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.466920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:29.467048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:29.467106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:29.467158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:29.467226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:29.467275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:29.467327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:29.467398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:29.467452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:29.467507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:29.467559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:29.467612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.467664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.467714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.467763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:29.467842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:29.468794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:29.468877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:29.468933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:29.468995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:29.469044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:29.469104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:29.469160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:29.469219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:29.469270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:29.469327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:29.469377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:29.469434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:29.469486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:29.469547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:29.469598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:29.469657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:29.469710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:29.469787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:29.469835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:29.469894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:29.469944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.470006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.470053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.470115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.470165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.470222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.470790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:29.495071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:29.505405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:29.505465Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:29.505484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:29.505507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:29.505536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 813 [2:7561401721512702710:8065]
2025-10-15T11:00:29.505596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:29.505675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:29.505693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:29.505707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:29.505721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:29.505782Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:29.505809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:29.505835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:29.506842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.506860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.506875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.506888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:29.508754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 813
2025-10-15T11:00:29.508860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 813
2025-10-15T11:00:29.508929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 813, pipe: [1:7561401718713011421:8824]
2025-10-15T11:00:29.511534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:29.511570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.511726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.511941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.512206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:29.512252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401718713011316:2467], now have 1 active actors on pipe
2025-10-15T11:00:29.512281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401718713011392:8995], now have 1 active actors on pipe
2025-10-15T11:00:29.512307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401718713011421:8824], now have 1 active actors on pipe
2025-10-15T11:00:29.512382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:29.512406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:29.512493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401721512702705:8065]
2025-10-15T11:00:29.512509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401721512702705:8065]
2025-10-15T11:00:29.512524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401721512702705:8065]
2025-10-15T11:00:29.512566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:29.512675Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:29.512709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:29.512729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:29.512742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:29.512795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:29.512845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:29.512899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:29.513106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:29.513127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:29.513266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:29.513319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401721512702705:8065]
2025-10-15T11:00:29.513339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:29.514132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:29.514160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:29.514171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:29.514198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:29.521680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:29.521741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:29.521829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:29.522319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 814 partition: 0 MaxSeqNo: 46 sessionId: src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0
2025-10-15T11:00:29.523310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e86f2a6-c5e11426-d6869947-c6c4413d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:29.556685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0] Write session: try to update token
2025-10-15T11:00:29.556754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:29.613412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:29.613449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:29.613465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:29.613477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:29.613513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401721512702705:8065]
2025-10-15T11:00:29.613543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401721512702705:8065]
2025-10-15T11:00:29.613568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401721512702705:8065]
2025-10-15T11:00:29.613723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:29.613742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:29.613754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:29.613806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:29.613829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:29.614348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:29.614421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:29.614450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:29.614682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:29.712207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId: src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:29.743811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:29.761894Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:29.763919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:29.763959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:29.767500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:29.767686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:29.767699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:29.768098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401718713011421:8824]
2025-10-15T11:00:29.767991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:29.777965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:29.778010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0] Write session will restart in 0.007483s
2025-10-15T11:00:29.778146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0] Write session: Do CDS request
2025-10-15T11:00:29.778197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:29.777150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 814 reason: error at write: Disconnected sessionId: src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0
2025-10-15T11:00:29.777521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 814 sessionId: src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0 is DEAD
2025-10-15T11:00:29.792255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:29.795592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:29.795620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 815
2025-10-15T11:00:29.795984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:29.796082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:29.796096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:29.796104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:29.802669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 815 sessionId:  describe result for acl check
2025-10-15T11:00:29.802772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:29.802782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:29.802792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:29.802806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401718713011485:9002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:29.805585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401718713011485:9002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:29.824336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401718713011485:9002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:29.839747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401718713011485:9002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:29.839791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401718713011485:9002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:29.839807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401718713011485:9002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:29.839837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:29.868392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401718713011614:8824]
2025-10-15T11:00:29.875675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:29.880302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:29.881152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:29.881171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:29.881211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:29.881450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:29.881627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401721512702880:8074]
2025-10-15T11:00:29.884897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:29.890813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:29.891103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:29.892459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:29.892803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:29.892812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:29.892819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:29.892826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:29.892833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:29.892838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:29.892845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:29.892850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:29.892856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:29.892862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:29.892868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:29.892875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.892883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.892890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.892932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:29.893036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:29.893081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:29.893125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:29.893168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:29.893210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:29.893252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:29.893298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:29.893343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:29.893389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:29.893431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:29.893472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.893512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.893555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.893599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:29.893661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:29.893716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:29.893769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:29.893816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:29.893865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:29.893907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:29.893957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:29.894003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:29.894054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:29.894094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:29.894144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:29.894190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:29.894240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:29.894284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:29.894334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:29.894379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:29.894431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:29.894474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:29.894525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:29.894569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:29.894618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:29.894663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.894717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.894761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.894812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.894856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.894906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.896056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:29.927002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:29.938806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:29.938851Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:29.938866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:29.938882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:29.938906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 814 [2:7561401721512702880:8074]
2025-10-15T11:00:29.938955Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:29.939009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:29.939022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:29.939033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:29.939045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:29.939088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:29.939108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:29.939127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:29.958640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.962069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.962101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.962111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:29.962411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:29.962427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:29.962546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:29.962698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:29.962893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:29.962954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401721512702875:8074]
2025-10-15T11:00:29.962967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401721512702875:8074]
2025-10-15T11:00:29.962979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401721512702875:8074]
2025-10-15T11:00:29.963017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:29.963080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:29.963256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:29.963272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:29.963407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401721512702875:8074]
2025-10-15T11:00:29.963426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:29.964043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:29.964064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:29.964075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:29.964097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:29.965078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401718713011556:9002], now have 1 active actors on pipe
2025-10-15T11:00:29.965107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401718713011475:2467], now have 1 active actors on pipe
2025-10-15T11:00:29.965126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401718713011614:8824], now have 1 active actors on pipe
2025-10-15T11:00:29.966126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 814
2025-10-15T11:00:29.966221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 814
2025-10-15T11:00:29.966283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 814, pipe: [1:7561401718713011614:8824]
2025-10-15T11:00:29.971462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:29.971498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:29.971569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:29.971598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:29.971613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:29.971624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:29.971655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:29.971693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:29.971731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:29.979445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:29.979488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:29.979566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:29.982970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 815 partition: 0 MaxSeqNo: 46 sessionId: src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0
2025-10-15T11:00:29.987611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9edcae5f-ecad4465-c61da16d-a7ead1c4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:30.042134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0] Write session: try to update token
2025-10-15T11:00:30.042190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:30.074574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:30.074595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:30.074602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:30.074640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:30.074648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:30.074655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:30.074662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:30.074683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401721512702875:8074]
2025-10-15T11:00:30.074700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401721512702875:8074]
2025-10-15T11:00:30.074715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401721512702875:8074]
2025-10-15T11:00:30.074794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:30.074823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:30.074824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:30.074838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:30.074848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:30.075846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:30.160689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId: src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:30.217395Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:30.231500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:30.257772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:30.257798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:30.257215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:30.257246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:30.257286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401721512702875:8074]
2025-10-15T11:00:30.257491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:30.289444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:30.289590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401718713011614:8824]
2025-10-15T11:00:30.289648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 815 reason: error at write: Disconnected sessionId: src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0
2025-10-15T11:00:30.289879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 815 sessionId: src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0 is DEAD
2025-10-15T11:00:30.291800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:30.291846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0] Write session will restart in 0.006475s
2025-10-15T11:00:30.291984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0] Write session: Do CDS request
2025-10-15T11:00:30.292026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:30.305514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:30.309499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:30.309527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 816
2025-10-15T11:00:30.309790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:30.309888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:30.309906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:30.309914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:30.311116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 816 sessionId:  describe result for acl check
2025-10-15T11:00:30.311238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:30.311248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:30.311257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:30.311271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401723007978990:9013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:30.313588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401723007978990:9013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:30.329539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401723007978990:9013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:30.335468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:30.339848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:30.340505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:30.340532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:30.340568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:30.340776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:30.340955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401725807670342:8082]
2025-10-15T11:00:30.342394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:30.343503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:30.343675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:30.342790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401723007978990:9013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:30.342835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401723007978990:9013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:30.342852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401723007978990:9013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:30.342881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:30.344519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:30.344799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:30.344814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:30.344821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:30.344829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:30.344835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:30.344841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:30.344847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:30.344853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:30.344858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:30.344864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:30.344871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:30.344876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.344882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.344889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.344932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:30.345025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:30.345069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:30.345225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:30.345301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:30.345350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:30.345399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:30.345446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:30.345495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:30.345544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:30.345589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:30.345636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.345684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.345730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.345772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:30.345839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:30.345897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:30.345946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:30.345976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:30.346010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:30.346038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:30.346072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:30.346117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:30.346169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:30.346200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:30.346233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:30.346260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:30.346292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:30.346320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:30.346362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:30.346391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:30.346425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:30.346453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:30.346487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:30.346517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:30.346550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:30.346581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.346625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.346654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.346686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.346713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.346744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.347117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:30.365809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:30.376078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:30.376127Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:30.376143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:30.376161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:30.376182Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 815 [2:7561401725807670342:8082]
2025-10-15T11:00:30.376231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:30.376284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:30.376299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:30.376310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:30.376320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:30.376363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:30.376383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:30.376401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:30.387021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.387048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.387058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.387066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:30.389204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 815
2025-10-15T11:00:30.389296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 815
2025-10-15T11:00:30.388883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:30.388914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.389038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.389193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.389392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:30.389429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401723007979099:9013], now have 1 active actors on pipe
2025-10-15T11:00:30.389449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401723007978973:2467], now have 1 active actors on pipe
2025-10-15T11:00:30.389527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:30.389546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:30.389577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401725807670337:8082]
2025-10-15T11:00:30.389589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401725807670337:8082]
2025-10-15T11:00:30.389601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401725807670337:8082]
2025-10-15T11:00:30.391124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401723007979107:8824]
2025-10-15T11:00:30.389637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:30.389703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:30.389722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:30.389737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:30.389748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:30.389854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:30.389869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:30.389922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:30.389949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:30.389964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:30.389973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:30.390003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:30.390039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:30.390165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401725807670337:8082]
2025-10-15T11:00:30.390191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:30.390230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:30.390230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:30.392416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 815, pipe: [1:7561401723007979107:8824]
2025-10-15T11:00:30.395076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:30.395113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:30.395167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401723007979107:8824], now have 1 active actors on pipe
2025-10-15T11:00:30.395235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:30.396722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 816 partition: 0 MaxSeqNo: 46 sessionId: src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0
2025-10-15T11:00:30.399607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a8573e7-aa51a63b-8264c872-8efa6b78_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:30.475958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0] Write session: try to update token
2025-10-15T11:00:30.476028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:30.476647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:30.476680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:30.476693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:30.523216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:30.523248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:30.523258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:30.523269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:30.523299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401725807670337:8082]
2025-10-15T11:00:30.523323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401725807670337:8082]
2025-10-15T11:00:30.523359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401725807670337:8082]
2025-10-15T11:00:30.523525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:30.523546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:30.524559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:30.525880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:30.525925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:30.525950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:30.677842Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:30.679010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId: src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:30.703043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:30.703073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:30.703115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401725807670337:8082]
2025-10-15T11:00:30.703436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:30.715283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:30.715462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401723007979107:8824]
2025-10-15T11:00:30.726847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:30.726890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:30.742837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T11:00:30.742900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0] Write session will restart in 0.006408s
2025-10-15T11:00:30.743072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0] Write session: Do CDS request
2025-10-15T11:00:30.743117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:30.742060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 816 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0
2025-10-15T11:00:30.742366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 816 sessionId: src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0 is DEAD
2025-10-15T11:00:30.756242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:30.759601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:30.759641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 817
2025-10-15T11:00:30.762506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:30.762627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:30.762647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:30.762656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:30.765573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 817 sessionId:  describe result for acl check
2025-10-15T11:00:30.765746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:30.765765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:30.765785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:30.765812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401723007979170:9021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:30.769877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401723007979170:9021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:30.788045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401723007979170:9021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:30.802153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401723007979170:9021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:30.802204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401723007979170:9021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:30.802227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401723007979170:9021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:30.802262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:30.802400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:30.805786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:30.806359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:30.806371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:30.806396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:30.806549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:30.806669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401725807670511:8085]
2025-10-15T11:00:30.808984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:30.810013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:30.810218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:30.811418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:30.811737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:30.811745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:30.811751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:30.811758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:30.811765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:30.811773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:30.811779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:30.811785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:30.811792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:30.811799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:30.811806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:30.811813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.811819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.811825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.811873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:30.811979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:30.812025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:30.812086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:30.812131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:30.812176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:30.812219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:30.812266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:30.812307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:30.812352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:30.812396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:30.812441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.813144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.813204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.813253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:30.813317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:30.813371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:30.813423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:30.813471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:30.813524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:30.813567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:30.813617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:30.813659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:30.813714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:30.813759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:30.813809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:30.813854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:30.813901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:30.813945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:30.813995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:30.814042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:30.814093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:30.815553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401723007979268:8824]
2025-10-15T11:00:30.814135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:30.814187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:30.814231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:30.814282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:30.814326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.814379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.814423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.814473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.814515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.814564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.815044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:30.842189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:30.852136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:30.852183Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:30.852198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:30.852215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:30.852238Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 816 [2:7561401725807670511:8085]
2025-10-15T11:00:30.852289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:30.852343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:30.852358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:30.852369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:30.852379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:30.852421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:30.852441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:30.852462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:30.853925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.853940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.853954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.853964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:30.854238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:30.854256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:30.854392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:30.854571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:30.854799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:30.854866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401725807670505:8085]
2025-10-15T11:00:30.854881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401725807670505:8085]
2025-10-15T11:00:30.854893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401725807670505:8085]
2025-10-15T11:00:30.855136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:30.855147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:30.855158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:30.855342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:30.855433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:30.855606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:30.855636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:30.855679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401723007979264:9021], now have 1 active actors on pipe
2025-10-15T11:00:30.855702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401723007979115:2467], now have 1 active actors on pipe
2025-10-15T11:00:30.855725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401723007979268:8824], now have 1 active actors on pipe
2025-10-15T11:00:30.855836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401725807670505:8085]
2025-10-15T11:00:30.855875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:30.855776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 816
2025-10-15T11:00:30.855870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 816
2025-10-15T11:00:30.855929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 816, pipe: [1:7561401723007979268:8824]
2025-10-15T11:00:30.859578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:30.859816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:30.859841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:30.859913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:30.859959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:30.859975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:30.859986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:30.860020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:30.860057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:30.860098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:30.863640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:30.863673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:30.863741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:30.870576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 817 partition: 0 MaxSeqNo: 46 sessionId: src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0
2025-10-15T11:00:30.876205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f2316-4f51c4eb-1b35a98c-183b1ab4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:30.940823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0] Write session: try to update token
2025-10-15T11:00:30.940875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:31.044146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:31.044180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:31.044191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:31.044304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:31.044317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:31.044329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:31.044337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:31.044368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401725807670505:8085]
2025-10-15T11:00:31.044394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401725807670505:8085]
2025-10-15T11:00:31.044416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401725807670505:8085]
2025-10-15T11:00:31.044561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:31.044602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:31.044629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:31.056132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:31.056172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:31.057259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:31.086068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId: src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:31.112086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:31.207341Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:31.234790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:31.234833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:31.234879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401725807670505:8085]
2025-10-15T11:00:31.235024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:31.235046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:31.235174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:31.235944Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:31.238410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:31.242162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:31.242365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401723007979268:8824]
2025-10-15T11:00:31.271905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 817 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0
2025-10-15T11:00:31.272184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 817 sessionId: src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0 is DEAD
2025-10-15T11:00:31.279624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:31.279685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0] Write session will restart in 0.008185s
2025-10-15T11:00:31.279827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0] Write session: Do CDS request
2025-10-15T11:00:31.279871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:31.297782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:31.298382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:31.298417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 818
2025-10-15T11:00:31.298865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:31.299050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:31.299071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:31.299080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:31.300498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 818 sessionId:  describe result for acl check
2025-10-15T11:00:31.300605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:31.300615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:31.300626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:31.300644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401727302946639:9026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:31.303123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401727302946639:9026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:31.316663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401727302946639:9026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:31.328455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401727302946639:9026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:31.328498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401727302946639:9026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:31.328526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401727302946639:9026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:31.328559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:31.338350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:31.342430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401727302946748:8824]
2025-10-15T11:00:31.342640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:31.343611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:31.343644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:31.343692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:31.344255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:31.344467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401730102637973:8091]
2025-10-15T11:00:31.346807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:31.348260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:31.348494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:31.349943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:31.350309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:31.350318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:31.350327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:31.350336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:31.350347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:31.350356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:31.350365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:31.350373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:31.350381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:31.350388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:31.350397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:31.350405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.350412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.350420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.350472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:31.350597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:31.350652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:31.350706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:31.350758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:31.350809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:31.350860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:31.350913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:31.350966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:31.351022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:31.351073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:31.351125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.351176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.351244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.351291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:31.352239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:31.352323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:31.352391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:31.352450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:31.352529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:31.352580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:31.352643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:31.352698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:31.352759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:31.352812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:31.352873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:31.352923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:31.352984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:31.353038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:31.353096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:31.353153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:31.353216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:31.353268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:31.353327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:31.353378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:31.353439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:31.353496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.353559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.353617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.353681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.353732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.353793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.354380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:31.385300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:31.398522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 817
2025-10-15T11:00:31.398636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 817
2025-10-15T11:00:31.398664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 817, pipe: [1:7561401727302946748:8824]
2025-10-15T11:00:31.395850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:31.395894Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:31.395909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:31.395924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:31.395947Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 817 [2:7561401730102637973:8091]
2025-10-15T11:00:31.395990Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:31.396040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:31.396052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:31.396062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:31.396072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:31.396115Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:31.396134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:31.396151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:31.397743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.397758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.397771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.397781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:31.398042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:31.398057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.398182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.398363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.398587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:31.398665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401727302946590:2467], now have 1 active actors on pipe
2025-10-15T11:00:31.398699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401727302946744:9026], now have 1 active actors on pipe
2025-10-15T11:00:31.398725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401727302946748:8824], now have 1 active actors on pipe
2025-10-15T11:00:31.398747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401730102637967:8091]
2025-10-15T11:00:31.398760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401730102637967:8091]
2025-10-15T11:00:31.398776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401730102637967:8091]
2025-10-15T11:00:31.398819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:31.398872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:31.398884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:31.398890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:31.398902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:31.399051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:31.399067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:31.399199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401730102637967:8091]
2025-10-15T11:00:31.399239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:31.399282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:31.399294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:31.399312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:31.400451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:31.400490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:31.400506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:31.400516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:31.400549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:31.400588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:31.400650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:31.403097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:31.403129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:31.403194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:31.404154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 818 partition: 0 MaxSeqNo: 46 sessionId: src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0
2025-10-15T11:00:31.405618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac05a2-6ad449a1-5cac0fc5-10981a44_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:31.480339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0] Write session: try to update token
2025-10-15T11:00:31.480411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:31.565900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:31.565944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:31.565957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:31.566017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:31.566033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:31.566048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:31.566059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:31.566097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401730102637967:8091]
2025-10-15T11:00:31.566125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401730102637967:8091]
2025-10-15T11:00:31.566152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401730102637967:8091]
2025-10-15T11:00:31.566309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:31.566332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:31.566560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:31.566603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:31.566635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:31.572248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:31.671457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId: src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:31.705500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:31.757129Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:31.762517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:31.762570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:31.766642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:31.767487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:31.767637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:31.775110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 818 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0
2025-10-15T11:00:31.775603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 818 sessionId: src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0 is DEAD
2025-10-15T11:00:31.776276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:31.776314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0] Write session will restart in 0.006698s
2025-10-15T11:00:31.776431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0] Write session: Do CDS request
2025-10-15T11:00:31.776461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:31.790146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:31.792597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401727302946748:8824]
2025-10-15T11:00:31.792810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:31.792826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 819
2025-10-15T11:00:31.793378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:31.793518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:31.793535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:31.793546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:31.796901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 819 sessionId:  describe result for acl check
2025-10-15T11:00:31.797101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:31.797126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:31.797151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:31.797181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401727302946779:9035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:31.801644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401727302946779:9035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:31.855323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401727302946779:9035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:31.895263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401727302946914:8824]
2025-10-15T11:00:31.897980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:31.928632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:31.929566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:31.929597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:31.929641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:31.929911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:31.930108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401730102638153:8099]
2025-10-15T11:00:31.929267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401727302946779:9035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:31.929319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401727302946779:9035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:31.929335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401727302946779:9035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:31.929368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:31.932319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:31.933578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:31.933808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:31.935100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:31.935496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:31.935518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:31.935526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:31.935536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:31.935543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:31.935550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:31.935558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:31.935564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:31.935570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:31.935577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:31.935585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:31.935592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.935601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.935608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.935656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:31.935767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:31.935817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:31.935874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:31.935930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:31.935984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:31.936066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:31.936121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:31.936168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:31.936221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:31.936272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:31.936325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.936382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.936442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.936493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:31.936566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:31.936632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:31.936693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:31.936746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:31.936807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:31.936862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:31.936917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:31.936967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:31.937026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:31.937072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:31.937127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:31.937176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:31.937230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:31.937275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:31.937328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:31.937380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:31.937443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:31.937496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:31.937554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:31.937609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:31.937668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:31.937720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.937777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.937827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.937887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.937937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.937995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.938495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:31.981011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:31.992198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:31.992246Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:31.992264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:31.992286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:31.992312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 818 [2:7561401730102638153:8099]
2025-10-15T11:00:31.992364Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:31.992422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:31.992439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:31.992452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:31.992464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:31.992518Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:31.992543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:31.992568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:31.993702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.993718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.993732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.995521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 818
2025-10-15T11:00:31.993741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:31.995603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 818, pipe: [1:7561401727302946914:8824]
2025-10-15T11:00:31.994013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:31.995684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 818
2025-10-15T11:00:31.994034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:31.994185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:31.994391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:31.994659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:31.994735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401730102638129:8099]
2025-10-15T11:00:31.994751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401730102638129:8099]
2025-10-15T11:00:31.994767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401730102638129:8099]
2025-10-15T11:00:31.994817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:31.994892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:31.994898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:31.994909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:31.994942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:31.995113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:31.995135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:31.995312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401730102638129:8099]
2025-10-15T11:00:31.995338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:31.995368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:31.996412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401727302946920:9035], now have 1 active actors on pipe
2025-10-15T11:00:31.996452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401727302946914:8824], now have 1 active actors on pipe
2025-10-15T11:00:31.996477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401727302946768:2467], now have 1 active actors on pipe
2025-10-15T11:00:31.997207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:31.997240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:31.997336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:31.997371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:31.997390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:31.997403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:31.997441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:31.997487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:31.997539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:31.998304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:31.998332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:31.998397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:31.998659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 819 partition: 0 MaxSeqNo: 46 sessionId: src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0
2025-10-15T11:00:31.999591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b176f96c-8fffdfac-75b83b91-87cc6253_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:32.045828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0] Write session: try to update token
2025-10-15T11:00:32.045894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:32.143120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:32.143178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:32.143210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:32.143239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:32.143301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401730102638129:8099]
2025-10-15T11:00:32.143337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401730102638129:8099]
2025-10-15T11:00:32.143397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401730102638129:8099]
2025-10-15T11:00:32.143647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:32.143683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:32.143697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:32.143860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:32.143907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:32.145345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:32.145417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:32.145469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:32.145759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:32.179265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId: src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:32.202624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:32.307722Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:32.321456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:32.321512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:32.321594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:32.321610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:32.321654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401730102638129:8099]
2025-10-15T11:00:32.321867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:32.322277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:32.322219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:32.322261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:32.323495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401727302946914:8824]
2025-10-15T11:00:32.323602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:32.331332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 819 reason: error at write: Disconnected sessionId: src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0
2025-10-15T11:00:32.331836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 819 sessionId: src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0 is DEAD
2025-10-15T11:00:32.335877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:32.335933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0] Write session will restart in 0.009821s
2025-10-15T11:00:32.336117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0] Write session: Do CDS request
2025-10-15T11:00:32.336161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:32.355708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:32.355738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 820
2025-10-15T11:00:32.355892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:32.356398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:32.356557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:32.356574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:32.356584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:32.357978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 820 sessionId:  describe result for acl check
2025-10-15T11:00:32.358069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:32.358082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:32.358088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:32.358101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401731597914284:9045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:32.361355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401731597914284:9045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:32.385110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401731597914284:9045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:32.392914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:32.396557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401731597914284:9045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:32.396600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401731597914284:9045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:32.396617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401731597914284:9045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:32.396647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:32.397003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:32.397828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:32.397849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:32.397889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:32.398132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:32.398307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401734397605611:8109]
2025-10-15T11:00:32.400531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:32.401489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:32.401697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:32.402960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:32.403308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:32.403324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:32.403331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:32.403340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:32.403364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:32.403371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:32.403379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:32.403386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:32.403394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:32.403411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:32.403420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:32.403428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.403438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.403446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.403497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:32.403620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:32.403675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:32.403726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:32.403782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:32.403833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:32.403888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:32.403943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:32.403999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:32.404054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:32.404108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:32.404163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.404219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.404267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.404316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:32.404393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:32.404462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:32.404526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:32.404585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:32.404649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:32.404698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:32.404756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:32.404808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:32.404863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:32.404913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:32.404970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:32.405023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:32.405081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:32.405133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:32.405190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:32.405240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:32.405296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:32.405345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:32.405400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:32.405451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:32.405509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:32.405555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.405613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.405663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.405720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.405771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.405834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.406373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:32.423811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401731597914414:8824]
2025-10-15T11:00:32.425348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:32.438887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:32.438936Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:32.438953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:32.438970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:32.438992Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 819 [2:7561401734397605611:8109]
2025-10-15T11:00:32.439042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:32.439099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:32.439114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:32.439126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:32.439137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:32.439181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:32.439202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:32.439234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:32.465571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.465598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.465608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.465618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:32.465858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:32.465872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.465984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.466129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.466309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:32.466366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401734397605605:8109]
2025-10-15T11:00:32.466378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401734397605605:8109]
2025-10-15T11:00:32.466389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401734397605605:8109]
2025-10-15T11:00:32.466428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:32.466489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:32.466557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:32.466582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:32.466593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:32.466643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:32.466657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:32.466757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401734397605605:8109]
2025-10-15T11:00:32.466773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:32.466832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:32.466894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401731597914414:8824], now have 1 active actors on pipe
2025-10-15T11:00:32.466913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401731597914409:9045], now have 1 active actors on pipe
2025-10-15T11:00:32.466931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401731597914268:2467], now have 1 active actors on pipe
2025-10-15T11:00:32.467875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 819, pipe: [1:7561401731597914414:8824]
2025-10-15T11:00:32.467990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 819
2025-10-15T11:00:32.468062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 819
2025-10-15T11:00:32.469754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:32.469792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:32.469877Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a270a987-c5d2136-c05e1075-7aaec99c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:32.469908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:32.469924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:32.469934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:32.469965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:32.470011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:32.470064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:32.470672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:32.470701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:32.470756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:32.471813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a82d2b5-14e1136d-2c6b9adf-225d640a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a270a987-c5d2136-c05e1075-7aaec99c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:32.471031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 820 partition: 0 MaxSeqNo: 46 sessionId: src_id|a270a987-c5d2136-c05e1075-7aaec99c_0
2025-10-15T11:00:32.507023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a270a987-c5d2136-c05e1075-7aaec99c_0] Write session: try to update token
2025-10-15T11:00:32.507092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a270a987-c5d2136-c05e1075-7aaec99c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:32.535937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:32.535973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:32.535987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:32.535998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:32.536032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401734397605605:8109]
2025-10-15T11:00:32.536059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401734397605605:8109]
2025-10-15T11:00:32.536085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401734397605605:8109]
2025-10-15T11:00:32.536216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:32.536236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:32.537274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:32.539715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:32.539755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:32.539784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:32.651791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId: src_id|a270a987-c5d2136-c05e1075-7aaec99c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:32.679907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:32.686360Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:32.691151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401731597914414:8824]
2025-10-15T11:00:32.687920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:32.687952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:32.690598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:32.691463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:32.691528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:32.691553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:32.739476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 820 reason: error at write: Disconnected sessionId: src_id|a270a987-c5d2136-c05e1075-7aaec99c_0
2025-10-15T11:00:32.739880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 820 sessionId: src_id|a270a987-c5d2136-c05e1075-7aaec99c_0 is DEAD
2025-10-15T11:00:32.740590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270a987-c5d2136-c05e1075-7aaec99c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:32.740645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270a987-c5d2136-c05e1075-7aaec99c_0] Write session will restart in 0.009177s
2025-10-15T11:00:32.740799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270a987-c5d2136-c05e1075-7aaec99c_0] Write session: Do CDS request
2025-10-15T11:00:32.740845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270a987-c5d2136-c05e1075-7aaec99c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:32.753981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:32.754015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 821
2025-10-15T11:00:32.755891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a270a987-c5d2136-c05e1075-7aaec99c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:32.756433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:32.756573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:32.756595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:32.756606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:32.757640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 821 sessionId:  describe result for acl check
2025-10-15T11:00:32.757735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:32.757751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:32.757760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:32.757779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401731597914498:9050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:32.759801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401731597914498:9050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:32.768886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401731597914498:9050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:32.779553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:32.781509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:32.780313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401731597914498:9050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:32.780352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401731597914498:9050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:32.780368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401731597914498:9050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:32.780400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:32.782241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:32.782272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:32.782312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:32.782534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:32.782756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401734397605764:8111]
2025-10-15T11:00:32.784794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:32.785671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:32.785906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:32.786963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:32.787332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:32.787366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:32.787374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:32.787381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:32.787388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:32.787397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:32.787404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:32.787411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:32.787419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:32.787427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:32.787435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:32.787441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.787448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.787455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.787502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:32.787623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:32.787672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:32.787734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:32.787781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:32.787826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:32.787873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:32.787928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:32.787977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:32.788021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:32.788066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:32.788109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.788154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.788203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.788246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:32.788314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:32.788385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:32.788445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:32.788493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:32.788546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:32.788593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:32.788638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:32.788675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:32.788720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:32.788753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:32.788793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:32.788838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:32.788887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:32.788934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:32.788993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:32.789034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:32.789081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:32.789121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:32.789174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:32.789220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:32.789276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:32.789322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.789376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.789426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.789481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.789528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.789584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.790187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:32.791766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401731597914576:8824]
2025-10-15T11:00:32.808306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:32.819287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:32.819331Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:32.819364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:32.819386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:32.819412Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 820 [2:7561401734397605764:8111]
2025-10-15T11:00:32.819468Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:32.819528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:32.819542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:32.819554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:32.819566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:32.819618Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:32.819651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:32.819674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:32.824375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 820
2025-10-15T11:00:32.824475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 820
2025-10-15T11:00:32.824513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 820, pipe: [1:7561401731597914576:8824]
2025-10-15T11:00:32.821145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.821172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.821186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.821197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:32.821445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:32.821462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:32.821604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:32.821818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:32.822059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:32.822129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401734397605758:8111]
2025-10-15T11:00:32.822146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401734397605758:8111]
2025-10-15T11:00:32.822159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401734397605758:8111]
2025-10-15T11:00:32.822198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:32.822273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:32.822462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:32.822480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:32.822596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401734397605758:8111]
2025-10-15T11:00:32.822615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:32.822940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:32.822952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:32.822964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:32.822986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:32.824626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401731597914570:9050], now have 1 active actors on pipe
2025-10-15T11:00:32.824653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401731597914423:2467], now have 1 active actors on pipe
2025-10-15T11:00:32.824677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401731597914576:8824], now have 1 active actors on pipe
2025-10-15T11:00:32.824723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:32.824745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:32.824834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:32.824868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:32.824887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:32.824898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:32.824937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:32.824981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:32.825032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:32.825736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:32.825772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:32.825838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:32.827921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270a987-c5d2136-c05e1075-7aaec99c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:32.826165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 821 partition: 0 MaxSeqNo: 46 sessionId: src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0
2025-10-15T11:00:32.868984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0] Write session: try to update token
2025-10-15T11:00:32.869052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:32.884595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:32.884637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:32.884678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401734397605758:8111]
2025-10-15T11:00:32.884812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:32.885202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:32.913212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:32.914313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:32.916030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:32.917395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:32.927918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:32.928336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:32.928359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:32.928372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:32.928434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:33.014976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:33.015018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:33.015032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:33.015044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:33.015085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401734397605758:8111]
2025-10-15T11:00:33.015115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401734397605758:8111]
2025-10-15T11:00:33.015143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401734397605758:8111]
2025-10-15T11:00:33.015322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:33.015371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:33.016417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:33.018830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:33.018867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:33.018898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:33.029615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId: src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:33.054052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:33.169629Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:33.176256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:33.176304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:33.177322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401731597914576:8824]
2025-10-15T11:00:33.177431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:33.177443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:33.179524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:33.177670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:33.199705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 821 reason: error at write: Disconnected sessionId: src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0
2025-10-15T11:00:33.200065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 821 sessionId: src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0 is DEAD
2025-10-15T11:00:33.203206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:33.203261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0] Write session will restart in 0.005415s
2025-10-15T11:00:33.203382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0] Write session: Do CDS request
2025-10-15T11:00:33.203414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:33.213824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:33.215857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:33.215909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 822
2025-10-15T11:00:33.217264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:33.217438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:33.217462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:33.217472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:33.218945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 822 sessionId:  describe result for acl check
2025-10-15T11:00:33.219052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:33.219064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:33.219073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:33.219092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401735892881906:9054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:33.221734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401735892881906:9054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:33.232491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401735892881906:9054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:33.245177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401735892881906:9054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:33.245219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401735892881906:9054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:33.245235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401735892881906:9054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:33.245264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:33.279511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401735892882038:8824]
2025-10-15T11:00:33.284309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:33.288200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:33.288992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:33.289011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:33.289048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:33.289323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:33.289500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401738692573240:8121]
2025-10-15T11:00:33.291749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:33.293287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:33.293484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:33.294702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:33.294994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:33.295001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:33.295009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:33.295016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:33.295023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:33.295031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:33.295037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:33.295045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:33.295052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:33.295058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:33.295065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:33.295072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.295079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.295087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.295130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:33.295251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:33.295300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:33.295371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:33.295421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:33.295469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:33.295517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:33.295563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:33.295611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:33.295672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:33.295717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:33.295761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.295806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.295853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.295895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:33.296104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:33.296177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:33.296234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:33.296281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:33.296334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:33.296381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:33.296436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:33.296485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:33.296538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:33.296584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:33.296637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:33.296680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:33.296732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:33.296776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:33.296827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:33.296876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:33.296929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:33.296974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:33.297027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:33.297076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:33.297128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:33.297171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.297223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.297268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.297318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.297363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.297417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.297904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:33.328602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:33.338208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:33.338256Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:33.338271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:33.338289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:33.338310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 821 [2:7561401738692573240:8121]
2025-10-15T11:00:33.338358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:33.338411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:33.338424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:33.338436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:33.338448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:33.338495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:33.338516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:33.338537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:33.340326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.340355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.340369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.340381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:33.340636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:33.340653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.340781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.340971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.341197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:33.341273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401738692573235:8121]
2025-10-15T11:00:33.341288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401738692573235:8121]
2025-10-15T11:00:33.341301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401738692573235:8121]
2025-10-15T11:00:33.341343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:33.341411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:33.341600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:33.341629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:33.341745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401738692573235:8121]
2025-10-15T11:00:33.341770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:33.342035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:33.342055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:33.342066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:33.342090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:33.343145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401735892882038:8824], now have 1 active actors on pipe
2025-10-15T11:00:33.343179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401735892881889:2467], now have 1 active actors on pipe
2025-10-15T11:00:33.343201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401735892881975:9054], now have 1 active actors on pipe
2025-10-15T11:00:33.344134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 821
2025-10-15T11:00:33.344249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 821
2025-10-15T11:00:33.344323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 821, pipe: [1:7561401735892882038:8824]
2025-10-15T11:00:33.347638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:33.347677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:33.347762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:33.347803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:33.347820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:33.347832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:33.347870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:33.347917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:33.347971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:33.348661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:33.348688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:33.348752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:33.349238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 822 partition: 0 MaxSeqNo: 46 sessionId: src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0
2025-10-15T11:00:33.350722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afdf9ddd-bc23d783-1bd7e804-c2a8a5c0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:33.403613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0] Write session: try to update token
2025-10-15T11:00:33.403677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:33.465587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:33.465626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:33.465641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:33.465652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:33.465684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401738692573235:8121]
2025-10-15T11:00:33.465709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401738692573235:8121]
2025-10-15T11:00:33.465734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401738692573235:8121]
2025-10-15T11:00:33.465893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:33.465911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:33.465922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:33.466041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:33.466063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:33.466210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:33.466249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:33.466280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:33.467387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:33.539987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId: src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:33.564091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:33.638684Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:33.661576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:33.661621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:33.661696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:33.661709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:33.661749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401738692573235:8121]
2025-10-15T11:00:33.661944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:33.662314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:33.667763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401735892882038:8824]
2025-10-15T11:00:33.667904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:33.668099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:33.721180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 822 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0
2025-10-15T11:00:33.721500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 822 sessionId: src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0 is DEAD
2025-10-15T11:00:33.727571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:33.727618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0] Write session will restart in 0.008554s
2025-10-15T11:00:33.727716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0] Write session: Do CDS request
2025-10-15T11:00:33.727743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:33.743006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:33.745141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:33.745080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:33.747936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:33.747969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 823
2025-10-15T11:00:33.745888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:33.745920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:33.745963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:33.746219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:33.746400Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401738692573411:8128]
2025-10-15T11:00:33.748314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:33.749746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:33.751582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:33.751732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:33.751749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:33.751759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:33.749934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:33.750842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:33.751110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:33.751116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:33.751120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:33.751125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:33.751130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:33.751134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:33.751139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:33.751143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:33.751148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:33.751153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:33.751157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:33.751161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.751166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.751171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.751206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:33.751306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:33.751340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:33.751391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:33.751420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:33.751453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:33.751486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:33.751518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:33.751550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:33.751581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:33.751615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:33.751662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.751710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.751753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.751783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:33.751826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:33.751877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:33.751933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:33.751984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:33.752036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:33.752079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:33.752133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:33.752178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:33.752234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:33.752277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:33.752331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:33.752377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:33.752429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:33.752471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:33.752521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:33.752565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:33.752619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:33.752663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:33.752717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:33.752763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:33.752815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:33.752860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.752911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.752956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.753013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.753055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.753108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.753585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:33.753069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 823 sessionId:  describe result for acl check
2025-10-15T11:00:33.753175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:33.753185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:33.753194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:33.753212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401735892882201:9066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:33.755730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401735892882201:9066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:33.761446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401735892882201:9066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:33.768608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401735892882230:8824]
2025-10-15T11:00:33.769701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401735892882201:9066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:33.769730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401735892882201:9066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:33.769750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401735892882201:9066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:33.769783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:33.793975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:33.803306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:33.803369Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:33.803384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:33.803404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:33.803428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 822 [2:7561401738692573411:8128]
2025-10-15T11:00:33.803477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:33.803533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:33.803547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:33.803560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:33.803572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:33.803622Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:33.803646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:33.803675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:33.805229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.805256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.805271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.805283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:33.805545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:33.805573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:33.805716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:33.805909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:33.806155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:33.806231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401738692573404:8128]
2025-10-15T11:00:33.806251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401738692573404:8128]
2025-10-15T11:00:33.806265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401738692573404:8128]
2025-10-15T11:00:33.806307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:33.806389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:33.806569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:33.806588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:33.806712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401738692573404:8128]
2025-10-15T11:00:33.806731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:33.807015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:33.807028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:33.807040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:33.807064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:33.807957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401735892882233:9066], now have 1 active actors on pipe
2025-10-15T11:00:33.807992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401735892882080:2467], now have 1 active actors on pipe
2025-10-15T11:00:33.808015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401735892882230:8824], now have 1 active actors on pipe
2025-10-15T11:00:33.811797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:33.811534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 822
2025-10-15T11:00:33.811848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:33.811632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 822
2025-10-15T11:00:33.811943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:33.811700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 822, pipe: [1:7561401735892882230:8824]
2025-10-15T11:00:33.811978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:33.812998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 823 partition: 0 MaxSeqNo: 46 sessionId: src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0
2025-10-15T11:00:33.811997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:33.812008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:33.812058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:33.812117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:33.812169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:33.812629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:33.812650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:33.812715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:33.815891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70b725cd-d0f4ca2b-f5f23e3f-fe517a07_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:33.839960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0] Write session: try to update token
2025-10-15T11:00:33.840025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:33.929617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:33.929661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:33.929676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:33.929689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:33.929727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401738692573404:8128]
2025-10-15T11:00:33.929756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401738692573404:8128]
2025-10-15T11:00:33.929781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401738692573404:8128]
2025-10-15T11:00:33.929936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:33.929957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:33.929969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:33.930076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:33.930110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:33.931562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:33.931608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:33.931637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:33.944518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:33.998527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId: src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:34.022054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:34.098283Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:34.107766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:34.107821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:34.107909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:34.107926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:34.107975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401738692573404:8128]
2025-10-15T11:00:34.108334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:34.109306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:34.109866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:34.109900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:34.111552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:34.111816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401735892882230:8824]
2025-10-15T11:00:34.139228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 823 reason: error at write: Disconnected sessionId: src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0
2025-10-15T11:00:34.139772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 823 sessionId: src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0 is DEAD
2025-10-15T11:00:34.143315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:34.143389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0] Write session will restart in 0.006054s
2025-10-15T11:00:34.143538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0] Write session: Do CDS request
2025-10-15T11:00:34.143582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:34.154542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:34.155062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:34.155092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 824
2025-10-15T11:00:34.155514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:34.155639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:34.155658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:34.155668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:34.156880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 824 sessionId:  describe result for acl check
2025-10-15T11:00:34.156985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:34.156996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:34.157005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:34.157021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401740187849570:9073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:34.159169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401740187849570:9073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:34.174306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401740187849570:9073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:34.184733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401740187849570:9073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:34.184777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401740187849570:9073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:34.184791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401740187849570:9073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:34.184821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:34.201698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:34.209508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401740187849704:8824]
2025-10-15T11:00:34.210201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:34.211155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:34.211175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:34.211217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:34.211521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:34.211705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401742987540885:8133]
2025-10-15T11:00:34.213995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:34.215088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:34.215361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:34.216790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:34.217145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:34.217154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:34.217163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:34.217170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:34.217178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:34.217184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:34.217192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:34.217198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:34.217205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:34.217212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:34.217220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:34.217226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.217234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.217241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.217291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:34.217410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:34.217463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:34.217514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:34.217566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:34.217617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:34.217665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:34.217719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:34.217768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:34.217819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:34.217868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:34.217915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.217963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.218011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.218073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:34.218148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:34.218219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:34.218276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:34.218328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:34.218384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:34.218432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:34.218490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:34.218540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:34.218598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:34.218643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:34.218701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:34.218752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:34.218808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:34.218857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:34.218912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:34.218961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:34.219024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:34.219073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:34.219126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:34.219176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:34.219233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:34.219292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.219364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.219418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.219545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.219594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.219653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.220193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:34.248071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:34.257915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:34.257969Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:34.257991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:34.258013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:34.258038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 823 [2:7561401742987540885:8133]
2025-10-15T11:00:34.258098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:34.258163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:34.258181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:34.258195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:34.258208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:34.258265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:34.258290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:34.258315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:34.267979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.268016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.268033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.268047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:34.268364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:34.268387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.268563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.268788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.269072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:34.269154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401742987540880:8133]
2025-10-15T11:00:34.269171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401742987540880:8133]
2025-10-15T11:00:34.269187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401742987540880:8133]
2025-10-15T11:00:34.269236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:34.269325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:34.269359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:34.269375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:34.269386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:34.269541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:34.269564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:34.269701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401742987540880:8133]
2025-10-15T11:00:34.269737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:34.269795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401740187849676:9073], now have 1 active actors on pipe
2025-10-15T11:00:34.269822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401740187849704:8824], now have 1 active actors on pipe
2025-10-15T11:00:34.269847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401740187849554:2467], now have 1 active actors on pipe
2025-10-15T11:00:34.270581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:34.271197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:34.271236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:34.271367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40a85699-5be33b23-16532961-179fdcfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:34.271404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:34.271430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:34.271442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:34.271492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:34.271536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:34.271597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:34.270519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 823
2025-10-15T11:00:34.270546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 823
2025-10-15T11:00:34.270622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 823, pipe: [1:7561401740187849704:8824]
2025-10-15T11:00:34.275440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:34.275485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:34.275571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:34.276575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 824 partition: 0 MaxSeqNo: 46 sessionId: src_id|40a85699-5be33b23-16532961-179fdcfd_0
2025-10-15T11:00:34.277548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13ee63c8-d7a3bcd0-ec305b21-792e7a98_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|40a85699-5be33b23-16532961-179fdcfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:34.306683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a85699-5be33b23-16532961-179fdcfd_0] Write session: try to update token
2025-10-15T11:00:34.306746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a85699-5be33b23-16532961-179fdcfd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:34.332916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:34.332955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:34.332999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401742987540880:8133]
2025-10-15T11:00:34.333139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:34.334939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:34.336036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:34.344370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:34.345627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:34.346840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:34.352519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:34.352938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:34.356326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:34.356355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:34.356369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:34.457274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId: src_id|40a85699-5be33b23-16532961-179fdcfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:34.462143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:34.462186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:34.462201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:34.462214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:34.462255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401742987540880:8133]
2025-10-15T11:00:34.462284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401742987540880:8133]
2025-10-15T11:00:34.462312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401742987540880:8133]
2025-10-15T11:00:34.462488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:34.462510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:34.462527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:34.462578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:34.462603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:34.463192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:34.463232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:34.463275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:34.471907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:34.507159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:34.635955Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:34.643176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:34.643233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:34.646095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:34.646121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:34.648809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401740187849704:8824]
2025-10-15T11:00:34.648929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:34.645534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:34.654163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 824 reason: error at write: Disconnected sessionId: src_id|40a85699-5be33b23-16532961-179fdcfd_0
2025-10-15T11:00:34.656773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a85699-5be33b23-16532961-179fdcfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:34.656811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a85699-5be33b23-16532961-179fdcfd_0] Write session will restart in 0.008115s
2025-10-15T11:00:34.656908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a85699-5be33b23-16532961-179fdcfd_0] Write session: Do CDS request
2025-10-15T11:00:34.656939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a85699-5be33b23-16532961-179fdcfd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:34.654546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 824 sessionId: src_id|40a85699-5be33b23-16532961-179fdcfd_0 is DEAD
2025-10-15T11:00:34.676817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40a85699-5be33b23-16532961-179fdcfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:34.676498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:34.676534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 825
2025-10-15T11:00:34.683509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:34.683670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:34.683687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:34.683699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:34.685143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 825 sessionId:  describe result for acl check
2025-10-15T11:00:34.685275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:34.685286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:34.685295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:34.685325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401740187849752:9080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:34.688776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401740187849752:9080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:34.694789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401740187849752:9080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:34.701146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401740187849752:9080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:34.701192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401740187849752:9080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:34.701210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401740187849752:9080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:34.701243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:34.738504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:34.741796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:34.742684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:34.742703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:34.742751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:34.743021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:34.743200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401742987541054:8142]
2025-10-15T11:00:34.748408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401740187849892:8824]
2025-10-15T11:00:34.745405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:34.746454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:34.746692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:34.747994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:34.748328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:34.748336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:34.748343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:34.748350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:34.748358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:34.748365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:34.748373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:34.748381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:34.748388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:34.748395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:34.748403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:34.748411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.748418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.748424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.748472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:34.748590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:34.748640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:34.748690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:34.748738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:34.748788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:34.748835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:34.748885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:34.748933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:34.748985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:34.749034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:34.749081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.749130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.749178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.749226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:34.749300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:34.749361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:34.749422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:34.749474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:34.749532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:34.749580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:34.749639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:34.749688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:34.749744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:34.749791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:34.749847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:34.749917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:34.750395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:34.750465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:34.750527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:34.750580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:34.750648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:34.750695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:34.750755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:34.750806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:34.750862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:34.750910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.750966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.751014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.751069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.751128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.751184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.751747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:34.773810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:34.791410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:34.791457Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:34.791475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:34.791490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:34.791513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 824 [2:7561401742987541054:8142]
2025-10-15T11:00:34.791561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:34.791613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:34.791625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:34.791638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:34.791651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:34.791693Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:34.791714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:34.791735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:34.793731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.793761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.793790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.793804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:34.794112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:34.794131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:34.794265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:34.794427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:34.794635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:34.794697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401742987541049:8142]
2025-10-15T11:00:34.794725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401742987541049:8142]
2025-10-15T11:00:34.794755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401742987541049:8142]
2025-10-15T11:00:34.794829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:34.794957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:34.795146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:34.795162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:34.795331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401742987541049:8142]
2025-10-15T11:00:34.795365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:34.795459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:34.795479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:34.795493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:34.795524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:34.796259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401740187849892:8824], now have 1 active actors on pipe
2025-10-15T11:00:34.796289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401740187849792:9080], now have 1 active actors on pipe
2025-10-15T11:00:34.796312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401740187849738:2467], now have 1 active actors on pipe
2025-10-15T11:00:34.796247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 824, pipe: [1:7561401740187849892:8824]
2025-10-15T11:00:34.796362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 824
2025-10-15T11:00:34.796442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 824
2025-10-15T11:00:34.800552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:34.800601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:34.800714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:34.800752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:34.800772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:34.800784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:34.800824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:34.800873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:34.800928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:34.811501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:34.811557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:34.811655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:34.815860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 825 partition: 0 MaxSeqNo: 46 sessionId: src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0
2025-10-15T11:00:34.819596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40a85699-5be33b23-16532961-179fdcfd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:34.873389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0] Write session: try to update token
2025-10-15T11:00:34.873446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:34.974119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:34.974157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:34.974168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:34.974218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:34.974233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:34.974246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:34.974257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:34.974289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401742987541049:8142]
2025-10-15T11:00:34.974313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401742987541049:8142]
2025-10-15T11:00:34.974336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401742987541049:8142]
2025-10-15T11:00:34.974483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:34.974505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:34.974530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:34.974580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:34.974614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:34.987710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:35.075589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId: src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:35.097432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:35.172545Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:35.174617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:35.174644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:35.178264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:35.179520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401740187849892:8824]
2025-10-15T11:00:35.179693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:35.191167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:35.191327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 825 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0
2025-10-15T11:00:35.198721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 825 sessionId: src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0 is DEAD
2025-10-15T11:00:35.200245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:35.200324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0] Write session will restart in 0.009048s
2025-10-15T11:00:35.200560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0] Write session: Do CDS request
2025-10-15T11:00:35.200625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:35.220782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:35.230099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:35.230141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 826
2025-10-15T11:00:35.231629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:35.231755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:35.231773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:35.231789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:35.233503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 826 sessionId:  describe result for acl check
2025-10-15T11:00:35.233603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:35.233621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:35.233629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:35.233644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401744482817244:9091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:35.235802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401744482817244:9091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:35.257673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401744482817244:9091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:35.268586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401744482817244:9091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:35.268625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401744482817244:9091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:35.268640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401744482817244:9091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:35.268667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:35.279692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401744482817369:8824]
2025-10-15T11:00:35.286087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:35.295575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:35.296347Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:35.296380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:35.296417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:35.296656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:35.296837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401747282508540:8151]
2025-10-15T11:00:35.298893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:35.300171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:35.300423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:35.301602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:35.301924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:35.301944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:35.301950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:35.301956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:35.301962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:35.301968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:35.301974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:35.301980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:35.301985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:35.301992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:35.301998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:35.302005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.302011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.302019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.302064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:35.302159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:35.302203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:35.302247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:35.302293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:35.302337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:35.302392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:35.302434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:35.302475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:35.302516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:35.302556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:35.302595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.302637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.302681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.302720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:35.302781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:35.302833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:35.302882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:35.302924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:35.302970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:35.303008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:35.303058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:35.303101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:35.303149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:35.303190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:35.303241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:35.303300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:35.303476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:35.303528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:35.303597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:35.303645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:35.303697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:35.303738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:35.303789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:35.303829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:35.303877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:35.303918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.303968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.304009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.304055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.304098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.304145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.304616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:35.329737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:35.342569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:35.342614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:35.342630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:35.342653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:35.342677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 825 [2:7561401747282508540:8151]
2025-10-15T11:00:35.342724Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:35.342774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:35.342787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:35.342798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:35.342807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:35.342850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:35.342872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:35.342889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:35.345478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 825, pipe: [1:7561401744482817369:8824]
2025-10-15T11:00:35.345593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 825
2025-10-15T11:00:35.345658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 825
2025-10-15T11:00:35.344829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.344857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.344871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.344881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:35.345143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:35.345159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.345288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.345472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.345698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:35.345770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401744482817369:8824], now have 1 active actors on pipe
2025-10-15T11:00:35.345793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401744482817339:9091], now have 1 active actors on pipe
2025-10-15T11:00:35.345812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401744482817220:2467], now have 1 active actors on pipe
2025-10-15T11:00:35.345836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401747282508534:8151]
2025-10-15T11:00:35.345851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401747282508534:8151]
2025-10-15T11:00:35.345863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401747282508534:8151]
2025-10-15T11:00:35.345900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:35.345953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:35.345966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:35.345967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:35.345976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:35.346138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:35.346158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:35.346309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:35.346331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:35.346377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401747282508534:8151]
2025-10-15T11:00:35.346409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:35.346437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:35.346516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:35.346544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:35.346563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:35.346571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:35.346603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:35.346641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:35.346724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:35.347242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:35.347265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:35.347337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:35.347871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 826 partition: 0 MaxSeqNo: 46 sessionId: src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0
2025-10-15T11:00:35.348673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57a6a3c2-ce06d422-8185ad27-d90e97a5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:35.463476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0] Write session: try to update token
2025-10-15T11:00:35.463536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:35.506014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:35.506048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:35.506060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:35.506113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:35.506128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:35.506141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:35.506151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:35.506181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401747282508534:8151]
2025-10-15T11:00:35.506209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401747282508534:8151]
2025-10-15T11:00:35.506234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401747282508534:8151]
2025-10-15T11:00:35.506691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:35.506724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:35.507470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:35.507516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:35.507544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:35.508000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:35.591231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId: src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:35.638542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:35.670918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:35.672527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:35.672568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:35.673934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401744482817369:8824]
2025-10-15T11:00:35.674116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:35.674139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:35.675502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:35.676186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:35.732785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 826 reason: error at write: Disconnected sessionId: src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0
2025-10-15T11:00:35.733088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 826 sessionId: src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0 is DEAD
2025-10-15T11:00:35.736113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:35.736183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0] Write session will restart in 0.006181s
2025-10-15T11:00:35.736369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0] Write session: Do CDS request
2025-10-15T11:00:35.736427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:35.750121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:35.750497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:35.750536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 827
2025-10-15T11:00:35.751101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:35.751234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:35.751252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:35.751265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:35.753105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 827 sessionId:  describe result for acl check
2025-10-15T11:00:35.753219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:35.753229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:35.753237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:35.753253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401744482817497:9100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:35.755766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401744482817497:9100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:35.775664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401744482817551:8824]
2025-10-15T11:00:35.777174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401744482817497:9100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:35.788833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:35.791805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401744482817497:9100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:35.791836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401744482817497:9100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:35.791846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401744482817497:9100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:35.791866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:35.792857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:35.793486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:35.793497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:35.793520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:35.793672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:35.793884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401747282508705:8155]
2025-10-15T11:00:35.795251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:35.795908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:35.796059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:35.796858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:35.797081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:35.797085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:35.797090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:35.797095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:35.797100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:35.797104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:35.797108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:35.797113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:35.797117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:35.797121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:35.797124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:35.797129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.797133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.797136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.797165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:35.797236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:35.797270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:35.797301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:35.797333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:35.797364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:35.797393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:35.797421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:35.797450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:35.797480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:35.797511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:35.797541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.797571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.797601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.797625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:35.797666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:35.797701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:35.797737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:35.797773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:35.797807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:35.797834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:35.797867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:35.797899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:35.797932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:35.797959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:35.797992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:35.798022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:35.798069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:35.798100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:35.798132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:35.798163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:35.798196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:35.798224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:35.798258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:35.798287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:35.798321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:35.798351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.798383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.798415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.798449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.798477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.798511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.798827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:35.816881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:35.827468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:35.827518Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:35.827536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:35.827554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:35.827577Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 826 [2:7561401747282508705:8155]
2025-10-15T11:00:35.827625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:35.827682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:35.827697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:35.827709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:35.827721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:35.827763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:35.827783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:35.827803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:35.828681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.828703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.828715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.828726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:35.828939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:35.828961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:35.829096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:35.829190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 826
2025-10-15T11:00:35.829270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 826, pipe: [1:7561401744482817551:8824]
2025-10-15T11:00:35.829351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 826
2025-10-15T11:00:35.829294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:35.829532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:35.829606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401744482817564:9100], now have 1 active actors on pipe
2025-10-15T11:00:35.829627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401744482817551:8824], now have 1 active actors on pipe
2025-10-15T11:00:35.829646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401744482817412:2467], now have 1 active actors on pipe
2025-10-15T11:00:35.829691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:35.829709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:35.829744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401747282508700:8155]
2025-10-15T11:00:35.829757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401747282508700:8155]
2025-10-15T11:00:35.829769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401747282508700:8155]
2025-10-15T11:00:35.829803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:35.829828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:35.829841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:35.829852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:35.829867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:35.830031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:35.830047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:35.830124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:35.830150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:35.830166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:35.830176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:35.830207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:35.830239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:35.830347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401747282508700:8155]
2025-10-15T11:00:35.830376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:35.830409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:35.830419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:35.830919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:35.830942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:35.831005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:35.831678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 827 partition: 0 MaxSeqNo: 46 sessionId: src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0
2025-10-15T11:00:35.832377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a2591da-880519e8-7a75b48e-68cd2e56_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:35.858784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0] Write session: try to update token
2025-10-15T11:00:35.858837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:35.904443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:35.904479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:35.904511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401747282508700:8155]
2025-10-15T11:00:35.904624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:35.904623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:35.912259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:35.913555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:35.915014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:35.920475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:35.922303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:35.922767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:35.927887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:35.927918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:35.927930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:35.972648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:35.972681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:35.972692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:35.972702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:35.972736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401747282508700:8155]
2025-10-15T11:00:35.972763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401747282508700:8155]
2025-10-15T11:00:35.972786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401747282508700:8155]
2025-10-15T11:00:35.972917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:35.972949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:35.973042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:35.973074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:35.973104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:35.981890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:36.007434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId: src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:36.038067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:36.121089Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:36.123060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:36.123087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:36.126386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:36.126421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:36.126286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:36.127218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401744482817551:8824]
2025-10-15T11:00:36.127316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:36.146181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 827 reason: error at write: Disconnected sessionId: src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0
2025-10-15T11:00:36.146451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 827 sessionId: src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0 is DEAD
2025-10-15T11:00:36.146925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:36.146996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0] Write session will restart in 0.008900s
2025-10-15T11:00:36.147220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0] Write session: Do CDS request
2025-10-15T11:00:36.147276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:36.163927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:36.163961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 828
2025-10-15T11:00:36.166183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:36.166689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:36.166790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:36.166805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:36.166812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:36.167772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 828 sessionId:  describe result for acl check
2025-10-15T11:00:36.167839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:36.167850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:36.167859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:36.167875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401748777784893:9104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:36.170107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401748777784893:9104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:36.178768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401748777784893:9104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:36.192136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401748777784893:9104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:36.192178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401748777784893:9104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:36.192193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401748777784893:9104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:36.192218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:36.226500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401748777785034:8824]
2025-10-15T11:00:36.227718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:36.232372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:36.233143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:36.233159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:36.233198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:36.233438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:36.233624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401751577476189:8164]
2025-10-15T11:00:36.235790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:36.236715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:36.236920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:36.238102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:36.238440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:36.238462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:36.238468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:36.238475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:36.238482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:36.238488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:36.238495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:36.238501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:36.238508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:36.238514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:36.238521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:36.238526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.238534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.238541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.238587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:36.238688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:36.238732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:36.238778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:36.238819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:36.238874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:36.238917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:36.238959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:36.239008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:36.239059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:36.239109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:36.239159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.239206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.239255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.239311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:36.239400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:36.239467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:36.239529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:36.239582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:36.239641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:36.239695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:36.239748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:36.239796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:36.239849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:36.239895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:36.239944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:36.239991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:36.240042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:36.240085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:36.240137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:36.240184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:36.240237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:36.240280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:36.240332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:36.240378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:36.240431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:36.240475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.240527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.240571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.240621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.240663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.240712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.241215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:36.259963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:36.271675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:36.271716Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:36.271731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:36.271747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:36.271768Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 827 [2:7561401751577476189:8164]
2025-10-15T11:00:36.271816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:36.271868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:36.271880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:36.271892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:36.271902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:36.271946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:36.271965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:36.271986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:36.273510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.273540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.273552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.273563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:36.273813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:36.273836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.273963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.274033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 827
2025-10-15T11:00:36.274144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 827
2025-10-15T11:00:36.274200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 827, pipe: [1:7561401748777785034:8824]
2025-10-15T11:00:36.274141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.274377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:36.274445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401748777784880:2467], now have 1 active actors on pipe
2025-10-15T11:00:36.274468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401748777784945:9104], now have 1 active actors on pipe
2025-10-15T11:00:36.274489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401748777785034:8824], now have 1 active actors on pipe
2025-10-15T11:00:36.274529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401751577476183:8164]
2025-10-15T11:00:36.274544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401751577476183:8164]
2025-10-15T11:00:36.274556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401751577476183:8164]
2025-10-15T11:00:36.274590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:36.274654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:36.274820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:36.274836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:36.274887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:36.274905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:36.275009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401751577476183:8164]
2025-10-15T11:00:36.275027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:36.275086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:36.275114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:36.275130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:36.275140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:36.275170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:36.275204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:36.275325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:36.275328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:36.275341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:36.275369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:36.275395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:36.276233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:36.276259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:36.276329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:36.277195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 828 partition: 0 MaxSeqNo: 46 sessionId: src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0
2025-10-15T11:00:36.277987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a57aa74-46bced6f-6398bb0e-aac742fa_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:36.307607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0] Write session: try to update token
2025-10-15T11:00:36.307664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:36.407575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:36.407606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:36.407617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:36.407665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:36.407687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:36.407699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:36.407708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:36.407739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401751577476183:8164]
2025-10-15T11:00:36.407762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401751577476183:8164]
2025-10-15T11:00:36.407783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401751577476183:8164]
2025-10-15T11:00:36.407891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:36.407903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:36.407922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:36.407926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:36.407952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:36.439990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:36.483444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId: src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:36.530592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:36.583440Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:36.585402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:36.585436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:36.586506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:36.586731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:36.586749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:36.589218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:36.632638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 828 reason: error at write: Disconnected sessionId: src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0
2025-10-15T11:00:36.632922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 828 sessionId: src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0 is DEAD
2025-10-15T11:00:36.635385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:36.635418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0] Write session will restart in 0.005236s
2025-10-15T11:00:36.635503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0] Write session: Do CDS request
2025-10-15T11:00:36.635527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:36.645794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:36.654834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401748777785034:8824]
2025-10-15T11:00:36.654986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:36.654999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 829
2025-10-15T11:00:36.655737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:36.655847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:36.655862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:36.655871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:36.659583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 829 sessionId:  describe result for acl check
2025-10-15T11:00:36.659680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:36.659689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:36.659697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:36.659712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401748777785125:9115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:36.661542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401748777785125:9115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:36.670778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T11:00:36.670824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-10-15T11:00:36.674442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401748777785125:9115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:36.689185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401748777785125:9115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:36.689222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401748777785125:9115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:36.689239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401748777785125:9115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:36.689266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:36.697961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:36.702127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:36.702802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:36.702818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:36.702851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:36.703012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:36.703135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401751577476366:8172]
2025-10-15T11:00:36.704652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:36.705956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:36.706146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:36.707063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:36.707446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:36.707462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:36.707469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:36.707474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:36.707481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:36.707488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:36.707494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:36.707500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:36.707507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:36.707513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:36.707520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:36.707526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.707532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.707539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.707580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:36.707677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:36.707721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:36.707763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:36.707815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:36.707867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:36.707913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:36.707960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:36.708004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:36.708054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:36.708102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:36.708148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.708193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.708241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.708282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:36.708346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:36.708404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:36.708460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:36.708512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:36.708562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:36.708611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:36.708662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:36.708709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:36.708761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:36.708807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:36.710159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:36.710222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:36.710285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:36.710334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:36.710390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:36.710451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:36.710508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:36.710555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:36.710615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:36.710650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:36.710685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:36.710715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.710765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.710807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.710853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.710883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.710932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.711331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:36.738464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:36.749273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:36.749325Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:36.749344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:36.749365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:36.749392Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 828 [2:7561401751577476366:8172]
2025-10-15T11:00:36.749454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:36.749516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:36.749531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:36.749544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:36.749557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:36.749609Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:36.749643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:36.749666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:36.755332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401748777785248:8824]
2025-10-15T11:00:36.765761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.765801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.765815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.765827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:36.766127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:36.766143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:36.766291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:36.766493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:36.766728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:36.766789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401751577476361:8172]
2025-10-15T11:00:36.766804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401751577476361:8172]
2025-10-15T11:00:36.766817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401751577476361:8172]
2025-10-15T11:00:36.766858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:36.766925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:36.767110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:36.767128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:36.768264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 828, pipe: [1:7561401748777785248:8824]
2025-10-15T11:00:36.767262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401751577476361:8172]
2025-10-15T11:00:36.767284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:36.768409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 828
2025-10-15T11:00:36.767491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:36.768505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 828
2025-10-15T11:00:36.767504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:36.767515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:36.767538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:36.767912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401748777785248:8824], now have 1 active actors on pipe
2025-10-15T11:00:36.767949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401748777785092:2467], now have 1 active actors on pipe
2025-10-15T11:00:36.767973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401748777785237:9115], now have 1 active actors on pipe
2025-10-15T11:00:36.769322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:36.769365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:36.769545Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:00:36.769669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:36.769701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:36.769720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:36.769732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:36.769770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:36.769811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:36.769856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:36.771911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:36.771949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:36.772030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:36.772003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 15 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:00:36.772147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:00:36.772319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 829 partition: 0 MaxSeqNo: 46 sessionId: src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0
2025-10-15T11:00:36.775921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebd58ebd-a1ddf363-660b9651-ef709bd7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:36.839836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0] Write session: try to update token
2025-10-15T11:00:36.839886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:36.849985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:36.850015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:36.850027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:36.959251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:36.959290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:36.959315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:36.959324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:36.959371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401751577476361:8172]
2025-10-15T11:00:36.959396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401751577476361:8172]
2025-10-15T11:00:36.959421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401751577476361:8172]
2025-10-15T11:00:36.959564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:36.959575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:36.959585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:36.959623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:36.959641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:36.977828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:36.990751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:36.990797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:36.990820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:37.047571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId: src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:37.087808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:37.135341Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:37.136991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:37.137016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:37.139247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:37.139343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:37.139400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:37.140523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401748777785248:8824]
2025-10-15T11:00:37.140645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:37.184328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 829 reason: error at write: Disconnected sessionId: src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0
2025-10-15T11:00:37.184633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 829 sessionId: src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0 is DEAD
2025-10-15T11:00:37.191555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:37.191596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0] Write session will restart in 0.009334s
2025-10-15T11:00:37.191692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0] Write session: Do CDS request
2025-10-15T11:00:37.191717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:37.208604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:37.209067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:37.209111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 830
2025-10-15T11:00:37.209481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:37.209616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:37.209633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:37.209643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:37.211961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 830 sessionId:  describe result for acl check
2025-10-15T11:00:37.212089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:37.212109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:37.212119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:37.212136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401753072752630:9123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:37.214953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401753072752630:9123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:37.227195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401753072752630:9123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:37.240049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401753072752630:9123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:37.240096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401753072752630:9123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:37.240114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401753072752630:9123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:37.240149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:37.244116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401753072752732:8824]
2025-10-15T11:00:37.249929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:37.251666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:37.252570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:37.252590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:37.252632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:37.252895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:37.253096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401755872443846:8178]
2025-10-15T11:00:37.256082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:37.258049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:37.258284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:37.259666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:37.259992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:37.260000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:37.260010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:37.260019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:37.260026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:37.260033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:37.260041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:37.260049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:37.260055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:37.260061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:37.260069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:37.260077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.260084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.260091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.260138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:37.260261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:37.260312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:37.260366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:37.260413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:37.260461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:37.260511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:37.260559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:37.260609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:37.260661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:37.260712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:37.260761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.260808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.260859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.260901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:37.260974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:37.261036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:37.261096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:37.261147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:37.261205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:37.261253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:37.261327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:37.261378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:37.261434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:37.261482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:37.261536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:37.261589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:37.261650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:37.261694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:37.261752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:37.261804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:37.261861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:37.261909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:37.261966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:37.262013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:37.262071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:37.262120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.262178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.262229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.262287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.262331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.262387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.262926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:37.285210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:37.304827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:37.304889Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:37.304910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:37.304933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:37.304963Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 829 [2:7561401755872443846:8178]
2025-10-15T11:00:37.305024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:37.305091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:37.305109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:37.305124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:37.305136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:37.305195Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:37.305222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:37.305249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:37.306258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.306276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.307062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 829
2025-10-15T11:00:37.306291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.306304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:37.307177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 829, pipe: [1:7561401753072752732:8824]
2025-10-15T11:00:37.306595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:37.307258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 829
2025-10-15T11:00:37.306616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.306779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.306984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.307256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:37.307744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401753072752576:2467], now have 1 active actors on pipe
2025-10-15T11:00:37.307796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401753072752732:8824], now have 1 active actors on pipe
2025-10-15T11:00:37.307821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401753072752729:9123], now have 1 active actors on pipe
2025-10-15T11:00:37.307870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401755872443841:8178]
2025-10-15T11:00:37.307889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401755872443841:8178]
2025-10-15T11:00:37.307902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401755872443841:8178]
2025-10-15T11:00:37.307945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:37.307992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:37.308008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:37.308019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:37.308037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:37.308253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:37.308272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:37.308333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:37.308357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:37.308530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401755872443841:8178]
2025-10-15T11:00:37.308560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:37.308593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:37.308635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:37.308668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:37.308687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:37.308699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:37.308739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:37.308784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:37.308920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:37.309805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:37.309838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:37.309914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:37.310264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 830 partition: 0 MaxSeqNo: 46 sessionId: src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0
2025-10-15T11:00:37.310970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f604628-3cc2d9ea-74307168-9e5deaf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:37.350121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0] Write session: try to update token
2025-10-15T11:00:37.350180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:37.471963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:37.471998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:37.472008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:37.472058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:37.472072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:37.472085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:37.472096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:37.472126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401755872443841:8178]
2025-10-15T11:00:37.472152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401755872443841:8178]
2025-10-15T11:00:37.472177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401755872443841:8178]
2025-10-15T11:00:37.472364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:37.472386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:37.472513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:37.472540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:37.472568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:37.473981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:37.485095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId: src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:37.509628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:37.674971Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:37.726194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:37.726245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:37.731558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:37.730581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:37.731600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:37.730726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401753072752732:8824]
2025-10-15T11:00:37.731660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401755872443841:8178]
2025-10-15T11:00:37.730794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:37.732594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:37.735461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:37.730804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:37.762495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 830 reason: error at write: Disconnected sessionId: src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0
2025-10-15T11:00:37.762773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 830 sessionId: src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0 is DEAD
2025-10-15T11:00:37.764029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:37.764058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0] Write session will restart in 0.005312s
2025-10-15T11:00:37.764143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0] Write session: Do CDS request
2025-10-15T11:00:37.764166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:37.775528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:37.774589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:37.774630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 831
2025-10-15T11:00:37.776073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:37.776210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:37.776228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:37.776239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:37.778722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 831 sessionId:  describe result for acl check
2025-10-15T11:00:37.778915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:37.778945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:37.778957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:37.778985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401753072752781:9129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:37.783319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401753072752781:9129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:37.805882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401753072752781:9129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:37.819392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401753072752781:9129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:37.819441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401753072752781:9129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:37.819459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401753072752781:9129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:37.819494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:37.831456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401753072752918:8824]
2025-10-15T11:00:37.857846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:37.861622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:37.862518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:37.862538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:37.862582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:37.862843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:37.863025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401755872444025:8187]
2025-10-15T11:00:37.865320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:37.867706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:37.867936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:37.869171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:37.869504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:37.869513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:37.869519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:37.869527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:37.869534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:37.869543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:37.869550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:37.869558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:37.869566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:37.869573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:37.869580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:37.869587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.869594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.869601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.869649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:37.869761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:37.869810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:37.869859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:37.869903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:37.869952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:37.869995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:37.870043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:37.870086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:37.870149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:37.870197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:37.870253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.870298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.870344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.870387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:37.870464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:37.870532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:37.870597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:37.870650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:37.870707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:37.870755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:37.870816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:37.870868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:37.870927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:37.870973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:37.871027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:37.871075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:37.871133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:37.871179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:37.871233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:37.871281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:37.871363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:37.871413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:37.871471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:37.871520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:37.871575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:37.871623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.871678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.871726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.871779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.871826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.871880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.872377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:37.898826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:37.917562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 830, pipe: [1:7561401753072752918:8824]
2025-10-15T11:00:37.917689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 830
2025-10-15T11:00:37.917780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 830
2025-10-15T11:00:37.915615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:37.915669Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:37.915687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:37.915708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:37.915737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 830 [2:7561401755872444025:8187]
2025-10-15T11:00:37.915792Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:37.915858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:37.915875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:37.915888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:37.915899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:37.915960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:37.915986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:37.916011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:37.916937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.916955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.916973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.916985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:37.917261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:37.917280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:37.917434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:37.917636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:37.917886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:37.917975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401753072752918:8824], now have 1 active actors on pipe
2025-10-15T11:00:37.918001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401753072752763:2467], now have 1 active actors on pipe
2025-10-15T11:00:37.918024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401753072752905:9129], now have 1 active actors on pipe
2025-10-15T11:00:37.918072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401755872444018:8187]
2025-10-15T11:00:37.918089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401755872444018:8187]
2025-10-15T11:00:37.918104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401755872444018:8187]
2025-10-15T11:00:37.918148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:37.918173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:37.918187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:37.918199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:37.918222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:37.918414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:37.918430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:37.918485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:37.918507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:37.918644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401755872444018:8187]
2025-10-15T11:00:37.918674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:37.918699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:37.918754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:37.918789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:37.918807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:37.918818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:37.918857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:37.918898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:37.920457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:37.922502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 831 partition: 0 MaxSeqNo: 46 sessionId: src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0
2025-10-15T11:00:37.922103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:37.922138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:37.922212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:37.927577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b19a27-d7cd166c-5cff1977-dee899f9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:37.972275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0] Write session: try to update token
2025-10-15T11:00:37.972328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:38.022707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:38.022737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:38.022744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:38.022785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:38.022795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:38.022804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:38.022811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:38.022832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401755872444018:8187]
2025-10-15T11:00:38.022848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401755872444018:8187]
2025-10-15T11:00:38.022863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401755872444018:8187]
2025-10-15T11:00:38.022957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:38.022985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:38.022985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:38.023005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:38.023014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:38.025530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:38.093277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId: src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:38.116299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:38.179068Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:38.181448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:38.181489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:38.183028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401753072752918:8824]
2025-10-15T11:00:38.183165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:38.183369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:38.183383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:38.194446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 831 reason: error at write: Disconnected sessionId: src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0
2025-10-15T11:00:38.199773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:38.199811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0] Write session will restart in 0.005120s
2025-10-15T11:00:38.199900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0] Write session: Do CDS request
2025-10-15T11:00:38.199925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:38.196499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 831 sessionId: src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0 is DEAD
2025-10-15T11:00:38.205190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:38.213418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:38.253103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:38.253151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 832
2025-10-15T11:00:38.253568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:38.253698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:38.253720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:38.253730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:38.256779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 832 sessionId:  describe result for acl check
2025-10-15T11:00:38.256904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:38.256916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:38.256925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:38.256943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401757367720317:9139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:38.259774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401757367720317:9139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:38.273333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401757367720317:9139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:38.284263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401757367720399:8824]
2025-10-15T11:00:38.286806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401757367720317:9139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:38.286847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401757367720317:9139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:38.286865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401757367720317:9139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:38.286895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:38.291609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:38.295132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:38.295986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:38.296022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:38.296062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:38.296309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:38.296480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401760167411515:8195]
2025-10-15T11:00:38.298994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:38.300300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:38.300510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:38.301774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:38.302109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:38.302118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:38.302125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:38.302132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:38.302139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:38.302146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:38.302154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:38.302162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:38.302169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:38.302176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:38.302183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:38.302189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.302196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.302203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.302250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:38.302361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:38.302411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:38.302460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:38.302508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:38.302556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:38.302601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:38.302647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:38.302697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:38.302743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:38.302786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:38.302831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.302878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.302920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.302962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:38.303027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:38.303084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:38.303143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:38.303194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:38.303250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:38.303295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:38.303384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:38.303438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:38.303496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:38.303542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:38.303596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:38.303644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:38.303699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:38.303746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:38.303798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:38.303847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:38.303900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:38.303946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:38.303998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:38.304044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:38.304097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:38.304142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.304195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.304241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.304294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.304337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.304392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.304916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:38.332926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:38.343109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:38.343162Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:38.343179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:38.343198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:38.343221Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 831 [2:7561401760167411515:8195]
2025-10-15T11:00:38.343273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:38.343341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:38.343495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:38.343519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:38.343532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:38.343584Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:38.343607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:38.343628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:38.345204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.345221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.345234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.345891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 831
2025-10-15T11:00:38.345245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:38.345514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:38.346017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 831
2025-10-15T11:00:38.345532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.346080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 831, pipe: [1:7561401757367720399:8824]
2025-10-15T11:00:38.345668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.345851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.346070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:38.346154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401757367720247:2467], now have 1 active actors on pipe
2025-10-15T11:00:38.346180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401757367720405:9139], now have 1 active actors on pipe
2025-10-15T11:00:38.346202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401757367720399:8824], now have 1 active actors on pipe
2025-10-15T11:00:38.346245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401760167411510:8195]
2025-10-15T11:00:38.346261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401760167411510:8195]
2025-10-15T11:00:38.346276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401760167411510:8195]
2025-10-15T11:00:38.346315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:38.346343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:38.346357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:38.346370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:38.346401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:38.346418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:38.346463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:38.346637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:38.346653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:38.346810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:38.346840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:38.346860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:38.346870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:38.346909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:38.346950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:38.346984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401760167411510:8195]
2025-10-15T11:00:38.347014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:38.347033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:38.347104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:38.348089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:38.348127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:38.348222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:38.351949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6efc63-82898de4-e5c0c77b-104ab606_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:38.348571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 832 partition: 0 MaxSeqNo: 46 sessionId: src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0
2025-10-15T11:00:38.400879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0] Write session: try to update token
2025-10-15T11:00:38.400927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:38.433471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:38.433509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:38.433524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:38.433536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:38.433575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401760167411510:8195]
2025-10-15T11:00:38.433602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401760167411510:8195]
2025-10-15T11:00:38.433630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401760167411510:8195]
2025-10-15T11:00:38.433784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:38.433818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:38.434878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:38.436277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:38.436323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:38.436365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:38.511043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId: src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:38.544076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:38.587735Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:38.589250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:38.589294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:38.591457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:38.591497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:38.594922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401757367720399:8824]
2025-10-15T11:00:38.595023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:38.591998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:38.631855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 832 reason: error at write: Disconnected sessionId: src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0
2025-10-15T11:00:38.632213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 832 sessionId: src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0 is DEAD
2025-10-15T11:00:38.639729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:38.639792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0] Write session will restart in 0.007076s
2025-10-15T11:00:38.639966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0] Write session: Do CDS request
2025-10-15T11:00:38.640012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:38.656558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:38.656142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:38.656175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 833
2025-10-15T11:00:38.657038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:38.657166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:38.657181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:38.657191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:38.658285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 833 sessionId:  describe result for acl check
2025-10-15T11:00:38.658365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:38.658377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:38.658383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:38.658397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401757367720533:9147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:38.660477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401757367720533:9147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:38.686023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401757367720533:9147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:38.688050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:38.695577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401757367720596:8824]
2025-10-15T11:00:38.696097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:38.697034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:38.697054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:38.697101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:38.697388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:38.697584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401760167411684:8200]
2025-10-15T11:00:38.698372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401757367720533:9147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:38.698419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401757367720533:9147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:38.698435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401757367720533:9147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:38.698468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:38.704094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:38.707667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:38.707979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:38.709386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:38.709744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:38.709753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:38.709762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:38.709768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:38.709776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:38.709783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:38.709790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:38.709797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:38.709804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:38.709812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:38.709820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:38.709828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.709835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.709842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.709895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:38.710016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:38.710070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:38.710119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:38.710169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:38.710220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:38.710270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:38.710317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:38.710360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:38.710412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:38.710460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:38.710510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.710554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.710600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.710654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:38.710725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:38.710788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:38.710845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:38.710899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:38.710957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:38.711006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:38.711064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:38.711113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:38.711167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:38.711215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:38.711271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:38.711336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:38.711497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:38.711547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:38.711605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:38.711656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:38.711715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:38.711765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:38.711822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:38.711870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:38.711923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:38.711970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.712027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.712075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.712130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.712178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.712234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.712764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:38.756809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:38.765188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:38.765243Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:38.765263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:38.765284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:38.765312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 832 [2:7561401760167411684:8200]
2025-10-15T11:00:38.765370Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:38.765437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:38.765454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:38.765469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:38.765481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:38.765532Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:38.765564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:38.765588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:38.766666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.766684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.766699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.766710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:38.767005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:38.767024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:38.767173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:38.768075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:38.768351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:38.768448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401757367720601:9147], now have 1 active actors on pipe
2025-10-15T11:00:38.768489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401757367720449:2467], now have 1 active actors on pipe
2025-10-15T11:00:38.768312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 832
2025-10-15T11:00:38.768426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 832, pipe: [1:7561401757367720596:8824]
2025-10-15T11:00:38.768520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 832
2025-10-15T11:00:38.768511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401757367720596:8824], now have 1 active actors on pipe
2025-10-15T11:00:38.768544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401760167411678:8200]
2025-10-15T11:00:38.768561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401760167411678:8200]
2025-10-15T11:00:38.768577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401760167411678:8200]
2025-10-15T11:00:38.768610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:38.768688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:38.768886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:38.768906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:38.769041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401760167411678:8200]
2025-10-15T11:00:38.769061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:38.769227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:38.769243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:38.769254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:38.769297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:38.769448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:38.769479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:38.769581Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26776577-46faeb73-79584183-918fc8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:38.769618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:38.769637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:38.769650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:38.769687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:38.769732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:38.769780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:38.776588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:38.776640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:38.776735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:38.777118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 833 partition: 0 MaxSeqNo: 46 sessionId: src_id|26776577-46faeb73-79584183-918fc8d_0
2025-10-15T11:00:38.782663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab9354ab-ce8b918e-1965f9fb-db88fb8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|26776577-46faeb73-79584183-918fc8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:38.841387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:38.841430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:38.841473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401760167411678:8200]
2025-10-15T11:00:38.841600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:38.843298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:38.843487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:38.857904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26776577-46faeb73-79584183-918fc8d_0] Write session: try to update token
2025-10-15T11:00:38.857947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26776577-46faeb73-79584183-918fc8d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:38.858965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:38.859993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:38.925173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:38.926694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:38.927044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:38.927057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:38.927069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:38.927120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:39.029375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:39.029412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:39.029425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:39.029435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:39.029469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401760167411678:8200]
2025-10-15T11:00:39.029493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401760167411678:8200]
2025-10-15T11:00:39.029514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401760167411678:8200]
2025-10-15T11:00:39.029659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:39.029670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:39.029679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:39.029689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:39.029720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:39.029739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:39.029741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:39.029779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:39.030845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:39.055543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId: src_id|26776577-46faeb73-79584183-918fc8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:39.080740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:39.169450Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:39.171492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:39.171534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:39.172234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:39.172996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:39.175567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:39.175846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401757367720596:8824]
2025-10-15T11:00:39.213536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 833 reason: status is not ok: tablet will be restarted right now sessionId: src_id|26776577-46faeb73-79584183-918fc8d_0
2025-10-15T11:00:39.213923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 833 sessionId: src_id|26776577-46faeb73-79584183-918fc8d_0 is DEAD
2025-10-15T11:00:39.215890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26776577-46faeb73-79584183-918fc8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:39.215961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26776577-46faeb73-79584183-918fc8d_0] Write session will restart in 0.008959s
2025-10-15T11:00:39.216112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26776577-46faeb73-79584183-918fc8d_0] Write session: Do CDS request
2025-10-15T11:00:39.216164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26776577-46faeb73-79584183-918fc8d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:39.230057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26776577-46faeb73-79584183-918fc8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:39.233486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:39.233520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 834
2025-10-15T11:00:39.234525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:39.234672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:39.234690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:39.234707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:39.237340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 834 sessionId:  describe result for acl check
2025-10-15T11:00:39.237451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:39.237459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:39.237468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:39.237482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401761662687951:9152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:39.240074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401761662687951:9152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:39.249296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401761662687951:9152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:39.267691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401761662687951:9152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:39.267739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401761662687951:9152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:39.267758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401761662687951:9152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:39.267791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:39.271791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401761662688080:8824]
2025-10-15T11:00:39.278747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:39.287610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:39.288394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:39.288412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:39.288450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:39.288682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:39.288853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401764462379174:8209]
2025-10-15T11:00:39.290950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:39.299652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:39.299900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:39.301309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:39.301657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:39.301666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:39.301672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:39.301679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:39.301685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:39.301693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:39.301700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:39.301707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:39.301713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:39.301721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:39.301728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:39.301734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.301741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.301747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.301791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:39.301892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:39.301938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:39.301983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:39.302026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:39.302070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:39.302113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:39.302156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:39.302197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:39.302243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:39.302287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:39.302333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.302375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.302416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.302458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:39.302520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:39.302576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:39.302629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:39.302676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:39.302728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:39.302772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:39.302821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:39.302866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:39.302918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:39.302960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:39.303012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:39.303057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:39.303107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:39.303150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:39.303201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:39.303247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:39.303298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:39.303378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:39.303437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:39.303482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:39.303530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:39.303573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.303621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.303662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.303713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.303756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.303805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.304274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:39.328644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:39.378123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:39.378166Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:39.378180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:39.378196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:39.378217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 833 [2:7561401764462379174:8209]
2025-10-15T11:00:39.378259Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:39.378307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:39.378319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:39.378330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:39.378339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:39.378383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:39.378402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:39.378421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:39.380612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.380640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.380652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.380664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:39.380911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:39.380927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.381053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.381223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.381432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:39.381492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401764462379169:8209]
2025-10-15T11:00:39.381507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401764462379169:8209]
2025-10-15T11:00:39.381520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401764462379169:8209]
2025-10-15T11:00:39.381556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:39.381621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:39.381783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:39.381797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:39.381899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401764462379169:8209]
2025-10-15T11:00:39.381916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:39.382276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:39.382294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:39.382304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:39.382329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:39.382929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401761662688075:9152], now have 1 active actors on pipe
2025-10-15T11:00:39.382965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401761662687920:2467], now have 1 active actors on pipe
2025-10-15T11:00:39.383178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401761662688080:8824], now have 1 active actors on pipe
2025-10-15T11:00:39.383164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 833
2025-10-15T11:00:39.383256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 833
2025-10-15T11:00:39.383788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:39.383816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:39.383894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89e63d63-89cda93f-666d237b-7e68b08b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:39.383922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:39.383937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:39.383945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:39.383978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:39.384013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:39.384054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:39.385759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:39.385787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:39.385848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:39.384842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 833, pipe: [1:7561401761662688080:8824]
2025-10-15T11:00:39.386196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 834 partition: 0 MaxSeqNo: 46 sessionId: src_id|89e63d63-89cda93f-666d237b-7e68b08b_0
2025-10-15T11:00:39.387506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26776577-46faeb73-79584183-918fc8d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|89e63d63-89cda93f-666d237b-7e68b08b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:39.453225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e63d63-89cda93f-666d237b-7e68b08b_0] Write session: try to update token
2025-10-15T11:00:39.453279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e63d63-89cda93f-666d237b-7e68b08b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:39.473950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:39.473981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:39.473991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:39.572516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:39.572550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:39.572562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:39.572572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:39.572602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401764462379169:8209]
2025-10-15T11:00:39.572626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401764462379169:8209]
2025-10-15T11:00:39.572648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401764462379169:8209]
2025-10-15T11:00:39.572758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:39.572781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:39.572788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:39.572801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:39.572816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:39.584461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:39.594657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId: src_id|89e63d63-89cda93f-666d237b-7e68b08b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:39.643483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:39.740236Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:39.742317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:39.742357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:39.744324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401761662688080:8824]
2025-10-15T11:00:39.744524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:39.744549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:39.754921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:39.755038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 834 reason: error at write: Disconnected sessionId: src_id|89e63d63-89cda93f-666d237b-7e68b08b_0
2025-10-15T11:00:39.755332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 834 sessionId: src_id|89e63d63-89cda93f-666d237b-7e68b08b_0 is DEAD
2025-10-15T11:00:39.756597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e63d63-89cda93f-666d237b-7e68b08b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:39.756630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e63d63-89cda93f-666d237b-7e68b08b_0] Write session will restart in 0.005904s
2025-10-15T11:00:39.756716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e63d63-89cda93f-666d237b-7e68b08b_0] Write session: Do CDS request
2025-10-15T11:00:39.756742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e63d63-89cda93f-666d237b-7e68b08b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:39.772549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89e63d63-89cda93f-666d237b-7e68b08b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:39.777513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:39.803531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:39.804851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 835
2025-10-15T11:00:39.805748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:39.805878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:39.805894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:39.805904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:39.808008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 835 sessionId:  describe result for acl check
2025-10-15T11:00:39.808109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:39.808120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:39.808130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:39.808147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401761662688153:9166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:39.810801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401761662688153:9166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:39.823656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401761662688153:9166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:39.844714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401761662688281:8824]
2025-10-15T11:00:39.849155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401761662688153:9166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:39.849194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401761662688153:9166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:39.849212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401761662688153:9166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:39.849241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:39.862784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:39.872123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:39.872984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:39.873016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:39.873055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:39.873303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:39.873492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401764462379359:8217]
2025-10-15T11:00:39.875794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:39.879617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:39.879844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:39.881046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:39.881364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:39.881372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:39.881379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:39.881386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:39.881393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:39.881399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:39.881407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:39.881413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:39.881420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:39.881426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:39.881439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:39.881456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.881466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.881472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.881584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:39.881788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:39.881850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:39.881906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:39.881949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:39.881994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:39.882036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:39.882082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:39.882123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:39.882173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:39.882216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:39.882260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.882305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.882347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.882387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:39.882450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:39.882547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:39.882655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:39.882757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:39.882822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:39.882877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:39.882933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:39.882980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:39.883034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:39.883079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:39.883128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:39.883174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:39.883225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:39.883268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:39.883319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:39.891767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:39.891874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:39.891924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:39.891989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:39.892065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:39.892132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:39.892177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.892230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.892276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.892328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.892369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.892423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.892888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:39.923578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:39.936085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:39.936132Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:39.936149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:39.936168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:39.936194Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 834 [2:7561401764462379359:8217]
2025-10-15T11:00:39.936246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:39.936299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:39.936314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:39.936326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:39.940335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 834
2025-10-15T11:00:39.936338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:39.936382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:39.940422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 834, pipe: [1:7561401761662688281:8824]
2025-10-15T11:00:39.936402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:39.940491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 834
2025-10-15T11:00:39.936423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:39.938146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.938161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.938175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.938187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:39.938456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:39.938474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:39.938614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:39.938844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:39.941206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:39.941312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401761662688129:2467], now have 1 active actors on pipe
2025-10-15T11:00:39.941340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401761662688281:8824], now have 1 active actors on pipe
2025-10-15T11:00:39.941361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401761662688286:9166], now have 1 active actors on pipe
2025-10-15T11:00:39.941431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:39.941451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:39.941486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401764462379353:8217]
2025-10-15T11:00:39.941501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401764462379353:8217]
2025-10-15T11:00:39.941512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401764462379353:8217]
2025-10-15T11:00:39.941557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:39.941598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:39.941615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:39.941627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:39.941632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:39.941806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:39.941823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:39.941884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:39.941912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:39.941928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:39.941938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:39.941970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:39.942006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:39.942122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401764462379353:8217]
2025-10-15T11:00:39.942154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:39.942195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:39.942964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:39.943817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:39.943845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:39.943909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:39.944868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 835 partition: 0 MaxSeqNo: 46 sessionId: src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0
2025-10-15T11:00:39.945739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89e63d63-89cda93f-666d237b-7e68b08b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:39.988258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0] Write session: try to update token
2025-10-15T11:00:39.988312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:40.082207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:40.082251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:40.082265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:40.082330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:40.082358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:40.082377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:40.082388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:40.082430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401764462379353:8217]
2025-10-15T11:00:40.082457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401764462379353:8217]
2025-10-15T11:00:40.082485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401764462379353:8217]
2025-10-15T11:00:40.082644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:40.082678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:40.083136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:40.083169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:40.083197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:40.092188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:40.178547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId: src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:40.208973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:40.245568Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:40.247183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:40.247216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:40.250791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:40.251499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:40.251514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:40.251529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:40.251728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401761662688281:8824]
2025-10-15T11:00:40.294560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 835 reason: error at write: Disconnected sessionId: src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0
2025-10-15T11:00:40.295893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:40.295931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0] Write session will restart in 0.007487s
2025-10-15T11:00:40.296026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0] Write session: Do CDS request
2025-10-15T11:00:40.296052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:40.298987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 835 sessionId: src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0 is DEAD
2025-10-15T11:00:40.310885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:40.310437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:40.310471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 836
2025-10-15T11:00:40.315682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:40.315851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:40.315868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:40.315879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:40.318061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 836 sessionId:  describe result for acl check
2025-10-15T11:00:40.318174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:40.318187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:40.318197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:40.318216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401765957655661:9173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:40.325853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401765957655661:9173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:40.351704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401765957655743:8824]
2025-10-15T11:00:40.366144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401765957655661:9173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:40.375654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:40.387969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401765957655661:9173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:40.388010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401765957655661:9173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:40.388027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401765957655661:9173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:40.388058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:40.387916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:40.388797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:40.388818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:40.388861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:40.389118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:40.389301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401768757346843:8223]
2025-10-15T11:00:40.391535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:40.392543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:40.392762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:40.394041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:40.394355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:40.394363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:40.394371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:40.394378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:40.394386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:40.394393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:40.394400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:40.394408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:40.394416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:40.394424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:40.394432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:40.394440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.394446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.394453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.394500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:40.394616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:40.394669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:40.394721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:40.394767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:40.394819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:40.394866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:40.394913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:40.394960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:40.395011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:40.395060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:40.395107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.395152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.395198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.395241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:40.395309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:40.395402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:40.395461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:40.395511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:40.395568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:40.395618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:40.395677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:40.395724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:40.395780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:40.395827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:40.395883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:40.395933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:40.395988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:40.396037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:40.396092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:40.396140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:40.396198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:40.396246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:40.396299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:40.396347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:40.396403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:40.396449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.396499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.396546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.396602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.396648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.396701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.397216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:40.425588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:40.441901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:40.441957Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:40.441973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:40.441994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:40.442019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 835 [2:7561401768757346843:8223]
2025-10-15T11:00:40.442069Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:40.442126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:40.442142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:40.442154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:40.442164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:40.442209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:40.442231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:40.442251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:40.443238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.443263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.443274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.443283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:40.443601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:40.443633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.443792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.444002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.444249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:40.444341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401765957655778:9173], now have 1 active actors on pipe
2025-10-15T11:00:40.444364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401765957655743:8824], now have 1 active actors on pipe
2025-10-15T11:00:40.444385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401765957655619:2467], now have 1 active actors on pipe
2025-10-15T11:00:40.444410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401768757346838:8223]
2025-10-15T11:00:40.444425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401768757346838:8223]
2025-10-15T11:00:40.444437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401768757346838:8223]
2025-10-15T11:00:40.444473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:40.444552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:40.444585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:40.444604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:40.444617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:40.444741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:40.444759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:40.444949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:40.444972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:40.445007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401768757346838:8223]
2025-10-15T11:00:40.445037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:40.445155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:40.445190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:40.445207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:40.445218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:40.445257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:40.445302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:40.445397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:40.446058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:40.446432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:40.446460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:40.446526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:40.444208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 835
2025-10-15T11:00:40.444294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 835, pipe: [1:7561401765957655743:8824]
2025-10-15T11:00:40.444367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 835
2025-10-15T11:00:40.447098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 836 partition: 0 MaxSeqNo: 46 sessionId: src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0
2025-10-15T11:00:40.451606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb33e9c4-486443d-14f63c8a-4584b0a8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:40.478298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0] Write session: try to update token
2025-10-15T11:00:40.478369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:40.566969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:40.567016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:40.567032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:40.567046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:40.567086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401768757346838:8223]
2025-10-15T11:00:40.567116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401768757346838:8223]
2025-10-15T11:00:40.567144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401768757346838:8223]
2025-10-15T11:00:40.567293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:40.567321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:40.567334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:40.567336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:40.567381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:40.567392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:40.567510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:40.567533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:40.572860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:40.631517Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:00:40.657268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId: src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:40.690275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:40.726361Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:40.749675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:40.749731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:40.749796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:40.749810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:40.749852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401768757346838:8223]
2025-10-15T11:00:40.750378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:40.751530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:40.751564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:40.751822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401765957655743:8824]
2025-10-15T11:00:40.751922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:40.751580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:40.771044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 836 reason: error at write: Disconnected sessionId: src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0
2025-10-15T11:00:40.771396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 836 sessionId: src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0 is DEAD
2025-10-15T11:00:40.771803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:40.771853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0] Write session will restart in 0.006785s
2025-10-15T11:00:40.772019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0] Write session: Do CDS request
2025-10-15T11:00:40.772071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:40.786455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:40.786417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:40.786454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 837
2025-10-15T11:00:40.787015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:40.787152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:40.787172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:40.787182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:40.789084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 837 sessionId:  describe result for acl check
2025-10-15T11:00:40.789198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:40.789214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:40.789223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:40.789242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401765957655818:9178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:40.791827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401765957655818:9178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:40.814470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401765957655818:9178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:40.835669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401765957655818:9178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:40.835711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401765957655818:9178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:40.835730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401765957655818:9178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:40.835760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:40.850829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401765957655927:8824]
2025-10-15T11:00:40.891545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:40.904472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:40.905423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:40.905456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:40.905507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:40.905827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:40.906031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401768757347027:8231]
2025-10-15T11:00:40.908510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:40.912146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:40.912579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:40.913868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:40.914208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:40.914226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:40.914234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:40.914241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:40.914249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:40.914257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:40.914264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:40.914271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:40.914278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:40.914286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:40.914297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:40.914304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.914311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.914318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.914367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:40.914483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:40.914533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:40.914581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:40.914626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:40.914676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:40.914722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:40.914769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:40.914818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:40.914867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:40.914913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:40.914957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.915003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.915049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.915094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:40.915160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:40.915221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:40.915277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:40.915329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:40.916117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:40.916178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:40.916240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:40.916291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:40.916353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:40.916399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:40.916457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:40.916507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:40.916565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:40.916613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:40.916670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:40.916721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:40.916781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:40.916830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:40.916885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:40.916932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:40.916984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:40.917033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.917091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.917140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.917197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.917244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.917301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.917824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:40.961715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:40.977764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:40.977815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:40.977832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:40.977852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:40.977875Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 836 [2:7561401768757347027:8231]
2025-10-15T11:00:40.977927Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:40.977986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:40.978001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:40.978014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:40.978025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:40.978077Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:40.978102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:40.978124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:40.979949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.979994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.980010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.980021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:40.980281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:40.980301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:40.980436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:40.980618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:40.980847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:40.980918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401768757347022:8231]
2025-10-15T11:00:40.980933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401768757347022:8231]
2025-10-15T11:00:40.980946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401768757347022:8231]
2025-10-15T11:00:40.980990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:40.981066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:40.981246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:40.981264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:40.981388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401768757347022:8231]
2025-10-15T11:00:40.981406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:40.981903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:40.981918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:40.981929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:40.981953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:40.983244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 836
2025-10-15T11:00:40.983324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 836, pipe: [1:7561401765957655927:8824]
2025-10-15T11:00:40.983432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 836
2025-10-15T11:00:40.982886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401765957655891:9178], now have 1 active actors on pipe
2025-10-15T11:00:40.982926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401765957655927:8824], now have 1 active actors on pipe
2025-10-15T11:00:40.982948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401765957655805:2467], now have 1 active actors on pipe
2025-10-15T11:00:40.983455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:40.983480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:40.983573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:40.983607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:40.983626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:40.983647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:40.983684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:40.983734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:40.983780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:40.984504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:40.984532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:40.984594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:40.984885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 837 partition: 0 MaxSeqNo: 46 sessionId: src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0
2025-10-15T11:00:40.985671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ea1c12-78f79b0-84581d98-9ee512a0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:41.019833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0] Write session: try to update token
2025-10-15T11:00:41.019897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:41.120706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:41.120746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:41.120762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:41.120774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:41.120813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401768757347022:8231]
2025-10-15T11:00:41.120842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401768757347022:8231]
2025-10-15T11:00:41.120872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401768757347022:8231]
2025-10-15T11:00:41.120995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:41.121030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:41.121060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:41.121098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:41.121112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:41.121124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:41.121172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:41.121195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:41.122223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:41.161888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId: src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:41.184041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:41.292208Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:41.304063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:41.304130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:41.304208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:41.304224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:41.304268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401768757347022:8231]
2025-10-15T11:00:41.305359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:41.306013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:41.309633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401765957655927:8824]
2025-10-15T11:00:41.309764Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:41.309959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:41.358091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 837 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0
2025-10-15T11:00:41.358441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 837 sessionId: src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0 is DEAD
2025-10-15T11:00:41.360108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:41.360167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0] Write session will restart in 0.007526s
2025-10-15T11:00:41.360335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0] Write session: Do CDS request
2025-10-15T11:00:41.360393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:41.384059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:41.384598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:41.384633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 838
2025-10-15T11:00:41.389835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:41.390002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:41.390019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:41.390032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:41.391300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 838 sessionId:  describe result for acl check
2025-10-15T11:00:41.391446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:41.391457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:41.391466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:41.391484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401770252623380:9189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:41.394203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401770252623380:9189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:41.404832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401770252623380:9189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:41.414040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401770252623456:8824]
2025-10-15T11:00:41.417163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401770252623380:9189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:41.417207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401770252623380:9189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:41.417226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401770252623380:9189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:41.417259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:41.422131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:41.426021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:41.426865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:41.426899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:41.426940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:41.427221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:41.427435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401773052314525:8240]
2025-10-15T11:00:41.429587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:41.431532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:41.431753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:41.433003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:41.433320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:41.433329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:41.433336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:41.433343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:41.433350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:41.433358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:41.433366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:41.433373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:41.433381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:41.433388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:41.433395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:41.433402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.433409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.433417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.433464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:41.433574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:41.433624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:41.433670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:41.433717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:41.433762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:41.433808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:41.433855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:41.433903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:41.433951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:41.433997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:41.434040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.434083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.434128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.434170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:41.434237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:41.434293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:41.434349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:41.434420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:41.434479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:41.434527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:41.439652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:41.439748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:41.439819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:41.439874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:41.439931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:41.439984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:41.440039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:41.440089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:41.440142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:41.440194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:41.440249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:41.440298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:41.440358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:41.440404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:41.440462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:41.440513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.440572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.440623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.440678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.440728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.440783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.441311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:41.465674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:41.476704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:41.476753Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:41.476772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:41.476791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:41.476818Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 837 [2:7561401773052314525:8240]
2025-10-15T11:00:41.476876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:41.476937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:41.476952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:41.476965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:41.476977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:41.477029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:41.477055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:41.477079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:41.478921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.478937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.478952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.478964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:41.479243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:41.479261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.480148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.480381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.480613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:41.480702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401770252623456:8824], now have 1 active actors on pipe
2025-10-15T11:00:41.480727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401770252623303:2467], now have 1 active actors on pipe
2025-10-15T11:00:41.480751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401770252623462:9189], now have 1 active actors on pipe
2025-10-15T11:00:41.480778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401773052314519:8240]
2025-10-15T11:00:41.480792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401773052314519:8240]
2025-10-15T11:00:41.480807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401773052314519:8240]
2025-10-15T11:00:41.480848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:41.480904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:41.480919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:41.480926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:41.480931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:41.481115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:41.481132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:41.481249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401773052314519:8240]
2025-10-15T11:00:41.481274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:41.481452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:41.482566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 837, pipe: [1:7561401770252623456:8824]
2025-10-15T11:00:41.482668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 837
2025-10-15T11:00:41.482744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 837
2025-10-15T11:00:41.483821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:41.483858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:41.483937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4e78199-c0822963-8ee255bd-aadd416_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:41.483972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:41.483992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:41.484002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:41.484042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:41.484086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:41.484132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:41.490865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:41.490915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:41.491009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:41.491560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 838 partition: 0 MaxSeqNo: 46 sessionId: src_id|f4e78199-c0822963-8ee255bd-aadd416_0
2025-10-15T11:00:41.495973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fc41ff-31d70d2b-f1090c38-24d1c27c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f4e78199-c0822963-8ee255bd-aadd416_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:41.541191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e78199-c0822963-8ee255bd-aadd416_0] Write session: try to update token
2025-10-15T11:00:41.541255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e78199-c0822963-8ee255bd-aadd416_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:41.644304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:41.644344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:41.644356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:41.644410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:41.644424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:41.644437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:41.644447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:41.644480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401773052314519:8240]
2025-10-15T11:00:41.644506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401773052314519:8240]
2025-10-15T11:00:41.644529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401773052314519:8240]
2025-10-15T11:00:41.644674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:41.644717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:41.644720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:41.644741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:41.644757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:41.645684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:41.707470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId: src_id|f4e78199-c0822963-8ee255bd-aadd416_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:41.728079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:41.808489Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:41.821921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:41.821974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:41.822047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:41.822062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:41.822106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401773052314519:8240]
2025-10-15T11:00:41.822299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:41.823053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:41.823625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:41.823757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:41.823764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401770252623456:8824]
2025-10-15T11:00:41.823769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:41.832038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 838 reason: error at write: Disconnected sessionId: src_id|f4e78199-c0822963-8ee255bd-aadd416_0
2025-10-15T11:00:41.832352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 838 sessionId: src_id|f4e78199-c0822963-8ee255bd-aadd416_0 is DEAD
2025-10-15T11:00:41.835765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e78199-c0822963-8ee255bd-aadd416_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:41.835818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e78199-c0822963-8ee255bd-aadd416_0] Write session will restart in 0.009387s
2025-10-15T11:00:41.835919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e78199-c0822963-8ee255bd-aadd416_0] Write session: Do CDS request
2025-10-15T11:00:41.835951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e78199-c0822963-8ee255bd-aadd416_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:41.850572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e78199-c0822963-8ee255bd-aadd416_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:41.853646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:41.853679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 839
2025-10-15T11:00:41.855712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:41.855838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:41.855857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:41.855865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:41.857910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 839 sessionId:  describe result for acl check
2025-10-15T11:00:41.858012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:41.858022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:41.858031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:41.858047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401770252623518:9198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:41.860909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401770252623518:9198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:41.872827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401770252623518:9198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:41.884989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401770252623518:9198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:41.885035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401770252623518:9198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:41.885055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401770252623518:9198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:41.885089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:41.922876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401770252623668:8824]
2025-10-15T11:00:41.958694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:41.961046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:41.961819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:41.961833Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:41.961867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:41.962041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:41.962161Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401773052314714:8244]
2025-10-15T11:00:41.963624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:41.964598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:41.964811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:41.965883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:41.966165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:41.966196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:41.966205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:41.966211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:41.966218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:41.966226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:41.966233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:41.966240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:41.966246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:41.966254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:41.966261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:41.966269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.966275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.966283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.966331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:41.966459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:41.966507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:41.966555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:41.966602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:41.966652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:41.966710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:41.966767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:41.966805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:41.966839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:41.966874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:41.966909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.966941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.966976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.967021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:41.967081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:41.967142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:41.967201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:41.967250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:41.967299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:41.967330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:41.967402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:41.967439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:41.967478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:41.967512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:41.967551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:41.967583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:41.967623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:41.967656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:41.967700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:41.967749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:41.967803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:41.967849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:41.967903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:41.967947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:41.967988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:41.968024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.968074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:41.968121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.968176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:41.968220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.968275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:41.968802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:41.990156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:42.000149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:42.000205Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:42.000225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:42.000246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:42.000272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 838 [2:7561401773052314714:8244]
2025-10-15T11:00:42.000332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:42.000398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:42.000412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:42.000428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:42.000440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:42.000497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:42.000531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:42.000557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:42.001843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:42.001872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:42.001887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:42.001899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:42.002172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:42.002191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:42.002341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:42.002545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:42.002788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:42.002875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401770252623551:9198], now have 1 active actors on pipe
2025-10-15T11:00:42.002901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401770252623668:8824], now have 1 active actors on pipe
2025-10-15T11:00:42.002925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401770252623507:2467], now have 1 active actors on pipe
2025-10-15T11:00:42.002954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401773052314709:8244]
2025-10-15T11:00:42.002972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401773052314709:8244]
2025-10-15T11:00:42.002988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401773052314709:8244]
2025-10-15T11:00:42.003027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:42.003108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:42.003311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:42.003340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:42.003869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:42.003896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:42.003911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:42.003881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 838
2025-10-15T11:00:42.003970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 838, pipe: [1:7561401770252623668:8824]
2025-10-15T11:00:42.004048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 838
2025-10-15T11:00:42.005341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:42.005380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:42.005448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401773052314709:8244]
2025-10-15T11:00:42.005479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:42.005601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45512320-e83a63a6-f7710ff4-16163bd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:42.005632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:42.005651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:42.005663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:42.005701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:42.005747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:42.005835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:42.006327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:42.008898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:42.008936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:42.009028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:42.010219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e78199-c0822963-8ee255bd-aadd416_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|45512320-e83a63a6-f7710ff4-16163bd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:42.009443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 839 partition: 0 MaxSeqNo: 46 sessionId: src_id|45512320-e83a63a6-f7710ff4-16163bd7_0
2025-10-15T11:00:42.049984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45512320-e83a63a6-f7710ff4-16163bd7_0] Write session: try to update token
2025-10-15T11:00:42.050040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45512320-e83a63a6-f7710ff4-16163bd7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:42.176989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:42.177034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:42.177046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:42.177102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:42.177117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:42.177132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:42.177144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:42.177178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401773052314709:8244]
2025-10-15T11:00:42.177205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401773052314709:8244]
2025-10-15T11:00:42.177230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401773052314709:8244]
2025-10-15T11:00:42.177396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:42.177421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:42.177436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:42.177445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:42.177476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:42.178577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:42.183533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId: src_id|45512320-e83a63a6-f7710ff4-16163bd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:42.207480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:42.325574Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:42.346990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:42.347044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:42.347191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:42.347205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:42.347247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401773052314709:8244]
2025-10-15T11:00:42.347733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:42.348219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401770252623668:8824]
2025-10-15T11:00:42.348299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:42.348401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:42.348411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:42.348350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:42.359414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45512320-e83a63a6-f7710ff4-16163bd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:42.359470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45512320-e83a63a6-f7710ff4-16163bd7_0] Write session will restart in 0.005292s
2025-10-15T11:00:42.359580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45512320-e83a63a6-f7710ff4-16163bd7_0] Write session: Do CDS request
2025-10-15T11:00:42.359614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45512320-e83a63a6-f7710ff4-16163bd7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:42.358655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 839 reason: error at write: Disconnected sessionId: src_id|45512320-e83a63a6-f7710ff4-16163bd7_0
2025-10-15T11:00:42.367485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 839 sessionId: src_id|45512320-e83a63a6-f7710ff4-16163bd7_0 is DEAD
2025-10-15T11:00:42.380069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45512320-e83a63a6-f7710ff4-16163bd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:42.380058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:42.380093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 840
2025-10-15T11:00:42.380634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:42.380762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:42.380778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:42.380789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:42.382296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 840 sessionId:  describe result for acl check
2025-10-15T11:00:42.382417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:42.382429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:42.382439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:42.382457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401774547591000:9202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:42.385245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401774547591000:9202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:42.404750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401774547591000:9202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:42.413160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401774547591000:9202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:42.413206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401774547591000:9202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:42.413222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401774547591000:9202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:42.413251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:42.448117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401774547591124:8824]
2025-10-15T11:00:42.475078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:42.480661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:42.481443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:42.481459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:42.481497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:42.481731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:42.481908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401777347282197:8254]
2025-10-15T11:00:42.484119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:42.485132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:42.485340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:42.486381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:42.486685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:42.486693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:42.486699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:42.486707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:42.486713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:42.486720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:42.486726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:42.486733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:42.486740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:42.486746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:42.486752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:42.486759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:42.486766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:42.486772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:42.486818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:42.486919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:42.486962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:42.487007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:42.487049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:42.487091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:42.487134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:42.487174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:42.487215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:42.487259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:42.487300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:42.487341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:42.487417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:42.487461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:42.487504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:42.487569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:42.487622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:42.487672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:42.487721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:42.487769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:42.487813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:42.487865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:42.487910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:42.487960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:42.488004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:42.488055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:42.488096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:42.488148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:42.488194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:42.488246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:42.488294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:42.488343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:42.488389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:42.488439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:42.488482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:42.488533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:42.488577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:42.488629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:42.488673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:42.488727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:42.488771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:42.488824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:42.489306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:42.522439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:42.532928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:42.532978Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:42.532995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:42.533012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:42.533035Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 839 [2:7561401777347282197:8254]
2025-10-15T11:00:42.533082Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:42.533139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:42.533153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:42.533164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:42.533175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:42.533222Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:42.533243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:42.533262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:42.534928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:42.534958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:42.534972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:42.534983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:42.535737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:42.535767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:42.536467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 839, pipe: [1:7561401774547591124:8824]
2025-10-15T11:00:42.536585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 839
2025-10-15T11:00:42.536659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 839
2025-10-15T11:00:42.535894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:42.536072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:42.536281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:42.536317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401774547591124:8824], now have 1 active actors on pipe
2025-10-15T11:00:42.536340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401774547591035:9202], now have 1 active actors on pipe
2025-10-15T11:00:42.536360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401774547590991:2467], now have 1 active actors on pipe
2025-10-15T11:00:42.536447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401777347282191:8254]
2025-10-15T11:00:42.536461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401777347282191:8254]
2025-10-15T11:00:42.536475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401777347282191:8254]
2025-10-15T11:00:42.536509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:42.536577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:42.536740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:42.536754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:42.536858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401777347282191:8254]
2025-10-15T11:00:42.536877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:42.536933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:42.536948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:42.536961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:42.536986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:42.537810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:42.537848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:42.537928Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:42.537962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:42.537997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:42.538009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:42.538042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:42.538080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:42.538124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:42.538736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:42.538770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:42.538836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:42.540717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45512320-e83a63a6-f7710ff4-16163bd7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:42.539128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 840 partition: 0 MaxSeqNo: 46 sessionId: src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0
2025-10-15T11:00:42.597840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0] Write session: try to update token
2025-10-15T11:00:42.597896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:42.618861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:42.618901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:42.618939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401777347282191:8254]
2025-10-15T11:00:42.619062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:42.619413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:42.626214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:42.627938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:42.629247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:42.635820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:42.637928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:42.638644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:42.638657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:42.638668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:42.638716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:42.759090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:42.759139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:42.759168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:42.759191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:42.759230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401777347282191:8254]
2025-10-15T11:00:42.759257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401777347282191:8254]
2025-10-15T11:00:42.759300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401777347282191:8254]
2025-10-15T11:00:42.759468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:42.759502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:42.759521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:42.759543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:42.759554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:42.759581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:42.759625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:42.759649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:42.760686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:42.766956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId: src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:42.788712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:42.906455Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:42.908824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:42.908874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:42.909707Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:42.912422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401774547591124:8824]
2025-10-15T11:00:42.912603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:42.920378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 840 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0
2025-10-15T11:00:42.920743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 840 sessionId: src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0 is DEAD
2025-10-15T11:00:42.927485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:42.927525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0] Write session will restart in 0.008450s
2025-10-15T11:00:42.927626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0] Write session: Do CDS request
2025-10-15T11:00:42.927656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:42.936203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:42.947577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:42.947613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:42.947647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 841
2025-10-15T11:00:42.948216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:42.948354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:42.948376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:42.948385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:42.949672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 841 sessionId:  describe result for acl check
2025-10-15T11:00:42.949775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:42.949794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:42.949806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:42.949823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401774547591208:9214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:42.952478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401774547591208:9214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:42.961254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401774547591208:9214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:42.972932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401774547591208:9214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:42.972979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401774547591208:9214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:42.972995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401774547591208:9214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:42.973019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:43.015591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401778842558632:8824]
2025-10-15T11:00:43.033469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:43.035214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:43.036033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:43.036068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:43.036108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:43.036350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:43.036549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401781642249697:8261]
2025-10-15T11:00:43.038674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:43.044191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:43.044469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:43.045834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:43.046196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:43.046213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:43.046220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:43.046228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:43.046234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:43.046240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:43.046246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:43.046253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:43.046260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:43.046267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:43.046273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:43.046281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.046288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.046295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.046344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:43.046451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:43.046502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:43.046566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:43.046619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:43.046669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:43.046717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:43.046762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:43.046798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:43.046856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:43.046905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:43.046952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.046992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.047029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.047074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:43.047145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:43.047210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:43.047265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:43.047319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:43.047453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:43.047506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:43.047575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:43.047632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:43.047700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:43.047751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:43.047809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:43.047860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:43.047921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:43.047970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:43.048029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:43.048085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:43.048161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:43.048213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:43.048276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:43.048324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:43.048385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:43.048436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.048498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.048552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.048615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.048661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.048722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.049253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:43.066120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:43.075640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:43.075687Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:43.075704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:43.075724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:43.075747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 840 [2:7561401781642249697:8261]
2025-10-15T11:00:43.075797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:43.075848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:43.075860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:43.075872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:43.075883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:43.075934Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:43.075957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:43.075979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:43.077679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.077702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.077715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.077726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:43.078275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 840, pipe: [1:7561401778842558632:8824]
2025-10-15T11:00:43.078415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 840
2025-10-15T11:00:43.078512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 840
2025-10-15T11:00:43.077981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:43.078008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.078143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.078316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.078533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:43.078610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401778842558632:8824], now have 1 active actors on pipe
2025-10-15T11:00:43.078633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401774547591202:2467], now have 1 active actors on pipe
2025-10-15T11:00:43.078653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401774547591261:9214], now have 1 active actors on pipe
2025-10-15T11:00:43.078697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401781642249692:8261]
2025-10-15T11:00:43.078712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401781642249692:8261]
2025-10-15T11:00:43.078724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401781642249692:8261]
2025-10-15T11:00:43.078763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:43.078853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:43.078871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:43.078908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:43.079079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:43.079097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:43.079250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:43.079277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:43.079296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:43.079306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:43.079341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:43.079416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:43.079429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:43.079441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:43.079979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:43.080028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401781642249692:8261]
2025-10-15T11:00:43.080054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:43.080148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:43.080180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:43.080842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:43.080880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:43.080942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:43.081210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 841 partition: 0 MaxSeqNo: 46 sessionId: src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0
2025-10-15T11:00:43.081991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd9226bd-264de6c0-5709f060-9bd9c73c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:43.104552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0] Write session: try to update token
2025-10-15T11:00:43.104610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:43.157128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:43.157161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:43.157199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401781642249692:8261]
2025-10-15T11:00:43.157329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:43.157353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:43.158993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:43.160388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:43.161398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:43.162410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:43.164003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:43.192342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:43.192372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:43.192385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:43.192450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:43.210891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:43.210931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:43.210946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:43.210958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:43.211003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401781642249692:8261]
2025-10-15T11:00:43.211035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401781642249692:8261]
2025-10-15T11:00:43.211061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401781642249692:8261]
2025-10-15T11:00:43.211202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:43.211236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:43.211250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:43.211258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:43.211280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:43.216795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:43.218602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId: src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:43.237898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:43.358428Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:43.360041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:43.360079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:43.361120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:43.364962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401778842558632:8824]
2025-10-15T11:00:43.365146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:43.365406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:43.411263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 841 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0
2025-10-15T11:00:43.412619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:43.412685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0] Write session will restart in 0.008198s
2025-10-15T11:00:43.412862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0] Write session: Do CDS request
2025-10-15T11:00:43.412920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:43.411636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 841 sessionId: src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0 is DEAD
2025-10-15T11:00:43.428400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:43.428439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 842
2025-10-15T11:00:43.428568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:43.431824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:43.431998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:43.432020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:43.432035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:43.434336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 842 sessionId:  describe result for acl check
2025-10-15T11:00:43.434470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:43.434491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:43.434501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:43.434519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401778842558766:9221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:43.437392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401778842558766:9221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:43.446020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401778842558766:9221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:43.455310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401778842558766:9221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:43.455369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401778842558766:9221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:43.455387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401778842558766:9221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:43.455433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:43.458389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:43.464378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:43.464613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401778842558873:8824]
2025-10-15T11:00:43.465073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:43.465095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:43.465122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:43.465289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:43.465404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401781642249878:8266]
2025-10-15T11:00:43.468531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:43.472051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:43.472261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:43.473234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:43.473470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:43.473475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:43.473479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:43.473485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:43.473489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:43.473493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:43.473497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:43.473501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:43.473505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:43.473509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:43.473513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:43.473517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.473521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.473525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.473556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:43.473636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:43.473676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:43.473720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:43.473753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:43.473783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:43.473813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:43.473843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:43.473873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:43.473903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:43.473942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:43.473971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.474001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.474031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.474057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:43.474099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:43.474136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:43.474178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:43.474217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:43.474251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:43.474281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:43.474317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:43.474348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:43.474381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:43.474407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:43.474455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:43.474494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:43.474532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:43.474560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:43.474594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:43.474625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:43.474659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:43.474695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:43.474740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:43.474769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:43.474803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:43.474828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.474861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.474890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.474922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.474958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.474991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.475322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:43.503268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:43.517192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:43.517245Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:43.517265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:43.517288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:43.517318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 841 [2:7561401781642249878:8266]
2025-10-15T11:00:43.517376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:43.517445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:43.517463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:43.517477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:43.517490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:43.517542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:43.517566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:43.517591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:43.518632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.518648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.518664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.518677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:43.518954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:43.518974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:43.519137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:43.519341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:43.520158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 841, pipe: [1:7561401778842558873:8824]
2025-10-15T11:00:43.520281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 841
2025-10-15T11:00:43.520372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 841
2025-10-15T11:00:43.520958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:43.521057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401778842558873:8824], now have 1 active actors on pipe
2025-10-15T11:00:43.521083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401778842558693:2467], now have 1 active actors on pipe
2025-10-15T11:00:43.521106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401778842558864:9221], now have 1 active actors on pipe
2025-10-15T11:00:43.521174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:43.521198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:43.521235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401781642249873:8266]
2025-10-15T11:00:43.521250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401781642249873:8266]
2025-10-15T11:00:43.521265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401781642249873:8266]
2025-10-15T11:00:43.521308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:43.521355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:43.521371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:43.521383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:43.521385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:43.521594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:43.521612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:43.521685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:43.521718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:43.521736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:43.521747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:43.521785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:43.521830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:43.521962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401781642249873:8266]
2025-10-15T11:00:43.521992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:43.522018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:43.522039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:43.523672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:43.523702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:43.523776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:43.524052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 842 partition: 0 MaxSeqNo: 46 sessionId: src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0
2025-10-15T11:00:43.524873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6933298-9f31a12c-35a7529c-bcbe268e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:43.576384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0] Write session: try to update token
2025-10-15T11:00:43.576441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:43.584415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:43.584448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:43.584484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401781642249873:8266]
2025-10-15T11:00:43.584597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:43.584620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:43.613158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:43.617332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:43.618556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:43.650567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:43.652499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:43.690390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:43.690417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:43.690429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:43.690540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:43.706943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId: src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:43.730831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:43.730868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:43.730883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:43.730894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:43.730932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401781642249873:8266]
2025-10-15T11:00:43.730959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401781642249873:8266]
2025-10-15T11:00:43.730983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401781642249873:8266]
2025-10-15T11:00:43.731131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:43.731159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:43.731152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:43.731214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:43.731254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:43.732538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:43.733906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:43.869462Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:43.871703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:43.871738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:43.872294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401778842558873:8824]
2025-10-15T11:00:43.872346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:43.872411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:43.872423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:43.872953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:43.904008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 842 reason: error at write: Disconnected sessionId: src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0
2025-10-15T11:00:43.904332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 842 sessionId: src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0 is DEAD
2025-10-15T11:00:43.907756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:43.907782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0] Write session will restart in 0.005247s
2025-10-15T11:00:43.907882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0] Write session: Do CDS request
2025-10-15T11:00:43.907909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:43.922189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:43.922221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 843
2025-10-15T11:00:43.924374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:43.927901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:43.928074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:43.928089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:43.928099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:43.931552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 843 sessionId:  describe result for acl check
2025-10-15T11:00:43.931682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:43.931693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:43.931702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:43.931718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401778842558924:9227] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:43.934477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401778842558924:9227] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:43.943619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401778842558924:9227] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:43.953106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401778842558924:9227] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:43.953146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401778842558924:9227] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:43.953160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401778842558924:9227] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:43.953185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:43.973559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401778842559056:8824]
2025-10-15T11:00:43.991441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:44.000040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:44.000760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:44.000775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:44.000813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:44.001042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:44.001210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401785937217374:8275]
2025-10-15T11:00:44.003280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:44.007888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:44.008097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:44.009252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:44.009550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:44.009557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:44.009564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:44.009571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:44.009578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:44.009584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:44.009591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:44.009598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:44.009605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:44.009612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:44.009619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:44.009626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.009632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.009640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.009685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:44.009782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:44.009828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:44.009871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:44.009914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:44.009957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:44.010000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:44.010041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:44.010082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:44.010126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:44.010168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:44.010208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.010250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.010294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.010329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:44.010386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:44.010438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:44.010489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:44.010535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:44.010586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:44.010628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:44.010679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:44.010724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:44.010773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:44.010812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:44.010860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:44.010903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:44.010951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:44.010991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:44.011038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:44.011080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:44.011128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:44.011169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:44.011216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:44.011259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:44.011307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:44.011411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.011466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.011512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.011562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.011599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.011645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.012121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:44.045435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:44.056226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:44.056263Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:44.056278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:44.056296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:44.056319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 842 [2:7561401785937217374:8275]
2025-10-15T11:00:44.056365Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:44.056419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:44.056431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:44.056441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:44.056450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:44.056494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:44.056513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:44.056532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:44.058356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.058369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.058381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.058392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:44.058642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:44.058658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.058773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.058927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.059125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:44.059190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401781642250072:8275]
2025-10-15T11:00:44.059204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401781642250072:8275]
2025-10-15T11:00:44.059218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401781642250072:8275]
2025-10-15T11:00:44.059990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 842
2025-10-15T11:00:44.059343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:44.059370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:44.060100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 842
2025-10-15T11:00:44.059381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:44.060160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 842, pipe: [1:7561401778842559056:8824]
2025-10-15T11:00:44.064604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:44.064731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:44.064922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:44.064938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:44.064990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401778842558890:2467], now have 1 active actors on pipe
2025-10-15T11:00:44.065012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401778842559034:9227], now have 1 active actors on pipe
2025-10-15T11:00:44.065032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401778842559056:8824], now have 1 active actors on pipe
2025-10-15T11:00:44.065099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:44.065118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:44.065226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401781642250072:8275]
2025-10-15T11:00:44.065254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:44.065315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60cd1e46-581b1311-ceedcf22-23549781_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:44.065341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:44.065356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:44.065367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:44.065442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:44.065477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:44.065594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:44.066940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:44.069556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 843 partition: 0 MaxSeqNo: 46 sessionId: src_id|60cd1e46-581b1311-ceedcf22-23549781_0
2025-10-15T11:00:44.069192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:44.069221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:44.069290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:44.075658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01cbba2-e34a7eb0-34cf9291-48c98400_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|60cd1e46-581b1311-ceedcf22-23549781_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:44.130802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd1e46-581b1311-ceedcf22-23549781_0] Write session: try to update token
2025-10-15T11:00:44.130860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd1e46-581b1311-ceedcf22-23549781_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:44.265801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:44.265831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:44.265841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:44.265958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:44.265970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:44.265980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:44.265988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:44.266019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401781642250072:8275]
2025-10-15T11:00:44.266041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401781642250072:8275]
2025-10-15T11:00:44.266061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401781642250072:8275]
2025-10-15T11:00:44.267482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:44.267530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:44.267557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:44.276419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:44.276457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:44.278495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:44.283512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId: src_id|60cd1e46-581b1311-ceedcf22-23549781_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:44.327635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:44.431752Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:44.433687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:44.433714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:44.433758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401781642250072:8275]
2025-10-15T11:00:44.433891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:44.433909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:44.433935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:44.438930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:44.435524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:44.435671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:44.435693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:44.452574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 843 reason: error at write: Disconnected sessionId: src_id|60cd1e46-581b1311-ceedcf22-23549781_0
2025-10-15T11:00:44.452861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 843 sessionId: src_id|60cd1e46-581b1311-ceedcf22-23549781_0 is DEAD
2025-10-15T11:00:44.454702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd1e46-581b1311-ceedcf22-23549781_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:44.454783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd1e46-581b1311-ceedcf22-23549781_0] Write session will restart in 0.008699s
2025-10-15T11:00:44.454966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd1e46-581b1311-ceedcf22-23549781_0] Write session: Do CDS request
2025-10-15T11:00:44.455017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd1e46-581b1311-ceedcf22-23549781_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:44.469987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd1e46-581b1311-ceedcf22-23549781_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:44.493184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401778842559056:8824]
2025-10-15T11:00:44.496415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:44.496459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 844
2025-10-15T11:00:44.496989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:44.497112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:44.497135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:44.497145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:44.501057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 844 sessionId:  describe result for acl check
2025-10-15T11:00:44.501204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:44.501222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:44.501238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:44.501265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401783137526494:9240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:44.505824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401783137526494:9240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:44.514209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401783137526494:9240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:44.537306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:44.543452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401783137526494:9240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:44.543502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401783137526494:9240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:44.543519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401783137526494:9240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:44.543555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:44.544594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:44.545440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:44.545473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:44.545516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:44.545777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:44.545960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401785937217570:8284]
2025-10-15T11:00:44.548611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:44.549901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:44.550149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:44.551503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:44.551848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:44.551857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:44.551864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:44.551873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:44.551880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:44.551887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:44.551894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:44.551901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:44.551909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:44.551917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:44.551924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:44.551930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.551936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.551944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.551990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:44.552102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:44.552152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:44.552200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:44.552244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:44.552294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:44.552339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:44.552389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:44.552436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:44.552486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:44.552532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:44.552579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.552628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.552672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.552716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:44.552962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:44.553027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:44.553086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:44.553136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:44.553192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:44.553237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:44.553294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:44.553344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:44.553402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:44.553451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:44.553510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:44.553559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:44.553616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:44.553662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:44.553733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:44.553783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:44.553838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:44.553883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:44.553938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:44.553984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:44.554042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:44.554087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.554145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.554196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.554252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.554300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.554357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.554900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:44.580435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:44.594005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:44.594048Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:44.594067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:44.594087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:44.594112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 843 [2:7561401785937217570:8284]
2025-10-15T11:00:44.594166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:44.594229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:44.594245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:44.594259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:44.594270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:44.594323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:44.594349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:44.594371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:44.597023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.597048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.597063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.597077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:44.597359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:44.597378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:44.597538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:44.597725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:44.598005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:44.598097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401783137526588:8824], now have 1 active actors on pipe
2025-10-15T11:00:44.598122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401783137526394:2467], now have 1 active actors on pipe
2025-10-15T11:00:44.598144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401783137526572:9240], now have 1 active actors on pipe
2025-10-15T11:00:44.598170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401785937217564:8284]
2025-10-15T11:00:44.598186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401785937217564:8284]
2025-10-15T11:00:44.598199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401785937217564:8284]
2025-10-15T11:00:44.598242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:44.598316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:44.595515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401783137526588:8824]
2025-10-15T11:00:44.598519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:44.598539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:44.598526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 843
2025-10-15T11:00:44.598666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401785937217564:8284]
2025-10-15T11:00:44.598599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 843, pipe: [1:7561401783137526588:8824]
2025-10-15T11:00:44.598686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:44.598761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 843
2025-10-15T11:00:44.599274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:44.599288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:44.599301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:44.599327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:44.599918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:44.599954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:44.600050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78e14a63-5d195f17-9900d3ec-8887643c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:44.600084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:44.600104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:44.600114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:44.600153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:44.600198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:44.600253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:44.601621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:44.602302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 844 partition: 0 MaxSeqNo: 46 sessionId: src_id|78e14a63-5d195f17-9900d3ec-8887643c_0
2025-10-15T11:00:44.601645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:44.601717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:44.604231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd1e46-581b1311-ceedcf22-23549781_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|78e14a63-5d195f17-9900d3ec-8887643c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:44.631101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e14a63-5d195f17-9900d3ec-8887643c_0] Write session: try to update token
2025-10-15T11:00:44.631169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e14a63-5d195f17-9900d3ec-8887643c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:44.739071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId: src_id|78e14a63-5d195f17-9900d3ec-8887643c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:44.761865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:44.761893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:44.761904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:44.762018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:44.762037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:44.762050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:44.762060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:44.762091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401785937217564:8284]
2025-10-15T11:00:44.762114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401785937217564:8284]
2025-10-15T11:00:44.762139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401785937217564:8284]
2025-10-15T11:00:44.762372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:44.762431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:44.762469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:44.767592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:44.786424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:44.786467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:44.787400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:44.934031Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:44.935617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:44.935656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:44.935706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:44.935723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:44.935764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401785937217564:8284]
2025-10-15T11:00:44.935894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:44.936834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:44.936364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401783137526588:8824]
2025-10-15T11:00:44.936473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:44.936611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:44.936625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:44.949695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 844 reason: error at write: Disconnected sessionId: src_id|78e14a63-5d195f17-9900d3ec-8887643c_0
2025-10-15T11:00:44.950392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e14a63-5d195f17-9900d3ec-8887643c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:44.950430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e14a63-5d195f17-9900d3ec-8887643c_0] Write session will restart in 0.005107s
2025-10-15T11:00:44.950552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e14a63-5d195f17-9900d3ec-8887643c_0] Write session: Do CDS request
2025-10-15T11:00:44.950585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e14a63-5d195f17-9900d3ec-8887643c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:44.959678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e14a63-5d195f17-9900d3ec-8887643c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:44.962335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 844 sessionId: src_id|78e14a63-5d195f17-9900d3ec-8887643c_0 is DEAD
2025-10-15T11:00:44.964181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:44.964214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 845
2025-10-15T11:00:44.967708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:44.967849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:44.967865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:44.967877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:44.970695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 845 sessionId:  describe result for acl check
2025-10-15T11:00:44.970810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:44.970820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:44.970829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:44.970847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401783137526619:9248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:44.973275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401783137526619:9248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:44.983864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401783137526619:9248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:44.996567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401783137526619:9248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:44.996618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401783137526619:9248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:44.996636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401783137526619:9248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:44.996668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:45.036603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:45.035881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401787432494068:8824]
2025-10-15T11:00:45.043017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:45.044064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:45.044101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:45.044152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:45.044473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:45.044697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401790232185063:8288]
2025-10-15T11:00:45.047148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:45.049745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:45.050024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:45.051444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:45.051837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.051861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.051869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.051877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.051884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.051891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.051899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.051907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.051915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.051923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.051931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.051939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.051947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.051955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.052009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.052140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.052192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.052247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.052298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.052359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.052408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.052461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.052512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.052568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.052619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.052669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.052719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.052769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.052820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.052897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.052966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.053027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.053082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.053143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.053203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.053264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.053322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.053392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.053450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.053513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.053568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.053633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.053688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.053754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.053828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.053942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.054000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.054073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.054130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.054198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.054254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.054315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.054377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.054443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.054504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.054569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.055158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:45.074613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:45.083565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:45.083616Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:45.083637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:45.083659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:45.083683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 844 [2:7561401790232185063:8288]
2025-10-15T11:00:45.083727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:45.083801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:45.083819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:45.083832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:45.083847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:45.083902Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:45.083926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:45.083945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:45.108020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.108047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.108057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.108068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:45.108349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:45.108373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.108508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.108678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.108875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:45.108949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401790232185057:8288]
2025-10-15T11:00:45.108964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401790232185057:8288]
2025-10-15T11:00:45.108976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401790232185057:8288]
2025-10-15T11:00:45.109017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:45.109092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:45.109170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:45.109185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:45.109196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:45.109288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:45.109307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:45.109426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401790232185057:8288]
2025-10-15T11:00:45.109446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:45.109502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:45.110280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 844, pipe: [1:7561401787432494068:8824]
2025-10-15T11:00:45.109536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401787432494068:8824], now have 1 active actors on pipe
2025-10-15T11:00:45.109589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401783137526600:2467], now have 1 active actors on pipe
2025-10-15T11:00:45.110382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 844
2025-10-15T11:00:45.109610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401783137526669:9248], now have 1 active actors on pipe
2025-10-15T11:00:45.110461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 844
2025-10-15T11:00:45.110667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:45.110692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:45.110773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:45.110805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:45.110825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:45.110838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:45.110876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:45.110921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:45.110968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:45.112060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:45.112089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:45.112161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:45.114432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 845 partition: 0 MaxSeqNo: 46 sessionId: src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0
2025-10-15T11:00:45.117099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e14a63-5d195f17-9900d3ec-8887643c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:45.149396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0] Write session: try to update token
2025-10-15T11:00:45.149457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:45.178301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:45.178341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:45.178359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:45.178372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:45.178413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401790232185057:8288]
2025-10-15T11:00:45.178445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401790232185057:8288]
2025-10-15T11:00:45.178473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401790232185057:8288]
2025-10-15T11:00:45.178638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:45.178670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:45.179209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:45.179259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:45.179289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:45.180807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:45.239483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId: src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:45.300452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:45.332303Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:45.334351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:45.334383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:45.335421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:45.335509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401787432494068:8824]
2025-10-15T11:00:45.335619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:45.335645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:45.338645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:45.354580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 845 reason: error at write: Disconnected sessionId: src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0
2025-10-15T11:00:45.354948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 845 sessionId: src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0 is DEAD
2025-10-15T11:00:45.359568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:45.359611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0] Write session will restart in 0.005660s
2025-10-15T11:00:45.359703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0] Write session: Do CDS request
2025-10-15T11:00:45.359731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:45.369949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:45.377755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:45.377786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 846
2025-10-15T11:00:45.379586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:45.379717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:45.379733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:45.379745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:45.381161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 846 sessionId:  describe result for acl check
2025-10-15T11:00:45.381270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:45.381280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:45.381289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:45.381306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401787432494103:9252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:45.383917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401787432494103:9252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:45.404446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401787432494103:9252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:45.415047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401787432494103:9252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:45.415095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401787432494103:9252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:45.415117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401787432494103:9252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:45.415150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:45.431023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:45.435221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401787432494258:8824]
2025-10-15T11:00:45.439396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:45.440319Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:45.440340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:45.440387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:45.440655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:45.440848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401790232185255:8297]
2025-10-15T11:00:45.442666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:45.443890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:45.444111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:45.445477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:45.445848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.445859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.445867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.445874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.445881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.445888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.445895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.445902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.445910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.445916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.445925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.445933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.445940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.445948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.445999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.446116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.446168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.446226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.446281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.446332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.446382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.446428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.446478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.446532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.446583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.446635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.446687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.446733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.446780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.446847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.446907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.446966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.447017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.447104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.447153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.447213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.447264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.447320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.447495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.447562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.447612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.447672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.447723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.447790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.447843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.447899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.447945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.448001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.448052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.448107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.448157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.448213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.448261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.448317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.448365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.448420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.448972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:45.475035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:45.485067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:45.485112Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:45.485128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:45.485148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:45.485174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 845 [2:7561401790232185255:8297]
2025-10-15T11:00:45.485228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:45.485288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:45.485303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:45.485316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:45.485327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:45.485376Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:45.485400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:45.485423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:45.487016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.487032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.487048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.487061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:45.487329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:45.487702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.487852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.488050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.487947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 845, pipe: [1:7561401787432494258:8824]
2025-10-15T11:00:45.488004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 845
2025-10-15T11:00:45.488054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 845
2025-10-15T11:00:45.488302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:45.488400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401787432494258:8824], now have 1 active actors on pipe
2025-10-15T11:00:45.488429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401787432494226:9252], now have 1 active actors on pipe
2025-10-15T11:00:45.488453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401787432494087:2467], now have 1 active actors on pipe
2025-10-15T11:00:45.488486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401790232185248:8297]
2025-10-15T11:00:45.488507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401790232185248:8297]
2025-10-15T11:00:45.488522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401790232185248:8297]
2025-10-15T11:00:45.488565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:45.488652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:45.488846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:45.488873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:45.489005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401790232185248:8297]
2025-10-15T11:00:45.489031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:45.489319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:45.489338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:45.489348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:45.489372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:45.490025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:45.490058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:45.490152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c870388-31f7c99c-3a22fd11-290aff57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:45.490193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:45.490217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:45.490228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:45.490266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:45.490316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:45.490378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:45.494658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:45.494700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:45.494769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:45.495142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 846 partition: 0 MaxSeqNo: 46 sessionId: src_id|9c870388-31f7c99c-3a22fd11-290aff57_0
2025-10-15T11:00:45.495920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b4551c4-10f3930e-70a4394a-45c2698b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9c870388-31f7c99c-3a22fd11-290aff57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:45.522542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c870388-31f7c99c-3a22fd11-290aff57_0] Write session: try to update token
2025-10-15T11:00:45.522595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c870388-31f7c99c-3a22fd11-290aff57_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:45.657548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId: src_id|9c870388-31f7c99c-3a22fd11-290aff57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:45.669101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:45.669125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:45.669135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:45.669182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:45.669194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:45.669204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:45.669212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:45.669240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401790232185248:8297]
2025-10-15T11:00:45.669261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401790232185248:8297]
2025-10-15T11:00:45.669282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401790232185248:8297]
2025-10-15T11:00:45.669409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:45.669441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:45.669466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:45.690967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:45.699215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:45.699253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:45.700293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:45.839577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:45.841439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:45.841456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:45.841496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401790232185248:8297]
2025-10-15T11:00:45.841636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:45.841659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:45.841695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:45.842927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401787432494258:8824]
2025-10-15T11:00:45.843017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:45.843029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:45.842623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:45.886150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:45.886295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 846 reason: error at write: Disconnected sessionId: src_id|9c870388-31f7c99c-3a22fd11-290aff57_0
2025-10-15T11:00:45.886560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 846 sessionId: src_id|9c870388-31f7c99c-3a22fd11-290aff57_0 is DEAD
2025-10-15T11:00:45.891507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c870388-31f7c99c-3a22fd11-290aff57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:45.891583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c870388-31f7c99c-3a22fd11-290aff57_0] Write session will restart in 0.007310s
2025-10-15T11:00:45.891760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c870388-31f7c99c-3a22fd11-290aff57_0] Write session: Do CDS request
2025-10-15T11:00:45.891815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c870388-31f7c99c-3a22fd11-290aff57_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:45.904764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c870388-31f7c99c-3a22fd11-290aff57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:45.907706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:45.907738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 847
2025-10-15T11:00:45.908155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:45.908264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:45.908277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:45.908287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:45.909582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 847 sessionId:  describe result for acl check
2025-10-15T11:00:45.909689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:45.909698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:45.909707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:45.909723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401787432494316:9264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:45.911993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401787432494316:9264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:45.917801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401787432494316:9264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:45.943235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401787432494402:8824]
2025-10-15T11:00:45.951128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401787432494316:9264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:45.951179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401787432494316:9264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:45.951199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401787432494316:9264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:45.951232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:45.968750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:45.973860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:45.974708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:45.974727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:45.974769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:45.975017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:45.975192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401790232185451:8305]
2025-10-15T11:00:45.977399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:45.978577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:45.978816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:45.980242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:45.980584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.980593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.980600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.980607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.980616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.980624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.980631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.980639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.980646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.980654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.980663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.980670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.980678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.980685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.980734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.980846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.980895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.980946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.980995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.981047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.981093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.981140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.981207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.981254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.981301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.981349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.981394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.981441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.981483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.981551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:45.981611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.981673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:45.981755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.981814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:45.981862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.981920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:45.981971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.982027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:45.982073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.982128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:45.982178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.982230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:45.982275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.982329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:45.982379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.982434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:45.982481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.982538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:45.982588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.982646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:45.982694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.982749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:45.982797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.982853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:45.982900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.982958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:45.984723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:46.051414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:46.061257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:46.061295Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:46.061313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:46.061332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:46.061357Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 846 [2:7561401790232185451:8305]
2025-10-15T11:00:46.061405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:46.061458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:46.061472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:46.061484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:46.061496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:46.061537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:46.063494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 846
2025-10-15T11:00:46.061557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:46.061577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:46.063614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 846, pipe: [1:7561401787432494402:8824]
2025-10-15T11:00:46.062531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.063624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 846
2025-10-15T11:00:46.062546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.062558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.062569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:46.062829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:46.062846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.062976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.063158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.063994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:46.064084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401787432494311:2467], now have 1 active actors on pipe
2025-10-15T11:00:46.064107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401787432494439:9264], now have 1 active actors on pipe
2025-10-15T11:00:46.064128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401787432494402:8824], now have 1 active actors on pipe
2025-10-15T11:00:46.064166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401790232185446:8305]
2025-10-15T11:00:46.064181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401790232185446:8305]
2025-10-15T11:00:46.064192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401790232185446:8305]
2025-10-15T11:00:46.064227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:46.064290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:46.064297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:46.064311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:46.064322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:46.064459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:46.064474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:46.064524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:46.064541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:46.064652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401790232185446:8305]
2025-10-15T11:00:46.064680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:46.064699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:46.064739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:46.064764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:46.064780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:46.064790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:46.064819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:46.064850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:46.064958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:46.066283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:46.066317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:46.066378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:46.066751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 847 partition: 0 MaxSeqNo: 46 sessionId: src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0
2025-10-15T11:00:46.067636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c870388-31f7c99c-3a22fd11-290aff57_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:46.093672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0] Write session: try to update token
2025-10-15T11:00:46.093714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:46.202328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:46.202359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:46.202371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:46.202382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:46.202411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401790232185446:8305]
2025-10-15T11:00:46.202435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401790232185446:8305]
2025-10-15T11:00:46.202457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401790232185446:8305]
2025-10-15T11:00:46.202593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:46.202605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:46.202616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:46.202651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:46.202668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:46.202822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:46.202848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:46.202874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:46.204421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:46.210048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId: src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:46.231191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:46.352010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:46.353516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:46.353550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:46.354357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:46.354382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:46.354409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:46.354666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401787432494402:8824]
2025-10-15T11:00:46.363761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 847 reason: error at write: Disconnected sessionId: src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0
2025-10-15T11:00:46.364415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:46.364459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0] Write session will restart in 0.006967s
2025-10-15T11:00:46.364576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0] Write session: Do CDS request
2025-10-15T11:00:46.364607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:46.366023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:46.367594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 847 sessionId: src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0 is DEAD
2025-10-15T11:00:46.377526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:46.377572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 848
2025-10-15T11:00:46.391775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:46.392978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:46.393160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:46.393177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:46.393190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:46.394717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 848 sessionId:  describe result for acl check
2025-10-15T11:00:46.394838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:46.394848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:46.394858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:46.394876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401791727461810:9271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:46.397623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401791727461810:9271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:46.404154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401791727461810:9271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:46.411884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401791727461810:9271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:46.411929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401791727461810:9271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:46.411947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401791727461810:9271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:46.411981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:46.449270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:46.454624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401791727461971:8824]
2025-10-15T11:00:46.456127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:46.456789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:46.456800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:46.456828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:46.457016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:46.457137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401794527152948:8310]
2025-10-15T11:00:46.458543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:46.460295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:46.460465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:46.461340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:46.461585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:46.461591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:46.461607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:46.461613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:46.461617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:46.461622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:46.461627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:46.461632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:46.461636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:46.461641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:46.461646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:46.461651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.461656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.461661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.461696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:46.461782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:46.461822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:46.461859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:46.461891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:46.461923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:46.461967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:46.462001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:46.462034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:46.462068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:46.462103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:46.462137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.462173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.462206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.462236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:46.462285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:46.462329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:46.462368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:46.462403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:46.462445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:46.462486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:46.462527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:46.462584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:46.462647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:46.462704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:46.462770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:46.462827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:46.462894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:46.462947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:46.463008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:46.463059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:46.463122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:46.463178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:46.463238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:46.463288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:46.463463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:46.463529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.463596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.463652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.463715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.463762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.463819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.464377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:46.486254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:46.495203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:46.495251Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:46.495271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:46.495292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:46.495319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 847 [2:7561401794527152948:8310]
2025-10-15T11:00:46.495472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:46.495546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:46.495566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:46.495580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:46.495593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:46.495648Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:46.495677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:46.495705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:46.496681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.496706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.496722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.496733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:46.496985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:46.497007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.497160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.497333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.497518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:46.497608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401791727461841:9271], now have 1 active actors on pipe
2025-10-15T11:00:46.497647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401791727461797:2467], now have 1 active actors on pipe
2025-10-15T11:00:46.497682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401791727461971:8824], now have 1 active actors on pipe
2025-10-15T11:00:46.497711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401794527152942:8310]
2025-10-15T11:00:46.497730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401794527152942:8310]
2025-10-15T11:00:46.497743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401794527152942:8310]
2025-10-15T11:00:46.497780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:46.497822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:46.497844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:46.497858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:46.497859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:46.498041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:46.498063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:46.498182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401794527152942:8310]
2025-10-15T11:00:46.498211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:46.498229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:46.497995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 847
2025-10-15T11:00:46.498084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 847
2025-10-15T11:00:46.498143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 847, pipe: [1:7561401791727461971:8824]
2025-10-15T11:00:46.499135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:46.499169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:46.499263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:46.499297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:46.499315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:46.499327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:46.499381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:46.499427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:46.499494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:46.501570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:46.501611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:46.501702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:46.501992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 848 partition: 0 MaxSeqNo: 46 sessionId: src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0
2025-10-15T11:00:46.503809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d48e3a2d-c7544f36-3a49d331-1441ba37_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:46.560880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0] Write session: try to update token
2025-10-15T11:00:46.560935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:46.637904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:46.637956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:46.637980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:46.638069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:46.638099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:46.638130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:46.638156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:46.638211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401794527152942:8310]
2025-10-15T11:00:46.638271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401794527152942:8310]
2025-10-15T11:00:46.638340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401794527152942:8310]
2025-10-15T11:00:46.638551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:46.638586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:46.639235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:46.639271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:46.639298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:46.642615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:46.708149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId: src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:46.744727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:46.801370Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:46.803753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:46.803786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:46.809148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:46.809309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401791727461971:8824]
2025-10-15T11:00:46.809401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:46.809413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:46.814128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:46.822165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 848 reason: error at write: Disconnected sessionId: src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0
2025-10-15T11:00:46.822460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 848 sessionId: src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0 is DEAD
2025-10-15T11:00:46.827774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:46.827820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0] Write session will restart in 0.009199s
2025-10-15T11:00:46.827926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0] Write session: Do CDS request
2025-10-15T11:00:46.827960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:46.846178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:46.851776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:46.851817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 849
2025-10-15T11:00:46.855624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:46.855772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:46.855796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:46.855805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:46.857037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 849 sessionId:  describe result for acl check
2025-10-15T11:00:46.857138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:46.857156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:46.857166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:46.857181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401791727462011:9277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:46.859547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401791727462011:9277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:46.866023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401791727462011:9277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:46.872816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401791727462011:9277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:46.872857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401791727462011:9277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:46.872873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401791727462011:9277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:46.872900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:46.911555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401791727462136:8824]
2025-10-15T11:00:46.928232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:46.935335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:46.936116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:46.936144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:46.936185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:46.936414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:46.936589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401794527153142:8319]
2025-10-15T11:00:46.938657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:46.939849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:46.940036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:46.941208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:46.941456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:46.941462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:46.941466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:46.941471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:46.941475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:46.941479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:46.941483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:46.941486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:46.941490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:46.941495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:46.941498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:46.941503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.941509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.941515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.941554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:46.941641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:46.941685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:46.941720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:46.941749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:46.941780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:46.941809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:46.941839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:46.941882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:46.941922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:46.941950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:46.941979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.942021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.942059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.942097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:46.942156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:46.942207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:46.942249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:46.942280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:46.942313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:46.942340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:46.942383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:46.942412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:46.942445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:46.942472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:46.942507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:46.942543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:46.942585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:46.942617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:46.942664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:46.942695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:46.942729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:46.942755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:46.942787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:46.942814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:46.942848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:46.942882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.942918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.942947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.942981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.943009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.943047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.944046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:46.973759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:46.983700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:46.983737Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:46.983751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:46.983769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:46.983790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 848 [2:7561401794527153142:8319]
2025-10-15T11:00:46.983833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:46.983881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:46.983893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:46.983905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:46.983915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:46.983957Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:46.983976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:46.983997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:46.985399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.985420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.985432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.985443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:46.985642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:46.985663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:46.986818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 848
2025-10-15T11:00:46.986919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 848, pipe: [1:7561401791727462136:8824]
2025-10-15T11:00:46.986998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 848
2025-10-15T11:00:46.985782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:46.985949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:46.986150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:46.986229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401791727461996:2467], now have 1 active actors on pipe
2025-10-15T11:00:46.986254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401791727462136:8824], now have 1 active actors on pipe
2025-10-15T11:00:46.986275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401791727462043:9277], now have 1 active actors on pipe
2025-10-15T11:00:46.986297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401794527153136:8319]
2025-10-15T11:00:46.986309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401794527153136:8319]
2025-10-15T11:00:46.986320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401794527153136:8319]
2025-10-15T11:00:46.986355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:46.986387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:46.986400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:46.986401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:46.986411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:46.986513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:46.986522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:46.986597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401794527153136:8319]
2025-10-15T11:00:46.986614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:46.986632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:46.989704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:46.991406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:46.991500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:46.991529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:46.991545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:46.991555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:46.991589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:46.991628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:46.991668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:46.993055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 849 partition: 0 MaxSeqNo: 46 sessionId: src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0
2025-10-15T11:00:46.992659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:46.992684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:46.992736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:46.993839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bad3828-4e9d52cc-4fe2846b-fb200e9b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:47.027553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0] Write session: try to update token
2025-10-15T11:00:47.027607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:47.191481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:47.191524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:47.191549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:47.191559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:47.191594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401794527153136:8319]
2025-10-15T11:00:47.191620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401794527153136:8319]
2025-10-15T11:00:47.191643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401794527153136:8319]
2025-10-15T11:00:47.191801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:47.191799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:47.191819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:47.191826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:47.191829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:47.191852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:47.191916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:47.191935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:47.195013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:47.194050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId: src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:47.235516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:47.401801Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:47.422457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:47.422507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:47.422578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:47.422592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:47.422628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401794527153136:8319]
2025-10-15T11:00:47.422926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:47.424234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:47.424264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:47.427986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:47.457886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 849 reason: error at write: Disconnected sessionId: src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0
2025-10-15T11:00:47.458601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:47.458655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0] Write session will restart in 0.009021s
2025-10-15T11:00:47.458817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0] Write session: Do CDS request
2025-10-15T11:00:47.458874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:47.458164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 849 sessionId: src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0 is DEAD
2025-10-15T11:00:47.478020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:47.482162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:47.482302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401791727462136:8824]
2025-10-15T11:00:47.482326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:47.482339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 850
2025-10-15T11:00:47.483077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:47.483183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:47.483198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:47.483207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:47.484593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 850 sessionId:  describe result for acl check
2025-10-15T11:00:47.484691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:47.484701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:47.484710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:47.484726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401796022429546:9287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:47.487030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401796022429546:9287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:47.505791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401796022429546:9287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:47.519933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401796022429546:9287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:47.520002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401796022429546:9287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:47.520017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401796022429546:9287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:47.520050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:47.520498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:47.528088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:47.529000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:47.529020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:47.529069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:47.529375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:47.529572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401798822120651:8328]
2025-10-15T11:00:47.531882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:47.533026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:47.533250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:47.542479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:47.543012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:47.543021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:47.543027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:47.543034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:47.543042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:47.543049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:47.543057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:47.543063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:47.543069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:47.543077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:47.543084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:47.543090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:47.543097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:47.543104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:47.543150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:47.543266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:47.543317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:47.543422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:47.543484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:47.543529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:47.543577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:47.543625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:47.543672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:47.543720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:47.543762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:47.543805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:47.543850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:47.543898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:47.543946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:47.544013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:47.544071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:47.544127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:47.544176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:47.544229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:47.544277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:47.544336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:47.544397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:47.544452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:47.544497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:47.544547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:47.544596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:47.544649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:47.544708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:47.544765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:47.544824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:47.544881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:47.544926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:47.544981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:47.545038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:47.545090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:47.545138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:47.545191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:47.545238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:47.545290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:47.545338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:47.545400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:47.545938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:47.576750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:47.582724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401796022429704:8824]
2025-10-15T11:00:47.588020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:47.588065Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:47.588081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:47.588100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:47.588122Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 849 [2:7561401798822120651:8328]
2025-10-15T11:00:47.588167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:47.588220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:47.588240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:47.588251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:47.588262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:47.588303Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:47.588327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:47.588349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:47.589865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:47.589891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:47.589904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:47.589915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:47.590198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:47.590218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:47.590357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:47.590545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:47.590769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:47.590835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401798822120644:8328]
2025-10-15T11:00:47.590849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401798822120644:8328]
2025-10-15T11:00:47.590862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401798822120644:8328]
2025-10-15T11:00:47.590902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:47.590970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:47.591140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:47.591155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:47.591307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401798822120644:8328]
2025-10-15T11:00:47.591327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:47.591904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:47.591924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:47.591932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:47.591953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:47.592164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401796022429542:2467], now have 1 active actors on pipe
2025-10-15T11:00:47.592196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401796022429674:9287], now have 1 active actors on pipe
2025-10-15T11:00:47.592215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401796022429704:8824], now have 1 active actors on pipe
2025-10-15T11:00:47.592330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 849
2025-10-15T11:00:47.592504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 849
2025-10-15T11:00:47.592582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 849, pipe: [1:7561401796022429704:8824]
2025-10-15T11:00:47.592931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:47.592962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:47.593030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:47.593056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:47.593072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:47.593082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:47.593116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:47.593151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:47.593188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:47.594324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:47.594354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:47.594416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:47.594773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 850 partition: 0 MaxSeqNo: 46 sessionId: src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0
2025-10-15T11:00:47.599821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d65c2226-b5a288-5679b3da-3e8f9cb7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:47.627895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0] Write session: try to update token
2025-10-15T11:00:47.627950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:47.757179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId: src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:47.754232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:47.754265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:47.754279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:47.754289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:47.754326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401798822120644:8328]
2025-10-15T11:00:47.754352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401798822120644:8328]
2025-10-15T11:00:47.754375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401798822120644:8328]
2025-10-15T11:00:47.754605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:47.754617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:47.754630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:47.754680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:47.754700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:47.755701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:47.759883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:47.759923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:47.759955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:47.778715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:47.917987Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:47.927362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:47.927414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:47.927510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:47.927528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:47.927573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401798822120644:8328]
2025-10-15T11:00:47.927883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:47.928731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:47.928869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:47.928881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:47.931656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401796022429704:8824]
2025-10-15T11:00:47.929088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:48.000884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 850 reason: error at write: Disconnected sessionId: src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0
2025-10-15T11:00:48.001219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 850 sessionId: src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0 is DEAD
2025-10-15T11:00:48.002398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:48.002471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0] Write session will restart in 0.006880s
2025-10-15T11:00:48.002647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0] Write session: Do CDS request
2025-10-15T11:00:48.002698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:48.014686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:48.016246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:48.016284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 851
2025-10-15T11:00:48.016582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:48.016707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:48.016725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:48.016735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:48.018761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 851 sessionId:  describe result for acl check
2025-10-15T11:00:48.018884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:48.018902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:48.018911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:48.018929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401800317397067:9296] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:48.021426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401800317397067:9296] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:48.032754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401800317397112:8824]
2025-10-15T11:00:48.034449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401800317397067:9296] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:48.052674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401800317397067:9296] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:48.052719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401800317397067:9296] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:48.052736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401800317397067:9296] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:48.052769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:48.074197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:48.077141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:48.077991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:48.078011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:48.078050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:48.078301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:48.078491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401803117088148:8332]
2025-10-15T11:00:48.080801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:48.082084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:48.082314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:48.083606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:48.083925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:48.083933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:48.083940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:48.083947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:48.083955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:48.083964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:48.083972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:48.083980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:48.083987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:48.083994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:48.084001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:48.084008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.084015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.084023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.084071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:48.084190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:48.084241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:48.084294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:48.084345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:48.084395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:48.084447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:48.084497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:48.084543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:48.084595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:48.084645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:48.084695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.084744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.084789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.084835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:48.084906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:48.084970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:48.085029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:48.086049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:48.086123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:48.086171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:48.086234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:48.086288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:48.086355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:48.086418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:48.086473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:48.086524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:48.086580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:48.086631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:48.086689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:48.086740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:48.086802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:48.086850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:48.086911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:48.086973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:48.087037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:48.087088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.087146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.087196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.087252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.087298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.087364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.087900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:48.109999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:48.126296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:48.126348Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:48.126367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:48.126389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:48.126418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 850 [2:7561401803117088148:8332]
2025-10-15T11:00:48.126478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:48.126548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:48.126565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:48.126580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:48.126593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:48.126649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:48.126673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:48.126697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:48.128143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.128164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.128177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.128189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:48.128458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:48.128477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.128630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.128830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.129082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:48.129165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401803117088143:8332]
2025-10-15T11:00:48.129179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401803117088143:8332]
2025-10-15T11:00:48.129193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401803117088143:8332]
2025-10-15T11:00:48.129236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:48.129313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:48.129508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:48.129527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:48.129647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401803117088143:8332]
2025-10-15T11:00:48.129667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:48.130289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:48.130306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:48.130318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:48.130343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:48.131463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401800317397112:8824], now have 1 active actors on pipe
2025-10-15T11:00:48.131511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401796022429715:2467], now have 1 active actors on pipe
2025-10-15T11:00:48.131533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401800317397178:9296], now have 1 active actors on pipe
2025-10-15T11:00:48.134347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:48.134391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:48.134472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:48.134508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:48.134530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:48.134541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:48.134580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:48.134625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:48.134674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:48.132465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 850, pipe: [1:7561401800317397112:8824]
2025-10-15T11:00:48.132577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 850
2025-10-15T11:00:48.135369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:48.132672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 850
2025-10-15T11:00:48.135395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:48.135483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:48.135857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 851 partition: 0 MaxSeqNo: 46 sessionId: src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0
2025-10-15T11:00:48.143650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|879f497d-60dc173-a1cfbe76-68ed0a70_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:48.188272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0] Write session: try to update token
2025-10-15T11:00:48.188337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:48.311452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:48.311495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:48.311505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:48.311556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:48.311569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:48.311579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:48.311588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:48.311618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401803117088143:8332]
2025-10-15T11:00:48.311640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401803117088143:8332]
2025-10-15T11:00:48.311660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401803117088143:8332]
2025-10-15T11:00:48.311824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:48.311842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:48.311862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:48.311867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:48.311908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:48.312763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:48.333887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId: src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:48.356673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:48.454833Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:48.470331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:48.470373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:48.470433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:48.470444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:48.470482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401803117088143:8332]
2025-10-15T11:00:48.471679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401800317397112:8824]
2025-10-15T11:00:48.471788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:48.471937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:48.471959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:48.470965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:48.474279Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:48.481518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 851 reason: error at write: Disconnected sessionId: src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0
2025-10-15T11:00:48.481897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 851 sessionId: src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0 is DEAD
2025-10-15T11:00:48.483606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:48.483662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0] Write session will restart in 0.006415s
2025-10-15T11:00:48.483786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0] Write session: Do CDS request
2025-10-15T11:00:48.483823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:48.502840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:48.502896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 852
2025-10-15T11:00:48.504839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:48.505415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:48.505573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:48.505590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:48.505602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:48.509126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 852 sessionId:  describe result for acl check
2025-10-15T11:00:48.509243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:48.509255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:48.509269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:48.509293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401800317397220:9300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:48.512418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401800317397220:9300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:48.525387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401800317397220:9300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:48.537759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401800317397220:9300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:48.537802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401800317397220:9300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:48.537819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401800317397220:9300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:48.537852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:48.569386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401800317397356:8824]
2025-10-15T11:00:48.597135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:48.598834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:48.599664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:48.599684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:48.599731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:48.599963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:48.600126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401803117088358:8342]
2025-10-15T11:00:48.602174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:48.604373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:48.604571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:48.605770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:48.606076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:48.606090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:48.606096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:48.606103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:48.606110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:48.606117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:48.606123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:48.606130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:48.606136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:48.606143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:48.606150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:48.606158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.606165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.606171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.606214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:48.606327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:48.606373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:48.606417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:48.606464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:48.606514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:48.606565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:48.606614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:48.606663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:48.606715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:48.606767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:48.606812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.606859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.606904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.606948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:48.607017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:48.607081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:48.607140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:48.607192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:48.607247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:48.607299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:48.607374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:48.607424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:48.607504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:48.607554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:48.607615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:48.607665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:48.607730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:48.607775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:48.607831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:48.607883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:48.607941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:48.607987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:48.608044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:48.608089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:48.608143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:48.608187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.608237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.608280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.608329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.608373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.608425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.608924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:48.635723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:48.645198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:48.645239Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:48.645256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:48.645274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:48.645300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 851 [2:7561401803117088358:8342]
2025-10-15T11:00:48.645354Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:48.645409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:48.645423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:48.645437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:48.645448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:48.645494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:48.645518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:48.645540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:48.647116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.647132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.647145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.647157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:48.648449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 851, pipe: [1:7561401800317397356:8824]
2025-10-15T11:00:48.648543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 851
2025-10-15T11:00:48.648615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 851
2025-10-15T11:00:48.648089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:48.648114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:48.648253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:48.648434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:48.648662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:48.648752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401800317397356:8824], now have 1 active actors on pipe
2025-10-15T11:00:48.648777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401800317397209:2467], now have 1 active actors on pipe
2025-10-15T11:00:48.648801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401800317397263:9300], now have 1 active actors on pipe
2025-10-15T11:00:48.648828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401803117088348:8342]
2025-10-15T11:00:48.648845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401803117088348:8342]
2025-10-15T11:00:48.648860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401803117088348:8342]
2025-10-15T11:00:48.648892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:48.648945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:48.648965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:48.648966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:48.648977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:48.649143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:48.649159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:48.649322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:48.649340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:48.649384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401803117088348:8342]
2025-10-15T11:00:48.649420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:48.649546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d5c008a-69291249-98ce1872-8c44fcac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:48.649578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:48.649598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:48.649607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:48.649646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:48.649689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:48.649780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:48.649810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:48.651419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:48.651452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:48.651541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:48.652284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 852 partition: 0 MaxSeqNo: 46 sessionId: src_id|4d5c008a-69291249-98ce1872-8c44fcac_0
2025-10-15T11:00:48.657531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07ce4bc-2993588d-3c68ac18-ad1ec368_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4d5c008a-69291249-98ce1872-8c44fcac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:48.701990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5c008a-69291249-98ce1872-8c44fcac_0] Write session: try to update token
2025-10-15T11:00:48.702050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5c008a-69291249-98ce1872-8c44fcac_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:48.769350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:48.769380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:48.769392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:48.769515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:48.769531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:48.769546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:48.769558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:48.769590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401803117088348:8342]
2025-10-15T11:00:48.769619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401803117088348:8342]
2025-10-15T11:00:48.769645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401803117088348:8342]
2025-10-15T11:00:48.769792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:48.769827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:48.769854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:48.790354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:48.790407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:48.803992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:48.837771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId: src_id|4d5c008a-69291249-98ce1872-8c44fcac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:48.858255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:48.953331Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:48.977811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401800317397356:8824]
2025-10-15T11:00:48.977892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:48.975860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:48.975891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:48.975936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401803117088348:8342]
2025-10-15T11:00:48.976088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:48.976111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:48.976293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:48.977286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:48.978003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:48.987869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 852 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d5c008a-69291249-98ce1872-8c44fcac_0
2025-10-15T11:00:48.988167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 852 sessionId: src_id|4d5c008a-69291249-98ce1872-8c44fcac_0 is DEAD
2025-10-15T11:00:48.988561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5c008a-69291249-98ce1872-8c44fcac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:48.988640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5c008a-69291249-98ce1872-8c44fcac_0] Write session will restart in 0.007337s
2025-10-15T11:00:48.988819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5c008a-69291249-98ce1872-8c44fcac_0] Write session: Do CDS request
2025-10-15T11:00:48.988880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5c008a-69291249-98ce1872-8c44fcac_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:49.005181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:49.005216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 853
2025-10-15T11:00:49.007781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5c008a-69291249-98ce1872-8c44fcac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:49.008373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:49.008528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:49.008545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:49.008554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:49.010328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 853 sessionId:  describe result for acl check
2025-10-15T11:00:49.010444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:49.010455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:49.010464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:49.010480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401804612364746:9315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:49.013276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401804612364746:9315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:49.021000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401804612364746:9315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:49.032895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401804612364746:9315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:49.032940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401804612364746:9315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:49.032958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401804612364746:9315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:49.032991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:49.077619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401804612364913:8824]
2025-10-15T11:00:49.079274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:49.084431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:49.085184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:49.085213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:49.085254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:49.085504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:49.085685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401807412055865:8351]
2025-10-15T11:00:49.087125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:49.087956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:49.088175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:49.089039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:49.089262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:49.089276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:49.089283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:49.089291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:49.089298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:49.089305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:49.089310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:49.089317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:49.089323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:49.089327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:49.089332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:49.089336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.089340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.089344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.089377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:49.089450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:49.089481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:49.089522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:49.089557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:49.089589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:49.089618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:49.089646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:49.089682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:49.089717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:49.089753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:49.089787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.089826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.089873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.089911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:49.089976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:49.090036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:49.090094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:49.090149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:49.090205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:49.090261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:49.090313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:49.090366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:49.090428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:49.090475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:49.090525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:49.090556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:49.090589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:49.090623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:49.090662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:49.090698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:49.090737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:49.090770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:49.090819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:49.090855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:49.090892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:49.090934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.090988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.091037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.091092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.091131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.091180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.091683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:49.142337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:49.150047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:49.150090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:49.150104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:49.150122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:49.150143Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 852 [2:7561401807412055865:8351]
2025-10-15T11:00:49.150191Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:49.150245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:49.150259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:49.150272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:49.150282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:49.150327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:49.150348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:49.150367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:49.151435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.151459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.151471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.151481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:49.151746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:49.151767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.151889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.152062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.152282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:49.152364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401807412055859:8351]
2025-10-15T11:00:49.152384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401807412055859:8351]
2025-10-15T11:00:49.152394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401807412055859:8351]
2025-10-15T11:00:49.152425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:49.152468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:49.152586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:49.152600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:49.152675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401807412055859:8351]
2025-10-15T11:00:49.152690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:49.152850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:49.152861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:49.152867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:49.152882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:49.153308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401804612364780:9315], now have 1 active actors on pipe
2025-10-15T11:00:49.153344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401804612364913:8824], now have 1 active actors on pipe
2025-10-15T11:00:49.153375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401800317397432:2467], now have 1 active actors on pipe
2025-10-15T11:00:49.153460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 852
2025-10-15T11:00:49.153553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 852, pipe: [1:7561401804612364913:8824]
2025-10-15T11:00:49.153622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 852
2025-10-15T11:00:49.154069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:49.154097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:49.154188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c26b8333-6c17332-f384b545-e785f75e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:49.154220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:49.154235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:49.154245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:49.154278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:49.154314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:49.154373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:49.154772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:49.154810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:49.154868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:49.155127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 853 partition: 0 MaxSeqNo: 46 sessionId: src_id|c26b8333-6c17332-f384b545-e785f75e_0
2025-10-15T11:00:49.155893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5c008a-69291249-98ce1872-8c44fcac_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c26b8333-6c17332-f384b545-e785f75e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:49.182687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:49.182716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:49.182743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401807412055859:8351]
2025-10-15T11:00:49.182846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:49.183574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:49.185097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:49.191964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:49.195945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26b8333-6c17332-f384b545-e785f75e_0] Write session: try to update token
2025-10-15T11:00:49.196005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26b8333-6c17332-f384b545-e785f75e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:49.198979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:49.201849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:49.207689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:49.208121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:49.284416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:49.284444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:49.284453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:49.284503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:49.284515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:49.284526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:49.284534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:49.284564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401807412055859:8351]
2025-10-15T11:00:49.284583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401807412055859:8351]
2025-10-15T11:00:49.284599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401807412055859:8351]
2025-10-15T11:00:49.284703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:49.284719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:49.284731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:49.284791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:49.284822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:49.285556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:49.327609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId: src_id|c26b8333-6c17332-f384b545-e785f75e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:49.349470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:49.434248Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:49.439937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:49.439982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:49.440717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:49.443710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:49.443744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:49.445555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401804612364913:8824]
2025-10-15T11:00:49.445667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:49.450822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 853 reason: error at write: Disconnected sessionId: src_id|c26b8333-6c17332-f384b545-e785f75e_0
2025-10-15T11:00:49.451864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26b8333-6c17332-f384b545-e785f75e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:49.451921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26b8333-6c17332-f384b545-e785f75e_0] Write session will restart in 0.005701s
2025-10-15T11:00:49.452131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26b8333-6c17332-f384b545-e785f75e_0] Write session: Do CDS request
2025-10-15T11:00:49.452184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26b8333-6c17332-f384b545-e785f75e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:49.451159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 853 sessionId: src_id|c26b8333-6c17332-f384b545-e785f75e_0 is DEAD
2025-10-15T11:00:49.465065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26b8333-6c17332-f384b545-e785f75e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:49.465678Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:49.465713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 854
2025-10-15T11:00:49.466017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:49.466130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:49.466149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:49.466159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:49.468580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 854 sessionId:  describe result for acl check
2025-10-15T11:00:49.468728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:49.468740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:49.468748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:49.468768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401804612364946:9321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:49.472718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401804612364946:9321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:49.480166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401804612364946:9321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:49.495888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401804612364946:9321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:49.495957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401804612364946:9321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:49.495977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401804612364946:9321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:49.496018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:49.543557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401804612365105:8824]
2025-10-15T11:00:49.564487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:49.569352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:49.570151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:49.570168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:49.570206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:49.570431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:49.570605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401807412056054:8354]
2025-10-15T11:00:49.572745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:49.573941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:49.574137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:49.575312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:49.575652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:49.575660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:49.575668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:49.575675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:49.575682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:49.575688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:49.575695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:49.575701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:49.575708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:49.575715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:49.575721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:49.575728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.575737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.575744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.575790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:49.575896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:49.575945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:49.575993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:49.576040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:49.576088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:49.576133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:49.576179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:49.576224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:49.576270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:49.576319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:49.576364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.576409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.576451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.576491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:49.576557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:49.576613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:49.576667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:49.576713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:49.576767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:49.576812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:49.576863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:49.576909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:49.576962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:49.577009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:49.577063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:49.578118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:49.578187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:49.578238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:49.578291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:49.578342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:49.578397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:49.578442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:49.578498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:49.578543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:49.578595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:49.578640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.578693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.578740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.578794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.578838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.578889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.579410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:49.598580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:49.609502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:49.609547Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:49.609565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:49.609585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:49.609608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 853 [2:7561401807412056054:8354]
2025-10-15T11:00:49.609662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:49.609717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:49.609730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:49.609743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:49.609755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:49.609805Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:49.609828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:49.609851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:49.619958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.619988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.620001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.620013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:49.620291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:49.620308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:49.620448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:49.620622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:49.620848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:49.620917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401807412056049:8354]
2025-10-15T11:00:49.620933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401807412056049:8354]
2025-10-15T11:00:49.620947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401807412056049:8354]
2025-10-15T11:00:49.620987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:49.621060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:49.621243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:49.621260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:49.621380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401807412056049:8354]
2025-10-15T11:00:49.621400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:49.623333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 853
2025-10-15T11:00:49.623458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 853
2025-10-15T11:00:49.623561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 853, pipe: [1:7561401804612365105:8824]
2025-10-15T11:00:49.622010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:49.622027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:49.622037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:49.622059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:49.624423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401804612364982:9321], now have 1 active actors on pipe
2025-10-15T11:00:49.624454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401804612364936:2467], now have 1 active actors on pipe
2025-10-15T11:00:49.624476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401804612365105:8824], now have 1 active actors on pipe
2025-10-15T11:00:49.624541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:49.624568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:49.624665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:49.624698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:49.624717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:49.624727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:49.624765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:49.624811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:49.624855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:49.625473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:49.625499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:49.625565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:49.626059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 854 partition: 0 MaxSeqNo: 46 sessionId: src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0
2025-10-15T11:00:49.626921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26b8333-6c17332-f384b545-e785f75e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:49.655879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0] Write session: try to update token
2025-10-15T11:00:49.655940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:49.751884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:49.752022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:49.752036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:49.752091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:49.752107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:49.752119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:49.752130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:49.752174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401807412056049:8354]
2025-10-15T11:00:49.752196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401807412056049:8354]
2025-10-15T11:00:49.752219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401807412056049:8354]
2025-10-15T11:00:49.752412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:49.752433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:49.753394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:49.755833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:49.755896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:49.755929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:49.774654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId: src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:49.795081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:49.903736Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:49.925218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:49.925267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:49.925344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:49.925358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:49.925400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401807412056049:8354]
2025-10-15T11:00:49.925653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:49.925979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:49.928256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:49.931610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:49.931898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401804612365105:8824]
2025-10-15T11:00:49.945933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:49.946003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0] Write session will restart in 0.008810s
2025-10-15T11:00:49.946178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0] Write session: Do CDS request
2025-10-15T11:00:49.946225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:49.944850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 854 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0
2025-10-15T11:00:49.945314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 854 sessionId: src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0 is DEAD
2025-10-15T11:00:49.964050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:49.964084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 855
2025-10-15T11:00:49.967990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:49.971815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:49.971976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:49.971994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:49.972006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:49.973968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 855 sessionId:  describe result for acl check
2025-10-15T11:00:49.974073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:49.974085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:49.974096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:49.974113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401804612365162:9327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:49.977358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401804612365162:9327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:49.984950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401804612365162:9327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:50.014073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401804612365162:9327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:50.014121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401804612365162:9327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:50.014138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401804612365162:9327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:50.014169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:50.039476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401808907332594:8824]
2025-10-15T11:00:50.070035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:50.080070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:50.080910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:50.080928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:50.080967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:50.081207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:50.081378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401811707023560:8363]
2025-10-15T11:00:50.083145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:50.084276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:50.084473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:50.085501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:50.085749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:50.085757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:50.085763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:50.085770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:50.085774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:50.085780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:50.085786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:50.085793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:50.085799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:50.085806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:50.085813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:50.085817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.085823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.085826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.085864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:50.085962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:50.086010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:50.086054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:50.086086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:50.086124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:50.086170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:50.086210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:50.086254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:50.086306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:50.086347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:50.086385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.086425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.086470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.086510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:50.086571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:50.086624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:50.086675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:50.086720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:50.086771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:50.086813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:50.086877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:50.086949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:50.087004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:50.087048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:50.087094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:50.087141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:50.087188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:50.087231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:50.087281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:50.087324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:50.088302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:50.088367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:50.088423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:50.088468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:50.088520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:50.088564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.088615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.088661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.088709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.088754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.088802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.089273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:50.108196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:50.116735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:50.116766Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:50.116775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:50.116788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:50.116807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 854 [2:7561401811707023560:8363]
2025-10-15T11:00:50.116840Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:50.116882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:50.116894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:50.116903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:50.116911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:50.116942Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:50.116959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:50.116975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:50.118832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.118854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.118869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.118882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:50.119139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:50.119156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.119288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.120112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.120372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:50.120450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401808907332560:9327], now have 1 active actors on pipe
2025-10-15T11:00:50.120473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401804612365147:2467], now have 1 active actors on pipe
2025-10-15T11:00:50.120494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401808907332594:8824], now have 1 active actors on pipe
2025-10-15T11:00:50.120517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401811707023554:8363]
2025-10-15T11:00:50.120531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401811707023554:8363]
2025-10-15T11:00:50.120545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401811707023554:8363]
2025-10-15T11:00:50.120583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:50.120659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:50.120838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:50.120853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:50.120970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401811707023554:8363]
2025-10-15T11:00:50.120998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:50.121083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:50.121097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:50.121119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:50.121141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:50.121845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:50.121875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:50.121953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:50.121981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:50.121998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:50.122008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:50.122044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:50.122082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:50.122156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:50.122603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:50.122625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:50.122688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:50.121444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 854
2025-10-15T11:00:50.121530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 854
2025-10-15T11:00:50.121593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 854, pipe: [1:7561401808907332594:8824]
2025-10-15T11:00:50.123025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 855 partition: 0 MaxSeqNo: 46 sessionId: src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0
2025-10-15T11:00:50.123941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf502e3f-c82b67d7-8e171d30-851b27f5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:50.153620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0] Write session: try to update token
2025-10-15T11:00:50.153685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:50.209979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:50.210013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:50.210055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401811707023554:8363]
2025-10-15T11:00:50.210184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:50.210186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:50.211991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:50.213225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:50.221315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:50.222357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:50.226516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:50.227058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:50.227072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:50.227084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:50.227147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:50.295868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:50.295894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:50.295904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:50.295913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:50.295943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401811707023554:8363]
2025-10-15T11:00:50.295963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401811707023554:8363]
2025-10-15T11:00:50.295978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401811707023554:8363]
2025-10-15T11:00:50.296092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:50.296125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:50.296150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:50.296155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:50.296174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:50.297410Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:50.298167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId: src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:50.322116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:50.453755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:50.455722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:50.455761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:50.457310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:50.456502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:50.499279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:50.499341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0] Write session will restart in 0.006236s
2025-10-15T11:00:50.499474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0] Write session: Do CDS request
2025-10-15T11:00:50.498258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:50.499519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:50.498451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401808907332594:8824]
2025-10-15T11:00:50.498525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 855 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0
2025-10-15T11:00:50.498874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 855 sessionId: src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0 is DEAD
2025-10-15T11:00:50.513205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:50.515453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:50.515486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 856
2025-10-15T11:00:50.515872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:50.515996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:50.516021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:50.516030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:50.517599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 856 sessionId:  describe result for acl check
2025-10-15T11:00:50.517725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:50.517746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:50.517755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:50.517773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401808907332716:9337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:50.520423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401808907332716:9337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:50.535304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401808907332716:9337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:50.547222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401808907332716:9337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:50.547268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401808907332716:9337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:50.547285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401808907332716:9337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:50.547314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:50.565636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:50.568578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:50.569551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:50.569571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:50.569616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:50.569881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:50.570071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401811707023774:8371]
2025-10-15T11:00:50.580772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:50.582144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:50.582409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:50.583901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:50.584286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:50.584304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:50.584313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:50.584320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:50.584327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:50.584335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:50.584342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:50.584350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:50.584357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:50.584365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:50.584373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:50.584380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.584387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.584395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.584447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:50.584575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:50.584625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:50.584672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:50.584722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:50.584772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:50.584818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:50.584866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:50.584915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:50.584965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:50.585012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:50.585059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.585109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.585160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.585208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:50.585286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:50.585373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:50.585437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:50.585493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:50.585557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:50.585609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:50.585673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:50.585728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:50.585787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:50.585841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:50.585891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:50.585930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:50.585972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:50.586009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:50.586051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:50.586088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:50.586133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:50.586170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:50.586220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:50.586258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:50.586301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:50.586339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.586382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.586421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.586459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.586498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.586542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.586942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:50.602721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401808907332864:8824]
2025-10-15T11:00:50.614918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:50.629640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:50.629692Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:50.629712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:50.629733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:50.629764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 855 [2:7561401811707023774:8371]
2025-10-15T11:00:50.629826Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:50.629894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:50.629911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:50.629924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:50.629936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:50.629987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:50.630013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:50.630037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:50.646849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.646873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.646883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.646894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:50.647154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:50.647173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:50.647296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:50.647466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:50.647683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:50.647750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401811707023769:8371]
2025-10-15T11:00:50.647765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401811707023769:8371]
2025-10-15T11:00:50.647776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401811707023769:8371]
2025-10-15T11:00:50.647815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:50.647885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:50.647968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:50.647993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:50.648004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:50.648067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:50.648083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:50.648199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401811707023769:8371]
2025-10-15T11:00:50.648215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:50.648284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:50.648324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401808907332668:2467], now have 1 active actors on pipe
2025-10-15T11:00:50.648362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401808907332864:8824], now have 1 active actors on pipe
2025-10-15T11:00:50.648383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401808907332844:9337], now have 1 active actors on pipe
2025-10-15T11:00:50.649464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 855
2025-10-15T11:00:50.649561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 855, pipe: [1:7561401808907332864:8824]
2025-10-15T11:00:50.649637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 855
2025-10-15T11:00:50.650100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:50.650135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:50.650217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:50.650255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:50.650274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:50.650286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:50.650325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:50.650370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:50.650417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:50.651778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:50.651803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:50.651875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:50.652223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 856 partition: 0 MaxSeqNo: 46 sessionId: src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0
2025-10-15T11:00:50.656124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6019f6eb-ce58479e-1e3c73be-e2848f43_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:50.704868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:50.704905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:50.704947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401811707023769:8371]
2025-10-15T11:00:50.705078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:50.705090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:50.706757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:50.714099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:50.715801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0] Write session: try to update token
2025-10-15T11:00:50.715862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:50.716489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:50.717896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:50.719488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:50.721230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:50.731154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:50.731187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:50.731201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:50.764406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:50.764461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:50.764484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:50.764507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:50.764571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401811707023769:8371]
2025-10-15T11:00:50.764612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401811707023769:8371]
2025-10-15T11:00:50.764647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401811707023769:8371]
2025-10-15T11:00:50.764880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:50.764937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:50.765647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:50.765739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:50.765795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:50.772094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:50.848281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId: src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:50.867809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:50.925964Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:50.927642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:50.927676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:50.929300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:50.929442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401808907332864:8824]
2025-10-15T11:00:50.929522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:50.929533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:50.928924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:50.970835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 856 reason: error at write: Disconnected sessionId: src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0
2025-10-15T11:00:50.971199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 856 sessionId: src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0 is DEAD
2025-10-15T11:00:50.975705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:50.975773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0] Write session will restart in 0.009592s
2025-10-15T11:00:50.975940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0] Write session: Do CDS request
2025-10-15T11:00:50.975993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:50.998995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:50.999028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 857
2025-10-15T11:00:50.999364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:51.007607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:51.007899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:51.007952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:51.007976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:51.012533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 857 sessionId:  describe result for acl check
2025-10-15T11:00:51.012651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:51.012672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:51.012682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:51.012700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401813202300209:9346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:51.015246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401813202300209:9346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:51.029947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401813202300209:9346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:51.030435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401813202300276:8824]
2025-10-15T11:00:51.040775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401813202300209:9346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:51.040815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401813202300209:9346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:51.040831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401813202300209:9346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:51.040860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:51.056616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:51.058348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:51.059084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:51.059101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:51.059136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:51.059386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:51.059571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401816001991272:8376]
2025-10-15T11:00:51.061638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:51.062518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:51.062712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:51.063896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:51.064219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.064228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.064235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.064242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.064250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.064258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.064265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.064272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.064279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.064285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.064292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.064299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.064306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.064312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.064358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.064463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.064512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.064561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.064603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.064649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.064692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.064735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.064780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.064827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.064870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.064914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.064959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.065003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.065045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.065108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.065163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.065215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.065264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.065316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.065361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.065409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.065457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.065505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.065547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.065600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.065646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.065695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.065737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.065790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.065837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.065890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.065931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.065981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.066024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.066074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.066117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.066168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.066211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.066261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.066304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.066354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.066829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:51.086730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:51.095583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:51.095615Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:51.095627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:51.095640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:51.095659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 856 [2:7561401816001991272:8376]
2025-10-15T11:00:51.095720Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:51.095775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:51.095789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:51.095801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:51.095813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:51.095859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:51.095881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:51.095901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:51.120646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.120675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.120688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.120699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:51.120961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:51.120976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.121104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.121270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.121480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:51.121543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401816001991267:8376]
2025-10-15T11:00:51.121556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401816001991267:8376]
2025-10-15T11:00:51.121569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401816001991267:8376]
2025-10-15T11:00:51.121612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:51.121679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:51.121737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:51.121751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:51.121769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:51.121849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:51.121864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:51.121968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401816001991267:8376]
2025-10-15T11:00:51.121987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:51.122029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:51.122066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401813202300336:9346], now have 1 active actors on pipe
2025-10-15T11:00:51.122089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401813202300276:8824], now have 1 active actors on pipe
2025-10-15T11:00:51.122109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401808907332875:2467], now have 1 active actors on pipe
2025-10-15T11:00:51.122236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 856
2025-10-15T11:00:51.122316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 856, pipe: [1:7561401813202300276:8824]
2025-10-15T11:00:51.122378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 856
2025-10-15T11:00:51.122914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:51.122941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:51.123024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:51.123052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:51.123069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:51.123078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:51.123110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:51.123155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:51.123212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:51.123947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:51.123971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:51.124031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:51.125061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e712b08-1f0c4b39-6a309b74-52ea6e59_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:51.124401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 857 partition: 0 MaxSeqNo: 46 sessionId: src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0
2025-10-15T11:00:51.161887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0] Write session: try to update token
2025-10-15T11:00:51.161941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:51.225695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:51.225725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:51.225736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:51.225789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:51.225803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:51.225817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:51.225827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:51.225860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401816001991267:8376]
2025-10-15T11:00:51.225886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401816001991267:8376]
2025-10-15T11:00:51.225909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401816001991267:8376]
2025-10-15T11:00:51.226031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:51.226052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:51.227099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:51.231615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:51.231655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:51.231685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:51.345816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId: src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:51.368545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:51.376012Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:51.378128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:51.378155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:51.381956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:51.379491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:51.379536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:51.384215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401813202300276:8824]
2025-10-15T11:00:51.384387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:51.426658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 857 reason: error at write: Disconnected sessionId: src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0
2025-10-15T11:00:51.426968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 857 sessionId: src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0 is DEAD
2025-10-15T11:00:51.431394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:51.431430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0] Write session will restart in 0.009703s
2025-10-15T11:00:51.431534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0] Write session: Do CDS request
2025-10-15T11:00:51.431563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:51.452844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:51.452885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 858
2025-10-15T11:00:51.453449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:51.455796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:51.455950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:51.455974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:51.455984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:51.459856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 858 sessionId:  describe result for acl check
2025-10-15T11:00:51.459985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:51.460007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:51.460016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:51.460034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401813202300428:9350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:51.462452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401813202300428:9350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:51.471219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401813202300428:9350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:51.483114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401813202300428:9350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:51.483162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401813202300428:9350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:51.483179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401813202300428:9350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:51.483209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:51.484491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401813202300535:8824]
2025-10-15T11:00:51.512002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:51.519874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:51.520868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:51.520888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:51.520929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:51.521189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:51.521367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401816001991476:8385]
2025-10-15T11:00:51.523918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:51.525046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:51.525302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:51.526762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:51.527114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.527123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.527131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.527139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.527147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.527154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.527162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.527170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.527177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.527184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.527193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.527200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.527207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.527213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.527267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.527406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.527460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.527510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.527569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.527634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.527682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.527730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.527775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.527827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.527874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.527920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.527967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.528028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.528082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.528175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.528243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.528302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.528353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.528411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.528460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.528515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.528565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.528619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.528668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.528722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.528774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.528846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.528893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.528951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.529003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.529059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.529124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.529184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.529236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.529291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.529339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.529391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.529440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.529493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.529541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.529595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.530114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:51.557684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:51.569029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:51.569071Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:51.569087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:51.569103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:51.569125Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 857 [2:7561401816001991476:8385]
2025-10-15T11:00:51.569173Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:51.569221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:51.569233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:51.569244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:51.569255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:51.569298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:51.569316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:51.569333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:51.571768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.571782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.571795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.571805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:51.572052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:51.572069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.572197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.572372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.572605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:51.572666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401816001991469:8385]
2025-10-15T11:00:51.572688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401816001991469:8385]
2025-10-15T11:00:51.572702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401816001991469:8385]
2025-10-15T11:00:51.572738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:51.572801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:51.572961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:51.572977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:51.573080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401816001991469:8385]
2025-10-15T11:00:51.573095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:51.573395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:51.573412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:51.573423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:51.573443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:51.575418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401813202300535:8824], now have 1 active actors on pipe
2025-10-15T11:00:51.575447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401813202300534:9350], now have 1 active actors on pipe
2025-10-15T11:00:51.575467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401813202300375:2467], now have 1 active actors on pipe
2025-10-15T11:00:51.578198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 857, pipe: [1:7561401813202300535:8824]
2025-10-15T11:00:51.578490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 857
2025-10-15T11:00:51.580016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 857
2025-10-15T11:00:51.579064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:51.579103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:51.579200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:51.579241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:51.579260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:51.579271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:51.579309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:51.579397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:51.579458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:51.580338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:51.580358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:51.580432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:51.582012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 858 partition: 0 MaxSeqNo: 46 sessionId: src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0
2025-10-15T11:00:51.585450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ee1d7f-bcc0834f-2762839-28a93c7b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:51.657951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0] Write session: try to update token
2025-10-15T11:00:51.658014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:51.679647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:51.679681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:51.679695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:51.679705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:51.679739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401816001991469:8385]
2025-10-15T11:00:51.679766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401816001991469:8385]
2025-10-15T11:00:51.679793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401816001991469:8385]
2025-10-15T11:00:51.679961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:51.679973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:51.679970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:51.679984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:51.680009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:51.680033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:51.680050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:51.680054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:51.681141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:51.780888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId: src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:51.801165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:51.839228Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:51.854420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:51.854466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:51.857968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401813202300535:8824]
2025-10-15T11:00:51.858076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:51.858089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:51.857835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:51.879889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 858 reason: error at write: Disconnected sessionId: src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0
2025-10-15T11:00:51.880225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 858 sessionId: src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0 is DEAD
2025-10-15T11:00:51.883800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:51.883840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0] Write session will restart in 0.005737s
2025-10-15T11:00:51.883934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0] Write session: Do CDS request
2025-10-15T11:00:51.883965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:51.898498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:51.898503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:51.898756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:51.898779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 859
2025-10-15T11:00:51.899105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:51.899229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:51.899246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:51.899256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:51.900787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 859 sessionId:  describe result for acl check
2025-10-15T11:00:51.900886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:51.900896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:51.900907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:51.900924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401813202300620:9362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:51.915666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401813202300620:9362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:51.921443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401813202300620:9362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:51.932309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401813202300620:9362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:51.932358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401813202300620:9362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:51.932375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401813202300620:9362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:51.932406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:51.958091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401813202300775:8824]
2025-10-15T11:00:51.973614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:51.981762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:51.982738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:51.982761Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:51.982804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:51.983121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:51.983301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401816001991685:8393]
2025-10-15T11:00:51.985425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:51.986864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:51.987083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:51.988260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:51.988551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.988558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.988565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.988570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.988577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.988583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.988589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.988595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.988602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.988609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.988615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.988622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.988628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.988635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.988679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.988780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.988823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.988862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.988902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.988943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.988985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.989024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.989064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.989104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.989144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.989183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.989222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.989264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.989303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.989360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:51.989410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.989461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:51.989502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.989550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:51.989591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.989638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:51.989679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.989739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:51.989785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.989836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:51.989879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.989924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:51.989962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.990010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:51.990052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.990099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:51.990140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.990188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:51.990232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.990278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:51.990320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.990366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:51.990407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.990454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:51.990492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.990540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:51.991003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:52.021547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:52.034878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:52.034962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:52.035000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:52.035038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:52.035057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 858 [2:7561401816001991685:8393]
2025-10-15T11:00:52.035138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:52.035264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:52.035277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:52.035286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:52.035295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:52.035327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:52.035373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:52.035409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:52.037077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.037095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.037105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.037112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:52.037286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:52.037296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.037387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.037496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.037632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:52.037689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401813202300696:9362], now have 1 active actors on pipe
2025-10-15T11:00:52.037704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401813202300775:8824], now have 1 active actors on pipe
2025-10-15T11:00:52.037717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401813202300615:2467], now have 1 active actors on pipe
2025-10-15T11:00:52.037733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401816001991679:8393]
2025-10-15T11:00:52.037742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401816001991679:8393]
2025-10-15T11:00:52.037751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401816001991679:8393]
2025-10-15T11:00:52.037779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:52.037825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:52.037950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:52.039564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 858
2025-10-15T11:00:52.039657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 858, pipe: [1:7561401813202300775:8824]
2025-10-15T11:00:52.039758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 858
2025-10-15T11:00:52.037961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:52.038046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401816001991679:8393]
2025-10-15T11:00:52.038059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:52.038174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:52.038192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:52.038204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:52.038233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:52.039839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:52.039869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:52.039967Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:52.040000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:52.040018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:52.040030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:52.040065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:52.040108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:52.040159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:52.044131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:52.044174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:52.044256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:52.047258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 859 partition: 0 MaxSeqNo: 46 sessionId: src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0
2025-10-15T11:00:52.048041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eb1eb6-462e164c-43b9242c-75e55bc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:52.090412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0] Write session: try to update token
2025-10-15T11:00:52.090461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:52.142101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:52.142132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:52.142146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:52.142158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:52.142197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401816001991679:8393]
2025-10-15T11:00:52.142224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401816001991679:8393]
2025-10-15T11:00:52.142250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401816001991679:8393]
2025-10-15T11:00:52.142382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:52.142415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:52.142418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:52.142428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:52.142439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:52.142447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:52.142492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:52.142513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:52.144531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:52.223281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId: src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:52.245006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:52.314904Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:52.319250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:52.319285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:52.316450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:52.316491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:52.319547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401813202300775:8824]
2025-10-15T11:00:52.319681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:52.320302Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:52.338194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 859 reason: error at write: Disconnected sessionId: src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0
2025-10-15T11:00:52.338504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 859 sessionId: src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0 is DEAD
2025-10-15T11:00:52.345652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:52.345688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0] Write session will restart in 0.007944s
2025-10-15T11:00:52.345778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0] Write session: Do CDS request
2025-10-15T11:00:52.345805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:52.362194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:52.362231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 860
2025-10-15T11:00:52.364084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:52.364955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:52.365092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:52.365115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:52.365126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:52.366459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 860 sessionId:  describe result for acl check
2025-10-15T11:00:52.366571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:52.366587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:52.366596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:52.366611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401817497268135:9369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:52.369188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401817497268135:9369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:52.377185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401817497268135:9369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:52.389408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401817497268135:9369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:52.389450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401817497268135:9369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:52.389466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401817497268135:9369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:52.389497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:52.419942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401817497268302:8824]
2025-10-15T11:00:52.421074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:52.424147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:52.425015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:52.425035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:52.425078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:52.425370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:52.425572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401820296959193:8398]
2025-10-15T11:00:52.428288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:52.429362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:52.429617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:52.430955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:52.431311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:52.431319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:52.431327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:52.431335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:52.431343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:52.431417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:52.431424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:52.431433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:52.431441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:52.431449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:52.431457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:52.431465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.431473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.431481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.431548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:52.431668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:52.431724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:52.431774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:52.431823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:52.431876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:52.431941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:52.431988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:52.432039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:52.432089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:52.432138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:52.432191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.432249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.432307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.432366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:52.432452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:52.432522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:52.432589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:52.432647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:52.432702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:52.432749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:52.432808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:52.432860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:52.432917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:52.432963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:52.433018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:52.433065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:52.433121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:52.433170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:52.433223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:52.433274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:52.433330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:52.433378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:52.433433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:52.433482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:52.433537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:52.433584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.433638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.433689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.433748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.433793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.433848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.434384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:52.457898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:52.466511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:52.466555Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:52.466574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:52.466595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:52.466624Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 859 [2:7561401820296959193:8398]
2025-10-15T11:00:52.466682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:52.466742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:52.466754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:52.466764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:52.466773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:52.466812Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:52.466829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:52.466845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:52.468512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 859
2025-10-15T11:00:52.468599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 859, pipe: [1:7561401817497268302:8824]
2025-10-15T11:00:52.468691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 859
2025-10-15T11:00:52.467840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.467862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.467879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.467891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:52.468155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:52.468175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.468323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.468519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.468704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:52.471129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 860 partition: 0 MaxSeqNo: 46 sessionId: src_id|19674eff-96e8b869-1d61a780-13cf0f75_0
2025-10-15T11:00:52.468758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401817497268231:9369], now have 1 active actors on pipe
2025-10-15T11:00:52.468773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401817497268302:8824], now have 1 active actors on pipe
2025-10-15T11:00:52.468788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401817497268121:2467], now have 1 active actors on pipe
2025-10-15T11:00:52.468828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:52.468843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:52.468882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401820296959187:8398]
2025-10-15T11:00:52.468898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401820296959187:8398]
2025-10-15T11:00:52.468908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401820296959187:8398]
2025-10-15T11:00:52.468939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:52.468991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:52.468998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:52.469014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:52.469025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:52.469142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:52.469160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:52.469215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19674eff-96e8b869-1d61a780-13cf0f75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:52.469236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:52.471940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad6fe95a-5ba21d18-7d1b466c-863c4278_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|19674eff-96e8b869-1d61a780-13cf0f75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:52.469248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:52.469256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:52.469284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:52.469315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:52.469419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401820296959187:8398]
2025-10-15T11:00:52.469440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:52.469473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:52.469542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:52.470318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:52.470337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:52.470393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:52.500042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19674eff-96e8b869-1d61a780-13cf0f75_0] Write session: try to update token
2025-10-15T11:00:52.500108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19674eff-96e8b869-1d61a780-13cf0f75_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:52.512186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:52.512218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:52.512258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401820296959187:8398]
2025-10-15T11:00:52.512384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:52.512791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:52.521101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:52.522333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:52.523518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:52.528270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:52.530105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:52.530562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:52.575328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId: src_id|19674eff-96e8b869-1d61a780-13cf0f75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:52.603757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:52.607392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:52.607425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:52.607438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:52.607501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:52.607517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:52.607554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:52.607568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:52.607616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401820296959187:8398]
2025-10-15T11:00:52.607645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401820296959187:8398]
2025-10-15T11:00:52.607669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401820296959187:8398]
2025-10-15T11:00:52.607795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:52.607835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:52.607865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:52.607867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:52.607895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:52.607934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:52.607964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:52.608922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:52.751144Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:52.753486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:52.753548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:52.753790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:52.753562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:52.753674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401817497268302:8824]
2025-10-15T11:00:52.778300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 860 reason: error at write: Disconnected sessionId: src_id|19674eff-96e8b869-1d61a780-13cf0f75_0
2025-10-15T11:00:52.778628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 860 sessionId: src_id|19674eff-96e8b869-1d61a780-13cf0f75_0 is DEAD
2025-10-15T11:00:52.779905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19674eff-96e8b869-1d61a780-13cf0f75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:52.779941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19674eff-96e8b869-1d61a780-13cf0f75_0] Write session will restart in 0.005818s
2025-10-15T11:00:52.780038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19674eff-96e8b869-1d61a780-13cf0f75_0] Write session: Do CDS request
2025-10-15T11:00:52.780064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19674eff-96e8b869-1d61a780-13cf0f75_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:52.795729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19674eff-96e8b869-1d61a780-13cf0f75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:52.796700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:52.796742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 861
2025-10-15T11:00:52.797764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:52.797883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:52.797906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:52.797915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:52.800196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 861 sessionId:  describe result for acl check
2025-10-15T11:00:52.800315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:52.800332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:52.800343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:52.800358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401817497268365:9374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:52.805376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401817497268365:9374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:52.827950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401817497268365:9374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:52.835471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401817497268365:9374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:52.835512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401817497268365:9374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:52.835526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401817497268365:9374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:52.835577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:52.846818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:52.850480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:52.851279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:52.851312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:52.851375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:52.851671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:52.851881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401820296959398:8407]
2025-10-15T11:00:52.854050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:52.854608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401817497268522:8824]
2025-10-15T11:00:52.855180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:52.855410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:52.856689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:52.857042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:52.857064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:52.857070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:52.857077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:52.857084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:52.857091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:52.857098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:52.857104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:52.857111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:52.857119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:52.857125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:52.857132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.857140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.857146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.857191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:52.857300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:52.857347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:52.857394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:52.857440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:52.857486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:52.857534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:52.857591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:52.857643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:52.857702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:52.857762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:52.857814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.857870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.857913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.857956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:52.858027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:52.858083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:52.858148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:52.858203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:52.858264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:52.858313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:52.858372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:52.858423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:52.858485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:52.858543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:52.858605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:52.858656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:52.858714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:52.858764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:52.858824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:52.858877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:52.858938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:52.858989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:52.859047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:52.859101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:52.859160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:52.859209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.859263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.859320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.859408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.859462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.859520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.862369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:52.883575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:52.899039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:52.899088Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:52.899106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:52.899125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:52.899151Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 860 [2:7561401820296959398:8407]
2025-10-15T11:00:52.899206Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:52.899266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:52.899281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:52.899295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:52.899306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:52.902896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 860
2025-10-15T11:00:52.902996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 860, pipe: [1:7561401817497268522:8824]
2025-10-15T11:00:52.903075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 860
2025-10-15T11:00:52.899799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:52.899835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:52.899860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:52.901797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.901813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.901826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.901837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:52.902120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:52.902139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:52.902280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:52.902471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:52.902694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:52.902783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401817497268331:2467], now have 1 active actors on pipe
2025-10-15T11:00:52.902809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401817497268522:8824], now have 1 active actors on pipe
2025-10-15T11:00:52.902832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401817497268514:9374], now have 1 active actors on pipe
2025-10-15T11:00:52.902858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401820296959393:8407]
2025-10-15T11:00:52.902873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401820296959393:8407]
2025-10-15T11:00:52.902886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401820296959393:8407]
2025-10-15T11:00:52.902932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:52.902984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:52.903001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:52.903007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:52.903025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:52.903165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:52.903177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:52.903268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401820296959393:8407]
2025-10-15T11:00:52.903280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:52.903371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:52.904088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:52.904122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:52.904225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bee04736-b6a395e3-968bec16-8814993b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:52.904258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:52.904282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:52.904296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:52.904331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:52.904364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:52.904411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:52.904924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:52.904960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:52.905049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:52.906122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19674eff-96e8b869-1d61a780-13cf0f75_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|bee04736-b6a395e3-968bec16-8814993b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:52.905341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 861 partition: 0 MaxSeqNo: 46 sessionId: src_id|bee04736-b6a395e3-968bec16-8814993b_0
2025-10-15T11:00:52.936276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee04736-b6a395e3-968bec16-8814993b_0] Write session: try to update token
2025-10-15T11:00:52.936331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee04736-b6a395e3-968bec16-8814993b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:53.020089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:53.020122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:53.020136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:53.020147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:53.020183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401820296959393:8407]
2025-10-15T11:00:53.020211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401820296959393:8407]
2025-10-15T11:00:53.020241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401820296959393:8407]
2025-10-15T11:00:53.020383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:53.020411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:53.020418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:53.020423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:53.020435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:53.020448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:53.020539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:53.020578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:53.021554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:53.033721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId: src_id|bee04736-b6a395e3-968bec16-8814993b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:53.054128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:53.165257Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:53.183161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:53.183209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:53.183277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:53.183289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:53.183325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401820296959393:8407]
2025-10-15T11:00:53.183605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:53.184745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:53.184775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:53.184379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:53.215006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 861 reason: error at write: Disconnected sessionId: src_id|bee04736-b6a395e3-968bec16-8814993b_0
2025-10-15T11:00:53.215385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 861 sessionId: src_id|bee04736-b6a395e3-968bec16-8814993b_0 is DEAD
2025-10-15T11:00:53.215821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee04736-b6a395e3-968bec16-8814993b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:53.215882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee04736-b6a395e3-968bec16-8814993b_0] Write session will restart in 0.007859s
2025-10-15T11:00:53.216026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee04736-b6a395e3-968bec16-8814993b_0] Write session: Do CDS request
2025-10-15T11:00:53.216065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee04736-b6a395e3-968bec16-8814993b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:53.230006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee04736-b6a395e3-968bec16-8814993b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:53.231176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:53.231425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401817497268522:8824]
2025-10-15T11:00:53.231508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:53.231523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 862
2025-10-15T11:00:53.231888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:53.232016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:53.232038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:53.232048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:53.234123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 862 sessionId:  describe result for acl check
2025-10-15T11:00:53.234236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:53.234251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:53.234260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:53.234277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401821792235883:9385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:53.236904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401821792235883:9385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:53.250546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401821792235883:9385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:53.264530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401821792235883:9385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:53.264575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401821792235883:9385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:53.264592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401821792235883:9385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:53.264622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:53.270045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:53.275096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:53.276013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:53.276033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:53.276076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:53.276338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:53.276535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401824591926919:8415]
2025-10-15T11:00:53.279818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:53.280877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:53.281141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:53.282484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:53.282837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:53.282851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:53.282859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:53.282867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:53.282875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:53.282882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:53.282890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:53.282911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:53.282917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:53.282926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:53.282932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:53.282941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.282947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.282955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.283003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:53.283110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:53.283159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:53.283205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:53.283250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:53.283297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:53.283366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:53.283414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:53.283460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:53.283507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:53.283562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:53.283612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.283661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.283709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.283755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:53.283833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:53.283902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:53.283965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:53.284019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:53.284077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:53.284125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:53.284183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:53.284231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:53.284290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:53.284338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:53.284395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:53.284441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:53.284501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:53.284550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:53.284607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:53.284668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:53.284739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:53.284795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:53.284861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:53.284916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:53.284979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:53.285032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.285095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.285150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.285213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.285267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.285330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.285875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:53.305090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:53.331218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:53.331262Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:53.331277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:53.331295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:53.331318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 861 [2:7561401824591926919:8415]
2025-10-15T11:00:53.331378Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:53.331433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:53.331445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:53.331457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:53.331468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:53.331514Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:53.331534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:53.331564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:53.331835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401821792236041:8824]
2025-10-15T11:00:53.333416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.333432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.333440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.333447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:53.333668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:53.333691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.333816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.333993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.334224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:53.334284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401824591926914:8415]
2025-10-15T11:00:53.334298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401824591926914:8415]
2025-10-15T11:00:53.334310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401824591926914:8415]
2025-10-15T11:00:53.334348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:53.334416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:53.334518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:53.334534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:53.334546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:53.334583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:53.334599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:53.334703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401824591926914:8415]
2025-10-15T11:00:53.334722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:53.334777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:53.334839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401821792236041:8824], now have 1 active actors on pipe
2025-10-15T11:00:53.334862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401821792235870:2467], now have 1 active actors on pipe
2025-10-15T11:00:53.334883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401821792236031:9385], now have 1 active actors on pipe
2025-10-15T11:00:53.338773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 861, pipe: [1:7561401821792236041:8824]
2025-10-15T11:00:53.338894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 861
2025-10-15T11:00:53.338989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 861
2025-10-15T11:00:53.339125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:53.339157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:53.339223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|104eedf0-32d1a7e8-78857012-555e593a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:53.339252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:53.339276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:53.339285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:53.339329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:53.339389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:53.339443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:53.339954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:53.339981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:53.340044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:53.340307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 862 partition: 0 MaxSeqNo: 46 sessionId: src_id|104eedf0-32d1a7e8-78857012-555e593a_0
2025-10-15T11:00:53.342660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee04736-b6a395e3-968bec16-8814993b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|104eedf0-32d1a7e8-78857012-555e593a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:53.373687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|104eedf0-32d1a7e8-78857012-555e593a_0] Write session: try to update token
2025-10-15T11:00:53.373746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|104eedf0-32d1a7e8-78857012-555e593a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:53.383978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:53.384008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:53.384047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401824591926914:8415]
2025-10-15T11:00:53.384162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:53.384184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:53.386364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:53.387899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:53.389094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:53.390424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:53.393905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:53.394447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:53.431640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:53.431665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:53.431677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
E1015 11:00:53.481048772  923061 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:00:53.487169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:53.487201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:53.487214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:53.487224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:53.487259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401824591926914:8415]
2025-10-15T11:00:53.487285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401824591926914:8415]
2025-10-15T11:00:53.487305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401824591926914:8415]
2025-10-15T11:00:53.487459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:53.487486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:53.487632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:53.487663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:53.487688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:53.488452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:53.529632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId: src_id|104eedf0-32d1a7e8-78857012-555e593a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:53.554117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:53.653524Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:53.656038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:53.656087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:53.656855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:53.657326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401821792236041:8824]
2025-10-15T11:00:53.657415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:53.657551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:53.657571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:53.666092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 862 reason: error at write: Disconnected sessionId: src_id|104eedf0-32d1a7e8-78857012-555e593a_0
2025-10-15T11:00:53.666487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 862 sessionId: src_id|104eedf0-32d1a7e8-78857012-555e593a_0 is DEAD
2025-10-15T11:00:53.667897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|104eedf0-32d1a7e8-78857012-555e593a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:53.668004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|104eedf0-32d1a7e8-78857012-555e593a_0] Write session will restart in 0.007844s
2025-10-15T11:00:53.668219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|104eedf0-32d1a7e8-78857012-555e593a_0] Write session: Do CDS request
2025-10-15T11:00:53.668272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|104eedf0-32d1a7e8-78857012-555e593a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:53.679704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|104eedf0-32d1a7e8-78857012-555e593a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:53.679685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:53.679718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 863
2025-10-15T11:00:53.680266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:53.680427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:53.680453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:53.680463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:53.681731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 863 sessionId:  describe result for acl check
2025-10-15T11:00:53.681855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:53.681882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:53.681892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:53.681909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401821792236090:9393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:53.684687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401821792236090:9393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:53.691503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401821792236090:9393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:53.704566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401821792236090:9393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:53.704612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401821792236090:9393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:53.704630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401821792236090:9393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:53.704662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:53.733695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:53.737936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:53.738618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:53.738638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:53.738666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:53.738854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:53.738990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401824591927123:8420]
2025-10-15T11:00:53.740885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:53.741796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:53.742020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:53.742975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:53.743219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:53.743225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:53.743230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:53.743235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:53.743240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:53.743245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:53.743249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:53.743254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:53.743259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:53.743263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:53.743267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:53.743272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.743292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.743300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.743335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:53.743471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:53.743521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:53.743580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:53.743625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:53.743673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:53.743721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:53.743769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:53.743813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:53.743860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:53.743906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:53.743966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.744015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.744049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.744085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:53.744140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:53.744202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:53.744258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:53.744295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:53.744336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:53.744388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:53.744443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:53.744497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:53.744556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:53.744605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:53.744663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:53.744713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:53.744769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:53.744821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:53.744873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:53.744927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:53.744987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:53.745037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:53.745095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:53.745147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:53.745204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:53.745254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.745311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.745366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.745422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.745474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.745531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.746043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:53.756791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401821792236266:8824]
2025-10-15T11:00:53.764604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:53.773215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:53.773261Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:53.773280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:53.773301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:53.773330Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 862 [2:7561401824591927123:8420]
2025-10-15T11:00:53.773385Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:53.773449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:53.773464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:53.773478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:53.773491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:53.773528Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:53.773545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:53.773569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:53.774355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.774372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.774381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.774401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:53.774680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:53.774711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:53.774861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:53.775011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:53.775016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 862
2025-10-15T11:00:53.775101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 862, pipe: [1:7561401821792236266:8824]
2025-10-15T11:00:53.775186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:53.775186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 862
2025-10-15T11:00:53.775245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401821792236163:9393], now have 1 active actors on pipe
2025-10-15T11:00:53.775264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401821792236266:8824], now have 1 active actors on pipe
2025-10-15T11:00:53.775281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401821792236077:2467], now have 1 active actors on pipe
2025-10-15T11:00:53.775298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401824591927118:8420]
2025-10-15T11:00:53.775310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401824591927118:8420]
2025-10-15T11:00:53.775319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401824591927118:8420]
2025-10-15T11:00:53.775361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:53.775417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:53.775440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:53.775472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:53.775483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:53.775594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:53.775615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:53.775751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:53.775779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:53.775826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401824591927118:8420]
2025-10-15T11:00:53.775857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:53.775913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:53.775957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:53.775983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:53.775995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:53.776001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:53.776030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:53.776058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:53.776135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:53.776809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:53.776842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:53.776925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:53.777230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 863 partition: 0 MaxSeqNo: 46 sessionId: src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0
2025-10-15T11:00:53.777963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|104eedf0-32d1a7e8-78857012-555e593a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:53.800553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0] Write session: try to update token
2025-10-15T11:00:53.800609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:53.843186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:53.843249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:53.843294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:53.843324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:53.843407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401824591927118:8420]
2025-10-15T11:00:53.843461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401824591927118:8420]
2025-10-15T11:00:53.843535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401824591927118:8420]
2025-10-15T11:00:53.843739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:53.843798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:53.843833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:53.843851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:53.843867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:53.847666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:53.878632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId: src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:53.904796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:53.985174Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:53.997850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:53.997897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:53.997954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:53.997969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:53.998009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401824591927118:8420]
2025-10-15T11:00:53.998193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:53.998580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:53.998565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:53.998599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:53.999607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401821792236266:8824]
2025-10-15T11:00:53.999740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:54.008652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 863 reason: error at write: Disconnected sessionId: src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0
2025-10-15T11:00:54.009005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 863 sessionId: src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0 is DEAD
2025-10-15T11:00:54.011975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:54.012058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0] Write session will restart in 0.006769s
2025-10-15T11:00:54.012208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0] Write session: Do CDS request
2025-10-15T11:00:54.012257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:54.023214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:54.023032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:54.023064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 864
2025-10-15T11:00:54.023729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:54.023848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:54.023869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:54.023878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:54.025175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 864 sessionId:  describe result for acl check
2025-10-15T11:00:54.025294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:54.025312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:54.025322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:54.025337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401826087203589:9398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:54.028203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401826087203589:9398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:54.033931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401826087203589:9398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:54.047144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401826087203589:9398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:54.047184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401826087203589:9398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:54.047198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401826087203589:9398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:54.047225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:54.078897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:54.080959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:54.081817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:54.081851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:54.081893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:54.082151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:54.082345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401828886894613:8422]
2025-10-15T11:00:54.084682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:54.086045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:54.086268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:54.087603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:54.087941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.087959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.087967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.087974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.087981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.087988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.087995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.088003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.088010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.088018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.088024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.088031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.088039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.088045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.088099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.088215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.088265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.088315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.088364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.088413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.088462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.088507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.088556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.088608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.088655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.088702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.088749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.088796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.088842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.088911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.088973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.089028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.089081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.089141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.089190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.089246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.089296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.089352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.089401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.089458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.089513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.089567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.089613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.089668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.089719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.089774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.089819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.089877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.089925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.089979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.090024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.090082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.090131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.090189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.090237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.090292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.090832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:54.099840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401826087203768:8824]
2025-10-15T11:00:54.113719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:54.123797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:54.123843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:54.123859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:54.123878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:54.123903Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 863 [2:7561401828886894613:8422]
2025-10-15T11:00:54.123957Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:54.124018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:54.124033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:54.124045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:54.124056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:54.124105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:54.124129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:54.124162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:54.135955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.135985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.135993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.136002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:54.136263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:54.136285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.136403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.136561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.136552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 863, pipe: [1:7561401826087203768:8824]
2025-10-15T11:00:54.136652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 863
2025-10-15T11:00:54.136675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 863
2025-10-15T11:00:54.136746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:54.136832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401826087203768:8824], now have 1 active actors on pipe
2025-10-15T11:00:54.136859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401821792236280:2467], now have 1 active actors on pipe
2025-10-15T11:00:54.136879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401826087203656:9398], now have 1 active actors on pipe
2025-10-15T11:00:54.136904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401828886894608:8422]
2025-10-15T11:00:54.136922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401828886894608:8422]
2025-10-15T11:00:54.136935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401828886894608:8422]
2025-10-15T11:00:54.136964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:54.137012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:54.137031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:54.137044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:54.137055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:54.137199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:54.137224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:54.137296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:54.137322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:54.137435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401828886894608:8422]
2025-10-15T11:00:54.137461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:54.137533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcce7234-6162f6f0-e3357beb-4695153f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:54.137569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:54.137591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:54.137601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:54.137606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:54.137636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:54.137681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:54.137808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:54.138533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:54.138566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:54.138635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:54.139148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 864 partition: 0 MaxSeqNo: 46 sessionId: src_id|dcce7234-6162f6f0-e3357beb-4695153f_0
2025-10-15T11:00:54.139965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9684cc-d069e7f5-cca5c546-d01d46c9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dcce7234-6162f6f0-e3357beb-4695153f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:54.171382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:54.171417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:54.171453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401828886894608:8422]
2025-10-15T11:00:54.171584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:54.171603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:54.178640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcce7234-6162f6f0-e3357beb-4695153f_0] Write session: try to update token
2025-10-15T11:00:54.178702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcce7234-6162f6f0-e3357beb-4695153f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:54.178651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:54.180133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:54.181442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:54.189948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:54.196105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:54.196851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:54.227459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:54.227491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:54.227503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:54.282964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:54.283000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:54.283015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:54.283029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:54.283070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401828886894608:8422]
2025-10-15T11:00:54.283095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401828886894608:8422]
2025-10-15T11:00:54.283119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401828886894608:8422]
2025-10-15T11:00:54.283277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:54.283303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:54.283929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:54.283969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:54.284004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:54.288166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:54.299189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId: src_id|dcce7234-6162f6f0-e3357beb-4695153f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:54.322824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:54.435058Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:54.437379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:54.437420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:54.439147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:54.439384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:54.438132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:54.443596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401826087203768:8824]
2025-10-15T11:00:54.466572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 864 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dcce7234-6162f6f0-e3357beb-4695153f_0
2025-10-15T11:00:54.466852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 864 sessionId: src_id|dcce7234-6162f6f0-e3357beb-4695153f_0 is DEAD
2025-10-15T11:00:54.467611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcce7234-6162f6f0-e3357beb-4695153f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:54.467668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcce7234-6162f6f0-e3357beb-4695153f_0] Write session will restart in 0.005775s
2025-10-15T11:00:54.467808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcce7234-6162f6f0-e3357beb-4695153f_0] Write session: Do CDS request
2025-10-15T11:00:54.467857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcce7234-6162f6f0-e3357beb-4695153f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:54.477138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:54.477175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 865
2025-10-15T11:00:54.477377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcce7234-6162f6f0-e3357beb-4695153f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:54.477853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:54.477995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:54.478013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:54.478023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:54.479246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 865 sessionId:  describe result for acl check
2025-10-15T11:00:54.479369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:54.479387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:54.479395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:54.479410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401826087203802:9404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:54.481797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401826087203802:9404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:54.487640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401826087203802:9404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:54.498149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401826087203802:9404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:54.498195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401826087203802:9404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:54.498212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401826087203802:9404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:54.498240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:54.521668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:54.527647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:54.528339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:54.528352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:54.528382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:54.528568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:54.528682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401828886894837:8431]
2025-10-15T11:00:54.530124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:54.531035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:54.531312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:54.532608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:54.532919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.532927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.532936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.532943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.532950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.532956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.532963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.532969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.532976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.532982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.532990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.532997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.533004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.533010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.533058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.533164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.533213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.533259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.533303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.533348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.533392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.533439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.533503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.533551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.533597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.533642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.533685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.533726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.533765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.533830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.533884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.533939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.533987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.534037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.534081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.534131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.534174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.534224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.534267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.534318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.534363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.534414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.534459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.534512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.534590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.534649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.534694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.534743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.534791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.534841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.534885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.534937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.534983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.535033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.535073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.535123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.535669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:54.544653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401826087203980:8824]
2025-10-15T11:00:54.557562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:54.574484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:54.574526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:54.574542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:54.574560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:54.574584Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 864 [2:7561401828886894837:8431]
2025-10-15T11:00:54.574633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:54.574685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:54.574700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:54.574711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:54.574722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:54.574764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:54.574784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:54.574804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:54.577394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.577428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.577441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.577452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:54.577746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:54.577773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.577904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.578097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.578331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:54.578399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401828886894832:8431]
2025-10-15T11:00:54.578420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401828886894832:8431]
2025-10-15T11:00:54.578433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401828886894832:8431]
2025-10-15T11:00:54.578472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:54.578542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:54.578720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:54.578743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:54.578793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:54.578808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:54.578817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:54.578885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401826087203980:8824], now have 1 active actors on pipe
2025-10-15T11:00:54.578917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401826087203859:9404], now have 1 active actors on pipe
2025-10-15T11:00:54.578938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401826087203785:2467], now have 1 active actors on pipe
2025-10-15T11:00:54.578957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401828886894832:8431]
2025-10-15T11:00:54.578983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:54.579081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 864
2025-10-15T11:00:54.579192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 864, pipe: [1:7561401826087203980:8824]
2025-10-15T11:00:54.579238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:54.579273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 864
2025-10-15T11:00:54.579920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:54.579950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:54.580016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b31c2acb-1662799-63366862-5464a682_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:54.580052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:54.580075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:54.580086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:54.580119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:54.580156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:54.580205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:54.580932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:54.580957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:54.581018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:54.581627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 865 partition: 0 MaxSeqNo: 46 sessionId: src_id|b31c2acb-1662799-63366862-5464a682_0
2025-10-15T11:00:54.583830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcce7234-6162f6f0-e3357beb-4695153f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b31c2acb-1662799-63366862-5464a682_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:54.619812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c2acb-1662799-63366862-5464a682_0] Write session: try to update token
2025-10-15T11:00:54.619863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c2acb-1662799-63366862-5464a682_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:54.691491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:54.691521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:54.691532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:54.691542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:54.691584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401828886894832:8431]
2025-10-15T11:00:54.691607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401828886894832:8431]
2025-10-15T11:00:54.691626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401828886894832:8431]
2025-10-15T11:00:54.691749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:54.691788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:54.691809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:54.691820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:54.691827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:54.691829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:54.691866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:54.691883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:54.692841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:54.769641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId: src_id|b31c2acb-1662799-63366862-5464a682_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:54.789906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:54.834918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:54.846165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:54.846209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:54.846265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:54.846278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:54.846314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401828886894832:8431]
2025-10-15T11:00:54.846593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:54.846879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:54.846687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401826087203980:8824]
2025-10-15T11:00:54.846791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:54.846802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:54.856013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 865 reason: error at write: Disconnected sessionId: src_id|b31c2acb-1662799-63366862-5464a682_0
2025-10-15T11:00:54.856294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 865 sessionId: src_id|b31c2acb-1662799-63366862-5464a682_0 is DEAD
2025-10-15T11:00:54.858451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c2acb-1662799-63366862-5464a682_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:54.858508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c2acb-1662799-63366862-5464a682_0] Write session will restart in 0.007344s
2025-10-15T11:00:54.858680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c2acb-1662799-63366862-5464a682_0] Write session: Do CDS request
2025-10-15T11:00:54.858722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c2acb-1662799-63366862-5464a682_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:54.870452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c2acb-1662799-63366862-5464a682_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:54.874240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:54.874419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:54.874440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 866
2025-10-15T11:00:54.874836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:54.874971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:54.874992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:54.875001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:54.876098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 866 sessionId:  describe result for acl check
2025-10-15T11:00:54.876206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:54.876235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:54.876243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:54.876258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401826087204032:9416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:54.878113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401826087204032:9416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:54.885822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401826087204032:9416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:54.897873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401826087204032:9416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:54.897917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401826087204032:9416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:54.897933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401826087204032:9416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:54.897960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:54.946706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401826087204207:8824]
2025-10-15T11:00:54.953270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:54.959770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:54.960695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:54.960714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:54.960759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:54.961011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:54.961209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401828886895054:8439]
2025-10-15T11:00:54.963968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:54.965255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:54.965491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:54.966818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:54.967397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.967429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.967436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.967442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.967450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.967458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.967466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.967473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.967483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.967489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.967496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.967503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.967510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.967525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.967590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.967706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.967764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.967819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.967871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.967922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.967974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.968027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.968129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.968185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.968236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.968287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.968336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.968387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.968435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.968510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:54.968574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.968634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:54.968688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.968750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:54.968803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.968868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:54.968922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.968982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:54.969029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.969089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:54.969142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.969202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:54.969251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.969309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:54.969362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.969417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:54.969463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.969517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:54.969567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.969627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:54.969679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.969735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:54.969782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.969839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:54.969889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.969948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:54.970506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:54.989654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:55.002169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:55.002207Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:55.002219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:55.002235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:55.002256Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 865 [2:7561401828886895054:8439]
2025-10-15T11:00:55.002294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:55.002342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:55.002353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:55.002363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:55.002372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:55.002411Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:55.002428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:55.002446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:55.004209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.004238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.004254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.004266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:55.004554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:55.004579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.004729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.004929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.005158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:55.005246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401826087204207:8824], now have 1 active actors on pipe
2025-10-15T11:00:55.005276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401826087204026:2467], now have 1 active actors on pipe
2025-10-15T11:00:55.005304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401826087204095:9416], now have 1 active actors on pipe
2025-10-15T11:00:55.005333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401828886895049:8439]
2025-10-15T11:00:55.005353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401828886895049:8439]
2025-10-15T11:00:55.005367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401828886895049:8439]
2025-10-15T11:00:55.005406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:55.005452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:55.005468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:55.005481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:55.005483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:55.005690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:55.005716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:55.005593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 865, pipe: [1:7561401826087204207:8824]
2025-10-15T11:00:55.005726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 865
2025-10-15T11:00:55.005806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 865
2025-10-15T11:00:55.005854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401828886895049:8439]
2025-10-15T11:00:55.005886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:55.005922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:55.006618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:55.006665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:55.006770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f774bc3-f46575d6-840237dd-381ffff4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:55.006809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:55.006826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:55.006836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:55.006869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:55.006903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:55.006950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:55.008394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:55.008423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:55.008498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:55.008924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 866 partition: 0 MaxSeqNo: 46 sessionId: src_id|4f774bc3-f46575d6-840237dd-381ffff4_0
2025-10-15T11:00:55.009893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b31c2acb-1662799-63366862-5464a682_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4f774bc3-f46575d6-840237dd-381ffff4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:55.043629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:55.043667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:55.043710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401828886895049:8439]
2025-10-15T11:00:55.043864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:55.043871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:55.045735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:55.046991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:55.048319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:55.049455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:55.052132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:55.052387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f774bc3-f46575d6-840237dd-381ffff4_0] Write session: try to update token
2025-10-15T11:00:55.052444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f774bc3-f46575d6-840237dd-381ffff4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:55.052621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:55.101411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:55.101467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:55.101494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:55.101511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:55.101572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401828886895049:8439]
2025-10-15T11:00:55.101609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401828886895049:8439]
2025-10-15T11:00:55.101645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401828886895049:8439]
2025-10-15T11:00:55.101788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:55.101817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:55.101842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:55.101843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:55.101866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:55.112745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:55.164653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId: src_id|4f774bc3-f46575d6-840237dd-381ffff4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:55.184820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:55.259560Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:55.271059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:55.271101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:55.271675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401826087204207:8824]
2025-10-15T11:00:55.271677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:55.271784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:55.271815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:55.271834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:55.280701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 866 reason: error at write: Disconnected sessionId: src_id|4f774bc3-f46575d6-840237dd-381ffff4_0
2025-10-15T11:00:55.281068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 866 sessionId: src_id|4f774bc3-f46575d6-840237dd-381ffff4_0 is DEAD
2025-10-15T11:00:55.282148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f774bc3-f46575d6-840237dd-381ffff4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:55.282206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f774bc3-f46575d6-840237dd-381ffff4_0] Write session will restart in 0.009788s
2025-10-15T11:00:55.282367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f774bc3-f46575d6-840237dd-381ffff4_0] Write session: Do CDS request
2025-10-15T11:00:55.282418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f774bc3-f46575d6-840237dd-381ffff4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:55.298118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:55.298157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 867
2025-10-15T11:00:55.298341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f774bc3-f46575d6-840237dd-381ffff4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:55.298896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:55.299038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:55.299077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:55.299089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:55.300488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 867 sessionId:  describe result for acl check
2025-10-15T11:00:55.300606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:55.300627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:55.300638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:55.300657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401830382171547:9423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:55.304268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401830382171547:9423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:55.310946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401830382171547:9423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:55.319181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401830382171547:9423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:55.319227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401830382171547:9423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:55.319244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401830382171547:9423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:55.319276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:55.358629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:55.360572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:55.361156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:55.361178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:55.361205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:55.361372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:55.361535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401833181862565:8444]
2025-10-15T11:00:55.363031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:55.364104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:55.364240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:55.364998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:55.365211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:55.365216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:55.365221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:55.365227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:55.365234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:55.365241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:55.365247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:55.365253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:55.365259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:55.365263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:55.365267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:55.365271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.365274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.365279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.365309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:55.365394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:55.365424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:55.365455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:55.365482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:55.365515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:55.365545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:55.365573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:55.365605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:55.365640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:55.365670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:55.365698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.365726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.365764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.365787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:55.365831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:55.365875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:55.365917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:55.365946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:55.365979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:55.366006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:55.366037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:55.366068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:55.366103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:55.366136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:55.366170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:55.366201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:55.366237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:55.366275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:55.366306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:55.366333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:55.366369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:55.366410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:55.366444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:55.366472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:55.366504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:55.366533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.366565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.366593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.366628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.366661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.366694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.367030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:55.372149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401830382171729:8824]
2025-10-15T11:00:55.385999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:55.405147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:55.405195Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:55.405210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:55.405226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:55.405249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 866 [2:7561401833181862565:8444]
2025-10-15T11:00:55.405297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:55.405349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:55.405362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:55.405374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:55.405384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:55.405428Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:55.405459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:55.405480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:55.406697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.406718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.406730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.406740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:55.406997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:55.407021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.407152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.407335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.407597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:55.407445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 866, pipe: [1:7561401830382171729:8824]
2025-10-15T11:00:55.407491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 866
2025-10-15T11:00:55.407685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401830382171729:8824], now have 1 active actors on pipe
2025-10-15T11:00:55.407570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 866
2025-10-15T11:00:55.407711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401830382171591:9423], now have 1 active actors on pipe
2025-10-15T11:00:55.407732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401830382171531:2467], now have 1 active actors on pipe
2025-10-15T11:00:55.407759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401833181862560:8444]
2025-10-15T11:00:55.407777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401833181862560:8444]
2025-10-15T11:00:55.407789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401833181862560:8444]
2025-10-15T11:00:55.407830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:55.407875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:55.407900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:55.407900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:55.407922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:55.408071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:55.408096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:55.408150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:55.408168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:55.408292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401833181862560:8444]
2025-10-15T11:00:55.408321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:55.408352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:55.408385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:55.408415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:55.408435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:55.408445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:55.408477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:55.408508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:55.408643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:55.409316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:55.409341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:55.409402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:55.409674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 867 partition: 0 MaxSeqNo: 46 sessionId: src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0
2025-10-15T11:00:55.410521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f774bc3-f46575d6-840237dd-381ffff4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:55.443543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0] Write session: try to update token
2025-10-15T11:00:55.443614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:55.454948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:55.454983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:55.455025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401833181862560:8444]
2025-10-15T11:00:55.455163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:55.455209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:55.456956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:55.458142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:55.459363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:55.460462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:55.461931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:55.462299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:55.542568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:55.542600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:55.542613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:55.542673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:55.542687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:55.542701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:55.542709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:55.542750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401833181862560:8444]
2025-10-15T11:00:55.542775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401833181862560:8444]
2025-10-15T11:00:55.542798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401833181862560:8444]
2025-10-15T11:00:55.542927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:55.542950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:55.542968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:55.542971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:55.542994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:55.544286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:55.563638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId: src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:55.584167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:55.692847Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:55.694978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:55.695007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:55.697064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401830382171729:8824]
2025-10-15T11:00:55.697178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:55.697191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:55.697755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:55.699548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:55.716456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 867 reason: error at write: Disconnected sessionId: src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0
2025-10-15T11:00:55.716803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 867 sessionId: src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0 is DEAD
2025-10-15T11:00:55.723551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:55.723603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0] Write session will restart in 0.009654s
2025-10-15T11:00:55.723729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0] Write session: Do CDS request
2025-10-15T11:00:55.723763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:55.744136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:55.743681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:55.743719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 868
2025-10-15T11:00:55.746830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:55.746953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:55.746968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:55.746980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:55.747990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 868 sessionId:  describe result for acl check
2025-10-15T11:00:55.748075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:55.748081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:55.748088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:55.748099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401830382171766:9428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:55.749898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401830382171766:9428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:55.761956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401830382171766:9428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:55.782566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401830382171766:9428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:55.782610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401830382171766:9428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:55.782627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401830382171766:9428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:55.782658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:55.797096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401830382171931:8824]
2025-10-15T11:00:55.816617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:55.828447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:55.829316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:55.829335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:55.829380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:55.829641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:55.829821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401833181862782:8453]
2025-10-15T11:00:55.832238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:55.833309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:55.833516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:55.834748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:55.835100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:55.835108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:55.835115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:55.835122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:55.835129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:55.835136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:55.835144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:55.835151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:55.835159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:55.835166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:55.835172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:55.835180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.835185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.835193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.835240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:55.835362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:55.835411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:55.835459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:55.835507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:55.835555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:55.835612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:55.835659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:55.835705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:55.835753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:55.835802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:55.835848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.835893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.835938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.835980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:55.836052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:55.836108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:55.836162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:55.836209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:55.836261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:55.836309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:55.836364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:55.836414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:55.836467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:55.836512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:55.836565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:55.836612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:55.836667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:55.836712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:55.836766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:55.836815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:55.836875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:55.836920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:55.836977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:55.837021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:55.837073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:55.837117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.837173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.837223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.837279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.837327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.837380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.839098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:55.857495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:55.867119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:55.867168Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:55.867186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:55.867205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:55.867230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 867 [2:7561401833181862782:8453]
2025-10-15T11:00:55.867283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:55.867342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:55.867585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:55.867613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:55.867624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:55.867675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:55.867699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:55.867723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:55.882982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.883007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.883017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.883027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:55.883281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:55.883295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:55.883499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:55.883672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:55.883881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:55.883960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401830382171931:8824], now have 1 active actors on pipe
2025-10-15T11:00:55.883983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401830382171877:9428], now have 1 active actors on pipe
2025-10-15T11:00:55.883656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 867
2025-10-15T11:00:55.884004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401830382171753:2467], now have 1 active actors on pipe
2025-10-15T11:00:55.884030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401833181862776:8453]
2025-10-15T11:00:55.883752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 867
2025-10-15T11:00:55.884045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401833181862776:8453]
2025-10-15T11:00:55.883825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 867, pipe: [1:7561401830382171931:8824]
2025-10-15T11:00:55.884057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401833181862776:8453]
2025-10-15T11:00:55.884094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:55.884162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:55.884335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:55.884350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:55.884405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:55.884424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:55.884544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401833181862776:8453]
2025-10-15T11:00:55.884561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:55.884627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d58c03a2-89983699-f016f871-d52ffdc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:55.884657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:55.884675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:55.884685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:55.884722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:55.884763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:55.884875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:55.885006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:55.885017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:55.885030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:55.885052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:55.887655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:55.887682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:55.887759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:55.888073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 868 partition: 0 MaxSeqNo: 46 sessionId: src_id|d58c03a2-89983699-f016f871-d52ffdc5_0
2025-10-15T11:00:55.891106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7537ac5b-e407f49c-57ae1afb-e8363491_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d58c03a2-89983699-f016f871-d52ffdc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:55.923897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d58c03a2-89983699-f016f871-d52ffdc5_0] Write session: try to update token
2025-10-15T11:00:55.923951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d58c03a2-89983699-f016f871-d52ffdc5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:55.997468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:55.997503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:55.997515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:55.997526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:55.997556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401833181862776:8453]
2025-10-15T11:00:55.997580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401833181862776:8453]
2025-10-15T11:00:55.997602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401833181862776:8453]
2025-10-15T11:00:55.997740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:55.997745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:55.997757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:55.997767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:55.997788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:55.997816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:55.997853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:55.997871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:55.998935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:56.027804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId: src_id|d58c03a2-89983699-f016f871-d52ffdc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:56.049229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:56.139806Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:56.156558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:56.156603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:56.156683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:56.156698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:56.156734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401833181862776:8453]
2025-10-15T11:00:56.156896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:56.157295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:56.157168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401830382171931:8824]
2025-10-15T11:00:56.157280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:56.157292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:56.167222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 868 reason: error at write: Disconnected sessionId: src_id|d58c03a2-89983699-f016f871-d52ffdc5_0
2025-10-15T11:00:56.167724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 868 sessionId: src_id|d58c03a2-89983699-f016f871-d52ffdc5_0 is DEAD
2025-10-15T11:00:56.168059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58c03a2-89983699-f016f871-d52ffdc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:56.168106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58c03a2-89983699-f016f871-d52ffdc5_0] Write session will restart in 0.007945s
2025-10-15T11:00:56.168256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58c03a2-89983699-f016f871-d52ffdc5_0] Write session: Do CDS request
2025-10-15T11:00:56.168299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58c03a2-89983699-f016f871-d52ffdc5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:56.184989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d58c03a2-89983699-f016f871-d52ffdc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:56.192736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:56.192822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:56.192836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 869
2025-10-15T11:00:56.193147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:56.193256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:56.193276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:56.193286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:56.194455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 869 sessionId:  describe result for acl check
2025-10-15T11:00:56.194558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:56.194578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:56.194588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:56.194603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401834677139291:9439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:56.196988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401834677139291:9439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:56.203142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401834677139291:9439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:56.210201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401834677139291:9439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:56.210250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401834677139291:9439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:56.210265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401834677139291:9439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:56.210291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:56.237723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:56.242733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:56.243547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:56.243574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:56.243627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:56.243870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:56.244053Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401837476830308:8461]
2025-10-15T11:00:56.246163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:56.246952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:56.247128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:56.248085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:56.248384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:56.248401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:56.248408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:56.248415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:56.248422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:56.248429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:56.248436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:56.248444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:56.248450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:56.248457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:56.248464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:56.248470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.248477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.248483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.248518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:56.248606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:56.248650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:56.248694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:56.248737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:56.248782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:56.248829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:56.248876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:56.248926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:56.248979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:56.249022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:56.249114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.249165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.249208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.249251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:56.249315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:56.249367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:56.249424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:56.249478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:56.249533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:56.249581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:56.249636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:56.249688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:56.249744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:56.249799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:56.249854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:56.249904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:56.249975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:56.250014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:56.250095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:56.250150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:56.250204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:56.250251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:56.250308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:56.250353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:56.250400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:56.250447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.250500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.250548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.250603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.250650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.250703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.251179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:56.257363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401834677139472:8824]
2025-10-15T11:00:56.266272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:56.276098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:56.276133Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:56.276149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:56.276167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:56.276191Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 868 [2:7561401837476830308:8461]
2025-10-15T11:00:56.276240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:56.276293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:56.276306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:56.276318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:56.276329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:56.276371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:56.276401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:56.276421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:56.278123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.278147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.278156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.278163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:56.278407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:56.278433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.278546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.278665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 868, pipe: [1:7561401834677139472:8824]
2025-10-15T11:00:56.278730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.278778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 868
2025-10-15T11:00:56.278868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 868
2025-10-15T11:00:56.278951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:56.279035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401834677139472:8824], now have 1 active actors on pipe
2025-10-15T11:00:56.279066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401834677139366:9439], now have 1 active actors on pipe
2025-10-15T11:00:56.279089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401834677139287:2467], now have 1 active actors on pipe
2025-10-15T11:00:56.279130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:56.279156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:56.279202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401837476830303:8461]
2025-10-15T11:00:56.279215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401837476830303:8461]
2025-10-15T11:00:56.279228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401837476830303:8461]
2025-10-15T11:00:56.279268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:56.279293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:56.279306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:56.279317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:56.279334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:56.279525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:56.279541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:56.279587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:56.279627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:56.279648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:56.279659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:56.279688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:56.279725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:56.279847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401837476830303:8461]
2025-10-15T11:00:56.279880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:56.279913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:56.279926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:56.280309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:56.280332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:56.280381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:56.280632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 869 partition: 0 MaxSeqNo: 46 sessionId: src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0
2025-10-15T11:00:56.281267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d58c03a2-89983699-f016f871-d52ffdc5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:56.299265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0] Write session: try to update token
2025-10-15T11:00:56.299316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:56.343442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:56.343473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:56.343510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401837476830303:8461]
2025-10-15T11:00:56.343645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:56.343704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:56.345719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:56.347082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:56.348413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:56.349549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:56.351241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:56.387935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId: src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:56.390667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:56.390806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:56.390826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:56.390839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:56.390848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:56.390886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401837476830303:8461]
2025-10-15T11:00:56.390911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401837476830303:8461]
2025-10-15T11:00:56.390933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401837476830303:8461]
2025-10-15T11:00:56.391068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:56.391089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:56.391102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:56.391111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:56.391114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:56.391138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:56.391152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:56.391185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:56.392216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:56.408580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:56.532017Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:56.533303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:56.533341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:56.533928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401834677139472:8824]
2025-10-15T11:00:56.533918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:56.534029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:56.533950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:56.534081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:56.601993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:56.602069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0] Write session will restart in 0.009664s
2025-10-15T11:00:56.602248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0] Write session: Do CDS request
2025-10-15T11:00:56.602310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:56.601258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 869 reason: error at write: Disconnected sessionId: src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0
2025-10-15T11:00:56.601505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 869 sessionId: src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0 is DEAD
2025-10-15T11:00:56.620444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:56.620486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 870
2025-10-15T11:00:56.620600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:56.621042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:56.621175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:56.621194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:56.621203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:56.622505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 870 sessionId:  describe result for acl check
2025-10-15T11:00:56.622615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:56.622632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:56.622641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:56.622656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401834677139662:9446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:56.625018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401834677139662:9446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:56.626746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:56.628386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:56.629094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:56.629124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:56.629161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:56.629394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:56.629572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401837476830516:8466]
2025-10-15T11:00:56.630390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401834677139662:9446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:56.631747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:56.632522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:56.632732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:56.633877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:56.634159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401834677139689:8824]
2025-10-15T11:00:56.634172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:56.634191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:56.634197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:56.634205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:56.634211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:56.634217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:56.634224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:56.634229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:56.634235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:56.634242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:56.634248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:56.634255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.634261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.634266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.634311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:56.634410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:56.634458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:56.634499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:56.634545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:56.634588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:56.634629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:56.634672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:56.634715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:56.634759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:56.634798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:56.634840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.634882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.634924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.634964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:56.635026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:56.635079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:56.635131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:56.635174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:56.635227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:56.635272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:56.635323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:56.635403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:56.635458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:56.635500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:56.635566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:56.635631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:56.635683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:56.635742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:56.635793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:56.635845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:56.635896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:56.635947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:56.636000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:56.636050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:56.636105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:56.636153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.636211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.636260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.636315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.636363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.636420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.636897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:56.637206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401834677139662:9446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:56.637244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401834677139662:9446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:56.637260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401834677139662:9446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:56.637287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:56.651814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:56.662191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:56.662235Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:56.662253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:56.662268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:56.662292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 869 [2:7561401837476830516:8466]
2025-10-15T11:00:56.662339Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:56.662387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:56.662400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:56.662411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:56.662422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:56.662465Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:56.662483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:56.662505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:56.678013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.678045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.678060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.678072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:56.678339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:56.678365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:56.678503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:56.678693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:56.678916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:56.678996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401834677139497:2467], now have 1 active actors on pipe
2025-10-15T11:00:56.679018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401834677139689:8824], now have 1 active actors on pipe
2025-10-15T11:00:56.679038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401834677139695:9446], now have 1 active actors on pipe
2025-10-15T11:00:56.679095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:56.679115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:56.679151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401837476830511:8466]
2025-10-15T11:00:56.679164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401837476830511:8466]
2025-10-15T11:00:56.679176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401837476830511:8466]
2025-10-15T11:00:56.679218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:56.679242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:56.679256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:56.679266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:56.679287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:56.679483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:56.679499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:56.679561Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbbe3564-5529c639-1982936c-e554efcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:56.679590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:56.679619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:56.679630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:56.679662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:56.679698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:56.679814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401837476830511:8466]
2025-10-15T11:00:56.679844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:56.679886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:56.680033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:56.680656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:56.680690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:56.680750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:56.678610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 869
2025-10-15T11:00:56.678696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 869, pipe: [1:7561401834677139689:8824]
2025-10-15T11:00:56.678767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 869
2025-10-15T11:00:56.681069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 870 partition: 0 MaxSeqNo: 46 sessionId: src_id|dbbe3564-5529c639-1982936c-e554efcf_0
2025-10-15T11:00:56.683558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87965e5a-5205227c-aef4d2bd-f66b9d45_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dbbe3564-5529c639-1982936c-e554efcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:56.702495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbe3564-5529c639-1982936c-e554efcf_0] Write session: try to update token
2025-10-15T11:00:56.702546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbe3564-5529c639-1982936c-e554efcf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:56.768129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:56.768160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:56.768172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:56.768182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:56.768213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401837476830511:8466]
2025-10-15T11:00:56.768237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401837476830511:8466]
2025-10-15T11:00:56.768260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401837476830511:8466]
2025-10-15T11:00:56.768463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:56.768475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:56.768485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:56.768491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:56.768529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:56.768537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:56.768555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:56.768557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:56.777216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:56.779503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId: src_id|dbbe3564-5529c639-1982936c-e554efcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:56.804112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:56.919244Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:56.939101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:56.939150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:56.939210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:56.939223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:56.939259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401837476830511:8466]
2025-10-15T11:00:56.939445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:56.939809Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:56.939900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:56.940022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401834677139689:8824]
2025-10-15T11:00:56.940061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:56.940082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:56.971509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 870 reason: error at write: Disconnected sessionId: src_id|dbbe3564-5529c639-1982936c-e554efcf_0
2025-10-15T11:00:56.971771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 870 sessionId: src_id|dbbe3564-5529c639-1982936c-e554efcf_0 is DEAD
2025-10-15T11:00:56.972201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbe3564-5529c639-1982936c-e554efcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:56.972286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbe3564-5529c639-1982936c-e554efcf_0] Write session will restart in 0.007529s
2025-10-15T11:00:56.972451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbe3564-5529c639-1982936c-e554efcf_0] Write session: Do CDS request
2025-10-15T11:00:56.972500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbe3564-5529c639-1982936c-e554efcf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:56.983992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:56.984021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 871
2025-10-15T11:00:56.984216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbe3564-5529c639-1982936c-e554efcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:56.984670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:56.984811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:56.984831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:56.984840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:56.986318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 871 sessionId:  describe result for acl check
2025-10-15T11:00:56.986403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:56.986409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:56.986414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:56.986424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401834677139768:9452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:56.988610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401834677139768:9452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:56.995918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401834677139768:9452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:57.002992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401834677139768:9452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:57.003028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401834677139768:9452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:57.003037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401834677139768:9452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:57.003058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:57.019775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:57.021397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:57.022084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:57.022101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:57.022131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:57.022321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:57.022452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401841771798016:8468]
2025-10-15T11:00:57.024534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:57.025219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:57.025376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:57.026409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:57.026720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.026735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.026743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.026750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.026758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.026765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.026772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.026780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.026789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.026795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.026803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.026810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.026818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.026826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.026873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.026976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.027022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.027069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.027115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.027169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.027221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.027271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.027324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.027388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.027435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.027488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.027534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.027579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.027636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.027702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.027758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.027809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.027855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.027906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.027948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.028001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.028064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.028119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.028193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.028246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.028292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.028352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.028403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.028464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.028518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.028578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.028642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.028702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.028757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.028813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.028863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.028918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.028969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.029027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.029085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.029137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.029677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:57.040243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401838972107215:8824]
2025-10-15T11:00:57.045774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:57.054826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:57.054870Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:57.054885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:57.054903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:57.054927Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 870 [2:7561401841771798016:8468]
2025-10-15T11:00:57.054978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:57.055033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:57.055047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:57.055059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:57.055069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:57.055110Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:57.055131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:57.055149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:57.056276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.056303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.056317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.056327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:57.056587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:57.056610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.056741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.056928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.057156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:57.057233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401834677139719:2467], now have 1 active actors on pipe
2025-10-15T11:00:57.057259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401838972107207:9452], now have 1 active actors on pipe
2025-10-15T11:00:57.057281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401838972107215:8824], now have 1 active actors on pipe
2025-10-15T11:00:57.057336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:57.057360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:57.057394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401841771798011:8468]
2025-10-15T11:00:57.057410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401841771798011:8468]
2025-10-15T11:00:57.057422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401841771798011:8468]
2025-10-15T11:00:57.057456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:57.057499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:57.057521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:57.057523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:57.057534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:57.057687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:57.057709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:57.057764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:57.057793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:57.057816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:57.057826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:57.057855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:57.057890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:57.058001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401841771798011:8468]
2025-10-15T11:00:57.058031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:57.058075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:57.058103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:57.058564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:57.058597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:57.058657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:57.056811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 870
2025-10-15T11:00:57.056835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 870
2025-10-15T11:00:57.056916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 870, pipe: [1:7561401838972107215:8824]
2025-10-15T11:00:57.058896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 871 partition: 0 MaxSeqNo: 46 sessionId: src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0
2025-10-15T11:00:57.059636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbbe3564-5529c639-1982936c-e554efcf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:57.094054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0] Write session: try to update token
2025-10-15T11:00:57.094106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:57.109930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:57.109958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:57.109989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401841771798011:8468]
2025-10-15T11:00:57.110097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:57.110117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:57.112114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:57.113384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:57.114672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:57.115868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:57.117677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:57.118147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:57.162127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:57.162156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:57.162169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:57.162180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:57.162215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401841771798011:8468]
2025-10-15T11:00:57.162238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401841771798011:8468]
2025-10-15T11:00:57.162259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401841771798011:8468]
2025-10-15T11:00:57.162399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:57.162418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:57.162429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:57.162434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:57.162462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:57.162469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:57.162486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:57.162497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:57.163537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:57.171416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId: src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:57.191676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:57.304482Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:57.306513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:57.306553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:57.307243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:57.307358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401838972107215:8824]
2025-10-15T11:00:57.307453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:57.307641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:57.307668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:57.319232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:57.319289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0] Write session will restart in 0.005987s
2025-10-15T11:00:57.319514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0] Write session: Do CDS request
2025-10-15T11:00:57.319582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:57.318515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 871 reason: error at write: Disconnected sessionId: src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0
2025-10-15T11:00:57.318870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 871 sessionId: src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0 is DEAD
2025-10-15T11:00:57.331803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:57.331576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:57.331636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 872
2025-10-15T11:00:57.333329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:57.333448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:57.333462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:57.333470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:57.334555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 872 sessionId:  describe result for acl check
2025-10-15T11:00:57.334638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:57.334648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:57.334655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:57.334670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401838972107242:9456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:57.337935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401838972107242:9456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:57.345644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401838972107242:9456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:57.356314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401838972107242:9456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:57.356356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401838972107242:9456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:57.356371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401838972107242:9456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:57.356399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:57.407873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401838972107423:8824]
2025-10-15T11:00:57.414170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:57.417367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:57.418170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:57.418195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:57.418228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:57.418434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:57.418595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401841771798244:8477]
2025-10-15T11:00:57.420855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:57.422318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:57.422495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:57.423808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:57.424103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.424110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.424116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.424123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.424128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.424135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.424140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.424147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.424153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.424159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.424166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.424172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.424178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.424184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.424223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.424314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.424356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.424398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.424438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.424480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.424531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.424573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.424613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.424655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.424696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.424738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.424778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.424819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.424858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.424915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.424964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.425028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.425075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.425122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.425163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.425209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.425255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.425302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.425343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.425391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.425432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.425477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.425517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.425564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.425608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.425655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.425696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.425742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.425783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.425829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.425872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.425918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.425959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.426005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.426045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.426088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.426540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:57.444999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:57.455050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:57.455094Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:57.455113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:57.455134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:57.455159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 871 [2:7561401841771798244:8477]
2025-10-15T11:00:57.455212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:57.455273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:57.455289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:57.455301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:57.455313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:57.455451Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:57.455474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:57.455496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:57.457441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.457469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.457484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.457495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:57.457762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:57.457787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.457932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.458127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.458364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:57.458435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401841771798238:8477]
2025-10-15T11:00:57.458460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401841771798238:8477]
2025-10-15T11:00:57.458472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401841771798238:8477]
2025-10-15T11:00:57.458513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:57.458592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:57.458668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:57.458694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:57.458706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:57.459218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 871
2025-10-15T11:00:57.459323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 871, pipe: [1:7561401838972107423:8824]
2025-10-15T11:00:57.459416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 871
2025-10-15T11:00:57.461328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 872 partition: 0 MaxSeqNo: 46 sessionId: src_id|30fac258-1044f511-7268725c-fae45beb_0
2025-10-15T11:00:57.462279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4622bd3-fd16bbc4-2df5f14d-4c2db4c4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|30fac258-1044f511-7268725c-fae45beb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:57.458781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:57.458808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:57.458923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401841771798238:8477]
2025-10-15T11:00:57.458943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:57.458973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:57.459035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401838972107229:2467], now have 1 active actors on pipe
2025-10-15T11:00:57.459062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401838972107423:8824], now have 1 active actors on pipe
2025-10-15T11:00:57.459083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401838972107273:9456], now have 1 active actors on pipe
2025-10-15T11:00:57.459906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:57.459930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:57.460036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30fac258-1044f511-7268725c-fae45beb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:57.460069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:57.460087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:57.460097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:57.460133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:57.460178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:57.460222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:57.460936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:57.460953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:57.461018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:57.488841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30fac258-1044f511-7268725c-fae45beb_0] Write session: try to update token
2025-10-15T11:00:57.488904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30fac258-1044f511-7268725c-fae45beb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:57.526779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:57.526817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:57.526851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401841771798238:8477]
2025-10-15T11:00:57.526988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:57.527329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:57.537677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:57.539106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:57.542249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:57.544772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:57.547333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:57.547890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:57.555856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:57.555888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:57.555900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:57.610368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:57.610404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:57.610420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:57.610432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:57.610473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401841771798238:8477]
2025-10-15T11:00:57.610499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401841771798238:8477]
2025-10-15T11:00:57.610524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401841771798238:8477]
2025-10-15T11:00:57.610663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:57.610685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:57.610958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:57.610992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:57.611029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:57.615897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:57.637666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId: src_id|30fac258-1044f511-7268725c-fae45beb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:57.660501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:57.756869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:57.764973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:57.765013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:57.765847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:57.767528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:57.767825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401838972107423:8824]
2025-10-15T11:00:57.767957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:57.819379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fac258-1044f511-7268725c-fae45beb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:57.819446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fac258-1044f511-7268725c-fae45beb_0] Write session will restart in 0.009541s
2025-10-15T11:00:57.819682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fac258-1044f511-7268725c-fae45beb_0] Write session: Do CDS request
2025-10-15T11:00:57.819754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fac258-1044f511-7268725c-fae45beb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:57.818592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 872 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30fac258-1044f511-7268725c-fae45beb_0
2025-10-15T11:00:57.818933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 872 sessionId: src_id|30fac258-1044f511-7268725c-fae45beb_0 is DEAD
2025-10-15T11:00:57.835437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30fac258-1044f511-7268725c-fae45beb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:57.840485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:57.840521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 873
2025-10-15T11:00:57.843064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:57.843187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:57.843203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:57.843212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:57.844909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 873 sessionId:  describe result for acl check
2025-10-15T11:00:57.845026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:57.845038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:57.845048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:57.845064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401838972107533:9468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:57.847945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401838972107533:9468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:57.861910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401838972107533:9468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:57.868393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401838972107633:8824]
2025-10-15T11:00:57.892657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401838972107533:9468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:57.892702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401838972107533:9468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:57.892719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401838972107533:9468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:57.892749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:57.906323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:57.916688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:57.917573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:57.917590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:57.917630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:57.917871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:57.918011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401841771798469:8485]
2025-10-15T11:00:57.920245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:57.922613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:57.923035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:57.924572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:57.924919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.924927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.924934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.924941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.924949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.924956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.924964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.924972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.924978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.924986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.924994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.925002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.925009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.925016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.925071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.925305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.925408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.925461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.925517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.925569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.925615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.925663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.925702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.925748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.925793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.925834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.925889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.925937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.925980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.926092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:57.926252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.926322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:57.926387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.926448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:57.926500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.926551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:57.926587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.926637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:57.926680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.926733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:57.926783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.926839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:57.926886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.926981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:57.927096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.927226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:57.927276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.928826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:57.928906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.928963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:57.929017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.929076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.929128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.929187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.929230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.929283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.929778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:57.956998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:57.995957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:57.996010Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:57.996026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:57.996043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:57.996067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 872 [2:7561401841771798469:8485]
2025-10-15T11:00:57.996121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:57.996196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:57.996213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:57.996225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:57.996237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:57.996289Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:57.996314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:57.996338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:57.997587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.997603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.997616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.997627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:57.997904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:57.997922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:57.998068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:57.998261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:57.998492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:57.998578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401841771798464:8485]
2025-10-15T11:00:57.998597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401841771798464:8485]
2025-10-15T11:00:57.998611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401841771798464:8485]
2025-10-15T11:00:57.998656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:57.998735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:57.998922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:57.998941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:57.999071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401841771798464:8485]
2025-10-15T11:00:57.999092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:57.999433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:57.999450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:57.999461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:57.999485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:58.003790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fac258-1044f511-7268725c-fae45beb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:58.000485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401838972107467:2467], now have 1 active actors on pipe
2025-10-15T11:00:58.000534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 872
2025-10-15T11:00:58.000525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401838972107664:9468], now have 1 active actors on pipe
2025-10-15T11:00:58.000551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401838972107633:8824], now have 1 active actors on pipe
2025-10-15T11:00:58.001191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:58.000651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 872
2025-10-15T11:00:58.001219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:58.000728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 872, pipe: [1:7561401838972107633:8824]
2025-10-15T11:00:58.001299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:58.003041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 873 partition: 0 MaxSeqNo: 46 sessionId: src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0
2025-10-15T11:00:58.001332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:58.001352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:58.001364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:58.001412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:58.001468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:58.001508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:58.002655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:58.002676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:58.002744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:58.038799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0] Write session: try to update token
2025-10-15T11:00:58.038854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:58.137255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:58.137290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:58.137303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:58.137363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:58.137378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:58.137393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:58.137404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:58.137437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401841771798464:8485]
2025-10-15T11:00:58.137456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401841771798464:8485]
2025-10-15T11:00:58.137471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401841771798464:8485]
2025-10-15T11:00:58.137618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:58.137656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:58.137679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:58.137687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:58.137703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:58.138763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:58.147141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId: src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:58.167263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:58.284728Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:58.293325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:58.293377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:58.293453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:58.293468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:58.293515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401841771798464:8485]
2025-10-15T11:00:58.293811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:58.294020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:58.294525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:58.294658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:58.295467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401838972107633:8824]
2025-10-15T11:00:58.327652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0
2025-10-15T11:00:58.327890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 873 sessionId: src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0 is DEAD
2025-10-15T11:00:58.328369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:58.328429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0] Write session will restart in 0.006120s
2025-10-15T11:00:58.328579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0] Write session: Do CDS request
2025-10-15T11:00:58.328637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:58.339036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:58.339074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 874
2025-10-15T11:00:58.339422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:58.339850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:58.339962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:58.339998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:58.340007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:58.341178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 874 sessionId:  describe result for acl check
2025-10-15T11:00:58.341277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:58.341294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:58.341302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:58.341318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401843267075018:9475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:58.343573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401843267075018:9475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:58.350887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401843267075018:9475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:58.366078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401843267075018:9475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:58.366124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401843267075018:9475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:58.366139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401843267075018:9475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:58.366167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:58.395498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401843267075192:8824]
2025-10-15T11:00:58.400411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:58.402526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:58.403285Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:58.403316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:58.403378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:58.403614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:58.403828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401846066765990:8490]
2025-10-15T11:00:58.405795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:58.412324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:58.412543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:58.413494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:58.413754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:58.413768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:58.413775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:58.413782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:58.413789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:58.413796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:58.413802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:58.413808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:58.413815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:58.413821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:58.413827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:58.413833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.413840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.413848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.413891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:58.413992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:58.414040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:58.414087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:58.414140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:58.414191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:58.414241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:58.414290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:58.414342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:58.414387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:58.414431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:58.414480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.414529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.414576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.414623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:58.414691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:58.414751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:58.414809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:58.414861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:58.414918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:58.414966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:58.415021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:58.415072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:58.415128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:58.415175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:58.415231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:58.415281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:58.415335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:58.415398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:58.415453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:58.415505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:58.415561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:58.415609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:58.415682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:58.415733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:58.415786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:58.415835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.415888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.415940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.415994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.416040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.416111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.416546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:58.433797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:58.446256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:58.446297Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:58.446313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:58.446331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:58.446358Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 873 [2:7561401846066765990:8490]
2025-10-15T11:00:58.446408Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:58.446459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:58.446477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:58.446489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:58.446498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:58.446542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:58.446568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:58.446589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:58.447677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.447701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.447713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.447723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:58.447944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:58.447955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.448044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.448158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.448316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:58.448359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401846066765985:8490]
2025-10-15T11:00:58.448368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401846066765985:8490]
2025-10-15T11:00:58.448376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401846066765985:8490]
2025-10-15T11:00:58.448404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:58.448448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:58.448540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:58.448554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:58.448566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:58.448571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:58.448581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:58.448657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401846066765985:8490]
2025-10-15T11:00:58.449079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 873, pipe: [1:7561401843267075192:8824]
2025-10-15T11:00:58.448669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:58.448787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:58.449192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 873
2025-10-15T11:00:58.448871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401843267075192:8824], now have 1 active actors on pipe
2025-10-15T11:00:58.449276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 873
2025-10-15T11:00:58.448897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401843267074994:2467], now have 1 active actors on pipe
2025-10-15T11:00:58.448916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401843267075117:9475], now have 1 active actors on pipe
2025-10-15T11:00:58.449626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:58.449652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:58.449716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f801e320-2f144965-ff4ab4c4-63561184_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:58.449749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:58.449770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:58.449779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:58.449826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:58.449871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:58.449928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:58.450396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:58.450418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:58.450475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:58.450719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 874 partition: 0 MaxSeqNo: 46 sessionId: src_id|f801e320-2f144965-ff4ab4c4-63561184_0
2025-10-15T11:00:58.451443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f5fea0d-73ac3961-79053f7d-1ed5021f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f801e320-2f144965-ff4ab4c4-63561184_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:58.478554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f801e320-2f144965-ff4ab4c4-63561184_0] Write session: try to update token
2025-10-15T11:00:58.478608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f801e320-2f144965-ff4ab4c4-63561184_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:58.542396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:58.542437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:58.542472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401846066765985:8490]
2025-10-15T11:00:58.542602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:58.542912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:58.545083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:58.547180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:58.557212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:58.576699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:58.578211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:58.579335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:58.583366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:58.583406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:58.583579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:58.645103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:58.645134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:58.645144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:58.645151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:58.645179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401846066765985:8490]
2025-10-15T11:00:58.645198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401846066765985:8490]
2025-10-15T11:00:58.645212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401846066765985:8490]
2025-10-15T11:00:58.645328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:58.645347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:58.645344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:58.645378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:58.645417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:58.646325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:58.666904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId: src_id|f801e320-2f144965-ff4ab4c4-63561184_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:58.692260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:58.792984Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:58.796739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:58.796793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:58.798193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:58.799478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:58.799693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:00:58.799830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401843267075192:8824]
2025-10-15T11:00:58.835473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 874 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f801e320-2f144965-ff4ab4c4-63561184_0
2025-10-15T11:00:58.835810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 874 sessionId: src_id|f801e320-2f144965-ff4ab4c4-63561184_0 is DEAD
2025-10-15T11:00:58.843567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f801e320-2f144965-ff4ab4c4-63561184_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:00:58.843613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f801e320-2f144965-ff4ab4c4-63561184_0] Write session will restart in 0.005457s
2025-10-15T11:00:58.843727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f801e320-2f144965-ff4ab4c4-63561184_0] Write session: Do CDS request
2025-10-15T11:00:58.843759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f801e320-2f144965-ff4ab4c4-63561184_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:58.853593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f801e320-2f144965-ff4ab4c4-63561184_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:58.853451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:58.853495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 875
2025-10-15T11:00:58.854126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:58.854268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:58.854286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:58.854297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:58.859200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 875 sessionId:  describe result for acl check
2025-10-15T11:00:58.859333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:58.859366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:58.859375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:58.859391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401843267075264:9481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:58.861760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401843267075264:9481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:58.872680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401843267075264:9481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:58.888245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401843267075264:9481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:58.888287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401843267075264:9481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:58.888302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401843267075264:9481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:58.888330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:58.900021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401843267075418:8824]
2025-10-15T11:00:58.912679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:58.914334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:58.915051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:58.915068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:58.915103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:58.915317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:58.915517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401846066766212:8499]
2025-10-15T11:00:58.917753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:58.918582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:58.918756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:58.919963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:58.920288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:58.920305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:58.920386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:58.920400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:58.920408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:58.920415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:58.920422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:58.920428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:58.920435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:58.920442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:58.920449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:58.920456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.920463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.920470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.920513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:58.920617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:58.920663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:58.920709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:58.920754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:58.920810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:58.920855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:58.920898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:58.920940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:58.920983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:58.921027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:58.921071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.921116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.921160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.921202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:58.921265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:58.921319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:58.921374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:58.921434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:58.921498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:58.921544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:58.921596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:58.921640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:58.921691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:58.921733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:58.921782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:58.921825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:58.921877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:58.921919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:58.921969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:58.922014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:58.922077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:58.922172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:58.922261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:58.922327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:58.922378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:58.922425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.922476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.922520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.922567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.922608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.922657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.923197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:58.954146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:58.964604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:58.964640Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:58.964655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:58.964672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:58.964694Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 874 [2:7561401846066766212:8499]
2025-10-15T11:00:58.964737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:58.964785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:58.964797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:58.964809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:58.964819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:58.964858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:58.964878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:58.964896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:58.967376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 874
2025-10-15T11:00:58.967487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 874, pipe: [1:7561401843267075418:8824]
2025-10-15T11:00:58.967573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 874
2025-10-15T11:00:58.970411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 875 partition: 0 MaxSeqNo: 46 sessionId: src_id|d6adcfae-3ab43d24-991f6353-177c338d_0
2025-10-15T11:00:58.971157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f801e320-2f144965-ff4ab4c4-63561184_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d6adcfae-3ab43d24-991f6353-177c338d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:58.966696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.966719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.966731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.966741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:58.966977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:58.966993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:58.967116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:58.967288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:58.967740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:58.967808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401843267075219:2467], now have 1 active actors on pipe
2025-10-15T11:00:58.967831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401843267075418:8824], now have 1 active actors on pipe
2025-10-15T11:00:58.967852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401843267075388:9481], now have 1 active actors on pipe
2025-10-15T11:00:58.967872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401846066766207:8499]
2025-10-15T11:00:58.967886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401846066766207:8499]
2025-10-15T11:00:58.967898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401846066766207:8499]
2025-10-15T11:00:58.967933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:58.968012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:58.968173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:58.968188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:58.968236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:58.968253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:58.968354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401846066766207:8499]
2025-10-15T11:00:58.968372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:58.968431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6adcfae-3ab43d24-991f6353-177c338d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:58.968457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:58.968471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:58.968480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:58.968509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:58.968541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:58.968643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:58.968738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:58.968753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:58.968764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:58.968789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:58.969992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:58.970023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:58.970091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:58.995956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6adcfae-3ab43d24-991f6353-177c338d_0] Write session: try to update token
2025-10-15T11:00:58.996020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6adcfae-3ab43d24-991f6353-177c338d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:59.024205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:59.024237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:59.024273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401846066766207:8499]
2025-10-15T11:00:59.024384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:59.024391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:59.028430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:59.030230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:59.040603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:59.044188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:59.046548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:59.047504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:59.089922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:59.089957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:59.089971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:59.090034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:59.090066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:59.090105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:59.090121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:59.090159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401846066766207:8499]
2025-10-15T11:00:59.090186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401846066766207:8499]
2025-10-15T11:00:59.090206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401846066766207:8499]
2025-10-15T11:00:59.090359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:59.090390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:59.090393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:59.090455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:59.090500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:59.092421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:59.152105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId: src_id|d6adcfae-3ab43d24-991f6353-177c338d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:59.171954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:59.248699Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:59.261191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:59.261242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:59.262116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:59.262273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401843267075418:8824]
2025-10-15T11:00:59.262353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:59.262365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:59.261937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:59.272455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 875 reason: error at write: Disconnected sessionId: src_id|d6adcfae-3ab43d24-991f6353-177c338d_0
2025-10-15T11:00:59.273239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6adcfae-3ab43d24-991f6353-177c338d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:59.273286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6adcfae-3ab43d24-991f6353-177c338d_0] Write session will restart in 0.009882s
2025-10-15T11:00:59.273475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6adcfae-3ab43d24-991f6353-177c338d_0] Write session: Do CDS request
2025-10-15T11:00:59.273521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6adcfae-3ab43d24-991f6353-177c338d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:59.272802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 875 sessionId: src_id|d6adcfae-3ab43d24-991f6353-177c338d_0 is DEAD
2025-10-15T11:00:59.288661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6adcfae-3ab43d24-991f6353-177c338d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:59.294501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:59.294542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 876
2025-10-15T11:00:59.295122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:59.295382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:59.295437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:59.295453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:59.297846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 876 sessionId:  describe result for acl check
2025-10-15T11:00:59.298042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:59.298064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:59.298084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:59.298110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401847562042764:9491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:59.301390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401847562042764:9491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:59.307512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401847562042764:9491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:59.315589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401847562042764:9491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:59.315637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401847562042764:9491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:59.315671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401847562042764:9491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:59.315706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:59.357621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:59.365110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401847562042951:8824]
2025-10-15T11:00:59.366401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:59.367242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:59.367272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:59.367316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:59.367595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:59.367804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401850361733744:8507]
2025-10-15T11:00:59.370028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:59.371008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:59.371240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:59.372610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:59.372946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:59.372963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:59.372971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:59.372978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:59.372986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:59.372993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:59.373000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:59.373008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:59.373015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:59.373023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:59.373029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:59.373048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.373056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.373063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.373114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:59.373233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:59.373283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:59.373330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:59.373380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:59.373435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:59.373481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:59.373526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:59.373574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:59.373627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:59.373673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:59.373726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.373778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.373829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.373881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:59.373958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:59.374023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:59.374082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:59.374136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:59.374192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:59.374235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:59.374273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:59.374310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:59.374354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:59.374398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:59.374459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:59.374509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:59.374570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:59.374620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:59.374674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:59.374726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:59.374783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:59.374833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:59.374891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:59.374945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:59.375004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:59.375056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.375107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.375142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.375183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.375214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.375255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.375769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:59.394003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:59.404247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:59.404292Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:59.404309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:59.404328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:59.404354Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 875 [2:7561401850361733744:8507]
2025-10-15T11:00:59.404407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:59.404467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:59.404481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:59.404492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:59.404504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:59.404552Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:59.404575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:59.404608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:59.406111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.406139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.406153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.406164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:59.406402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:59.406427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.406563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.406689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.406859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:59.406920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401847562042749:2467], now have 1 active actors on pipe
2025-10-15T11:00:59.406940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401847562042951:8824], now have 1 active actors on pipe
2025-10-15T11:00:59.406954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401847562042794:9491], now have 1 active actors on pipe
2025-10-15T11:00:59.406974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401850361733738:8507]
2025-10-15T11:00:59.406984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401850361733738:8507]
2025-10-15T11:00:59.406994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401850361733738:8507]
2025-10-15T11:00:59.407023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:59.407075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:59.407084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:59.407101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:59.407113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:59.407213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:59.407228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:59.407343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401850361733738:8507]
2025-10-15T11:00:59.407382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:59.407405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:59.407526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 875
2025-10-15T11:00:59.407877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:59.407908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:59.407973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:59.408001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:59.408013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:59.408020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:59.408048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:59.408051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 875
2025-10-15T11:00:59.408082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:59.408123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:59.408129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 875, pipe: [1:7561401847562042951:8824]
2025-10-15T11:00:59.408516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:59.408544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:59.408620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:59.408958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 876 partition: 0 MaxSeqNo: 46 sessionId: src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0
2025-10-15T11:00:59.409636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6adcfae-3ab43d24-991f6353-177c338d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:59.430596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0] Write session: try to update token
2025-10-15T11:00:59.430654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:59.488489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:00:59.488521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:59.488558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401850361733738:8507]
2025-10-15T11:00:59.488668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:00:59.488742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:00:59.490724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:00:59.492043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:59.493375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:59.495060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:00:59.497536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:00:59.499557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId: src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:00:59.520103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:00:59.520274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:59.520296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:59.520306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:59.520350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:59.520360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:59.520372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:59.520380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:59.520407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401850361733738:8507]
2025-10-15T11:00:59.520429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401850361733738:8507]
2025-10-15T11:00:59.520455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401850361733738:8507]
2025-10-15T11:00:59.520596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:59.520602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:59.520624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:59.520633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:59.520658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:59.521609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:59.536712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:00:59.670533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:00:59.672246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:59.672277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:59.676483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:00:59.675633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:00:59.675842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401847562042951:8824]
2025-10-15T11:00:59.675931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:00:59.675946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:00:59.687752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 876 reason: error at write: Disconnected sessionId: src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0
2025-10-15T11:00:59.688558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:00:59.688088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 876 sessionId: src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0 is DEAD
2025-10-15T11:00:59.688614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0] Write session will restart in 0.008496s
2025-10-15T11:00:59.688752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0] Write session: Do CDS request
2025-10-15T11:00:59.688784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:00:59.712149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:59.711177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:00:59.711226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 877
2025-10-15T11:00:59.715165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:00:59.715314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:00:59.715331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:00:59.715342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:00:59.717599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 877 sessionId:  describe result for acl check
2025-10-15T11:00:59.717717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:00:59.717728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:00:59.717737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:00:59.717756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401847562042995:9500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:00:59.720387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401847562042995:9500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:00:59.741109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401847562042995:9500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:00:59.765848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401847562042995:9500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:00:59.765891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401847562042995:9500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:00:59.765909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401847562042995:9500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:00:59.765940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:00:59.776535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401847562043118:8824]
2025-10-15T11:00:59.802432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:00:59.806935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:00:59.807851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:00:59.807877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:00:59.807919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:00:59.808161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:00:59.808349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401850361733962:8512]
2025-10-15T11:00:59.810727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:00:59.811884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:00:59.812095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:00:59.813632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:00:59.813974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:59.813994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:59.814001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:59.814009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:59.814017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:59.814023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:59.814030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:59.814037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:59.814043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:59.814049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:59.814055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:59.814064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.814070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.814082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.814158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:59.814367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:59.814417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:59.814469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:59.814522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:59.814570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:59.814617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:59.814670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:59.814715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:59.814768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:59.814817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:59.814866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.814910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.814953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.814997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:59.815062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:00:59.815121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:59.815182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:00:59.815228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:59.815320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:00:59.815419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:59.815561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:00:59.815619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:59.815688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:00:59.815748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:59.815802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:00:59.815848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:59.815908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:00:59.815951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:59.816013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:00:59.816065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:59.816123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:00:59.816171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:59.816305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:00:59.816409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:59.816513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:00:59.816594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.816653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.816704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.816760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.816809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.816865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.817357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:00:59.835116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:00:59.843883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:00:59.843925Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:00:59.843942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:00:59.843960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:00:59.843986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 876 [2:7561401850361733962:8512]
2025-10-15T11:00:59.844036Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:00:59.844091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:00:59.844104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:59.844115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:59.844127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:59.844171Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:00:59.844193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:00:59.844212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:00:59.863270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.863289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.863295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.863301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:00:59.863545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:00:59.863567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:00:59.863682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:00:59.863836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:00:59.863862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 876, pipe: [1:7561401847562043118:8824]
2025-10-15T11:00:59.863876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 876
2025-10-15T11:00:59.863976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 876
2025-10-15T11:00:59.864032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:00:59.864089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401847562042979:2467], now have 1 active actors on pipe
2025-10-15T11:00:59.864106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401847562043118:8824], now have 1 active actors on pipe
2025-10-15T11:00:59.864118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401847562043091:9500], now have 1 active actors on pipe
2025-10-15T11:00:59.864135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401850361733957:8512]
2025-10-15T11:00:59.864146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401850361733957:8512]
2025-10-15T11:00:59.864157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401850361733957:8512]
2025-10-15T11:00:59.864190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:00:59.864222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:00:59.864235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:00:59.864245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:00:59.864263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:59.864280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:59.864334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:00:59.864494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:00:59.864512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:00:59.864638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:00:59.864668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:59.864684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:59.864693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:00:59.864725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:59.864761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:00:59.864797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401850361733957:8512]
2025-10-15T11:00:59.864826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:00:59.864880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:00:59.864906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:59.865444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:00:59.865468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:00:59.865524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:00:59.865861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 877 partition: 0 MaxSeqNo: 46 sessionId: src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0
2025-10-15T11:00:59.866678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbb544c-443dca32-4e616a8b-a1e11fa4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:00:59.890968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0] Write session: try to update token
2025-10-15T11:00:59.891019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:00:59.952575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:00:59.952609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:00:59.952622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:00:59.952685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:00:59.952701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:00:59.952714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:00:59.952724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:00:59.952758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401850361733957:8512]
2025-10-15T11:00:59.952785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401850361733957:8512]
2025-10-15T11:00:59.952808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401850361733957:8512]
2025-10-15T11:00:59.952935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:00:59.952964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:00:59.952967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:00:59.952987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:00:59.952994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:00:59.954056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:00:59.975123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId: src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:00.007489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:00.110472Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:00.113177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:00.113221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:00.116811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401847562043118:8824]
2025-10-15T11:01:00.116937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:00.116958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:00.118194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:00.125872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 877 reason: error at write: Disconnected sessionId: src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0
2025-10-15T11:01:00.126232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 877 sessionId: src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0 is DEAD
2025-10-15T11:01:00.127822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:00.127868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0] Write session will restart in 0.009768s
2025-10-15T11:01:00.127975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0] Write session: Do CDS request
2025-10-15T11:01:00.128008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:00.143709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:00.152011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:00.152060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 878
2025-10-15T11:01:00.152709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:00.153395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:00.153601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:00.153631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:00.153649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:00.155895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 878 sessionId:  describe result for acl check
2025-10-15T11:01:00.156066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:00.156087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:00.156105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:00.156133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401851857010519:9506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:00.160027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401851857010519:9506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:00.174987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401851857010519:9506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:00.188973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401851857010519:9506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:00.189022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401851857010519:9506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:00.189039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401851857010519:9506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:00.189070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:00.217213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401851857010600:8824]
2025-10-15T11:01:00.283022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:00.284341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:00.285008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:00.285020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:00.285050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:00.285244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:00.285388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401854656701493:8520]
2025-10-15T11:01:00.286715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:00.287627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:00.287824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:00.288806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:00.289058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:00.289065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:00.289069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:00.289074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:00.289079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:00.289082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:00.289087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:00.289091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:00.289096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:00.289100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:00.289105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:00.289109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.289114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.289118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.289152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:00.289227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:00.289259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:00.289291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:00.289322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:00.289356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:00.289385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:00.289416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:00.289446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:00.289477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:00.289507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:00.289538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.289569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.289597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.289622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:00.289682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:00.289725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:00.289767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:00.289800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:00.289836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:00.289866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:00.289903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:00.289933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:00.289966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:00.289996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:00.290030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:00.290058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:00.290092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:00.290122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:00.290157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:00.290190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:00.290224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:00.290251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:00.290285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:00.290315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:00.290348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:00.290378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.290409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.290436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.290473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.290501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.290537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.290927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:00.314649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:00.325442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:00.325501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:00.325520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:00.325542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:00.325571Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 877 [2:7561401854656701493:8520]
2025-10-15T11:01:00.325633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:00.325709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:00.325727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:00.325741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:00.325757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:00.325813Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:00.325840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:00.325866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:00.333807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.333844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.333859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.333871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:00.334167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:00.334186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.334345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.334536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.334702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:00.334754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401854656701488:8520]
2025-10-15T11:01:00.334766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401854656701488:8520]
2025-10-15T11:01:00.334777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401854656701488:8520]
2025-10-15T11:01:00.334809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:00.334862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:00.335010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:00.335022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:00.335121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401854656701488:8520]
2025-10-15T11:01:00.335134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:00.335700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:00.335721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:00.335732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:00.335732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401851857010510:2467], now have 1 active actors on pipe
2025-10-15T11:01:00.335757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:00.335759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401851857010555:9506], now have 1 active actors on pipe
2025-10-15T11:01:00.335783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401851857010600:8824], now have 1 active actors on pipe
2025-10-15T11:01:00.336321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 877
2025-10-15T11:01:00.336347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 877
2025-10-15T11:01:00.336420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 877, pipe: [1:7561401851857010600:8824]
2025-10-15T11:01:00.337661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:00.337704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:00.337812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:00.337852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:00.337873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:00.337899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:00.337946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:00.337996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:00.338051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:00.338579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:00.338606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:00.338674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:00.338977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 878 partition: 0 MaxSeqNo: 46 sessionId: src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0
2025-10-15T11:01:00.341198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2cd9c39-e8397c79-2c56c0d5-f3b78875_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:00.369797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0] Write session: try to update token
2025-10-15T11:01:00.369857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:00.438005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:00.438039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:00.438050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:00.438059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:00.438091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401854656701488:8520]
2025-10-15T11:01:00.438117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401854656701488:8520]
2025-10-15T11:01:00.438144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401854656701488:8520]
2025-10-15T11:01:00.438365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:00.438384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:00.438394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:00.438439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:00.438461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:00.439594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:00.439597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:00.439644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:00.439678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:00.463278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId: src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:00.484153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:00.597654Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:00.609673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:00.609730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:00.609815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:00.609830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:00.609875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401854656701488:8520]
2025-10-15T11:01:00.610536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:00.611578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:00.610864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:00.610895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:00.632363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 878 reason: error at write: Disconnected sessionId: src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0
2025-10-15T11:01:00.632723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 878 sessionId: src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0 is DEAD
2025-10-15T11:01:00.633086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:00.633139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0] Write session will restart in 0.009684s
2025-10-15T11:01:00.633296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0] Write session: Do CDS request
2025-10-15T11:01:00.633344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:00.650246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:00.653735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401851857010600:8824]
2025-10-15T11:01:00.653919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:00.654047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:00.654061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 879
2025-10-15T11:01:00.654448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:00.654576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:00.654600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:00.654610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:00.655927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 879 sessionId:  describe result for acl check
2025-10-15T11:01:00.656056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:00.656074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:00.656085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:00.656106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401851857010770:9516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:00.658363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401851857010770:9516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:00.665638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401851857010770:9516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:00.681442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401851857010770:9516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:00.681493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401851857010770:9516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:00.681510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401851857010770:9516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:00.681541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:00.700361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:00.702537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:00.703497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:00.703528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:00.703572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:00.703863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:00.704060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401854656701721:8529]
2025-10-15T11:01:00.706316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:00.707341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:00.707616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:00.709010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:00.709357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:00.709371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:00.709380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:00.709388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:00.709396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:00.709402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:00.709409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:00.709415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:00.709424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:00.709431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:00.709438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:00.709445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.709452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.709459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.709509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:00.709630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:00.709692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:00.709742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:00.709789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:00.709836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:00.709880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:00.709927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:00.709982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:00.710033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:00.710102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:00.710155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.710207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.710258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.710309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:00.710398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:00.710471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:00.710536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:00.710592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:00.710648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:00.710709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:00.710770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:00.710824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:00.710888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:00.710939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:00.710996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:00.711046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:00.711102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:00.711151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:00.711205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:00.711256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:00.711312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:00.711381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:00.711438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:00.711494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:00.711551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:00.711594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.711650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.711713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.711769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.711813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.711869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.712417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:00.730080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:00.741042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:00.741087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:00.741104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:00.741123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:00.741146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 878 [2:7561401854656701721:8529]
2025-10-15T11:01:00.741196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:00.741250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:00.741265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:00.741277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:00.741288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:00.741337Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:00.741359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:00.741381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:00.751294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.751323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.751337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.751366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:00.751654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:00.751695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:00.751835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:00.752027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:00.752255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:00.752331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401851857010896:9516], now have 1 active actors on pipe
2025-10-15T11:01:00.752354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401851857010759:2467], now have 1 active actors on pipe
2025-10-15T11:01:00.752378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401854656701716:8529]
2025-10-15T11:01:00.752391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401854656701716:8529]
2025-10-15T11:01:00.752405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401854656701716:8529]
2025-10-15T11:01:00.752442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:00.752510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:00.752697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:00.752714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:00.752824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401854656701716:8529]
2025-10-15T11:01:00.752843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:00.753389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:00.753401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:00.753413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:00.753437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:00.754160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:00.754190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:00.754277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f260199-17913737-211dd108-d81452f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:00.754306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:00.754324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:00.754335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:00.751971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 878
2025-10-15T11:01:00.754366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:00.752078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 878
2025-10-15T11:01:00.754410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:00.754458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:00.755240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:00.755265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:00.755329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:00.755662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 879 partition: 0 MaxSeqNo: 46 sessionId: src_id|3f260199-17913737-211dd108-d81452f_0
2025-10-15T11:01:00.756119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401851857010956:8824]
2025-10-15T11:01:00.756732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941f73af-e12c9347-4c8c6f0c-b1f73979_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3f260199-17913737-211dd108-d81452f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:00.759545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401851857010956:8824], now have 1 active actors on pipe
2025-10-15T11:01:00.759655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 878, pipe: [1:7561401851857010956:8824]
2025-10-15T11:01:00.782222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f260199-17913737-211dd108-d81452f_0] Write session: try to update token
2025-10-15T11:01:00.782285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f260199-17913737-211dd108-d81452f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:00.885566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:00.885606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:00.885620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:00.885632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:00.885669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401854656701716:8529]
2025-10-15T11:01:00.885694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401854656701716:8529]
2025-10-15T11:01:00.885717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401854656701716:8529]
2025-10-15T11:01:00.885855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:00.885889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:00.885897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:00.885902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:00.885913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:00.885926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:00.886011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:00.886036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:00.896276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:00.899731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId: src_id|3f260199-17913737-211dd108-d81452f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:00.922061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:01.035166Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:01.045044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:01.045093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:01.045167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:01.045181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:01.045221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401854656701716:8529]
2025-10-15T11:01:01.045403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:01.045722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401851857010956:8824]
2025-10-15T11:01:01.045817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:01.045835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:01.045854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:01.047081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:01.103879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 879 reason: error at write: Disconnected sessionId: src_id|3f260199-17913737-211dd108-d81452f_0
2025-10-15T11:01:01.104194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 879 sessionId: src_id|3f260199-17913737-211dd108-d81452f_0 is DEAD
2025-10-15T11:01:01.106557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f260199-17913737-211dd108-d81452f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:01.106643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f260199-17913737-211dd108-d81452f_0] Write session will restart in 0.006563s
2025-10-15T11:01:01.106813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f260199-17913737-211dd108-d81452f_0] Write session: Do CDS request
2025-10-15T11:01:01.106880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f260199-17913737-211dd108-d81452f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:01.117967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:01.118223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f260199-17913737-211dd108-d81452f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:01.117998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 880
2025-10-15T11:01:01.118763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:01.118894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:01.118908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:01.118917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:01.120063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 880 sessionId:  describe result for acl check
2025-10-15T11:01:01.120159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:01.120165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:01.120171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:01.120182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401856151978424:9525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:01.122860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401856151978424:9525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:01.132122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401856151978424:9525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:01.141002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401856151978424:9525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:01.141047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401856151978424:9525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:01.141063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401856151978424:9525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:01.141094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:01.145948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401856151978490:8824]
2025-10-15T11:01:01.148773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:01.150930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:01.151704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:01.151731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:01.151773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:01.152020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:01.152216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401858951669237:8533]
2025-10-15T11:01:01.154167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:01.155181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:01.155414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:01.156690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:01.157023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:01.157031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:01.157038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:01.157045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:01.157051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:01.157057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:01.157065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:01.157071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:01.157078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:01.157084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:01.157091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:01.157098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.157105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.157111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.157157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:01.157260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:01.157315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:01.157357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:01.157404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:01.157449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:01.157491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:01.157534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:01.157576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:01.157623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:01.157667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:01.157710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.157751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.157792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.157835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:01.157897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:01.157953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:01.158004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:01.158050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:01.158103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:01.158145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:01.158193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:01.158238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:01.158286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:01.158331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:01.158393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:01.158439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:01.158490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:01.158533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:01.158584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:01.158630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:01.158679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:01.158722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:01.158770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:01.158815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:01.158865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:01.158910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.158961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.159005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.159058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.159102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.159153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.160811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:01.190472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:01.200345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:01.200390Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:01.200408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:01.200426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:01.200452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 879 [2:7561401858951669237:8533]
2025-10-15T11:01:01.200504Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:01.200559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:01.200573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:01.200584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:01.200594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:01.200637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:01.200658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:01.200676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:01.202339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.202369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.202382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.202392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:01.202657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:01.202680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.202811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.202987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.203225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:01.203295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401858951669232:8533]
2025-10-15T11:01:01.203315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401858951669232:8533]
2025-10-15T11:01:01.203326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401858951669232:8533]
2025-10-15T11:01:01.203381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:01.203448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:01.203618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:01.203638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:01.203761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401858951669232:8533]
2025-10-15T11:01:01.203785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:01.204013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:01.204034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:01.204043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:01.204063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:01.204789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401856151978490:8824], now have 1 active actors on pipe
2025-10-15T11:01:01.204822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401856151978489:9525], now have 1 active actors on pipe
2025-10-15T11:01:01.204941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 879, pipe: [1:7561401856151978490:8824]
2025-10-15T11:01:01.204841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401856151978285:2467], now have 1 active actors on pipe
2025-10-15T11:01:01.204997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 879
2025-10-15T11:01:01.205039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 879
2025-10-15T11:01:01.205972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:01.206002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:01.206078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:01.206113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:01.206129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:01.206138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:01.206169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:01.206211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:01.206262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:01.206893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:01.206923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:01.206990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:01.207385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 880 partition: 0 MaxSeqNo: 46 sessionId: src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0
2025-10-15T11:01:01.208264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f260199-17913737-211dd108-d81452f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:01.230053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0] Write session: try to update token
2025-10-15T11:01:01.230118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:01.300781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:01.300809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:01.300822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:01.300839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:01.300869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401858951669232:8533]
2025-10-15T11:01:01.300894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401858951669232:8533]
2025-10-15T11:01:01.300914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401858951669232:8533]
2025-10-15T11:01:01.301027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:01.301065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:01.301099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:01.301113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:01.301132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:01.302237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:01.333287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId: src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:01.371101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:01.459715Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:01.496110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:01.496151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:01.496214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:01.496227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:01.496262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401858951669232:8533]
2025-10-15T11:01:01.496492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:01.496852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:01.499505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:01.499526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401856151978490:8824]
2025-10-15T11:01:01.499666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:01.513839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 880 reason: status is not ok: tablet will be restarted right now sessionId: src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0
2025-10-15T11:01:01.514335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 880 sessionId: src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0 is DEAD
2025-10-15T11:01:01.519619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:01.519669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0] Write session will restart in 0.006629s
2025-10-15T11:01:01.519801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0] Write session: Do CDS request
2025-10-15T11:01:01.519837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:01.533640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:01.532756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:01.532798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 881
2025-10-15T11:01:01.534243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:01.534376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:01.534394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:01.534405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:01.535809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 881 sessionId:  describe result for acl check
2025-10-15T11:01:01.535925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:01.535937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:01.535946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:01.535962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401856151978526:9529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:01.538456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401856151978526:9529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:01.546748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401856151978526:9529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:01.558287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401856151978526:9529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:01.558329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401856151978526:9529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:01.558343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401856151978526:9529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:01.558369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:01.586448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:01.594871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:01.595715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:01.595733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:01.595774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:01.596012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:01.596187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401858951669477:8536]
2025-10-15T11:01:01.598204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:01.600511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401856151978719:8824]
2025-10-15T11:01:01.600315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:01.600549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:01.601826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:01.602139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:01.602146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:01.602153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:01.602160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:01.602166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:01.602172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:01.602179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:01.602185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:01.602192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:01.602198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:01.602204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:01.602211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.602218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.602224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.602267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:01.602367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:01.602412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:01.602454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:01.602493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:01.602534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:01.602572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:01.602611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:01.602652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:01.602691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:01.602731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:01.602770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.602810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.602849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.602891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:01.602951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:01.603004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:01.603054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:01.603095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:01.603144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:01.604318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:01.604398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:01.604461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:01.604542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:01.604594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:01.604652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:01.604704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:01.604756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:01.604801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:01.604854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:01.604900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:01.604954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:01.604998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:01.605051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:01.605091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:01.605141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:01.605183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.605234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.605278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.605326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.605369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.605417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.605879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:01.629909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:01.669864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:01.669906Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:01.669920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:01.669934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:01.669956Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 880 [2:7561401858951669477:8536]
2025-10-15T11:01:01.669998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:01.670045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:01.670056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:01.670066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:01.670075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:01.670114Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:01.670132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:01.670151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:01.678249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.678278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.678290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.678298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:01.678531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:01.678546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:01.678656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:01.678808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:01.678993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:01.679049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401858951669472:8536]
2025-10-15T11:01:01.679061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401858951669472:8536]
2025-10-15T11:01:01.679072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401858951669472:8536]
2025-10-15T11:01:01.679106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:01.679167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:01.679307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:01.679320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:01.679892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:01.679909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:01.679919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:01.680148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 880, pipe: [1:7561401856151978719:8824]
2025-10-15T11:01:01.680277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 880
2025-10-15T11:01:01.680302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 880
2025-10-15T11:01:01.680281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401858951669472:8536]
2025-10-15T11:01:01.680311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:01.680356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401856151978719:8824], now have 1 active actors on pipe
2025-10-15T11:01:01.680358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:01.680377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401856151978628:9529], now have 1 active actors on pipe
2025-10-15T11:01:01.680396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401856151978512:2467], now have 1 active actors on pipe
2025-10-15T11:01:01.680836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:01.680860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:01.680934Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:01.680960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:01.680975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:01.680983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:01.681014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:01.681050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:01.681090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:01.685057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:01.685086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:01.685154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:01.685607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 881 partition: 0 MaxSeqNo: 46 sessionId: src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0
2025-10-15T11:01:01.689485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85d2d9fe-7e141e0c-9ed2f772-d5d47680_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:01.780605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0] Write session: try to update token
2025-10-15T11:01:01.780660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:01.812097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:01.812131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:01.812142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:01.812152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:01.812186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401858951669472:8536]
2025-10-15T11:01:01.812211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401858951669472:8536]
2025-10-15T11:01:01.812235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401858951669472:8536]
2025-10-15T11:01:01.812378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:01.812390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:01.812403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:01.812494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:01.812513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:01.814240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:01.814284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:01.814312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:01.827955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:01.906241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId: src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:01.944830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:01.977575Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:01.991737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:01.991781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:01.991836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:01.991852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:01.991888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401858951669472:8536]
2025-10-15T11:01:01.992489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:01.995601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401856151978719:8824]
2025-10-15T11:01:01.995785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:01.993415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:02.007848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 881 reason: status is not ok: tablet will be restarted right now sessionId: src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0
2025-10-15T11:01:02.008152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 881 sessionId: src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0 is DEAD
2025-10-15T11:01:02.023204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:02.023266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0] Write session will restart in 0.007074s
2025-10-15T11:01:02.023462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0] Write session: Do CDS request
2025-10-15T11:01:02.023551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:02.025939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:02.040247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:02.040284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 882
2025-10-15T11:01:02.044326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:02.047979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:02.048141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:02.048157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:02.048167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:02.049437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 882 sessionId:  describe result for acl check
2025-10-15T11:01:02.049540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:02.049551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:02.049559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:02.049575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401860446946076:9541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:02.051863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401860446946076:9541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:02.060938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401860446946076:9541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:02.076010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401860446946076:9541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:02.076055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401860446946076:9541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:02.076070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401860446946076:9541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:02.076098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:02.097204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401860446946166:8824]
2025-10-15T11:01:02.132466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:02.139407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:02.140035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:02.140045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:02.140070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:02.140222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:02.140334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401863246637005:8545]
2025-10-15T11:01:02.141696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:02.142595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:02.142718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:02.143523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:02.143775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:02.143798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:02.143805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:02.143812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:02.143818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:02.143824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:02.143830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:02.143836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:02.143841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:02.143845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:02.143850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:02.143854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.143858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.143862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.143892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:02.143964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:02.144004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:02.144048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:02.144084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:02.144113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:02.144148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:02.144190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:02.144231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:02.144274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:02.144315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:02.144354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.144392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.144435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.144471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:02.144528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:02.144580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:02.144631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:02.144674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:02.144722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:02.144762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:02.144809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:02.144850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:02.144897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:02.144937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:02.144981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:02.145021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:02.145056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:02.145082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:02.145113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:02.145141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:02.145182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:02.145215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:02.145248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:02.145276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:02.145309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:02.145349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.145380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.145410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.145442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.145469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.145500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.145887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:02.166703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:02.177944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:02.178139Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:02.178160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:02.178176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:02.178199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 881 [2:7561401863246637005:8545]
2025-10-15T11:01:02.178248Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:02.178299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:02.178312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:02.178323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:02.178333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:02.178378Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:02.178413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:02.178433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:02.180112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.180129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.180142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.180153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:02.180408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:02.180426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.180554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.180731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.180949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:02.181040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401863246637000:8545]
2025-10-15T11:01:02.181056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401863246637000:8545]
2025-10-15T11:01:02.181068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401863246637000:8545]
2025-10-15T11:01:02.181107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:02.181174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:02.181337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:02.181354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:02.181462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401863246637000:8545]
2025-10-15T11:01:02.181482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:02.182550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:02.182569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:02.182580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:02.182602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:02.183913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401860446946112:9541], now have 1 active actors on pipe
2025-10-15T11:01:02.183947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401860446946067:2467], now have 1 active actors on pipe
2025-10-15T11:01:02.183986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401860446946166:8824], now have 1 active actors on pipe
2025-10-15T11:01:02.184454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:02.183945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 881
2025-10-15T11:01:02.184485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:02.184578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:02.184057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 881
2025-10-15T11:01:02.184608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:02.184128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 881, pipe: [1:7561401860446946166:8824]
2025-10-15T11:01:02.184626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:02.184637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:02.184671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:02.184708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:02.184758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:02.186261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:02.186291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:02.186383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:02.186838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 882 partition: 0 MaxSeqNo: 46 sessionId: src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0
2025-10-15T11:01:02.187722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|143c26a8-59e0e416-adc3e9ca-2bd3b899_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:02.240980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0] Write session: try to update token
2025-10-15T11:01:02.241045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:02.321058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:02.321091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:02.321106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:02.321117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:02.321150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401863246637000:8545]
2025-10-15T11:01:02.321177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401863246637000:8545]
2025-10-15T11:01:02.321199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401863246637000:8545]
2025-10-15T11:01:02.321317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:02.321352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:02.321363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:02.321373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:02.321379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:02.321407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:02.321464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:02.321491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:02.322502Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:02.343009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId: src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:02.364364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:02.472647Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:02.482918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:02.482960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:02.483031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:02.483045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:02.483080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401863246637000:8545]
2025-10-15T11:01:02.483253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:02.483616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:02.483904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401860446946166:8824]
2025-10-15T11:01:02.483999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:02.484120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:02.496661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 882 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0
2025-10-15T11:01:02.497024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 882 sessionId: src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0 is DEAD
2025-10-15T11:01:02.497545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:02.497622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0] Write session will restart in 0.008931s
2025-10-15T11:01:02.497820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0] Write session: Do CDS request
2025-10-15T11:01:02.497882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:02.516366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:02.516150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:02.516204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 883
2025-10-15T11:01:02.518151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:02.518317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:02.518332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:02.518342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:02.520261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 883 sessionId:  describe result for acl check
2025-10-15T11:01:02.520374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:02.520384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:02.520393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:02.520410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401860446946316:9548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:02.522952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401860446946316:9548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:02.539041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401860446946316:9548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:02.555561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401860446946316:9548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:02.555609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401860446946316:9548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:02.555628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401860446946316:9548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:02.555661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:02.585915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401860446946473:8824]
2025-10-15T11:01:02.620593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:02.623179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:02.624136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:02.624170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:02.624218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:02.624515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:02.624741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401863246637241:8555]
2025-10-15T11:01:02.627217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:02.628643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:02.628878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:02.630250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:02.630586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:02.630607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:02.630617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:02.630624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:02.630632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:02.630640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:02.630648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:02.630657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:02.630664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:02.630672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:02.630679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:02.630687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.630694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.630702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.630754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:02.630875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:02.630928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:02.630980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:02.631029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:02.631081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:02.631131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:02.631182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:02.631231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:02.631285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:02.631332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:02.631399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.631452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.631503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.631556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:02.631632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:02.631712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:02.631775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:02.631829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:02.631888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:02.631939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:02.631998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:02.632052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:02.632114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:02.632165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:02.633401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:02.633482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:02.633553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:02.633605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:02.633666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:02.633721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:02.633780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:02.633831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:02.633893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:02.633947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:02.634005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:02.634053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.634116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.634170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.634229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.634277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.634335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.634889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:02.653372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:02.662369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:02.662426Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:02.662445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:02.662469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:02.662500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 882 [2:7561401863246637241:8555]
2025-10-15T11:01:02.662560Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:02.662627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:02.662659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:02.662682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:02.662697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:02.662756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:02.662781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:02.662805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:02.664025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.664052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.664066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.664079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:02.664812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 882, pipe: [1:7561401860446946473:8824]
2025-10-15T11:01:02.664853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 882
2025-10-15T11:01:02.664900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 882
2025-10-15T11:01:02.664401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:02.664427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:02.664590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:02.664806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:02.665068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:02.665160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401860446946302:2467], now have 1 active actors on pipe
2025-10-15T11:01:02.665187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401860446946473:8824], now have 1 active actors on pipe
2025-10-15T11:01:02.665213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401860446946393:9548], now have 1 active actors on pipe
2025-10-15T11:01:02.665243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401863246637236:8555]
2025-10-15T11:01:02.665259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401863246637236:8555]
2025-10-15T11:01:02.665274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401863246637236:8555]
2025-10-15T11:01:02.665316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:02.665354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:02.665369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:02.665383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:02.665405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:02.665607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:02.665633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:02.665710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:02.665733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:02.665865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401863246637236:8555]
2025-10-15T11:01:02.665903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:02.665925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:02.665984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef14be57-eda8441c-b3940aae-20b84523_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:02.666018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:02.666039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:02.666051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:02.666094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:02.666151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:02.666346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:02.667071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:02.667791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 883 partition: 0 MaxSeqNo: 46 sessionId: src_id|ef14be57-eda8441c-b3940aae-20b84523_0
2025-10-15T11:01:02.672624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57cfa218-59c73d6f-5a7159a3-d0ea5dba_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ef14be57-eda8441c-b3940aae-20b84523_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:02.667183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:02.667267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:02.707445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef14be57-eda8441c-b3940aae-20b84523_0] Write session: try to update token
2025-10-15T11:01:02.707509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef14be57-eda8441c-b3940aae-20b84523_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:02.780946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:02.780986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:02.781005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:02.781019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:02.781059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401863246637236:8555]
2025-10-15T11:01:02.781092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401863246637236:8555]
2025-10-15T11:01:02.781121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401863246637236:8555]
2025-10-15T11:01:02.781291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:02.781308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:02.781347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:02.781369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:02.781375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:02.781431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:02.805634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:02.805680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:02.806715Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:02.859535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId: src_id|ef14be57-eda8441c-b3940aae-20b84523_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:02.893573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:02.964469Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:02.976084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:02.976118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:02.976167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401863246637236:8555]
2025-10-15T11:01:02.976319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:02.976334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:02.976359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:02.977221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:02.977238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:02.977415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401860446946473:8824]
2025-10-15T11:01:02.977487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:02.977499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:03.009493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 883 reason: error at write: Disconnected sessionId: src_id|ef14be57-eda8441c-b3940aae-20b84523_0
2025-10-15T11:01:03.009810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 883 sessionId: src_id|ef14be57-eda8441c-b3940aae-20b84523_0 is DEAD
2025-10-15T11:01:03.010866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef14be57-eda8441c-b3940aae-20b84523_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:03.010938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef14be57-eda8441c-b3940aae-20b84523_0] Write session will restart in 0.009146s
2025-10-15T11:01:03.011124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef14be57-eda8441c-b3940aae-20b84523_0] Write session: Do CDS request
2025-10-15T11:01:03.011181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef14be57-eda8441c-b3940aae-20b84523_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:03.026216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef14be57-eda8441c-b3940aae-20b84523_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:03.026039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:03.026077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 884
2025-10-15T11:01:03.029102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:03.029280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:03.029298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:03.029313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:03.030866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 884 sessionId:  describe result for acl check
2025-10-15T11:01:03.030983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:03.030995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:03.031006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:03.031027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401864741913851:9554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:03.034186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401864741913851:9554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:03.051497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401864741913851:9554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:03.074273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401864741913851:9554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:03.074320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401864741913851:9554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:03.074339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401864741913851:9554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:03.074372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:03.077705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401864741914006:8824]
2025-10-15T11:01:03.094034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:03.104276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:03.105283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:03.105325Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:03.105385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:03.105728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:03.105949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401867541604757:8558]
2025-10-15T11:01:03.108282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:03.113991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:03.114220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:03.115187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:03.115502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:03.115508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:03.115512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:03.115517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:03.115522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:03.115526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:03.115531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:03.115536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:03.115541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:03.115545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:03.115550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:03.115555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.115560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.115564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.115599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:03.115682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:03.115740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:03.115785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:03.115818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:03.115852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:03.115893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:03.115926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:03.115958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:03.115998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:03.116038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:03.116070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.116099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.116128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.116157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:03.116205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:03.116244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:03.116280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:03.116310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:03.116346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:03.116383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:03.116424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:03.116463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:03.116516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:03.116566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:03.116626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:03.116675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:03.116731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:03.116776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:03.116828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:03.116874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:03.116926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:03.116968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:03.117021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:03.117070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:03.117127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:03.117174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.117230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.117277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.117337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.117382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.117455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.117987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:03.155081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:03.163845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:03.163887Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:03.163904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:03.163922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:03.163946Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 883 [2:7561401867541604757:8558]
2025-10-15T11:01:03.163998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:03.164055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:03.164069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:03.164081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:03.164092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:03.164142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:03.164167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:03.164190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:03.165805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.165831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.165846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.165857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:03.166120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:03.166147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.166298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.166369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 883
2025-10-15T11:01:03.166449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 883
2025-10-15T11:01:03.166479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 883, pipe: [1:7561401864741914006:8824]
2025-10-15T11:01:03.166508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.166763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:03.166849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401860446946527:2467], now have 1 active actors on pipe
2025-10-15T11:01:03.166874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401864741913994:9554], now have 1 active actors on pipe
2025-10-15T11:01:03.166897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401864741914006:8824], now have 1 active actors on pipe
2025-10-15T11:01:03.166945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:03.166967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:03.167021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401867541604748:8558]
2025-10-15T11:01:03.167036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401867541604748:8558]
2025-10-15T11:01:03.167050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401867541604748:8558]
2025-10-15T11:01:03.167090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:03.167142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:03.167157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:03.167163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:03.167169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:03.167662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:03.167687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:03.167771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:03.167803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:03.167822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:03.167833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:03.167870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:03.167917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:03.168058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401867541604748:8558]
2025-10-15T11:01:03.168088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:03.168138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:03.168139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:03.168631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:03.168652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:03.168726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:03.169061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 884 partition: 0 MaxSeqNo: 46 sessionId: src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0
2025-10-15T11:01:03.169876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef14be57-eda8441c-b3940aae-20b84523_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:03.187963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0] Write session: try to update token
2025-10-15T11:01:03.188040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:03.198358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:03.198397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:03.198437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401867541604748:8558]
2025-10-15T11:01:03.198564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:03.198561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:03.200507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:03.201864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:03.203196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:03.204949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:03.206671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:03.207176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:03.281822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId: src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:03.289365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:03.289399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:03.289411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:03.289462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:03.289478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:03.289491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:03.289501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:03.289538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401867541604748:8558]
2025-10-15T11:01:03.289565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401867541604748:8558]
2025-10-15T11:01:03.289587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401867541604748:8558]
2025-10-15T11:01:03.289721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:03.289739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:03.290747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:03.295472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:03.295518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:03.295548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:03.321837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:03.446061Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:03.448104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:03.448140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:03.452188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:03.455477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:03.456895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401864741914006:8824]
2025-10-15T11:01:03.457018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:03.475531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:03.475587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0] Write session will restart in 0.005531s
2025-10-15T11:01:03.475693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0] Write session: Do CDS request
2025-10-15T11:01:03.475738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:03.474809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 884 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0
2025-10-15T11:01:03.475107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 884 sessionId: src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0 is DEAD
2025-10-15T11:01:03.492690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
E1015 11:01:03.518440272  821272 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-15T11:01:03.520212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:03.520249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 885
2025-10-15T11:01:03.523409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:03.523539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:03.523553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:03.523562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:03.524873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 885 sessionId:  describe result for acl check
2025-10-15T11:01:03.524982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:03.524993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:03.525003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:03.525018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401864741914107:9560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:03.527874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401864741914107:9560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:03.540338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401864741914107:9560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:03.555638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401864741914107:9560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:03.555683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401864741914107:9560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:03.555699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401864741914107:9560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:03.555746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:03.558842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401864741914244:8824]
2025-10-15T11:01:03.582253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:03.592222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:03.593207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:03.593231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:03.593285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:03.593589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:03.593792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401867541604997:8567]
2025-10-15T11:01:03.597678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:03.598946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:03.599227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:03.600605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:03.600990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:03.600998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:03.601006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:03.601014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:03.601021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:03.601028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:03.601035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:03.601044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:03.601051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:03.601059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:03.601067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:03.601075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.601082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.601090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.601139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:03.601257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:03.601307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:03.601353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:03.601400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:03.601446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:03.602328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:03.602396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:03.602448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:03.602499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:03.602550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:03.602607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.602658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.602967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.603037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:03.603119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:03.603184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:03.603254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:03.603315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:03.603385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:03.603438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:03.603496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:03.603547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:03.603607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:03.603653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:03.603725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:03.603775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:03.603833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:03.603882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:03.603941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:03.603995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:03.604051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:03.604099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:03.604159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:03.604210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:03.604267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:03.604317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.604373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.604422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.604479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.604523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.604577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.605110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:03.633568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:03.646461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:03.646504Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:03.646518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:03.646535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:03.646557Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 884 [2:7561401867541604997:8567]
2025-10-15T11:01:03.646603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:03.646657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:03.646671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:03.646683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:03.646692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:03.646737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:03.646756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:03.646776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:03.648436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.648451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.648463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.648473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:03.648762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:03.648795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:03.648923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:03.649094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:03.649314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:03.649394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401864741914233:9560], now have 1 active actors on pipe
2025-10-15T11:01:03.649418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401864741914061:2467], now have 1 active actors on pipe
2025-10-15T11:01:03.649438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401864741914244:8824], now have 1 active actors on pipe
2025-10-15T11:01:03.649460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401867541604991:8567]
2025-10-15T11:01:03.649474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401867541604991:8567]
2025-10-15T11:01:03.649488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401867541604991:8567]
2025-10-15T11:01:03.649530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:03.649589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:03.649600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:03.649601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:03.649609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:03.649771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:03.649788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:03.649905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401867541604991:8567]
2025-10-15T11:01:03.649935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:03.649957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:03.658285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 884
2025-10-15T11:01:03.658377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 884
2025-10-15T11:01:03.658445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 884, pipe: [1:7561401864741914244:8824]
2025-10-15T11:01:03.659009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:03.659043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:03.659107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:03.659133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:03.659147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:03.659155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:03.659185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:03.659223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:03.659257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:03.663318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:03.663365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:03.663441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:03.664743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 885 partition: 0 MaxSeqNo: 46 sessionId: src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0
2025-10-15T11:01:03.665505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a02235-caeeae9b-7fb19b7d-ee2c9b37_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:03.708852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0] Write session: try to update token
2025-10-15T11:01:03.708903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:03.885610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:03.885642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:03.885654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:03.885770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:03.885786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:03.885798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:03.885809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:03.885841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401867541604991:8567]
2025-10-15T11:01:03.885868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401867541604991:8567]
2025-10-15T11:01:03.885893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401867541604991:8567]
2025-10-15T11:01:03.886781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:03.886818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:03.886848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:03.896510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:03.896554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:03.897618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:03.903291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId: src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:03.926538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:04.051001Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:04.052433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:04.052456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:04.052494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401867541604991:8567]
2025-10-15T11:01:04.052620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:04.052647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:04.052770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:04.056392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:04.053457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:04.053493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:04.054254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:04.054535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401864741914244:8824]
2025-10-15T11:01:04.093296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:04.093375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0] Write session will restart in 0.005879s
2025-10-15T11:01:04.093552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0] Write session: Do CDS request
2025-10-15T11:01:04.093603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:04.092285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 885 reason: error at write: Disconnected sessionId: src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0
2025-10-15T11:01:04.092627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 885 sessionId: src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0 is DEAD
2025-10-15T11:01:04.106345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:04.106381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 886
2025-10-15T11:01:04.107375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:04.111513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:04.111695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:04.111713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:04.111738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:04.113303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 886 sessionId:  describe result for acl check
2025-10-15T11:01:04.113436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:04.113448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:04.113458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:04.113479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401869036881646:9573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:04.120517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401869036881646:9573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:04.135176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401869036881646:9573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:04.150552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401869036881646:9573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:04.150602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401869036881646:9573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:04.150619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401869036881646:9573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:04.150650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:04.154463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401869036881772:8824]
2025-10-15T11:01:04.186288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
E1015 11:01:04.188813965  868853 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:01:04.191301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:04.192227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:04.192254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:04.192297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:04.192566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:04.192761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401871836572534:8577]
2025-10-15T11:01:04.192945Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:01:04.194864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:04.195970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:04.196244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:04.197645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:04.198002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:04.198010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:04.198018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:04.198027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:04.198035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:04.198042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:04.198049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:04.198057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:04.198065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:04.198072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:04.198081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:04.198088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.198094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.198102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.198153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:04.198279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:04.198330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:04.198382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:04.198431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:04.198485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:04.198532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:04.198583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:04.198633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:04.198684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:04.198733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:04.198781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.198828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.198883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.198932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:04.199023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:04.199086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:04.199145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:04.199197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:04.199269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:04.199320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:04.199407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:04.199462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:04.199521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:04.199579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:04.199646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:04.199703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:04.199779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:04.199832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:04.199891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:04.199941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:04.199996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:04.200044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:04.200102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:04.200153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:04.200210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:04.200257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.200313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.200368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.200430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.200479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.200539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.201101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:04.223555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:04.233591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:04.233637Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:04.233653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:04.233671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:04.233695Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 885 [2:7561401871836572534:8577]
2025-10-15T11:01:04.233747Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:04.233801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:04.233814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:04.233826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:04.233837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:04.233881Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:04.233903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:04.233923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:04.234958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.234974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.234987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.234998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:04.235257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:04.235274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.236268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.236495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.236731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:04.236811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401869036881621:2467], now have 1 active actors on pipe
2025-10-15T11:01:04.236834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401869036881772:8824], now have 1 active actors on pipe
2025-10-15T11:01:04.236855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401869036881748:9573], now have 1 active actors on pipe
2025-10-15T11:01:04.236880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401871836572529:8577]
2025-10-15T11:01:04.236896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401871836572529:8577]
2025-10-15T11:01:04.236908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401871836572529:8577]
2025-10-15T11:01:04.236945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:04.237013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:04.237178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:04.237192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:04.237301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401871836572529:8577]
2025-10-15T11:01:04.237322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:04.237454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:04.237468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:04.237477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:04.237499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:04.239071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 885
2025-10-15T11:01:04.239165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 885, pipe: [1:7561401869036881772:8824]
2025-10-15T11:01:04.239248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 885
2025-10-15T11:01:04.239663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:04.239696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:04.239799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:04.239830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:04.239846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:04.239856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:04.239892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:04.239929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:04.239987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:04.240675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:04.240699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:04.240757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:04.241352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 886 partition: 0 MaxSeqNo: 46 sessionId: src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0
2025-10-15T11:01:04.242236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef77c49a-f5768d36-c53e0053-f96d4390_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:04.272755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0] Write session: try to update token
2025-10-15T11:01:04.272822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:04.338187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:04.338222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:04.338234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:04.343171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId: src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:04.380535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:04.380572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:04.380635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T11:01:04.379309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:04.381065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:04.460572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:04.460610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:04.460622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:04.460677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:04.460691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:04.460705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:04.460715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:04.460747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401871836572529:8577]
2025-10-15T11:01:04.460772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401871836572529:8577]
2025-10-15T11:01:04.460797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401871836572529:8577]
2025-10-15T11:01:04.460929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:04.460943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:04.460950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:04.460985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:04.461032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:04.471997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:04.617521Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:04.655481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:04.655536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:04.656289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.656791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.657295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.657788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.658022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.658047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.658541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.659036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.659801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.660331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.660554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.660577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.661077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.661546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.662008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.662485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.662696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.662718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.663201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.663788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.664275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.664740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.664976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.665009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.665475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.665938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.666405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.666913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.667148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.667179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.667669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.668137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.668593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.669055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.669293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.669323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.669800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.670269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.670756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.671208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.671486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.671525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.672032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.672516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.673000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.673495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.673730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.673761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.674264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.674751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.675198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.675913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.676129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.676158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.676705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:04.677157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:04.677624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:04.678092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:04.678320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:04.678347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:04.712040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:04.712103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0] Write session will restart in 0.006890s
2025-10-15T11:01:04.712314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0] Write session: Do CDS request
2025-10-15T11:01:04.712365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:04.711036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:04.711089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:04.711168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:04.711222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 886 reason: error at write: Disconnected sessionId: src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0
2025-10-15T11:01:04.711491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401869036881772:8824]
2025-10-15T11:01:04.711707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 886 sessionId: src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0 is DEAD
2025-10-15T11:01:04.724523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:04.724374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:04.724422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 887
2025-10-15T11:01:04.724988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:04.725115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:04.725136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:04.725145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:04.726526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 887 sessionId:  describe result for acl check
2025-10-15T11:01:04.726631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:04.726647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:04.726661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:04.726677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401869036881863:9579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:04.729225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401869036881863:9579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:04.735286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401869036881863:9579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:04.742190Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:04.742686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401869036881863:9579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:04.742729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401869036881863:9579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:04.742744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401869036881863:9579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:04.742772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:04.811389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401869036882048:8824]
2025-10-15T11:01:04.830332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:04.832200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:04.832961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:04.833003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:04.833043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:04.833286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:04.833458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401871836572780:8587]
2025-10-15T11:01:04.835552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:04.836391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:04.836597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:04.837696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:04.838008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:04.838022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:04.838029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:04.838036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:04.838042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:04.838047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:04.838052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:04.838059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:04.838065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:04.838071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:04.838077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:04.838085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.838091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.838097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.838138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:04.838232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:04.838275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:04.838319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:04.838361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:04.838410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:04.838452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:04.838498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:04.838544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:04.838592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:04.838639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:04.838684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.838731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.838787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.838829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:04.838893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:04.838949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:04.839005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:04.839080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:04.839139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:04.839182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:04.839234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:04.839284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:04.839338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:04.839449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:04.839508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:04.839558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:04.839611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:04.839654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:04.839703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:04.839765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:04.839816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:04.839860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:04.839915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:04.839956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:04.840003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:04.840049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.840097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.840143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.840198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.840243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.840294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.840742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:04.856668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:04.866565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:04.866610Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:04.866627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:04.866646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:04.866669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 886 [2:7561401871836572780:8587]
2025-10-15T11:01:04.866721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:04.866776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:04.866789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:04.866801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:04.866812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:04.866855Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:04.866877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:04.866897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:04.877821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.877853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.877863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.877872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:04.878142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:04.878165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:04.878282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:04.878434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:04.878639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:04.878712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401871836572775:8587]
2025-10-15T11:01:04.878731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401871836572775:8587]
2025-10-15T11:01:04.878744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401871836572775:8587]
2025-10-15T11:01:04.878780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:04.878848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:04.879024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:04.879048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:04.879108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:04.879121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:04.879132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:04.879167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401869036882048:8824], now have 1 active actors on pipe
2025-10-15T11:01:04.879190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401869036881896:9579], now have 1 active actors on pipe
2025-10-15T11:01:04.879207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401871836572775:8587]
2025-10-15T11:01:04.879233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:04.879251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:04.879267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401869036881855:2467], now have 1 active actors on pipe
2025-10-15T11:01:04.879883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:04.879906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:04.879981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|541cf10a-b2682add-c0895884-b799c072_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:04.880016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:04.880032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:04.880041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:04.880074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:04.880109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:04.880153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:04.879309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 886, pipe: [1:7561401869036882048:8824]
2025-10-15T11:01:04.879427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 886
2025-10-15T11:01:04.879494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 886
2025-10-15T11:01:04.881519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:04.881544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:04.881603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:04.883782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d92931d0-9bc0a06a-73a8eea6-c3f30640_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|541cf10a-b2682add-c0895884-b799c072_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:04.882149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 887 partition: 0 MaxSeqNo: 46 sessionId: src_id|541cf10a-b2682add-c0895884-b799c072_0
2025-10-15T11:01:04.910198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|541cf10a-b2682add-c0895884-b799c072_0] Write session: try to update token
2025-10-15T11:01:04.910241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|541cf10a-b2682add-c0895884-b799c072_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:05.012632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:05.012664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:05.012678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:05.012688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:05.012716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401871836572775:8587]
2025-10-15T11:01:05.012738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401871836572775:8587]
2025-10-15T11:01:05.012762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401871836572775:8587]
2025-10-15T11:01:05.012879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:05.012931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:05.012956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:05.012956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:05.012966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:05.012975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:05.013012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:05.013030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:05.016213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:05.024258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId: src_id|541cf10a-b2682add-c0895884-b799c072_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:05.050977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:05.155095Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:05.170441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:05.170482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:05.170542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:05.170555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:05.170591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401871836572775:8587]
2025-10-15T11:01:05.170818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:05.171131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:05.172014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401869036882048:8824]
2025-10-15T11:01:05.172104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:05.200039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:05.201110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541cf10a-b2682add-c0895884-b799c072_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:05.201159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541cf10a-b2682add-c0895884-b799c072_0] Write session will restart in 0.006565s
2025-10-15T11:01:05.201301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541cf10a-b2682add-c0895884-b799c072_0] Write session: Do CDS request
2025-10-15T11:01:05.201344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541cf10a-b2682add-c0895884-b799c072_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:05.200175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 887 reason: status is not ok: tablet will be restarted right now sessionId: src_id|541cf10a-b2682add-c0895884-b799c072_0
2025-10-15T11:01:05.200461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 887 sessionId: src_id|541cf10a-b2682add-c0895884-b799c072_0 is DEAD
2025-10-15T11:01:05.212036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|541cf10a-b2682add-c0895884-b799c072_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:05.212029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:05.212061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 888
2025-10-15T11:01:05.212507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:05.212620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:05.212640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:05.212648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:05.214208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 888 sessionId:  describe result for acl check
2025-10-15T11:01:05.214327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:05.214342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:05.214352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:05.214367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401873331849424:9591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:05.216569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401873331849424:9591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:05.222877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401873331849424:9591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:05.237235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401873331849424:9591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:05.237287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401873331849424:9591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:05.237304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401873331849424:9591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:05.237334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:05.268284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:05.272416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:05.273132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401873331849619:8824]
2025-10-15T11:01:05.273264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:05.273300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:05.273347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:05.273638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:05.273832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401876131540322:8594]
2025-10-15T11:01:05.276041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:05.276973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:05.277275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:05.278564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:05.278901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:05.278922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:05.278930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:05.278937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:05.278944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:05.278950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:05.278957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:05.278964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:05.278971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:05.278978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:05.278986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:05.278993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.279000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.279006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.279051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:05.279146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:05.279192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:05.279235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:05.279299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:05.279370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:05.279421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:05.279463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:05.279504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:05.279548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:05.279590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:05.279637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.279685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.279728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.279795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:05.279887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:05.279950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:05.280010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:05.280060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:05.280116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:05.280162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:05.280216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:05.280266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:05.280332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:05.280391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:05.280442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:05.280493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:05.280558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:05.280607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:05.280659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:05.280706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:05.280754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:05.280802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:05.280855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:05.280925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:05.281005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:05.281047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.281091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.281134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.281186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.281226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.281280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.281742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:05.302849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:05.313677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:05.313722Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:05.313741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:05.313760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:05.313784Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 887 [2:7561401876131540322:8594]
2025-10-15T11:01:05.313836Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:05.313889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:05.313901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:05.313913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:05.313923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:05.313967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:05.313988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:05.314006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:05.315797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.315836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.315851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.315862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:05.316138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:05.316163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.316291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.316471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.316698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:05.316778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401873331849417:2467], now have 1 active actors on pipe
2025-10-15T11:01:05.316806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401873331849514:9591], now have 1 active actors on pipe
2025-10-15T11:01:05.316825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401873331849619:8824], now have 1 active actors on pipe
2025-10-15T11:01:05.316848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401876131540308:8594]
2025-10-15T11:01:05.316861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401876131540308:8594]
2025-10-15T11:01:05.316874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401876131540308:8594]
2025-10-15T11:01:05.316911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:05.316988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:05.317165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:05.317188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:05.317301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401876131540308:8594]
2025-10-15T11:01:05.317327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:05.317456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:05.317481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:05.317492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:05.317531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:05.317912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 887, pipe: [1:7561401873331849619:8824]
2025-10-15T11:01:05.318055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 887
2025-10-15T11:01:05.318381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:05.318148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 887
2025-10-15T11:01:05.318410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:05.318506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eed8fded-833435ac-74edb99e-ac7a6099_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:05.318547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:05.318568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:05.318577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:05.318617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:05.318654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:05.318710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:05.319116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:05.319143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:05.319198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:05.319484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 888 partition: 0 MaxSeqNo: 46 sessionId: src_id|eed8fded-833435ac-74edb99e-ac7a6099_0
2025-10-15T11:01:05.320286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541cf10a-b2682add-c0895884-b799c072_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eed8fded-833435ac-74edb99e-ac7a6099_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:05.355913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eed8fded-833435ac-74edb99e-ac7a6099_0] Write session: try to update token
2025-10-15T11:01:05.355977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eed8fded-833435ac-74edb99e-ac7a6099_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:05.423458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:05.423488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:05.423502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:05.423513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:05.423545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401876131540308:8594]
2025-10-15T11:01:05.423578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401876131540308:8594]
2025-10-15T11:01:05.423603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401876131540308:8594]
2025-10-15T11:01:05.423727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:05.423753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:05.423764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:05.424507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:05.424568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:05.424622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:05.437650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:05.437691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:05.439480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:05.443708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId: src_id|eed8fded-833435ac-74edb99e-ac7a6099_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:05.473607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:05.579128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:05.580447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:05.580468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:05.580511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401876131540308:8594]
2025-10-15T11:01:05.580621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:05.580623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:05.580636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:05.581182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:05.582128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:05.582352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:05.584333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401873331849619:8824]
2025-10-15T11:01:05.590884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 888 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eed8fded-833435ac-74edb99e-ac7a6099_0
2025-10-15T11:01:05.591233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 888 sessionId: src_id|eed8fded-833435ac-74edb99e-ac7a6099_0 is DEAD
2025-10-15T11:01:05.591627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed8fded-833435ac-74edb99e-ac7a6099_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:05.591687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed8fded-833435ac-74edb99e-ac7a6099_0] Write session will restart in 0.008734s
2025-10-15T11:01:05.591844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed8fded-833435ac-74edb99e-ac7a6099_0] Write session: Do CDS request
2025-10-15T11:01:05.591903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed8fded-833435ac-74edb99e-ac7a6099_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:05.604646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eed8fded-833435ac-74edb99e-ac7a6099_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:05.604523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:05.604583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 889
2025-10-15T11:01:05.605423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:05.605647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:05.605681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:05.605698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:05.608298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 889 sessionId:  describe result for acl check
2025-10-15T11:01:05.608503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:05.608525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:05.608554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:05.608592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401873331849658:9598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:05.613742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401873331849658:9598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:05.624551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401873331849658:9598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:05.648368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401873331849658:9598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:05.648404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401873331849658:9598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:05.648416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401873331849658:9598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:05.648442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:05.687694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401873331849813:8824]
2025-10-15T11:01:05.721189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:05.723299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:05.724236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:05.724256Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:05.724291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:05.724556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:05.724746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401876131540556:8600]
2025-10-15T11:01:05.726941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:05.727854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:05.728060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:05.729259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:05.729589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:05.729597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:05.729605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:05.729613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:05.729619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:05.729628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:05.729634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:05.729642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:05.729649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:05.729656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:05.729664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:05.729671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.729677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.729685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.729723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:05.729827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:05.729875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:05.729911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:05.729959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:05.729996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:05.730044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:05.730092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:05.730130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:05.730167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:05.730202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:05.730236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.730273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.730313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.730351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:05.730406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:05.730460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:05.730508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:05.730552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:05.730602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:05.730632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:05.730675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:05.730735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:05.730795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:05.730847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:05.730907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:05.730962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:05.731028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:05.731074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:05.731129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:05.731176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:05.731219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:05.731252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:05.731301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:05.731342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:05.731431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:05.731483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.731544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.731598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.731655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.731695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.731736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.732214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:05.747265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:05.756488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:05.756537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:05.756557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:05.756577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:05.756605Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 888 [2:7561401876131540556:8600]
2025-10-15T11:01:05.756660Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:05.756727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:05.756743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:05.756758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:05.756770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:05.756824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:05.756848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:05.756873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:05.765773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.765810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.765825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.765837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:05.766137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:05.766157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:05.766324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:05.766501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 888, pipe: [1:7561401873331849813:8824]
2025-10-15T11:01:05.766533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:05.766547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 888
2025-10-15T11:01:05.766612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 888
2025-10-15T11:01:05.766806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:05.766908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401873331849813:8824], now have 1 active actors on pipe
2025-10-15T11:01:05.766939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401873331849703:9598], now have 1 active actors on pipe
2025-10-15T11:01:05.766964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401873331849649:2467], now have 1 active actors on pipe
2025-10-15T11:01:05.766992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401876131540551:8600]
2025-10-15T11:01:05.767008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401876131540551:8600]
2025-10-15T11:01:05.767022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401876131540551:8600]
2025-10-15T11:01:05.767053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:05.767122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:05.767135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:05.767142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:05.767154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:05.767337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:05.767423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:05.767495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:05.767525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:05.767674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401876131540551:8600]
2025-10-15T11:01:05.767711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:05.767753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:05.767807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:05.767850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:05.767870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:05.767882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:05.767931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:05.767994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:05.768160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:05.768722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:05.768751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:05.768819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:05.769111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 889 partition: 0 MaxSeqNo: 46 sessionId: src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0
2025-10-15T11:01:05.769815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eed8fded-833435ac-74edb99e-ac7a6099_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:05.801472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0] Write session: try to update token
2025-10-15T11:01:05.801527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:05.817070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:05.817115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:05.817168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401876131540551:8600]
2025-10-15T11:01:05.817323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:05.817677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:05.819932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:05.822427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:05.824130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:05.832812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:05.834538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:05.834934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:05.857908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:05.857976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:05.858012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:05.895099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:05.895131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:05.895144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:05.895153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:05.895191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401876131540551:8600]
2025-10-15T11:01:05.895216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401876131540551:8600]
2025-10-15T11:01:05.895240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401876131540551:8600]
2025-10-15T11:01:05.895409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:05.895438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:05.895531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:05.895562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:05.895587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:05.904669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:05.915224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId: src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:05.944571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:06.053187Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:06.054554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:06.054584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:06.055311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:06.055395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:06.055427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:06.055425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:06.055659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401873331849813:8824]
2025-10-15T11:01:06.065426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 889 reason: error at write: Disconnected sessionId: src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0
2025-10-15T11:01:06.065735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 889 sessionId: src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0 is DEAD
2025-10-15T11:01:06.071644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:06.071705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0] Write session will restart in 0.008333s
2025-10-15T11:01:06.071906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0] Write session: Do CDS request
2025-10-15T11:01:06.071964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:06.090227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:06.089836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:06.089873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 890
2025-10-15T11:01:06.090768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:06.090914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:06.090932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:06.090942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:06.092472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 890 sessionId:  describe result for acl check
2025-10-15T11:01:06.092639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:06.092659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:06.092679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:06.092707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401877626817203:9603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:06.096189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401877626817203:9603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:06.106180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401877626817203:9603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:06.115542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401877626817203:9603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:06.115589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401877626817203:9603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:06.115610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401877626817203:9603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:06.115644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:06.155889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401877626817348:8824]
2025-10-15T11:01:06.188258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:06.191979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:06.192854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:06.192873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:06.192920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:06.193182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:06.193371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401880426508085:8602]
2025-10-15T11:01:06.195957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:06.197110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:06.197329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:06.198715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:06.199069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:06.199077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:06.199084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:06.199091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:06.199098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:06.199107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:06.199114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:06.199122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:06.199128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:06.199136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:06.199145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:06.199152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.199159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.199167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.199219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:06.199338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:06.199413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:06.199461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:06.199510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:06.199556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:06.199605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:06.199652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:06.199702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:06.199765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:06.199811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:06.199862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.199912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.199963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.200012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:06.200085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:06.200153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:06.200211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:06.200263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:06.200319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:06.200365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:06.200421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:06.200469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:06.200525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:06.200573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:06.200632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:06.200680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:06.200739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:06.200787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:06.200841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:06.200888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:06.200945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:06.200992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:06.201050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:06.201101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:06.201159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:06.201219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.201275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.201325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.201379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.201424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.201476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.202014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:06.227723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:06.239876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:06.239919Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:06.239934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:06.239951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:06.239975Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 889 [2:7561401880426508085:8602]
2025-10-15T11:01:06.240021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:06.240074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:06.240088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:06.240100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:06.240112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:06.240155Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:06.240174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:06.240192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:06.242116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.242132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.242145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.242156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:06.242428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:06.242444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.242578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.242755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.242971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:06.243045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401877626817348:8824], now have 1 active actors on pipe
2025-10-15T11:01:06.243067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401877626817180:2467], now have 1 active actors on pipe
2025-10-15T11:01:06.243087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401877626817243:9603], now have 1 active actors on pipe
2025-10-15T11:01:06.243018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 889, pipe: [1:7561401877626817348:8824]
2025-10-15T11:01:06.243110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401880426508080:8602]
2025-10-15T11:01:06.243122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401880426508080:8602]
2025-10-15T11:01:06.243061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 889
2025-10-15T11:01:06.243135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401880426508080:8602]
2025-10-15T11:01:06.243130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 889
2025-10-15T11:01:06.243165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:06.243228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:06.243257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:06.243271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:06.243283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:06.243414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:06.243442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:06.243590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:06.243609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:06.243635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401880426508080:8602]
2025-10-15T11:01:06.243663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:06.243769Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e4f389f-4938d690-e2454a2c-a0364086_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:06.243795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:06.243812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:06.243821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:06.243852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:06.243885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:06.243954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:06.244059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:06.245236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 890 partition: 0 MaxSeqNo: 46 sessionId: src_id|2e4f389f-4938d690-e2454a2c-a0364086_0
2025-10-15T11:01:06.244814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:06.244843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:06.244904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:06.246095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc964dc2-6112076f-5fd7935-c32ce9dd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2e4f389f-4938d690-e2454a2c-a0364086_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:06.274450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4f389f-4938d690-e2454a2c-a0364086_0] Write session: try to update token
2025-10-15T11:01:06.274496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4f389f-4938d690-e2454a2c-a0364086_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:06.329412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:06.329448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:06.329461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:06.329471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:06.329507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401880426508080:8602]
2025-10-15T11:01:06.329533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401880426508080:8602]
2025-10-15T11:01:06.329555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401880426508080:8602]
2025-10-15T11:01:06.329695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:06.329717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:06.329749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:06.329750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:06.329791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:06.334757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:06.383813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId: src_id|2e4f389f-4938d690-e2454a2c-a0364086_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:06.404307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:06.497755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:06.504305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:06.504341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:06.506515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401877626817348:8824]
2025-10-15T11:01:06.506661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:06.506839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:06.508816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:06.509374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:06.529444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 890 reason: error at write: Disconnected sessionId: src_id|2e4f389f-4938d690-e2454a2c-a0364086_0
2025-10-15T11:01:06.529728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 890 sessionId: src_id|2e4f389f-4938d690-e2454a2c-a0364086_0 is DEAD
2025-10-15T11:01:06.532030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4f389f-4938d690-e2454a2c-a0364086_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:06.532069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4f389f-4938d690-e2454a2c-a0364086_0] Write session will restart in 0.008891s
2025-10-15T11:01:06.532181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4f389f-4938d690-e2454a2c-a0364086_0] Write session: Do CDS request
2025-10-15T11:01:06.532219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4f389f-4938d690-e2454a2c-a0364086_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:06.550440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4f389f-4938d690-e2454a2c-a0364086_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:06.551178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:06.551212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 891
2025-10-15T11:01:06.551546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:06.551650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:06.551664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:06.551673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:06.553100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 891 sessionId:  describe result for acl check
2025-10-15T11:01:06.553205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:06.553215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:06.553225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:06.553241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401877626817470:9614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:06.555932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401877626817470:9614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:06.563189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401877626817470:9614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:06.576054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401877626817470:9614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:06.576096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401877626817470:9614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:06.576115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401877626817470:9614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:06.576144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:06.609931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401877626817602:8824]
2025-10-15T11:01:06.630867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:06.638130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:06.638981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:06.639017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:06.639060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:06.639312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:06.639605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401880426508340:8611]
2025-10-15T11:01:06.642024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:06.648023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:06.648285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:06.649637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:06.649988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:06.650010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:06.650018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:06.650025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:06.650033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:06.650041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:06.650047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:06.650055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:06.650062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:06.650070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:06.650077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:06.650083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.650090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.650097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.650144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:06.650257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:06.650307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:06.650354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:06.650402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:06.650465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:06.650511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:06.650556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:06.650603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:06.650649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:06.650697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:06.650743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.650788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.650831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.650875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:06.650941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:06.650997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:06.651047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:06.651094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:06.651144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:06.651188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:06.651240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:06.651281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:06.651317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:06.651416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:06.651487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:06.651535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:06.651586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:06.651629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:06.651680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:06.651726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:06.651795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:06.651849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:06.651904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:06.651945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:06.651995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:06.652042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.652104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.652152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.652206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.652255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.652310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.652712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:06.670916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T11:01:06.670988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-10-15T11:01:06.675507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:06.686365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:06.686418Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:06.686436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:06.686454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:06.686478Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 890 [2:7561401880426508340:8611]
2025-10-15T11:01:06.686541Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:06.686597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:06.686609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:06.686621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:06.686632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:06.686676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:06.686706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:06.686735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:06.688772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.688797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.688810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.688821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:06.689107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:06.689130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:06.689259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:06.689460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:06.689705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:06.689789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401877626817442:2467], now have 1 active actors on pipe
2025-10-15T11:01:06.689812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401877626817602:8824], now have 1 active actors on pipe
2025-10-15T11:01:06.689831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401877626817498:9614], now have 1 active actors on pipe
2025-10-15T11:01:06.689855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401880426508335:8611]
2025-10-15T11:01:06.689870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401880426508335:8611]
2025-10-15T11:01:06.689883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401880426508335:8611]
2025-10-15T11:01:06.689923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:06.689959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:06.689973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:06.689985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:06.689994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:06.690163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:06.690180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:06.690293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401880426508335:8611]
2025-10-15T11:01:06.690327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:06.690496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:06.690278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 890
2025-10-15T11:01:06.690370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 890, pipe: [1:7561401877626817602:8824]
2025-10-15T11:01:06.690472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 890
2025-10-15T11:01:06.690938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:06.690966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:06.691102Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:01:06.691237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:06.691269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:06.691285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:06.691296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:06.691327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:06.691374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:06.691419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:06.692651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 16 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:01:06.692801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:01:06.693929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:06.693963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:06.694038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:06.695246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 891 partition: 0 MaxSeqNo: 46 sessionId: src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0
2025-10-15T11:01:06.698904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e4f389f-4938d690-e2454a2c-a0364086_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:06.719808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0] Write session: try to update token
2025-10-15T11:01:06.719870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:06.770408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:06.770449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:06.770494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401880426508335:8611]
2025-10-15T11:01:06.770626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:06.771478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:06.777122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:06.784718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:06.786242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:06.790714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:06.799438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:06.800050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:06.800072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:06.800084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:06.800142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:06.885784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:06.891548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:06.891592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:06.891605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:06.891649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401880426508335:8611]
2025-10-15T11:01:06.891679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401880426508335:8611]
2025-10-15T11:01:06.891703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401880426508335:8611]
2025-10-15T11:01:06.891862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:06.891890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:06.891908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:06.891913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:06.891941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:06.895486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:06.899913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId: src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:06.921689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:07.046646Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:07.048086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:07.048130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:07.049074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:07.049142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-15T11:01:07.049284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401877626817602:8824]
2025-10-15T11:01:07.049364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:07.049376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:07.048846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:07.109898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 891 reason: error at write: Disconnected sessionId: src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0
2025-10-15T11:01:07.110186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 891 sessionId: src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0 is DEAD
2025-10-15T11:01:07.110692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:07.110728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0] Write session will restart in 0.005536s
2025-10-15T11:01:07.110839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0] Write session: Do CDS request
2025-10-15T11:01:07.110869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:07.123588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:07.123640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 892
2025-10-15T11:01:07.124759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:07.126313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:07.126452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:07.126477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:07.126486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:07.128058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 892 sessionId:  describe result for acl check
2025-10-15T11:01:07.128138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:07.128150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:07.128159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:07.128176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401881921785093:9622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:07.130404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401881921785093:9622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:07.141680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401881921785093:9622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:07.149638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401881921785206:8824]
2025-10-15T11:01:07.155856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401881921785093:9622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:07.155902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401881921785093:9622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:07.155921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401881921785093:9622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:07.155957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:07.168977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:07.170995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:07.172002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:07.172039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:07.172087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:07.172361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:07.172569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401884721475868:8622]
2025-10-15T11:01:07.174828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:07.175829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:07.176056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:07.177350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:07.177681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:07.177699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:07.177708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:07.177716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:07.177723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:07.177731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:07.177750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:07.177758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:07.177764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:07.177770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:07.177778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:07.177784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.177791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.177799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.177848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:07.177967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:07.178021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:07.178078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:07.178134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:07.178190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:07.178242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:07.178293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:07.178347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:07.178400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:07.178453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:07.178503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.178553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.178608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.178658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:07.178733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:07.178798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:07.178859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:07.178916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:07.178973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:07.179016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:07.179071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:07.179121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:07.179174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:07.179224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:07.179293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:07.179358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:07.179420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:07.179474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:07.179535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:07.179586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:07.179649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:07.179705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:07.179778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:07.179833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:07.179893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:07.179946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.180006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.180072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.180145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.180199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.180259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.180789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:07.198553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:07.208035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:07.208088Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:07.208106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:07.208126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:07.208154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 891 [2:7561401884721475868:8622]
2025-10-15T11:01:07.208211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:07.208277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:07.208292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:07.208305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:07.208319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:07.208370Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:07.208394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:07.208417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:07.260415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.260446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.260457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.260469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:07.260751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:07.260776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.260917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.261107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.261324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:07.261402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401884721475863:8622]
2025-10-15T11:01:07.261424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401884721475863:8622]
2025-10-15T11:01:07.261436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401884721475863:8622]
2025-10-15T11:01:07.261476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:07.261556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:07.261753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:07.261776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:07.261883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:07.261906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:07.261906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401884721475863:8622]
2025-10-15T11:01:07.261917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:07.261925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:07.261941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:07.262632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401881921785227:9622], now have 1 active actors on pipe
2025-10-15T11:01:07.262669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401881921785206:8824], now have 1 active actors on pipe
2025-10-15T11:01:07.262691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401881921785001:2467], now have 1 active actors on pipe
2025-10-15T11:01:07.262620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 891
2025-10-15T11:01:07.262707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 891, pipe: [1:7561401881921785206:8824]
2025-10-15T11:01:07.262797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 891
2025-10-15T11:01:07.263116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:07.263148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:07.263270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:07.263308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:07.263333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:07.263359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:07.263399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:07.263455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:07.263623Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:01:07.263729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:07.266143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 17 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:01:07.266295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:01:07.266690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:07.266726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:07.266802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:07.267147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 892 partition: 0 MaxSeqNo: 46 sessionId: src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0
2025-10-15T11:01:07.268022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b92d903-929471cb-c60b2ec5-68cf342d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:07.308678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0] Write session: try to update token
2025-10-15T11:01:07.308743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:07.330598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:07.330637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:07.330650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:07.330709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:07.330726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:07.330768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401884721475863:8622]
2025-10-15T11:01:07.330892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:07.330919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:07.338682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:07.339896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:07.341034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:07.346079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:07.347660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:07.348129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:07.430691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:07.430731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:07.430750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:07.430764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:07.430811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401884721475863:8622]
2025-10-15T11:01:07.430842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401884721475863:8622]
2025-10-15T11:01:07.430870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401884721475863:8622]
2025-10-15T11:01:07.431015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:07.431051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:07.431065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:07.431067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:07.431078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:07.431096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:07.431130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:07.431155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:07.432306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:07.458075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId: src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:07.477571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:07.577423Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:07.578886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:07.578919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:07.579828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:07.580370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:07.583564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401881921785206:8824]
2025-10-15T11:01:07.583757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:07.583917Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T11:01:07.584401Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 9 consumer shared/user session shared/user_1_9_15124978577476656889_v1 is DEAD
2025-10-15T11:01:07.584867Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401675763334988:8821] disconnected; active server actors: 1
2025-10-15T11:01:07.584903Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401675763334988:8821] client user disconnected session shared/user_1_9_15124978577476656889_v1
2025-10-15T11:01:07.587787Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T11:01:07.588524Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T11:01:07.588563Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T11:01:07.588617Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.005724s
2025-10-15T11:01:07.593327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 892 reason: status is not ok: tablet will be restarted right now sessionId: src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0
2025-10-15T11:01:07.593673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 892 sessionId: src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0 is DEAD
2025-10-15T11:01:07.594264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:07.594320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0] Write session will restart in 0.009363s
2025-10-15T11:01:07.594491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0] Write session: Do CDS request
2025-10-15T11:01:07.594578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:07.599763Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T11:01:07.600346Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T11:01:07.600401Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 10
2025-10-15T11:01:07.601106Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 10 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T11:01:07.601514Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T11:01:07.602196Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 auth for : user
2025-10-15T11:01:07.603123Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 Handle describe topics response
2025-10-15T11:01:07.603363Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 auth is DEAD
2025-10-15T11:01:07.603457Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 auth ok: topics# 1, initDone# 0
2025-10-15T11:01:07.604470Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T11:01:07.604734Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_10_14544789689558060916_v1
2025-10-15T11:01:07.604759Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T11:01:07.604963Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T11:01:07.605528Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T11:01:07.605667Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 got read request: guid# 9c6c3128-cfa98077-e353e32b-abcfaa28
2025-10-15T11:01:07.605747Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401881921785270:9627] connected; active server actors: 1
2025-10-15T11:01:07.605783Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561401881921785270:9627] session shared/user_1_10_14544789689558060916_v1
2025-10-15T11:01:07.605827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T11:01:07.605879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T11:01:07.605927Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_10_14544789689558060916_v1" (Sender=[1:7561401881921785265:9627], Pipe=[1:7561401881921785270:9627], Partitions=[], ActiveFamilyCount=0)
2025-10-15T11:01:07.605957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T11:01:07.606004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T11:01:07.606060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_10_14544789689558060916_v1" (Sender=[1:7561401881921785265:9627], Pipe=[1:7561401881921785270:9627], Partitions=[], ActiveFamilyCount=0)
2025-10-15T11:01:07.606123Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_10_14544789689558060916_v1" sender [1:7561401881921785265:9627] lock partition 0 for ReadingSession "shared/user_1_10_14544789689558060916_v1" (Sender=[1:7561401881921785265:9627], Pipe=[1:7561401881921785270:9627], Partitions=[], ActiveFamilyCount=1) generation 1 step 10
2025-10-15T11:01:07.606176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T11:01:07.606209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000177s
2025-10-15T11:01:07.606928Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 10 Session: "shared/user_1_10_14544789689558060916_v1" ClientId: "user" PipeClient { RawX1: 7561401881921785270 RawX2: 4503603922347419 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T11:01:07.607017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T11:01:07.608523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:07.608320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:07.608352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 893
2025-10-15T11:01:07.609021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:07.609167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:07.609189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:07.609198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:07.610721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 893 sessionId:  describe result for acl check
2025-10-15T11:01:07.610841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:07.610858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:07.610868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:07.610885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401881921785279:9631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:07.613784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401881921785279:9631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:07.629112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401881921785279:9631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:07.644082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401881921785279:9631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:07.644123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401881921785279:9631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:07.644135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401881921785279:9631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:07.644155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:07.668578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:07.677360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:07.678314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:07.678345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:07.678391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:07.678656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:07.678853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401884721476122:8627]
2025-10-15T11:01:07.681082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:07.682103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:07.682320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:07.683529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:07.683865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:07.683884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:07.683892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:07.683898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:07.683906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:07.683913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:07.683921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:07.683928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:07.683936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:07.683944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:07.683952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:07.683960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.683966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.683972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.684019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:07.684130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:07.684187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:07.684233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:07.684282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:07.684330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:07.684376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:07.684422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:07.684467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:07.684516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:07.684560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:07.684606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.684654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.684701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.684750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:07.684818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:07.684879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:07.684937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:07.684985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:07.685037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:07.685088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:07.685141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:07.685189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:07.685245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:07.685292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:07.685347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:07.685396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:07.685450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:07.685495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:07.685549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:07.685594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:07.685650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:07.685697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:07.685752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:07.685799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:07.685853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:07.685901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.685957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.686001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.686054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.686096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.686153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.686676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:07.705362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:07.715868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:07.715913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:07.715931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:07.715951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:07.715977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 892 [2:7561401884721476122:8627]
2025-10-15T11:01:07.716028Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:07.716086Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:07.716101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:07.716114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:07.716126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:07.716175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:07.716199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:07.716223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:07.725144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.725183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.725197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.725208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:07.725493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:07.725518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:07.725657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:07.725851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:07.726093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:07.726184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401881921785379:9631], now have 1 active actors on pipe
2025-10-15T11:01:07.726215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401881921785274:9630], now have 1 active actors on pipe
2025-10-15T11:01:07.726238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401881921785259:2467], now have 1 active actors on pipe
2025-10-15T11:01:07.726264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401884721476117:8627]
2025-10-15T11:01:07.726284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401884721476117:8627]
2025-10-15T11:01:07.726298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401884721476117:8627]
2025-10-15T11:01:07.726335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:07.726370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 892
2025-10-15T11:01:07.726384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:07.726408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:07.726410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:07.726418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:07.726477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 892, pipe: [1:7561401881921785274:9630]
2025-10-15T11:01:07.726544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 892
2025-10-15T11:01:07.726588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:07.726614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:07.726762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:07.726788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:07.726821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401884721476117:8627]
2025-10-15T11:01:07.726854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:07.726908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:07.726914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:07.726926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:07.726956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_10_14544789689558060916_v1 on pipe: [1:7561401881921785274:9630]
2025-10-15T11:01:07.727088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:07.727131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:07.727165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:07.727177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:07.727228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:07.727275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:07.727376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:07.727399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:07.727411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:07.727478Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_10_14544789689558060916_v1
2025-10-15T11:01:07.727493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:07.727611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:07.727696Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T11:01:07.728103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:07.728132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:07.728190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:07.728241Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_10_14544789689558060916_v1:1 with generation 892
2025-10-15T11:01:07.729266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|331aa1e4-ff8436f0-69fe3cb6-b11c9012_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:07.728503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 893 partition: 0 MaxSeqNo: 46 sessionId: src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0
2025-10-15T11:01:07.735632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T11:01:07.735715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T11:01:07.735741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:07.735757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:07.735768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:07.735813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T11:01:07.735848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T11:01:07.736205Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760526067727 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T11:01:07.736265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T11:01:07.736351Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 sending to client partition status
2025-10-15T11:01:07.757180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0] Write session: try to update token
2025-10-15T11:01:07.757243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:07.792606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:07.792640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:07.792652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:07.792661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:07.792700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401884721476117:8627]
2025-10-15T11:01:07.792727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401884721476117:8627]
2025-10-15T11:01:07.792751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401884721476117:8627]
2025-10-15T11:01:07.792897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:07.792927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:07.793021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:07.793056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:07.793080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:07.796521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:07.835873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId: src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:07.861040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:07.946452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:07.949721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:07.949755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:07.952228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:07.952273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:07.953146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401881921785274:9630]
2025-10-15T11:01:07.953215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:07.960959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 893 reason: error at write: Disconnected sessionId: src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0
2025-10-15T11:01:07.961314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 893 sessionId: src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0 is DEAD
2025-10-15T11:01:07.961693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:07.961730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0] Write session will restart in 0.006438s
2025-10-15T11:01:07.961831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0] Write session: Do CDS request
2025-10-15T11:01:07.961876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:07.972310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_10_14544789689558060916_v1
2025-10-15T11:01:07.972352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:07.972617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:07.972457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:07.972501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 894
2025-10-15T11:01:07.973150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:07.973331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:07.973357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:07.973371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:07.975597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 894 sessionId:  describe result for acl check
2025-10-15T11:01:07.976068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:07.976094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:07.976109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:07.976138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401881921785516:9636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:07.980537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401881921785516:9636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:07.980607Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_10_14544789689558060916_v1
2025-10-15T11:01:07.986663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401881921785516:9636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:07.995583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401881921785516:9636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:07.995626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401881921785516:9636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:07.995643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401881921785516:9636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:07.995674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:08.033349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:08.035116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:08.035772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:08.035807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:08.035846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:08.036031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:08.036172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401889016443644:8635]
2025-10-15T11:01:08.037674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:08.038521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:08.038704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:08.039941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:08.040241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.040257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.040264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.040271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.040277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.040284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.040291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.040299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.040306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.040314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.040321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.040328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.040336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.040343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.040388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.040493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.040548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.040598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.040647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.040698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.040761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.040809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.040857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.040911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.040961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.041010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.041062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.041112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.041156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.041225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.041288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.041349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.041400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.041458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.041511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.041571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.041624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.041682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.041734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.041790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.041841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.041898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.041945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.042000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.042048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.042104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.042149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.042199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.042244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.042295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.042345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.042407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.042453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.042507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.042562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.042620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.043082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:08.053403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401886216753032:9630]
2025-10-15T11:01:08.063812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:08.089476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:08.089523Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:08.089541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:08.089559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:08.089584Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 893 [2:7561401889016443644:8635]
2025-10-15T11:01:08.089633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:08.089692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:08.089706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:08.089719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:08.089730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:08.089782Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:08.089807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:08.089830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:08.091435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.091464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.091478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.091498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:08.091810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:08.091836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.091984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.092196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.092213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 893
2025-10-15T11:01:08.092311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 893, pipe: [1:7561401886216753032:9630]
2025-10-15T11:01:08.092405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 893
2025-10-15T11:01:08.092435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:08.092522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401881921785503:2467], now have 1 active actors on pipe
2025-10-15T11:01:08.092551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401886216753032:9630], now have 1 active actors on pipe
2025-10-15T11:01:08.092573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401881921785554:9636], now have 1 active actors on pipe
2025-10-15T11:01:08.092603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401889016443639:8635]
2025-10-15T11:01:08.092622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401889016443639:8635]
2025-10-15T11:01:08.092635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401889016443639:8635]
2025-10-15T11:01:08.092674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:08.092716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:08.092732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:08.092743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:08.092754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:08.092935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:08.092959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:08.093120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:08.093147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:08.093178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401889016443639:8635]
2025-10-15T11:01:08.093204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:08.093236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:08.093315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2141720d-54177e0-a59c01e4-1fe7088b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:08.093350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:08.093373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:08.093383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:08.093419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:08.093464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:08.093540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:08.094080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:08.094109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:08.094180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:08.094541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 894 partition: 0 MaxSeqNo: 46 sessionId: src_id|2141720d-54177e0-a59c01e4-1fe7088b_0
2025-10-15T11:01:08.095563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fa40f9-9e0a8630-363cd117-6e30f00b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2141720d-54177e0-a59c01e4-1fe7088b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:08.125270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2141720d-54177e0-a59c01e4-1fe7088b_0] Write session: try to update token
2025-10-15T11:01:08.125334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2141720d-54177e0-a59c01e4-1fe7088b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:08.214156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:08.214191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:08.214203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:08.214282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:08.214298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:08.214311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:08.214327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:08.214367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401889016443639:8635]
2025-10-15T11:01:08.214394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401889016443639:8635]
2025-10-15T11:01:08.214417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401889016443639:8635]
2025-10-15T11:01:08.214539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:08.214581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:08.214617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:08.214636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:08.214659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:08.220272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:08.245806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId: src_id|2141720d-54177e0-a59c01e4-1fe7088b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:08.267501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:08.364472Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:08.382897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:08.382945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:08.381800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:08.381867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:08.381940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:08.381953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:08.381994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401889016443639:8635]
2025-10-15T11:01:08.382397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:08.382623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:08.396858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:08.397021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401886216753032:9630]
2025-10-15T11:01:08.397093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 894 reason: error at write: Disconnected sessionId: src_id|2141720d-54177e0-a59c01e4-1fe7088b_0
2025-10-15T11:01:08.397474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 894 sessionId: src_id|2141720d-54177e0-a59c01e4-1fe7088b_0 is DEAD
2025-10-15T11:01:08.397903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2141720d-54177e0-a59c01e4-1fe7088b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:08.397953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2141720d-54177e0-a59c01e4-1fe7088b_0] Write session will restart in 0.008289s
2025-10-15T11:01:08.398113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2141720d-54177e0-a59c01e4-1fe7088b_0] Write session: Do CDS request
2025-10-15T11:01:08.398162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2141720d-54177e0-a59c01e4-1fe7088b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:08.410097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2141720d-54177e0-a59c01e4-1fe7088b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:08.411612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:08.411648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 895
2025-10-15T11:01:08.415612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:08.415813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:08.415842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:08.415853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:08.417236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 895 sessionId:  describe result for acl check
2025-10-15T11:01:08.417357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:08.417374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:08.417383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:08.417400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401886216753072:9647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:08.421153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401886216753072:9647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:08.432285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401886216753072:9647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:08.445839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401886216753072:9647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:08.445891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401886216753072:9647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:08.445908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401886216753072:9647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:08.445941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:08.486401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:08.490534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:08.491441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:08.491468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:08.491511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:08.491779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:08.491981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401889016443908:8643]
2025-10-15T11:01:08.494260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:08.495283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:08.495545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:08.496876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:08.497226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.497248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.497256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.497262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.497271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.497278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.497287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.497295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.497302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.497310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.497317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.497324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.497332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.497339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.497388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.497502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.497549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.497594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.497642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.497716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.497270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401886216753290:9630]
2025-10-15T11:01:08.497771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.497825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.497870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.497917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.497963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.498010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.498060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.498105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.498155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.498228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.498290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.498345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.498394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.498449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.498492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.498543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.498590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.498644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.498690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.498747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.498800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.498859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.498911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.498971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.499020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.499077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.499127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.499184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.499231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.499286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.499334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.499838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.499942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.500009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.500075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.500139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.500718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:08.522277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:08.539998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:08.540053Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:08.540069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:08.540086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:08.540110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 894 [2:7561401889016443908:8643]
2025-10-15T11:01:08.540160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:08.540219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:08.540233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:08.540246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:08.540257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:08.540306Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:08.540327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:08.540348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:08.541495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.541530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.541544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.541554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:08.541829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:08.541854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.541992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.542187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.542429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:08.542512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401886216753290:9630], now have 1 active actors on pipe
2025-10-15T11:01:08.542543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401886216753148:9647], now have 1 active actors on pipe
2025-10-15T11:01:08.542562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401886216753061:2467], now have 1 active actors on pipe
2025-10-15T11:01:08.542309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 894, pipe: [1:7561401886216753290:9630]
2025-10-15T11:01:08.542591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401889016443903:8643]
2025-10-15T11:01:08.542443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 894
2025-10-15T11:01:08.542610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401889016443903:8643]
2025-10-15T11:01:08.542521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 894
2025-10-15T11:01:08.542623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401889016443903:8643]
2025-10-15T11:01:08.542660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:08.542717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:08.542729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:08.542742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:08.542752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:08.542905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:08.542927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:08.543055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:08.543079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:08.543125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401889016443903:8643]
2025-10-15T11:01:08.543161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:08.543204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:08.543264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:08.543291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:08.543312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:08.543322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:08.543371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:08.543407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:08.543492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:08.543966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:08.543992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:08.544049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:08.544278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 895 partition: 0 MaxSeqNo: 46 sessionId: src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0
2025-10-15T11:01:08.544959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2141720d-54177e0-a59c01e4-1fe7088b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:08.566523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0] Write session: try to update token
2025-10-15T11:01:08.566577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:08.670734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:08.670780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:08.670795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:08.670808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:08.670847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401889016443903:8643]
2025-10-15T11:01:08.670876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401889016443903:8643]
2025-10-15T11:01:08.670901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401889016443903:8643]
2025-10-15T11:01:08.671042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:08.671107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:08.671108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:08.671123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:08.671136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:08.671138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:08.678946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId: src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:08.684536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:08.684586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:08.685913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:08.700298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:08.830143Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:08.843781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:08.843838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:08.843885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401889016443903:8643]
2025-10-15T11:01:08.844011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:08.844038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:08.844062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:08.844614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401886216753290:9630]
2025-10-15T11:01:08.844638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:08.844711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:08.844653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:08.844701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:08.870270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 895 reason: error at write: Disconnected sessionId: src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0
2025-10-15T11:01:08.870554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 895 sessionId: src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0 is DEAD
2025-10-15T11:01:08.870963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:08.871027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0] Write session will restart in 0.008362s
2025-10-15T11:01:08.871221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0] Write session: Do CDS request
2025-10-15T11:01:08.871265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:08.885295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:08.885340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 896
2025-10-15T11:01:08.885508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:08.887174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:08.887264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:08.887292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:08.887302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:08.888900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 896 sessionId:  describe result for acl check
2025-10-15T11:01:08.889014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:08.889033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:08.889044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:08.889061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401886216753332:9655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:08.891524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401886216753332:9655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:08.900022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401886216753332:9655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:08.907891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401886216753332:9655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:08.907936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401886216753332:9655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:08.907955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401886216753332:9655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:08.907986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:08.932738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:08.935081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:08.936090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:08.936122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:08.936169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:08.936566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:08.936777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401889016444138:8648]
2025-10-15T11:01:08.939780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:08.940970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:08.941212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:08.942523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:08.942872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.942892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.942900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.942907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.942913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.942922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.942929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.942937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.942944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.942952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.942960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.942967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.942974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.942982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.943032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.943153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.943202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.943253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.943301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.943380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.943433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.943490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.943541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.943595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.943648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.943699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.943752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.943816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.943868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.943946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:08.944017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.944081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:08.944138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.944200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:08.944254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.944317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:08.944373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.944428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:08.944482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.944538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:08.944595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.944786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:08.944728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401886216753527:9630]
2025-10-15T11:01:08.944842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.944905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:08.944962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.945024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:08.945079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.945142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:08.945197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.945259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:08.945313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.945376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:08.945431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.945495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:08.945552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.945612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:08.946173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:08.972616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:08.981922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:08.981971Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:08.981990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:08.982012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:08.982041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 895 [2:7561401889016444138:8648]
2025-10-15T11:01:08.982098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:08.982164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:08.982181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:08.982195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:08.982206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:08.982258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:08.982280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:08.982306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:09.015198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.015228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.015240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.015251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:09.015766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:09.015802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.015938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.015901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 895
2025-10-15T11:01:09.015925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 895, pipe: [1:7561401886216753527:9630]
2025-10-15T11:01:09.016018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 895
2025-10-15T11:01:09.016097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.016298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:09.016390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401886216753301:2467], now have 1 active actors on pipe
2025-10-15T11:01:09.016417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401886216753527:9630], now have 1 active actors on pipe
2025-10-15T11:01:09.016439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401886216753466:9655], now have 1 active actors on pipe
2025-10-15T11:01:09.016505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:09.016530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:09.016570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401889016444133:8648]
2025-10-15T11:01:09.016591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401889016444133:8648]
2025-10-15T11:01:09.016604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401889016444133:8648]
2025-10-15T11:01:09.016640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:09.016692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:09.016712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:09.016715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:09.016727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:09.016891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:09.016916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:09.016987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:09.017022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:09.017043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:09.017053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:09.017090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:09.017134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:09.017269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401889016444133:8648]
2025-10-15T11:01:09.017300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:09.017346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:09.017392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:09.019177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:09.019215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:09.019290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:09.019630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 896 partition: 0 MaxSeqNo: 46 sessionId: src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0
2025-10-15T11:01:09.020607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87fb0ade-c24e4f70-f901b03c-69417d55_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:09.040064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0] Write session: try to update token
2025-10-15T11:01:09.040119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:09.056345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:09.056378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:09.056415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401889016444133:8648]
2025-10-15T11:01:09.056529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:09.056586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:09.058295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:09.059616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:09.064833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:09.066407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:09.068442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:09.069120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:09.082550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:09.082582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:09.082596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:09.127815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:09.127856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:09.127869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:09.127880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:09.127932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401889016444133:8648]
2025-10-15T11:01:09.127957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401889016444133:8648]
2025-10-15T11:01:09.127985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401889016444133:8648]
2025-10-15T11:01:09.128138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:09.128169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:09.128298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:09.128341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:09.128371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:09.129753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:09.133004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId: src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:09.153708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:09.276987Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:09.280005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:09.280047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:09.280860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:09.282569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:09.282807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401886216753527:9630]
2025-10-15T11:01:09.282926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:09.298120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 896 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0
2025-10-15T11:01:09.298427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 896 sessionId: src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0 is DEAD
2025-10-15T11:01:09.299790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:09.299835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0] Write session will restart in 0.008896s
2025-10-15T11:01:09.299924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0] Write session: Do CDS request
2025-10-15T11:01:09.299950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:09.314441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:09.314468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 897
2025-10-15T11:01:09.314818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:09.315204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:09.315281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:09.315290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:09.315298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:09.316181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 897 sessionId:  describe result for acl check
2025-10-15T11:01:09.316282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:09.316297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:09.316306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:09.316322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401890511720866:9660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:09.317950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401890511720866:9660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:09.325764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401890511720866:9660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:09.334006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401890511720866:9660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:09.334052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401890511720866:9660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:09.334074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401890511720866:9660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:09.334107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:09.383500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401890511721034:9630]
2025-10-15T11:01:09.404848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:09.411449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:09.412323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:09.412353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:09.412395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:09.412643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:09.412829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401893311411687:8656]
2025-10-15T11:01:09.415012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:09.415950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:09.416163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:09.417430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:09.417761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:09.417778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:09.417786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:09.417794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:09.417800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:09.417807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:09.417814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:09.417822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:09.417829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:09.417835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:09.417844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:09.417851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.417858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.417867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.417912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:09.418024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:09.418071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:09.418117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:09.418163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:09.418212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:09.418267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:09.418318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:09.418371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:09.418424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:09.418474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:09.418528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.418577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.418630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.418681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:09.418752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:09.418815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:09.419177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:09.419249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:09.419311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:09.419379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:09.419444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:09.419490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:09.419561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:09.419611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:09.419670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:09.419723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:09.419793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:09.419861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:09.419928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:09.419984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:09.420039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:09.420088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:09.420149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:09.420198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:09.420255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:09.420304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.420361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.420411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.420467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.420517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.420575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.421079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:09.441623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:09.453636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:09.453682Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:09.453697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:09.453713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:09.453735Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 896 [2:7561401893311411687:8656]
2025-10-15T11:01:09.453785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:09.453834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:09.453846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:09.453859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:09.453868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:09.453912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:09.453932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:09.453951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:09.456685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.456716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.456728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.456738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:09.457020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:09.457036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.457170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.457345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.457595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:09.457661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401893311411681:8656]
2025-10-15T11:01:09.457673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401893311411681:8656]
2025-10-15T11:01:09.457685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401893311411681:8656]
2025-10-15T11:01:09.457725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:09.457796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:09.457966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:09.457981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:09.458092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401893311411681:8656]
2025-10-15T11:01:09.458110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:09.459885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 896
2025-10-15T11:01:09.459990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 896
2025-10-15T11:01:09.460032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 896, pipe: [1:7561401890511721034:9630]
2025-10-15T11:01:09.459119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:09.459140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:09.459151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:09.459171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:09.461142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401890511720849:2467], now have 1 active actors on pipe
2025-10-15T11:01:09.461177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401890511720896:9660], now have 1 active actors on pipe
2025-10-15T11:01:09.461200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401890511721034:9630], now have 1 active actors on pipe
2025-10-15T11:01:09.461260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:09.461280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:09.461349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:09.461377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:09.461394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:09.461404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:09.461437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:09.461476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:09.461517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:09.462929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:09.462957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:09.463021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:09.463520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 897 partition: 0 MaxSeqNo: 46 sessionId: src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0
2025-10-15T11:01:09.464372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac547f0-7f55b916-ef47123e-83b8fae6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:09.505521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:09.505550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:09.505576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401893311411681:8656]
2025-10-15T11:01:09.505673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:09.507221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:09.507515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:09.508606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:09.510571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:09.512015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:09.513732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:09.514303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:09.520252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0] Write session: try to update token
2025-10-15T11:01:09.520306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:09.618319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:09.618353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:09.618365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:09.618426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:09.618442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:09.618457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:09.618468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:09.618512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401893311411681:8656]
2025-10-15T11:01:09.618541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401893311411681:8656]
2025-10-15T11:01:09.618564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401893311411681:8656]
2025-10-15T11:01:09.618701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:09.618723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:09.619447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:09.619482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:09.619509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:09.621219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:09.646842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId: src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:09.668991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:09.776659Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:09.778720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:09.778752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:09.780637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:09.779515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:09.797478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401890511721034:9630]
2025-10-15T11:01:09.797583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:09.797829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 897 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0
2025-10-15T11:01:09.798208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 897 sessionId: src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0 is DEAD
2025-10-15T11:01:09.798558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 334 BytesWritten: 103628882 MessagesWritten: 46 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-15T11:01:09.798765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:09.798828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0] Write session will restart in 0.005037s
2025-10-15T11:01:09.799023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0] Write session: Do CDS request
2025-10-15T11:01:09.799078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:09.809054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:09.824388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:09.824427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 898
2025-10-15T11:01:09.825320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:09.825501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:09.825524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:09.825537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:09.832986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 898 sessionId:  describe result for acl check
2025-10-15T11:01:09.833145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:09.833166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:09.833184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:09.833203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401890511721146:9674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:09.836060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401890511721146:9674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:09.849523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401890511721146:9674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:09.859937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401890511721146:9674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:09.859989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401890511721146:9674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:09.860007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401890511721146:9674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:09.860041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:09.881434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:09.888326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:09.889238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:09.889259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:09.889308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:09.889592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:09.889775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401893311411936:8665]
2025-10-15T11:01:09.892152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:09.893844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:09.894064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:09.895389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:09.895734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:09.895757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:09.895765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:09.895773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:09.895781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:09.895788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:09.895796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:09.895803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:09.895825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:09.895832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:09.895839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:09.895846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.895854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.895862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.895911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:09.896026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:09.896077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:09.896139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:09.896192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:09.896247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:09.896296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:09.896348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:09.896401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:09.896454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:09.896509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:09.896561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.896613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.896666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.896716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:09.896793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:09.896858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:09.896939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:09.896996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:09.897055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:09.897107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:09.897169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:09.897225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:09.897291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:09.897346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:09.897400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:09.897455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:09.897513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:09.897567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:09.897631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:09.897585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401890511721339:9630]
2025-10-15T11:01:09.897688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:09.897755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:09.897810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:09.897872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:09.897925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:09.897988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:09.898042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.898105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.898159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.898220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.898272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.898333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.898870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:09.918032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:09.936428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:09.936474Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:09.936491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:09.936523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:09.936551Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 897 [2:7561401893311411936:8665]
2025-10-15T11:01:09.936603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:09.936665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:09.936680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:09.936695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:09.936706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:09.936758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:09.936791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:09.936814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:09.938582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.938611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.938625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.938636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:09.938884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:09.938909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:09.939041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:09.939185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 897, pipe: [1:7561401890511721339:9630]
2025-10-15T11:01:09.939280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 897
2025-10-15T11:01:09.939286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 897
2025-10-15T11:01:09.939251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:09.939504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:09.939587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401890511721339:9630], now have 1 active actors on pipe
2025-10-15T11:01:09.939618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401890511721110:2467], now have 1 active actors on pipe
2025-10-15T11:01:09.939648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401890511721289:9674], now have 1 active actors on pipe
2025-10-15T11:01:09.939706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:09.939722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:09.939754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401893311411931:8665]
2025-10-15T11:01:09.939768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401893311411931:8665]
2025-10-15T11:01:09.939779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401893311411931:8665]
2025-10-15T11:01:09.939826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:09.939890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:09.939890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:09.939906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:09.939929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:09.940053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:09.940071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:09.940129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:09.940153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:09.940169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:09.940179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:09.940210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:09.940247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:09.940358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401893311411931:8665]
2025-10-15T11:01:09.940387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:09.940416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:09.940427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:09.941091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:09.941121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:09.941220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:09.941691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 898 partition: 0 MaxSeqNo: 46 sessionId: src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0
2025-10-15T11:01:09.942388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af2c706-d9fd91f0-210832fb-e114ccd6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:09.970427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0] Write session: try to update token
2025-10-15T11:01:09.970480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:10.068995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:10.069026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:10.069044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:10.069055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:10.069084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401893311411931:8665]
2025-10-15T11:01:10.069117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401893311411931:8665]
2025-10-15T11:01:10.069143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401893311411931:8665]
2025-10-15T11:01:10.069302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:10.069348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:10.069359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:10.069380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:10.069390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:10.069424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:10.069427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:10.069441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:10.072881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:10.091178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId: src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:10.119613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:10.208768Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:10.226007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:10.226059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:10.226125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:10.226138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:10.226177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401893311411931:8665]
2025-10-15T11:01:10.226522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:10.226816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:10.227190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:10.227215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401890511721339:9630]
2025-10-15T11:01:10.227293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:10.235137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 898 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0
2025-10-15T11:01:10.235744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:10.235778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0] Write session will restart in 0.007795s
2025-10-15T11:01:10.235928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0] Write session: Do CDS request
2025-10-15T11:01:10.235983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:10.235624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 898 sessionId: src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0 is DEAD
2025-10-15T11:01:10.248027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:10.255664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:10.255716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 899
2025-10-15T11:01:10.256239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:10.256466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:10.256497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:10.256513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:10.258901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 899 sessionId:  describe result for acl check
2025-10-15T11:01:10.259066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:10.259096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:10.259115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:10.259143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401894806688677:9685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:10.261474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401894806688677:9685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:10.271475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401894806688677:9685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:10.282969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401894806688677:9685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:10.283013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401894806688677:9685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:10.283028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401894806688677:9685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:10.283057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:10.327952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401894806688871:9630]
2025-10-15T11:01:10.347431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:10.353370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:10.354393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:10.354430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:10.354480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:10.354787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:10.354991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401897606379483:8669]
2025-10-15T11:01:10.357388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:10.358380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:10.358612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:10.360084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:10.360475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:10.360484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:10.360493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:10.360501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:10.360509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:10.360517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:10.360525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:10.360533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:10.360540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:10.360548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:10.360556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:10.360565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.360572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.360580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.360636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:10.360758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:10.360810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:10.360861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:10.360907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:10.360959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:10.361008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:10.361056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:10.361106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:10.361158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:10.361212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:10.361260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.361307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.361353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.361400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:10.361490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:10.361556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:10.361616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:10.361667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:10.361731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:10.361783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:10.361842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:10.361898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:10.361958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:10.362009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:10.362067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:10.362121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:10.362178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:10.362225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:10.362281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:10.362336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:10.362400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:10.362448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:10.362505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:10.362558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:10.362617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:10.362669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.362730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.362781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.362841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.362889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.362950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.364531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:10.392782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:10.421391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:10.421434Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:10.421446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:10.421461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:10.421483Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 898 [2:7561401897606379483:8669]
2025-10-15T11:01:10.421524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:10.421576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:10.421589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:10.421600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:10.421610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:10.421647Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:10.421665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:10.421682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:10.423117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 898
2025-10-15T11:01:10.423200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 898, pipe: [1:7561401894806688871:9630]
2025-10-15T11:01:10.422498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.423270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 898
2025-10-15T11:01:10.422517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.422526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.422534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:10.422719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:10.422732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.422835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.422978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.423212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:10.423294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401894806688725:9685], now have 1 active actors on pipe
2025-10-15T11:01:10.423317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401894806688871:9630], now have 1 active actors on pipe
2025-10-15T11:01:10.423339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401894806688659:2467], now have 1 active actors on pipe
2025-10-15T11:01:10.423586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401897606379478:8669]
2025-10-15T11:01:10.423602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401897606379478:8669]
2025-10-15T11:01:10.423612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401897606379478:8669]
2025-10-15T11:01:10.423639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:10.423696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:10.423953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:10.423958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:10.423977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:10.423979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:10.423991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:10.424021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:10.424038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:10.424147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401897606379478:8669]
2025-10-15T11:01:10.424166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:10.424217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c672cf30-628a30e3-8e80277c-f99a137_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:10.424239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:10.424252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:10.424259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:10.424266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:10.424289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:10.424318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:10.424404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:10.425340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:10.425372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:10.425443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:10.425691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 899 partition: 0 MaxSeqNo: 46 sessionId: src_id|c672cf30-628a30e3-8e80277c-f99a137_0
2025-10-15T11:01:10.426334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3119a332-93c6c2db-2587fb44-20b9f06b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c672cf30-628a30e3-8e80277c-f99a137_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:10.454772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c672cf30-628a30e3-8e80277c-f99a137_0] Write session: try to update token
2025-10-15T11:01:10.454836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c672cf30-628a30e3-8e80277c-f99a137_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:10.481850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:10.481892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:10.481936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401897606379478:8669]
2025-10-15T11:01:10.482074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:10.482288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:10.483895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:10.485101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:10.486267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:10.488802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:10.490573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:10.491038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:10.521194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:10.521228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:10.521241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:10.577010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId: src_id|c672cf30-628a30e3-8e80277c-f99a137_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:10.608909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:10.608940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:10.608953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:10.608962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:10.608998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401897606379478:8669]
2025-10-15T11:01:10.609025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401897606379478:8669]
2025-10-15T11:01:10.609045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401897606379478:8669]
2025-10-15T11:01:10.609181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:10.609205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:10.610437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:10.612213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:10.612281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:10.612317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:10.617381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:10.748031Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:10.756692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:10.756740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:10.757284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:10.757319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:10.757334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401894806688871:9630]
2025-10-15T11:01:10.757415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:10.757416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:10.776421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 899 reason: error at write: Disconnected sessionId: src_id|c672cf30-628a30e3-8e80277c-f99a137_0
2025-10-15T11:01:10.776746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 899 sessionId: src_id|c672cf30-628a30e3-8e80277c-f99a137_0 is DEAD
2025-10-15T11:01:10.777211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672cf30-628a30e3-8e80277c-f99a137_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:10.777274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672cf30-628a30e3-8e80277c-f99a137_0] Write session will restart in 0.006660s
2025-10-15T11:01:10.777442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672cf30-628a30e3-8e80277c-f99a137_0] Write session: Do CDS request
2025-10-15T11:01:10.777495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672cf30-628a30e3-8e80277c-f99a137_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:10.788376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:10.788415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 900
2025-10-15T11:01:10.788593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c672cf30-628a30e3-8e80277c-f99a137_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:10.789097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:10.789208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:10.789231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:10.789240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:10.790444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 900 sessionId:  describe result for acl check
2025-10-15T11:01:10.790549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:10.790571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:10.790580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:10.790596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401894806688929:9690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:10.793713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401894806688929:9690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:10.800725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401894806688929:9690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:10.808218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401894806688929:9690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:10.808266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401894806688929:9690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:10.808283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401894806688929:9690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:10.808317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:10.857591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401894806689137:9630]
2025-10-15T11:01:10.859597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:10.861743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:10.862577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:10.862609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:10.862657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:10.862924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:10.863131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401897606379728:8679]
2025-10-15T11:01:10.865365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:10.866185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:10.866330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:10.867284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:10.867634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:10.867648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:10.867653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:10.867659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:10.867664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:10.867669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:10.867674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:10.867679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:10.867684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:10.867691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:10.867699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:10.867707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.867715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.867721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.867769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:10.867892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:10.867941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:10.867993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:10.868043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:10.868095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:10.868146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:10.868197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:10.868246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:10.868298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:10.868346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:10.868396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.868438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.868482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.868531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:10.868602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:10.868664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:10.868725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:10.868778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:10.868836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:10.868886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:10.868944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:10.868996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:10.869055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:10.869106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:10.869166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:10.869216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:10.869274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:10.869321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:10.869381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:10.869437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:10.869495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:10.869549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:10.869603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:10.869657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:10.869713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:10.869764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.869823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.869872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.869930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.869979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.870036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.870550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:10.887201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:10.897292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:10.897328Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:10.897340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:10.897356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:10.897376Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 899 [2:7561401897606379728:8679]
2025-10-15T11:01:10.897422Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:10.897486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:10.897501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:10.897514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:10.897526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:10.897577Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:10.897600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:10.897624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:10.899449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.899478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.899493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.899505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:10.900146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 899, pipe: [1:7561401894806689137:9630]
2025-10-15T11:01:10.900249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 899
2025-10-15T11:01:10.900333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 899
2025-10-15T11:01:10.900557Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 9 CurrentSessionLifetimeMs: 422192 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T11:01:10.899799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:10.899835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:10.899979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:10.900143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:10.900316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:10.900399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401894806689137:9630], now have 1 active actors on pipe
2025-10-15T11:01:10.900423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401894806688913:2467], now have 1 active actors on pipe
2025-10-15T11:01:10.900439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401894806688958:9690], now have 1 active actors on pipe
2025-10-15T11:01:10.900458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401897606379723:8679]
2025-10-15T11:01:10.900469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401897606379723:8679]
2025-10-15T11:01:10.900480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401897606379723:8679]
2025-10-15T11:01:10.900501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:10.900555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:10.900600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:10.900614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:10.900626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:10.900723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:10.900738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:10.900926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:10.900942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:10.900967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401897606379723:8679]
2025-10-15T11:01:10.900991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:10.901040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:10.901104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:10.901137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:10.901159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:10.901169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:10.901207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:10.901248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:10.901328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:10.902274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:10.902304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:10.902371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:10.902626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 900 partition: 0 MaxSeqNo: 46 sessionId: src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0
2025-10-15T11:01:10.903474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c672cf30-628a30e3-8e80277c-f99a137_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:10.929214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0] Write session: try to update token
2025-10-15T11:01:10.929265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:11.071221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:11.071257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:11.071269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:11.071320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:11.071333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:11.071364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:11.071373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:11.071407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401897606379723:8679]
2025-10-15T11:01:11.071439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401897606379723:8679]
2025-10-15T11:01:11.071470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401897606379723:8679]
2025-10-15T11:01:11.071601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:11.071621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:11.071721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:11.071758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:11.071784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:11.080401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:11.084759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId: src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:11.105615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:11.219736Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:11.221640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:11.221674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:11.225308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:11.225361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:11.235051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 900 reason: error at write: Disconnected sessionId: src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0
2025-10-15T11:01:11.235904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:11.235938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0] Write session will restart in 0.006153s
2025-10-15T11:01:11.236025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0] Write session: Do CDS request
2025-10-15T11:01:11.236050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:11.236743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 900 sessionId: src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0 is DEAD
2025-10-15T11:01:11.249218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:11.265855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:11.294955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:11.294988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 901
2025-10-15T11:01:11.297470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401894806689137:9630]
2025-10-15T11:01:11.297522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:11.298011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:11.298116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:11.298131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:11.298139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:11.299169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 901 sessionId:  describe result for acl check
2025-10-15T11:01:11.299243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:11.299249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:11.299254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:11.299265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401899101656531:9701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:11.301617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401899101656531:9701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:11.307948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401899101656531:9701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:11.320420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401899101656531:9701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:11.320468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401899101656531:9701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:11.320483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401899101656531:9701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:11.320511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:11.352553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:11.354601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:11.355331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:11.355376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:11.355411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:11.355621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:11.355804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401901901347294:8686]
2025-10-15T11:01:11.357881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:11.358620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:11.358829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:11.359965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:11.360268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:11.360275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:11.360281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:11.360288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:11.360294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:11.360300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:11.360306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:11.360312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:11.360318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:11.360325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:11.360332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:11.360339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.360344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.360350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.360398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:11.360495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:11.360547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:11.360591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:11.360640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:11.360687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:11.360731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:11.360778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:11.360822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:11.360877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:11.360921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:11.360969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.361013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.361055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.361099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:11.361160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:11.361215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:11.361267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:11.361314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:11.361369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:11.361413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:11.361467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:11.361512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:11.361566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:11.361608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:11.361664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:11.361710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:11.361762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:11.361810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:11.361861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:11.361910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:11.361963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:11.362010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:11.362062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:11.362107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:11.362157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:11.362202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.362253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.362296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.362353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.362397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.362453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.362956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:11.383398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:11.402265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401899101656723:9630]
2025-10-15T11:01:11.409245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:11.409289Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:11.409304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:11.409321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:11.409346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 900 [2:7561401901901347294:8686]
2025-10-15T11:01:11.409395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:11.409450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:11.409463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:11.409475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:11.409486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:11.409529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:11.409550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:11.409571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:11.410646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.410660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.410672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.410684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:11.410936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:11.410951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.411079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.411251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.411489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:11.411552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401901901347281:8686]
2025-10-15T11:01:11.411566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401901901347281:8686]
2025-10-15T11:01:11.411579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401901901347281:8686]
2025-10-15T11:01:11.411617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:11.411686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:11.411758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:11.411773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:11.411786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:11.411866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:11.411882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:11.411993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401901901347281:8686]
2025-10-15T11:01:11.412012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:11.412070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:11.412113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401899101656723:9630], now have 1 active actors on pipe
2025-10-15T11:01:11.412134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401899101656644:9701], now have 1 active actors on pipe
2025-10-15T11:01:11.412154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401899101656521:2467], now have 1 active actors on pipe
2025-10-15T11:01:11.417264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:11.417306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:11.417392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ba1636c-3a2bf541-be7dac92-31471220_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:11.417433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:11.417450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:11.417461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:11.417499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:11.417554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:11.417611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:11.416793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 900
2025-10-15T11:01:11.416888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 900, pipe: [1:7561401899101656723:9630]
2025-10-15T11:01:11.416976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 900
2025-10-15T11:01:11.423852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:11.423892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:11.423972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:11.425404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 901 partition: 0 MaxSeqNo: 46 sessionId: src_id|2ba1636c-3a2bf541-be7dac92-31471220_0
2025-10-15T11:01:11.427686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59dd7015-c9be9e51-392840c5-b76cb84d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2ba1636c-3a2bf541-be7dac92-31471220_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:11.465362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba1636c-3a2bf541-be7dac92-31471220_0] Write session: try to update token
2025-10-15T11:01:11.465418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba1636c-3a2bf541-be7dac92-31471220_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:11.503390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:11.503425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:11.503439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:11.503451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:11.503488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401901901347281:8686]
2025-10-15T11:01:11.503514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401901901347281:8686]
2025-10-15T11:01:11.503539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401901901347281:8686]
2025-10-15T11:01:11.503662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:11.503673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:11.503692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:11.503720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:11.503755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:11.505837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:11.571049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId: src_id|2ba1636c-3a2bf541-be7dac92-31471220_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:11.593548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:11.650466Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:11.652118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:11.652152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:11.658096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:11.655441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401899101656723:9630]
2025-10-15T11:01:11.655496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:11.655509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:11.655522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:11.702399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 901 reason: error at write: Disconnected sessionId: src_id|2ba1636c-3a2bf541-be7dac92-31471220_0
2025-10-15T11:01:11.702704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 901 sessionId: src_id|2ba1636c-3a2bf541-be7dac92-31471220_0 is DEAD
2025-10-15T11:01:11.706758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba1636c-3a2bf541-be7dac92-31471220_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:11.706831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba1636c-3a2bf541-be7dac92-31471220_0] Write session will restart in 0.008106s
2025-10-15T11:01:11.706980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba1636c-3a2bf541-be7dac92-31471220_0] Write session: Do CDS request
2025-10-15T11:01:11.707029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba1636c-3a2bf541-be7dac92-31471220_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:11.721479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:11.721518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 902
2025-10-15T11:01:11.722058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba1636c-3a2bf541-be7dac92-31471220_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:11.722568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:11.722687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:11.722702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:11.722711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:11.724265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 902 sessionId:  describe result for acl check
2025-10-15T11:01:11.724393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:11.724414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:11.724425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:11.724444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401899101656808:9709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:11.727095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401899101656808:9709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:11.741616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401899101656808:9709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:11.752510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401899101656808:9709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:11.752558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401899101656808:9709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:11.752574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401899101656808:9709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:11.752608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:11.755679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401899101656957:9630]
2025-10-15T11:01:11.761465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:11.766397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:11.767368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:11.767401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:11.767446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:11.767707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:11.767911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401901901347532:8692]
2025-10-15T11:01:11.769588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:11.770551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:11.770852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:11.772362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:11.772768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:11.772790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:11.772798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:11.772805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:11.772812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:11.772821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:11.772827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:11.772835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:11.772844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:11.772851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:11.772859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:11.772867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.772875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.772884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.772941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:11.773062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:11.773110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:11.773158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:11.773209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:11.773260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:11.773305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:11.773362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:11.773418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:11.773504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:11.773556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:11.773606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.773656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.773705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.773757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:11.773840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:11.773914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:11.773981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:11.774034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:11.774093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:11.774144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:11.774200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:11.774237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:11.774279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:11.774310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:11.774351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:11.774398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:11.774458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:11.774506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:11.774564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:11.774624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:11.774692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:11.774751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:11.774822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:11.774880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:11.774953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:11.775005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.775063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.775113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.775169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.775227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.775298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.777023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:11.794965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:11.829688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:11.829732Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:11.829748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:11.829768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:11.829797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 901 [2:7561401901901347532:8692]
2025-10-15T11:01:11.829849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:11.829934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:11.829956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:11.829987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:11.830009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:11.830097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:11.830125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:11.830148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:11.831692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.831717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.831731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.831742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:11.832046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:11.832072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:11.832282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:11.832305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 901
2025-10-15T11:01:11.832407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 901
2025-10-15T11:01:11.832436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 901, pipe: [1:7561401899101656957:9630]
2025-10-15T11:01:11.832547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:11.832783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:11.832873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401899101656956:9709], now have 1 active actors on pipe
2025-10-15T11:01:11.832903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401899101656957:9630], now have 1 active actors on pipe
2025-10-15T11:01:11.832924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401899101656733:2467], now have 1 active actors on pipe
2025-10-15T11:01:11.832973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:11.833000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:11.833053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401901901347527:8692]
2025-10-15T11:01:11.833073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401901901347527:8692]
2025-10-15T11:01:11.833087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401901901347527:8692]
2025-10-15T11:01:11.833125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:11.833161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:11.833200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:11.833203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:11.833212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:11.833393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:11.833421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:11.833486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:11.833524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:11.833542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:11.833555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:11.833592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:11.833635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:11.833776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401901901347527:8692]
2025-10-15T11:01:11.833811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:11.833860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:11.833890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:11.834323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:11.834351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:11.834416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:11.834681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 902 partition: 0 MaxSeqNo: 46 sessionId: src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0
2025-10-15T11:01:11.835389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ba1636c-3a2bf541-be7dac92-31471220_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:11.854765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0] Write session: try to update token
2025-10-15T11:01:11.854810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:11.864065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:11.864100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:11.864138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401901901347527:8692]
2025-10-15T11:01:11.864258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:11.864282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:11.866392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:11.867676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:11.869001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:11.870366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:11.872176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:11.872652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:11.930393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:11.930432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:11.930444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:11.934625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId: src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:11.981680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:11.985595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:11.985625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:11.985637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:11.985647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:11.985682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401901901347527:8692]
2025-10-15T11:01:11.985708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401901901347527:8692]
2025-10-15T11:01:11.985733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401901901347527:8692]
2025-10-15T11:01:11.985848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:11.985886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:11.985899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:11.985916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:11.985922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:11.985955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:11.985975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:11.986939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:12.122236Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:12.124798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401899101656957:9630]
2025-10-15T11:01:12.124907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:12.125058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:12.125077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:12.124847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:12.144682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:12.144734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0] Write session will restart in 0.008007s
2025-10-15T11:01:12.144866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0] Write session: Do CDS request
2025-10-15T11:01:12.144914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:12.143730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 902 reason: error at write: Disconnected sessionId: src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0
2025-10-15T11:01:12.144246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 902 sessionId: src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0 is DEAD
2025-10-15T11:01:12.157371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:12.157443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 903
2025-10-15T11:01:12.157880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:12.158557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:12.158739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:12.158761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:12.158771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:12.160538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 903 sessionId:  describe result for acl check
2025-10-15T11:01:12.160701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:12.160728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:12.160746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:12.160768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401903396624292:9714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:12.163874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401903396624292:9714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:12.170118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401903396624292:9714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:12.176299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401903396624292:9714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:12.176337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401903396624292:9714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:12.176352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401903396624292:9714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:12.176376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:12.226212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401903396624443:9630]
2025-10-15T11:01:12.257087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:12.259034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:12.259840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:12.259882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:12.259921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:12.260148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:12.260328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401906196315076:8700]
2025-10-15T11:01:12.262319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:12.263203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:12.263421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:12.264595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:12.264887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:12.264903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:12.264911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:12.264917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:12.264924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:12.264930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:12.264936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:12.264942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:12.264949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:12.264955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:12.264962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:12.264967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.264973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.264978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.265017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:12.265108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:12.265150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:12.265189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:12.265232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:12.265275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:12.265326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:12.265375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:12.265415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:12.265461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:12.265503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:12.265547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.265590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.265631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.265675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:12.265732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:12.265789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:12.265841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:12.265888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:12.265937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:12.265980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:12.266029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:12.266076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:12.266129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:12.266170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:12.266220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:12.266263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:12.266315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:12.266355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:12.266405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:12.266451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:12.266500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:12.266543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:12.266595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:12.266641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:12.266692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:12.266751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.266811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.266855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.266904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.266945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.266993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.267461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:12.288997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:12.299522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:12.299569Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:12.299585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:12.299604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:12.299629Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 902 [2:7561401906196315076:8700]
2025-10-15T11:01:12.299683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:12.299738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:12.299753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:12.299765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:12.299775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:12.299821Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:12.299856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:12.299876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:12.301676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.301704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.301718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.301729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:12.301992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:12.302010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.302145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.302329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.302560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:12.302637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401903396624275:2467], now have 1 active actors on pipe
2025-10-15T11:01:12.302661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401903396624443:9630], now have 1 active actors on pipe
2025-10-15T11:01:12.302683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401903396624324:9714], now have 1 active actors on pipe
2025-10-15T11:01:12.302706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401906196315071:8700]
2025-10-15T11:01:12.302721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401906196315071:8700]
2025-10-15T11:01:12.302735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401906196315071:8700]
2025-10-15T11:01:12.302778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:12.302824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:12.302839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:12.302849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:12.302851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:12.303032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:12.303049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:12.303159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401906196315071:8700]
2025-10-15T11:01:12.303190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:12.303209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:12.304610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 902
2025-10-15T11:01:12.304700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 902, pipe: [1:7561401903396624443:9630]
2025-10-15T11:01:12.304781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 902
2025-10-15T11:01:12.305178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:12.305211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:12.305282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:12.305310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:12.305335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:12.305345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:12.305379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:12.305415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:12.305456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:12.305884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:12.305907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:12.305962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:12.307649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 903 partition: 0 MaxSeqNo: 46 sessionId: src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0
2025-10-15T11:01:12.311552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d986e0c-a46eb9a1-7879e6e2-f5de2a00_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:12.364565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0] Write session: try to update token
2025-10-15T11:01:12.364616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:12.442858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:12.442899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:12.442910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:12.442966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:12.442981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:12.442991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:12.443000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:12.443032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401906196315071:8700]
2025-10-15T11:01:12.443057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401906196315071:8700]
2025-10-15T11:01:12.443082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401906196315071:8700]
2025-10-15T11:01:12.443214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:12.443234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:12.443594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:12.443625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:12.443650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:12.444672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:12.510150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId: src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:12.538207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:12.607243Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:12.609762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:12.609808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:12.610955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:12.611196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401903396624443:9630]
2025-10-15T11:01:12.611310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:12.611329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:12.620433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 903 reason: error at write: Disconnected sessionId: src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0
2025-10-15T11:01:12.620767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 903 sessionId: src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0 is DEAD
2025-10-15T11:01:12.621705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:12.621749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0] Write session will restart in 0.006985s
2025-10-15T11:01:12.621907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0] Write session: Do CDS request
2025-10-15T11:01:12.621945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:12.635163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:12.636781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:12.654773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:12.654805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 904
2025-10-15T11:01:12.655132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:12.655245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:12.655260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:12.655268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:12.656445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 904 sessionId:  describe result for acl check
2025-10-15T11:01:12.656534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:12.656543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:12.656551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:12.656565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401903396624568:9725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:12.659546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401903396624568:9725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:12.667430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401903396624568:9725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:12.678253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401903396624568:9725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:12.678303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401903396624568:9725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:12.678319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401903396624568:9725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:12.678346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:12.708568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:12.710060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:12.710743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:12.710771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:12.710807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:12.711022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:12.711188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401906196315341:8708]
2025-10-15T11:01:12.711526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401903396624781:9630]
2025-10-15T11:01:12.713239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:12.714097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:12.714294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:12.715500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:12.715814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:12.715833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:12.715839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:12.715847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:12.715866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:12.715890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:12.715903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:12.715911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:12.715919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:12.715926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:12.715932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:12.715939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.715945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.715953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.715996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:12.716093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:12.716137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:12.716180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:12.716219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:12.716262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:12.716301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:12.716343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:12.716383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:12.716427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:12.716468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:12.716509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.716552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.716595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.716634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:12.716695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:12.716746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:12.716795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:12.716843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:12.716891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:12.716932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:12.717005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:12.717057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:12.717109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:12.717150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:12.717195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:12.717242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:12.717291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:12.717332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:12.717383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:12.717452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:12.717505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:12.717547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:12.717598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:12.717639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:12.717686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:12.717726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.717773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.717814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.717861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.717900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.717947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.718387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:12.733722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:12.744581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:12.744627Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:12.744641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:12.744657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:12.744679Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 903 [2:7561401906196315341:8708]
2025-10-15T11:01:12.744724Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:12.744775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:12.744787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:12.744798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:12.744808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:12.744851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:12.744870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:12.744888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:12.746576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.746600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.746612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.746623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:12.746876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:12.746902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:12.747028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:12.747204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:12.747080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 903, pipe: [1:7561401903396624781:9630]
2025-10-15T11:01:12.747188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 903
2025-10-15T11:01:12.747257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 903
2025-10-15T11:01:12.747442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:12.747522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401903396624781:9630], now have 1 active actors on pipe
2025-10-15T11:01:12.747548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401903396624690:9725], now have 1 active actors on pipe
2025-10-15T11:01:12.747568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401903396624552:2467], now have 1 active actors on pipe
2025-10-15T11:01:12.747614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:12.747637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:12.747684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401906196315336:8708]
2025-10-15T11:01:12.747730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401906196315336:8708]
2025-10-15T11:01:12.747751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401906196315336:8708]
2025-10-15T11:01:12.747785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:12.747812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:12.747833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:12.747844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:12.747870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:12.748036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:12.748059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:12.748115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|416db44e-e5f336d2-35872fba-17337453_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:12.748146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:12.748167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:12.748177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:12.748219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:12.748263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:12.748390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401906196315336:8708]
2025-10-15T11:01:12.748422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:12.748439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:12.748463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:12.748989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:12.749016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:12.749075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:12.749379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 904 partition: 0 MaxSeqNo: 46 sessionId: src_id|416db44e-e5f336d2-35872fba-17337453_0
2025-10-15T11:01:12.750096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3db349a-2895162e-d517a0d6-b1e07ff9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|416db44e-e5f336d2-35872fba-17337453_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:12.769938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|416db44e-e5f336d2-35872fba-17337453_0] Write session: try to update token
2025-10-15T11:01:12.769988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|416db44e-e5f336d2-35872fba-17337453_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:12.805262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:12.805288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:12.805313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401906196315336:8708]
2025-10-15T11:01:12.805410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:12.805423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:12.813031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:12.819761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:12.820938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:12.863071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId: src_id|416db44e-e5f336d2-35872fba-17337453_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:12.867086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:12.868861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:12.869370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:12.869395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:12.869406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:12.869455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:12.888476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:12.895602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:12.895633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:12.895645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:12.895656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:12.895693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401906196315336:8708]
2025-10-15T11:01:12.895722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401906196315336:8708]
2025-10-15T11:01:12.895746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401906196315336:8708]
2025-10-15T11:01:12.895879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:12.895923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:12.895931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:12.895951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:12.895956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:12.895993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:12.896013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:12.896981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:13.033487Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:13.054661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:13.054791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401903396624781:9630]
2025-10-15T11:01:13.054857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:13.054867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:13.054382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:13.084589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416db44e-e5f336d2-35872fba-17337453_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:13.084634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416db44e-e5f336d2-35872fba-17337453_0] Write session will restart in 0.009005s
2025-10-15T11:01:13.084753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416db44e-e5f336d2-35872fba-17337453_0] Write session: Do CDS request
2025-10-15T11:01:13.084794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416db44e-e5f336d2-35872fba-17337453_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:13.083840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 904 reason: error at write: Disconnected sessionId: src_id|416db44e-e5f336d2-35872fba-17337453_0
2025-10-15T11:01:13.084165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 904 sessionId: src_id|416db44e-e5f336d2-35872fba-17337453_0 is DEAD
2025-10-15T11:01:13.104140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|416db44e-e5f336d2-35872fba-17337453_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:13.103148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:13.103209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 905
2025-10-15T11:01:13.105224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:13.105468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:13.105498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:13.105514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:13.109765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 905 sessionId:  describe result for acl check
2025-10-15T11:01:13.109874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:13.109884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:13.109894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:13.109910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401907691592153:9733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:13.112485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401907691592153:9733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:13.121186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401907691592153:9733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:13.134450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401907691592153:9733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:13.134494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401907691592153:9733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:13.134511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401907691592153:9733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:13.134542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:13.157841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401907691592337:9630]
2025-10-15T11:01:13.168718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:13.170543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:13.171236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:13.171253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:13.171289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:13.171534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:13.171698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401910491282882:8713]
2025-10-15T11:01:13.173554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:13.174560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:13.174751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:13.175880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:13.176166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:13.176184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:13.176189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:13.176195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:13.176201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:13.176207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:13.176214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:13.176220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:13.176227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:13.176233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:13.176237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:13.176243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.176248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.176254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.176294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:13.176383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:13.176427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:13.176466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:13.176507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:13.176546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:13.176586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:13.176624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:13.176667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:13.176707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:13.176744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:13.176781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.176817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.176852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.176890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:13.176946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:13.176998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:13.177047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:13.177086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:13.177128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:13.177169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:13.177213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:13.177253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:13.177298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:13.177335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:13.177382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:13.178253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:13.178324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:13.178374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:13.178427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:13.178481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:13.178534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:13.178578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:13.178630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:13.178678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:13.178728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:13.178773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.178826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.178868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.178921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.178968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.179019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.179482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:13.215615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:13.223263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:13.223303Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:13.223319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:13.223337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:13.223372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 904 [2:7561401910491282882:8713]
2025-10-15T11:01:13.223420Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:13.223472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:13.223491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:13.223502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:13.223511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:13.223554Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:13.223574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:13.223601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:13.224442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.224461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.224470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.224476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:13.224656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:13.224670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.224754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.224868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.225055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:13.225125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401910491282877:8713]
2025-10-15T11:01:13.225143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401910491282877:8713]
2025-10-15T11:01:13.225156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401910491282877:8713]
2025-10-15T11:01:13.225193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:13.225257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:13.225430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:13.225448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:13.225549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401910491282877:8713]
2025-10-15T11:01:13.225566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:13.226146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:13.226163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:13.226171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:13.226185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:13.226773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401907691592277:9733], now have 1 active actors on pipe
2025-10-15T11:01:13.226807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401907691592337:9630], now have 1 active actors on pipe
2025-10-15T11:01:13.226826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401907691592109:2467], now have 1 active actors on pipe
2025-10-15T11:01:13.226872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 904
2025-10-15T11:01:13.226908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 904, pipe: [1:7561401907691592337:9630]
2025-10-15T11:01:13.226968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 904
2025-10-15T11:01:13.227460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:13.227483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:13.227529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:13.227549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:13.227560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:13.227566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:13.227590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:13.227615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:13.227651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:13.228546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:13.228567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:13.228620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:13.228960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 905 partition: 0 MaxSeqNo: 46 sessionId: src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0
2025-10-15T11:01:13.229600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416db44e-e5f336d2-35872fba-17337453_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:13.266720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0] Write session: try to update token
2025-10-15T11:01:13.266776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:13.344207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:13.344235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:13.344247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:13.344257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:13.344283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401910491282877:8713]
2025-10-15T11:01:13.344306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401910491282877:8713]
2025-10-15T11:01:13.344326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401910491282877:8713]
2025-10-15T11:01:13.344462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:13.344472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:13.344482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:13.346489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:13.346521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:13.346550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:13.377930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:13.377963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:13.378688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:13.394464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId: src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:13.415828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:13.521617Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:13.522992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:13.523010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:13.523039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401910491282877:8713]
2025-10-15T11:01:13.523126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:13.523147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:13.523289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:13.523822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:13.523851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:13.523960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401907691592337:9630]
2025-10-15T11:01:13.524084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:13.524111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:13.548280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 905 reason: error at write: Disconnected sessionId: src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0
2025-10-15T11:01:13.548572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 905 sessionId: src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0 is DEAD
2025-10-15T11:01:13.552389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:13.552450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0] Write session will restart in 0.009606s
2025-10-15T11:01:13.552597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0] Write session: Do CDS request
2025-10-15T11:01:13.552640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:13.572675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:13.572288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:13.572321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 906
2025-10-15T11:01:13.575439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:13.575556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:13.575582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:13.575591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:13.576844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 906 sessionId:  describe result for acl check
2025-10-15T11:01:13.576942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:13.576953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:13.576961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:13.576976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401907691592387:9738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:13.579263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401907691592387:9738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:13.585372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401907691592387:9738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:13.599081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401907691592387:9738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:13.599124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401907691592387:9738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:13.599141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401907691592387:9738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:13.599169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:13.624542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401907691592527:9630]
2025-10-15T11:01:13.656153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:13.657921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:13.658794Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:13.658819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:13.658858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:13.659119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:13.659307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401910491283148:8718]
2025-10-15T11:01:13.661470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:13.662489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:13.662751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:13.664102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:13.664437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:13.664457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:13.664464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:13.664471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:13.664478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:13.664483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:13.664489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:13.664496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:13.664502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:13.664509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:13.664516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:13.664523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.664529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.664535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.664580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:13.664684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:13.664732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:13.664779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:13.664826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:13.664880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:13.664930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:13.664980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:13.665034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:13.665079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:13.665131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:13.665176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.665222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.665268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.665308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:13.665375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:13.665428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:13.665480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:13.665525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:13.665577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:13.665620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:13.665671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:13.665716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:13.665766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:13.665808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:13.665858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:13.665902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:13.665955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:13.665999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:13.666049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:13.666094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:13.666146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:13.666192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:13.666248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:13.666291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:13.666344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:13.666390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.666442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.666487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.666539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.666580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.666630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.667112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:13.682985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:13.698887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:13.698933Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:13.698949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:13.698966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:13.698989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 905 [2:7561401910491283148:8718]
2025-10-15T11:01:13.699037Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:13.699090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:13.699103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:13.699115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:13.699125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:13.699169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:13.699189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:13.699208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:13.701257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.701287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.701300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.701311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:13.701566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:13.701590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:13.701720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:13.701907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:13.702144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:13.702228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401907691592371:2467], now have 1 active actors on pipe
2025-10-15T11:01:13.702256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401907691592527:9630], now have 1 active actors on pipe
2025-10-15T11:01:13.702278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401907691592463:9738], now have 1 active actors on pipe
2025-10-15T11:01:13.702301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401910491283143:8718]
2025-10-15T11:01:13.702316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401910491283143:8718]
2025-10-15T11:01:13.702329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401910491283143:8718]
2025-10-15T11:01:13.702368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:13.702413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:13.702426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:13.702438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:13.702449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:13.702443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 905
2025-10-15T11:01:13.702557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 905, pipe: [1:7561401907691592527:9630]
2025-10-15T11:01:13.702621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:13.702648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 905
2025-10-15T11:01:13.702649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:13.702780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401910491283143:8718]
2025-10-15T11:01:13.702800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:13.702832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:13.702936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:13.702966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:13.703050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:13.703076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:13.703093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:13.703102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:13.703133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:13.703169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:13.703206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:13.703625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:13.703650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:13.703704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:13.703985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 906 partition: 0 MaxSeqNo: 46 sessionId: src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0
2025-10-15T11:01:13.704790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdbf1c1-7ff76282-2a17ba5e-d88cffd1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:13.725259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0] Write session: try to update token
2025-10-15T11:01:13.725313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:13.832227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:13.832264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:13.832276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:13.832288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:13.832319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401910491283143:8718]
2025-10-15T11:01:13.832342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401910491283143:8718]
2025-10-15T11:01:13.832363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401910491283143:8718]
2025-10-15T11:01:13.832479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:13.832508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:13.832519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:13.832531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:13.832533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:13.832560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:13.839079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId: src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:13.854923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:13.854967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:13.856124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:13.868330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:13.995246Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:13.997718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:13.997756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:13.997797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401910491283143:8718]
2025-10-15T11:01:13.997887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:13.997935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:13.997959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:13.998653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:13.999262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:13.999430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401907691592527:9630]
2025-10-15T11:01:13.999506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:14.029037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 906 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0
2025-10-15T11:01:14.029734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:14.029784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0] Write session will restart in 0.007619s
2025-10-15T11:01:14.029946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0] Write session: Do CDS request
2025-10-15T11:01:14.029984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:14.029329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 906 sessionId: src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0 is DEAD
2025-10-15T11:01:14.041681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:14.045145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:14.045182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 907
2025-10-15T11:01:14.045456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:14.045553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:14.045567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:14.045574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:14.046828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 907 sessionId:  describe result for acl check
2025-10-15T11:01:14.046935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:14.046950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:14.046960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:14.046976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401911986559951:9751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:14.049785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401911986559951:9751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:14.063523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401911986559951:9751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:14.077666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401911986559951:9751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:14.077715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401911986559951:9751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:14.077733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401911986559951:9751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:14.077767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:14.099532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401911986560162:9630]
2025-10-15T11:01:14.109071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:14.113189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:14.114046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:14.114078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:14.114121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:14.114374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:14.114598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401914786250699:8730]
2025-10-15T11:01:14.116886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:14.117884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:14.118099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:14.119315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:14.119649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.119670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.119678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.119687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.119693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.119702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.119710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.119718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.119724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.119731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.119739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.119747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.119755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.119762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.119806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.119933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.119989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.120037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.120092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.120145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.120197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.120248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.120298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.120352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.120397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.120449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.120501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.120555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.120608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.120681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.120744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.120803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.120856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.120911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.120962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.121022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.121075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.121135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.121188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.121248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.121302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.121365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.121416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.121479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.121535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.121596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.121648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.121710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.121763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.121826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.121879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.121938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.121996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.122058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.122110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.122176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.122715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:14.140044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:14.187381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:14.187431Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:14.187445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:14.187465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:14.187489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 906 [2:7561401914786250699:8730]
2025-10-15T11:01:14.187540Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:14.187598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:14.187611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:14.187623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:14.187634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:14.187686Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:14.187709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:14.187733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:14.189907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.189939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.189952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.189965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:14.190263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:14.190290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.190442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.190526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 906, pipe: [1:7561401911986560162:9630]
2025-10-15T11:01:14.190635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.190650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 906
2025-10-15T11:01:14.190748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 906
2025-10-15T11:01:14.190861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:14.190960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401911986560162:9630], now have 1 active actors on pipe
2025-10-15T11:01:14.190990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401907691592636:2467], now have 1 active actors on pipe
2025-10-15T11:01:14.191013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401911986560099:9751], now have 1 active actors on pipe
2025-10-15T11:01:14.191083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:14.191109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:14.191148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401914786250694:8730]
2025-10-15T11:01:14.191167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401914786250694:8730]
2025-10-15T11:01:14.191181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401914786250694:8730]
2025-10-15T11:01:14.191218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:14.191254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:14.191289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:14.191295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:14.191302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:14.191504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:14.191530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:14.191603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:14.191640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:14.191658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:14.191668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:14.191704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:14.191752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:14.191896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401914786250694:8730]
2025-10-15T11:01:14.191939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:14.191990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:14.191990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:14.192647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:14.192675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:14.192752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:14.193413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 907 partition: 0 MaxSeqNo: 46 sessionId: src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0
2025-10-15T11:01:14.194131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34b7047-4d85b974-c2d7f48b-956b428b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:14.212991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0] Write session: try to update token
2025-10-15T11:01:14.213043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:14.252280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:14.252324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:14.252349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:14.252363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:14.252414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401914786250694:8730]
2025-10-15T11:01:14.252458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401914786250694:8730]
2025-10-15T11:01:14.252500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401914786250694:8730]
2025-10-15T11:01:14.252662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:14.252720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:14.252758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:14.252804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:14.252837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:14.254809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:14.284149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId: src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:14.304855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:14.401732Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:14.421485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:14.421530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:14.421588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:14.421601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:14.421636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401914786250694:8730]
2025-10-15T11:01:14.421777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:14.422202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:14.422206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401911986560162:9630]
2025-10-15T11:01:14.422272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:14.422305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:14.422315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:14.470853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 907 reason: error at write: Disconnected sessionId: src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0
2025-10-15T11:01:14.471161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 907 sessionId: src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0 is DEAD
2025-10-15T11:01:14.471436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:14.471491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0] Write session will restart in 0.009402s
2025-10-15T11:01:14.471615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0] Write session: Do CDS request
2025-10-15T11:01:14.471651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:14.485160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:14.485227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 908
2025-10-15T11:01:14.485348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:14.485975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:14.486224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:14.486246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:14.486259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:14.488297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 908 sessionId:  describe result for acl check
2025-10-15T11:01:14.488469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:14.488505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:14.488521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:14.488548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401911986560411:9762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:14.491704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401911986560411:9762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:14.496609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401911986560411:9762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:14.497947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:14.499486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:14.500210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:14.500236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:14.500272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:14.500488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:14.500685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401914786250956:8735]
2025-10-15T11:01:14.502576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401911986560411:9762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:14.502615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401911986560411:9762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:14.502630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401911986560411:9762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:14.502657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:14.502715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:14.503482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:14.503678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:14.504827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:14.505137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.505151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.505158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.505165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.505171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.505177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.505183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.505190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.505196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.505203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.505210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.505216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.505222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.505229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.505272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.505373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.505422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.505466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.505511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.505567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.505616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.505664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.505716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.505764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.505809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.505854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.505899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.505941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.505981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.506041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.506097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.506147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.506194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.506246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.506299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.506353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.506410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.506462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.506513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.506569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.506620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.506679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.506722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.506779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.506829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.506887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.506936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.506986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.507034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.507090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.507139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.507198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.507249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.507302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.507437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.507500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.507993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:14.522515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401911986560448:9630]
2025-10-15T11:01:14.523687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:14.538236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:14.538284Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:14.538300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:14.538316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:14.538341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 907 [2:7561401914786250956:8735]
2025-10-15T11:01:14.538391Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:14.538446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:14.538463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:14.538476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:14.538486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:14.538529Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:14.538550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:14.538570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:14.539663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.539688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.539701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.539711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:14.539975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:14.539999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.540125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.540302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.540261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 907, pipe: [1:7561401911986560448:9630]
2025-10-15T11:01:14.540378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 907
2025-10-15T11:01:14.540448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 907
2025-10-15T11:01:14.540521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:14.540599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401911986560448:9630], now have 1 active actors on pipe
2025-10-15T11:01:14.540621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401911986560443:9762], now have 1 active actors on pipe
2025-10-15T11:01:14.540641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401911986560207:2467], now have 1 active actors on pipe
2025-10-15T11:01:14.540662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401914786250951:8735]
2025-10-15T11:01:14.540674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401914786250951:8735]
2025-10-15T11:01:14.540686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401914786250951:8735]
2025-10-15T11:01:14.540719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:14.540756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:14.540770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:14.540781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:14.540802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:14.540821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:14.540866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:14.541032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:14.541054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:14.541186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:14.541218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:14.541233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:14.541243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:14.541274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:14.541307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:14.541349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401914786250951:8735]
2025-10-15T11:01:14.541374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:14.541422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:14.541451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:14.541776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:14.541798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:14.541847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:14.542105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 908 partition: 0 MaxSeqNo: 46 sessionId: src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0
2025-10-15T11:01:14.542809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edbd44cf-8414227f-5ab9b2c-d6b3b8f3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:14.568602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0] Write session: try to update token
2025-10-15T11:01:14.568655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:14.575512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:14.575549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:14.575587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401914786250951:8735]
2025-10-15T11:01:14.575700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:14.575893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:14.577798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:14.579331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:14.580707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:14.582073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:14.583807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:14.584234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:14.677597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:14.677633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:14.677647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:14.677657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:14.677693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401914786250951:8735]
2025-10-15T11:01:14.677718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401914786250951:8735]
2025-10-15T11:01:14.677741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401914786250951:8735]
2025-10-15T11:01:14.677866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:14.677898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:14.677907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:14.677919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:14.677926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:14.677930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:14.677969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:14.677989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:14.681038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId: src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:14.681988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:14.702034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:14.818277Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:14.819641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:14.819679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:14.820362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:14.821245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:14.822053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:14.822282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401911986560448:9630]
2025-10-15T11:01:14.852374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 908 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0
2025-10-15T11:01:14.852677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 908 sessionId: src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0 is DEAD
2025-10-15T11:01:14.856837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:14.856908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0] Write session will restart in 0.009978s
2025-10-15T11:01:14.857062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0] Write session: Do CDS request
2025-10-15T11:01:14.857106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:14.872991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:14.873039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 909
2025-10-15T11:01:14.873882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:14.874943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:14.875108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:14.875127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:14.875138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:14.876836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 909 sessionId:  describe result for acl check
2025-10-15T11:01:14.876968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:14.876980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:14.876992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:14.877013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401911986560499:9766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:14.880022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401911986560499:9766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:14.890563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401911986560499:9766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:14.900433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401911986560499:9766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:14.900480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401911986560499:9766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:14.900490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401911986560499:9766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:14.900521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:14.919217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:14.922330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401911986560694:9630]
2025-10-15T11:01:14.924411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:14.925248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:14.925267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:14.925316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:14.925579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:14.925766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401914786251201:8738]
2025-10-15T11:01:14.928082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:14.929067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:14.929280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:14.930465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:14.930779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.930797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.930804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.930812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.930819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.930825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.930831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.930837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.930844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.930851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.930857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.930864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.930871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.930877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.930921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.931005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.931040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.931073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.931103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.931134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.931172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.931219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.931250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.931285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.931322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.931373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.931414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.931457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.931498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.931559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:14.931616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.931668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:14.931716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.931770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:14.931813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.931867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:14.931930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.931981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:14.932024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.932096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:14.932155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.932195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:14.932236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.932294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:14.932346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.932395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:14.932429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.932469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:14.932501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.932568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:14.932620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.932691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.932743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.932800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.932848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.932897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.933409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:14.956954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:14.967234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:14.967278Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:14.967294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:14.967312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:14.967337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 908 [2:7561401914786251201:8738]
2025-10-15T11:01:14.967437Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:14.967489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:14.967509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:14.967522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:14.967536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:14.967581Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:14.967608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:14.967627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:14.968697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.968725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.968738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.968749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:14.969004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:14.969027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:14.969161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:14.969318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 908
2025-10-15T11:01:14.969348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:14.969357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 908, pipe: [1:7561401911986560694:9630]
2025-10-15T11:01:14.969425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 908
2025-10-15T11:01:14.969588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:14.969664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401911986560456:2467], now have 1 active actors on pipe
2025-10-15T11:01:14.969694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401911986560694:9630], now have 1 active actors on pipe
2025-10-15T11:01:14.969714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401911986560609:9766], now have 1 active actors on pipe
2025-10-15T11:01:14.969775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:14.969797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:14.969829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401914786251195:8738]
2025-10-15T11:01:14.969848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401914786251195:8738]
2025-10-15T11:01:14.969861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401914786251195:8738]
2025-10-15T11:01:14.969895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:14.969939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:14.969958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:14.969962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:14.969973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:14.970124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:14.970146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:14.970203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|929afae8-962ea405-d6741e14-7062187c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:14.970235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:14.970255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:14.970264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:14.970294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:14.970328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:14.970442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401914786251195:8738]
2025-10-15T11:01:14.970471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:14.970490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:14.970515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:14.970972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:14.970998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:14.971054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:14.971306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 909 partition: 0 MaxSeqNo: 46 sessionId: src_id|929afae8-962ea405-d6741e14-7062187c_0
2025-10-15T11:01:14.975673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b40e47b4-e0b0dc4b-40822f82-775e13b1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|929afae8-962ea405-d6741e14-7062187c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:14.996699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|929afae8-962ea405-d6741e14-7062187c_0] Write session: try to update token
2025-10-15T11:01:14.996757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|929afae8-962ea405-d6741e14-7062187c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:14.999804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:14.999833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:14.999875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401914786251195:8738]
2025-10-15T11:01:15.000015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:15.003461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:15.005390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:15.006631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:15.008253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:15.009342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:15.011147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:15.011662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:15.068433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:15.068499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:15.068528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:15.107495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId: src_id|929afae8-962ea405-d6741e14-7062187c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:15.120226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:15.120265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:15.120282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:15.120295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:15.120341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401914786251195:8738]
2025-10-15T11:01:15.120374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401914786251195:8738]
2025-10-15T11:01:15.120399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401914786251195:8738]
2025-10-15T11:01:15.120527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:15.120564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:15.120567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:15.120591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:15.120597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:15.122155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:15.133470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:15.276237Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:15.278675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:15.278730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:15.279590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:15.279810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401911986560694:9630]
2025-10-15T11:01:15.279934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:15.279965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:15.283548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:15.335193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 909 reason: error at write: Disconnected sessionId: src_id|929afae8-962ea405-d6741e14-7062187c_0
2025-10-15T11:01:15.346295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|929afae8-962ea405-d6741e14-7062187c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:15.346355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|929afae8-962ea405-d6741e14-7062187c_0] Write session will restart in 0.009087s
2025-10-15T11:01:15.346498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|929afae8-962ea405-d6741e14-7062187c_0] Write session: Do CDS request
2025-10-15T11:01:15.346542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|929afae8-962ea405-d6741e14-7062187c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:15.341918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 909 sessionId: src_id|929afae8-962ea405-d6741e14-7062187c_0 is DEAD
2025-10-15T11:01:15.361045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|929afae8-962ea405-d6741e14-7062187c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:15.364981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:15.365025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 910
2025-10-15T11:01:15.366268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:15.366409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:15.366427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:15.366439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:15.368440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 910 sessionId:  describe result for acl check
2025-10-15T11:01:15.368566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:15.368578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:15.368588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:15.368608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401916281528044:9778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:15.372760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401916281528044:9778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:15.380825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401916281528079:9630]
2025-10-15T11:01:15.387106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401916281528044:9778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:15.405164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401916281528044:9778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:15.405211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401916281528044:9778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:15.405228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401916281528044:9778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:15.405260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:15.453643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:15.461841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:15.462998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:15.463021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:15.463068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:15.463371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:15.463578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401919081218762:8746]
2025-10-15T11:01:15.465847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:15.467183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:15.467450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:15.468904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:15.469246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:15.469255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:15.469263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:15.469270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:15.469276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:15.469283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:15.469290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:15.469297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:15.469305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:15.469312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:15.469319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:15.469327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.469334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.469341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.469389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:15.469508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:15.469561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:15.469608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:15.469656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:15.469701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:15.469746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:15.469792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:15.469837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:15.469885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:15.469930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:15.469974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.470020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.470064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.470107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:15.470173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:15.470232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:15.470285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:15.470332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:15.470388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:15.470431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:15.470483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:15.470533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:15.470594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:15.470639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:15.470694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:15.470740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:15.470795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:15.470841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:15.470895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:15.470942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:15.470995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:15.471040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:15.471096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:15.471143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:15.471195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:15.471242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.471297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.471493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.471557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.471606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.471661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.472227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:15.498067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:15.534538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:15.534586Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:15.534602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:15.534622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:15.534647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 909 [2:7561401919081218762:8746]
2025-10-15T11:01:15.534706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:15.534768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:15.534781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:15.534792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:15.534803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:15.534857Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:15.534880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:15.534903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:15.536684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.536714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.536730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.536741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:15.537017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:15.537046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.537190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.537390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.537588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:15.537647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401916281528148:9778], now have 1 active actors on pipe
2025-10-15T11:01:15.537665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401916281528008:2467], now have 1 active actors on pipe
2025-10-15T11:01:15.537679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401916281528079:9630], now have 1 active actors on pipe
2025-10-15T11:01:15.537698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401919081218757:8746]
2025-10-15T11:01:15.537708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401919081218757:8746]
2025-10-15T11:01:15.537719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401919081218757:8746]
2025-10-15T11:01:15.537741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:15.537802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:15.537801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:15.537827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:15.537838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:15.537948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:15.537959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:15.537999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:15.538013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:15.538122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401919081218757:8746]
2025-10-15T11:01:15.538150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:15.538186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:15.538219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:15.538247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:15.538260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:15.538268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:15.538297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:15.538337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:15.538482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:15.537383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 909
2025-10-15T11:01:15.537483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 909
2025-10-15T11:01:15.537556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 909, pipe: [1:7561401916281528079:9630]
2025-10-15T11:01:15.539805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:15.539854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:15.539946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:15.540430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 910 partition: 0 MaxSeqNo: 46 sessionId: src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0
2025-10-15T11:01:15.541537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|929afae8-962ea405-d6741e14-7062187c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:15.569068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0] Write session: try to update token
2025-10-15T11:01:15.569131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:15.580938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:15.581016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:15.581063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401919081218757:8746]
2025-10-15T11:01:15.581228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:15.581243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:15.583635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:15.588666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:15.591162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:15.592495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:15.594193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:15.609817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:15.664490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:15.664523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:15.664535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:15.664586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:15.664598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:15.664609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:15.664619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:15.664653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401919081218757:8746]
2025-10-15T11:01:15.664681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401919081218757:8746]
2025-10-15T11:01:15.664703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401919081218757:8746]
2025-10-15T11:01:15.664823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:15.664830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:15.664851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:15.664855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:15.664880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:15.665937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:15.677297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId: src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:15.699311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:15.803084Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:15.804364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:15.804400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:15.805102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:15.805821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401916281528079:9630]
2025-10-15T11:01:15.805914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:15.805925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:15.809208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:15.814944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 910 reason: error at write: Disconnected sessionId: src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0
2025-10-15T11:01:15.815225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 910 sessionId: src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0 is DEAD
2025-10-15T11:01:15.819582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:15.819644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0] Write session will restart in 0.009143s
2025-10-15T11:01:15.819780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0] Write session: Do CDS request
2025-10-15T11:01:15.819830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:15.841228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:15.841040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:15.841094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 911
2025-10-15T11:01:15.847999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:15.848226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:15.848252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:15.848263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:15.849735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 911 sessionId:  describe result for acl check
2025-10-15T11:01:15.849857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:15.849877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:15.849886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:15.849901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401916281528313:9785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:15.852435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401916281528313:9785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:15.860661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401916281528313:9785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:15.872691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401916281528313:9785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:15.872728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401916281528313:9785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:15.872737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401916281528313:9785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:15.872756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:15.907081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401916281528536:9630]
2025-10-15T11:01:15.907662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:15.920434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:15.921130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:15.921143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:15.921171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:15.921349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:15.921478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401919081219032:8757]
2025-10-15T11:01:15.922877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:15.924192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:15.924487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:15.925936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:15.926326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:15.926349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:15.926358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:15.926366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:15.926374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:15.926382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:15.926389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:15.926397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:15.926406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:15.926413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:15.926422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:15.926430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.926438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.926445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.926501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:15.926621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:15.926669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:15.926721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:15.926770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:15.926820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:15.926869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:15.926922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:15.926971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:15.927020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:15.927067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:15.927127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.927176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.927227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.927281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:15.927952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:15.928060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:15.928159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:15.928219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:15.928284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:15.928340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:15.928429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:15.928483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:15.928544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:15.928601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:15.928674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:15.928746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:15.928809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:15.928841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:15.928878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:15.928910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:15.928947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:15.928979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:15.929015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:15.929046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:15.929083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:15.929114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.929151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:15.929183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.929221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:15.929252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.929289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:15.929655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:15.952286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:16.005987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:16.006037Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:16.006054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:16.006072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:16.006096Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 910 [2:7561401919081219032:8757]
2025-10-15T11:01:16.006148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:16.006201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:16.006214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:16.006226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:16.006238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:16.006286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:16.006306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:16.006326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:16.007456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.007480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.007504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.007515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:16.007787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:16.009138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 910, pipe: [1:7561401916281528536:9630]
2025-10-15T11:01:16.007802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.007944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.009260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 910
2025-10-15T11:01:16.009340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 910
2025-10-15T11:01:16.008128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.008353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:16.008413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401919081219026:8757]
2025-10-15T11:01:16.008427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401919081219026:8757]
2025-10-15T11:01:16.008440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401919081219026:8757]
2025-10-15T11:01:16.008479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:16.008544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:16.008715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:16.008724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:16.008731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:16.008747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:16.008760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:16.008858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401916281528536:9630], now have 1 active actors on pipe
2025-10-15T11:01:16.008876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401919081219026:8757]
2025-10-15T11:01:16.008895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:16.008926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:16.008996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401916281528301:2467], now have 1 active actors on pipe
2025-10-15T11:01:16.009018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401916281528384:9785], now have 1 active actors on pipe
2025-10-15T11:01:16.009960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:16.009992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:16.010068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af907345-bc118e2b-677ef565-67a2712f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:16.010098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:16.010116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:16.010127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:16.010158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:16.010194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:16.010235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:16.011327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 911 partition: 0 MaxSeqNo: 46 sessionId: src_id|af907345-bc118e2b-677ef565-67a2712f_0
2025-10-15T11:01:16.012127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2de39f04-ad861d77-dfcb85f8-8b5941f5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|af907345-bc118e2b-677ef565-67a2712f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:16.010933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:16.010959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:16.011030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:16.047994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af907345-bc118e2b-677ef565-67a2712f_0] Write session: try to update token
2025-10-15T11:01:16.048038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af907345-bc118e2b-677ef565-67a2712f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:16.128605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:16.128636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:16.128649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:16.128665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:16.128694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401919081219026:8757]
2025-10-15T11:01:16.128717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401919081219026:8757]
2025-10-15T11:01:16.128740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401919081219026:8757]
2025-10-15T11:01:16.128946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:16.128968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:16.128979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:16.129025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:16.129045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:16.129130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:16.129164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:16.129190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:16.132507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:16.172201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId: src_id|af907345-bc118e2b-677ef565-67a2712f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:16.194851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:16.273617Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:16.282599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:16.282646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:16.282713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:16.282727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:16.282765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401919081219026:8757]
2025-10-15T11:01:16.282938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:16.283328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:16.283504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:16.283522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:16.283544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:16.284264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401916281528536:9630]
2025-10-15T11:01:16.332953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 911 reason: error at write: Disconnected sessionId: src_id|af907345-bc118e2b-677ef565-67a2712f_0
2025-10-15T11:01:16.333425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af907345-bc118e2b-677ef565-67a2712f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:16.333452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af907345-bc118e2b-677ef565-67a2712f_0] Write session will restart in 0.009052s
2025-10-15T11:01:16.333519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af907345-bc118e2b-677ef565-67a2712f_0] Write session: Do CDS request
2025-10-15T11:01:16.333538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af907345-bc118e2b-677ef565-67a2712f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:16.333589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 911 sessionId: src_id|af907345-bc118e2b-677ef565-67a2712f_0 is DEAD
2025-10-15T11:01:16.347237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:16.347276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 912
2025-10-15T11:01:16.350945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af907345-bc118e2b-677ef565-67a2712f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:16.351588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:16.351724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:16.351744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:16.351754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:16.353170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 912 sessionId:  describe result for acl check
2025-10-15T11:01:16.353276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:16.353287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:16.353296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:16.353311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401920576495956:9790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:16.355895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401920576495956:9790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:16.369128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401920576495956:9790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:16.376679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401920576495956:9790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:16.376723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401920576495956:9790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:16.376739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401920576495956:9790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:16.376766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:16.384749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401920576496096:9630]
2025-10-15T11:01:16.386223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:16.390262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:16.391503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:16.391539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:16.391597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:16.391853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:16.392076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401923376186575:8759]
2025-10-15T11:01:16.393969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:16.395080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:16.395237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:16.396355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:16.396672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:16.396691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:16.396698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:16.396704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:16.396711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:16.396718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:16.396724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:16.396732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:16.396739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:16.396744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:16.396751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:16.396756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.396762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.396769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.396811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:16.396914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:16.396962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:16.397008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:16.397049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:16.397089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:16.397119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:16.397160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:16.397191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:16.397223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:16.397255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:16.397285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.397325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.397367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.397397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:16.397451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:16.397499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:16.397554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:16.397607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:16.397671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:16.397719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:16.397770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:16.397817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:16.397870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:16.397913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:16.397963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:16.398009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:16.398055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:16.398084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:16.398117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:16.398149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:16.398209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:16.398252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:16.398305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:16.398333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:16.398366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:16.398408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.398457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.398503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.398552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.398596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.398641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.399088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:16.418693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:16.429020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:16.429073Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:16.429090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:16.429110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:16.429134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 911 [2:7561401923376186575:8759]
2025-10-15T11:01:16.429184Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:16.429239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:16.429253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:16.429269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:16.429280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:16.429326Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:16.429346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:16.429366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:16.436700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.436733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.436746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.436757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:16.437045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:16.437072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.437223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.437421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.437659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:16.437740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401920576496096:9630], now have 1 active actors on pipe
2025-10-15T11:01:16.437765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401920576496085:9790], now have 1 active actors on pipe
2025-10-15T11:01:16.437787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401920576495849:2467], now have 1 active actors on pipe
2025-10-15T11:01:16.437810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401923376186567:8759]
2025-10-15T11:01:16.437824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401923376186567:8759]
2025-10-15T11:01:16.437836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401923376186567:8759]
2025-10-15T11:01:16.437880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:16.437951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:16.438123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:16.438139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:16.438251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401923376186567:8759]
2025-10-15T11:01:16.438272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:16.438818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:16.438838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:16.438849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:16.438870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:16.440224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 911
2025-10-15T11:01:16.440313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 911
2025-10-15T11:01:16.440378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 911, pipe: [1:7561401920576496096:9630]
2025-10-15T11:01:16.441635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:16.441671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:16.441751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:16.441780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:16.441795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:16.441805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:16.441840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:16.441877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:16.441923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:16.442595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:16.442620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:16.442680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:16.444284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af907345-bc118e2b-677ef565-67a2712f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:16.443060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 912 partition: 0 MaxSeqNo: 46 sessionId: src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0
2025-10-15T11:01:16.479841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0] Write session: try to update token
2025-10-15T11:01:16.479897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:16.530430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:16.530461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:16.530476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:16.530487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:16.530519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401923376186567:8759]
2025-10-15T11:01:16.530545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401923376186567:8759]
2025-10-15T11:01:16.530571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401923376186567:8759]
2025-10-15T11:01:16.530684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:16.530715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:16.530725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:16.530727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:16.530739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:16.530753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:16.530782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:16.530800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:16.532097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:16.588553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId: src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:16.613874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:16.680588Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:16.683284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:16.683327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:16.686607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:16.686662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:16.686701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:16.686718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:16.686972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401920576496096:9630]
2025-10-15T11:01:16.694984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 912 reason: error at write: Disconnected sessionId: src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0
2025-10-15T11:01:16.695263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 912 sessionId: src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0 is DEAD
2025-10-15T11:01:16.695545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:16.695573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0] Write session will restart in 0.009037s
2025-10-15T11:01:16.695659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0] Write session: Do CDS request
2025-10-15T11:01:16.695688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:16.714136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:16.714233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:16.714183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 913
2025-10-15T11:01:16.714944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:16.715093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:16.715119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:16.715129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:16.716709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 913 sessionId:  describe result for acl check
2025-10-15T11:01:16.716836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:16.716856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:16.716866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:16.716885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401920576496123:9795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:16.721443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401920576496123:9795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:16.730434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401920576496123:9795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:16.738648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401920576496123:9795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:16.738702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401920576496123:9795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:16.738720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401920576496123:9795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:16.738756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:16.786551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401920576496364:9630]
2025-10-15T11:01:16.796740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:16.802550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:16.803438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:16.803463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:16.803504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:16.803738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:16.803967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401923376186842:8769]
2025-10-15T11:01:16.806050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:16.807082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:16.807334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:16.808629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:16.808970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:16.808991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:16.808998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:16.809005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:16.809011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:16.809018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:16.809025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:16.809032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:16.809038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:16.809045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:16.809050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:16.809058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.809064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.809071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.809116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:16.809228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:16.809276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:16.809321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:16.809367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:16.809426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:16.809475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:16.809523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:16.809571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:16.809623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:16.809675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:16.809728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.809778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.809827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.809875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:16.809943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:16.810007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:16.810068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:16.810124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:16.810182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:16.810236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:16.810296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:16.810352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:16.810415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:16.810467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:16.810527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:16.810589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:16.810641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:16.810686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:16.810738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:16.810783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:16.810840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:16.810890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:16.810947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:16.810999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:16.811057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:16.811108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.811167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.811217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.811274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.811323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.811400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.811898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:16.828746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:16.871124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:16.871172Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:16.871188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:16.871206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:16.871233Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 912 [2:7561401923376186842:8769]
2025-10-15T11:01:16.871281Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:16.871333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:16.871363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:16.871375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:16.871385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:16.871427Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:16.871448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:16.871467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:16.880382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.880413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.880426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.880436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:16.880684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:16.880705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:16.881063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 912
2025-10-15T11:01:16.881200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 912
2025-10-15T11:01:16.881267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 912, pipe: [1:7561401920576496364:9630]
2025-10-15T11:01:16.880851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:16.881039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:16.881258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:16.881329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401920576496113:2467], now have 1 active actors on pipe
2025-10-15T11:01:16.881352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401920576496161:9795], now have 1 active actors on pipe
2025-10-15T11:01:16.881372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401920576496364:9630], now have 1 active actors on pipe
2025-10-15T11:01:16.881412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401923376186837:8769]
2025-10-15T11:01:16.881425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401923376186837:8769]
2025-10-15T11:01:16.881437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401923376186837:8769]
2025-10-15T11:01:16.881473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:16.881513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:16.881536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:16.881547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:16.881548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:16.881568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:16.881609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:16.881781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:16.881803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:16.881953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:16.881989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:16.882006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:16.882015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:16.882045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:16.882079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:16.882116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401923376186837:8769]
2025-10-15T11:01:16.882146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:16.882201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:16.882230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:16.882877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:16.882901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:16.882956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:16.883235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 913 partition: 0 MaxSeqNo: 46 sessionId: src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0
2025-10-15T11:01:16.883967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|315169ea-8e4ef0da-912fa8a8-454bb07f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:16.902801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0] Write session: try to update token
2025-10-15T11:01:16.902853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:17.009680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:17.009729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:17.009747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:17.009757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:17.009785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401923376186837:8769]
2025-10-15T11:01:17.009802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401923376186837:8769]
2025-10-15T11:01:17.009819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401923376186837:8769]
2025-10-15T11:01:17.009948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:17.009955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:17.009952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:17.009964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:17.009986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:17.010021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:17.010053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:17.010072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:17.016430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:17.035912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId: src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:17.057014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:17.151364Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:17.162587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:17.162634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:17.162710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:17.162723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:17.162763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401923376186837:8769]
2025-10-15T11:01:17.163452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:17.163691Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:17.167589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401920576496364:9630]
2025-10-15T11:01:17.167729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:17.167914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:17.174382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 913 reason: status is not ok: tablet will be restarted right now sessionId: src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0
2025-10-15T11:01:17.174864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 913 sessionId: src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0 is DEAD
2025-10-15T11:01:17.183499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:17.183555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0] Write session will restart in 0.008094s
2025-10-15T11:01:17.183667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0] Write session: Do CDS request
2025-10-15T11:01:17.183698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:17.196785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:17.197513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:17.197543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 914
2025-10-15T11:01:17.197903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:17.197997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:17.198010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:17.198018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:17.199408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 914 sessionId:  describe result for acl check
2025-10-15T11:01:17.199507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:17.199516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:17.199525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:17.199540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401924871463694:9806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:17.201759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401924871463694:9806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:17.213648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401924871463694:9806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:17.225222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401924871463694:9806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:17.225263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401924871463694:9806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:17.225279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401924871463694:9806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:17.225306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:17.262721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:17.264409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:17.265187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:17.265214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:17.265253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:17.265489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:17.265664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401927671154408:8776]
2025-10-15T11:01:17.267844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:17.268042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401924871463931:9630]
2025-10-15T11:01:17.268769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:17.268957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:17.270093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:17.270383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:17.270390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:17.270398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:17.270405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:17.270411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:17.270418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:17.270426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:17.270433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:17.270439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:17.270445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:17.270452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:17.270458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.270465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.270471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.270512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:17.270613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:17.270659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:17.270704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:17.270745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:17.270787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:17.270834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:17.270875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:17.270916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:17.270960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:17.271005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:17.271049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.271092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.271135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.271172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:17.271234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:17.271286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:17.271335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:17.271412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:17.271467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:17.271508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:17.271559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:17.271602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:17.271655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:17.271696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:17.271744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:17.271787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:17.271840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:17.271882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:17.271945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:17.271990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:17.272039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:17.272081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:17.272133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:17.272173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:17.272223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:17.272265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.272315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.272358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.272420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.272470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.272527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.272957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:17.292527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:17.301664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:17.301718Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:17.301738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:17.301760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:17.301787Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 913 [2:7561401927671154408:8776]
2025-10-15T11:01:17.301845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:17.301911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:17.301929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:17.301943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:17.301956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:17.302009Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:17.302035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:17.302073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:17.302945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.302965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.302974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.302982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:17.303210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:17.303238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.303466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.304048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 913, pipe: [1:7561401924871463931:9630]
2025-10-15T11:01:17.304159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 913
2025-10-15T11:01:17.304237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 913
2025-10-15T11:01:17.303681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.303949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:17.304032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401924871463931:9630], now have 1 active actors on pipe
2025-10-15T11:01:17.304059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401924871463679:2467], now have 1 active actors on pipe
2025-10-15T11:01:17.304083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401924871463762:9806], now have 1 active actors on pipe
2025-10-15T11:01:17.304111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401927671154403:8776]
2025-10-15T11:01:17.304127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401927671154403:8776]
2025-10-15T11:01:17.304141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401927671154403:8776]
2025-10-15T11:01:17.304178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:17.304233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:17.304237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:17.304253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:17.304264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:17.304393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:17.304405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:17.304540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:17.304564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:17.304596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401927671154403:8776]
2025-10-15T11:01:17.304617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:17.304643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:17.304704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:17.304738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:17.304755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:17.304763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:17.304791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:17.304822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:17.304879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:17.306383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 914 partition: 0 MaxSeqNo: 46 sessionId: src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0
2025-10-15T11:01:17.305760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:17.305801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:17.305890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:17.307281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329ccce7-9295f173-c6caed5a-e5ba9fe8_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:17.343491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0] Write session: try to update token
2025-10-15T11:01:17.343549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:17.448451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:17.448483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:17.448496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:17.448505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:17.448540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401927671154403:8776]
2025-10-15T11:01:17.448565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401927671154403:8776]
2025-10-15T11:01:17.448587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401927671154403:8776]
2025-10-15T11:01:17.448728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:17.448742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:17.448753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:17.448845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:17.448865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:17.449105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:17.449150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:17.449184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:17.459742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:17.465261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId: src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:17.491681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:17.596860Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:17.628160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:17.628210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:17.628227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:17.628451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401924871463931:9630]
2025-10-15T11:01:17.627380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:17.627423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:17.627484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:17.627496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:17.627530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401927671154403:8776]
2025-10-15T11:01:17.627727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:17.628078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:17.637538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 914 reason: error at write: Disconnected sessionId: src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0
2025-10-15T11:01:17.637893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 914 sessionId: src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0 is DEAD
2025-10-15T11:01:17.638360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:17.638423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0] Write session will restart in 0.009473s
2025-10-15T11:01:17.638619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0] Write session: Do CDS request
2025-10-15T11:01:17.638692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:17.654299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:17.654338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 915
2025-10-15T11:01:17.659647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:17.661211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:17.661383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:17.661400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:17.661410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:17.663054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 915 sessionId:  describe result for acl check
2025-10-15T11:01:17.663246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:17.663299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:17.663316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:17.663365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401924871463975:9814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:17.667881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401924871463975:9814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:17.674311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401924871463975:9814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:17.684982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401924871463975:9814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:17.685027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401924871463975:9814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:17.685042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401924871463975:9814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:17.685070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:17.728593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401924871464198:9630]
2025-10-15T11:01:17.737082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:17.739686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:17.740434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:17.740450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:17.740487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:17.740710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:17.740877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401927671154670:8781]
2025-10-15T11:01:17.742990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:17.746797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:17.747043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:17.748280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:17.748582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:17.748598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:17.748605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:17.748611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:17.748619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:17.748625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:17.748641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:17.748648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:17.748655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:17.748661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:17.748669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:17.748675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.748683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.748690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.748734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:17.748832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:17.748878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:17.748923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:17.748975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:17.749023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:17.749075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:17.749116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:17.749171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:17.749224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:17.749270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:17.749319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.749363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.749410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.749455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:17.749519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:17.749577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:17.749630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:17.749684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:17.749739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:17.749784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:17.749838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:17.749887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:17.749942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:17.749988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:17.750040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:17.750087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:17.750141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:17.750189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:17.750242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:17.750293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:17.750346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:17.750395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:17.750450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:17.750500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:17.750551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:17.750598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.750652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.750702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.750760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.750806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.750859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.751326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:17.775243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:17.784313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:17.784354Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:17.784372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:17.784389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:17.784414Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 914 [2:7561401927671154670:8781]
2025-10-15T11:01:17.784462Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:17.784517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:17.784538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:17.784549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:17.784560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:17.784601Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:17.784621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:17.784639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:17.785616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.785639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.785651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.785661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:17.785902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:17.785923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:17.786051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:17.786160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 914, pipe: [1:7561401924871464198:9630]
2025-10-15T11:01:17.786231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:17.786167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 914
2025-10-15T11:01:17.786254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 914
2025-10-15T11:01:17.786463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:17.786539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401924871464198:9630], now have 1 active actors on pipe
2025-10-15T11:01:17.786566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401924871463959:2467], now have 1 active actors on pipe
2025-10-15T11:01:17.786589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401924871464012:9814], now have 1 active actors on pipe
2025-10-15T11:01:17.786648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:17.786671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:17.786700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401927671154665:8781]
2025-10-15T11:01:17.786718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401927671154665:8781]
2025-10-15T11:01:17.786730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401927671154665:8781]
2025-10-15T11:01:17.786761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:17.786793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:17.786815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:17.786823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:17.786825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:17.786981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:17.787000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:17.787055Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:17.787085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:17.787104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:17.787114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:17.787144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:17.787173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:17.787290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401927671154665:8781]
2025-10-15T11:01:17.787321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:17.787420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:17.787439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:17.788083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:17.788101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:17.788158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:17.788423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 915 partition: 0 MaxSeqNo: 46 sessionId: src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0
2025-10-15T11:01:17.789087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66511d63-5b75bc67-3f718de0-3bd6f0c0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:17.819745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0] Write session: try to update token
2025-10-15T11:01:17.819819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:17.899165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:17.899210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:17.899229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:17.899243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:17.899289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401927671154665:8781]
2025-10-15T11:01:17.899324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401927671154665:8781]
2025-10-15T11:01:17.899423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401927671154665:8781]
2025-10-15T11:01:17.899632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:17.899666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:17.899686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:17.899832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:17.899865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:17.900015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:17.900044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:17.900068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:17.908110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:17.959982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId: src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:17.984034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:18.076645Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:18.088048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:18.088095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:18.088160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:18.088173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:18.088210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401927671154665:8781]
2025-10-15T11:01:18.088698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:18.089075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:18.089244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:18.089275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:18.091691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401924871464198:9630]
2025-10-15T11:01:18.091840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:18.098132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 915 reason: error at write: Disconnected sessionId: src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0
2025-10-15T11:01:18.098418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 915 sessionId: src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0 is DEAD
2025-10-15T11:01:18.100033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:18.100060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0] Write session will restart in 0.009487s
2025-10-15T11:01:18.100149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0] Write session: Do CDS request
2025-10-15T11:01:18.100173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:18.114291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:18.114333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 916
2025-10-15T11:01:18.114744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:18.115401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:18.115521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:18.115542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:18.115551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:18.119132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 916 sessionId:  describe result for acl check
2025-10-15T11:01:18.119266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:18.119284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:18.119299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:18.119319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401929166431524:9819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:18.122216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401929166431524:9819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:18.128876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401929166431524:9819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:18.137622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401929166431524:9819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:18.137672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401929166431524:9819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:18.137687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401929166431524:9819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:18.137715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:18.191494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401929166431675:9630]
2025-10-15T11:01:18.225374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:18.231621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:18.232406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:18.232423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:18.232477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:18.232720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:18.232903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401931966122225:8786]
2025-10-15T11:01:18.234949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:18.236364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:18.236574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:18.237722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:18.238031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:18.238039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:18.238046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:18.238053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:18.238059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:18.238065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:18.238072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:18.238078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:18.238084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:18.238090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:18.238097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:18.238103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.238110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.238116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.238160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:18.238266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:18.238310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:18.238354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:18.238400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:18.238443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:18.238487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:18.238528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:18.238569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:18.238614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:18.238658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:18.238701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.238745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.238788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.238828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:18.238888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:18.238942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:18.238999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:18.239044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:18.239096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:18.239140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:18.239193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:18.239238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:18.239291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:18.239333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:18.240233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:18.240296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:18.240352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:18.240394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:18.240458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:18.240504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:18.240554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:18.240595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:18.240647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:18.240694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:18.240745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:18.240788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.240841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.240886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.240939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.240982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.241030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.241506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:18.262746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:18.272651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:18.272693Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:18.272709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:18.272724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:18.272747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 915 [2:7561401931966122225:8786]
2025-10-15T11:01:18.272790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:18.272839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:18.272852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:18.272863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:18.272873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:18.272915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:18.272934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:18.272953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:18.289609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.289640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.289650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.289658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:18.289893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:18.289913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.290018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.290156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.290341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:18.290415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401929166431675:9630], now have 1 active actors on pipe
2025-10-15T11:01:18.290435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401929166431560:9819], now have 1 active actors on pipe
2025-10-15T11:01:18.290453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401929166431515:2467], now have 1 active actors on pipe
2025-10-15T11:01:18.290474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401931966122220:8786]
2025-10-15T11:01:18.290487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401931966122220:8786]
2025-10-15T11:01:18.290498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401931966122220:8786]
2025-10-15T11:01:18.290528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:18.290589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:18.290735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:18.290749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:18.290846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401931966122220:8786]
2025-10-15T11:01:18.290861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:18.290942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:18.290955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:18.290966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:18.290986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:18.293814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:18.293849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:18.293927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3a7a680-1269d296-47a371b1-c5614d27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:18.293956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:18.293972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:18.293982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:18.294012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:18.294046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:18.294086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:18.291624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 915, pipe: [1:7561401929166431675:9630]
2025-10-15T11:01:18.291779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 915
2025-10-15T11:01:18.291875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 915
2025-10-15T11:01:18.298372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:18.298405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:18.298477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:18.301058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 916 partition: 0 MaxSeqNo: 46 sessionId: src_id|e3a7a680-1269d296-47a371b1-c5614d27_0
2025-10-15T11:01:18.303597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f775bbe-9f13b378-b95052bb-f6a92e2a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e3a7a680-1269d296-47a371b1-c5614d27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:18.353504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a7a680-1269d296-47a371b1-c5614d27_0] Write session: try to update token
2025-10-15T11:01:18.353570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a7a680-1269d296-47a371b1-c5614d27_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:18.381386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:18.381418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:18.381429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:18.381477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:18.381490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:18.381502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:18.381512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:18.381545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401931966122220:8786]
2025-10-15T11:01:18.381569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401931966122220:8786]
2025-10-15T11:01:18.381591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401931966122220:8786]
2025-10-15T11:01:18.381719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:18.381724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:18.381742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:18.381770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:18.381803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:18.392002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:18.469288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId: src_id|e3a7a680-1269d296-47a371b1-c5614d27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:18.491676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:18.530182Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:18.532321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:18.532346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:18.535247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:18.535296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:18.544150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 916 reason: error at write: Disconnected sessionId: src_id|e3a7a680-1269d296-47a371b1-c5614d27_0
2025-10-15T11:01:18.544413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 916 sessionId: src_id|e3a7a680-1269d296-47a371b1-c5614d27_0 is DEAD
2025-10-15T11:01:18.547570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a7a680-1269d296-47a371b1-c5614d27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:18.547621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a7a680-1269d296-47a371b1-c5614d27_0] Write session will restart in 0.007785s
2025-10-15T11:01:18.547728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a7a680-1269d296-47a371b1-c5614d27_0] Write session: Do CDS request
2025-10-15T11:01:18.547753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a7a680-1269d296-47a371b1-c5614d27_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:18.558429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:18.561877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:18.562140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401929166431675:9630]
2025-10-15T11:01:18.564253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a7a680-1269d296-47a371b1-c5614d27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:18.564269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:18.564309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 917
2025-10-15T11:01:18.565752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:18.565942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:18.565964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:18.565978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:18.572433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 917 sessionId:  describe result for acl check
2025-10-15T11:01:18.572541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:18.572551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:18.572559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:18.572573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401929166431811:9830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:18.574766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401929166431811:9830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:18.584626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401929166431811:9830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:18.600809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401929166431811:9830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:18.600856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401929166431811:9830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:18.600874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401929166431811:9830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:18.600907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:18.662476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401929166431973:9630]
2025-10-15T11:01:18.693997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:18.702353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:18.703160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:18.703192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:18.703237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:18.703498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:18.703668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401931966122504:8798]
2025-10-15T11:01:18.705691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:18.707712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:18.707924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:18.709153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:18.709454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:18.709462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:18.709467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:18.709474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:18.709480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:18.709487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:18.709494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:18.709500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:18.709507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:18.709514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:18.709520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:18.709526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.709531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.709538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.709579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:18.709679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:18.709722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:18.709762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:18.709800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:18.709841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:18.709880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:18.709923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:18.709978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:18.710021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:18.710075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:18.710114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.710152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.710194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.710225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:18.710281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:18.710332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:18.710377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:18.710417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:18.710465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:18.710503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:18.710550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:18.710591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:18.710634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:18.710672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:18.710768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:18.710841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:18.710919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:18.710980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:18.711053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:18.711121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:18.711174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:18.711215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:18.711286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:18.711334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:18.711814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:18.711863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.711926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.712043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.712110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.712184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.712247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.712831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:18.735887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:18.751302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:18.751342Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:18.751370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:18.751387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:18.751408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 916 [2:7561401931966122504:8798]
2025-10-15T11:01:18.751456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:18.751508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:18.751522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:18.751534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:18.751545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:18.751586Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:18.751618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:18.751637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:18.752496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.752510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.752523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.752534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:18.752792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:18.752808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:18.752935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:18.753109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:18.753332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:18.753398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401929166431848:9830], now have 1 active actors on pipe
2025-10-15T11:01:18.753419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401929166431973:9630], now have 1 active actors on pipe
2025-10-15T11:01:18.753439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401929166431806:2467], now have 1 active actors on pipe
2025-10-15T11:01:18.753460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401931966122499:8798]
2025-10-15T11:01:18.753473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401931966122499:8798]
2025-10-15T11:01:18.753483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401931966122499:8798]
2025-10-15T11:01:18.753525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:18.753589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:18.753602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:18.753614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:18.753624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:18.753749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:18.753765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:18.753864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401931966122499:8798]
2025-10-15T11:01:18.753888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:18.753904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:18.754978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 916
2025-10-15T11:01:18.755097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 916, pipe: [1:7561401929166431973:9630]
2025-10-15T11:01:18.755188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 916
2025-10-15T11:01:18.755308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:18.755344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:18.755437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f042f209-c0edacc7-aa8e6634-de02c603_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:18.755464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:18.755480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:18.755490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:18.755522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:18.755558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:18.755601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:18.756270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:18.756292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:18.756357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:18.756616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 917 partition: 0 MaxSeqNo: 46 sessionId: src_id|f042f209-c0edacc7-aa8e6634-de02c603_0
2025-10-15T11:01:18.759561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3a7a680-1269d296-47a371b1-c5614d27_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f042f209-c0edacc7-aa8e6634-de02c603_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:18.805999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f042f209-c0edacc7-aa8e6634-de02c603_0] Write session: try to update token
2025-10-15T11:01:18.806055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f042f209-c0edacc7-aa8e6634-de02c603_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:18.818198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:18.818230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:18.818265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401931966122499:8798]
2025-10-15T11:01:18.818376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:18.818459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:18.840550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:18.841843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:18.843061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:18.848692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:18.850281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:18.850652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:18.857160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:18.857206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:18.857223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:18.919836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId: src_id|f042f209-c0edacc7-aa8e6634-de02c603_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:18.960778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:18.960820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:18.960839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:18.960850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:18.960892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401931966122499:8798]
2025-10-15T11:01:18.960920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401931966122499:8798]
2025-10-15T11:01:18.960943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401931966122499:8798]
2025-10-15T11:01:18.961072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:18.961113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:18.961126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:18.961139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:18.961141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:18.961153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:18.961208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:18.961229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:18.973705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:18.983250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:19.112292Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:19.113630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:19.113659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:19.114542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:19.114573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:19.115724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401929166431973:9630]
2025-10-15T11:01:19.115967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:19.114789Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:19.158453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 917 reason: error at write: Disconnected sessionId: src_id|f042f209-c0edacc7-aa8e6634-de02c603_0
2025-10-15T11:01:19.159090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f042f209-c0edacc7-aa8e6634-de02c603_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:19.159147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f042f209-c0edacc7-aa8e6634-de02c603_0] Write session will restart in 0.007415s
2025-10-15T11:01:19.159290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f042f209-c0edacc7-aa8e6634-de02c603_0] Write session: Do CDS request
2025-10-15T11:01:19.159327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f042f209-c0edacc7-aa8e6634-de02c603_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:19.158733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 917 sessionId: src_id|f042f209-c0edacc7-aa8e6634-de02c603_0 is DEAD
2025-10-15T11:01:19.176717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:19.176756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 918
2025-10-15T11:01:19.177052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f042f209-c0edacc7-aa8e6634-de02c603_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:19.177552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:19.177695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:19.177712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:19.177722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:19.178963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 918 sessionId:  describe result for acl check
2025-10-15T11:01:19.179074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:19.179084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:19.179092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:19.179108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401933461399446:9838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:19.181621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401933461399446:9838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:19.190940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401933461399446:9838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:19.201034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401933461399446:9838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:19.201077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401933461399446:9838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:19.201091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401933461399446:9838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:19.201132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:19.211441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:19.215509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401933461399613:9630]
2025-10-15T11:01:19.219031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:19.219899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:19.219930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:19.219984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:19.220237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:19.220430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401936261090059:8803]
2025-10-15T11:01:19.222493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:19.223431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:19.223654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:19.224667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:19.224887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:19.224898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:19.224902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:19.224907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:19.224911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:19.224916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:19.224920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:19.224924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:19.224928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:19.224932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:19.224936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:19.224939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.224943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.224947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.224980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:19.225052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:19.225084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:19.225115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:19.225145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:19.225179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:19.225210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:19.225240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:19.225301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:19.225357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:19.225404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:19.225450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.225496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.225534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.225562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:19.225603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:19.225640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:19.225676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:19.225710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:19.225748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:19.225781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:19.225835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:19.225888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:19.225943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:19.225983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:19.226038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:19.226089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:19.226131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:19.226163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:19.226202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:19.226240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:19.226279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:19.226311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:19.226348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:19.226382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:19.226419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:19.226450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.226499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.226549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.226589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.226621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.226658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.226988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:19.240685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:19.249070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:19.249110Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:19.249124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:19.249140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:19.249163Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 917 [2:7561401936261090059:8803]
2025-10-15T11:01:19.249208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:19.249259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:19.249272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:19.249284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:19.249295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:19.249338Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:19.249357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:19.249376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:19.250345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.250370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.250383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.250393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:19.250632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:19.250654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.250783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.250897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 917, pipe: [1:7561401933461399613:9630]
2025-10-15T11:01:19.250964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 917
2025-10-15T11:01:19.250920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.251014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 917
2025-10-15T11:01:19.251077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:19.251134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401933461399613:9630], now have 1 active actors on pipe
2025-10-15T11:01:19.251152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401933461399368:2467], now have 1 active actors on pipe
2025-10-15T11:01:19.251166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401933461399603:9838], now have 1 active actors on pipe
2025-10-15T11:01:19.251193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401936261090053:8803]
2025-10-15T11:01:19.251201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401936261090053:8803]
2025-10-15T11:01:19.251209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401936261090053:8803]
2025-10-15T11:01:19.251233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:19.251268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:19.251276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:19.251285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:19.251292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:19.251443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:19.251465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:19.251506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:19.251521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:19.251605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401936261090053:8803]
2025-10-15T11:01:19.251626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:19.251640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:19.251669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:19.251690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:19.251701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:19.251707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:19.251727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:19.251749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:19.251823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:19.252301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:19.252318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:19.252355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:19.252606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 918 partition: 0 MaxSeqNo: 46 sessionId: src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0
2025-10-15T11:01:19.253218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f042f209-c0edacc7-aa8e6634-de02c603_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:19.272280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0] Write session: try to update token
2025-10-15T11:01:19.272321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:19.322964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:19.322996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:19.323043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401936261090053:8803]
2025-10-15T11:01:19.323151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:19.323209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:19.327054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:19.329013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:19.330415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:19.332237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:19.334604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:19.351534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId: src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:19.361094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:19.361265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:19.361290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:19.361302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:19.361364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:19.361378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:19.361391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:19.361402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:19.361439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401936261090053:8803]
2025-10-15T11:01:19.361465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401936261090053:8803]
2025-10-15T11:01:19.361487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401936261090053:8803]
2025-10-15T11:01:19.361597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:19.361617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:19.361636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:19.361636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:19.361670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:19.362751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:19.373038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:19.499824Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:19.502653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:19.502702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:19.503383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:19.503421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401933461399613:9630]
2025-10-15T11:01:19.503424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:19.503539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:19.503551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:19.513439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 918 reason: error at write: Disconnected sessionId: src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0
2025-10-15T11:01:19.513727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 918 sessionId: src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0 is DEAD
2025-10-15T11:01:19.514207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:19.514280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0] Write session will restart in 0.009067s
2025-10-15T11:01:19.514467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0] Write session: Do CDS request
2025-10-15T11:01:19.514524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:19.530842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:19.530878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 919
2025-10-15T11:01:19.531637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:19.532489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:19.532682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:19.532735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:19.532751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:19.534646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 919 sessionId:  describe result for acl check
2025-10-15T11:01:19.534813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:19.534846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:19.534858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:19.534889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401933461399658:9845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:19.538049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401933461399658:9845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:19.544348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401933461399658:9845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:19.554041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401933461399658:9845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:19.554086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401933461399658:9845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:19.554103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401933461399658:9845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:19.554133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:19.603544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401933461399889:9630]
2025-10-15T11:01:19.606216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:19.607922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:19.608673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:19.608699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:19.608734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:19.608970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:19.609161Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401936261090335:8808]
2025-10-15T11:01:19.610935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:19.611710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:19.611905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:19.613073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:19.613428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:19.613450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:19.613457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:19.613465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:19.613472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:19.613479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:19.613485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:19.613492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:19.613498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:19.613505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:19.613512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:19.613520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.613526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.613533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.613571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:19.613669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:19.613718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:19.613760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:19.613793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:19.613835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:19.613885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:19.613934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:19.613985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:19.614052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:19.614099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:19.614148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.614196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.614234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.614266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:19.614315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:19.614365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:19.614410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:19.614447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:19.614490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:19.614537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:19.614588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:19.614627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:19.614666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:19.614704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:19.614760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:19.614800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:19.614834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:19.614876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:19.614931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:19.614984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:19.615037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:19.615086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:19.615157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:19.615192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:19.615240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:19.615295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.615366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.615426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.615482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.615533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.615584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.616093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:19.631180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:19.641785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:19.641833Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:19.641848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:19.641864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:19.641890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 918 [2:7561401936261090335:8808]
2025-10-15T11:01:19.641937Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:19.641994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:19.642010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:19.642022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:19.642032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:19.642063Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:19.642079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:19.642094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:19.643721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.643746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.643759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.643771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:19.644031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:19.644053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:19.644182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:19.644286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 918, pipe: [1:7561401933461399889:9630]
2025-10-15T11:01:19.644348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 918
2025-10-15T11:01:19.644400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 918
2025-10-15T11:01:19.644367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:19.644605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:19.644679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401933461399889:9630], now have 1 active actors on pipe
2025-10-15T11:01:19.644701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401933461399643:2467], now have 1 active actors on pipe
2025-10-15T11:01:19.644720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401933461399691:9845], now have 1 active actors on pipe
2025-10-15T11:01:19.644777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:19.644796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:19.644831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401936261090330:8808]
2025-10-15T11:01:19.644844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401936261090330:8808]
2025-10-15T11:01:19.644857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401936261090330:8808]
2025-10-15T11:01:19.644893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:19.644945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:19.644960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:19.644970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:19.644972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:19.645138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:19.645153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:19.645208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b079543-60c324ad-326623d4-47f54766_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:19.645236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:19.645251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:19.645261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:19.645293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:19.645329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:19.645436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401936261090330:8808]
2025-10-15T11:01:19.645464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:19.645498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:19.645502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:19.646036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:19.646058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:19.646139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:19.646411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 919 partition: 0 MaxSeqNo: 46 sessionId: src_id|7b079543-60c324ad-326623d4-47f54766_0
2025-10-15T11:01:19.647173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f412fed4-9d60add7-34fdd613-df2f3fb7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7b079543-60c324ad-326623d4-47f54766_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:19.679468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b079543-60c324ad-326623d4-47f54766_0] Write session: try to update token
2025-10-15T11:01:19.679524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b079543-60c324ad-326623d4-47f54766_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:19.705401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:19.705441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:19.705475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401936261090330:8808]
2025-10-15T11:01:19.705612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:19.705624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:19.709657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:19.711216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:19.712623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:19.714176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:19.716052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:19.716629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:19.769913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:19.769946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:19.769956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:19.770002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:19.770015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:19.770026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:19.770035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:19.770068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401936261090330:8808]
2025-10-15T11:01:19.770082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401936261090330:8808]
2025-10-15T11:01:19.770104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401936261090330:8808]
2025-10-15T11:01:19.770225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:19.770236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:19.770254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:19.770257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:19.770280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:19.771240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:19.780641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId: src_id|7b079543-60c324ad-326623d4-47f54766_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:19.802049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:19.906973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:19.915007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:19.915046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:19.915695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:19.917653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401933461399889:9630]
2025-10-15T11:01:19.917787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:19.917963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:19.917998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:19.966325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 919 reason: error at write: Disconnected sessionId: src_id|7b079543-60c324ad-326623d4-47f54766_0
2025-10-15T11:01:19.966649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 919 sessionId: src_id|7b079543-60c324ad-326623d4-47f54766_0 is DEAD
2025-10-15T11:01:19.970140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b079543-60c324ad-326623d4-47f54766_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:19.970188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b079543-60c324ad-326623d4-47f54766_0] Write session will restart in 0.006898s
2025-10-15T11:01:19.970295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b079543-60c324ad-326623d4-47f54766_0] Write session: Do CDS request
2025-10-15T11:01:19.970343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b079543-60c324ad-326623d4-47f54766_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:19.982072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b079543-60c324ad-326623d4-47f54766_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:19.981524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:19.981563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 920
2025-10-15T11:01:19.982711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:19.982840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:19.982869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:19.982879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:19.985108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 920 sessionId:  describe result for acl check
2025-10-15T11:01:19.985228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:19.985246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:19.985255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:19.985270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401933461399969:9856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:19.987662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401933461399969:9856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:19.996334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401933461399969:9856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:20.004830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401933461399969:9856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:20.004876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401933461399969:9856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:20.004892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401933461399969:9856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:20.004917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:20.018181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401937756367465:9630]
2025-10-15T11:01:20.028643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:20.030683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:20.031565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:20.031597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:20.031649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:20.031941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:20.032158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401940556057902:8815]
2025-10-15T11:01:20.034452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:20.035462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:20.035761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:20.037198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:20.037573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:20.037593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:20.037600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:20.037609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:20.037617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:20.037625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:20.037633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:20.037641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:20.037649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:20.037656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:20.037663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:20.037672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.037679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.037685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.037751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:20.037865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:20.037914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:20.037974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:20.038029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:20.038083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:20.038136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:20.038189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:20.038252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:20.038307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:20.038358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:20.038410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.038463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.038513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.038568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:20.038644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:20.038711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:20.038774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:20.038829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:20.038893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:20.038944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:20.039033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:20.039098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:20.039157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:20.039207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:20.039267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:20.039322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:20.039472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:20.039538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:20.039601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:20.039659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:20.039729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:20.039784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:20.039847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:20.039899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:20.039953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:20.040022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.040085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.040144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.040210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.040260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.040321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.040867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:20.060184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:20.069577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:20.069630Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:20.069649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:20.069671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:20.069697Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 919 [2:7561401940556057902:8815]
2025-10-15T11:01:20.069754Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:20.069822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:20.069836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:20.069849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:20.069861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:20.069911Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:20.069936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:20.069958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:20.097001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.097036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.097050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.097060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:20.097332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:20.097349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.097486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.097657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.097864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:20.097971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401940556057897:8815]
2025-10-15T11:01:20.097987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401940556057897:8815]
2025-10-15T11:01:20.097999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401940556057897:8815]
2025-10-15T11:01:20.098038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:20.098110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:20.098286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:20.098304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:20.098431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401940556057897:8815]
2025-10-15T11:01:20.098447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:20.099064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:20.099083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:20.099095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:20.099118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:20.100214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 919
2025-10-15T11:01:20.100316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 919
2025-10-15T11:01:20.100390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 919, pipe: [1:7561401937756367465:9630]
2025-10-15T11:01:20.101225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401937756367401:9856], now have 1 active actors on pipe
2025-10-15T11:01:20.101258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401933461399920:2467], now have 1 active actors on pipe
2025-10-15T11:01:20.101280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401937756367465:9630], now have 1 active actors on pipe
2025-10-15T11:01:20.101326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:20.101351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:20.101437Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e263809e-7bd09530-7b313fc8-d0be8787_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:20.101470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:20.101488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:20.101497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:20.101537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:20.101582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:20.101630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:20.102983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:20.103009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:20.103073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:20.103424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 920 partition: 0 MaxSeqNo: 46 sessionId: src_id|e263809e-7bd09530-7b313fc8-d0be8787_0
2025-10-15T11:01:20.104665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b079543-60c324ad-326623d4-47f54766_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e263809e-7bd09530-7b313fc8-d0be8787_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:20.146900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e263809e-7bd09530-7b313fc8-d0be8787_0] Write session: try to update token
2025-10-15T11:01:20.146956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e263809e-7bd09530-7b313fc8-d0be8787_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:20.171952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:20.172000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:20.172012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:20.172024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:20.172059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401940556057897:8815]
2025-10-15T11:01:20.172086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401940556057897:8815]
2025-10-15T11:01:20.172110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401940556057897:8815]
2025-10-15T11:01:20.172263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:20.172287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:20.172297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:20.172339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:20.172357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:20.173369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:20.175463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:20.175511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:20.175541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
E1015 11:01:20.238804401  821866 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:01:20.242163Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:01:20.271541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId: src_id|e263809e-7bd09530-7b313fc8-d0be8787_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:20.291503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:20.333756Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:20.335556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:20.335602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:20.337261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:20.337314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:20.337326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:20.339848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:20.337564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401937756367465:9630]
2025-10-15T11:01:20.398236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 920 reason: error at write: Disconnected sessionId: src_id|e263809e-7bd09530-7b313fc8-d0be8787_0
2025-10-15T11:01:20.398524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 920 sessionId: src_id|e263809e-7bd09530-7b313fc8-d0be8787_0 is DEAD
2025-10-15T11:01:20.402514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e263809e-7bd09530-7b313fc8-d0be8787_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:20.402576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e263809e-7bd09530-7b313fc8-d0be8787_0] Write session will restart in 0.007644s
2025-10-15T11:01:20.402739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e263809e-7bd09530-7b313fc8-d0be8787_0] Write session: Do CDS request
2025-10-15T11:01:20.402787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e263809e-7bd09530-7b313fc8-d0be8787_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:20.416493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e263809e-7bd09530-7b313fc8-d0be8787_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:20.419783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:20.419821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 921
2025-10-15T11:01:20.420475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:20.420599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:20.420614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:20.420624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:20.422250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 921 sessionId:  describe result for acl check
2025-10-15T11:01:20.422379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:20.422390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:20.422399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:20.422419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401937756367611:9863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:20.425100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401937756367611:9863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:20.436682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401937756367611:9863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:20.437758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401937756367687:9630]
2025-10-15T11:01:20.447799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401937756367611:9863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:20.447852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401937756367611:9863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:20.447870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401937756367611:9863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:20.447903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:20.468814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:20.472916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:20.473942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:20.473984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:20.474034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:20.474344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:20.474576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401940556058162:8824]
2025-10-15T11:01:20.477015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:20.478240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:20.478493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:20.479953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:20.480364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:20.480374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:20.480384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:20.480392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:20.480400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:20.480407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:20.480415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:20.480423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:20.480432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:20.480440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:20.480448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:20.480455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.480462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.480470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.480525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:20.480647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:20.480700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:20.480754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:20.480807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:20.480859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:20.480910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:20.480958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:20.481005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:20.481052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:20.481099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:20.481148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.481197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.481245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.481296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:20.481372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:20.481438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:20.481502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:20.481556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:20.481615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:20.481666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:20.481724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:20.481779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:20.481833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:20.481871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:20.481914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:20.481948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:20.481990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:20.482032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:20.482088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:20.482139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:20.482195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:20.482245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:20.482303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:20.482353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:20.482412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:20.482462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.482518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.482569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.482625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.482673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.482727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.483267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:20.508041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:20.520459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:20.520511Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:20.520528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:20.520547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:20.520572Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 920 [2:7561401940556058162:8824]
2025-10-15T11:01:20.520629Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:20.520690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:20.520707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:20.520719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:20.520732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:20.520787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:20.520822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:20.520848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:20.522105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.522137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.522150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.522164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:20.522476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:20.522506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:20.522664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:20.522872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:20.523120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:20.523218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401937756367732:9863], now have 1 active actors on pipe
2025-10-15T11:01:20.523251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401937756367498:2467], now have 1 active actors on pipe
2025-10-15T11:01:20.523274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401937756367687:9630], now have 1 active actors on pipe
2025-10-15T11:01:20.523308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401940556058157:8824]
2025-10-15T11:01:20.523331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401940556058157:8824]
2025-10-15T11:01:20.523452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401940556058157:8824]
2025-10-15T11:01:20.523500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:20.523452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 920
2025-10-15T11:01:20.523553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 920
2025-10-15T11:01:20.523569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:20.523590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:20.523598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:20.523622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 920, pipe: [1:7561401937756367687:9630]
2025-10-15T11:01:20.523619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:20.523796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:20.523820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:20.523948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401940556058157:8824]
2025-10-15T11:01:20.523993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:20.524041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:20.524101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:20.524132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:20.524283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:20.524329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:20.524348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:20.524360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:20.524401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:20.524453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:20.524536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:20.525721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:20.525747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:20.525797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:20.526151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 921 partition: 0 MaxSeqNo: 46 sessionId: src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0
2025-10-15T11:01:20.527094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e263809e-7bd09530-7b313fc8-d0be8787_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:20.548892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0] Write session: try to update token
2025-10-15T11:01:20.548957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:20.669479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:20.669517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:20.669532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:20.669596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:20.669611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:20.669625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:20.669636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:20.669671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401940556058157:8824]
2025-10-15T11:01:20.669696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401940556058157:8824]
2025-10-15T11:01:20.669718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401940556058157:8824]
2025-10-15T11:01:20.669852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:20.669871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:20.670309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:20.670345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:20.670371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:20.671878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:20.685695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId: src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:20.719128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:20.886663Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:20.888389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:20.888433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:20.890307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:20.892134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:20.890360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:20.891548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:20.891832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401937756367687:9630]
2025-10-15T11:01:20.914298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 921 reason: error at write: Disconnected sessionId: src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0
2025-10-15T11:01:20.914688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 921 sessionId: src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0 is DEAD
2025-10-15T11:01:20.919689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:20.919759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0] Write session will restart in 0.009072s
2025-10-15T11:01:20.919915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0] Write session: Do CDS request
2025-10-15T11:01:20.919965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:20.934743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:20.936285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:20.936323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 922
2025-10-15T11:01:20.936776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:20.936930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:20.936954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:20.936965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:20.938609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 922 sessionId:  describe result for acl check
2025-10-15T11:01:20.938730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:20.938751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:20.938771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:20.938813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401937756367789:9869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:20.941486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401937756367789:9869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:20.953933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401937756367789:9869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:20.976897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401937756367789:9869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:20.976949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401937756367789:9869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:20.976965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401937756367789:9869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:20.977000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:20.989043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401937756367959:9630]
2025-10-15T11:01:21.019736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:21.028532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:21.029326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:21.029343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:21.029381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:21.029610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:21.029777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401944851025730:8828]
2025-10-15T11:01:21.032722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:21.033999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:21.034231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:21.035426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:21.035741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.035770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.035776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.035783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.035789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.035795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.035801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.035807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.035812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.035818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.035825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.035831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.035837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.035842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.035885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.035994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.036041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.036086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.036128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.036169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.036210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.036249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.036290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.036333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.036373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.036413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.036454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.036493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.036534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.036594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.036648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.036700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.036743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.036791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.036833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.036879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.036925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.036969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.037010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.037059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.037100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.037148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.037187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.037235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.037277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.037326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.038400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.038466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.038513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.038561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.038604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.038652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.038698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.038746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.038785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.038832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.039292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:21.059790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:21.078286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:21.078338Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:21.078357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:21.078376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:21.078402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 921 [2:7561401944851025730:8828]
2025-10-15T11:01:21.078454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:21.078515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:21.078529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:21.078542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:21.078552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:21.078604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:21.078628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:21.078651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:21.081023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.081061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.081076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.081088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:21.081379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:21.081399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.081549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.081739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.081970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:21.082056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401937756367773:2467], now have 1 active actors on pipe
2025-10-15T11:01:21.082081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401937756367901:9869], now have 1 active actors on pipe
2025-10-15T11:01:21.082104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401937756367959:9630], now have 1 active actors on pipe
2025-10-15T11:01:21.082130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401944851025725:8828]
2025-10-15T11:01:21.082145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401944851025725:8828]
2025-10-15T11:01:21.082159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401944851025725:8828]
2025-10-15T11:01:21.082202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:21.082235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:21.081973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 921
2025-10-15T11:01:21.082068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 921
2025-10-15T11:01:21.082250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:21.082120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 921, pipe: [1:7561401937756367959:9630]
2025-10-15T11:01:21.082261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:21.082277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:21.082464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:21.082482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:21.082561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:21.082581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:21.082710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401944851025725:8828]
2025-10-15T11:01:21.082738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:21.082776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:21.082812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b348caea-52856906-fb8c6151-c6760566_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:21.082846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:21.082865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:21.082874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:21.082910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:21.082954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:21.083088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:21.084114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:21.084155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:21.084227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:21.087588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 922 partition: 0 MaxSeqNo: 46 sessionId: src_id|b348caea-52856906-fb8c6151-c6760566_0
2025-10-15T11:01:21.088529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fe2a12b-1b54b3f1-ee83406a-d9487eea_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b348caea-52856906-fb8c6151-c6760566_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:21.125311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b348caea-52856906-fb8c6151-c6760566_0] Write session: try to update token
2025-10-15T11:01:21.125373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b348caea-52856906-fb8c6151-c6760566_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:21.203803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:21.203840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:21.203852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:21.203864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:21.203899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401944851025725:8828]
2025-10-15T11:01:21.203922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401944851025725:8828]
2025-10-15T11:01:21.203945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401944851025725:8828]
2025-10-15T11:01:21.204088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:21.204121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:21.204131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:21.204132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:21.204141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:21.204159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:21.204250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:21.204270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:21.207080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:21.239452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId: src_id|b348caea-52856906-fb8c6151-c6760566_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:21.268802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:21.353458Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:21.385104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:21.385155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:21.385220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:21.385233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:21.385273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401944851025725:8828]
2025-10-15T11:01:21.385785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:21.386359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:21.386542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:21.386554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:21.386809Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:21.397493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401937756367959:9630]
2025-10-15T11:01:21.397648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 922 reason: error at write: Disconnected sessionId: src_id|b348caea-52856906-fb8c6151-c6760566_0
2025-10-15T11:01:21.397996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 922 sessionId: src_id|b348caea-52856906-fb8c6151-c6760566_0 is DEAD
2025-10-15T11:01:21.402405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b348caea-52856906-fb8c6151-c6760566_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:21.402471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b348caea-52856906-fb8c6151-c6760566_0] Write session will restart in 0.008453s
2025-10-15T11:01:21.402630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b348caea-52856906-fb8c6151-c6760566_0] Write session: Do CDS request
2025-10-15T11:01:21.402689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b348caea-52856906-fb8c6151-c6760566_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:21.420712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b348caea-52856906-fb8c6151-c6760566_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:21.422122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:21.422172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 923
2025-10-15T11:01:21.422696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:21.422890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:21.422914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:21.422934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:21.424844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 923 sessionId:  describe result for acl check
2025-10-15T11:01:21.424967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:21.424978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:21.424987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:21.425004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401942051335361:9879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:21.427701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401942051335361:9879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:21.434886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401942051335361:9879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:21.445955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401942051335361:9879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:21.446002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401942051335361:9879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:21.446020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401942051335361:9879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:21.446049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:21.498589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401942051335569:9630]
2025-10-15T11:01:21.518621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:21.520764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:21.521596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:21.521629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:21.521672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:21.521921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:21.522120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401944851026011:8836]
2025-10-15T11:01:21.524299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:21.525556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:21.525869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:21.527294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:21.527696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.527719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.527727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.527736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.527749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.527762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.527770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.527777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.527785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.527792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.527800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.527808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.527814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.527821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.527873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.528002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.528057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.528105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.528154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.528206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.528268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.528315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.528370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.528413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.528455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.528493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.528533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.528568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.528608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.528668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.528738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.528788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.528829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.528873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.528912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.528955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.528996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.529038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.529077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.529120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.529168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.529233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.529279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.529340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.529393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.529447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.529496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.529556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.529648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.529726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.529780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.529841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.529887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.529937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.529976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.530026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.530551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:21.549731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:21.570764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:21.570820Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:21.570837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:21.570856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:21.570881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 922 [2:7561401944851026011:8836]
2025-10-15T11:01:21.570930Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:21.570986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:21.571002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:21.571015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:21.571026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:21.571072Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:21.571093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:21.571116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:21.573027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.573057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.573070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.573081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:21.573365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:21.573394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.573547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.573704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 922
2025-10-15T11:01:21.573830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 922, pipe: [1:7561401942051335569:9630]
2025-10-15T11:01:21.573904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 922
2025-10-15T11:01:21.573746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.573979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:21.574059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401942051335348:2467], now have 1 active actors on pipe
2025-10-15T11:01:21.574083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401942051335569:9630], now have 1 active actors on pipe
2025-10-15T11:01:21.574105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401942051335392:9879], now have 1 active actors on pipe
2025-10-15T11:01:21.574145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401944851026006:8836]
2025-10-15T11:01:21.574159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401944851026006:8836]
2025-10-15T11:01:21.574173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401944851026006:8836]
2025-10-15T11:01:21.574212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:21.574248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:21.574262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:21.574273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:21.574296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:21.574315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:21.574359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:21.574530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:21.574546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:21.574700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:21.574729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:21.574746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:21.574756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:21.574788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:21.574826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:21.574858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401944851026006:8836]
2025-10-15T11:01:21.574889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:21.574921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:21.574968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:21.577041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:21.577076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:21.577139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:21.577381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 923 partition: 0 MaxSeqNo: 46 sessionId: src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0
2025-10-15T11:01:21.578218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b348caea-52856906-fb8c6151-c6760566_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:21.637441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0] Write session: try to update token
2025-10-15T11:01:21.637506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:21.687714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:21.687769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:21.687788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:21.687876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:21.687905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:21.687924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:21.687940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:21.687985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401944851026006:8836]
2025-10-15T11:01:21.688037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401944851026006:8836]
2025-10-15T11:01:21.688063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401944851026006:8836]
2025-10-15T11:01:21.688194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:21.688253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:21.688307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:21.688310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:21.688352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:21.690277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:21.738752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId: src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:21.762922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:21.844764Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:21.856157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:21.856208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:21.856272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:21.856287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:21.856325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401944851026006:8836]
2025-10-15T11:01:21.856515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:21.856782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:21.856820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401942051335569:9630]
2025-10-15T11:01:21.856903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:21.856916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:21.856905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:21.919123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 923 reason: error at write: Disconnected sessionId: src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0
2025-10-15T11:01:21.921337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:21.921398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0] Write session will restart in 0.009605s
2025-10-15T11:01:21.921581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0] Write session: Do CDS request
2025-10-15T11:01:21.921626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:21.919434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 923 sessionId: src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0 is DEAD
2025-10-15T11:01:21.938139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:21.938180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 924
2025-10-15T11:01:21.938368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:21.941805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:21.941970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:21.941994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:21.942006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:21.944117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 924 sessionId:  describe result for acl check
2025-10-15T11:01:21.944241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:21.944257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:21.944268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:21.944286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401942051335780:9888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:21.947991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401942051335780:9888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:21.957136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401942051335780:9888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:21.958188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401942051335854:9630]
2025-10-15T11:01:21.967596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401942051335780:9888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:21.967647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401942051335780:9888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:21.967665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401942051335780:9888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:21.967697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:21.974513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:21.980192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:21.981068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:21.981086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:21.981125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:21.981385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:21.981579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401944851026288:8847]
2025-10-15T11:01:21.984366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:21.985425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:21.985655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:21.986934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:21.987261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.987269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.987278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.987286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.987294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.987302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.987310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.987318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.987326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.987333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.987340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.987367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.987375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.987383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.987434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.987555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.987611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.987666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.987714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.987767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.987817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.987868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.987918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.987969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.988032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.988080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.988130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.988179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.988227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.988296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:21.988358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.988421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:21.988474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.988536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:21.988583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.988641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:21.988694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.988752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:21.988801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.988857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:21.988907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.988965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:21.989015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.989071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:21.989124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.989179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:21.989229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.989288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:21.989337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.989393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:21.989443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.989501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:21.989551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.989607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:21.989657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.989717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:21.990253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:22.008403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:22.063595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:22.063652Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:22.063670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:22.063691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:22.063719Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 923 [2:7561401944851026288:8847]
2025-10-15T11:01:22.063773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:22.063837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:22.063852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:22.063865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:22.063877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:22.063930Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:22.063955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:22.063977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:22.065827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 923, pipe: [1:7561401942051335854:9630]
2025-10-15T11:01:22.065977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 923
2025-10-15T11:01:22.066091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 923
2025-10-15T11:01:22.065015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.065047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.065062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.065074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:22.065352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:22.065371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.065541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.065764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.066008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:22.066101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401942051335854:9630], now have 1 active actors on pipe
2025-10-15T11:01:22.066128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401942051335886:9888], now have 1 active actors on pipe
2025-10-15T11:01:22.066154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401942051335637:2467], now have 1 active actors on pipe
2025-10-15T11:01:22.066181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401944851026283:8847]
2025-10-15T11:01:22.066198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401944851026283:8847]
2025-10-15T11:01:22.066213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401944851026283:8847]
2025-10-15T11:01:22.066249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:22.066310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:22.066324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:22.066326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:22.066338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:22.066519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:22.066537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:22.066595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:22.066616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:22.066761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401944851026283:8847]
2025-10-15T11:01:22.066793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:22.066823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:22.066866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:22.066899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:22.066919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:22.066930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:22.066970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:22.067013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:22.067142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:22.068482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:22.068525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:22.072302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 924 partition: 0 MaxSeqNo: 46 sessionId: src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0
2025-10-15T11:01:22.073119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90d2f12-a6a20e66-c971c4f5-4b3b0322_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:22.068600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:22.093964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0] Write session: try to update token
2025-10-15T11:01:22.094018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:22.159700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:22.159758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:22.159780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:22.159795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:22.159835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401944851026283:8847]
2025-10-15T11:01:22.159871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401944851026283:8847]
2025-10-15T11:01:22.159907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401944851026283:8847]
2025-10-15T11:01:22.160096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:22.160133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:22.160141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:22.160152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:22.160168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:22.162800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:22.192509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId: src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:22.228515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:22.307324Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:22.316564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:22.316618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:22.316681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:22.316694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:22.316735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401944851026283:8847]
2025-10-15T11:01:22.317229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:22.317308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:22.317443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:22.317479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:22.319082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:22.319218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401942051335854:9630]
2025-10-15T11:01:22.349479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 924 reason: error at write: Disconnected sessionId: src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0
2025-10-15T11:01:22.351526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:22.351564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0] Write session will restart in 0.005065s
2025-10-15T11:01:22.351652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0] Write session: Do CDS request
2025-10-15T11:01:22.351679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:22.349769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 924 sessionId: src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0 is DEAD
2025-10-15T11:01:22.366217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:22.366261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 925
2025-10-15T11:01:22.372084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:22.372825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:22.373023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:22.373054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:22.373067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:22.374416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 925 sessionId:  describe result for acl check
2025-10-15T11:01:22.374509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:22.374522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:22.374530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:22.374548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401946346303222:9892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:22.377175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401946346303222:9892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:22.385819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401946346303222:9892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:22.400249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401946346303222:9892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:22.400296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401946346303222:9892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:22.400312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401946346303222:9892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:22.400343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:22.419546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401946346303369:9630]
2025-10-15T11:01:22.456644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:22.459098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:22.460022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:22.460056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:22.460103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:22.460379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:22.460585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401949145993845:8849]
2025-10-15T11:01:22.463363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:22.464871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:22.465178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:22.466531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:22.466787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:22.466799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:22.466804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:22.466809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:22.466813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:22.466819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:22.466824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:22.466829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:22.466834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:22.466838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:22.466842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:22.466847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.466851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.466856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.466889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:22.466972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:22.467008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:22.467044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:22.467075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:22.467109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:22.467146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:22.467180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:22.467212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:22.467246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:22.467284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:22.467322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.467385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.467436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.467484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:22.467558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:22.467618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:22.467672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:22.467728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:22.467783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:22.467828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:22.467881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:22.467929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:22.467982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:22.468042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:22.468093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:22.468142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:22.468184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:22.468230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:22.468288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:22.468322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:22.468357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:22.468391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:22.468430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:22.468463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:22.468503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:22.468536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.468576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.468607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.468644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.468684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.468739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.469126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:22.502436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:22.515189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 924
2025-10-15T11:01:22.515297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 924, pipe: [1:7561401946346303369:9630]
2025-10-15T11:01:22.512375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:22.512428Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:22.515403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 924
2025-10-15T11:01:22.512445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:22.512467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:22.512494Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 924 [2:7561401949145993845:8849]
2025-10-15T11:01:22.512551Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:22.512614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:22.512631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:22.512644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:22.512656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:22.512711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:22.512735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:22.512762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:22.514428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.514446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.514460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.514472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:22.514736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:22.514756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.514906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.515114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.515755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:22.515839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401946346303296:9892], now have 1 active actors on pipe
2025-10-15T11:01:22.515861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401946346303206:2467], now have 1 active actors on pipe
2025-10-15T11:01:22.515876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401946346303369:9630], now have 1 active actors on pipe
2025-10-15T11:01:22.515898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401949145993840:8849]
2025-10-15T11:01:22.515908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401949145993840:8849]
2025-10-15T11:01:22.515918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401949145993840:8849]
2025-10-15T11:01:22.515946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:22.515987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:22.516021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:22.516033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:22.516048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:22.516065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:22.516093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:22.516246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:22.516267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:22.516422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20e3a24b-519542c-f0ce919c-d205bd09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:22.516457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:22.516471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:22.516479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:22.516507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:22.516539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:22.516574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401949145993840:8849]
2025-10-15T11:01:22.516607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:22.516641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:22.516692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:22.517442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:22.517472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:22.517535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:22.518036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 925 partition: 0 MaxSeqNo: 46 sessionId: src_id|20e3a24b-519542c-f0ce919c-d205bd09_0
2025-10-15T11:01:22.518835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9254f3ae-4bab7faa-6664ada9-b540e3ea_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|20e3a24b-519542c-f0ce919c-d205bd09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:22.540633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e3a24b-519542c-f0ce919c-d205bd09_0] Write session: try to update token
2025-10-15T11:01:22.540693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e3a24b-519542c-f0ce919c-d205bd09_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:22.585354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:22.585398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:22.585414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:22.585426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:22.585466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401949145993840:8849]
2025-10-15T11:01:22.585492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401949145993840:8849]
2025-10-15T11:01:22.585509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401949145993840:8849]
2025-10-15T11:01:22.585630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:22.585654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:22.585706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:22.585748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:22.585779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:22.586604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:22.668520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId: src_id|20e3a24b-519542c-f0ce919c-d205bd09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:22.694729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:22.734621Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:22.738074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:22.738118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:22.743556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:22.743594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:22.751020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 925 reason: error at write: Disconnected sessionId: src_id|20e3a24b-519542c-f0ce919c-d205bd09_0
2025-10-15T11:01:22.751634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e3a24b-519542c-f0ce919c-d205bd09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:22.751681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e3a24b-519542c-f0ce919c-d205bd09_0] Write session will restart in 0.005294s
2025-10-15T11:01:22.751781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e3a24b-519542c-f0ce919c-d205bd09_0] Write session: Do CDS request
2025-10-15T11:01:22.751808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e3a24b-519542c-f0ce919c-d205bd09_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:22.753048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 925 sessionId: src_id|20e3a24b-519542c-f0ce919c-d205bd09_0 is DEAD
2025-10-15T11:01:22.761804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:22.768848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20e3a24b-519542c-f0ce919c-d205bd09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:22.781225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:22.781395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401946346303369:9630]
2025-10-15T11:01:22.781617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:22.781633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 926
2025-10-15T11:01:22.782043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:22.782161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:22.782176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:22.782186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:22.784068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 926 sessionId:  describe result for acl check
2025-10-15T11:01:22.784188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:22.784198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:22.784208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:22.784226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401946346303508:9903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:22.786850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401946346303508:9903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:22.798073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401946346303508:9903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:22.813175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401946346303508:9903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:22.813225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401946346303508:9903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:22.813243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401946346303508:9903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:22.813271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:22.882134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401946346303732:9630]
2025-10-15T11:01:22.907714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:22.923881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:22.924946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:22.924980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:22.925025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:22.925263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:22.925437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401949145994126:8859]
2025-10-15T11:01:22.927635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:22.929280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:22.929531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:22.931076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:22.931501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:22.931520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:22.931528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:22.931534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:22.931540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:22.931544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:22.931550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:22.931554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:22.931560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:22.931591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:22.931598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:22.931603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.931612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.931618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.931661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:22.931748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:22.931784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:22.931822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:22.931857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:22.931890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:22.931925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:22.931959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:22.931993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:22.932044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:22.932088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:22.932121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.932154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.932199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.932246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:22.932319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:22.932385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:22.932447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:22.932503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:22.932562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:22.932616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:22.932677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:22.932735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:22.932798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:22.932849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:22.932910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:22.932968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:22.933031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:22.933081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:22.933182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:22.933245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:22.933307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:22.933359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:22.933425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:22.933476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:22.933537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:22.933589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.933649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:22.933698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.933754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:22.933802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.933857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:22.934312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:22.967080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:22.984173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:22.984221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:22.984240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:22.984259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:22.984286Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 925 [2:7561401949145994126:8859]
2025-10-15T11:01:22.984342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:22.984403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:22.984419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:22.984431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:22.984444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:22.984494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:22.984518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:22.984543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:23.012969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:23.013002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:23.013014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:23.013025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:23.013307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:23.013332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:23.013468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:23.013649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:23.013865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:23.013947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401949145994118:8859]
2025-10-15T11:01:23.013969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401949145994118:8859]
2025-10-15T11:01:23.013983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401949145994118:8859]
2025-10-15T11:01:23.014023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:23.014100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:23.014293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:23.014317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:23.014383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:23.014418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:23.014429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:23.014464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401946346303732:9630], now have 1 active actors on pipe
2025-10-15T11:01:23.014487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401946346303501:2467], now have 1 active actors on pipe
2025-10-15T11:01:23.014503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401949145994118:8859]
2025-10-15T11:01:23.014524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:23.014552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:23.014561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401946346303539:9903], now have 1 active actors on pipe
2025-10-15T11:01:23.016287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 925, pipe: [1:7561401946346303732:9630]
2025-10-15T11:01:23.016398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 925
2025-10-15T11:01:23.016485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 925
2025-10-15T11:01:23.017188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:23.017247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:23.017356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19a79706-5371731e-3d28d5df-6db86df1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:23.017396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:23.017416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:23.017428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:23.017479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:23.017530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:23.017610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:23.019115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:23.019167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:23.019244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:23.019706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 926 partition: 0 MaxSeqNo: 46 sessionId: src_id|19a79706-5371731e-3d28d5df-6db86df1_0
2025-10-15T11:01:23.024096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20e3a24b-519542c-f0ce919c-d205bd09_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|19a79706-5371731e-3d28d5df-6db86df1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:23.085049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:23.085086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:23.085100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:23.087326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a79706-5371731e-3d28d5df-6db86df1_0] Write session: try to update token
2025-10-15T11:01:23.087403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a79706-5371731e-3d28d5df-6db86df1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:23.126797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:23.126840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:23.126855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:23.126867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:23.126905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401949145994118:8859]
2025-10-15T11:01:23.126935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401949145994118:8859]
2025-10-15T11:01:23.126961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401949145994118:8859]
2025-10-15T11:01:23.127119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:23.127153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:23.128752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:23.129780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:23.129823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:23.129852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:23.209636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId: src_id|19a79706-5371731e-3d28d5df-6db86df1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:23.230508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:23.297812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:23.299605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:23.299653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:23.301889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401946346303732:9630]
2025-10-15T11:01:23.302089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:23.302121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:23.302190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:23.303121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:23.335317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 926 reason: error at write: Disconnected sessionId: src_id|19a79706-5371731e-3d28d5df-6db86df1_0
2025-10-15T11:01:23.335735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 926 sessionId: src_id|19a79706-5371731e-3d28d5df-6db86df1_0 is DEAD
2025-10-15T11:01:23.339992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a79706-5371731e-3d28d5df-6db86df1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:23.340048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a79706-5371731e-3d28d5df-6db86df1_0] Write session will restart in 0.007045s
2025-10-15T11:01:23.340141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a79706-5371731e-3d28d5df-6db86df1_0] Write session: Do CDS request
2025-10-15T11:01:23.340172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a79706-5371731e-3d28d5df-6db86df1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:23.357744Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:23.357784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 927
2025-10-15T11:01:23.358231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19a79706-5371731e-3d28d5df-6db86df1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:23.358748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:23.358873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:23.358888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:23.358897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:23.360519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 927 sessionId:  describe result for acl check
2025-10-15T11:01:23.360659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:23.360671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:23.360681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:23.360700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401950641271106:9911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:23.363654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401950641271106:9911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:23.381611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401950641271106:9911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:23.402362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401950641271106:9911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:23.402422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401950641271106:9911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:23.402439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401950641271106:9911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:23.402467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:23.402882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401950641271222:9630]
2025-10-15T11:01:23.453310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:23.472561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:23.473637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:23.473674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:23.473723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:23.474000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:23.474205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401953440961704:8868]
2025-10-15T11:01:23.476385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:23.477835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:23.478067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:23.479386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:23.479722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:23.479739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:23.479747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:23.479755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:23.479763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:23.479770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:23.479778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:23.479785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:23.479793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:23.479800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:23.479809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:23.479816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:23.479824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:23.479830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:23.479879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:23.480001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:23.480066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:23.480113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:23.480163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:23.480213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:23.480261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:23.480309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:23.480359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:23.480409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:23.480460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:23.480509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:23.480560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:23.480609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:23.480657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:23.480730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:23.480809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:23.480882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:23.480935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:23.480994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:23.481044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:23.481100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:23.481153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:23.481210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:23.481258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:23.481317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:23.481366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:23.481424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:23.481471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:23.481528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:23.482091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:23.482162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:23.482211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:23.482268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:23.482317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:23.482375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:23.482424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:23.482479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:23.482531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:23.482590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:23.482637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:23.482692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:23.483225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:23.505681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:23.517093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:23.517152Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:23.517170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:23.517191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:23.517219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 926 [2:7561401953440961704:8868]
2025-10-15T11:01:23.517275Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:23.517342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:23.517357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:23.517371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:23.517383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:23.517437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:23.517462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:23.517487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:23.518932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:23.518965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:23.518980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:23.518992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:23.520812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 926, pipe: [1:7561401950641271222:9630]
2025-10-15T11:01:23.520906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 926
2025-10-15T11:01:23.521044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 926
2025-10-15T11:01:23.523069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:23.523105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:23.523261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:23.523488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:23.523724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:23.523769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401950641271079:2467], now have 1 active actors on pipe
2025-10-15T11:01:23.523794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401950641271222:9630], now have 1 active actors on pipe
2025-10-15T11:01:23.523817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401950641271221:9911], now have 1 active actors on pipe
2025-10-15T11:01:23.523874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:23.523897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:23.524000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401953440961699:8868]
2025-10-15T11:01:23.524016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401953440961699:8868]
2025-10-15T11:01:23.524043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401953440961699:8868]
2025-10-15T11:01:23.524087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:23.524142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:23.524157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:23.524170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:23.524187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:23.524220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:23.524240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:23.524253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:23.524293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:23.524342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:23.524398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:23.524593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:23.524612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:23.524751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:23.524812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401953440961699:8868]
2025-10-15T11:01:23.524838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:23.525093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:23.526745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:23.526791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:23.526866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:23.527422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 927 partition: 0 MaxSeqNo: 46 sessionId: src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0
2025-10-15T11:01:23.528986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19a79706-5371731e-3d28d5df-6db86df1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:23.563412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0] Write session: try to update token
2025-10-15T11:01:23.563487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:23.721790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId: src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:23.731821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:23.731856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:23.731866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:23.731875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:23.731902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401953440961699:8868]
2025-10-15T11:01:23.731919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401953440961699:8868]
2025-10-15T11:01:23.731936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401953440961699:8868]
2025-10-15T11:01:23.732043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:23.732067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:23.732078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:23.732086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:23.732094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:23.732121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:23.732170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:23.732186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:23.733027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:23.748112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:23.882100Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:23.890608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:23.890657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:23.890725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:23.890741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:23.891419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:23.891452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:23.890790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401953440961699:8868]
2025-10-15T11:01:23.890978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:23.892589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:23.893012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:23.893285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401950641271222:9630]
2025-10-15T11:01:23.910475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 927 reason: error at write: Disconnected sessionId: src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0
2025-10-15T11:01:23.910846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 927 sessionId: src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0 is DEAD
2025-10-15T11:01:23.911809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:23.911847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0] Write session will restart in 0.009740s
2025-10-15T11:01:23.911954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0] Write session: Do CDS request
2025-10-15T11:01:23.911985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:23.934476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:23.936468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:23.936516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 928
2025-10-15T11:01:23.936883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:23.937028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:23.937054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:23.937065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:23.940867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 928 sessionId:  describe result for acl check
2025-10-15T11:01:23.940983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:23.941002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:23.941012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:23.941032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401950641271377:9917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:23.945731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401950641271377:9917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:23.956277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401950641271377:9917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:23.971042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401950641271377:9917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:23.971087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401950641271377:9917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:23.971102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401950641271377:9917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:23.971132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:23.992828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401950641271542:9630]
2025-10-15T11:01:24.018708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:24.021931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:24.022786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:24.022802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:24.022841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:24.023061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:24.023225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401957735929287:8872]
2025-10-15T11:01:24.025235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:24.026310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:24.026526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:24.037086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:24.037559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:24.037568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:24.037575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:24.037582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:24.037589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:24.037597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:24.037604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:24.037611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:24.037617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:24.037624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:24.037630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:24.037637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.037643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.037650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.037694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:24.037810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:24.037856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:24.037904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:24.037948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:24.037994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:24.038036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:24.038080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:24.038122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:24.038167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:24.038211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:24.038255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.038297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.038339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.038378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:24.038441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:24.038496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:24.038549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:24.038595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:24.038646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:24.038690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:24.038742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:24.038788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:24.038838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:24.038881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:24.038934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:24.038979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:24.039032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:24.039078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:24.039130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:24.039176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:24.039225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:24.039268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:24.039317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:24.039380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:24.039428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:24.039473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.039520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.039565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.039616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.039659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.039709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.042187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:24.060852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:24.075263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:24.075320Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:24.075335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:24.075367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:24.075390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 927 [2:7561401957735929287:8872]
2025-10-15T11:01:24.075444Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:24.075497Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:24.075509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:24.075520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:24.075541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:24.075597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:24.075626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:24.075645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:24.077366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.077382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.077395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.077405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:24.077678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:24.077695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.077825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.078023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.078243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:24.078319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401950641271436:9917], now have 1 active actors on pipe
2025-10-15T11:01:24.078340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401950641271542:9630], now have 1 active actors on pipe
2025-10-15T11:01:24.078358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401950641271358:2467], now have 1 active actors on pipe
2025-10-15T11:01:24.078383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401957735929282:8872]
2025-10-15T11:01:24.078397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401957735929282:8872]
2025-10-15T11:01:24.079531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 927
2025-10-15T11:01:24.078408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401957735929282:8872]
2025-10-15T11:01:24.078447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:24.079611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 927, pipe: [1:7561401950641271542:9630]
2025-10-15T11:01:24.078502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:24.079676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 927
2025-10-15T11:01:24.078515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:24.078518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:24.078530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:24.078674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:24.078690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:24.078793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401957735929282:8872]
2025-10-15T11:01:24.078824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:24.078856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:24.080105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:24.080143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:24.080235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:24.080264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:24.080281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:24.080290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:24.080323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:24.080360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:24.080403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:24.084019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:24.084070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:24.084132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:24.087180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 928 partition: 0 MaxSeqNo: 46 sessionId: src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0
2025-10-15T11:01:24.091620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783af2a2-8d8eccc0-f897507c-d30e0b7b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:24.120285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:24.129408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:24.129468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401957735929282:8872]
2025-10-15T11:01:24.129607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:24.131058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:24.144298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:24.161748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0] Write session: try to update token
2025-10-15T11:01:24.161798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:24.227151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:24.228607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:24.230126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:24.236368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:24.236835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:24.236844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:24.236852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:24.236888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:24.285082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:24.285110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:24.285119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:24.285127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:24.285152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401957735929282:8872]
2025-10-15T11:01:24.285175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401957735929282:8872]
2025-10-15T11:01:24.285198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401957735929282:8872]
2025-10-15T11:01:24.285291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:24.285305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:24.285403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:24.285420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:24.285444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:24.286476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:24.291978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId: src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:24.311471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:24.429561Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:24.439311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:24.439449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:24.440995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:24.441024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:24.440548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:24.450497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 928 reason: error at write: Disconnected sessionId: src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0
2025-10-15T11:01:24.450792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 928 sessionId: src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0 is DEAD
2025-10-15T11:01:24.451730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:24.451768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0] Write session will restart in 0.006419s
2025-10-15T11:01:24.451904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0] Write session: Do CDS request
2025-10-15T11:01:24.451951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:24.463640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401950641271542:9630]
2025-10-15T11:01:24.463707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:24.471321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:24.471383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 929
2025-10-15T11:01:24.471768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:24.474676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:24.474796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:24.474811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:24.474820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:24.476528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 929 sessionId:  describe result for acl check
2025-10-15T11:01:24.476637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:24.476653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:24.476661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:24.476676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401954936238963:9927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:24.478716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401954936238963:9927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:24.489256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401954936238963:9927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:24.506782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401954936238963:9927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:24.506825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401954936238963:9927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:24.506840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401954936238963:9927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:24.506867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:24.565786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:24.567727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401954936239211:9630]
2025-10-15T11:01:24.570094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:24.570923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:24.570940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:24.570980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:24.571220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:24.571422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401957735929578:8885]
2025-10-15T11:01:24.573565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:24.574929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:24.575138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:24.576595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:24.576939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:24.576946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:24.576954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:24.576960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:24.576966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:24.576972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:24.576979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:24.576984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:24.576991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:24.576998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:24.577004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:24.577011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.577017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.577022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.577067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:24.577170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:24.577213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:24.577255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:24.577296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:24.577338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:24.577381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:24.577424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:24.577466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:24.577510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:24.577554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:24.577594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.577634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.577675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.577719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:24.577781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:24.577831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:24.577879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:24.577922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:24.577969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:24.578010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:24.578057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:24.578098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:24.578144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:24.578185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:24.578231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:24.578272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:24.578315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:24.578354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:24.578398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:24.578440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:24.578489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:24.578549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:24.578604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:24.578650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:24.578700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:24.578743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.578793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.578841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.578890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.578932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.578984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.579596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:24.601143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:24.608838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:24.608879Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:24.608893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:24.608909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:24.608931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 928 [2:7561401957735929578:8885]
2025-10-15T11:01:24.608978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:24.611874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 928, pipe: [1:7561401954936239211:9630]
2025-10-15T11:01:24.611994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 928
2025-10-15T11:01:24.612077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 928
2025-10-15T11:01:24.609029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:24.609140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:24.609154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:24.609165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:24.609201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:24.609216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:24.609231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:24.610594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.610609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.610622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.610636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:24.610884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:24.610899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:24.611022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:24.611186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:24.611412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:24.611490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401954936239211:9630], now have 1 active actors on pipe
2025-10-15T11:01:24.611511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401954936239035:9927], now have 1 active actors on pipe
2025-10-15T11:01:24.611533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401954936238949:2467], now have 1 active actors on pipe
2025-10-15T11:01:24.611556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401957735929572:8885]
2025-10-15T11:01:24.611573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401957735929572:8885]
2025-10-15T11:01:24.611586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401957735929572:8885]
2025-10-15T11:01:24.611629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:24.611679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:24.611694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:24.611698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:24.611706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:24.611874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:24.611893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:24.612009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401957735929572:8885]
2025-10-15T11:01:24.612051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:24.612073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:24.615832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:24.615870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:24.615963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:24.615992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:24.616010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:24.616019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:24.616066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:24.616104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:24.616152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:24.627971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:24.628021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:24.628128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:24.629452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92956bc4-c7c8b1a8-7016eb5e-37f01edc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:24.628740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 929 partition: 0 MaxSeqNo: 46 sessionId: src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0
2025-10-15T11:01:24.651199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0] Write session: try to update token
2025-10-15T11:01:24.651250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:24.686961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:24.686997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:24.687031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401957735929572:8885]
2025-10-15T11:01:24.687139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:24.687142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:24.688822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:24.689902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:24.691275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:24.692605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:24.694379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:24.694803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:24.711422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:24.711457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:24.711467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:24.752414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId: src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:24.788957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:24.789346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:24.789389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:24.789454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T11:01:24.789697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:24.820097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:24.820129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:24.820140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:24.820190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:24.820208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:24.820229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:24.820243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:24.820283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401957735929572:8885]
2025-10-15T11:01:24.820317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401957735929572:8885]
2025-10-15T11:01:24.820345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401957735929572:8885]
2025-10-15T11:01:24.820459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:24.820483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:24.820505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:24.820520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:24.820556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:24.821849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:24.963864Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:25.001718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:25.001777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:25.002449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.002887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.003326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.003797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.004027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.004069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.004519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.004951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.005376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.005832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.006026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.006049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.006496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.006916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.007337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.007783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.007984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.008005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.008444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.008862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.009301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.009712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.010211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.010240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.010708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.011161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.011723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.012184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.012392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.012413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.012858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.013301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.013728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.014327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.014563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.014592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.015564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.016076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.016575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.017046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.017267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.017286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.017959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.018434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.018872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.019329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.019568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.019587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.020025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.020464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.020892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.021327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.021791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.021810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.022414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 1 size: 511959
2025-10-15T11:01:25.022881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 1 messageNo: 1 size: 511959
2025-10-15T11:01:25.023636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 2 messageNo: 1 size: 511959
2025-10-15T11:01:25.024115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 3 messageNo: 1 size: 511959
2025-10-15T11:01:25.024333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 4 messageNo: 1 size: 205040
2025-10-15T11:01:25.024353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T11:01:25.033664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:25.034494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401954936239211:9630]
2025-10-15T11:01:25.034588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:25.034691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 929 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0
2025-10-15T11:01:25.035195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 929 sessionId: src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0 is DEAD
2025-10-15T11:01:25.035539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:25.039625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:25.039681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0] Write session will restart in 0.009968s
2025-10-15T11:01:25.039846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0] Write session: Do CDS request
2025-10-15T11:01:25.039898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:25.056674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:25.057210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:25.057242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 930
2025-10-15T11:01:25.057610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:25.057715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:25.057730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:25.057739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:25.060923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 930 sessionId:  describe result for acl check
2025-10-15T11:01:25.061034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:25.061045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:25.061054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:25.061070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401959231206552:9938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:25.063253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401959231206552:9938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:25.074739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401959231206552:9938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:25.104525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401959231206552:9938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:25.104570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401959231206552:9938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:25.104585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401959231206552:9938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:25.104615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:25.134856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401959231206721:9630]
2025-10-15T11:01:25.172486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:25.182791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:25.183692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:25.183721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:25.183763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:25.184056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:25.184380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401962030897146:8891]
2025-10-15T11:01:25.185942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:25.187616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:25.187827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:25.188781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:25.189003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:25.189007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:25.189012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:25.189016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:25.189021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:25.189026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:25.189030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:25.189035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:25.189039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:25.189044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:25.189048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:25.189053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.189057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.189062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.189091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:25.189170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:25.189201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:25.189234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:25.189266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:25.189297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:25.189327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:25.189370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:25.189407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:25.189439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:25.189472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:25.189500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.189530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.189561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.189587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:25.189632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:25.189668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:25.189704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:25.189735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:25.189769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:25.189799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:25.189850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:25.189895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:25.189939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:25.189981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:25.190017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:25.190047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:25.190081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:25.190112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:25.190145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:25.190176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:25.190211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:25.190239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:25.190272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:25.190303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:25.190337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:25.190365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.190401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.190444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.190480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.190510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.190543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.190893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:25.209141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:25.217921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:25.217959Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:25.217972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:25.217985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:25.218003Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 929 [2:7561401962030897146:8891]
2025-10-15T11:01:25.218039Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:25.218083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:25.218093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:25.218102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:25.218110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:25.218144Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:25.218158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:25.218178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:25.219781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.219799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.219807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.219814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:25.220095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:25.220113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.220248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.220439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.220664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:25.220740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401959231206540:2467], now have 1 active actors on pipe
2025-10-15T11:01:25.220761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401959231206598:9938], now have 1 active actors on pipe
2025-10-15T11:01:25.220781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401959231206721:9630], now have 1 active actors on pipe
2025-10-15T11:01:25.220805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401962030897141:8891]
2025-10-15T11:01:25.220817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401962030897141:8891]
2025-10-15T11:01:25.220830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401962030897141:8891]
2025-10-15T11:01:25.220867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:25.220936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:25.220948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:25.220960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:25.220970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:25.221101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:25.221117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:25.221238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:25.221258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:25.221302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401962030897141:8891]
2025-10-15T11:01:25.221331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:25.221438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57435e29-44f880d6-8d5849b3-5951169e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:25.221466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:25.221500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:25.221510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:25.221542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:25.221578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:25.221659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:25.221883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:25.222993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:25.223026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:25.223098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:25.220643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 929
2025-10-15T11:01:25.220717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 929, pipe: [1:7561401959231206721:9630]
2025-10-15T11:01:25.220784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 929
2025-10-15T11:01:25.223531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 930 partition: 0 MaxSeqNo: 46 sessionId: src_id|57435e29-44f880d6-8d5849b3-5951169e_0
2025-10-15T11:01:25.224126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c410702b-e5ebeb69-9d17b42c-f4673c60_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|57435e29-44f880d6-8d5849b3-5951169e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:25.252006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57435e29-44f880d6-8d5849b3-5951169e_0] Write session: try to update token
2025-10-15T11:01:25.252072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57435e29-44f880d6-8d5849b3-5951169e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:25.315178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:25.315211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:25.315224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:25.315234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:25.315269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401962030897141:8891]
2025-10-15T11:01:25.315294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401962030897141:8891]
2025-10-15T11:01:25.315317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401962030897141:8891]
2025-10-15T11:01:25.315536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:25.315564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:25.315591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:25.316075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:25.316089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:25.316099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:25.316182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:25.316200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:25.317185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:25.374217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId: src_id|57435e29-44f880d6-8d5849b3-5951169e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:25.396631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:25.470543Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:25.492749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:25.492796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:25.492858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:25.492869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:25.492903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401962030897141:8891]
2025-10-15T11:01:25.493081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:25.493417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:25.495975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:25.497323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:25.497577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401959231206721:9630]
2025-10-15T11:01:25.512304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 930 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57435e29-44f880d6-8d5849b3-5951169e_0
2025-10-15T11:01:25.512584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 930 sessionId: src_id|57435e29-44f880d6-8d5849b3-5951169e_0 is DEAD
2025-10-15T11:01:25.516365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57435e29-44f880d6-8d5849b3-5951169e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:25.516421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57435e29-44f880d6-8d5849b3-5951169e_0] Write session will restart in 0.009045s
2025-10-15T11:01:25.516602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57435e29-44f880d6-8d5849b3-5951169e_0] Write session: Do CDS request
2025-10-15T11:01:25.516646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57435e29-44f880d6-8d5849b3-5951169e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:25.530716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:25.530748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 931
2025-10-15T11:01:25.531487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57435e29-44f880d6-8d5849b3-5951169e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:25.532392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:25.532538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:25.532558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:25.532566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:25.533984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 931 sessionId:  describe result for acl check
2025-10-15T11:01:25.534092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:25.534102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:25.534110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:25.534126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401959231206825:9942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:25.536188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401959231206825:9942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:25.542421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401959231206825:9942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:25.557375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401959231206825:9942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:25.557425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401959231206825:9942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:25.557441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401959231206825:9942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:25.557469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:25.597606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401959231207077:9630]
2025-10-15T11:01:25.607003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:25.616530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:25.617370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:25.617406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:25.617446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:25.617688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:25.617866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401962030897434:8899]
2025-10-15T11:01:25.620178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:25.621164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:25.621387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:25.622625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:25.622938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:25.622959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:25.622966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:25.622973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:25.622980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:25.622987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:25.622994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:25.623001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:25.623008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:25.623015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:25.623021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:25.623028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.623036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.623042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.623085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:25.623186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:25.623232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:25.623276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:25.623322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:25.623388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:25.623435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:25.623483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:25.623529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:25.623578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:25.623623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:25.623675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.623725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.623773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.623817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:25.623885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:25.623946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:25.624004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:25.624066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:25.624120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:25.624198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:25.624255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:25.624304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:25.624358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:25.624402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:25.624458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:25.624507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:25.624565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:25.624612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:25.624666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:25.624717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:25.624772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:25.624820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:25.624875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:25.624924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:25.624979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:25.625028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.625082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.625127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.625186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.625370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.625429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.625905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:25.646066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:25.654468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:25.654511Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:25.654521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:25.654536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:25.654560Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 930 [2:7561401962030897434:8899]
2025-10-15T11:01:25.654596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:25.654636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:25.654647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:25.654657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:25.654664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:25.654695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:25.654710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:25.654724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:25.656244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.656269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.656279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.656289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:25.656558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:25.656582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:25.656705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:25.656774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 930
2025-10-15T11:01:25.656870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 930, pipe: [1:7561401959231207077:9630]
2025-10-15T11:01:25.656972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 930
2025-10-15T11:01:25.656885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:25.657109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:25.657186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401959231206812:2467], now have 1 active actors on pipe
2025-10-15T11:01:25.657207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401959231207077:9630], now have 1 active actors on pipe
2025-10-15T11:01:25.657229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401959231206895:9942], now have 1 active actors on pipe
2025-10-15T11:01:25.657268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401962030897429:8899]
2025-10-15T11:01:25.657282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401962030897429:8899]
2025-10-15T11:01:25.657295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401962030897429:8899]
2025-10-15T11:01:25.657323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:25.657350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:25.657363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:25.657374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:25.657389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:25.657541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:25.657558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:25.657612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:25.657630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:25.657739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401962030897429:8899]
2025-10-15T11:01:25.657771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:25.657812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:25.657837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2db919bf-d20d6046-3b93d5-435dc420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:25.657868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:25.657885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:25.657896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:25.657924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:25.657950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:25.658035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:25.659305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:25.659336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:25.659416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:25.659986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 931 partition: 0 MaxSeqNo: 46 sessionId: src_id|2db919bf-d20d6046-3b93d5-435dc420_0
2025-10-15T11:01:25.663540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57435e29-44f880d6-8d5849b3-5951169e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2db919bf-d20d6046-3b93d5-435dc420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:25.684710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db919bf-d20d6046-3b93d5-435dc420_0] Write session: try to update token
2025-10-15T11:01:25.684759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db919bf-d20d6046-3b93d5-435dc420_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:25.692364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:25.692401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:25.692435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401962030897429:8899]
2025-10-15T11:01:25.692546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:25.694298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:25.695606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:25.700565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:25.702385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:25.703654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:25.705684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:25.706166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:25.772165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:25.772201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:25.772213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:25.772223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:25.772259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401962030897429:8899]
2025-10-15T11:01:25.772284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401962030897429:8899]
2025-10-15T11:01:25.772307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401962030897429:8899]
2025-10-15T11:01:25.772467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:25.772488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:25.772490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:25.772497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:25.772535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:25.772537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:25.772552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:25.772567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:25.773934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:25.792919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId: src_id|2db919bf-d20d6046-3b93d5-435dc420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:25.813727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:25.925830Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:25.927989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:25.928033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:25.928887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:25.928676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:25.928713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:25.971237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 931 reason: error at write: Disconnected sessionId: src_id|2db919bf-d20d6046-3b93d5-435dc420_0
2025-10-15T11:01:25.973190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db919bf-d20d6046-3b93d5-435dc420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:25.973264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db919bf-d20d6046-3b93d5-435dc420_0] Write session will restart in 0.006398s
2025-10-15T11:01:25.973440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db919bf-d20d6046-3b93d5-435dc420_0] Write session: Do CDS request
2025-10-15T11:01:25.973480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db919bf-d20d6046-3b93d5-435dc420_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:25.972735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 931 sessionId: src_id|2db919bf-d20d6046-3b93d5-435dc420_0 is DEAD
2025-10-15T11:01:25.984141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2db919bf-d20d6046-3b93d5-435dc420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:25.989626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:25.989817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401959231207077:9630]
2025-10-15T11:01:25.989846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:25.989860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 932
2025-10-15T11:01:25.990504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:25.990594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:25.990604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:25.990611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:25.991738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 932 sessionId:  describe result for acl check
2025-10-15T11:01:25.991815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:25.991821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:25.991829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:25.991840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401959231207126:9954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:25.993607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401959231207126:9954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:26.001540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401959231207126:9954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:26.015892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401959231207126:9954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:26.015939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401959231207126:9954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:26.015955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401959231207126:9954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:26.015981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:26.090035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401963526174640:9630]
2025-10-15T11:01:26.105808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:26.114564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:26.115527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:26.115547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:26.115596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:26.115870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:26.116056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401966325865012:8908]
2025-10-15T11:01:26.118333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:26.121033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:26.121334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:26.122655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:26.122981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:26.122991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:26.122998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:26.123005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:26.123012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:26.123019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:26.123027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:26.123035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:26.123237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:26.123248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:26.123256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:26.123264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.123272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.123279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.123330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:26.123466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:26.123517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:26.123567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:26.123615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:26.123663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:26.123715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:26.123760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:26.123808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:26.123858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:26.123906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:26.123952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.124005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.124053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.124114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:26.124187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:26.124251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:26.124322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:26.124373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:26.124429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:26.124476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:26.124532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:26.124581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:26.124637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:26.124684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:26.124743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:26.124792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:26.124846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:26.124890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:26.124942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:26.124993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:26.125047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:26.125095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:26.125150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:26.125198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:26.125255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:26.125303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.125360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.125410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.125463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.125509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.125562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.126097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:26.156483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:26.166029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:26.166080Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:26.166099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:26.166119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:26.166146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 931 [2:7561401966325865012:8908]
2025-10-15T11:01:26.166202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:26.166258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:26.166273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:26.166286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:26.166298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:26.166350Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:26.166374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:26.166398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:26.168021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.168054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.168081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.168093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:26.168360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:26.168387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.168533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.168729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.168966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:26.169040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401966325865007:8908]
2025-10-15T11:01:26.169056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401966325865007:8908]
2025-10-15T11:01:26.169070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401966325865007:8908]
2025-10-15T11:01:26.169109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:26.169184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:26.169365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:26.169383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:26.169508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401966325865007:8908]
2025-10-15T11:01:26.169529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:26.169671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401963526174477:9954], now have 1 active actors on pipe
2025-10-15T11:01:26.169696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401963526174640:9630], now have 1 active actors on pipe
2025-10-15T11:01:26.169735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401959231207122:2467], now have 1 active actors on pipe
2025-10-15T11:01:26.169814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:26.169829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:26.169842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:26.169877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:26.171755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 931
2025-10-15T11:01:26.171847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 931, pipe: [1:7561401963526174640:9630]
2025-10-15T11:01:26.171922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 931
2025-10-15T11:01:26.171959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:26.172005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:26.172100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:26.172133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:26.172152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:26.172164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:26.172205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:26.172250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:26.172296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:26.176778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:26.176823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:26.176905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:26.177578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 932 partition: 0 MaxSeqNo: 46 sessionId: src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0
2025-10-15T11:01:26.178427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2db919bf-d20d6046-3b93d5-435dc420_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:26.225744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0] Write session: try to update token
2025-10-15T11:01:26.225811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:26.262541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:26.262578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:26.262632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401966325865007:8908]
2025-10-15T11:01:26.262750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:26.262759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:26.264622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:26.265606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:26.269542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:26.270432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:26.271644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:26.272025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:26.272037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:26.272049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:26.272109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:26.310431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:26.310467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:26.310480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:26.310490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:26.310526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401966325865007:8908]
2025-10-15T11:01:26.310553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401966325865007:8908]
2025-10-15T11:01:26.310582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401966325865007:8908]
2025-10-15T11:01:26.310707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:26.310727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:26.311460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:26.311493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:26.311521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:26.311614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:26.338172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId: src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:26.357143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:26.446909Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:26.448440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:26.448505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:26.449613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:26.450169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:26.450200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:26.452146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401963526174640:9630]
2025-10-15T11:01:26.452280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:26.460889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 932 reason: error at write: Disconnected sessionId: src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0
2025-10-15T11:01:26.461256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 932 sessionId: src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0 is DEAD
2025-10-15T11:01:26.463319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:26.463394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0] Write session will restart in 0.006762s
2025-10-15T11:01:26.463579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0] Write session: Do CDS request
2025-10-15T11:01:26.463635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:26.475604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:26.475640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 933
2025-10-15T11:01:26.479117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:26.483794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:26.483952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:26.483968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:26.483987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:26.485289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 933 sessionId:  describe result for acl check
2025-10-15T11:01:26.485400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:26.485409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:26.485418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:26.485435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401963526174710:9961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:26.491103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401963526174710:9961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:26.506061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401963526174710:9961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:26.520010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401963526174710:9961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:26.520082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401963526174710:9961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:26.520104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401963526174710:9961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:26.520146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:26.554193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401963526174806:9630]
2025-10-15T11:01:26.609971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:26.626531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:26.627258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:26.627271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:26.627308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:26.627664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:26.627863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401966325865296:8912]
2025-10-15T11:01:26.630297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:26.632110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:26.632375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:26.633836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:26.634206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:26.634225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:26.634232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:26.634240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:26.634247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:26.634254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:26.634261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:26.634270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:26.634278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:26.634287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:26.634298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:26.634306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.634312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.634320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.634371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:26.634496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:26.634548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:26.634599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:26.634646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:26.634694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:26.634745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:26.634794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:26.634842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:26.634890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:26.634939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:26.634986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.635033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.635080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.635131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:26.635202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:26.635268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:26.635327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:26.635398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:26.635456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:26.635508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:26.635565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:26.635616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:26.635679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:26.635740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:26.635796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:26.635855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:26.635915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:26.635970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:26.636034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:26.636102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:26.636164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:26.636216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:26.636275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:26.636329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:26.636386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:26.636435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.636492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.636541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.636597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.636651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.636706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.637243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:26.669085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:26.677807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:26.677866Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:26.677885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:26.677906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:26.677933Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 932 [2:7561401966325865296:8912]
2025-10-15T11:01:26.677989Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:26.678055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:26.678071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:26.678085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:26.678098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:26.678150Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:26.678187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:26.678211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:26.679160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.679177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.679193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.679206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:26.681594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 932
2025-10-15T11:01:26.681710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 932
2025-10-15T11:01:26.681780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 932, pipe: [1:7561401963526174806:9630]
2025-10-15T11:01:26.679724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:26.679756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:26.679912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:26.680134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:26.680383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:26.680475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401963526174748:9961], now have 1 active actors on pipe
2025-10-15T11:01:26.680502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401963526174694:2467], now have 1 active actors on pipe
2025-10-15T11:01:26.680525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401963526174806:9630], now have 1 active actors on pipe
2025-10-15T11:01:26.680552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401966325865291:8912]
2025-10-15T11:01:26.680570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401966325865291:8912]
2025-10-15T11:01:26.680584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401966325865291:8912]
2025-10-15T11:01:26.680632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:26.680681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:26.680700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:26.680710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:26.680713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:26.680914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:26.680932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:26.681065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401966325865291:8912]
2025-10-15T11:01:26.681095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:26.681121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:26.682246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:26.682276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:26.682388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:26.682421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:26.682439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:26.682453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:26.682492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:26.682537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:26.682600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:26.684168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:26.684202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:26.684285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:26.684878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 933 partition: 0 MaxSeqNo: 46 sessionId: src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0
2025-10-15T11:01:26.685619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e36dcc16-6534d360-b0d56e53-4cb78299_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:26.713114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0] Write session: try to update token
2025-10-15T11:01:26.713207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:26.760519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:26.760575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:26.760632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401966325865291:8912]
2025-10-15T11:01:26.760803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:26.760816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:26.784038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:26.803651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:26.805376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:26.812291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:26.813717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:26.814033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:26.814045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:26.814056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:26.814170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:26.926207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId: src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:26.933267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:26.933309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:26.933326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:26.933338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:26.933381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401966325865291:8912]
2025-10-15T11:01:26.933421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401966325865291:8912]
2025-10-15T11:01:26.933449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401966325865291:8912]
2025-10-15T11:01:26.933570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:26.933617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:26.933623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:26.933636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:26.933647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:26.933648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:26.933697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:26.933720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:26.945247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:26.965545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:27.127621Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:27.135141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:27.135191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:27.134548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:27.134612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:27.135412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:27.136230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:27.136474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401963526174806:9630]
2025-10-15T11:01:27.146964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 933 reason: error at write: Disconnected sessionId: src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0
2025-10-15T11:01:27.147329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 933 sessionId: src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0 is DEAD
2025-10-15T11:01:27.151553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:27.151597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0] Write session will restart in 0.005307s
2025-10-15T11:01:27.151719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0] Write session: Do CDS request
2025-10-15T11:01:27.151755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:27.164725Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:27.164786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 934
2025-10-15T11:01:27.164947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:27.165633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:27.165846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:27.165874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:27.165891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:27.168229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 934 sessionId:  describe result for acl check
2025-10-15T11:01:27.168397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:27.168415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:27.168435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:27.168465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401967821142292:9967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:27.172674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401967821142292:9967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:27.180982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401967821142292:9967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:27.194339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401967821142292:9967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:27.194393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401967821142292:9967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:27.194412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401967821142292:9967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:27.194446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:27.236472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401967821142485:9630]
2025-10-15T11:01:27.270342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:27.272359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:27.273162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:27.273182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:27.273229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:27.273507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:27.273708Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401970620832873:8922]
2025-10-15T11:01:27.275742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:27.276773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:27.277004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:27.278281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:27.278607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:27.278614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:27.278621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:27.278627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:27.278633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:27.278640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:27.278647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:27.278654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:27.278660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:27.278668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:27.278674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:27.278682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.278688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.278696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.278744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:27.278853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:27.278903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:27.278951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:27.278995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:27.279038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:27.279081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:27.279123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:27.279168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:27.279215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:27.279261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:27.279308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.279376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.279423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.279466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:27.279531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:27.279592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:27.279649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:27.279699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:27.279752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:27.279800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:27.279855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:27.279902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:27.279957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:27.280000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:27.280045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:27.280094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:27.280142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:27.280172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:27.280209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:27.280244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:27.280279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:27.280309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:27.280347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:27.280378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:27.280445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:27.280481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.280517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.280549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.280602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.280633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.280670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.281064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:27.303141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:27.313510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:27.313569Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:27.313586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:27.313605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:27.313630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 933 [2:7561401970620832873:8922]
2025-10-15T11:01:27.313684Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:27.313759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:27.313775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:27.313788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:27.313800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:27.313857Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:27.313887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:27.313903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:27.315701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.315729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.315742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.315754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:27.316027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:27.316053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.316208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.316304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 933, pipe: [1:7561401967821142485:9630]
2025-10-15T11:01:27.316427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 933
2025-10-15T11:01:27.316515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 933
2025-10-15T11:01:27.316398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.316656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:27.316743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401967821142485:9630], now have 1 active actors on pipe
2025-10-15T11:01:27.316767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401967821142335:9967], now have 1 active actors on pipe
2025-10-15T11:01:27.316789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401967821142280:2467], now have 1 active actors on pipe
2025-10-15T11:01:27.316837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:27.316860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:27.316913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401970620832868:8922]
2025-10-15T11:01:27.316930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401970620832868:8922]
2025-10-15T11:01:27.316945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401970620832868:8922]
2025-10-15T11:01:27.316984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:27.317060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:27.317240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:27.317257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:27.317321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:27.317354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:27.317373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:27.317383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:27.317419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:27.317463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:27.317588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401970620832868:8922]
2025-10-15T11:01:27.317606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:27.317652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:27.317717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:27.317727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:27.317735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:27.317753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:27.318183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:27.318198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:27.318246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:27.318494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 934 partition: 0 MaxSeqNo: 46 sessionId: src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0
2025-10-15T11:01:27.319567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de839b12-3a10ebb9-b4d3acb1-c651e72d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:27.340404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0] Write session: try to update token
2025-10-15T11:01:27.340459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:27.351048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:27.351091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:27.351132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401970620832868:8922]
2025-10-15T11:01:27.351263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:27.351262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:27.375926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:27.378816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:27.385789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:27.392725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:27.395287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:27.396447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:27.414598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:27.414643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:27.414656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:27.492441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:27.492480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:27.492495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:27.492507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:27.492544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401970620832868:8922]
2025-10-15T11:01:27.492572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401970620832868:8922]
2025-10-15T11:01:27.492599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401970620832868:8922]
2025-10-15T11:01:27.492741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:27.492775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:27.493064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:27.493108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:27.493137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:27.494074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:27.521873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId: src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:27.545007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:27.649566Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:27.662142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:27.662187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:27.662704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401967821142485:9630]
2025-10-15T11:01:27.662842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:27.662861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:27.663004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:27.729164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:27.729312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 934 reason: error at write: Disconnected sessionId: src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0
2025-10-15T11:01:27.729643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 934 sessionId: src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0 is DEAD
2025-10-15T11:01:27.731577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:27.731640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0] Write session will restart in 0.009884s
2025-10-15T11:01:27.731793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0] Write session: Do CDS request
2025-10-15T11:01:27.731829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:27.748228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:27.748269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 935
2025-10-15T11:01:27.748667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:27.749506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:27.749687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:27.749704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:27.749714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:27.751777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 935 sessionId:  describe result for acl check
2025-10-15T11:01:27.751910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:27.751922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:27.751931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:27.751949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401967821142741:9979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:27.755119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401967821142741:9979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:27.766345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401967821142741:9979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:27.767170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401967821142843:9630]
2025-10-15T11:01:27.773865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401967821142741:9979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:27.773917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401967821142741:9979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:27.773935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401967821142741:9979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:27.773968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:27.780891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:27.783055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:27.783932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:27.783967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:27.784012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:27.784273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:27.784465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401970620833177:8930]
2025-10-15T11:01:27.786766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:27.787769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:27.788033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:27.789476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:27.789861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:27.789887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:27.789895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:27.789902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:27.789909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:27.789916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:27.789923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:27.789929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:27.789937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:27.789943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:27.789951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:27.789958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.789964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.789971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.790021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:27.790143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:27.790194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:27.790242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:27.790304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:27.790362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:27.790416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:27.790470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:27.790525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:27.790583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:27.790638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:27.790694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.790747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.790796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.790846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:27.790920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:27.790989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:27.791053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:27.791106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:27.791156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:27.791194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:27.791242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:27.791282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:27.791335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:27.791487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:27.791555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:27.791608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:27.791665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:27.791700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:27.791754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:27.791814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:27.791881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:27.791939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:27.792004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:27.792054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:27.792126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:27.792186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.792249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.792304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.792362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.792401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.792463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.793037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:27.812043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:27.820390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:27.820445Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:27.820464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:27.820487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:27.820516Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 934 [2:7561401970620833177:8930]
2025-10-15T11:01:27.820575Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:27.820642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:27.820661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:27.820676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:27.820688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:27.820746Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:27.820779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:27.820819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:27.821872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.821897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.821912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.821925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:27.822202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:27.822227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:27.822381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:27.822590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:27.822570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 934
2025-10-15T11:01:27.822586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 934
2025-10-15T11:01:27.822675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 934, pipe: [1:7561401967821142843:9630]
2025-10-15T11:01:27.822844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:27.822934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401967821142853:9979], now have 1 active actors on pipe
2025-10-15T11:01:27.822958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401967821142635:2467], now have 1 active actors on pipe
2025-10-15T11:01:27.822983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401967821142843:9630], now have 1 active actors on pipe
2025-10-15T11:01:27.823036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:27.823067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:27.823120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401970620833172:8930]
2025-10-15T11:01:27.823142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401970620833172:8930]
2025-10-15T11:01:27.823157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401970620833172:8930]
2025-10-15T11:01:27.823196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:27.823255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:27.823274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:27.823279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:27.823292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:27.823484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:27.823513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:27.823579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:27.823611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:27.823629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:27.823640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:27.823680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:27.823727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:27.823855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401970620833172:8930]
2025-10-15T11:01:27.823886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:27.823911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:27.823928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:27.824563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:27.824594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:27.824682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:27.825000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 935 partition: 0 MaxSeqNo: 46 sessionId: src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0
2025-10-15T11:01:27.826552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b800cc1-3657e525-9d4810ec-5828fecb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:27.883472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:27.883516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:27.883558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401970620833172:8930]
2025-10-15T11:01:27.883688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:27.883695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:27.886109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:27.887561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:27.889094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:27.890406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:27.890980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0] Write session: try to update token
2025-10-15T11:01:27.891032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:27.892577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:27.893115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:27.940279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:27.940322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:27.940334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:27.940398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:27.940414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:27.940430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:27.940441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:27.940483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401970620833172:8930]
2025-10-15T11:01:27.940515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401970620833172:8930]
2025-10-15T11:01:27.940542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401970620833172:8930]
2025-10-15T11:01:27.940691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:27.940725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:27.941768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:27.943564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:27.943636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:27.943691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:28.017700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId: src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:28.054309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:28.093297Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:28.094664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:28.094706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:28.095579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:28.095609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:28.097151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:28.097419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401967821142843:9630]
2025-10-15T11:01:28.096111Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:28.104070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 935 reason: error at write: Disconnected sessionId: src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0
2025-10-15T11:01:28.104450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 935 sessionId: src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0 is DEAD
2025-10-15T11:01:28.107965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:28.108007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0] Write session will restart in 0.009056s
2025-10-15T11:01:28.108104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0] Write session: Do CDS request
2025-10-15T11:01:28.108135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:28.121115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:28.123602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:28.123637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 936
2025-10-15T11:01:28.123969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:28.124102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:28.124127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:28.124137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:28.125441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 936 sessionId:  describe result for acl check
2025-10-15T11:01:28.125578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:28.125591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:28.125600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:28.125617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401972116110178:9986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:28.127441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401972116110178:9986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:28.141310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401972116110178:9986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:28.150724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401972116110178:9986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:28.150774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401972116110178:9986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:28.150793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401972116110178:9986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:28.150828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:28.199997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401972116110304:9630]
2025-10-15T11:01:28.253329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:28.256024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:28.257006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:28.257043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:28.257092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:28.257375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:28.257566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401974915800741:8935]
2025-10-15T11:01:28.261210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:28.265692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:28.265969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:28.267392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:28.267765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:28.267787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:28.267795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:28.267802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:28.267810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:28.267818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:28.267825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:28.267833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:28.267840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:28.267847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:28.267854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:28.267863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.267871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.267879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.267934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:28.268056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:28.268125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:28.268178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:28.268229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:28.268281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:28.268332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:28.268379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:28.268430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:28.268480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:28.268530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:28.268578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.268627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.268677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.268725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:28.268798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:28.268863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:28.268923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:28.268974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:28.269035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:28.269085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:28.269143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:28.269197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:28.269253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:28.269303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:28.269362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:28.270507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:28.270608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:28.270669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:28.270739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:28.270798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:28.270863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:28.270916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:28.270981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:28.271031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:28.271093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:28.271140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.271197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.271249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.271307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.271373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.271429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.272004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:28.322375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:28.331649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:28.331708Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:28.331728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:28.331751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:28.331782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 935 [2:7561401974915800741:8935]
2025-10-15T11:01:28.331842Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:28.331912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:28.331927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:28.331942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:28.331953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:28.332007Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:28.332032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:28.332057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:28.333124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.333151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.333165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.333177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:28.333441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:28.333466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.333616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.333814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.333883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 935
2025-10-15T11:01:28.333894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 935, pipe: [1:7561401972116110304:9630]
2025-10-15T11:01:28.333991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 935
2025-10-15T11:01:28.334062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:28.334152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401972116110304:9630], now have 1 active actors on pipe
2025-10-15T11:01:28.334181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401972116110212:9986], now have 1 active actors on pipe
2025-10-15T11:01:28.334203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401972116110168:2467], now have 1 active actors on pipe
2025-10-15T11:01:28.334230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401974915800736:8935]
2025-10-15T11:01:28.334245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401974915800736:8935]
2025-10-15T11:01:28.334259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401974915800736:8935]
2025-10-15T11:01:28.334294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:28.334323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:28.334338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:28.334351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:28.334366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:28.334552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:28.334575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:28.334630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:28.334657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:28.334792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401974915800736:8935]
2025-10-15T11:01:28.334822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:28.334844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:28.334893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:28.334930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:28.334954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:28.334966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:28.335005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:28.335047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:28.335175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:28.336104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:28.336138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:28.336208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:28.337077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 936 partition: 0 MaxSeqNo: 46 sessionId: src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0
2025-10-15T11:01:28.339959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f2b13fb-12e25048-d062c2c5-5ec30f21_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:28.367437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0] Write session: try to update token
2025-10-15T11:01:28.367507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:28.382863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:28.382911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:28.382953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401974915800736:8935]
2025-10-15T11:01:28.383086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:28.383099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:28.385036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:28.386261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:28.388684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:28.390097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:28.391992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:28.392734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:28.432653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:28.432681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:28.432688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:28.481277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId: src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:28.506227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:28.506271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:28.506286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:28.506297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:28.506342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401974915800736:8935]
2025-10-15T11:01:28.506371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401974915800736:8935]
2025-10-15T11:01:28.506398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401974915800736:8935]
2025-10-15T11:01:28.506533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:28.506565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:28.506570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:28.506589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:28.506613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:28.507601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:28.511259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:28.652807Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:28.659235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:28.659300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:28.660567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401972116110304:9630]
2025-10-15T11:01:28.660049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:28.660667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:28.660678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:28.661192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:28.691221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 936 reason: error at write: Disconnected sessionId: src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0
2025-10-15T11:01:28.691760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 936 sessionId: src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0 is DEAD
2025-10-15T11:01:28.692227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:28.692283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0] Write session will restart in 0.007975s
2025-10-15T11:01:28.692464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0] Write session: Do CDS request
2025-10-15T11:01:28.692523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:28.706256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:28.706233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:28.706275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 937
2025-10-15T11:01:28.706756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:28.706893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:28.706910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:28.706921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:28.708437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 937 sessionId:  describe result for acl check
2025-10-15T11:01:28.708554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:28.708564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:28.708571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:28.708588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401972116110477:9991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:28.714695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401972116110477:9991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:28.722817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401972116110477:9991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:28.746735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401972116110477:9991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:28.746784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401972116110477:9991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:28.746796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401972116110477:9991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:28.746824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:28.761184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401972116110638:9630]
2025-10-15T11:01:28.783966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:28.789594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:28.790357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:28.790387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:28.790428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:28.790672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:28.790845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401974915801035:8944]
2025-10-15T11:01:28.793052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:28.793995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:28.794239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:28.795397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:28.795732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:28.795751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:28.795758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:28.795765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:28.795772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:28.795779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:28.795787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:28.795794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:28.795803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:28.795811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:28.795818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:28.795826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.795833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.795839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.795886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:28.796001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:28.796048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:28.796093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:28.796154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:28.796196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:28.796232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:28.796269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:28.796306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:28.796345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:28.796383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:28.796420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.796457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.796493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.796535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:28.796598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:28.796645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:28.796689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:28.796727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:28.796767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:28.796812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:28.796867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:28.796920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:28.796976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:28.797016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:28.797066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:28.797116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:28.797173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:28.797221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:28.797282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:28.797334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:28.797397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:28.797450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:28.797510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:28.797561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:28.797619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:28.797668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.797727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.797779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.797834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.797886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.797946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.798453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:28.822609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:28.832945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:28.832999Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:28.833015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:28.833035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:28.833060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 936 [2:7561401974915801035:8944]
2025-10-15T11:01:28.833117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:28.833182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:28.833197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:28.833211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:28.833223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:28.833276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:28.833300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:28.833325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:28.835455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.835490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.835506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.835517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:28.836032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 936, pipe: [1:7561401972116110638:9630]
2025-10-15T11:01:28.836174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 936
2025-10-15T11:01:28.836259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 936
2025-10-15T11:01:28.835800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:28.835828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:28.835978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:28.836188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:28.836434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:28.836520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401972116110638:9630], now have 1 active actors on pipe
2025-10-15T11:01:28.836544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401972116110565:9991], now have 1 active actors on pipe
2025-10-15T11:01:28.836566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401972116110461:2467], now have 1 active actors on pipe
2025-10-15T11:01:28.836632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:28.836654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:28.836694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401974915801030:8944]
2025-10-15T11:01:28.836709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401974915801030:8944]
2025-10-15T11:01:28.836723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401974915801030:8944]
2025-10-15T11:01:28.836767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:28.836800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:28.836815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:28.836826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:28.836844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:28.837037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:28.837054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:28.837126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:28.837157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:28.837176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:28.837187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:28.837224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:28.837288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:28.837421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401974915801030:8944]
2025-10-15T11:01:28.837453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:28.837479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:28.837515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:28.838556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:28.838600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:28.838675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:28.839086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 937 partition: 0 MaxSeqNo: 46 sessionId: src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0
2025-10-15T11:01:28.839999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac7272cc-a97e6c27-f2c1be5b-82a77a6e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:28.865814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0] Write session: try to update token
2025-10-15T11:01:28.865883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:28.876781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:28.876821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:28.876862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401974915801030:8944]
2025-10-15T11:01:28.876993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:28.877001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:28.878913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:28.880556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:28.881850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:28.883202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:28.884980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:28.885552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:28.950966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:28.951005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:28.951017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:28.951082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:28.951098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:28.951113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:28.951124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:28.951167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401974915801030:8944]
2025-10-15T11:01:28.951194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401974915801030:8944]
2025-10-15T11:01:28.951217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401974915801030:8944]
2025-10-15T11:01:28.951323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:28.951367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:28.951396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:28.951898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:28.951924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:28.963784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:28.981730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId: src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:29.001972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:29.110528Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:29.112633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:29.112680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:29.113267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401972116110638:9630]
2025-10-15T11:01:29.113375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:29.113384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:29.113445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:29.164905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:29.165069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 937 reason: error at write: Disconnected sessionId: src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0
2025-10-15T11:01:29.165432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 937 sessionId: src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0 is DEAD
2025-10-15T11:01:29.165876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:29.165932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0] Write session will restart in 0.006589s
2025-10-15T11:01:29.166096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0] Write session: Do CDS request
2025-10-15T11:01:29.166151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:29.184149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:29.187447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:29.187486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 938
2025-10-15T11:01:29.187968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:29.188094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:29.188123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:29.188133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:29.189422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 938 sessionId:  describe result for acl check
2025-10-15T11:01:29.189539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:29.189549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:29.189558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:29.189575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401976411078209:10002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:29.192296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401976411078209:10002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:29.200691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401976411078209:10002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:29.207498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401976411078209:10002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:29.207534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401976411078209:10002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:29.207551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401976411078209:10002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:29.207584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:29.213857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401976411078313:9630]
2025-10-15T11:01:29.216931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:29.219644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:29.220559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:29.220592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:29.220637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:29.220916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:29.221102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401979210768621:8952]
2025-10-15T11:01:29.223852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:29.224958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:29.225175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:29.226491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:29.226808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:29.226815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:29.226821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:29.226828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:29.226835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:29.226843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:29.226849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:29.226855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:29.226861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:29.226867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:29.226873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:29.226880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.226886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.226892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.226938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:29.227046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:29.227094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:29.227140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:29.227188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:29.227230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:29.227273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:29.227316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:29.227380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:29.227429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:29.227486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:29.227529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.227571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.227616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.227661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:29.227726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:29.227785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:29.227836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:29.227883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:29.227936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:29.227979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:29.228043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:29.228093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:29.228166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:29.228210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:29.228262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:29.228317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:29.228371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:29.228415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:29.228468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:29.228516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:29.228572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:29.228617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:29.228671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:29.228726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:29.228781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:29.228826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.228878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.228923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.228973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.230230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.230324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.230853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:29.284174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:29.292592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:29.292642Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:29.292658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:29.292677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:29.292701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 937 [2:7561401979210768621:8952]
2025-10-15T11:01:29.292751Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:29.292806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:29.292819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:29.292831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:29.292842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:29.292884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:29.292904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:29.292924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:29.293817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.293847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.293860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.293871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:29.294155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:29.294182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.294317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.294534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 937
2025-10-15T11:01:29.294682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 937
2025-10-15T11:01:29.294786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 937, pipe: [1:7561401976411078313:9630]
2025-10-15T11:01:29.294504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.294755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:29.294835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401976411078313:9630], now have 1 active actors on pipe
2025-10-15T11:01:29.294859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401976411078310:10002], now have 1 active actors on pipe
2025-10-15T11:01:29.294879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401976411078091:2467], now have 1 active actors on pipe
2025-10-15T11:01:29.294926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:29.294946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:29.294979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401979210768616:8952]
2025-10-15T11:01:29.294992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401979210768616:8952]
2025-10-15T11:01:29.295003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401979210768616:8952]
2025-10-15T11:01:29.295043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:29.295077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:29.295092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:29.295103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:29.295124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:29.295294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:29.295327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:29.295440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:29.295474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:29.295490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:29.295499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:29.295531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:29.295568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:29.295701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401979210768616:8952]
2025-10-15T11:01:29.295738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:29.295768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:29.295782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:29.296446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:29.296477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:29.296539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:29.297195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 938 partition: 0 MaxSeqNo: 46 sessionId: src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0
2025-10-15T11:01:29.299616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da49c9e-1cb4fce2-8ad16255-a4994a09_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:29.322432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0] Write session: try to update token
2025-10-15T11:01:29.322515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:29.336732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:29.336777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:29.336823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401979210768616:8952]
2025-10-15T11:01:29.336966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:29.337299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:29.339221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:29.344027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:29.347401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:29.348864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:29.350462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:29.350884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:29.393019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:29.393053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:29.393066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:29.427312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:29.428453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:29.428488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:29.428501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:29.428547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401979210768616:8952]
2025-10-15T11:01:29.428580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401979210768616:8952]
2025-10-15T11:01:29.428607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401979210768616:8952]
2025-10-15T11:01:29.428738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:29.428772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:29.428793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:29.428802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:29.428820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:29.430413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:29.463481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId: src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:29.520856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:29.580379Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:29.581795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:29.581828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:29.584465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401976411078313:9630]
2025-10-15T11:01:29.584583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:29.584595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:29.584737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:29.588105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:29.593398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 938 reason: error at write: Disconnected sessionId: src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0
2025-10-15T11:01:29.593718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 938 sessionId: src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0 is DEAD
2025-10-15T11:01:29.594645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:29.594701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0] Write session will restart in 0.006240s
2025-10-15T11:01:29.594860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0] Write session: Do CDS request
2025-10-15T11:01:29.594899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:29.610033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:29.610067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 939
2025-10-15T11:01:29.610941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:29.611459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:29.611587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:29.611603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:29.611613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:29.612930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 939 sessionId:  describe result for acl check
2025-10-15T11:01:29.613033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:29.613044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:29.613053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:29.613068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401976411078357:10011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:29.616000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401976411078357:10011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:29.633345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401976411078357:10011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:29.657145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401976411078357:10011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:29.657193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401976411078357:10011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:29.657209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401976411078357:10011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:29.657239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:29.689604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401976411078477:9630]
2025-10-15T11:01:29.759928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:29.768665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:29.769456Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:29.769474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:29.769513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:29.769743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:29.769913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401979210768911:8956]
2025-10-15T11:01:29.771984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:29.774325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:29.774553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:29.775821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:29.776174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:29.776194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:29.776202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:29.776209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:29.776216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:29.776221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:29.776228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:29.776234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:29.776240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:29.776246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:29.776252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:29.776257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.776263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.776269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.776315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:29.776410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:29.776456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:29.776500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:29.776537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:29.776576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:29.776616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:29.776655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:29.776693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:29.776735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:29.776775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:29.776816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.776856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.776896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.776936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:29.776992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:29.777041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:29.777085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:29.777128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:29.777175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:29.777217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:29.777263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:29.777306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:29.777350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:29.777390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:29.777436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:29.777477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:29.777523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:29.777565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:29.777610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:29.777653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:29.777699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:29.777740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:29.777787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:29.777829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:29.777880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:29.777919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.777969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.778011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.778058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.778096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.778140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.778598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:29.821696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:29.830421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:29.830474Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:29.830493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:29.830509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:29.830534Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 938 [2:7561401979210768911:8956]
2025-10-15T11:01:29.830584Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:29.830640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:29.830654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:29.830666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:29.830678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:29.830722Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:29.830744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:29.830764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:29.832165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.832190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.832202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.832212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:29.832462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:29.832478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:29.832612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:29.832777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:29.832997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:29.833060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401979210768906:8956]
2025-10-15T11:01:29.833073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401979210768906:8956]
2025-10-15T11:01:29.833085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401979210768906:8956]
2025-10-15T11:01:29.833129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:29.833817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 938, pipe: [1:7561401976411078477:9630]
2025-10-15T11:01:29.833193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:29.833838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 938
2025-10-15T11:01:29.833252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:29.833266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:29.833939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 938
2025-10-15T11:01:29.833279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:29.833361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:29.833377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:29.833485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401979210768906:8956]
2025-10-15T11:01:29.833506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:29.833553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:29.833603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401976411078348:2467], now have 1 active actors on pipe
2025-10-15T11:01:29.833627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401976411078477:9630], now have 1 active actors on pipe
2025-10-15T11:01:29.833653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401976411078401:10011], now have 1 active actors on pipe
2025-10-15T11:01:29.834540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:29.834570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:29.834639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e148572-f492386f-87c10f25-2ee06228_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:29.834667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:29.834683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:29.834695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:29.834727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:29.834761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:29.834799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:29.835420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:29.835445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:29.835505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:29.835920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 939 partition: 0 MaxSeqNo: 46 sessionId: src_id|3e148572-f492386f-87c10f25-2ee06228_0
2025-10-15T11:01:29.839728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37c5a0f-e44a8d42-885937c2-1ffa1b30_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3e148572-f492386f-87c10f25-2ee06228_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:29.871500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e148572-f492386f-87c10f25-2ee06228_0] Write session: try to update token
2025-10-15T11:01:29.871568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e148572-f492386f-87c10f25-2ee06228_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:29.955180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId: src_id|3e148572-f492386f-87c10f25-2ee06228_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:29.979495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:29.979534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:29.979547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:29.979558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:29.979595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401979210768906:8956]
2025-10-15T11:01:29.979628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401979210768906:8956]
2025-10-15T11:01:29.979650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401979210768906:8956]
2025-10-15T11:01:29.979803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:29.979824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:29.979836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:29.979930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:29.979955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:29.981210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:29.981272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:29.981322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:29.981368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:29.996144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:30.122361Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:30.137522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:30.137760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401976411078477:9630]
2025-10-15T11:01:30.135599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:30.135648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:30.135711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:30.135725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:30.135765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401979210768906:8956]
2025-10-15T11:01:30.136041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:30.136372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:30.137894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:30.167740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 939 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e148572-f492386f-87c10f25-2ee06228_0
2025-10-15T11:01:30.168064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 939 sessionId: src_id|3e148572-f492386f-87c10f25-2ee06228_0 is DEAD
2025-10-15T11:01:30.172092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e148572-f492386f-87c10f25-2ee06228_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:30.172173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e148572-f492386f-87c10f25-2ee06228_0] Write session will restart in 0.007386s
2025-10-15T11:01:30.172352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e148572-f492386f-87c10f25-2ee06228_0] Write session: Do CDS request
2025-10-15T11:01:30.172406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e148572-f492386f-87c10f25-2ee06228_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:30.186051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:30.186086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 940
2025-10-15T11:01:30.186667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e148572-f492386f-87c10f25-2ee06228_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:30.187313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:30.187454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:30.187468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:30.187477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:30.189022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 940 sessionId:  describe result for acl check
2025-10-15T11:01:30.189155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:30.189173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:30.189183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:30.189202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401980706045957:10017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:30.192733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401980706045957:10017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:30.201196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401980706045957:10017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:30.221817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401980706045957:10017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:30.221867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401980706045957:10017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:30.221885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401980706045957:10017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:30.221920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:30.238850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401980706046156:9630]
2025-10-15T11:01:30.262937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:30.273501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:30.274355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:30.274387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:30.274430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:30.274702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:30.274878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401983505736494:8966]
2025-10-15T11:01:30.276937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:30.279610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:30.279856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:30.281069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:30.281386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:30.281405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:30.281411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:30.281418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:30.281425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:30.281432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:30.281438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:30.281445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:30.281451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:30.281457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:30.281464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:30.281471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.281477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.281484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.281524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:30.281622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:30.281666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:30.281707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:30.281748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:30.281798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:30.281840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:30.281879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:30.281921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:30.281962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:30.282002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:30.282044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.282091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.282140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.282182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:30.282246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:30.282302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:30.282360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:30.282410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:30.282464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:30.282510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:30.282559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:30.282610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:30.282662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:30.282712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:30.282766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:30.282814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:30.282874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:30.282923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:30.282976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:30.283025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:30.283080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:30.283129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:30.283181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:30.283233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:30.283283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:30.283327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.283398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.283442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.283492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.283532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.283582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.284054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:30.305030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:30.332058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:30.332097Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:30.332111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:30.332138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:30.332160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 939 [2:7561401983505736494:8966]
2025-10-15T11:01:30.332205Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:30.332252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:30.332263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:30.332273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:30.332283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:30.332323Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:30.332342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:30.332361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:30.334535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.334564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.334576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.334586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:30.334827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:30.334842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.335191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.335129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 939
2025-10-15T11:01:30.335262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 939
2025-10-15T11:01:30.335333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 939, pipe: [1:7561401980706046156:9630]
2025-10-15T11:01:30.335424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.335639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:30.335722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401980706046067:10017], now have 1 active actors on pipe
2025-10-15T11:01:30.335749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401980706045939:2467], now have 1 active actors on pipe
2025-10-15T11:01:30.335768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401980706046156:9630], now have 1 active actors on pipe
2025-10-15T11:01:30.335812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:30.335837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:30.335884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401983505736487:8966]
2025-10-15T11:01:30.335901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401983505736487:8966]
2025-10-15T11:01:30.335913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401983505736487:8966]
2025-10-15T11:01:30.335948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:30.335999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:30.336012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:30.336021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:30.336031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:30.336182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:30.336211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:30.336270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:30.336298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:30.336314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:30.336323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:30.336352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:30.336389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:30.336505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401983505736487:8966]
2025-10-15T11:01:30.336533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:30.336574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:30.336647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:30.337084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:30.337107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:30.337161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:30.337497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 940 partition: 0 MaxSeqNo: 46 sessionId: src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0
2025-10-15T11:01:30.339964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e148572-f492386f-87c10f25-2ee06228_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:30.368622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0] Write session: try to update token
2025-10-15T11:01:30.368675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:30.438723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:30.438764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:30.438780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:30.438793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:30.438837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401983505736487:8966]
2025-10-15T11:01:30.438865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401983505736487:8966]
2025-10-15T11:01:30.438894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401983505736487:8966]
2025-10-15T11:01:30.439144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:30.439159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:30.439174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:30.439225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:30.439246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:30.439769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:30.439812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:30.439842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:30.446788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:30.471181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId: src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:30.492696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:30.597862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:30.617302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:30.617359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:30.617434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:30.617449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:30.617492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401983505736487:8966]
2025-10-15T11:01:30.617673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:30.618064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:30.618665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:30.618809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:30.629600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 940 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0
2025-10-15T11:01:30.630265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:30.630319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0] Write session will restart in 0.007419s
2025-10-15T11:01:30.630464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0] Write session: Do CDS request
2025-10-15T11:01:30.630508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:30.629875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 940 sessionId: src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0 is DEAD
2025-10-15T11:01:30.645517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401980706046156:9630]
2025-10-15T11:01:30.645833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:30.647961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:30.647994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 941
2025-10-15T11:01:30.648287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:30.648394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:30.648414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:30.648422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:30.649549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 941 sessionId:  describe result for acl check
2025-10-15T11:01:30.649653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:30.649668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:30.649678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:30.649693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401980706046254:10027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:30.652377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401980706046254:10027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:30.663240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401980706046254:10027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:30.682881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401980706046254:10027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:30.682931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401980706046254:10027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:30.682948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401980706046254:10027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:30.682977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:30.746691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:30.748147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401980706046528:9630]
2025-10-15T11:01:30.754922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:30.755697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:30.755727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:30.755765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:30.755998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:30.756198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401983505736802:8973]
2025-10-15T11:01:30.758252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:30.759105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:30.759292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:30.760462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:30.760793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:30.760812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:30.760820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:30.760826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:30.760832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:30.760839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:30.760846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:30.760853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:30.760859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:30.760866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:30.760872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:30.760878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.760885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.760892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.760935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:30.761035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:30.761081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:30.761124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:30.761167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:30.761214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:30.761258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:30.761301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:30.761342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:30.761386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:30.761429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:30.761470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.761509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.761539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.761564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:30.761616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:30.761653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:30.761688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:30.761722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:30.761770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:30.761800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:30.761837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:30.761880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:30.761933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:30.761982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:30.762055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:30.762113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:30.762175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:30.762225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:30.762282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:30.762336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:30.762393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:30.762445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:30.762506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:30.762560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:30.762621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:30.762673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.762724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.762759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.762815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.762853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.762906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.763447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:30.780284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:30.788374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:30.788412Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:30.788424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:30.788437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:30.788456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 940 [2:7561401983505736802:8973]
2025-10-15T11:01:30.788501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:30.788556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:30.788569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:30.788581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:30.788592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:30.788635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:30.788654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:30.788675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:30.789373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.789391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.789412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.789423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:30.789679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:30.789708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:30.789800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:30.790448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 940, pipe: [1:7561401980706046528:9630]
2025-10-15T11:01:30.789925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:30.790553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 940
2025-10-15T11:01:30.790067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:30.790636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 940
2025-10-15T11:01:30.790118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401980706046528:9630], now have 1 active actors on pipe
2025-10-15T11:01:30.790140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401980706046241:2467], now have 1 active actors on pipe
2025-10-15T11:01:30.790155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401980706046304:10027], now have 1 active actors on pipe
2025-10-15T11:01:30.790173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401983505736796:8973]
2025-10-15T11:01:30.790184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401983505736796:8973]
2025-10-15T11:01:30.790198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401983505736796:8973]
2025-10-15T11:01:30.790231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:30.790258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:30.790269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:30.790281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:30.790294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:30.790427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:30.790438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:30.790548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401983505736796:8973]
2025-10-15T11:01:30.790578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:30.790628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:30.791110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:30.791152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:30.791224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:30.791256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:30.791273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:30.791284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:30.791319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:30.792263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 941 partition: 0 MaxSeqNo: 46 sessionId: src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0
2025-10-15T11:01:30.793466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a544f0-6a2874a7-96b0f6cd-1c30f55d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:30.791385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:30.791441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:30.791892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:30.791915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:30.791988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:30.813343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0] Write session: try to update token
2025-10-15T11:01:30.813400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0] Send 10 message(s) (0 left), first sequence number is 47
E1015 11:01:30.816486257  821070 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:01:30.819968Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:01:30.879757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:30.879785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:30.879811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401983505736796:8973]
2025-10-15T11:01:30.879932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:30.880376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:30.881456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:30.882427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:30.883580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:30.884949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:30.887109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:30.908804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:30.908958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:30.908971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:30.908982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:30.909032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:30.909046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:30.909058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:30.909067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:30.909102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401983505736796:8973]
2025-10-15T11:01:30.909141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401983505736796:8973]
2025-10-15T11:01:30.909165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401983505736796:8973]
2025-10-15T11:01:30.909298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:30.909317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:30.910956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:30.911024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:30.911058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:30.912857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:30.929856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId: src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:30.956486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:31.049385Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:31.050839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:31.050879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:31.051720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401980706046528:9630]
2025-10-15T11:01:31.051758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:31.051823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:31.051834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:31.052095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:31.061488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 941 reason: error at write: Disconnected sessionId: src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0
2025-10-15T11:01:31.063946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:31.064009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0] Write session will restart in 0.005539s
2025-10-15T11:01:31.064199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0] Write session: Do CDS request
2025-10-15T11:01:31.064250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:31.061807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 941 sessionId: src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0 is DEAD
2025-10-15T11:01:31.082079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:31.082115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 942
2025-10-15T11:01:31.082311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:31.082828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:31.082945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:31.082966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:31.082976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:31.084479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 942 sessionId:  describe result for acl check
2025-10-15T11:01:31.084608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:31.084618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:31.084628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:31.084644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401985001013853:10036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:31.089107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401985001013853:10036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:31.095290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401985001013853:10036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:31.103255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401985001013853:10036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:31.103312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401985001013853:10036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:31.103327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401985001013853:10036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:31.103370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:31.152741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401985001014065:9630]
2025-10-15T11:01:31.176513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:31.178431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:31.179176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:31.179209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:31.179253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:31.179554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:31.179764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401987800704375:8979]
2025-10-15T11:01:31.181542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:31.182530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:31.182764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:31.183908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:31.184227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:31.184242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:31.184249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:31.184258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:31.184267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:31.184275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:31.184283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:31.184290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:31.184297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:31.184304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:31.184312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:31.184320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.184328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.184334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.184386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:31.184518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:31.184571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:31.184628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:31.184681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:31.184749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:31.184806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:31.184862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:31.184920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:31.184976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:31.185030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:31.185080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.185127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.185187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.185243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:31.185324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:31.185398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:31.185469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:31.185528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:31.185593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:31.185651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:31.185719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:31.185775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:31.185838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:31.185893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:31.185957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:31.186008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:31.186073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:31.186131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:31.186195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:31.186253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:31.186318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:31.186374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:31.186438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:31.186494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:31.186558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:31.186614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.186675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.186729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.186794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.186850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.186911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.187494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:31.238332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:31.247404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:31.247468Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:31.247489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:31.247510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:31.247542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 941 [2:7561401987800704375:8979]
2025-10-15T11:01:31.247600Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:31.247670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:31.247688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:31.247702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:31.247716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:31.247772Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:31.247808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:31.247833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:31.249015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.249045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.249061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.249074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:31.249383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:31.249414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.249577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.249794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.250212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 941, pipe: [1:7561401985001014065:9630]
2025-10-15T11:01:31.250234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 941
2025-10-15T11:01:31.250327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 941
2025-10-15T11:01:31.250053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:31.250156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401985001014065:9630], now have 1 active actors on pipe
2025-10-15T11:01:31.250182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401985001013887:10036], now have 1 active actors on pipe
2025-10-15T11:01:31.250205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401985001013842:2467], now have 1 active actors on pipe
2025-10-15T11:01:31.250232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401987800704369:8979]
2025-10-15T11:01:31.250248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401987800704369:8979]
2025-10-15T11:01:31.250262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401987800704369:8979]
2025-10-15T11:01:31.250303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:31.250351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:31.250368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:31.250381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:31.250389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:31.250582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:31.250604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:31.250665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:31.250707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:31.250868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401987800704369:8979]
2025-10-15T11:01:31.250901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:31.250942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:31.250981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:31.251020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:31.251045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:31.251056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:31.251094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:31.251137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:31.251274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:31.255473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:31.255524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:31.255594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:31.255959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 942 partition: 0 MaxSeqNo: 46 sessionId: src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0
2025-10-15T11:01:31.256724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5fdaf7e-d6d2be73-2a04dde9-b0af8a93_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:31.279908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0] Write session: try to update token
2025-10-15T11:01:31.279975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:31.336021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:31.336055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:31.336067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:31.336076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:31.336110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401987800704369:8979]
2025-10-15T11:01:31.336133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401987800704369:8979]
2025-10-15T11:01:31.336165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401987800704369:8979]
2025-10-15T11:01:31.336281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:31.336316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:31.336344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:31.336352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:31.336371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:31.339650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:31.365670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId: src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:31.387369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:31.477986Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:31.488518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:31.488571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:31.488633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:31.488647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:31.488684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401987800704369:8979]
2025-10-15T11:01:31.488928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:31.489326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:31.489615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401985001014065:9630]
2025-10-15T11:01:31.489678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:31.489703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:31.524880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 942 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0
2025-10-15T11:01:31.525191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 942 sessionId: src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0 is DEAD
2025-10-15T11:01:31.527525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:31.527563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0] Write session will restart in 0.007528s
2025-10-15T11:01:31.527697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0] Write session: Do CDS request
2025-10-15T11:01:31.527742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:31.541390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:31.544114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:31.544158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 943
2025-10-15T11:01:31.544497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:31.544631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:31.544658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:31.544668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:31.546091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 943 sessionId:  describe result for acl check
2025-10-15T11:01:31.546198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:31.546214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:31.546224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:31.546240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401985001014172:10040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:31.548719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401985001014172:10040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:31.561802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401985001014172:10040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:31.578177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401985001014172:10040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:31.578222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401985001014172:10040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:31.578237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401985001014172:10040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:31.578264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:31.591590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401985001014315:9630]
2025-10-15T11:01:31.632644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:31.634340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:31.635083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:31.635113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:31.635152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:31.635414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:31.635602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401987800704664:8987]
2025-10-15T11:01:31.637697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:31.638587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:31.638785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:31.639952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:31.640272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:31.640290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:31.640297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:31.640303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:31.640310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:31.640315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:31.640322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:31.640328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:31.640334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:31.640340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:31.640347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:31.640353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.640358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.640366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.640406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:31.640516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:31.640560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:31.640604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:31.640655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:31.640699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:31.640747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:31.640793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:31.640840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:31.640887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:31.640935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:31.640982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.641027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.641072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.641113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:31.641177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:31.641236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:31.641292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:31.641342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:31.641395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:31.641442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:31.641498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:31.641549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:31.641600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:31.641641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:31.641694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:31.641738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:31.641794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:31.641842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:31.641896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:31.641945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:31.642000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:31.642044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:31.642100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:31.642147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:31.642203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:31.642251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.642306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.642354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.642406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.642457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.642504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.642991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:31.659725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:31.676337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 942
2025-10-15T11:01:31.676439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 942, pipe: [1:7561401985001014315:9630]
2025-10-15T11:01:31.676453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 942
2025-10-15T11:01:31.673564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:31.673617Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:31.673633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:31.673652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:31.673675Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 942 [2:7561401987800704664:8987]
2025-10-15T11:01:31.673725Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:31.673779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:31.673793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:31.673803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:31.673814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:31.673855Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:31.673877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:31.673897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:31.675758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.675773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.675786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.675795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:31.676066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:31.676083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:31.676227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:31.676397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:31.676632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:31.676712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401985001014128:2467], now have 1 active actors on pipe
2025-10-15T11:01:31.676734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401985001014281:10040], now have 1 active actors on pipe
2025-10-15T11:01:31.676753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401985001014315:9630], now have 1 active actors on pipe
2025-10-15T11:01:31.676812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:31.676832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:31.676866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401987800704659:8987]
2025-10-15T11:01:31.676882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401987800704659:8987]
2025-10-15T11:01:31.676894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401987800704659:8987]
2025-10-15T11:01:31.676934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:31.676965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:31.676978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:31.676988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:31.677002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:31.677164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:31.678401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 943 partition: 0 MaxSeqNo: 46 sessionId: src_id|cf563750-86224650-c6711738-88e59dd_0
2025-10-15T11:01:31.677180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:31.677241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf563750-86224650-c6711738-88e59dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:31.677266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:31.677282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:31.677291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:31.677321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:31.677356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:31.677467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401987800704659:8987]
2025-10-15T11:01:31.677497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:31.677519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:31.677534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:31.678021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:31.678043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:31.678110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:31.679064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4160db6b-cbf8331-bb6a0d02-4167e006_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cf563750-86224650-c6711738-88e59dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:31.700704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf563750-86224650-c6711738-88e59dd_0] Write session: try to update token
2025-10-15T11:01:31.700753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf563750-86224650-c6711738-88e59dd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:31.710534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:31.710572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:31.710602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401987800704659:8987]
2025-10-15T11:01:31.710709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:31.710817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:31.712440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:31.713636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:31.714775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:31.717306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:31.718718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:31.719233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:31.802387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:31.802422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:31.802434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:31.802482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:31.802496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:31.802507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:31.802517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:31.802553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401987800704659:8987]
2025-10-15T11:01:31.802578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401987800704659:8987]
2025-10-15T11:01:31.802601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401987800704659:8987]
2025-10-15T11:01:31.802718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:31.802721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:31.802739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:31.802758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:31.802775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:31.803785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:31.815590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId: src_id|cf563750-86224650-c6711738-88e59dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:31.837124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:31.936781Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:31.938641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:31.938681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:31.939393Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:31.939237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:31.939427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:31.939441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:31.992677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401985001014315:9630]
2025-10-15T11:01:31.999533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 943 reason: error at write: Disconnected sessionId: src_id|cf563750-86224650-c6711738-88e59dd_0
2025-10-15T11:01:31.999890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 943 sessionId: src_id|cf563750-86224650-c6711738-88e59dd_0 is DEAD
2025-10-15T11:01:32.003721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf563750-86224650-c6711738-88e59dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:32.003762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf563750-86224650-c6711738-88e59dd_0] Write session will restart in 0.008711s
2025-10-15T11:01:32.003870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf563750-86224650-c6711738-88e59dd_0] Write session: Do CDS request
2025-10-15T11:01:32.003905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf563750-86224650-c6711738-88e59dd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:32.018545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:32.018587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 944
2025-10-15T11:01:32.019382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf563750-86224650-c6711738-88e59dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:32.019917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:32.020051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:32.020068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:32.020077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:32.021709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 944 sessionId:  describe result for acl check
2025-10-15T11:01:32.021829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:32.021841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:32.021851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:32.021868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401989295981809:10052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:32.024612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401989295981809:10052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:32.031188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401989295981809:10052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:32.042210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401989295981809:10052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:32.042249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401989295981809:10052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:32.042268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401989295981809:10052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:32.042303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:32.062523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:32.068972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:32.069824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:32.069858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:32.069903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:32.070212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:32.070400Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401992095672266:8996]
2025-10-15T11:01:32.072147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:32.073406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:32.073640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:32.074598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:32.074826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:32.074838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:32.074844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:32.074849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:32.074854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:32.074858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:32.074862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:32.074867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:32.074871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:32.074875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:32.074880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:32.074884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.074889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.074894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.074926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:32.075008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:32.075051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:32.075083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:32.075110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:32.075140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:32.075167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:32.075194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:32.075222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:32.075250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:32.075278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:32.075303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.075330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.075386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.075427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:32.075492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:32.075546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:32.075608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:32.075658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:32.075694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:32.075729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:32.075769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:32.075799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:32.075847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:32.075894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:32.075950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:32.076001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:32.076059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:32.076099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:32.076151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:32.076213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:32.076272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:32.076323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:32.076375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:32.076416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:32.076473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:32.076514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.076554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.076589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.076627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.076658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.076698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.077048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:32.100649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401989295982013:9630]
2025-10-15T11:01:32.100675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:32.110562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:32.110618Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:32.110635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:32.110655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:32.110683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 943 [2:7561401992095672266:8996]
2025-10-15T11:01:32.110737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:32.110801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:32.110818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:32.110830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:32.110842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:32.110894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:32.110919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:32.110942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:32.112861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.112892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.112908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.112919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:32.113144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:32.113166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.113287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.113449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.113652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:32.113737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401985001014442:2467], now have 1 active actors on pipe
2025-10-15T11:01:32.113694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 943
2025-10-15T11:01:32.113803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 943, pipe: [1:7561401989295982013:9630]
2025-10-15T11:01:32.113890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 943
2025-10-15T11:01:32.113766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401989295981947:10052], now have 1 active actors on pipe
2025-10-15T11:01:32.113799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401989295982013:9630], now have 1 active actors on pipe
2025-10-15T11:01:32.113826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401992095672261:8996]
2025-10-15T11:01:32.113843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401992095672261:8996]
2025-10-15T11:01:32.113857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401992095672261:8996]
2025-10-15T11:01:32.113895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:32.113960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:32.113974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:32.113975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:32.113989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:32.114156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:32.114171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:32.114340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:32.114360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:32.114392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401992095672261:8996]
2025-10-15T11:01:32.114422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:32.114512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:32.114538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:32.114569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:32.114589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:32.114598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:32.114635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:32.114679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:32.114760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:32.115212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:32.115232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:32.115296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:32.115544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 944 partition: 0 MaxSeqNo: 46 sessionId: src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0
2025-10-15T11:01:32.119566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf563750-86224650-c6711738-88e59dd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:32.152686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0] Write session: try to update token
2025-10-15T11:01:32.152746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:32.256716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:32.256753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:32.256768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:32.256780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:32.256816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401992095672261:8996]
2025-10-15T11:01:32.256845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401992095672261:8996]
2025-10-15T11:01:32.256869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401992095672261:8996]
2025-10-15T11:01:32.257018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:32.257037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:32.257050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:32.257155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:32.257183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:32.258071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:32.259486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:32.259536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:32.259567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:32.274109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId: src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:32.298136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:32.413186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:32.425459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:32.425520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:32.425596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:32.425609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:32.425640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401992095672261:8996]
2025-10-15T11:01:32.426001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:32.426264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:32.426025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:32.426028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:32.426053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:32.426242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401989295982013:9630]
2025-10-15T11:01:32.434954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 944 reason: error at write: Disconnected sessionId: src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0
2025-10-15T11:01:32.435308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 944 sessionId: src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0 is DEAD
2025-10-15T11:01:32.435705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:32.435773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0] Write session will restart in 0.009620s
2025-10-15T11:01:32.435962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0] Write session: Do CDS request
2025-10-15T11:01:32.436019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:32.449993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:32.450047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:32.450075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 945
2025-10-15T11:01:32.450935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:32.451054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:32.451065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:32.451073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:32.452138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 945 sessionId:  describe result for acl check
2025-10-15T11:01:32.452254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:32.452269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:32.452278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:32.452295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401989295982054:10059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:32.454482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401989295982054:10059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:32.461222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401989295982054:10059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:32.475440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401989295982054:10059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:32.475481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401989295982054:10059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:32.475499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401989295982054:10059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:32.475532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:32.521643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:32.526458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401989295982309:9630]
2025-10-15T11:01:32.529515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:32.530293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:32.530315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:32.530349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:32.530571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:32.530741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401992095672552:9000]
2025-10-15T11:01:32.532737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:32.533565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:32.533771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:32.534894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:32.535218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:32.535226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:32.535232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:32.535239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:32.535247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:32.535255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:32.535263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:32.535269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:32.535275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:32.535282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:32.535289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:32.535295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.535303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.535310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.535375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:32.535474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:32.535519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:32.535561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:32.535603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:32.535647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:32.535706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:32.535750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:32.535794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:32.535841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:32.535885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:32.535932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.535976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.536017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.536057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:32.536119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:32.536186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:32.536258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:32.536305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:32.536356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:32.536397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:32.536448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:32.536492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:32.536542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:32.536584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:32.536634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:32.536676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:32.536726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:32.536769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:32.536818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:32.536866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:32.536918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:32.536959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:32.537010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:32.537050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:32.537097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:32.537141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.537191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.537237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.537288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.537330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.537382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.537845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:32.561148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:32.570922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:32.570984Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:32.571000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:32.571018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:32.571044Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 944 [2:7561401992095672552:9000]
2025-10-15T11:01:32.571098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:32.571155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:32.571170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:32.571183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:32.571194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:32.571240Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:32.571260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:32.571282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:32.585165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.585201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.585214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.585225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:32.585532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:32.585558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:32.585690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:32.585873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:32.586102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:32.586177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401992095672545:9000]
2025-10-15T11:01:32.586199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401992095672545:9000]
2025-10-15T11:01:32.586213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401992095672545:9000]
2025-10-15T11:01:32.586251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:32.586322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:32.586382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:32.586406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:32.586418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:32.586502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:32.586527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:32.586649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401992095672545:9000]
2025-10-15T11:01:32.586680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:32.586705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:32.586777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401989295982094:10059], now have 1 active actors on pipe
2025-10-15T11:01:32.586801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401989295982040:2467], now have 1 active actors on pipe
2025-10-15T11:01:32.586822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401989295982309:9630], now have 1 active actors on pipe
2025-10-15T11:01:32.586957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 944
2025-10-15T11:01:32.586965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 944
2025-10-15T11:01:32.587043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 944, pipe: [1:7561401989295982309:9630]
2025-10-15T11:01:32.587544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:32.587581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:32.587649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:32.587684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:32.587707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:32.587718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:32.587750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:32.587790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:32.587871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:32.593629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 945 partition: 0 MaxSeqNo: 46 sessionId: src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0
2025-10-15T11:01:32.594389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f5585f2-754710ea-4a2cb2ac-5b068580_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:32.591579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:32.591619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:32.591693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:32.629716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0] Write session: try to update token
2025-10-15T11:01:32.629784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:32.707496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId: src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:32.728361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:32.728407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:32.728421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:32.728432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:32.728483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401992095672545:9000]
2025-10-15T11:01:32.728512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401992095672545:9000]
2025-10-15T11:01:32.728537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401992095672545:9000]
2025-10-15T11:01:32.728666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:32.728717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:32.728747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:32.728779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:32.728793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:32.728805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:32.728854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:32.728889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:32.729926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:32.741234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:32.871835Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:32.886830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:32.886891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:32.886966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:32.886982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:32.887024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401992095672545:9000]
2025-10-15T11:01:32.887258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:32.887502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:32.887839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:32.887529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:32.888330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:32.888466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401989295982309:9630]
2025-10-15T11:01:32.898414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 945 reason: error at write: Disconnected sessionId: src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0
2025-10-15T11:01:32.898738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 945 sessionId: src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0 is DEAD
2025-10-15T11:01:32.899404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:32.899443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0] Write session will restart in 0.005970s
2025-10-15T11:01:32.899585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0] Write session: Do CDS request
2025-10-15T11:01:32.899622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:32.913190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:32.913220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 946
2025-10-15T11:01:32.913311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:32.913790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:32.913915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:32.913935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:32.913944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:32.915223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 946 sessionId:  describe result for acl check
2025-10-15T11:01:32.915326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:32.915361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:32.915370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:32.915386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401989295982349:10064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:32.917895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401989295982349:10064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:32.928846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401989295982349:10064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:32.936042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401989295982349:10064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:32.936082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401989295982349:10064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:32.936099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401989295982349:10064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:32.936132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:32.988301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401989295982503:9630]
2025-10-15T11:01:33.020759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:33.026620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:33.027500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:33.027518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:33.027559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:33.027800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:33.027991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401996390640153:9010]
2025-10-15T11:01:33.030924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:33.032861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:33.033088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:33.034317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:33.034649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:33.034668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:33.034676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:33.034683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:33.034689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:33.034696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:33.034704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:33.034710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:33.034716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:33.034723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:33.034729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:33.034736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.034743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.034751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.034798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:33.034908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:33.034960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:33.035005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:33.035049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:33.035104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:33.035154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:33.035204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:33.035255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:33.035311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:33.035376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:33.035423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.035469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.035513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.035555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:33.035617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:33.035674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:33.035725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:33.035769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:33.035825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:33.035869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:33.035923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:33.035971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:33.036022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:33.036066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:33.036121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:33.036194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:33.036250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:33.036296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:33.036345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:33.036391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:33.036443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:33.036488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:33.036541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:33.036584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:33.036636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:33.036680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.036732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.036780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.036835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.036877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.036927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.037397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:33.065641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:33.083863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:33.083917Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:33.083935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:33.083954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:33.083979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 945 [2:7561401996390640153:9010]
2025-10-15T11:01:33.084028Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:33.084082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:33.084097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:33.084109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:33.084120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:33.084164Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:33.084198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:33.084218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:33.111102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.111133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.111143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.111152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:33.112005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 945, pipe: [1:7561401989295982503:9630]
2025-10-15T11:01:33.112065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 945
2025-10-15T11:01:33.112113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 945
2025-10-15T11:01:33.111945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:33.111969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.112093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.112257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.112439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:33.112506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401989295982503:9630], now have 1 active actors on pipe
2025-10-15T11:01:33.112526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401989295982384:10064], now have 1 active actors on pipe
2025-10-15T11:01:33.112547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401989295982336:2467], now have 1 active actors on pipe
2025-10-15T11:01:33.112570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401996390640148:9010]
2025-10-15T11:01:33.112582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401996390640148:9010]
2025-10-15T11:01:33.112595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401996390640148:9010]
2025-10-15T11:01:33.112628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:33.112689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:33.112844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:33.112859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:33.112964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401996390640148:9010]
2025-10-15T11:01:33.112982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:33.113521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:33.113541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:33.113551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:33.113574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:33.114316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:33.114344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:33.114421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7787f500-7ed341e0-a635b570-97b8aad1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:33.114447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:33.114464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:33.114474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:33.114504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:33.114542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:33.114581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:33.115285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:33.115308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:33.115381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:33.115727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 946 partition: 0 MaxSeqNo: 46 sessionId: src_id|7787f500-7ed341e0-a635b570-97b8aad1_0
2025-10-15T11:01:33.116387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|800d4ba7-4857b58b-f221aebe-f6a95904_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7787f500-7ed341e0-a635b570-97b8aad1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:33.138911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7787f500-7ed341e0-a635b570-97b8aad1_0] Write session: try to update token
2025-10-15T11:01:33.138972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7787f500-7ed341e0-a635b570-97b8aad1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:33.221849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:33.221893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:33.221908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:33.221921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:33.221959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401996390640148:9010]
2025-10-15T11:01:33.221990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401996390640148:9010]
2025-10-15T11:01:33.222018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401996390640148:9010]
2025-10-15T11:01:33.222195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:33.222209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:33.222220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:33.222302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:33.222341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:33.222344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:33.222364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:33.222365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:33.223470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:33.250249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId: src_id|7787f500-7ed341e0-a635b570-97b8aad1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:33.270388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:33.368249Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:33.380155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:33.380223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:33.380305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:33.380318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:33.380358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401996390640148:9010]
2025-10-15T11:01:33.380631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:33.381077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:33.383566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401989295982503:9630]
2025-10-15T11:01:33.383772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:33.398161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:33.398280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 946 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7787f500-7ed341e0-a635b570-97b8aad1_0
2025-10-15T11:01:33.398560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 946 sessionId: src_id|7787f500-7ed341e0-a635b570-97b8aad1_0 is DEAD
2025-10-15T11:01:33.401546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7787f500-7ed341e0-a635b570-97b8aad1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:33.401582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7787f500-7ed341e0-a635b570-97b8aad1_0] Write session will restart in 0.008171s
2025-10-15T11:01:33.401675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7787f500-7ed341e0-a635b570-97b8aad1_0] Write session: Do CDS request
2025-10-15T11:01:33.401699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7787f500-7ed341e0-a635b570-97b8aad1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:33.420535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7787f500-7ed341e0-a635b570-97b8aad1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:33.423944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:33.423976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 947
2025-10-15T11:01:33.429404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:33.429553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:33.429569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:33.429580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:33.431616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 947 sessionId:  describe result for acl check
2025-10-15T11:01:33.431776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:33.431794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:33.431811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:33.431835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401993590949954:10075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:33.435454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401993590949954:10075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:33.448920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401993590949954:10075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:33.464369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401993590949954:10075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:33.464411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401993590949954:10075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:33.464429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401993590949954:10075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:33.464461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:33.483906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401993590950126:9630]
2025-10-15T11:01:33.521728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:33.526384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:33.527423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:33.527461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:33.527514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:33.527830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:33.528045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561401996390640448:9017]
2025-10-15T11:01:33.530449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:33.532080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:33.532368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:33.533845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:33.534229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:33.534251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:33.534259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:33.534266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:33.534274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:33.534281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:33.534289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:33.534296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:33.534302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:33.534309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:33.534316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:33.534322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.534328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.534335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.534384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:33.534514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:33.534564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:33.534615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:33.534665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:33.535280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:33.535367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:33.535416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:33.535465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:33.535516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:33.535563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:33.535610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.535658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.535707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.535759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:33.535827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:33.535890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:33.535948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:33.535995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:33.536053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:33.536102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:33.536156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:33.536225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:33.536283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:33.536333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:33.536390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:33.536439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:33.536496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:33.536542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:33.536601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:33.536658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:33.536720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:33.536768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:33.536858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:33.536922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:33.536980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:33.537031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.537088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.537136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.537192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.537258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.537328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.537887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:33.565346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:33.581787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:33.581848Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:33.581865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:33.581887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:33.581914Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 946 [2:7561401996390640448:9017]
2025-10-15T11:01:33.581969Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:33.582031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:33.582047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:33.582060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:33.582072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:33.582128Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:33.582152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:33.582177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:33.584944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.584977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.584990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.585002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:33.585314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:33.585331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:33.585478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:33.585674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:33.585914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:33.585999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561401996390640443:9017]
2025-10-15T11:01:33.586013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561401996390640443:9017]
2025-10-15T11:01:33.586025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561401996390640443:9017]
2025-10-15T11:01:33.586074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:33.586152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:33.586345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:33.586390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:33.586525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561401996390640443:9017]
2025-10-15T11:01:33.586546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:33.587430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:33.587457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:33.587469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:33.587494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:33.588463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401993590950050:10075], now have 1 active actors on pipe
2025-10-15T11:01:33.588498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401993590950126:9630], now have 1 active actors on pipe
2025-10-15T11:01:33.588522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401993590949942:2467], now have 1 active actors on pipe
2025-10-15T11:01:33.589592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 946
2025-10-15T11:01:33.589676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 946, pipe: [1:7561401993590950126:9630]
2025-10-15T11:01:33.589749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 946
2025-10-15T11:01:33.590052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:33.590086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:33.590185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:33.590223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:33.590243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:33.590252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:33.590295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:33.590348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:33.590399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:33.592484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:33.592521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:33.592610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:33.596445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 947 partition: 0 MaxSeqNo: 46 sessionId: src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0
2025-10-15T11:01:33.597495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7787f500-7ed341e0-a635b570-97b8aad1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:33.636226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0] Write session: try to update token
2025-10-15T11:01:33.636293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:33.682635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:33.682675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:33.682688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:33.702726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:33.702779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:33.702820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561401996390640443:9017]
2025-10-15T11:01:33.703881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:33.707427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:33.732714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:33.740352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:33.751978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:33.753302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:33.768008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:33.768561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:33.785154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:33.785199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:33.785213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:33.816302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId: src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:33.848858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:33.850647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:33.850686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:33.850701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:33.850735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:33.850813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561401996390640443:9017]
2025-10-15T11:01:33.850871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561401996390640443:9017]
2025-10-15T11:01:33.850915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561401996390640443:9017]
2025-10-15T11:01:33.851149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:33.851177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:33.851222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:33.851246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:33.853697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:33.853737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:33.853809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:33.856507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:34.001634Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:34.004167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401993590950126:9630]
2025-10-15T11:01:34.004263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:34.004395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:34.004410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:34.003993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:34.032241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 947 reason: error at write: Disconnected sessionId: src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0
2025-10-15T11:01:34.032555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 947 sessionId: src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0 is DEAD
2025-10-15T11:01:34.035858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:34.035895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0] Write session will restart in 0.009933s
2025-10-15T11:01:34.036021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0] Write session: Do CDS request
2025-10-15T11:01:34.036052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:34.052508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:34.052570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 948
2025-10-15T11:01:34.053440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:34.055909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:34.056073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:34.056100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:34.056112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:34.057335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 948 sessionId:  describe result for acl check
2025-10-15T11:01:34.057419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:34.057430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:34.057436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:34.057448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401997885917567:10084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:34.059593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401997885917567:10084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:34.066986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401997885917567:10084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:34.078738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401997885917567:10084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:34.078784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401997885917567:10084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:34.078803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401997885917567:10084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:34.078834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:34.104408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401997885917816:9630]
2025-10-15T11:01:34.121357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:34.123538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:34.124512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:34.124545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:34.124601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:34.124880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:34.125032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402000685608045:9023]
2025-10-15T11:01:34.126771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:34.127899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:34.128160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:34.129588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:34.129948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:34.129971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:34.129980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:34.129988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:34.129997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:34.130005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:34.130012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:34.130019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:34.130027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:34.130034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:34.130042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:34.130050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.130057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.130065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.130116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:34.130237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:34.130298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:34.130354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:34.130408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:34.130468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:34.130526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:34.130582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:34.130636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:34.130688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:34.130740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:34.130795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.130850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.130898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.130947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:34.131023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:34.131086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:34.131145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:34.131196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:34.131253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:34.131301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:34.131379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:34.131433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:34.131494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:34.131561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:34.131625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:34.131689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:34.131746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:34.131794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:34.131870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:34.131934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:34.131998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:34.132061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:34.132124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:34.132181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:34.132255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:34.132313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.132378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.132437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.132502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.132554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.132621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.133159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:34.148949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:34.189536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:34.189596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:34.189615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:34.189636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:34.189661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 947 [2:7561402000685608045:9023]
2025-10-15T11:01:34.189718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:34.189801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:34.189819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:34.189830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:34.189841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:34.189895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:34.189921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:34.189945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:34.191015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.191031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.191046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.191057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:34.191337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:34.191792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 947
2025-10-15T11:01:34.191808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 947, pipe: [1:7561401997885917816:9630]
2025-10-15T11:01:34.191909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 947
2025-10-15T11:01:34.191883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.192054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.192266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.192511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:34.192609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401997885917644:10084], now have 1 active actors on pipe
2025-10-15T11:01:34.192633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401997885917816:9630], now have 1 active actors on pipe
2025-10-15T11:01:34.192658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401997885917551:2467], now have 1 active actors on pipe
2025-10-15T11:01:34.192712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:34.192736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:34.192796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402000685608040:9023]
2025-10-15T11:01:34.192810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402000685608040:9023]
2025-10-15T11:01:34.192824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402000685608040:9023]
2025-10-15T11:01:34.192868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:34.192911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:34.192928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:34.192941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:34.192952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:34.193131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:34.193143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:34.193193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:34.193216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:34.193229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:34.193237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:34.193268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:34.193301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:34.193409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402000685608040:9023]
2025-10-15T11:01:34.193432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:34.193453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:34.193465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:34.194261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:34.194304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:34.194385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:34.194692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 948 partition: 0 MaxSeqNo: 46 sessionId: src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0
2025-10-15T11:01:34.195956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90328bd6-1f0ebef9-8beaf581-d6b19462_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:34.226476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0] Write session: try to update token
2025-10-15T11:01:34.226544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:34.253893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:34.253925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:34.253937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:34.253946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:34.253973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402000685608040:9023]
2025-10-15T11:01:34.253993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402000685608040:9023]
2025-10-15T11:01:34.254012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402000685608040:9023]
2025-10-15T11:01:34.254129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:34.254149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:34.254160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:34.254209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:34.254241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:34.255431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:34.354129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId: src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:34.375424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:34.442198Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:34.445105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:34.445159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:34.446631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401997885917816:9630]
2025-10-15T11:01:34.446724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:34.446804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:34.446825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:34.455736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:34.457417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 948 reason: error at write: Disconnected sessionId: src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0
2025-10-15T11:01:34.458388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:34.457874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 948 sessionId: src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0 is DEAD
2025-10-15T11:01:34.458451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0] Write session will restart in 0.006959s
2025-10-15T11:01:34.458605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0] Write session: Do CDS request
2025-10-15T11:01:34.458651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:34.474741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:34.474546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:34.474609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 949
2025-10-15T11:01:34.475501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:34.475715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:34.475761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:34.475795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:34.478434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 949 sessionId:  describe result for acl check
2025-10-15T11:01:34.478627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:34.478646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:34.478664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:34.478697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401997885917850:10088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:34.481981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401997885917850:10088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:34.489277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401997885917850:10088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:34.496359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401997885917850:10088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:34.496409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401997885917850:10088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:34.496428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401997885917850:10088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:34.496460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:34.546808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561401997885918070:9630]
2025-10-15T11:01:34.566416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:34.570382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:34.571293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:34.571326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:34.571385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:34.571674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:34.571863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402000685608339:9031]
2025-10-15T11:01:34.574143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:34.575247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:34.575506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:34.576844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:34.577201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:34.577220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:34.577228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:34.577237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:34.577245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:34.577252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:34.577260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:34.577267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:34.577275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:34.577283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:34.577291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:34.577299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.577307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.577314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.577366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:34.577488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:34.577538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:34.577591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:34.577654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:34.577711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:34.577772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:34.577831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:34.577889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:34.577945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:34.578002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:34.578058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.578117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.578175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.578231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:34.578313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:34.578385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:34.578455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:34.578518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:34.578585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:34.578640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:34.578707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:34.578787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:34.578863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:34.578921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:34.578984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:34.579038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:34.579100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:34.579155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:34.579217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:34.579274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:34.579333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:34.579742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:34.579821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:34.579860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:34.579906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:34.579940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.579984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.580019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.580060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.580092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.580134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.580546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:34.601897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:34.613176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:34.613239Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:34.613261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:34.613284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:34.613313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 948 [2:7561402000685608339:9031]
2025-10-15T11:01:34.613371Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:34.613438Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:34.613456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:34.613489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:34.613504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:34.613568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:34.613596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:34.613623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:34.615134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.615146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.615156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.615165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:34.615407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:34.615425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:34.615580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:34.615800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:34.616023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:34.616124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401997885917889:10088], now have 1 active actors on pipe
2025-10-15T11:01:34.616156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401997885918070:9630], now have 1 active actors on pipe
2025-10-15T11:01:34.616188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401997885917839:2467], now have 1 active actors on pipe
2025-10-15T11:01:34.616229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402000685608334:9031]
2025-10-15T11:01:34.616251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402000685608334:9031]
2025-10-15T11:01:34.617693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 948
2025-10-15T11:01:34.617775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 948, pipe: [1:7561401997885918070:9630]
2025-10-15T11:01:34.617870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 948
2025-10-15T11:01:34.622972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402000685608334:9031]
2025-10-15T11:01:34.623072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:34.623206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:34.623460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:34.623479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:34.623563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:34.623594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:34.623760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402000685608334:9031]
2025-10-15T11:01:34.623784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:34.623866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:34.623906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:34.623928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:34.623926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:34.623942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:34.623944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:34.623956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:34.623988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:34.623988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:34.624085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:34.624294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:34.626663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:34.626714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:34.626803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:34.627331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 949 partition: 0 MaxSeqNo: 46 sessionId: src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0
2025-10-15T11:01:34.630234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2571e967-dedcd4ee-4e12e33c-9cde8228_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:34.686772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0] Write session: try to update token
2025-10-15T11:01:34.686829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:34.734124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:34.734191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:34.734212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:34.734312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:34.734344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:34.734370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:34.734387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:34.734444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402000685608334:9031]
2025-10-15T11:01:34.734518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402000685608334:9031]
2025-10-15T11:01:34.734566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402000685608334:9031]
2025-10-15T11:01:34.734797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:34.734854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:34.734973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:34.735011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:34.735045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:34.745916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:34.827738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId: src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:34.859653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:34.897942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:34.908364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:34.908417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:34.912516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:34.912143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:34.912312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:34.912324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:34.944413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561401997885918070:9630]
2025-10-15T11:01:34.944587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 949 reason: error at write: Disconnected sessionId: src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0
2025-10-15T11:01:34.945367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:34.945440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0] Write session will restart in 0.005899s
2025-10-15T11:01:34.945597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0] Write session: Do CDS request
2025-10-15T11:01:34.945650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:34.944880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 949 sessionId: src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0 is DEAD
2025-10-15T11:01:34.955660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:34.964807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:34.964829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 950
2025-10-15T11:01:34.965331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:34.965440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:34.965455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:34.965465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:34.966634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 950 sessionId:  describe result for acl check
2025-10-15T11:01:34.966742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:34.966757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:34.966766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:34.966782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561401997885918190:10102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:34.970202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561401997885918190:10102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:34.985180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561401997885918190:10102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:35.003847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561401997885918190:10102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:35.003886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561401997885918190:10102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:35.003901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561401997885918190:10102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:35.003927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:35.035814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:35.037936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:35.038733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:35.038769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:35.038808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:35.039029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:35.039241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402004980575948:9039]
2025-10-15T11:01:35.042969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402002180885734:9630]
2025-10-15T11:01:35.041411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:35.042314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:35.042487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:35.043736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:35.044038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:35.044046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:35.044053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:35.044059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:35.044066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:35.044072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:35.044079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:35.044085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:35.044092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:35.044099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:35.044106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:35.044112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.044120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.044128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.044170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:35.044284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:35.044331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:35.044377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:35.044419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:35.044462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:35.044502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:35.044542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:35.044583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:35.044625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:35.044667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:35.044709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.044751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.044794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.044831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:35.044890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:35.044942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:35.044992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:35.045035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:35.045085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:35.045129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:35.045178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:35.045224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:35.045273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:35.045317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:35.045385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:35.045440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:35.045489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:35.045532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:35.045581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:35.045623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:35.045671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:35.045713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:35.045762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:35.045802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:35.045859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:35.045902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.045951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.045991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.046039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.046082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.046131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.046594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:35.066967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:35.094798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:35.094849Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:35.094863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:35.094879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:35.096556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 949 [2:7561402004980575948:9039]
2025-10-15T11:01:35.096626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:35.096678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:35.096691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:35.096703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:35.096714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:35.096759Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:35.096779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:35.096799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:35.099163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.099189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.099201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.099211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:35.099477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:35.099503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.099945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 949
2025-10-15T11:01:35.100031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 949, pipe: [1:7561402002180885734:9630]
2025-10-15T11:01:35.100106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 949
2025-10-15T11:01:35.100891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.101141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.101388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:35.101505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402002180885649:10102], now have 1 active actors on pipe
2025-10-15T11:01:35.101541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402002180885734:9630], now have 1 active actors on pipe
2025-10-15T11:01:35.101565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561401997885918159:2467], now have 1 active actors on pipe
2025-10-15T11:01:35.101639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:35.101672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:35.101715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402004980575943:9039]
2025-10-15T11:01:35.101731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402004980575943:9039]
2025-10-15T11:01:35.101746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402004980575943:9039]
2025-10-15T11:01:35.101791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:35.101837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:35.101854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:35.101867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:35.101876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:35.102071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:35.102089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:35.102160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5c067de-770d9db7-18ce265f-388b75b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:35.102204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:35.102222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:35.102234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:35.102272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:35.102319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:35.102450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402004980575943:9039]
2025-10-15T11:01:35.102480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:35.102517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:35.102528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:35.103112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:35.103143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:35.103209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:35.103522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 950 partition: 0 MaxSeqNo: 46 sessionId: src_id|d5c067de-770d9db7-18ce265f-388b75b0_0
2025-10-15T11:01:35.104430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4119f8be-3a1b5dcf-a0227dab-8f6704c1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d5c067de-770d9db7-18ce265f-388b75b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:35.133967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c067de-770d9db7-18ce265f-388b75b0_0] Write session: try to update token
2025-10-15T11:01:35.134029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c067de-770d9db7-18ce265f-388b75b0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:35.244807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:35.244851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:35.244888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402004980575943:9039]
2025-10-15T11:01:35.245006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:35.245018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:35.245030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:35.245041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:35.245173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:35.247419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:35.248524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:35.250573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:35.251676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:35.253994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:35.271785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId: src_id|d5c067de-770d9db7-18ce265f-388b75b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:35.286629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:35.286794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:35.286811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:35.286828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:35.286841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:35.286884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402004980575943:9039]
2025-10-15T11:01:35.286914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402004980575943:9039]
2025-10-15T11:01:35.286941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402004980575943:9039]
2025-10-15T11:01:35.287089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:35.287094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:35.287118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:35.287139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:35.287178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:35.292447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:35.302548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:35.440942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:35.442569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:35.442614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:35.443929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:35.448370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:35.448399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:35.451584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402002180885734:9630]
2025-10-15T11:01:35.451730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:35.457092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 950 reason: error at write: Disconnected sessionId: src_id|d5c067de-770d9db7-18ce265f-388b75b0_0
2025-10-15T11:01:35.457772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c067de-770d9db7-18ce265f-388b75b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:35.457820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c067de-770d9db7-18ce265f-388b75b0_0] Write session will restart in 0.006962s
2025-10-15T11:01:35.457985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c067de-770d9db7-18ce265f-388b75b0_0] Write session: Do CDS request
2025-10-15T11:01:35.458033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c067de-770d9db7-18ce265f-388b75b0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:35.457456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 950 sessionId: src_id|d5c067de-770d9db7-18ce265f-388b75b0_0 is DEAD
2025-10-15T11:01:35.478447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c067de-770d9db7-18ce265f-388b75b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:35.483550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:35.483605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 951
2025-10-15T11:01:35.484112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:35.484297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:35.484329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:35.484349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:35.486029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 951 sessionId:  describe result for acl check
2025-10-15T11:01:35.486150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:35.486167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:35.486178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:35.486199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402002180885776:10109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:35.489038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402002180885776:10109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:35.504717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402002180885776:10109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:35.514661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402002180885776:10109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:35.514707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402002180885776:10109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:35.514725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402002180885776:10109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:35.514759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:35.552330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402002180886011:9630]
2025-10-15T11:01:35.565116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:35.573140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:35.573999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:35.574032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:35.574070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:35.574347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:35.574548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402004980576237:9044]
2025-10-15T11:01:35.576226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:35.577155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:35.577366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:35.578519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:35.578831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:35.578848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:35.578855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:35.578862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:35.578869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:35.578875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:35.578881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:35.578888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:35.578895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:35.578901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:35.578908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:35.578914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.578921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.578928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.578971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:35.579072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:35.579120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:35.579165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:35.579207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:35.579250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:35.579293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:35.579334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:35.579404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:35.579449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:35.579506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:35.579550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.579595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.579639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.579681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:35.579741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:35.579799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:35.579849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:35.579897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:35.579949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:35.579992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:35.580041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:35.580107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:35.580157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:35.580199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:35.580264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:35.580311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:35.580361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:35.580409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:35.580462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:35.580506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:35.580557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:35.580600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:35.580665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:35.580709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:35.580759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:35.580808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.580868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.580921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.580979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.581032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.581088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.581663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:35.603810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:35.616275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:35.616326Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:35.616343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:35.616361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:35.616387Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 950 [2:7561402004980576237:9044]
2025-10-15T11:01:35.616439Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:35.616494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:35.616524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:35.616537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:35.616548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:35.616596Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:35.616618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:35.616639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:35.631249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.631287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.631298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.631308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:35.631769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:35.631794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:35.631908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:35.632054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:35.632261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:35.632338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402002180885825:10109], now have 1 active actors on pipe
2025-10-15T11:01:35.632359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402002180885765:2467], now have 1 active actors on pipe
2025-10-15T11:01:35.632376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402002180886011:9630], now have 1 active actors on pipe
2025-10-15T11:01:35.632401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402004980576232:9044]
2025-10-15T11:01:35.632415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402004980576232:9044]
2025-10-15T11:01:35.632427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402004980576232:9044]
2025-10-15T11:01:35.632466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:35.632512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:35.632526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:35.632534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:35.632537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:35.632694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:35.632709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:35.632817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402004980576232:9044]
2025-10-15T11:01:35.632845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:35.632945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:35.634006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 950
2025-10-15T11:01:35.634092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 950
2025-10-15T11:01:35.634153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 950, pipe: [1:7561402002180886011:9630]
2025-10-15T11:01:35.634558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:35.634597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:35.634681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:35.634715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:35.634731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:35.634740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:35.634774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:35.634814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:35.634862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:35.635637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 951 partition: 0 MaxSeqNo: 46 sessionId: src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0
2025-10-15T11:01:35.636418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c067de-770d9db7-18ce265f-388b75b0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:35.635284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:35.635310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:35.635391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:35.685123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0] Write session: try to update token
2025-10-15T11:01:35.685182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:35.698146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:35.698186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:35.698224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402004980576232:9044]
2025-10-15T11:01:35.698347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:35.699291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:35.705833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:35.711627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:35.713421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:35.714821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:35.717150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:35.717588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:35.717600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:35.717611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:35.717662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:35.780527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId: src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:35.800559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:35.800693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:35.800713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:35.800725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:35.800762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402004980576232:9044]
2025-10-15T11:01:35.800788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402004980576232:9044]
2025-10-15T11:01:35.800813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402004980576232:9044]
2025-10-15T11:01:35.800941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:35.800968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:35.801192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:35.801231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:35.801258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:35.802035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:35.832333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:35.960423Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:35.966553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:35.966599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:35.967502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402002180886011:9630]
2025-10-15T11:01:35.967603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:35.967614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:35.968409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:35.967384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:35.982042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 951 reason: error at write: Disconnected sessionId: src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0
2025-10-15T11:01:35.982359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 951 sessionId: src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0 is DEAD
2025-10-15T11:01:35.983822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:35.983858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0] Write session will restart in 0.009104s
2025-10-15T11:01:35.983986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0] Write session: Do CDS request
2025-10-15T11:01:35.984055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:36.005072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:36.006504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:36.006536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 952
2025-10-15T11:01:36.007608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:36.007842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:36.007868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:36.007886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:36.010245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 952 sessionId:  describe result for acl check
2025-10-15T11:01:36.010415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:36.010433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:36.010450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:36.010475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402006475853381:10115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:36.013544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402006475853381:10115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:36.021939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402006475853381:10115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:36.035779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402006475853381:10115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:36.035820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402006475853381:10115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:36.035837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402006475853381:10115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:36.035870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:36.067384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402006475853518:9630]
2025-10-15T11:01:36.098413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:36.109224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:36.110140Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:36.110179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:36.110225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:36.110522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:36.110721Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402009275543844:9054]
2025-10-15T11:01:36.113218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:36.114796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:36.115079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:36.116560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:36.116940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:36.116963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:36.116972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:36.116979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:36.116986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:36.116993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:36.117000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:36.117006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:36.117015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:36.117022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:36.117031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:36.117038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.117046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.117053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.117107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:36.117226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:36.117282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:36.117332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:36.117392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:36.117445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:36.117494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:36.117543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:36.117590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:36.117643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:36.117691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:36.117739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.117787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.117834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.117882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:36.117954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:36.118019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:36.118079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:36.118131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:36.118187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:36.118233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:36.118306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:36.118360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:36.118416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:36.118463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:36.118522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:36.118573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:36.118628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:36.118677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:36.118733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:36.118784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:36.118841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:36.118889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:36.118944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:36.118995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:36.119054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:36.119102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.119159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.119209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.119267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.119313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.119631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.120297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:36.161182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:36.172835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:36.172891Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:36.172909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:36.172929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:36.172959Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 951 [2:7561402009275543844:9054]
2025-10-15T11:01:36.173015Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:36.173317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:36.173340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:36.173355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:36.173366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:36.173436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:36.173461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:36.173486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:36.175780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.175811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.175826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.175838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:36.176058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:36.176081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.176202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.176384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.176620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:36.176713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402006475853518:9630], now have 1 active actors on pipe
2025-10-15T11:01:36.176752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402006475853418:10115], now have 1 active actors on pipe
2025-10-15T11:01:36.176777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402002180886070:2467], now have 1 active actors on pipe
2025-10-15T11:01:36.176914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 951, pipe: [1:7561402006475853518:9630]
2025-10-15T11:01:36.177015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 951
2025-10-15T11:01:36.177084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 951
2025-10-15T11:01:36.176811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402009275543839:9054]
2025-10-15T11:01:36.176832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402009275543839:9054]
2025-10-15T11:01:36.176845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402009275543839:9054]
2025-10-15T11:01:36.176907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:36.176920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:36.176931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:36.177003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:36.177088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:36.177273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:36.177291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:36.177425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402009275543839:9054]
2025-10-15T11:01:36.177458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:36.177726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:36.177876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:36.177907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:36.178019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:36.178065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:36.178084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:36.178104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:36.178148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:36.178205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:36.178273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:36.179817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:36.179852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:36.179922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:36.180263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 952 partition: 0 MaxSeqNo: 46 sessionId: src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0
2025-10-15T11:01:36.183596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc7104a8-3049f378-5b270f8c-d9dcb446_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:36.221630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0] Write session: try to update token
2025-10-15T11:01:36.221672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:36.227274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:36.227309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:36.227342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402009275543839:9054]
2025-10-15T11:01:36.227470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:36.227518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:36.229356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:36.230641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:36.243114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:36.244470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:36.257249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:36.291676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:36.291706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:36.291715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:36.291767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:36.358979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:36.359017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:36.359030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:36.359041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:36.359081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402009275543839:9054]
2025-10-15T11:01:36.359109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402009275543839:9054]
2025-10-15T11:01:36.359135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402009275543839:9054]
2025-10-15T11:01:36.359267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:36.359297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:36.359279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:36.359338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:36.359396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:36.362127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:36.368859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId: src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:36.390280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:36.508850Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:36.510973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:36.511001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:36.511678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402006475853518:9630]
2025-10-15T11:01:36.511760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:36.511767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:36.511760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:36.521466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 952 reason: error at write: Disconnected sessionId: src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0
2025-10-15T11:01:36.521758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 952 sessionId: src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0 is DEAD
2025-10-15T11:01:36.522130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:36.522189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0] Write session will restart in 0.008213s
2025-10-15T11:01:36.522330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0] Write session: Do CDS request
2025-10-15T11:01:36.522369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:36.536122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:36.563133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:36.567109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:36.567139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 953
2025-10-15T11:01:36.567800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:36.567888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:36.567903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:36.567909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:36.568853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 953 sessionId:  describe result for acl check
2025-10-15T11:01:36.568942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:36.568959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:36.568968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:36.568982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402006475853706:10125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:36.570703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402006475853706:10125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:36.582395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402006475853706:10125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:36.604602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402006475853706:10125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:36.604642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402006475853706:10125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:36.604658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402006475853706:10125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:36.604688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:36.613302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402006475853837:9630]
2025-10-15T11:01:36.654602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:36.660721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:36.661631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:36.661650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:36.661692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:36.661963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:36.662144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402009275544147:9061]
2025-10-15T11:01:36.663813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:36.664861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:36.665056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:36.666238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:36.666535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:36.666542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:36.666549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:36.666557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:36.666563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:36.666569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:36.666575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:36.666582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:36.666590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:36.666596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:36.666602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:36.666609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.666616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.666622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.666666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:36.666769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:36.666817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:36.666861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:36.666907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:36.666952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:36.666998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:36.667042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:36.667087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:36.667130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:36.667175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:36.667221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.667262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.667306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.667365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:36.667429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:36.667488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:36.667542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:36.667592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:36.667644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:36.667688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:36.667740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:36.667789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:36.667847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:36.667895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:36.667968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:36.668039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:36.668090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:36.668146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:36.668209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:36.668272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:36.668326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:36.668373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:36.668446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:36.668493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:36.668548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:36.668601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.668656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.668710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.668764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.668809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.668863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.669372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:36.671040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T11:01:36.671086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-15T11:01:36.691733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:36.701451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:36.701493Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:36.701507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:36.701524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:36.701548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 952 [2:7561402009275544147:9061]
2025-10-15T11:01:36.701594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:36.701647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:36.701665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:36.701678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:36.701687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:36.701731Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:36.701756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:36.701776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:36.703298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.703327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.703341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.703365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:36.703604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:36.703632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:36.703745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:36.703894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:36.704112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:36.704192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402006475853801:10125], now have 1 active actors on pipe
2025-10-15T11:01:36.704220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402006475853837:9630], now have 1 active actors on pipe
2025-10-15T11:01:36.704254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402006475853687:2467], now have 1 active actors on pipe
2025-10-15T11:01:36.704280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402009275544142:9061]
2025-10-15T11:01:36.704298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402009275544142:9061]
2025-10-15T11:01:36.704311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402009275544142:9061]
2025-10-15T11:01:36.704347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:36.704428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:36.704601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:36.704620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:36.704725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402009275544142:9061]
2025-10-15T11:01:36.704747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:36.704891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:36.704908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:36.704917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:36.704938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:36.705264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:36.705302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:36.705373Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:36.705410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:36.705431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:36.705441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:36.705475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:36.705521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:36.705576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:36.704164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 952
2025-10-15T11:01:36.704251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 952, pipe: [1:7561402006475853837:9630]
2025-10-15T11:01:36.705460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 952
2025-10-15T11:01:36.706294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:36.706332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:36.706486Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:01:36.706617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:36.707597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 953 partition: 0 MaxSeqNo: 46 sessionId: src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0
2025-10-15T11:01:36.708324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 18 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:01:36.708477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:01:36.708876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2165246c-6832c57b-5ba374c1-90c4df9a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:36.741677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0] Write session: try to update token
2025-10-15T11:01:36.741724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:36.763975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:36.764023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:36.764058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402009275544142:9061]
2025-10-15T11:01:36.764197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:36.764209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:36.766976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:36.768431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:36.770010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:36.771902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:36.774229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:36.774766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:36.837189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:36.837243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:36.837257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:36.837343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:36.837361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:36.837378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:36.837390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:36.837449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402009275544142:9061]
2025-10-15T11:01:36.837480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402009275544142:9061]
2025-10-15T11:01:36.837518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402009275544142:9061]
2025-10-15T11:01:36.837664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:36.837694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:36.837808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:36.837846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:36.837878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:36.839775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:36.868253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId: src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:36.889217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:36.985792Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:36.987030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:36.987056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:36.987969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:36.987989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:36.987955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:36.989013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402006475853837:9630]
2025-10-15T11:01:36.989110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:37.047272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 953 reason: error at write: Disconnected sessionId: src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0
2025-10-15T11:01:37.047658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 953 sessionId: src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0 is DEAD
2025-10-15T11:01:37.048130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:37.048183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0] Write session will restart in 0.007561s
2025-10-15T11:01:37.048347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0] Write session: Do CDS request
2025-10-15T11:01:37.048390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:37.061047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:37.061549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:37.061579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 954
2025-10-15T11:01:37.061861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:37.061986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:37.062007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:37.062017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:37.063676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 954 sessionId:  describe result for acl check
2025-10-15T11:01:37.063793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:37.063814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:37.063823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:37.063840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402010770821434:10134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:37.066359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402010770821434:10134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:37.077902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402010770821434:10134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:37.089352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402010770821582:9630]
2025-10-15T11:01:37.089539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402010770821434:10134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:37.089581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402010770821434:10134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:37.089599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402010770821434:10134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:37.089633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:37.109209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:37.111553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:37.112406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:37.112440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:37.112486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:37.112745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:37.112962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402013570511751:9067]
2025-10-15T11:01:37.115339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:37.116740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:37.116963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:37.118269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:37.118606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:37.118626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:37.118633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:37.118641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:37.118648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:37.118654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:37.118662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:37.118670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:37.118677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:37.118684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:37.118690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:37.118698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.118705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.118712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.118762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:37.118878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:37.118932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:37.118980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:37.119028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:37.119077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:37.119126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:37.119178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:37.119233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:37.119288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:37.119342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:37.119415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.119469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.119516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.119568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:37.119646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:37.119714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:37.119777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:37.119833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:37.119894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:37.119939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:37.119996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:37.120045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:37.120099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:37.120144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:37.120199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:37.120265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:37.120325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:37.120372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:37.120428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:37.120480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:37.120538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:37.120584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:37.120637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:37.120687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:37.120738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:37.120788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.120844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.120892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.120949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.120997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.121053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.121576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:37.148545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:37.159052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:37.159107Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:37.159125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:37.159144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:37.159168Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 953 [2:7561402013570511751:9067]
2025-10-15T11:01:37.159220Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:37.159278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:37.159292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:37.159304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:37.159314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:37.159376Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:37.159396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:37.159416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:37.161388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.161420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.161433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.161444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:37.161656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:37.161675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.161781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.161939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.162131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:37.162196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402006475854024:2467], now have 1 active actors on pipe
2025-10-15T11:01:37.162226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402010770821590:10134], now have 1 active actors on pipe
2025-10-15T11:01:37.162247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402010770821582:9630], now have 1 active actors on pipe
2025-10-15T11:01:37.162271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402013570511746:9067]
2025-10-15T11:01:37.162287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402013570511746:9067]
2025-10-15T11:01:37.162299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402013570511746:9067]
2025-10-15T11:01:37.162351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:37.162334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 953
2025-10-15T11:01:37.162410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:37.162427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:37.162433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 953, pipe: [1:7561402010770821582:9630]
2025-10-15T11:01:37.162436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:37.162441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:37.162524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 953
2025-10-15T11:01:37.162612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:37.162635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:37.162773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:37.162804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:37.162835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402013570511746:9067]
2025-10-15T11:01:37.162868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:37.162959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:37.162983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:37.162991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:37.163000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:37.163009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:37.163041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:37.163075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:37.163162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:37.164731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:37.164771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:37.164845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:37.165223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 954 partition: 0 MaxSeqNo: 46 sessionId: src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0
2025-10-15T11:01:37.166123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|854beeb6-9bacaa00-33e1ffe4-88493122_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:37.193115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0] Write session: try to update token
2025-10-15T11:01:37.193169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:37.276902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:37.276938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:37.276949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:37.277000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:37.277014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:37.277027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:37.277039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:37.277070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402013570511746:9067]
2025-10-15T11:01:37.277094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402013570511746:9067]
2025-10-15T11:01:37.277117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402013570511746:9067]
2025-10-15T11:01:37.277297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:37.277328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:37.278456Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:37.279498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:37.279540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:37.279566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:37.296891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId: src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:37.318780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:37.414907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:37.426746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:37.426797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:37.426860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:37.426873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:37.426912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402013570511746:9067]
2025-10-15T11:01:37.427425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:37.427700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:37.427715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:37.427733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:37.427900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402010770821582:9630]
2025-10-15T11:01:37.427875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:37.455538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 954 reason: error at write: Disconnected sessionId: src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0
2025-10-15T11:01:37.455784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 954 sessionId: src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0 is DEAD
2025-10-15T11:01:37.456223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:37.456294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0] Write session will restart in 0.009961s
2025-10-15T11:01:37.456460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0] Write session: Do CDS request
2025-10-15T11:01:37.456507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:37.471953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:37.471992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 955
2025-10-15T11:01:37.472128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:37.472586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:37.472713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:37.472744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:37.472753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:37.474171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 955 sessionId:  describe result for acl check
2025-10-15T11:01:37.474276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:37.474292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:37.474301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:37.474317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402010770821628:10138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:37.476801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402010770821628:10138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:37.482224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402010770821628:10138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:37.490040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402010770821628:10138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:37.490076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402010770821628:10138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:37.490093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402010770821628:10138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:37.490122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:37.530021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402010770821734:9630]
2025-10-15T11:01:37.598377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:37.608504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:37.609316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:37.609351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:37.609390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:37.609633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:37.609821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402013570512050:9076]
2025-10-15T11:01:37.612374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:37.614666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:37.614867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:37.616075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:37.616392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:37.616412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:37.616418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:37.616425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:37.616431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:37.616437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:37.616443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:37.616449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:37.616456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:37.616462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:37.616469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:37.616476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.616483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.616489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.616531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:37.616628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:37.616670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:37.616710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:37.616755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:37.616798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:37.616838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:37.616880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:37.616919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:37.616962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:37.617001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:37.617043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.617087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.617128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.617168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:37.617229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:37.617282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:37.617332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:37.617378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:37.617428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:37.617471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:37.617519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:37.617566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:37.617614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:37.617655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:37.617727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:37.617770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:37.617821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:37.617862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:37.617910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:37.617953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:37.618001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:37.618043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:37.618091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:37.618133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:37.618219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:37.618266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.618316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.618359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.618408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.618447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.618493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.618953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:37.656425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:37.666692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:37.666742Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:37.666759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:37.666777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:37.666802Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 954 [2:7561402013570512050:9076]
2025-10-15T11:01:37.666849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:37.666901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:37.666915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:37.666927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:37.666936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:37.666977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:37.667005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:37.667025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:37.668358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.668387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.668401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.668412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:37.668922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 954, pipe: [1:7561402010770821734:9630]
2025-10-15T11:01:37.669032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 954
2025-10-15T11:01:37.669043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 954
2025-10-15T11:01:37.668656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:37.668682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:37.668816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:37.669005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:37.669223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:37.669297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402010770821734:9630], now have 1 active actors on pipe
2025-10-15T11:01:37.669318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402010770821614:2467], now have 1 active actors on pipe
2025-10-15T11:01:37.669338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402010770821658:10138], now have 1 active actors on pipe
2025-10-15T11:01:37.669361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402013570512044:9076]
2025-10-15T11:01:37.669374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402013570512044:9076]
2025-10-15T11:01:37.669386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402013570512044:9076]
2025-10-15T11:01:37.669428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:37.669440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:37.669454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:37.669465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:37.669496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:37.669662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:37.669677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:37.669743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:37.669761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:37.669872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402013570512044:9076]
2025-10-15T11:01:37.669902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:37.669941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:37.669966Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:37.669992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:37.670008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:37.670017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:37.670050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:37.670085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:37.670198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:37.670831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:37.670852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:37.671109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:37.674057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f1788e3-582e288c-ec9618ad-1e217b46_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:37.671416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 955 partition: 0 MaxSeqNo: 46 sessionId: src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0
2025-10-15T11:01:37.696938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0] Write session: try to update token
2025-10-15T11:01:37.697003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:37.775142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:37.775193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:37.775209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:37.775220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:37.775260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402013570512044:9076]
2025-10-15T11:01:37.775297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402013570512044:9076]
2025-10-15T11:01:37.775323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402013570512044:9076]
2025-10-15T11:01:37.775460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:37.775495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:37.775539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:37.775543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:37.775556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:37.775567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:37.775680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:37.775703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:37.776736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:37.818509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId: src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:37.839197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:37.929372Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:37.941018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:37.941082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:37.941161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:37.941175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:37.941219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402013570512044:9076]
2025-10-15T11:01:37.941354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:37.942354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:37.951500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:37.951621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402010770821734:9630]
2025-10-15T11:01:37.951680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:37.958129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 955 reason: status is not ok: tablet will be restarted right now sessionId: src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0
2025-10-15T11:01:37.958503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 955 sessionId: src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0 is DEAD
2025-10-15T11:01:37.959804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:37.959852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0] Write session will restart in 0.005118s
2025-10-15T11:01:37.959963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0] Write session: Do CDS request
2025-10-15T11:01:37.959992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:37.972100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:37.982672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:37.982699Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 956
2025-10-15T11:01:37.983420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:37.983557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:37.983573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:37.983583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:37.985825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 956 sessionId:  describe result for acl check
2025-10-15T11:01:37.985944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:37.985955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:37.985965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:37.985984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402010770821959:10150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:37.988923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402010770821959:10150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:37.998866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402010770821959:10150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:38.021295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402010770821959:10150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:38.021349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402010770821959:10150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:38.021370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402010770821959:10150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:38.021412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:38.050413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402015065789379:9630]
2025-10-15T11:01:38.092214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:38.095727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:38.096647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:38.096682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:38.096727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:38.097000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:38.097205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402017865479666:9084]
2025-10-15T11:01:38.099659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:38.100851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:38.101084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:38.102380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:38.102724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:38.102745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:38.102754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:38.102762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:38.102770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:38.102778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:38.102784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:38.102792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:38.102799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:38.102808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:38.102815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:38.102823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.102830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.102839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.102890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:38.103006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:38.103054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:38.103113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:38.103161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:38.103220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:38.103272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:38.103325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:38.103392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:38.103446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:38.103497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:38.103552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.103604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.103655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.103707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:38.103783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:38.103852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:38.103913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:38.103966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:38.104029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:38.104087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:38.104147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:38.104199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:38.104271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:38.104321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:38.104380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:38.104430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:38.104487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:38.104534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:38.104594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:38.104644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:38.104699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:38.104747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:38.104803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:38.104854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:38.104910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:38.104958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.105012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.105061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.105116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.105164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.105214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.105739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:38.128549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:38.179480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:38.179525Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:38.179536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:38.179550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:38.179569Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 955 [2:7561402017865479666:9084]
2025-10-15T11:01:38.179604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:38.179649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:38.179658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:38.179667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:38.179675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:38.179711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:38.179728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:38.179744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:38.181151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.181173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.181182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.181189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:38.181383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:38.181400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.181497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.181631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.181798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:38.181876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402017865479661:9084]
2025-10-15T11:01:38.181897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402017865479661:9084]
2025-10-15T11:01:38.181910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402017865479661:9084]
2025-10-15T11:01:38.181944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:38.182020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:38.182176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:38.182201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:38.182214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:38.182217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:38.182235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:38.182411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402017865479661:9084]
2025-10-15T11:01:38.182449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:38.182495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:38.182503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402015065789291:10150], now have 1 active actors on pipe
2025-10-15T11:01:38.182528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402015065789379:9630], now have 1 active actors on pipe
2025-10-15T11:01:38.182551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402010770821941:2467], now have 1 active actors on pipe
2025-10-15T11:01:38.182506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 955
2025-10-15T11:01:38.182683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:38.182586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 955, pipe: [1:7561402015065789379:9630]
2025-10-15T11:01:38.182710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:38.182661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 955
2025-10-15T11:01:38.182810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5dda088-96397488-baef4942-2577e7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:38.182861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:38.182887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:38.182899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:38.182936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:38.182978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:38.183027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:38.183452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:38.183475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:38.183538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:38.184356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 956 partition: 0 MaxSeqNo: 46 sessionId: src_id|b5dda088-96397488-baef4942-2577e7d_0
2025-10-15T11:01:38.185160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|275d710c-222c0a89-d0b14b9c-343f6a1e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b5dda088-96397488-baef4942-2577e7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:38.203285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5dda088-96397488-baef4942-2577e7d_0] Write session: try to update token
2025-10-15T11:01:38.203359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5dda088-96397488-baef4942-2577e7d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:38.223532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:38.223571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:38.223610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402017865479661:9084]
2025-10-15T11:01:38.223734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:38.223741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:38.229588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:38.230858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:38.235762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:38.237444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:38.240499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:38.241081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:38.279250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:38.279291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:38.279317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:38.325126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId: src_id|b5dda088-96397488-baef4942-2577e7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:38.348515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:38.348551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:38.348564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:38.348573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:38.348606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402017865479661:9084]
2025-10-15T11:01:38.348628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402017865479661:9084]
2025-10-15T11:01:38.348649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402017865479661:9084]
2025-10-15T11:01:38.348769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:38.348775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:38.348795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:38.348802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:38.348826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:38.349792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:38.352740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:38.487156Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:38.488750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:38.488798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:38.489194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:38.489353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402015065789379:9630]
2025-10-15T11:01:38.489499Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:38.489429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:38.489447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:38.521873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 956 reason: error at write: Disconnected sessionId: src_id|b5dda088-96397488-baef4942-2577e7d_0
2025-10-15T11:01:38.522102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 956 sessionId: src_id|b5dda088-96397488-baef4942-2577e7d_0 is DEAD
2025-10-15T11:01:38.522678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5dda088-96397488-baef4942-2577e7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:38.522744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5dda088-96397488-baef4942-2577e7d_0] Write session will restart in 0.009851s
2025-10-15T11:01:38.522948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5dda088-96397488-baef4942-2577e7d_0] Write session: Do CDS request
2025-10-15T11:01:38.522986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5dda088-96397488-baef4942-2577e7d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:38.537234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:38.537271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 957
2025-10-15T11:01:38.538576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5dda088-96397488-baef4942-2577e7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:38.539085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:38.539229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:38.539261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:38.539275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:38.548454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 957 sessionId:  describe result for acl check
2025-10-15T11:01:38.548565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:38.548577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:38.548586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:38.548604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402015065789611:10157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:38.551058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402015065789611:10157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:38.566185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402015065789611:10157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:38.577362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402015065789611:10157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:38.577400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402015065789611:10157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:38.577417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402015065789611:10157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:38.577444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:38.589517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402015065789805:9630]
2025-10-15T11:01:38.610720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:38.612716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:38.613521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:38.613549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:38.613587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:38.613825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:38.614000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402017865479962:9089]
2025-10-15T11:01:38.616194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:38.617374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:38.617614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:38.618840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:38.619177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:38.619196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:38.619204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:38.619212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:38.619218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:38.619225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:38.619231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:38.619238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:38.619244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:38.619251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:38.619258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:38.619264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.619270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.619276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.619324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:38.619453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:38.619502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:38.619550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:38.619605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:38.619658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:38.619709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:38.619762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:38.619812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:38.619865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:38.619917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:38.619966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.620018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.620066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.620116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:38.620189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:38.620250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:38.620322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:38.620376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:38.620429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:38.620481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:38.620536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:38.620588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:38.620649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:38.620698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:38.620755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:38.620807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:38.620864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:38.620912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:38.620960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:38.621012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:38.621071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:38.621120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:38.621180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:38.621231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:38.621286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:38.621337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.621394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.621445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.621501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.621553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.621610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.622111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:38.640718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:38.653289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:38.653337Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:38.653353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:38.653369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:38.653395Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 956 [2:7561402017865479962:9089]
2025-10-15T11:01:38.653441Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:38.653494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:38.653506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:38.653517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:38.653528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:38.653573Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:38.653592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:38.653611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:38.655194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.655210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.655223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.655233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:38.655668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:38.655687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:38.655810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:38.655994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:38.656212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:38.656308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402015065789550:2467], now have 1 active actors on pipe
2025-10-15T11:01:38.656337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402015065789805:9630], now have 1 active actors on pipe
2025-10-15T11:01:38.656357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402015065789763:10157], now have 1 active actors on pipe
2025-10-15T11:01:38.656378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402017865479957:9089]
2025-10-15T11:01:38.656392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402017865479957:9089]
2025-10-15T11:01:38.656404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402017865479957:9089]
2025-10-15T11:01:38.656441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:38.656498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:38.656518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:38.656524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:38.656535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:38.656688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:38.656712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:38.656823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402017865479957:9089]
2025-10-15T11:01:38.656857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:38.656913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:38.657077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 956
2025-10-15T11:01:38.657160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 956, pipe: [1:7561402015065789805:9630]
2025-10-15T11:01:38.657236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 956
2025-10-15T11:01:38.657636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:38.657668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:38.657733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|236874ab-e322c2ef-6e70af65-406a672c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:38.657762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:38.657778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:38.657788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:38.657820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:38.657856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:38.657898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:38.658353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:38.658392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:38.658455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:38.658780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 957 partition: 0 MaxSeqNo: 46 sessionId: src_id|236874ab-e322c2ef-6e70af65-406a672c_0
2025-10-15T11:01:38.659595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5dda088-96397488-baef4942-2577e7d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|236874ab-e322c2ef-6e70af65-406a672c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:38.697425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|236874ab-e322c2ef-6e70af65-406a672c_0] Write session: try to update token
2025-10-15T11:01:38.697478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|236874ab-e322c2ef-6e70af65-406a672c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:38.766127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:38.766191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:38.766214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:38.766227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:38.766284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402017865479957:9089]
2025-10-15T11:01:38.766323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402017865479957:9089]
2025-10-15T11:01:38.766369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402017865479957:9089]
2025-10-15T11:01:38.766559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:38.766613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:38.766658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:38.766702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:38.766717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:38.766729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:38.766789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:38.766821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:38.769053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:38.802742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId: src_id|236874ab-e322c2ef-6e70af65-406a672c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:38.825659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:38.938704Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:38.953530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:38.953583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:38.953649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:38.953662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:38.953696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402017865479957:9089]
2025-10-15T11:01:38.953889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:38.954254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:38.954188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:38.954302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402015065789805:9630]
2025-10-15T11:01:38.954330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:38.954345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:38.990826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 957 reason: error at write: Disconnected sessionId: src_id|236874ab-e322c2ef-6e70af65-406a672c_0
2025-10-15T11:01:38.991181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 957 sessionId: src_id|236874ab-e322c2ef-6e70af65-406a672c_0 is DEAD
2025-10-15T11:01:38.991602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|236874ab-e322c2ef-6e70af65-406a672c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:38.991658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|236874ab-e322c2ef-6e70af65-406a672c_0] Write session will restart in 0.006845s
2025-10-15T11:01:38.991811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|236874ab-e322c2ef-6e70af65-406a672c_0] Write session: Do CDS request
2025-10-15T11:01:38.991855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|236874ab-e322c2ef-6e70af65-406a672c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:39.006390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|236874ab-e322c2ef-6e70af65-406a672c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:39.006321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:39.006350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 958
2025-10-15T11:01:39.007139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:39.007250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:39.007267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:39.007277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:39.009117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 958 sessionId:  describe result for acl check
2025-10-15T11:01:39.009295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:39.009325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:39.009347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:39.009378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402019360757173:10163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:39.013874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402019360757173:10163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:39.020960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402019360757173:10163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:39.027684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402019360757173:10163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:39.027719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402019360757173:10163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:39.027734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402019360757173:10163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:39.027762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:39.054435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402019360757257:9630]
2025-10-15T11:01:39.109230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:39.111662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:39.112506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:39.112544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:39.112585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:39.112856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:39.113079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402022160447593:9097]
2025-10-15T11:01:39.115119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:39.116090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:39.116316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:39.117444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:39.117780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:39.117803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:39.117810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:39.117816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:39.117822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:39.117829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:39.117835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:39.117841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:39.117847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:39.117854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:39.117860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:39.117866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.117872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.117879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.117927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:39.118024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:39.118068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:39.118114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:39.118154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:39.118211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:39.118260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:39.118307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:39.118355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:39.118403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:39.118453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:39.118501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.118548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.118595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.118644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:39.118712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:39.118769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:39.118825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:39.118877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:39.118932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:39.118979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:39.119033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:39.119081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:39.119138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:39.119186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:39.119241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:39.119288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:39.119340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:39.119410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:39.119465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:39.119520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:39.119575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:39.119624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:39.119679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:39.119725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:39.119772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:39.119813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.119870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.119920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.119979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.120026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.120080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.120560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:39.139083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:39.149228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:39.149294Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:39.149314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:39.149336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:39.149365Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 957 [2:7561402022160447593:9097]
2025-10-15T11:01:39.149424Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:39.149494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:39.149509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:39.149526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:39.149539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:39.149594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:39.149619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:39.149654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:39.150762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.150793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.150809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.150821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:39.151104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:39.151132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.151288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.151785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.151959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 957
2025-10-15T11:01:39.152045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 957, pipe: [1:7561402019360757257:9630]
2025-10-15T11:01:39.152128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 957
2025-10-15T11:01:39.152039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:39.152134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402019360757202:10163], now have 1 active actors on pipe
2025-10-15T11:01:39.152160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402019360757257:9630], now have 1 active actors on pipe
2025-10-15T11:01:39.152183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402015065789862:2467], now have 1 active actors on pipe
2025-10-15T11:01:39.152210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402022160447588:9097]
2025-10-15T11:01:39.152226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402022160447588:9097]
2025-10-15T11:01:39.152239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402022160447588:9097]
2025-10-15T11:01:39.152293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:39.152335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:39.152351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:39.152364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:39.152395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:39.152417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:39.152458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:39.152645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:39.152663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:39.152844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:39.152874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:39.152891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:39.152902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:39.152940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:39.152982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:39.153017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402022160447588:9097]
2025-10-15T11:01:39.153051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:39.153074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:39.153144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:39.153780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:39.153830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:39.153914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:39.155129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|236874ab-e322c2ef-6e70af65-406a672c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:39.154246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 958 partition: 0 MaxSeqNo: 46 sessionId: src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0
2025-10-15T11:01:39.177076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0] Write session: try to update token
2025-10-15T11:01:39.177146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:39.247613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:39.247647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:39.247680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402022160447588:9097]
2025-10-15T11:01:39.247827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:39.247857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:39.250317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:39.251591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:39.252968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:39.256395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:39.257922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:39.288505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId: src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:39.305241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:39.305282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:39.305293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:39.305352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:39.305490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:39.305517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:39.305530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:39.305539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:39.305578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402022160447588:9097]
2025-10-15T11:01:39.305603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402022160447588:9097]
2025-10-15T11:01:39.305625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402022160447588:9097]
2025-10-15T11:01:39.305779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:39.305808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:39.305822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:39.305900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:39.305937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:39.307019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:39.316208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:39.454907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:39.457009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:39.457058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:39.458777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:39.459746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:39.474427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 958 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0
2025-10-15T11:01:39.474801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 958 sessionId: src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0 is DEAD
2025-10-15T11:01:39.475919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:39.475980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0] Write session will restart in 0.009251s
2025-10-15T11:01:39.476136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0] Write session: Do CDS request
2025-10-15T11:01:39.476183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:39.489837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:39.491196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:39.491898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402019360757257:9630]
2025-10-15T11:01:39.492024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:39.492040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 959
2025-10-15T11:01:39.492444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:39.492570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:39.492586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:39.492595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:39.494018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 959 sessionId:  describe result for acl check
2025-10-15T11:01:39.494135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:39.494152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:39.494161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:39.494179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402019360757486:10173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:39.496443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402019360757486:10173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:39.505113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402019360757486:10173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:39.518736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402019360757486:10173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:39.518776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402019360757486:10173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:39.518794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402019360757486:10173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:39.518824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:39.592949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402019360757759:9630]
2025-10-15T11:01:39.594342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:39.602765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:39.603680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:39.603716Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:39.603760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:39.604038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:39.604233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402022160447882:9106]
2025-10-15T11:01:39.606439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:39.607666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:39.607948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:39.608928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:39.609170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:39.609175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:39.609181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:39.609186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:39.609191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:39.609195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:39.609200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:39.609205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:39.609210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:39.609214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:39.609219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:39.609224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.609230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.609235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.609269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:39.609365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:39.609401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:39.609439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:39.609473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:39.609521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:39.609561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:39.609596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:39.609631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:39.609666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:39.609701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:39.609733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.609774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.609811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.609851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:39.609902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:39.609946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:39.609986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:39.610020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:39.610057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:39.610087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:39.610126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:39.610160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:39.610200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:39.610230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:39.610277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:39.610310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:39.610357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:39.610390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:39.610428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:39.610461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:39.610516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:39.610547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:39.610596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:39.610633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:39.610677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:39.610716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.610755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.610799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.610841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.610890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.610932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.611315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:39.627470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:39.636860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:39.636913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:39.636931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:39.636952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:39.636976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 958 [2:7561402022160447882:9106]
2025-10-15T11:01:39.637032Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:39.637108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:39.637123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:39.637136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:39.637148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:39.637201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:39.637228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:39.637261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:39.638733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.638755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.638768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.638781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:39.639052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:39.639076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:39.639190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:39.639335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:39.639458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 958
2025-10-15T11:01:39.639560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 958
2025-10-15T11:01:39.639568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:39.639637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402019360757481:2467], now have 1 active actors on pipe
2025-10-15T11:01:39.639632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 958, pipe: [1:7561402019360757759:9630]
2025-10-15T11:01:39.639658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402019360757759:9630], now have 1 active actors on pipe
2025-10-15T11:01:39.639673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402019360757528:10173], now have 1 active actors on pipe
2025-10-15T11:01:39.639692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402022160447877:9106]
2025-10-15T11:01:39.639704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402022160447877:9106]
2025-10-15T11:01:39.639713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402022160447877:9106]
2025-10-15T11:01:39.639733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:39.639775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:39.639784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:39.639797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:39.639810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:39.639973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:39.639998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:39.640041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:39.640055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:39.640184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402022160447877:9106]
2025-10-15T11:01:39.640208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:39.640259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:39.640258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:39.640309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:39.640327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:39.640337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:39.640374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:39.640413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:39.640549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:39.641282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:39.641320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:39.641387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:39.644749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 959 partition: 0 MaxSeqNo: 46 sessionId: src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0
2025-10-15T11:01:39.645302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de0b78bf-dfde7462-613e9ed8-f30a9ecd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:39.680704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0] Write session: try to update token
2025-10-15T11:01:39.680759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:39.712063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:39.712091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:39.712120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402022160447877:9106]
2025-10-15T11:01:39.712259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:39.712759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:39.716446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:39.718047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:39.719780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:39.722829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:39.729484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:39.767561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:39.767715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:39.767734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:39.767744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:39.767793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:39.767812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:39.767824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:39.767836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:39.767869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402022160447877:9106]
2025-10-15T11:01:39.767895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402022160447877:9106]
2025-10-15T11:01:39.767919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402022160447877:9106]
2025-10-15T11:01:39.768038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:39.768043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:39.768069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:39.768076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:39.768108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:39.769351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:39.788159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId: src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:39.811019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:39.906753Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:39.908192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:39.908236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:39.908931Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:39.909062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:39.909111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402019360757759:9630]
2025-10-15T11:01:39.909210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:39.909234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:39.950845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 959 reason: error at write: Disconnected sessionId: src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0
2025-10-15T11:01:39.951194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 959 sessionId: src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0 is DEAD
2025-10-15T11:01:39.951596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:39.951653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0] Write session will restart in 0.007707s
2025-10-15T11:01:39.951826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0] Write session: Do CDS request
2025-10-15T11:01:39.951869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:39.969251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:39.969300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 960
2025-10-15T11:01:39.972015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:39.974559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:39.974723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:39.974740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:39.974751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:39.977564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 960 sessionId:  describe result for acl check
2025-10-15T11:01:39.977683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:39.977698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:39.977707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:39.977726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402019360757838:10183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:39.980771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402019360757838:10183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:39.988160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402019360757838:10183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:40.002044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402019360757838:10183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:40.002086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402019360757838:10183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:40.002104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402019360757838:10183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:40.002136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:40.007488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402023655725245:9630]
2025-10-15T11:01:40.043509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:40.047944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:40.048928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:40.048962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:40.049010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:40.049304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:40.049529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402026455415491:9110]
2025-10-15T11:01:40.051792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:40.052867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:40.053102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:40.054416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:40.054744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.054753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.054761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.054769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.054779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.054786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.054793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.054801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.054808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.054816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.054823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.054830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.054837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.054844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.054892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.055015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.055064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.055115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.055165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.055218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.055268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.055322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.055395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.055448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.055503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.055555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.055600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.055650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.055706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.055777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.055843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.055902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.055951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.056008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.056059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.056119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.056171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.056225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.056309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.056372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.056423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.056487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.056538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.056597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.056650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.056710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.056754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.056809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.056858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.056911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.056957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.057009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.057058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.057110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.057156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.057212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.057766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:40.084008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:40.098578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:40.098641Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:40.098659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:40.098681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:40.098712Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 959 [2:7561402026455415491:9110]
2025-10-15T11:01:40.098770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:40.098840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:40.098857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:40.098870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:40.098883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:40.098946Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:40.098971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:40.098997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:40.100065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.100096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.100112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.100124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:40.100420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:40.100449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.100601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.100807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.101058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:40.101145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402026455415486:9110]
2025-10-15T11:01:40.101160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402026455415486:9110]
2025-10-15T11:01:40.101175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402026455415486:9110]
2025-10-15T11:01:40.101221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:40.101304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:40.101506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:40.101524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:40.101652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402026455415486:9110]
2025-10-15T11:01:40.101672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:40.102030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402019360757786:2467], now have 1 active actors on pipe
2025-10-15T11:01:40.102075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402023655725245:9630], now have 1 active actors on pipe
2025-10-15T11:01:40.102108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402019360757919:10183], now have 1 active actors on pipe
2025-10-15T11:01:40.102291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:40.102321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:40.102333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:40.102359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:40.102833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 959
2025-10-15T11:01:40.102846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 959, pipe: [1:7561402023655725245:9630]
2025-10-15T11:01:40.102948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 959
2025-10-15T11:01:40.103138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:40.103177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:40.103259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:40.103312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:40.103366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:40.103383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:40.103427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:40.103475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:40.103536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:40.104550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:40.104584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:40.104658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:40.104913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 960 partition: 0 MaxSeqNo: 46 sessionId: src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0
2025-10-15T11:01:40.105699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6835de6b-190e7d-d514a1ed-a2113bf6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:40.130747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0] Write session: try to update token
2025-10-15T11:01:40.130805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:40.193558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:40.193599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:40.193636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402026455415486:9110]
2025-10-15T11:01:40.193776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:40.193778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:40.199496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:40.204915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:40.206288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:40.208010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:40.210639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:40.211062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:40.211091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:40.211101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:40.211163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:40.262853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:40.262890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:40.262901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:40.262909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:40.262940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402026455415486:9110]
2025-10-15T11:01:40.262966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402026455415486:9110]
2025-10-15T11:01:40.262984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402026455415486:9110]
2025-10-15T11:01:40.263099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:40.263119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:40.263207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:40.263234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:40.263251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:40.270530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId: src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:40.271494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:40.293760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:40.416305Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:40.421026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:40.421081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:40.421847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402023655725245:9630]
2025-10-15T11:01:40.421958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:40.421970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:40.423983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:40.422534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:40.430975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:40.431038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0] Write session will restart in 0.006148s
2025-10-15T11:01:40.431200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0] Write session: Do CDS request
2025-10-15T11:01:40.431250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:40.430216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 960 reason: error at write: Disconnected sessionId: src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0
2025-10-15T11:01:40.430552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 960 sessionId: src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0 is DEAD
2025-10-15T11:01:40.445762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:40.445808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 961
2025-10-15T11:01:40.445949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:40.446445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:40.446590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:40.446613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:40.446623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:40.447902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 961 sessionId:  describe result for acl check
2025-10-15T11:01:40.448013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:40.448029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:40.448039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:40.448057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402023655725409:10188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:40.451340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402023655725409:10188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:40.461727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402023655725409:10188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:40.469256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402023655725409:10188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:40.469297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402023655725409:10188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:40.469313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402023655725409:10188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:40.469346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:40.522026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402023655725595:9630]
2025-10-15T11:01:40.548515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:40.560429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:40.561343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:40.561364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:40.561408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:40.561677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:40.561852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402026455415797:9120]
2025-10-15T11:01:40.564341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:40.565450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:40.565696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:40.566913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:40.567252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.567260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.567267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.567275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.567282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.567290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.567298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.567306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.567313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.567320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.567327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.567334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.567340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.567365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.567413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.567505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.567541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.567573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.567609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.567643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.567674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.567712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.567745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.567781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.567819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.567859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.567894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.567934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.567971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.568033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.568091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.568146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.568194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.568250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.568308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.568362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.568412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.568461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.568495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.568545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.568594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.568651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.568702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.568760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.568819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.568874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.568920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.568976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.569024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.569078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.569124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.569178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.569229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.569284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.569328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.569381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.569905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:40.588526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:40.599312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:40.599385Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:40.599405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:40.599426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:40.599453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 960 [2:7561402026455415797:9120]
2025-10-15T11:01:40.599511Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:40.599576Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:40.599599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:40.599612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:40.599624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:40.599690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:40.599722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:40.599750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:40.601520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 960
2025-10-15T11:01:40.601628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 960, pipe: [1:7561402023655725595:9630]
2025-10-15T11:01:40.601708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 960
2025-10-15T11:01:40.600871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.600903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.600919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.600931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:40.601215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:40.601234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.601385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.601586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.601829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:40.601913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402023655725400:2467], now have 1 active actors on pipe
2025-10-15T11:01:40.601941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402023655725595:9630], now have 1 active actors on pipe
2025-10-15T11:01:40.601966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402023655725442:10188], now have 1 active actors on pipe
2025-10-15T11:01:40.602036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:40.602059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:40.602098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402026455415792:9120]
2025-10-15T11:01:40.602114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402026455415792:9120]
2025-10-15T11:01:40.602126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402026455415792:9120]
2025-10-15T11:01:40.602172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:40.602211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:40.602229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:40.602242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:40.602251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:40.602441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:40.602459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:40.602527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86595de0-dc0424ee-3f751237-49c827ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:40.602558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:40.602578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:40.602592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:40.602629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:40.602672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:40.602805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402026455415792:9120]
2025-10-15T11:01:40.602840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:40.602888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:40.602886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:40.603834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:40.603865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:40.603934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:40.604235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 961 partition: 0 MaxSeqNo: 46 sessionId: src_id|86595de0-dc0424ee-3f751237-49c827ae_0
2025-10-15T11:01:40.605024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a47d5c1f-ff3d5b07-e70e544d-e7df6b97_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|86595de0-dc0424ee-3f751237-49c827ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:40.624866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86595de0-dc0424ee-3f751237-49c827ae_0] Write session: try to update token
2025-10-15T11:01:40.624931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86595de0-dc0424ee-3f751237-49c827ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:40.683971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:40.684015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:40.684028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:40.684038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:40.684075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402026455415792:9120]
2025-10-15T11:01:40.684106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402026455415792:9120]
2025-10-15T11:01:40.684128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402026455415792:9120]
2025-10-15T11:01:40.684312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:40.684308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:40.684334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:40.684347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:40.684376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:40.688489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:40.741424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId: src_id|86595de0-dc0424ee-3f751237-49c827ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:40.763201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:40.832153Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:40.846968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:40.847013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:40.847789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:40.848027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402023655725595:9630]
2025-10-15T11:01:40.848160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:40.848179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:40.851262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:40.863135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 961 reason: error at write: Disconnected sessionId: src_id|86595de0-dc0424ee-3f751237-49c827ae_0
2025-10-15T11:01:40.863518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 961 sessionId: src_id|86595de0-dc0424ee-3f751237-49c827ae_0 is DEAD
2025-10-15T11:01:40.863892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86595de0-dc0424ee-3f751237-49c827ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:40.863941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86595de0-dc0424ee-3f751237-49c827ae_0] Write session will restart in 0.008399s
2025-10-15T11:01:40.864072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86595de0-dc0424ee-3f751237-49c827ae_0] Write session: Do CDS request
2025-10-15T11:01:40.864133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86595de0-dc0424ee-3f751237-49c827ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:40.877413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:40.877511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86595de0-dc0424ee-3f751237-49c827ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:40.877442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 962
2025-10-15T11:01:40.878103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:40.878206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:40.878224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:40.878233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:40.879325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 962 sessionId:  describe result for acl check
2025-10-15T11:01:40.879437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:40.879452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:40.879460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:40.879475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402023655725728:10198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:40.881646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402023655725728:10198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:40.887569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402023655725728:10198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:40.894485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402023655725728:10198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:40.894525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402023655725728:10198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:40.894540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402023655725728:10198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:40.894565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:40.942063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:40.943641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:40.944349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:40.944379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:40.944415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:40.944627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:40.944803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402026455416106:9127]
2025-10-15T11:01:40.946905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:40.947740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:40.947949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:40.948335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402023655726002:9630]
2025-10-15T11:01:40.949142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:40.949457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.949486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.949493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.949499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.949505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.949511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.949518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.949525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.949531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.949538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.949544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.949551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.949558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.949563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.949605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.949699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.949743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.949786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.949828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.949870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.949910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.949964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.950023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.950066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.950116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.950163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.950213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.950262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.950310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.950382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:40.950445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.950507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:40.950564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.950618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:40.950662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.950710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:40.950755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.950822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:40.950864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.950913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:40.950955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.951005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:40.951047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.951096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:40.951142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.951208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:40.951256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.951309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:40.951382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.951436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:40.951478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.951529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.951573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.951626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.951669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.951718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.952200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:40.967091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:40.977098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:40.977151Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:40.977167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:40.977183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:40.977208Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 961 [2:7561402026455416106:9127]
2025-10-15T11:01:40.977255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:40.977310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:40.977324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:40.977335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:40.977345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:40.977391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:40.977412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:40.977431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:40.979092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.979119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.979131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.979141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:40.979418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:40.979449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:40.979600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:40.979856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:40.980088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:40.980164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402023655726002:9630], now have 1 active actors on pipe
2025-10-15T11:01:40.980193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402023655725765:10198], now have 1 active actors on pipe
2025-10-15T11:01:40.980212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402023655725713:2467], now have 1 active actors on pipe
2025-10-15T11:01:40.980233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402026455416101:9127]
2025-10-15T11:01:40.980247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402026455416101:9127]
2025-10-15T11:01:40.980259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402026455416101:9127]
2025-10-15T11:01:40.980305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:40.980340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:40.980355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:40.980366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:40.980367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:40.980596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:40.980631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:40.980757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402026455416101:9127]
2025-10-15T11:01:40.980788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:40.980825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:40.981131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 961, pipe: [1:7561402023655726002:9630]
2025-10-15T11:01:40.981223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 961
2025-10-15T11:01:40.981292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 961
2025-10-15T11:01:40.981402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:40.981452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:40.981536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:40.981578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:40.981596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:40.981611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:40.981655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:40.981705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:40.981774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:40.982431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:40.982458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:40.982525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:40.983248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 962 partition: 0 MaxSeqNo: 46 sessionId: src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0
2025-10-15T11:01:40.984029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86595de0-dc0424ee-3f751237-49c827ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:41.010892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0] Write session: try to update token
2025-10-15T11:01:41.010959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:41.015583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:41.015619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:41.015650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402026455416101:9127]
2025-10-15T11:01:41.015757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:41.015772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:41.018250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:41.019865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:41.021683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:41.023286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:41.025082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:41.025658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:41.095768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:41.095804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:41.095815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:41.095910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:41.095926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:41.095942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:41.095959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:41.096003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402026455416101:9127]
2025-10-15T11:01:41.096030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402026455416101:9127]
2025-10-15T11:01:41.096066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402026455416101:9127]
2025-10-15T11:01:41.096148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:41.096194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:41.096215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:41.096222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:41.096238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:41.098581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:41.106255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId: src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:41.130083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:41.238393Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:41.239553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:41.239588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:41.240033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:41.240048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402023655726002:9630]
2025-10-15T11:01:41.240141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:41.240161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:41.240141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:41.247767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 962 reason: error at write: Disconnected sessionId: src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0
2025-10-15T11:01:41.248121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 962 sessionId: src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0 is DEAD
2025-10-15T11:01:41.248522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:41.248569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0] Write session will restart in 0.006220s
2025-10-15T11:01:41.248743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0] Write session: Do CDS request
2025-10-15T11:01:41.248799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:41.259373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:41.259412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 963
2025-10-15T11:01:41.259507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:41.259976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:41.260111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:41.260131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:41.260140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:41.261380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 963 sessionId:  describe result for acl check
2025-10-15T11:01:41.261485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:41.261501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:41.261510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:41.261527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402027950693349:10207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:41.263981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402027950693349:10207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:41.275616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402027950693349:10207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:41.285940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402027950693349:10207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:41.285982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402027950693349:10207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:41.286000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402027950693349:10207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:41.286030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:41.340547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402027950693637:9630]
2025-10-15T11:01:41.341482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:41.343451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:41.344346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:41.344385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:41.344430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:41.344693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:41.344887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402030750383720:9133]
2025-10-15T11:01:41.347139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:41.348022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:41.348232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:41.349538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:41.349873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:41.349892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:41.349901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:41.349908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:41.349915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:41.349923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:41.349930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:41.349938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:41.349945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:41.349952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:41.349960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:41.349967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.349975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.349982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.350028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:41.350145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:41.350194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:41.350244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:41.350299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:41.350351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:41.350402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:41.350455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:41.350506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:41.350555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:41.350608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:41.350658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.350714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.350762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.350814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:41.350886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:41.350953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:41.351015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:41.351068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:41.351127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:41.351178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:41.351237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:41.351292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:41.351378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:41.351444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:41.351513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:41.351568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:41.351626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:41.351677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:41.351738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:41.351792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:41.351853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:41.351904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:41.351965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:41.352014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:41.352070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:41.352124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.352181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.352234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.352292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.352352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.352409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.352923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:41.370188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:41.381900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:41.381961Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:41.381981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:41.382004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:41.382032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 962 [2:7561402030750383720:9133]
2025-10-15T11:01:41.382093Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:41.382159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:41.382176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:41.382190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:41.382203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:41.382257Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:41.382284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:41.382314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:41.383394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.383421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.383436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.383449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:41.383713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:41.383739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.383891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.384108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.384091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 962
2025-10-15T11:01:41.384077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 962, pipe: [1:7561402027950693637:9630]
2025-10-15T11:01:41.384210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 962
2025-10-15T11:01:41.384363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:41.384452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402027950693338:2467], now have 1 active actors on pipe
2025-10-15T11:01:41.384483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402027950693637:9630], now have 1 active actors on pipe
2025-10-15T11:01:41.384507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402027950693402:10207], now have 1 active actors on pipe
2025-10-15T11:01:41.384555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402030750383715:9133]
2025-10-15T11:01:41.384574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402030750383715:9133]
2025-10-15T11:01:41.384590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402030750383715:9133]
2025-10-15T11:01:41.384627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:41.384668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:41.384693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:41.384706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:41.384718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:41.384741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:41.384787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:41.384981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:41.385005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:41.385166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:41.385204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:41.385227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:41.385238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:41.385284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:41.385331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:41.385373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402030750383715:9133]
2025-10-15T11:01:41.385403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:41.385443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:41.385494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:41.385904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:41.385932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:41.385995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:41.386328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 963 partition: 0 MaxSeqNo: 46 sessionId: src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0
2025-10-15T11:01:41.387111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6c9e835-52c3f5cc-890c3484-2b7fe69_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:41.407828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0] Write session: try to update token
2025-10-15T11:01:41.407897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:41.477726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:41.477758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:41.477768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:41.477775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:41.477807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402030750383715:9133]
2025-10-15T11:01:41.477835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402030750383715:9133]
2025-10-15T11:01:41.477855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402030750383715:9133]
2025-10-15T11:01:41.477967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:41.477998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:41.478022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:41.478090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:41.478128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:41.479927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:41.483041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId: src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:41.502681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:41.620782Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:41.654965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:41.655009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:41.655060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:41.655070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:41.655108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402030750383715:9133]
2025-10-15T11:01:41.655302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:41.655684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:41.655655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:41.655691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402027950693637:9630]
2025-10-15T11:01:41.655778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:41.655790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:41.673432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 963 reason: error at write: Disconnected sessionId: src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0
2025-10-15T11:01:41.673779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 963 sessionId: src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0 is DEAD
2025-10-15T11:01:41.674181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:41.674237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0] Write session will restart in 0.005496s
2025-10-15T11:01:41.674401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0] Write session: Do CDS request
2025-10-15T11:01:41.674444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:41.684384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:41.684411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 964
2025-10-15T11:01:41.684526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:41.685079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:41.685186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:41.685199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:41.685211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:41.686550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 964 sessionId:  describe result for acl check
2025-10-15T11:01:41.686647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:41.686668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:41.686677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:41.686694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402027950693668:10211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:41.691220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402027950693668:10211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:41.697797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402027950693668:10211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:41.709592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402027950693668:10211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:41.709637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402027950693668:10211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:41.709654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402027950693668:10211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:41.709688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:41.755768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402027950693941:9630]
2025-10-15T11:01:41.766069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:41.767851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:41.768746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:41.768777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:41.768820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:41.769073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:41.769283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402030750384029:9141]
2025-10-15T11:01:41.771584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:41.772483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:41.772705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:41.774075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:41.774444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:41.774461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:41.774469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:41.774477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:41.774485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:41.774492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:41.774500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:41.774507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:41.774515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:41.774522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:41.774530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:41.774537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.774545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.774551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.774601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:41.774719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:41.774773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:41.774823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:41.774882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:41.774940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:41.774994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:41.775052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:41.775105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:41.775161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:41.775213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:41.775266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.775313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.775384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.775436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:41.775516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:41.775588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:41.775646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:41.775709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:41.775771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:41.775823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:41.775885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:41.775946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:41.776004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:41.776058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:41.776121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:41.776177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:41.776243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:41.776292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:41.776373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:41.776431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:41.776494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:41.776550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:41.776616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:41.776671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:41.776733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:41.776787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.776849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.776904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.776967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.777023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.777086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.777649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:41.794191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:41.804339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:41.804393Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:41.804412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:41.804431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:41.804459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 963 [2:7561402030750384029:9141]
2025-10-15T11:01:41.804515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:41.804580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:41.804594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:41.804607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:41.804619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:41.804670Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:41.804694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:41.804716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:41.806485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.806516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.806530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.806541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:41.806839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:41.806869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:41.807030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:41.807175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 963, pipe: [1:7561402027950693941:9630]
2025-10-15T11:01:41.807236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:41.807179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 963
2025-10-15T11:01:41.807254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 963
2025-10-15T11:01:41.807504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:41.807597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402027950693941:9630], now have 1 active actors on pipe
2025-10-15T11:01:41.807629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402027950693720:10211], now have 1 active actors on pipe
2025-10-15T11:01:41.807659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402027950693653:2467], now have 1 active actors on pipe
2025-10-15T11:01:41.807729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:41.807757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:41.807795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402030750384024:9141]
2025-10-15T11:01:41.807816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402030750384024:9141]
2025-10-15T11:01:41.807830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402030750384024:9141]
2025-10-15T11:01:41.807867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:41.807911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:41.807932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:41.807940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:41.807946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:41.808139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:41.808166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:41.808242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd1bce9b-afe165af-543a3843-851303dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:41.808279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:41.808302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:41.808326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:41.808365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:41.808411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:41.808542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402030750384024:9141]
2025-10-15T11:01:41.808573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:41.808612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:41.808620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:41.809020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:41.809050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:41.809121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:41.809336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 964 partition: 0 MaxSeqNo: 46 sessionId: src_id|dd1bce9b-afe165af-543a3843-851303dc_0
2025-10-15T11:01:41.810101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa5640be-5889bc5f-e801e2fe-9ae6d3a7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dd1bce9b-afe165af-543a3843-851303dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:41.834062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1bce9b-afe165af-543a3843-851303dc_0] Write session: try to update token
2025-10-15T11:01:41.834126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1bce9b-afe165af-543a3843-851303dc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:41.868506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:41.868567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:41.868588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:41.868612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:41.868663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402030750384024:9141]
2025-10-15T11:01:41.868705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402030750384024:9141]
2025-10-15T11:01:41.868747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402030750384024:9141]
2025-10-15T11:01:41.868888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:41.868955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:41.868994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:41.868994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:41.869029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:41.872334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:41.921994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId: src_id|dd1bce9b-afe165af-543a3843-851303dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:41.943490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:42.012540Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:42.061497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:42.061549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:42.061611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:42.061623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:42.061660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402030750384024:9141]
2025-10-15T11:01:42.062180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:42.062203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:42.062446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402027950693941:9630]
2025-10-15T11:01:42.062547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:42.063498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:42.086318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 964 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dd1bce9b-afe165af-543a3843-851303dc_0
2025-10-15T11:01:42.086704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 964 sessionId: src_id|dd1bce9b-afe165af-543a3843-851303dc_0 is DEAD
2025-10-15T11:01:42.087169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1bce9b-afe165af-543a3843-851303dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:42.087247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1bce9b-afe165af-543a3843-851303dc_0] Write session will restart in 0.007171s
2025-10-15T11:01:42.087426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1bce9b-afe165af-543a3843-851303dc_0] Write session: Do CDS request
2025-10-15T11:01:42.087475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1bce9b-afe165af-543a3843-851303dc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:42.101184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1bce9b-afe165af-543a3843-851303dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:42.104116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:42.104159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 965
2025-10-15T11:01:42.105621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:42.105777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:42.105800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:42.105811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:42.108772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 965 sessionId:  describe result for acl check
2025-10-15T11:01:42.108888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:42.108900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:42.108908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:42.108925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402032245661291:10219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:42.111338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402032245661291:10219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:42.119696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402032245661291:10219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:42.132206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402032245661291:10219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:42.132250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402032245661291:10219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:42.132267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402032245661291:10219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:42.132298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:42.162831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402032245661514:9630]
2025-10-15T11:01:42.193252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:42.197106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:42.197992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:42.198021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:42.198066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:42.198317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:42.198512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402035045351652:9149]
2025-10-15T11:01:42.200739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:42.201651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:42.201868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:42.202995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:42.203317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:42.203338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:42.203366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:42.203373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:42.203380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:42.203387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:42.203394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:42.203400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:42.203406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:42.203412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:42.203419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:42.203426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.203433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.203440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.203481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:42.203576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:42.203621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:42.203663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:42.203703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:42.203747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:42.203797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:42.203838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:42.203890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:42.203941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:42.203991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:42.204036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.204079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.204126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.204174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:42.204233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:42.204285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:42.204346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:42.204390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:42.204447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:42.204488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:42.204535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:42.204580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:42.204627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:42.204665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:42.204715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:42.204759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:42.204807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:42.204874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:42.204927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:42.204970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:42.205016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:42.205057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:42.205111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:42.205150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:42.205229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:42.205271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.205321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.205362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.205411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.205450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.205496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.205976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:42.226145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:42.237938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:42.237986Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:42.238001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:42.238018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:42.238040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 964 [2:7561402035045351652:9149]
2025-10-15T11:01:42.238086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:42.238137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:42.238150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:42.238159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:42.238169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:42.238210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:42.238229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:42.238248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:42.240601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 964, pipe: [1:7561402032245661514:9630]
2025-10-15T11:01:42.240711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 964
2025-10-15T11:01:42.240784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 964
2025-10-15T11:01:42.239872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.239899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.239910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.239921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:42.240166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:42.240182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.240301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.240471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.240664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:42.240738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402032245661514:9630], now have 1 active actors on pipe
2025-10-15T11:01:42.240759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402032245661271:2467], now have 1 active actors on pipe
2025-10-15T11:01:42.240779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402032245661351:10219], now have 1 active actors on pipe
2025-10-15T11:01:42.240802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402035045351647:9149]
2025-10-15T11:01:42.240815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402035045351647:9149]
2025-10-15T11:01:42.240826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402035045351647:9149]
2025-10-15T11:01:42.240869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:42.240924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:42.240935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:42.240939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:42.240950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:42.241088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:42.241104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:42.241207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402035045351647:9149]
2025-10-15T11:01:42.241232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:42.241243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:42.241296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:42.241313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:42.241440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28f230b4-960a671a-6134679e-15148291_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:42.241467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:42.241482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:42.241491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:42.241519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:42.241552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:42.241618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:42.242138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:42.242158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:42.242219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:42.242567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 965 partition: 0 MaxSeqNo: 46 sessionId: src_id|28f230b4-960a671a-6134679e-15148291_0
2025-10-15T11:01:42.243426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd1bce9b-afe165af-543a3843-851303dc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|28f230b4-960a671a-6134679e-15148291_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:42.264540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f230b4-960a671a-6134679e-15148291_0] Write session: try to update token
2025-10-15T11:01:42.264615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f230b4-960a671a-6134679e-15148291_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:42.378743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId: src_id|28f230b4-960a671a-6134679e-15148291_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:42.381159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:42.381191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:42.381202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:42.381212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:42.381241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402035045351647:9149]
2025-10-15T11:01:42.381264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402035045351647:9149]
2025-10-15T11:01:42.381286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402035045351647:9149]
2025-10-15T11:01:42.381495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:42.381507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:42.381518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:42.381565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:42.381583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:42.381671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:42.381694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:42.381719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:42.385999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:42.421750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:42.530760Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:42.547314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:42.547397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:42.547451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:42.547463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:42.547877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402032245661514:9630]
2025-10-15T11:01:42.547951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:42.548045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:42.548065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:42.547498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402035045351647:9149]
2025-10-15T11:01:42.547689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:42.548022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:42.591125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f230b4-960a671a-6134679e-15148291_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:42.591185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f230b4-960a671a-6134679e-15148291_0] Write session will restart in 0.007244s
2025-10-15T11:01:42.591332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f230b4-960a671a-6134679e-15148291_0] Write session: Do CDS request
2025-10-15T11:01:42.591385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f230b4-960a671a-6134679e-15148291_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:42.590469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 965 reason: error at write: Disconnected sessionId: src_id|28f230b4-960a671a-6134679e-15148291_0
2025-10-15T11:01:42.590764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 965 sessionId: src_id|28f230b4-960a671a-6134679e-15148291_0 is DEAD
2025-10-15T11:01:42.604758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28f230b4-960a671a-6134679e-15148291_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:42.608152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:42.608203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 966
2025-10-15T11:01:42.608672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:42.608850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:42.608877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:42.608899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:42.610911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 966 sessionId:  describe result for acl check
2025-10-15T11:01:42.611043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:42.611059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:42.611082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:42.611110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402032245661665:10230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:42.614512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402032245661665:10230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:42.622326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402032245661665:10230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:42.634232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402032245661665:10230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:42.634272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402032245661665:10230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:42.634287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402032245661665:10230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:42.634314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:42.648200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402032245661803:9630]
2025-10-15T11:01:42.703111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:42.707682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:42.708479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:42.708512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:42.708551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:42.708779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:42.708946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402035045351957:9154]
2025-10-15T11:01:42.711024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:42.712184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:42.712382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:42.713543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:42.713843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:42.713851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:42.713858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:42.713866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:42.713872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:42.713878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:42.713884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:42.713891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:42.713897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:42.713904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:42.713911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:42.713918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.713924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.713930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.713973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:42.714072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:42.714118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:42.714164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:42.714205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:42.714248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:42.714290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:42.714334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:42.714377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:42.714424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:42.714468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:42.714510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.714554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.714601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.714641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:42.714707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:42.714762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:42.714813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:42.714858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:42.714908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:42.714951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:42.715002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:42.715050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:42.715101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:42.715143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:42.715190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:42.715233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:42.715287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:42.715330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:42.716229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:42.716293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:42.716363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:42.716407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:42.716457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:42.716504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:42.716554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:42.716595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.716648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.716692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.716741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.716782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.716832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.717324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:42.736236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:42.747085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:42.749606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 965
2025-10-15T11:01:42.749726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 965
2025-10-15T11:01:42.749806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 965, pipe: [1:7561402032245661803:9630]
2025-10-15T11:01:42.747413Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:42.747441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:42.747459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:42.747482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 965 [2:7561402035045351957:9154]
2025-10-15T11:01:42.747530Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:42.747584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:42.747597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:42.747608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:42.747620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:42.747662Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:42.747683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:42.747702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:42.748797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.748814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.748829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.748844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:42.749093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:42.749111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:42.749243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:42.749425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:42.749681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:42.749756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402032245661761:10230], now have 1 active actors on pipe
2025-10-15T11:01:42.749782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402032245661608:2467], now have 1 active actors on pipe
2025-10-15T11:01:42.749805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402032245661803:9630], now have 1 active actors on pipe
2025-10-15T11:01:42.749829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402035045351952:9154]
2025-10-15T11:01:42.749844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402035045351952:9154]
2025-10-15T11:01:42.749858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402035045351952:9154]
2025-10-15T11:01:42.749896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:42.749981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:42.750002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:42.750044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:42.750213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:42.750229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:42.750361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:42.750387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:42.750404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:42.750414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:42.750444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:42.750477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:42.750507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402035045351952:9154]
2025-10-15T11:01:42.750526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:42.750600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:42.751550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:42.751579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:42.751590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:42.751611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:42.752449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:42.752476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:42.752539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:42.752915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 966 partition: 0 MaxSeqNo: 46 sessionId: src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0
2025-10-15T11:01:42.759620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28f230b4-960a671a-6134679e-15148291_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:42.792317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0] Write session: try to update token
2025-10-15T11:01:42.792395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:42.878321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:42.878391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:42.878420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:42.878440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:42.878492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402035045351952:9154]
2025-10-15T11:01:42.878540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402035045351952:9154]
2025-10-15T11:01:42.878580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402035045351952:9154]
2025-10-15T11:01:42.878879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:42.878903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:42.878923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:42.878987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:42.879029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:42.879235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:42.879295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:42.879342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:42.881641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:42.927651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId: src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:42.950710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:43.021376Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:43.062734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:43.062782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:43.062846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:43.062860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:43.062896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402035045351952:9154]
2025-10-15T11:01:43.063069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:43.063766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:43.065182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:43.065414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402032245661803:9630]
2025-10-15T11:01:43.065544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:43.065570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:43.074439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 966 reason: error at write: Disconnected sessionId: src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0
2025-10-15T11:01:43.074732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 966 sessionId: src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0 is DEAD
2025-10-15T11:01:43.075913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:43.075954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0] Write session will restart in 0.006116s
2025-10-15T11:01:43.076078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0] Write session: Do CDS request
2025-10-15T11:01:43.076112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:43.092421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:43.092450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 967
2025-10-15T11:01:43.094350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:43.094937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:43.095056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:43.095076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:43.095086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:43.096387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 967 sessionId:  describe result for acl check
2025-10-15T11:01:43.096509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:43.096529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:43.096538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:43.096555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402036540629234:10236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:43.103490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402036540629234:10236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:43.115529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402036540629234:10236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:43.122931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402036540629234:10236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:43.122971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402036540629234:10236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:43.122989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402036540629234:10236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:43.123019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:43.165952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402036540629406:9630]
2025-10-15T11:01:43.192923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:43.199922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:43.200802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:43.200832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:43.200875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:43.201140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:43.201336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402039340319580:9157]
2025-10-15T11:01:43.203085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:43.206950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:43.207214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:43.208525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:43.208822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:43.208827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:43.208832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:43.208837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:43.208841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:43.208845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:43.208851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:43.208855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:43.208860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:43.208866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:43.208873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:43.208881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.208888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.208894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.208928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:43.209028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:43.209075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:43.209112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:43.209158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:43.209201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:43.209234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:43.209268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:43.209302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:43.209338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:43.209375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:43.209417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.209454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.209501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.209531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:43.209598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:43.209647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:43.209702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:43.209738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:43.209778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:43.209810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:43.209850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:43.209883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:43.209932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:43.209969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:43.210016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:43.210048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:43.210102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:43.210136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:43.210190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:43.210231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:43.210271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:43.210303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:43.211249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:43.211320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:43.211400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:43.211455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.211519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.211573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.211636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.211681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.211739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.212176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:43.244566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:43.255215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:43.255269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:43.255286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:43.255309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:43.255334Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 966 [2:7561402039340319580:9157]
2025-10-15T11:01:43.255593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:43.255665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:43.255680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:43.255694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:43.255706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:43.255759Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:43.255783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:43.255807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:43.257665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.257690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.257705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.257718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:43.257994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:43.258017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.258161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.258317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 966
2025-10-15T11:01:43.258399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 966, pipe: [1:7561402036540629406:9630]
2025-10-15T11:01:43.258401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 966
2025-10-15T11:01:43.258359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.258602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:43.258684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402036540629270:10236], now have 1 active actors on pipe
2025-10-15T11:01:43.258709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402036540629227:2467], now have 1 active actors on pipe
2025-10-15T11:01:43.258732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402036540629406:9630], now have 1 active actors on pipe
2025-10-15T11:01:43.258781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:43.258799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:43.258849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402039340319574:9157]
2025-10-15T11:01:43.258865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402039340319574:9157]
2025-10-15T11:01:43.258879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402039340319574:9157]
2025-10-15T11:01:43.258917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:43.258970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:43.258984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:43.258990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:43.258996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:43.259191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:43.259208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:43.259273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|257a558d-a27b0669-625c324a-2957f23f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:43.259303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:43.259321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:43.259331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:43.259913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:43.259973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:43.260109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402039340319574:9157]
2025-10-15T11:01:43.260146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:43.260171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:43.260197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:43.260913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:43.260946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:43.261023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:43.261836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 967 partition: 0 MaxSeqNo: 46 sessionId: src_id|257a558d-a27b0669-625c324a-2957f23f_0
2025-10-15T11:01:43.262792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9502c36-8e22e68f-31430e0d-33d8ad3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|257a558d-a27b0669-625c324a-2957f23f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:43.298484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|257a558d-a27b0669-625c324a-2957f23f_0] Write session: try to update token
2025-10-15T11:01:43.298535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|257a558d-a27b0669-625c324a-2957f23f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:43.310964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:43.310994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:43.311020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402039340319574:9157]
2025-10-15T11:01:43.311131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:43.312106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:43.313197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:43.314605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:43.316170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:43.342882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:43.344614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:43.345173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:43.357164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:43.357193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:43.357203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:43.395555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:43.395592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:43.395604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:43.395613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:43.395643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402039340319574:9157]
2025-10-15T11:01:43.395661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402039340319574:9157]
2025-10-15T11:01:43.395679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402039340319574:9157]
2025-10-15T11:01:43.395789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:43.395808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:43.399481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:43.399538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:43.399567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:43.403933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:43.414692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId: src_id|257a558d-a27b0669-625c324a-2957f23f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:43.454017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:43.551316Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:43.553530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:43.553576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:43.554307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:43.556695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:43.556970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402036540629406:9630]
2025-10-15T11:01:43.557093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:43.566662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 967 reason: status is not ok: tablet will be restarted right now sessionId: src_id|257a558d-a27b0669-625c324a-2957f23f_0
2025-10-15T11:01:43.567069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 967 sessionId: src_id|257a558d-a27b0669-625c324a-2957f23f_0 is DEAD
2025-10-15T11:01:43.568297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257a558d-a27b0669-625c324a-2957f23f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:43.568366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257a558d-a27b0669-625c324a-2957f23f_0] Write session will restart in 0.009307s
2025-10-15T11:01:43.568502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257a558d-a27b0669-625c324a-2957f23f_0] Write session: Do CDS request
2025-10-15T11:01:43.568543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257a558d-a27b0669-625c324a-2957f23f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:43.588202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|257a558d-a27b0669-625c324a-2957f23f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:43.588257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:43.588294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 968
2025-10-15T11:01:43.609858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:43.610021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:43.610051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:43.610064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:43.613043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 968 sessionId:  describe result for acl check
2025-10-15T11:01:43.613164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:43.613175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:43.613186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:43.613204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402036540629577:5919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:43.616544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402036540629577:5919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:43.625028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402036540629577:5919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:43.652545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402036540629577:5919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:43.652591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402036540629577:5919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:43.652609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402036540629577:5919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:43.652641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:43.662488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402036540629709:9630]
2025-10-15T11:01:43.697899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:43.706340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:43.707055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:43.707068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:43.707100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:43.707281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:43.707426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402039340319896:9171]
2025-10-15T11:01:43.709053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:43.710215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:43.710452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:43.711750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:43.712096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:43.712112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:43.712119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:43.712126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:43.712133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:43.712141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:43.712149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:43.712158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:43.712165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:43.712174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:43.712180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:43.712189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.712197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.712203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.712255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:43.712391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:43.712452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:43.712508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:43.712560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:43.712627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:43.712681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:43.712735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:43.712788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:43.712846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:43.712896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:43.712951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.712998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.713051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.713102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:43.713176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:43.713240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:43.713303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:43.713355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:43.713420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:43.713469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:43.713526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:43.713578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:43.713636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:43.713687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:43.713744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:43.713797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:43.713856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:43.713911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:43.713971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:43.714025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:43.714082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:43.714143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:43.714203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:43.714268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:43.714333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:43.714384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.714441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.714521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.714587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.714639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.714710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.715241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:43.734250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:43.757376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:43.757426Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:43.757442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:43.757459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:43.757485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 967 [2:7561402039340319896:9171]
2025-10-15T11:01:43.757532Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:43.757590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:43.757604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:43.757616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:43.757628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:43.757675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:43.757698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:43.757722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:43.759727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.759752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.759764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.759775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:43.760047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:43.760065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:43.760204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:43.760403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:43.760634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:43.760703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402039340319891:9171]
2025-10-15T11:01:43.760718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402039340319891:9171]
2025-10-15T11:01:43.760732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402039340319891:9171]
2025-10-15T11:01:43.760774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:43.760846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:43.761477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 967
2025-10-15T11:01:43.760907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:43.760922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:43.760933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:43.761027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:43.761044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:43.761161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402039340319891:9171]
2025-10-15T11:01:43.761179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:43.761233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:43.761598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 967
2025-10-15T11:01:43.761674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 967, pipe: [1:7561402036540629709:9630]
2025-10-15T11:01:43.761784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402036540629544:2467], now have 1 active actors on pipe
2025-10-15T11:01:43.761864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402036540629683:5919], now have 1 active actors on pipe
2025-10-15T11:01:43.761885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402036540629709:9630], now have 1 active actors on pipe
2025-10-15T11:01:43.762247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:43.762273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:43.762409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa65d730-9330643e-21fb5bce-9753f604_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:43.762443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:43.762461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:43.762472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:43.762509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:43.762549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:43.762592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:43.763076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:43.763098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:43.763164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:43.765973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 968 partition: 0 MaxSeqNo: 46 sessionId: src_id|fa65d730-9330643e-21fb5bce-9753f604_0
2025-10-15T11:01:43.766754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257a558d-a27b0669-625c324a-2957f23f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fa65d730-9330643e-21fb5bce-9753f604_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:43.790360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa65d730-9330643e-21fb5bce-9753f604_0] Write session: try to update token
2025-10-15T11:01:43.790425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa65d730-9330643e-21fb5bce-9753f604_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:43.874584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:43.874652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:43.874677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:43.874697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:43.874754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402039340319891:9171]
2025-10-15T11:01:43.874807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402039340319891:9171]
2025-10-15T11:01:43.874847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402039340319891:9171]
2025-10-15T11:01:43.875030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:43.875105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:43.875159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:43.875210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:43.875247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:43.875273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:43.875334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:43.875377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:43.877306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:43.883411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId: src_id|fa65d730-9330643e-21fb5bce-9753f604_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:43.905514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:44.031798Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:44.042726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:44.042778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:44.042852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:44.042867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:44.042910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402039340319891:9171]
2025-10-15T11:01:44.043111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:44.043174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:44.043293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:44.043307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:44.043643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:44.043638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402036540629709:9630]
2025-10-15T11:01:44.101147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 968 reason: error at write: Disconnected sessionId: src_id|fa65d730-9330643e-21fb5bce-9753f604_0
2025-10-15T11:01:44.101499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 968 sessionId: src_id|fa65d730-9330643e-21fb5bce-9753f604_0 is DEAD
2025-10-15T11:01:44.101921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa65d730-9330643e-21fb5bce-9753f604_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:44.101979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa65d730-9330643e-21fb5bce-9753f604_0] Write session will restart in 0.009420s
2025-10-15T11:01:44.102145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa65d730-9330643e-21fb5bce-9753f604_0] Write session: Do CDS request
2025-10-15T11:01:44.102193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa65d730-9330643e-21fb5bce-9753f604_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:44.117580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:44.117640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 969
2025-10-15T11:01:44.117915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa65d730-9330643e-21fb5bce-9753f604_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:44.118567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:44.118698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:44.118712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:44.118721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:44.120291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 969 sessionId:  describe result for acl check
2025-10-15T11:01:44.120445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:44.120468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:44.120478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:44.120496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402040835597304:5906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:44.123186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402040835597304:5906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:44.131858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402040835597304:5906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:44.142761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402040835597304:5906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:44.142803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402040835597304:5906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:44.142820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402040835597304:5906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:44.142851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:44.143672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402040835597474:9630]
2025-10-15T11:01:44.157496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:44.159158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:44.160057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:44.160083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:44.160123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:44.160384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:44.160568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402043635287514:9175]
2025-10-15T11:01:44.162774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:44.163838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:44.164061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:44.165364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:44.165662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:44.165676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:44.165684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:44.165692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:44.165699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:44.165706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:44.165712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:44.165719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:44.165728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:44.165737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:44.165745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:44.165751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.165759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.165767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.165815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:44.165936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:44.165990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:44.166039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:44.166091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:44.166146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:44.166197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:44.166249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:44.166303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:44.166357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:44.166410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:44.166461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.166512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.166565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.166618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:44.166690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:44.166755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:44.166821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:44.166858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:44.166898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:44.166950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:44.167021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:44.167076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:44.167134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:44.167189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:44.167255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:44.167305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:44.167384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:44.167439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:44.167501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:44.167560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:44.167621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:44.167674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:44.167737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:44.167791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:44.167853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:44.167913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.167962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.167999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.168043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.168089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.168151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.168636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:44.218352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:44.229391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:44.229437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:44.229457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:44.229477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:44.229504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 968 [2:7561402043635287514:9175]
2025-10-15T11:01:44.229562Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:44.229626Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:44.229647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:44.229661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:44.229674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:44.229725Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:44.229751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:44.229775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:44.231055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.231082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.231095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.231107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:44.231440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:44.231473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.231721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 968
2025-10-15T11:01:44.231730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 968
2025-10-15T11:01:44.231815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 968, pipe: [1:7561402040835597474:9630]
2025-10-15T11:01:44.231621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.231844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.232085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:44.232172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402040835597182:2467], now have 1 active actors on pipe
2025-10-15T11:01:44.232196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402040835597474:9630], now have 1 active actors on pipe
2025-10-15T11:01:44.232220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402040835597473:5906], now have 1 active actors on pipe
2025-10-15T11:01:44.232287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:44.232308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:44.232362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402043635287509:9175]
2025-10-15T11:01:44.232377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402043635287509:9175]
2025-10-15T11:01:44.232390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402043635287509:9175]
2025-10-15T11:01:44.232444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:44.232485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:44.232502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:44.232512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:44.232520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:44.232710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:44.232726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:44.232787Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:44.232811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:44.232830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:44.232839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:44.232864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:44.232906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:44.233024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402043635287509:9175]
2025-10-15T11:01:44.233047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:44.233087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:44.233104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:44.233623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:44.233648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:44.233725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:44.234002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 969 partition: 0 MaxSeqNo: 46 sessionId: src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0
2025-10-15T11:01:44.234810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa65d730-9330643e-21fb5bce-9753f604_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:44.261210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0] Write session: try to update token
2025-10-15T11:01:44.261279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:44.267238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:44.267277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:44.267319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402043635287509:9175]
2025-10-15T11:01:44.267466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:44.268649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:44.269379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:44.270769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:44.272332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:44.273616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:44.275038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:44.279432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:44.329691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:44.329735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:44.329748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:44.329761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:44.329812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402043635287509:9175]
2025-10-15T11:01:44.329857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402043635287509:9175]
2025-10-15T11:01:44.329885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402043635287509:9175]
2025-10-15T11:01:44.329986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:44.330037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:44.330072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:44.330074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:44.330089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:44.330101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:44.330158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:44.330180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:44.332155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:44.337391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId: src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:44.359452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:44.481757Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:44.484894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:44.484937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:44.485625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:44.485762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:44.485802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402040835597474:9630]
2025-10-15T11:01:44.485884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:44.485913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:44.495191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 969 reason: error at write: Disconnected sessionId: src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0
2025-10-15T11:01:44.495452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 969 sessionId: src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0 is DEAD
2025-10-15T11:01:44.495759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:44.495807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0] Write session will restart in 0.009749s
2025-10-15T11:01:44.495908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0] Write session: Do CDS request
2025-10-15T11:01:44.495961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:44.508724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:44.508752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 970
2025-10-15T11:01:44.509006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:44.509451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:44.509565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:44.509586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:44.509594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:44.510722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 970 sessionId:  describe result for acl check
2025-10-15T11:01:44.510823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:44.510838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:44.510847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:44.510862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402040835597511:5893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:44.513314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402040835597511:5893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:44.524562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402040835597511:5893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:44.534127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402040835597511:5893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:44.534163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402040835597511:5893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:44.534193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402040835597511:5893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:44.534220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:44.583816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:44.586074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402040835597794:9630]
2025-10-15T11:01:44.588201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:44.588987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:44.589009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:44.589043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:44.589254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:44.589411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402043635287829:9179]
2025-10-15T11:01:44.591241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:44.592109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:44.592314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:44.593482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:44.593793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:44.593813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:44.593820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:44.593826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:44.593832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:44.593839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:44.593845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:44.593852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:44.593858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:44.593865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:44.593872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:44.593878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.593885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.593891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.593934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:44.594030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:44.594071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:44.594112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:44.594153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:44.594197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:44.594279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:44.594332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:44.594393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:44.594442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:44.594489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:44.594538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.594587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.594636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.594688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:44.594749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:44.594800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:44.594860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:44.594911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:44.594967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:44.595016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:44.595073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:44.595125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:44.595182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:44.595234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:44.595284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:44.595339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:44.595436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:44.595488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:44.595545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:44.595612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:44.595672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:44.595721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:44.595777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:44.595830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:44.595878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:44.595921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.595980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.596023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.596070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.596112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.596160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.596641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:44.621242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:44.643062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:44.643102Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:44.643118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:44.643135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:44.643156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 969 [2:7561402043635287829:9179]
2025-10-15T11:01:44.643203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:44.643251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:44.643264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:44.643275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:44.643285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:44.643326Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:44.643359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:44.643380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:44.645364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.645388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.645400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.645411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:44.645667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:44.645690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:44.645818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:44.645998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:44.645955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 969
2025-10-15T11:01:44.646034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 969, pipe: [1:7561402040835597794:9630]
2025-10-15T11:01:44.646095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 969
E1015 11:01:44.646120558  821272 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:01:44.646214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:44.646290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402040835597559:5893], now have 1 active actors on pipe
2025-10-15T11:01:44.646319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402040835597794:9630], now have 1 active actors on pipe
2025-10-15T11:01:44.646341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402040835597495:2467], now have 1 active actors on pipe
2025-10-15T11:01:44.646363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402043635287823:9179]
2025-10-15T11:01:44.646377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402043635287823:9179]
2025-10-15T11:01:44.646389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402043635287823:9179]
2025-10-15T11:01:44.646419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:44.646458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:44.646479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:44.646482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:44.646498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:44.646643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:44.646664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:44.646712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:44.646735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:44.646856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402043635287823:9179]
2025-10-15T11:01:44.646889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:44.646925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:44.646949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:44.646975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:44.646991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:44.647001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:44.647031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:44.647064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:44.647179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:44.647649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:44.647672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:44.647726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:44.648177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 970 partition: 0 MaxSeqNo: 46 sessionId: src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0
2025-10-15T11:01:44.648931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f2b58a-4a474a39-52ee2b7b-e9f51e6f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:44.669572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0] Write session: try to update token
2025-10-15T11:01:44.669627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:44.733852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:44.733880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:44.733890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:44.733898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:44.733927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402043635287823:9179]
2025-10-15T11:01:44.733949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402043635287823:9179]
2025-10-15T11:01:44.733969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402043635287823:9179]
2025-10-15T11:01:44.734117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:44.734146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:44.734153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:44.734165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:44.734185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:44.735151Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:44.749689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId: src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:44.770537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:44.872482Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:44.887961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:44.887996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:44.888040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:44.888048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:44.888074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402043635287823:9179]
2025-10-15T11:01:44.888251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:44.888482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:44.888844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:44.888869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402040835597794:9630]
2025-10-15T11:01:44.888945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:44.899394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 970 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0
2025-10-15T11:01:44.899824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 970 sessionId: src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0 is DEAD
2025-10-15T11:01:44.900298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:44.900370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0] Write session will restart in 0.008726s
2025-10-15T11:01:44.900477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0] Write session: Do CDS request
2025-10-15T11:01:44.900510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:44.913277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:44.913528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:44.913559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 971
2025-10-15T11:01:44.913937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:44.914058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:44.914079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:44.914087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:44.915259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 971 sessionId:  describe result for acl check
2025-10-15T11:01:44.915386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:44.915407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:44.915415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:44.915431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402040835597821:5887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:44.918953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402040835597821:5887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:44.926909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402040835597821:5887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:44.939477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402040835597821:5887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:44.939519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402040835597821:5887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:44.939536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402040835597821:5887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:44.939566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:44.989087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402040835598106:9630]
2025-10-15T11:01:45.000507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:45.002285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:45.003026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:45.003045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:45.003097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:45.003365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:45.003547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402047930255444:9187]
2025-10-15T11:01:45.005390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:45.006700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:45.006947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:45.008326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:45.008693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.008703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.008711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.008719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.008726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.008733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.008740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.008747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.008755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.008761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.008768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.008775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.008781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.008789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.008836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.008948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.008996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.009042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.009086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.009143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.009185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.009229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.009261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.009295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.009327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.009359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.009390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.009431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.009470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.009519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.009558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.009597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.009630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.009665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.009695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.009734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.009766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.009802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.009832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.009872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.009907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.009954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.009992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.010031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.010064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.010099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.010129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.010177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.010213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.010250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.010280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.010318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.010349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.010383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.010416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.010457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.010808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:45.057329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:45.067950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:45.067988Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:45.068004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:45.068024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:45.068048Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 970 [2:7561402047930255444:9187]
2025-10-15T11:01:45.068095Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:45.068148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:45.068160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:45.068171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:45.068181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:45.068225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:45.068252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:45.068274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:45.069898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.069922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.069935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.069946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:45.070209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:45.070233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.070370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.070555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.070584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 970, pipe: [1:7561402040835598106:9630]
2025-10-15T11:01:45.070799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:45.070704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 970
2025-10-15T11:01:45.070794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 970
2025-10-15T11:01:45.070888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402040835598106:9630], now have 1 active actors on pipe
2025-10-15T11:01:45.070915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402040835597870:5887], now have 1 active actors on pipe
2025-10-15T11:01:45.070938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402040835597807:2467], now have 1 active actors on pipe
2025-10-15T11:01:45.070965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402043635288143:9187]
2025-10-15T11:01:45.070981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402043635288143:9187]
2025-10-15T11:01:45.070994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402043635288143:9187]
2025-10-15T11:01:45.071024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:45.071092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:45.071097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:45.071119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:45.071131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:45.071270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:45.071287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:45.071458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:45.071488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:45.071519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402043635288143:9187]
2025-10-15T11:01:45.071550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:45.071623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:45.071665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:45.071692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:45.071713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:45.071723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:45.071757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:45.071790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:45.071872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:45.072517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:45.072547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:45.072608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:45.072959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 971 partition: 0 MaxSeqNo: 46 sessionId: src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0
2025-10-15T11:01:45.073686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2ab3fbb-fdb258e0-9efadd7f-f25027a5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:45.094308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0] Write session: try to update token
2025-10-15T11:01:45.094378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:45.133190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:45.133226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:45.133243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:45.133255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:45.133287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402043635288143:9187]
2025-10-15T11:01:45.133313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402043635288143:9187]
2025-10-15T11:01:45.133344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402043635288143:9187]
2025-10-15T11:01:45.133506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:45.133529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:45.133614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:45.133659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:45.133696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:45.138413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:45.183052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId: src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:45.204459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:45.290561Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:45.292817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:45.292855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:45.296418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402040835598106:9630]
2025-10-15T11:01:45.296534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:45.296548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:45.296611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:45.326220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:45.326371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 971 reason: error at write: Disconnected sessionId: src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0
2025-10-15T11:01:45.326910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 971 sessionId: src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0 is DEAD
2025-10-15T11:01:45.327264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:45.327322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0] Write session will restart in 0.005127s
2025-10-15T11:01:45.327503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0] Write session: Do CDS request
2025-10-15T11:01:45.327547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:45.338380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:45.345983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:45.346011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 972
2025-10-15T11:01:45.346419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:45.346525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:45.346540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:45.346550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:45.347907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 972 sessionId:  describe result for acl check
2025-10-15T11:01:45.348013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:45.348024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:45.348033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:45.348048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402045130565469:5858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:45.350608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402045130565469:5858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:45.362773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402045130565469:5858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:45.376054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402045130565469:5858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:45.376096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402045130565469:5858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:45.376111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402045130565469:5858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:45.376142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:45.396803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402045130565703:9630]
2025-10-15T11:01:45.420879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:45.422784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:45.423983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:45.424013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:45.424053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:45.424282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:45.424464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402047930255769:9196]
2025-10-15T11:01:45.426440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:45.427282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:45.427492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:45.428696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:45.428978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.428985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.428991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.428998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.429004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.429010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.429017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.429023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.429028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.429035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.429042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.429047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.429054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.429060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.429100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.429191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.429231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.429273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.429311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.429350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.429389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.429428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.429467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.429508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.429547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.429588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.429627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.429667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.429706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.429822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.430496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.430562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.430606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.430664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.430703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.430750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.430794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.430841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.430882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.430931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.430975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.431023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.431063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.431109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.431153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.431218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.431264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.431316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.431378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.431429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.431469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.431518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.431561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.431612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.431653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.431699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.432153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:45.458203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:45.469085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:45.469129Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:45.469146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:45.469162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:45.469186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 971 [2:7561402047930255769:9196]
2025-10-15T11:01:45.469235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:45.469290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:45.469304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:45.469315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:45.469326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:45.469368Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:45.469398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:45.469416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:45.491064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.491086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.491095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.491105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:45.491358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:45.491371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.491491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.491641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.491824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:45.491892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402045130565703:9630], now have 1 active actors on pipe
2025-10-15T11:01:45.491912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402045130565623:5858], now have 1 active actors on pipe
2025-10-15T11:01:45.491929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402045130565452:2467], now have 1 active actors on pipe
2025-10-15T11:01:45.491949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402047930255757:9196]
2025-10-15T11:01:45.491961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402047930255757:9196]
2025-10-15T11:01:45.491972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402047930255757:9196]
2025-10-15T11:01:45.492003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:45.492047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:45.492061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:45.492064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:45.492070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:45.492219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:45.492236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:45.492333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402047930255757:9196]
2025-10-15T11:01:45.492355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:45.492376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:45.495783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:45.495815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:45.495892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:45.495928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:45.495943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:45.495953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:45.495984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:45.496024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:45.496067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:45.496466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:45.496488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:45.496540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:45.498911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700a65d8-af3a5ae3-1d660893-e92834fb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:45.495473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 971, pipe: [1:7561402045130565703:9630]
2025-10-15T11:01:45.495494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 971
2025-10-15T11:01:45.495571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 971
2025-10-15T11:01:45.497008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 972 partition: 0 MaxSeqNo: 46 sessionId: src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0
2025-10-15T11:01:45.533345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0] Write session: try to update token
2025-10-15T11:01:45.533402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:45.584043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:45.584077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:45.584089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:45.584141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:45.584155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:45.584169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:45.584180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:45.584213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402047930255757:9196]
2025-10-15T11:01:45.584239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402047930255757:9196]
2025-10-15T11:01:45.584269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402047930255757:9196]
2025-10-15T11:01:45.584382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:45.584414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:45.584413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:45.584432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:45.584432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:45.586755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:45.641587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId: src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:45.668025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:45.730964Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:45.742960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:45.742996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:45.744158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402045130565703:9630]
2025-10-15T11:01:45.744350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:45.744396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:45.744716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:45.747021Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:45.781097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:45.781164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0] Write session will restart in 0.005256s
2025-10-15T11:01:45.781331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0] Write session: Do CDS request
2025-10-15T11:01:45.781378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:45.780427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 972 reason: error at write: Disconnected sessionId: src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0
2025-10-15T11:01:45.780710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 972 sessionId: src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0 is DEAD
2025-10-15T11:01:45.791096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:45.791608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:45.791632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 973
2025-10-15T11:01:45.793552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:45.793680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:45.793699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:45.793709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:45.794946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 973 sessionId:  describe result for acl check
2025-10-15T11:01:45.795056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:45.795066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:45.795075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:45.795090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402045130565790:5850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:45.797487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402045130565790:5850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:45.804946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402045130565790:5850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:45.814853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402045130565790:5850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:45.814898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402045130565790:5850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:45.814915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402045130565790:5850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:45.814944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:45.844564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402045130566061:9630]
2025-10-15T11:01:45.851864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:45.853780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:45.854685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:45.854712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:45.854764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:45.856895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:45.857169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402047930256079:9200]
2025-10-15T11:01:45.859763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:45.860844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:45.861051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:45.862229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:45.862536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.862552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.862559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.862567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.862574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.862580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.862586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.862592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.862598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.862604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.862610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.862616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.862623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.862630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.862671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.862773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.862820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.862863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.862905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.862956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.863003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.863051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.863100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.863146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.863193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.863240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.863285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.863332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.863390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.863455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:45.863510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.863566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:45.863618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.863672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:45.863717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.863771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:45.863824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.863873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:45.863915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.863972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:45.864019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.864073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:45.864119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.864171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:45.864216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.864263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:45.864311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.864367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:45.864424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.864481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:45.864527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.864580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.864627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.864681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.864727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.864774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.865259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:45.880844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:45.903740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:45.903780Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:45.903796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:45.903814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:45.903837Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 972 [2:7561402047930256079:9200]
2025-10-15T11:01:45.903884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:45.903937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:45.903949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:45.903961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:45.903971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:45.904016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:45.904035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:45.904055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:45.905039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.905062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.905074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.905085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:45.905340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:45.905364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:45.905497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:45.905578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 972, pipe: [1:7561402045130566061:9630]
2025-10-15T11:01:45.905625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 972
2025-10-15T11:01:45.905684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 972
2025-10-15T11:01:45.905676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:45.905915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:45.905988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402045130566061:9630], now have 1 active actors on pipe
2025-10-15T11:01:45.906009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402045130565907:5850], now have 1 active actors on pipe
2025-10-15T11:01:45.906031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402045130565765:2467], now have 1 active actors on pipe
2025-10-15T11:01:45.906088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:45.906108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:45.906143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402047930256069:9200]
2025-10-15T11:01:45.906156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402047930256069:9200]
2025-10-15T11:01:45.906170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402047930256069:9200]
2025-10-15T11:01:45.906208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:45.906246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:45.906275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:45.906276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:45.906287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:45.906442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:45.906456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:45.906516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:45.906543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:45.906558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:45.906568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:45.906598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:45.906630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:45.906755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402047930256069:9200]
2025-10-15T11:01:45.906787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:45.906831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:45.906834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:45.907332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:45.907373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:45.907447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:45.907732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 973 partition: 0 MaxSeqNo: 46 sessionId: src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0
2025-10-15T11:01:45.910210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60afd3e8-ad00e828-7265a4d1-e65e542c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:45.946462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0] Write session: try to update token
2025-10-15T11:01:45.946528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:45.963361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:45.963397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:45.963439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402047930256069:9200]
2025-10-15T11:01:45.963583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:45.963581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:45.966416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:45.973282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:45.974566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:45.999741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:46.011593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:46.012159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:46.012184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:46.012197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:46.012254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:46.089938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:46.089973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:46.089987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:46.090000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:46.090039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402047930256069:9200]
2025-10-15T11:01:46.090066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402047930256069:9200]
2025-10-15T11:01:46.090091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402047930256069:9200]
2025-10-15T11:01:46.090199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:46.090231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:46.090245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:46.090260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:46.090268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:46.091907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:46.098325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId: src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:46.120166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:46.244192Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:46.249579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:46.249633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:46.250859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402045130566061:9630]
2025-10-15T11:01:46.250859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:46.250873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:46.250954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:46.254357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:46.283687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:46.283762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0] Write session will restart in 0.006376s
2025-10-15T11:01:46.282810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 973 reason: error at write: Disconnected sessionId: src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0
2025-10-15T11:01:46.283857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0] Write session: Do CDS request
2025-10-15T11:01:46.283114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 973 sessionId: src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0 is DEAD
2025-10-15T11:01:46.283890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:46.290327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:46.295309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:46.295185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:46.295241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 974
2025-10-15T11:01:46.295286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:46.295966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:46.296107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:46.296128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:46.296139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:46.296739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:46.296771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:46.296825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:46.297147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:46.297342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402052225223461:9210]
2025-10-15T11:01:46.297505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 974 sessionId:  describe result for acl check
2025-10-15T11:01:46.297616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:46.297631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:46.297641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:46.297657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402049425533415:5837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:46.299635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:46.299676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402049425533415:5837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:46.300646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:46.300876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:46.302691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:46.303037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.303052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.303064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.303076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.303084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.303091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.303098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.303108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.303119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.303126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.303133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.303141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.303149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.303155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.303203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.303316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.303389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.303437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.303516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.303598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.303707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.303795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.303878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.303967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.304056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.304141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.304238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.304324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.304418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.304533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.304650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.304769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.304851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.304959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.305050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.305162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.305258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.305347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.305427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.305492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.305546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.305609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.305658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.305717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.305771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.305832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.305881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.305943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.305997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.306058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.306110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.306168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.306217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.306181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402049425533415:5837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:46.306274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.306324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.306384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.306900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:46.316329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402049425533415:5837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:46.316369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402049425533415:5837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:46.316396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402049425533415:5837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:46.316426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:46.323858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:46.335280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:46.335325Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:46.335343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:46.335379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:46.335407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 973 [2:7561402052225223461:9210]
2025-10-15T11:01:46.335461Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:46.335523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:46.335538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:46.335553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:46.335565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:46.335619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:46.335650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:46.335674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:46.337387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.337416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.337432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.337444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:46.337702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:46.337728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.337874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.338080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.338032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 973
2025-10-15T11:01:46.338078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 973
2025-10-15T11:01:46.338331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:46.338419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402049425533449:5837], now have 1 active actors on pipe
2025-10-15T11:01:46.338449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402049425533393:2467], now have 1 active actors on pipe
2025-10-15T11:01:46.338497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:46.338522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:46.338579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402052225223456:9210]
2025-10-15T11:01:46.338601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402052225223456:9210]
2025-10-15T11:01:46.338616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402052225223456:9210]
2025-10-15T11:01:46.338654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:46.338707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:46.338730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:46.338733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:46.338741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:46.338918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:46.338939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:46.339007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:46.339041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:46.339062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:46.339073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:46.339111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:46.339157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:46.339292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402052225223456:9210]
2025-10-15T11:01:46.339330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:46.339396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:46.339400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:46.339952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:46.339980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:46.340040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:46.340311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 974 partition: 0 MaxSeqNo: 46 sessionId: src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0
2025-10-15T11:01:46.341130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0063e7e-4b1a06d0-a33d9c66-74da7807_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:46.350956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402049425533457:9630]
2025-10-15T11:01:46.351569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402049425533457:9630], now have 1 active actors on pipe
2025-10-15T11:01:46.351703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 973, pipe: [1:7561402049425533457:9630]
2025-10-15T11:01:46.363224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0] Write session: try to update token
2025-10-15T11:01:46.363276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:46.395668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:46.395708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:46.395745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402052225223456:9210]
2025-10-15T11:01:46.395874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:46.397121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:46.398914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:46.400723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:46.405474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:46.416544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:46.423024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:46.423669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:46.450147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:46.450172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:46.450181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:46.450223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:46.450233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:46.450241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:46.450247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:46.450272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402052225223456:9210]
2025-10-15T11:01:46.450290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402052225223456:9210]
2025-10-15T11:01:46.450306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402052225223456:9210]
2025-10-15T11:01:46.450389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:46.450403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:46.450409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:46.450445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:46.450463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:46.451240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:46.470824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId: src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:46.494845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:46.583081Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:46.585088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:46.585125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:46.585814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:46.585846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:46.585870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:46.619266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:46.622559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:46.623505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:46.623536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:46.623577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:46.623799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:46.623972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402052225223536:9217]
2025-10-15T11:01:46.625896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:46.626785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:46.626964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:46.628213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:46.628535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.628543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.628548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.628554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.628560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.628565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.628570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.628575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.628580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.628585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.628592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.628598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.628604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.628609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.628648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.628736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.628772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.628810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.628846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.628894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.628930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.628964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.629000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.629033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.629068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.629101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.629134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.629170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.629203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.629255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.629301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.629347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.629415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.629473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.629521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.629571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.629607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.629652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.629691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.629736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.629773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.629828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.629873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.629924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.629977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.630031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.630069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.630127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.630180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.630224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.630258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.630302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.630337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.630393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.630436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.630497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.630960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:46.638497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402049425533457:9630]
2025-10-15T11:01:46.638590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:46.638825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 974 reason: error at write: Disconnected sessionId: src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0
2025-10-15T11:01:46.639132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 974 sessionId: src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0 is DEAD
2025-10-15T11:01:46.639779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:46.639822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0] Write session will restart in 0.006101s
2025-10-15T11:01:46.639997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0] Write session: Do CDS request
2025-10-15T11:01:46.640032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:46.650159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:46.658401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:46.660773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:46.660807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 975
2025-10-15T11:01:46.661319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:46.661432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:46.661452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:46.661463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:46.663022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 975 sessionId:  describe result for acl check
2025-10-15T11:01:46.663119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:46.663137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:46.663146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:46.663162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402049425533501:5819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:46.665903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402049425533501:5819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:46.670846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:46.670884Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:46.670899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:46.670914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:46.670934Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 974 [2:7561402052225223536:9217]
2025-10-15T11:01:46.670978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:46.671023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:46.671042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:46.671053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:46.671062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:46.671103Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:46.671121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:46.671138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:46.671902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402049425533501:5819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:46.673100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.673123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.673137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.673148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:46.673381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:46.673405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.673523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.673690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.673918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:46.673992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402049425533496:2467], now have 1 active actors on pipe
2025-10-15T11:01:46.674020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402052225223531:9217]
2025-10-15T11:01:46.674033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402052225223531:9217]
2025-10-15T11:01:46.674045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402052225223531:9217]
2025-10-15T11:01:46.674078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:46.674124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:46.674138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:46.674145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:46.674167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:46.674294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:46.674317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:46.674334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 974
2025-10-15T11:01:46.674418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402052225223531:9217]
2025-10-15T11:01:46.674454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:46.674464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:46.684187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402049425533501:5819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:46.684229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402049425533501:5819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:46.684248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402049425533501:5819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:46.684283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:46.685918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402049425533533:5819], now have 1 active actors on pipe
2025-10-15T11:01:46.686120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 974
2025-10-15T11:01:46.686314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:46.686345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:46.686422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:46.686458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:46.686488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:46.686503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:46.686537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:46.686574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:46.686624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:46.687129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:46.687154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:46.687233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:46.687511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 975 partition: 0 MaxSeqNo: 46 sessionId: src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0
2025-10-15T11:01:46.688322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565736ab-22556df1-2dbdc4c5-10fb5d72_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:46.712180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0] Write session: try to update token
2025-10-15T11:01:46.712240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:46.738545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402049425533537:9630]
2025-10-15T11:01:46.739164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 974, pipe: [1:7561402049425533537:9630]
2025-10-15T11:01:46.756173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402049425533537:9630], now have 1 active actors on pipe
2025-10-15T11:01:46.756226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:46.756245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:46.756259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:46.756269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:46.756302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402052225223531:9217]
2025-10-15T11:01:46.756329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402052225223531:9217]
2025-10-15T11:01:46.756359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402052225223531:9217]
2025-10-15T11:01:46.756527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:46.756556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:46.756710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:46.756747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:46.756774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:46.758210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:46.842091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId: src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:46.867309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:46.919058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402049425533537:9630]
2025-10-15T11:01:46.919158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:46.919265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:46.919306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:46.916458Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:46.918231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:46.918265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:46.922177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:46.958332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:46.961324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:46.962105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:46.962129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:46.962167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:46.962383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:46.962550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402052225223601:9221]
2025-10-15T11:01:46.964343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:46.965141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:46.965276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:46.966127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:46.966398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.966410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.966416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.966423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.966433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.966439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.966446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.966452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.966459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.966467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.966473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.966479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.966485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.966492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.966533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.966627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.966673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.966715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.966760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.966807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.966853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.966898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.966946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.966994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.967043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.967083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.967121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.967164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.967207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.967270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:46.967322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.967392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:46.967440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.967492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:46.967538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.967592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:46.967640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.967694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:46.967740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.967796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:46.967845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.967897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:46.967943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.967992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:46.968042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.968097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:46.968143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.968201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:46.968250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.968301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:46.968349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.968415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:46.968465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.968522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:46.968564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.968619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:46.969085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:46.981080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:46.981145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0] Write session will restart in 0.008390s
2025-10-15T11:01:46.981324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0] Write session: Do CDS request
2025-10-15T11:01:46.981376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:46.980237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 975 reason: error at write: Disconnected sessionId: src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0
2025-10-15T11:01:46.980616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 975 sessionId: src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0 is DEAD
2025-10-15T11:01:46.994949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:47.001908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:47.001721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:47.001765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 976
2025-10-15T11:01:47.002409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:47.002534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:47.002549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:47.002558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:47.003942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 976 sessionId:  describe result for acl check
2025-10-15T11:01:47.004107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:47.004139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:47.004155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:47.004179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402053720500877:5806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:47.008084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402053720500877:5806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:47.014827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402053720500877:5806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:47.015145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:47.015187Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:47.015231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:47.015250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:47.015275Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 975 [2:7561402052225223601:9221]
2025-10-15T11:01:47.015323Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:47.015390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:47.015405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:47.015416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:47.015428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:47.015475Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:47.015496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:47.015518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:47.017985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.018020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.018032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.018042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:47.018318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:47.018341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.018471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.018655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.018877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:47.018951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402049425533552:2467], now have 1 active actors on pipe
2025-10-15T11:01:47.018982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402052225223596:9221]
2025-10-15T11:01:47.019002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402052225223596:9221]
2025-10-15T11:01:47.019015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402052225223596:9221]
2025-10-15T11:01:47.019050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:47.019092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:47.019113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:47.019114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:47.019123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:47.019268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:47.019290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:47.019415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402052225223596:9221]
2025-10-15T11:01:47.019445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:47.019492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:47.019519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 975
2025-10-15T11:01:47.019583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402053720500901:9630]
2025-10-15T11:01:47.020107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 975, pipe: [1:7561402053720500901:9630]
2025-10-15T11:01:47.020296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720500901:9630], now have 1 active actors on pipe
2025-10-15T11:01:47.023342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402053720500877:5806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:47.023400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402053720500877:5806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:47.023418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402053720500877:5806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:47.023452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:47.027641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720500910:5806], now have 1 active actors on pipe
2025-10-15T11:01:47.027970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 975
2025-10-15T11:01:47.028156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.028186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.028265Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:47.028301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:47.028321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:47.028333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:47.028371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:47.028427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:47.028479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:47.028961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.028983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.029044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:47.029356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 976 partition: 0 MaxSeqNo: 46 sessionId: src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0
2025-10-15T11:01:47.030179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95f61f47-399dd9a6-5fc162fb-dbf64ba_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:47.051686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:47.051721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:47.051762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402052225223596:9221]
2025-10-15T11:01:47.051896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:47.051899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:47.053743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:47.055016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:47.056551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:47.061139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:47.062234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0] Write session: try to update token
2025-10-15T11:01:47.062290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:47.063982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:47.065187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:47.124810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:47.124840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:47.124850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:47.124897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:47.124909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:47.124921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:47.124929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:47.124962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402052225223596:9221]
2025-10-15T11:01:47.124983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402052225223596:9221]
2025-10-15T11:01:47.125002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402052225223596:9221]
2025-10-15T11:01:47.125119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:47.125135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:47.125142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:47.125181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:47.125216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:47.126096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:47.184110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId: src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:47.207014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:47.263035Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:47.264537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.264574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.265353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:47.266355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:47.267528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:47.267803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402053720500901:9630]
2025-10-15T11:01:47.274786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 976 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0
2025-10-15T11:01:47.275176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 976 sessionId: src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0 is DEAD
2025-10-15T11:01:47.275558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:47.275607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0] Write session will restart in 0.009987s
2025-10-15T11:01:47.275732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0] Write session: Do CDS request
2025-10-15T11:01:47.275777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:47.305060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:47.304399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:47.304449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 977
2025-10-15T11:01:47.305830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:47.306033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:47.306059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:47.306090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:47.308087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 977 sessionId:  describe result for acl check
2025-10-15T11:01:47.311387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:47.308245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:47.308262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:47.308274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:47.308302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402053720500950:5795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:47.314695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:47.311857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402053720500950:5795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:47.315587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:47.315617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:47.315662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:47.315922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:47.316119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402056520190971:9225]
2025-10-15T11:01:47.316846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402053720500950:5795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:47.318346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:47.319124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:47.319293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:47.320260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:47.320545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.320560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.320565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.320570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.320575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.320580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.320585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.320589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.320594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.320598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.320604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.320611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.320619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.320627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.320683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.320804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.320854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.320907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.320958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.321004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.321044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.321086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.321128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.321168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.321211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.321254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.321294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.321343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.321394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.321477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.321543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.321605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.321645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.321693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.321731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.321780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.321821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.321869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.321906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.321952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.322004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.322058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.322098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.322146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.322190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.322249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.322292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.322336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.322378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.322432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.322471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.322440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402053720500950:5795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:47.322534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.322481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402053720500950:5795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:47.322497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402053720500950:5795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:47.322588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.322528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:47.322651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.322705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.322768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.323300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:47.337129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:47.345718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:47.345769Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:47.345789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:47.345810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:47.345837Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 976 [2:7561402056520190971:9225]
2025-10-15T11:01:47.345894Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:47.345959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:47.345983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:47.345999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:47.346011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:47.346061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:47.346086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:47.346111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:47.357731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.357766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.357780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.357793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:47.358132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:47.358163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.358313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.358365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 976
2025-10-15T11:01:47.358405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 976
2025-10-15T11:01:47.358520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.358779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:47.358877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720500928:2467], now have 1 active actors on pipe
2025-10-15T11:01:47.358904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720500983:5795], now have 1 active actors on pipe
2025-10-15T11:01:47.358981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.359004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.359046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402056520190966:9225]
2025-10-15T11:01:47.359063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402056520190966:9225]
2025-10-15T11:01:47.359080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402056520190966:9225]
2025-10-15T11:01:47.359128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:47.359169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:47.359185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:47.359196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:47.359209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:47.359765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:47.359795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:47.359876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcdc44a-a769a783-cdb62319-f16928ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:47.359911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:47.359932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:47.359945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:47.359986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:47.360037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:47.360182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402056520190966:9225]
2025-10-15T11:01:47.360218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:47.360260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:47.360266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:47.360794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.360832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.360900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:47.361213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 977 partition: 0 MaxSeqNo: 46 sessionId: src_id|dcdc44a-a769a783-cdb62319-f16928ab_0
2025-10-15T11:01:47.362068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6da21f5-4e92c9a1-d00fde04-8fca2744_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dcdc44a-a769a783-cdb62319-f16928ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:47.368290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402053720500993:9630]
2025-10-15T11:01:47.368791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720500993:9630], now have 1 active actors on pipe
2025-10-15T11:01:47.368892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 976, pipe: [1:7561402053720500993:9630]
2025-10-15T11:01:47.381949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdc44a-a769a783-cdb62319-f16928ab_0] Write session: try to update token
2025-10-15T11:01:47.382005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdc44a-a769a783-cdb62319-f16928ab_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:47.411799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:47.411836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:47.411849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:47.411870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:47.411903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402056520190966:9225]
2025-10-15T11:01:47.411941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402056520190966:9225]
2025-10-15T11:01:47.411965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402056520190966:9225]
2025-10-15T11:01:47.412090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:47.412122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:47.412147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:47.412165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:47.412186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:47.413602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:47.457634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId: src_id|dcdc44a-a769a783-cdb62319-f16928ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:47.480726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:47.557917Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:47.570137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.570185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.570245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:47.570257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:47.570291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402056520190966:9225]
2025-10-15T11:01:47.570446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:47.570701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:47.570844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402053720500993:9630]
2025-10-15T11:01:47.570843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:47.570920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:47.570937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:47.602047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 977 reason: error at write: Disconnected sessionId: src_id|dcdc44a-a769a783-cdb62319-f16928ab_0
2025-10-15T11:01:47.602354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 977 sessionId: src_id|dcdc44a-a769a783-cdb62319-f16928ab_0 is DEAD
2025-10-15T11:01:47.602776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdc44a-a769a783-cdb62319-f16928ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:47.602844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdc44a-a769a783-cdb62319-f16928ab_0] Write session will restart in 0.007757s
2025-10-15T11:01:47.603001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdc44a-a769a783-cdb62319-f16928ab_0] Write session: Do CDS request
2025-10-15T11:01:47.603045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdc44a-a769a783-cdb62319-f16928ab_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:47.620394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:47.620435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 978
2025-10-15T11:01:47.620814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdc44a-a769a783-cdb62319-f16928ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:47.621312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:47.621449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:47.621475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:47.621485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:47.623588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 978 sessionId:  describe result for acl check
2025-10-15T11:01:47.623698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:47.623726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:47.623737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:47.623756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402053720501020:5789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:47.626587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402053720501020:5789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:47.626669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:47.628452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:47.629162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:47.629179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:47.629214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:47.629429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:47.629594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402056520191043:9233]
2025-10-15T11:01:47.631858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:47.632879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:47.633093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:47.634298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:47.634633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.634651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.634658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.634665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.634672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.634679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.634685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.634692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.634698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.634704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.634711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.634717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.634723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.634730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.634774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.634875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.634921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.634969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.635019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.635068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.635120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.635171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.635219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.635272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.635322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.635390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.635436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.635484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.635528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.635597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.635659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.635716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.635768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.635821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.635867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.635924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.635975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.636031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.636079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.636140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.636101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402053720501020:5789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:47.636186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.636243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.636290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.636347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.636417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.636476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.636521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.636578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.636628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.636684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.636733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.636784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.636836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.636885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.636936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.636982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.637478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:47.650296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402053720501020:5789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:47.650335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402053720501020:5789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:47.650354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402053720501020:5789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:47.650384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:47.655643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:47.665477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:47.665513Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:47.665524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:47.665538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:47.665558Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 977 [2:7561402056520191043:9233]
2025-10-15T11:01:47.665595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:47.665644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:47.665656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:47.665666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:47.665676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:47.665712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:47.665731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:47.665750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:47.667487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.667512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.667528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.667541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:47.667778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:47.667801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.667935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.668111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.668263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 977
2025-10-15T11:01:47.668342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:47.668362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 977
2025-10-15T11:01:47.668434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720501053:5789], now have 1 active actors on pipe
2025-10-15T11:01:47.668464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720500997:2467], now have 1 active actors on pipe
2025-10-15T11:01:47.668494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402056520191038:9233]
2025-10-15T11:01:47.668513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402056520191038:9233]
2025-10-15T11:01:47.668526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402056520191038:9233]
2025-10-15T11:01:47.668565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:47.668659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.668682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.668729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:47.668746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:47.668762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:47.668774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:47.668917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:47.668937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:47.669104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:47.669139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:47.669159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:47.669168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:47.669206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:47.669253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:47.669292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402056520191038:9233]
2025-10-15T11:01:47.669320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:47.669348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:47.669410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:47.670296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.670342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.670418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:47.670746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 978 partition: 0 MaxSeqNo: 46 sessionId: src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0
2025-10-15T11:01:47.671286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402053720501060:9630]
2025-10-15T11:01:47.671565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcdc44a-a769a783-cdb62319-f16928ab_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:47.671944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 977, pipe: [1:7561402053720501060:9630]
2025-10-15T11:01:47.672038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720501060:9630], now have 1 active actors on pipe
2025-10-15T11:01:47.695798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0] Write session: try to update token
2025-10-15T11:01:47.695851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:47.733379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:47.733417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:47.733433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:47.733446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:47.733482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402056520191038:9233]
2025-10-15T11:01:47.733512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402056520191038:9233]
2025-10-15T11:01:47.733540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402056520191038:9233]
2025-10-15T11:01:47.733671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:47.733698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:47.733707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:47.733723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:47.733724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:47.734805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:47.800695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId: src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:47.821610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:47.882555Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:47.885478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.885515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.886497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:47.886722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402053720501060:9630]
2025-10-15T11:01:47.886848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:47.886879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:47.890340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:47.919070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 978 reason: error at write: Disconnected sessionId: src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0
2025-10-15T11:01:47.919490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 978 sessionId: src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0 is DEAD
2025-10-15T11:01:47.921765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:47.921817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0] Write session will restart in 0.007592s
2025-10-15T11:01:47.921958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0] Write session: Do CDS request
2025-10-15T11:01:47.922007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:47.933440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:47.933893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:47.936639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:47.937632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:47.937661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:47.937707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:47.937961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:47.938151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402056520191123:9235]
2025-10-15T11:01:47.940336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:47.941256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:47.941481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:47.942861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:47.943223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.943240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.943248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.943255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.943262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.943269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.943275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.943283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.943289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.943296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.943303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.943311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.943317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.943323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.943388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.943499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.943549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.943596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.943648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.943699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.943747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.943793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.943847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.943892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.943936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.943988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.944041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.944096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.944150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.944224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:47.944281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.944339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:47.944394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.944470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:47.944520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.944577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:47.944626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.944684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:47.944735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.944790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:47.944906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.945045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:47.945156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.945269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:47.945390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.945525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:47.945620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.945743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:47.945864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.946004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:47.946122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.946251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.946360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.946498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.946603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.946744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.947603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:47.952082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:47.952117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 979
2025-10-15T11:01:47.952625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:47.952763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:47.952779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:47.952788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:47.953862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 979 sessionId:  describe result for acl check
2025-10-15T11:01:47.953986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:47.954004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:47.954013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:47.954033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402053720501107:5776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:47.956850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402053720501107:5776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:47.962668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402053720501107:5776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:47.968442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:47.970761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402053720501107:5776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:47.970802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402053720501107:5776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:47.970823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402053720501107:5776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:47.970857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:47.977296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:47.977327Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:47.977338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:47.977354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:47.977373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 978 [2:7561402056520191123:9235]
2025-10-15T11:01:47.977409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:47.977462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:47.977473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:47.977483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:47.977492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:47.977537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:47.977555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:47.977577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:47.979011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.979028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.979040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.979052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:47.979283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:47.979309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:47.979431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:47.979580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:47.979747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:47.979588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 978
2025-10-15T11:01:47.979677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 978
2025-10-15T11:01:47.979807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720501132:5776], now have 1 active actors on pipe
2025-10-15T11:01:47.979827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720501067:2467], now have 1 active actors on pipe
2025-10-15T11:01:47.979844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402056520191118:9235]
2025-10-15T11:01:47.979856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402056520191118:9235]
2025-10-15T11:01:47.979865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402056520191118:9235]
2025-10-15T11:01:47.979893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:47.979944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:47.980014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:47.980037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:47.980053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:47.980152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:47.980176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:47.980304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.980325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.980356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402056520191118:9235]
2025-10-15T11:01:47.980382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:47.980413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:47.980511Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:47.980548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:47.980569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:47.980579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:47.980613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:47.980658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:47.980751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:47.981476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:47.981496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:47.981540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:47.981964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 979 partition: 0 MaxSeqNo: 46 sessionId: src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0
2025-10-15T11:01:47.982757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27eff49c-a7c1b0a5-f2e94078-aa6dd207_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:47.986874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402053720501138:9630]
2025-10-15T11:01:47.987759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 978, pipe: [1:7561402053720501138:9630]
2025-10-15T11:01:47.988032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402053720501138:9630], now have 1 active actors on pipe
2025-10-15T11:01:48.014371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0] Write session: try to update token
2025-10-15T11:01:48.014429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:48.053038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:48.053076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:48.053090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:48.053100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:48.053136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402056520191118:9235]
2025-10-15T11:01:48.053166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402056520191118:9235]
2025-10-15T11:01:48.053192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402056520191118:9235]
2025-10-15T11:01:48.053316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:48.053343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:48.053356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:48.053380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:48.053384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:48.054594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:48.112613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId: src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:48.133059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:48.206643Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:48.208646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:48.208685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:48.210095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402053720501138:9630]
2025-10-15T11:01:48.210310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:48.210353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:48.222321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:48.222463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 979 reason: error at write: Disconnected sessionId: src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0
2025-10-15T11:01:48.222831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 979 sessionId: src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0 is DEAD
2025-10-15T11:01:48.224440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:48.224518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0] Write session will restart in 0.006249s
2025-10-15T11:01:48.224706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0] Write session: Do CDS request
2025-10-15T11:01:48.224770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:48.236639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:48.239324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:48.259531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:48.267803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:48.268713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:48.268733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:48.268774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:48.269031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:48.269236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402060815158479:9242]
2025-10-15T11:01:48.271624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:48.275688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:48.275928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:48.277421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:48.277742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.277759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.277766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.277772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.277778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.277784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.277791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.277797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.277804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.277812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.277819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.277826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.277831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.277838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.277884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.277993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.278036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.278080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.278128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.278180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.278227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.278272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.278319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.278366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.278413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.278461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.278503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.278541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.278579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.278642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.278694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.278743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.278793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.278841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.278877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.278924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.278965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.279012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.279050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.279096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.279136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.279184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.279222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.279270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.279314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.279484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.279537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.279590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.279635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.279698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.279744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.279796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.279843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.279897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.279940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.279994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.280480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:48.283388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:48.283417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 980
2025-10-15T11:01:48.283898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:48.284020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:48.284040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:48.284051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:48.285328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 980 sessionId:  describe result for acl check
2025-10-15T11:01:48.285471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:48.285487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:48.285501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:48.285519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402058015468485:5758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:48.288842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402058015468485:5758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:48.296042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402058015468485:5758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:48.298988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:48.303841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402058015468485:5758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:48.303880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402058015468485:5758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:48.303898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402058015468485:5758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:48.303931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:48.309227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:48.310401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402058015468516:9630]
2025-10-15T11:01:48.309268Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:48.309285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:48.309303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:48.309328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 979 [2:7561402060815158479:9242]
2025-10-15T11:01:48.309379Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:48.309433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:48.309447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:48.309459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:48.309470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:48.309515Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:48.309537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:48.309557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:48.311578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.311606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.311620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.311630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:48.311883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:48.311909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.312046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.312214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 979
2025-10-15T11:01:48.312242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.312300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 979, pipe: [1:7561402058015468516:9630]
2025-10-15T11:01:48.312391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 979
2025-10-15T11:01:48.312490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:48.312574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402058015468459:2467], now have 1 active actors on pipe
2025-10-15T11:01:48.312598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402058015468516:9630], now have 1 active actors on pipe
2025-10-15T11:01:48.312618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402058015468514:5758], now have 1 active actors on pipe
2025-10-15T11:01:48.312658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402060815158474:9242]
2025-10-15T11:01:48.312671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402060815158474:9242]
2025-10-15T11:01:48.312683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402060815158474:9242]
2025-10-15T11:01:48.312717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:48.312744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:48.312757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:48.312766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:48.312794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:48.312813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:48.312854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:48.313025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:48.313041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:48.313173Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:48.313199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:48.313217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:48.313227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:48.313257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:48.313291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:48.313322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402060815158474:9242]
2025-10-15T11:01:48.313354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:48.313390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:48.313430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:48.313909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:48.313931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:48.313993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:48.314261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 980 partition: 0 MaxSeqNo: 46 sessionId: src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0
2025-10-15T11:01:48.315043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03ead7e-ffa6a3eb-8fed18af-530576b7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:48.342881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0] Write session: try to update token
2025-10-15T11:01:48.342935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:48.374953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:48.374980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:48.375028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402060815158474:9242]
2025-10-15T11:01:48.375155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:48.375180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:48.377355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:48.378849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:48.380217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:48.381648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:48.383433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:48.383955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:48.429714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:48.429745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:48.429756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:48.429807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:48.429820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:48.429833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:48.429843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:48.429880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402060815158474:9242]
2025-10-15T11:01:48.429907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402060815158474:9242]
2025-10-15T11:01:48.429930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402060815158474:9242]
2025-10-15T11:01:48.430048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:48.430051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:48.430066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:48.430097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:48.430129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:48.431033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:48.455315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId: src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:48.479318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:48.569927Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:48.571336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:48.571397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:48.572131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:48.572484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:48.572661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402058015468516:9630]
2025-10-15T11:01:48.572745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:48.572758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:48.583424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 980 reason: error at write: Disconnected sessionId: src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0
2025-10-15T11:01:48.583793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 980 sessionId: src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0 is DEAD
2025-10-15T11:01:48.584273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:48.584330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0] Write session will restart in 0.005360s
2025-10-15T11:01:48.584500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0] Write session: Do CDS request
2025-10-15T11:01:48.584549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:48.595783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:48.595745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:48.595772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 981
2025-10-15T11:01:48.596317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:48.596463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:48.596485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:48.596495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:48.597833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 981 sessionId:  describe result for acl check
2025-10-15T11:01:48.597945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:48.597956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:48.597964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:48.597981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402058015468552:5756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:48.600441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402058015468552:5756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:48.607698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402058015468552:5756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:48.608279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:48.613198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:48.614085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:48.614119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:48.614164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:48.614436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:48.614615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402060815158565:9248]
2025-10-15T11:01:48.617889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:48.618461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402058015468552:5756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:48.618499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402058015468552:5756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:48.618518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402058015468552:5756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:48.618550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:48.619064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:48.619298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:48.620621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:48.620967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.620985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.620992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.620999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.621006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.621013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.621020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.621026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.621033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.621040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.621047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.621055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.621062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.621069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.621115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.621227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.621278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.621342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.621398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.621451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.621502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.621554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.621605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.621656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.621707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.621758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.621808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.621862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.621917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.621985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.622052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.622123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.622174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.622231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.622280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.622339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.622390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.622450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.622496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.622552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.622601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.622656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.622706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.622763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.622812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.622868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.622915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.622974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.623025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.623081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.623126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.623180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.623231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.623287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.623332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.624008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.624573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:48.645121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:48.654842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:48.654892Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:48.654911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:48.654933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:48.654962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 980 [2:7561402060815158565:9248]
2025-10-15T11:01:48.655021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:48.655085Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:48.655101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:48.655115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:48.655126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:48.655180Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:48.655216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:48.655241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:48.670344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.670372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.670383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.670394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:48.670665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:48.670689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.670834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.670951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 980
2025-10-15T11:01:48.670967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 980
2025-10-15T11:01:48.671021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.671249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:48.671336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402058015468596:5756], now have 1 active actors on pipe
2025-10-15T11:01:48.671380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402058015468538:2467], now have 1 active actors on pipe
2025-10-15T11:01:48.671446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:48.671472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:48.671510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402060815158560:9248]
2025-10-15T11:01:48.671532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402060815158560:9248]
2025-10-15T11:01:48.671546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402060815158560:9248]
2025-10-15T11:01:48.671584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:48.671613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:48.671624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:48.671637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:48.671665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:48.671847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:48.671873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:48.671943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:48.671978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:48.672000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:48.672011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:48.672049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:48.672097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:48.672224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402060815158560:9248]
2025-10-15T11:01:48.672260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:48.672305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:48.672369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:48.672835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402058015468602:9630]
2025-10-15T11:01:48.672927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:48.672967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:48.673063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:48.673298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402058015468602:9630], now have 1 active actors on pipe
2025-10-15T11:01:48.673355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 981 partition: 0 MaxSeqNo: 46 sessionId: src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0
2025-10-15T11:01:48.673435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 980, pipe: [1:7561402058015468602:9630]
2025-10-15T11:01:48.675868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7357f5ba-bfdfa5b1-5db31e7f-d035288_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:48.697051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0] Write session: try to update token
2025-10-15T11:01:48.697109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:48.706280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:48.706319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:48.706360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402060815158560:9248]
2025-10-15T11:01:48.706488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:48.706510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:48.708976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:48.710839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:48.712556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:48.714001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:48.716318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:48.717019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:48.763952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:48.763998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:48.764010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:48.764076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:48.764092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:48.764107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:48.764119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:48.764163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402060815158560:9248]
2025-10-15T11:01:48.764204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402060815158560:9248]
2025-10-15T11:01:48.764237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402060815158560:9248]
2025-10-15T11:01:48.764390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:48.764378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:48.764439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:48.764439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:48.764476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:48.766384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:48.790265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId: src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:48.813710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:48.906910Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:48.908184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:48.908222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:48.908761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:48.908786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:48.908813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402058015468602:9630]
2025-10-15T11:01:48.908931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:48.909071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:48.922567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 981 reason: error at write: Disconnected sessionId: src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0
2025-10-15T11:01:48.922946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 981 sessionId: src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0 is DEAD
2025-10-15T11:01:48.923468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:48.923521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0] Write session will restart in 0.009710s
2025-10-15T11:01:48.923698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0] Write session: Do CDS request
2025-10-15T11:01:48.923751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:48.937130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:48.937175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 982
2025-10-15T11:01:48.937331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:48.938008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:48.938201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:48.938231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:48.938247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:48.940182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 982 sessionId:  describe result for acl check
2025-10-15T11:01:48.940333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:48.940365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:48.940382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:48.940405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402058015468634:5744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:48.943665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402058015468634:5744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:48.945342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:48.948140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:48.948921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:48.948949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:48.948985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:48.949218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:48.949403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402060815158632:9250]
2025-10-15T11:01:48.950238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402058015468634:5744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:48.952182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:48.952983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:48.953214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:48.954557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:48.954878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.954900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.954906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.954913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.954920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.954926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.954933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.954941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.954948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.954954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.954961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.954969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.954978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.954984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.955029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.955129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.955176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.955219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.955263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.955309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.955379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.955425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.955474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.955526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.955574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.955623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.955673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.955718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.955765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.955828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:48.955889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.955940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:48.955990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.956044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:48.956097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.956149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:48.956200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.956255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:48.956305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.956356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:48.956410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.956476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:48.956527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.956584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:48.956635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.956693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:48.956736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.956793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:48.956845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.956899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:48.957801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402058015468634:5744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:48.957845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402058015468634:5744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:48.957864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402058015468634:5744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:48.957898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:48.956951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.957036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.957103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.957172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.957246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.957300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.957821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:48.973439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:48.996232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:48.996280Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:48.996296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:48.996313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:48.996339Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 981 [2:7561402060815158632:9250]
2025-10-15T11:01:48.996392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:48.996465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:48.996486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:48.996499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:48.996516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:48.996599Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:48.996658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:48.996709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:48.999087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.999117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.999132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.999145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:48.999431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:48.999459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:48.999661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:48.999953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:48.999914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 981
2025-10-15T11:01:48.999931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 981
2025-10-15T11:01:49.000212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:49.000304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402058015468667:5744], now have 1 active actors on pipe
2025-10-15T11:01:49.000337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402058015468607:2467], now have 1 active actors on pipe
2025-10-15T11:01:49.000393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:49.000431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:49.000487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402060815158627:9250]
2025-10-15T11:01:49.000507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402060815158627:9250]
2025-10-15T11:01:49.000520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402060815158627:9250]
2025-10-15T11:01:49.000560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:49.000602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:49.000630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:49.000636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:49.000642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:49.000820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:49.000845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:49.000915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12118383-7e926ca2-d9650688-d4fcb30d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:49.000952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:49.000974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:49.000985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:49.001024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:49.001074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:49.001212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402060815158627:9250]
2025-10-15T11:01:49.001248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:49.001284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:49.001299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:49.001745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:49.001773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:49.001847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:49.002142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 982 partition: 0 MaxSeqNo: 46 sessionId: src_id|12118383-7e926ca2-d9650688-d4fcb30d_0
2025-10-15T11:01:49.002826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93bdb2bd-3ae5e28c-8b143889-e17f4e25_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|12118383-7e926ca2-d9650688-d4fcb30d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:49.009247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402062310435973:9630]
2025-10-15T11:01:49.009757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402062310435973:9630], now have 1 active actors on pipe
2025-10-15T11:01:49.009840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 981, pipe: [1:7561402062310435973:9630]
2025-10-15T11:01:49.026090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12118383-7e926ca2-d9650688-d4fcb30d_0] Write session: try to update token
2025-10-15T11:01:49.026149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12118383-7e926ca2-d9650688-d4fcb30d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:49.035332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:49.035384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:49.035433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402060815158627:9250]
2025-10-15T11:01:49.035579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:49.035596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:49.037822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:49.058332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:49.059709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:49.061134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:49.063195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:49.063605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:49.118906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:49.118940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:49.118950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:49.119005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:49.119019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:49.119035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:49.119045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:49.119086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402060815158627:9250]
2025-10-15T11:01:49.119112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402060815158627:9250]
2025-10-15T11:01:49.119137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402060815158627:9250]
2025-10-15T11:01:49.119239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:49.119274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:49.119284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:49.119298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:49.119304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:49.121388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:49.122453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId: src_id|12118383-7e926ca2-d9650688-d4fcb30d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:49.144866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1015 11:01:49.249223483  821070 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:01:49.250580Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:01:49.267293Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:49.272846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:49.272893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:49.273536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:49.274540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402062310435973:9630]
2025-10-15T11:01:49.274693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:49.275842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:49.291038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 982 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12118383-7e926ca2-d9650688-d4fcb30d_0
2025-10-15T11:01:49.291332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 982 sessionId: src_id|12118383-7e926ca2-d9650688-d4fcb30d_0 is DEAD
2025-10-15T11:01:49.291811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12118383-7e926ca2-d9650688-d4fcb30d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:49.291886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12118383-7e926ca2-d9650688-d4fcb30d_0] Write session will restart in 0.009199s
2025-10-15T11:01:49.292092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12118383-7e926ca2-d9650688-d4fcb30d_0] Write session: Do CDS request
2025-10-15T11:01:49.292139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12118383-7e926ca2-d9650688-d4fcb30d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:49.306462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12118383-7e926ca2-d9650688-d4fcb30d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:49.307615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:49.307647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 983
2025-10-15T11:01:49.307943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:49.308056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:49.308071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:49.308082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:49.309714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 983 sessionId:  describe result for acl check
2025-10-15T11:01:49.309863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:49.309880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:49.309893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:49.309914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402062310436006:5740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:49.312538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402062310436006:5740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:49.318475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402062310436006:5740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:49.324582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:49.328321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402062310436006:5740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:49.328363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402062310436006:5740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:49.328381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402062310436006:5740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:49.328443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:49.328245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:49.329099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:49.329116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:49.329159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:49.329403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:49.329572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402065110126017:9259]
2025-10-15T11:01:49.331783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:49.332808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:49.333054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:49.334371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:49.334701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:49.334711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:49.334719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:49.334726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:49.334734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:49.334741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:49.334746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:49.334752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:49.334759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:49.334766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:49.334773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:49.334780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.334788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.334794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.334842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:49.334950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:49.334999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:49.335047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:49.335093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:49.335140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:49.335188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:49.335234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:49.335279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:49.335323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:49.335389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:49.335439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.335485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.335530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.335573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:49.335638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:49.335696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:49.335750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:49.335797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:49.335852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:49.335898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:49.335955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:49.336007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:49.336059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:49.336106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:49.336162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:49.336211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:49.336266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:49.336312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:49.336369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:49.336419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:49.336489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:49.336533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:49.336588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:49.336634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:49.336687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:49.336729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.336783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.336829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.336884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.336946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.336998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.337511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:49.362507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:49.372182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:49.372231Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:49.372248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:49.372266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:49.372290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 982 [2:7561402065110126017:9259]
2025-10-15T11:01:49.372337Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:49.372393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:49.372405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:49.372415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:49.372439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:49.372486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:49.372509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:49.372531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:49.374368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.374395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.374408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.374420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:49.374688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:49.374715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.374851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.374861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402062310436063:9630]
2025-10-15T11:01:49.375036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.375269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:49.375775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 982
2025-10-15T11:01:49.375857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 982
2025-10-15T11:01:49.375936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 982, pipe: [1:7561402062310436063:9630]
2025-10-15T11:01:49.375524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402065110126012:9259]
2025-10-15T11:01:49.375550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402065110126012:9259]
2025-10-15T11:01:49.375563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402065110126012:9259]
2025-10-15T11:01:49.375598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:49.375678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:49.375853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:49.375870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:49.375915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402062310436050:5740], now have 1 active actors on pipe
2025-10-15T11:01:49.375939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402062310435993:2467], now have 1 active actors on pipe
2025-10-15T11:01:49.375961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402062310436063:9630], now have 1 active actors on pipe
2025-10-15T11:01:49.376071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402065110126012:9259]
2025-10-15T11:01:49.376073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:49.376088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:49.376091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:49.376107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:49.376131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:49.376942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:49.376971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:49.377057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:49.377091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:49.377108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:49.377117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:49.377168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:49.377213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:49.377264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:49.379956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:49.379984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:49.380055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:49.380449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 983 partition: 0 MaxSeqNo: 46 sessionId: src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0
2025-10-15T11:01:49.383552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12118383-7e926ca2-d9650688-d4fcb30d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:49.414498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0] Write session: try to update token
2025-10-15T11:01:49.414584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:49.417219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:49.417254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:49.417291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402065110126012:9259]
2025-10-15T11:01:49.417415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:49.418144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:49.419473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:49.421552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:49.422991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:49.424332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:49.426085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:49.446619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:49.481211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:49.481239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:49.481251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:49.481262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:49.481303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402065110126012:9259]
2025-10-15T11:01:49.481331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402065110126012:9259]
2025-10-15T11:01:49.481357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402065110126012:9259]
2025-10-15T11:01:49.481477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:49.481520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:49.481529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:49.481542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:49.481553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:49.481554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:49.481599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:49.481618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:49.483124Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:49.512121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId: src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:49.533309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:49.647994Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:49.650088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:49.650125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:49.652888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:49.653097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:49.650814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:49.671921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402062310436063:9630]
2025-10-15T11:01:49.672092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 983 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0
2025-10-15T11:01:49.672491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 983 sessionId: src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0 is DEAD
2025-10-15T11:01:49.675773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:49.675811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0] Write session will restart in 0.008636s
2025-10-15T11:01:49.675908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0] Write session: Do CDS request
2025-10-15T11:01:49.675937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:49.694203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:49.693359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:49.693391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 984
2025-10-15T11:01:49.694836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:49.694958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:49.694973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:49.694990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:49.696284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 984 sessionId:  describe result for acl check
2025-10-15T11:01:49.696394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:49.696404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:49.696413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:49.696439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402062310436111:5724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:49.698686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402062310436111:5724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:49.703667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:49.705188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402062310436111:5724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:49.707944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:49.708781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:49.708809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:49.708850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:49.709104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:49.709287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402065110126101:9267]
2025-10-15T11:01:49.711552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:49.712660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:49.712901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:49.712554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402062310436111:5724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:49.712593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402062310436111:5724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:49.712610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402062310436111:5724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:49.712641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:49.714104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:49.714410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:49.714428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:49.714434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:49.714441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:49.714447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:49.714455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:49.714461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:49.714469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:49.714475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:49.714482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:49.714488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:49.714495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.714500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.714506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.714550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:49.714648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:49.714693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:49.714740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:49.714801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:49.714861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:49.714914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:49.714965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:49.715025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:49.715072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:49.715113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:49.715161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.715207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.715252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.715300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:49.715384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:49.715443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:49.715495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:49.715538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:49.715587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:49.715628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:49.715677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:49.715720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:49.715771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:49.716067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:49.716125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:49.716171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:49.716234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:49.716284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:49.716334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:49.716376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:49.716440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:49.716491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:49.716542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:49.716586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:49.716637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:49.716678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.716729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.716772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.716826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.716867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.716991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.717493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:49.737944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:49.748390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:49.748448Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:49.748465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:49.748483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:49.748509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 983 [2:7561402065110126101:9267]
2025-10-15T11:01:49.748558Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:49.748615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:49.748627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:49.748638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:49.748649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:49.748695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:49.748718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:49.748740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:49.750226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.750254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.750268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.750279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:49.750539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:49.750563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:49.750700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:49.750851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 983
2025-10-15T11:01:49.750885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:49.750938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 983
2025-10-15T11:01:49.751118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:49.751207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402062310436154:5724], now have 1 active actors on pipe
2025-10-15T11:01:49.751236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402062310436090:2467], now have 1 active actors on pipe
2025-10-15T11:01:49.751263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402065110126096:9267]
2025-10-15T11:01:49.751279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402065110126096:9267]
2025-10-15T11:01:49.751291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402065110126096:9267]
2025-10-15T11:01:49.751334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:49.751422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:49.751444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:49.751456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:49.751545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:49.751730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:49.751755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:49.751814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:49.751837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:49.751969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402065110126096:9267]
2025-10-15T11:01:49.752006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:49.752060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:49.752074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:49.752106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:49.752123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:49.752133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:49.752169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:49.752213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:49.752350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:49.753116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:49.753146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:49.753208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:49.753566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 984 partition: 0 MaxSeqNo: 46 sessionId: src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0
2025-10-15T11:01:49.754420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0c11b1-7992d794-f806e59a-3e2fe1cb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:49.772120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402062310436162:9630]
2025-10-15T11:01:49.774696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0] Write session: try to update token
2025-10-15T11:01:49.774750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:49.778225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402062310436162:9630], now have 1 active actors on pipe
2025-10-15T11:01:49.778321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 983, pipe: [1:7561402062310436162:9630]
2025-10-15T11:01:49.846498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId: src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:49.851400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:49.851451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:49.851465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:49.851477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:49.851522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402065110126096:9267]
2025-10-15T11:01:49.851561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402065110126096:9267]
2025-10-15T11:01:49.851590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402065110126096:9267]
2025-10-15T11:01:49.851839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:49.851853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:49.851866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:49.851901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:49.851919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:49.851937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:49.851942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:49.851966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:49.853347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:49.873881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:50.001059Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:50.019862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:50.019904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:50.019977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:50.019990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:50.020026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402065110126096:9267]
2025-10-15T11:01:50.020321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:50.020601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:50.021812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:50.021831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:50.021855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:50.022148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402062310436162:9630]
2025-10-15T11:01:50.030862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 984 reason: error at write: Disconnected sessionId: src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0
2025-10-15T11:01:50.031208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 984 sessionId: src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0 is DEAD
2025-10-15T11:01:50.031512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:50.031552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0] Write session will restart in 0.007566s
2025-10-15T11:01:50.031675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0] Write session: Do CDS request
2025-10-15T11:01:50.031722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:50.043397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:50.043429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 985
2025-10-15T11:01:50.043661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:50.046055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:50.046207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:50.046223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:50.046232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:50.048200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 985 sessionId:  describe result for acl check
2025-10-15T11:01:50.048345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:50.048364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:50.048375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:50.048393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402066605403490:5707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:50.051198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402066605403490:5707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:50.061895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402066605403490:5707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:50.068909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402066605403490:5707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:50.068949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402066605403490:5707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:50.068966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402066605403490:5707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:50.068994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:50.075063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:50.078701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:50.079610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:50.079641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:50.079689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:50.079955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:50.080151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402069405093473:9271]
2025-10-15T11:01:50.082430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:50.083488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:50.083714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:50.085106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:50.085466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.085484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.085493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.085500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.085508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.085514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.085522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.085530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.085537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.085545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.085554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.085561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.085569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.085577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.085628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.085747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.085801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.085854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.085914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.085964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.086012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.086057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.086105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.086154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.086202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.086253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.086303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.086352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.086420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.086496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.086557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.086616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.086670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.086727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.086775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.086833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.086886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.086945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.086994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.087054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.087104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.087163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.087209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.087264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.087316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.088125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.088195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.088255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.088315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.088382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.088433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.088507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.088565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.088629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.088684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.088748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.089305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:50.105523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:50.121867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402066605403542:9630]
2025-10-15T11:01:50.122189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 984
2025-10-15T11:01:50.122291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 984
2025-10-15T11:01:50.119486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:50.119541Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:50.119559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:50.119581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:50.119610Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 984 [2:7561402069405093473:9271]
2025-10-15T11:01:50.119666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:50.123450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 984, pipe: [1:7561402066605403542:9630]
2025-10-15T11:01:50.119734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:50.119752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:50.119765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:50.119777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:50.119829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:50.119854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:50.119879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:50.121006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.121023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.121037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.121049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:50.121329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:50.121349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.121509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.121712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.121961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:50.122045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402066605403534:5707], now have 1 active actors on pipe
2025-10-15T11:01:50.122071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402066605403480:2467], now have 1 active actors on pipe
2025-10-15T11:01:50.122096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402069405093468:9271]
2025-10-15T11:01:50.122112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402069405093468:9271]
2025-10-15T11:01:50.122127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402069405093468:9271]
2025-10-15T11:01:50.122175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:50.122255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:50.122259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:50.122285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:50.122298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:50.122450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:50.122467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:50.122619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:50.122643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:50.122691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402069405093468:9271]
2025-10-15T11:01:50.124145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 985 partition: 0 MaxSeqNo: 46 sessionId: src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0
2025-10-15T11:01:50.122725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:50.122751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:50.122842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:50.122874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:50.122894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:50.122907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:50.122946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:50.122989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:50.123073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:50.123283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402066605403542:9630], now have 1 active actors on pipe
2025-10-15T11:01:50.123685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:50.123713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:50.123788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:50.124923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7eb7f53-c5a007f8-860eca58-d4ebe11c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:50.144542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0] Write session: try to update token
2025-10-15T11:01:50.144607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:50.188224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:50.188255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:50.188270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:50.188282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:50.188318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402069405093468:9271]
2025-10-15T11:01:50.188345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402069405093468:9271]
2025-10-15T11:01:50.188374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402069405093468:9271]
2025-10-15T11:01:50.188896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:50.188935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:50.188966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:50.237881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:50.237935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:50.241602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:50.245006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId: src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:50.265851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:50.388731Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:50.390181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:50.390199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:50.390247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402069405093468:9271]
2025-10-15T11:01:50.390396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:50.390416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:50.390443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:50.391100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:50.391189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:50.391215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:50.391290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402066605403542:9630]
2025-10-15T11:01:50.391285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:50.402337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 985 reason: error at write: Disconnected sessionId: src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0
2025-10-15T11:01:50.402744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 985 sessionId: src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0 is DEAD
2025-10-15T11:01:50.403162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:50.403230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0] Write session will restart in 0.008761s
2025-10-15T11:01:50.403416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0] Write session: Do CDS request
2025-10-15T11:01:50.403471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:50.424259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:50.424302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 986
2025-10-15T11:01:50.427551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:50.428191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:50.428344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:50.428366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:50.428376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:50.429796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 986 sessionId:  describe result for acl check
2025-10-15T11:01:50.429913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:50.429923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:50.429932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:50.429950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402066605403584:5692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:50.432788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402066605403584:5692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:50.440341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:50.448518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402066605403584:5692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:50.449649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:50.450438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:50.450469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:50.450510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:50.450749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:50.450935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402069405093557:9275]
2025-10-15T11:01:50.453100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:50.454148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:50.454411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:50.455738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:50.456091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.456109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.456116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.456122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.456131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.456138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.456145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.456152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.456159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.456167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.456174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.456180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.456187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.456196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.456246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.456359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.456408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.456469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.456526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.456573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.456620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.456673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.456725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.456776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.456830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.456883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.456934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.456987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.457036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.457109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.457175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.457239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.457293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.457353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.457403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.457470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.457523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.457583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.457633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.457689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.457740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.457799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.457847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.457905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.457958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.458014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.458059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.458115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.458175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.458234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.458284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.458344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.458395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.458454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.458506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.458558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.459058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:50.463014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402066605403584:5692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:50.463052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402066605403584:5692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:50.463068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402066605403584:5692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:50.463094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:50.474921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:50.483907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:50.483952Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:50.483966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:50.483979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:50.483994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 985 [2:7561402069405093557:9275]
2025-10-15T11:01:50.484024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:50.484073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:50.484086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:50.484095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:50.484102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:50.484142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:50.484161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:50.484178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:50.485598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.485619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.485627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.485634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:50.485808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:50.485822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.485902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.486037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.486149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 985
2025-10-15T11:01:50.486182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 985
2025-10-15T11:01:50.486241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:50.486314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402066605403568:2467], now have 1 active actors on pipe
2025-10-15T11:01:50.486337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402066605403633:5692], now have 1 active actors on pipe
2025-10-15T11:01:50.486361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402069405093552:9275]
2025-10-15T11:01:50.486380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402069405093552:9275]
2025-10-15T11:01:50.486392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402069405093552:9275]
2025-10-15T11:01:50.486424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:50.486462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:50.486486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:50.486496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:50.486538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:50.486555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:50.486587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:50.486728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:50.486748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:50.486881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94db41f-59799c07-18903329-6f386f88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:50.486913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:50.486928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:50.486937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:50.486966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:50.486994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:50.487014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402069405093552:9275]
2025-10-15T11:01:50.487033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:50.487066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:50.487083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:50.487502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:50.487526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:50.487580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:50.487797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 986 partition: 0 MaxSeqNo: 46 sessionId: src_id|94db41f-59799c07-18903329-6f386f88_0
2025-10-15T11:01:50.490952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402066605403638:9630]
2025-10-15T11:01:50.491529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 985, pipe: [1:7561402066605403638:9630]
2025-10-15T11:01:50.491689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b1f873-9f646413-1db0dc3e-32bd8eba_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|94db41f-59799c07-18903329-6f386f88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:50.491405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402066605403638:9630], now have 1 active actors on pipe
2025-10-15T11:01:50.517651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:50.517686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:50.517716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402069405093552:9275]
2025-10-15T11:01:50.517824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:50.517835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:50.519767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:50.519871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94db41f-59799c07-18903329-6f386f88_0] Write session: try to update token
2025-10-15T11:01:50.519960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94db41f-59799c07-18903329-6f386f88_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:50.521231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:50.524532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:50.533573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:50.535551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:50.536296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:50.586788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:50.586827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:50.586841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:50.586851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:50.586891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402069405093552:9275]
2025-10-15T11:01:50.586921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402069405093552:9275]
2025-10-15T11:01:50.586943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402069405093552:9275]
2025-10-15T11:01:50.587058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:50.587103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:50.587117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:50.587130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:50.587139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:50.587141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:50.587187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:50.587208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:50.590649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:50.619479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId: src_id|94db41f-59799c07-18903329-6f386f88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:50.650369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:50.741586Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:50.744166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:50.744204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:50.747388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:50.747431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402066605403638:9630]
2025-10-15T11:01:50.747598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:50.747630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:50.746106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:50.757838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 986 reason: error at write: Disconnected sessionId: src_id|94db41f-59799c07-18903329-6f386f88_0
2025-10-15T11:01:50.758209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 986 sessionId: src_id|94db41f-59799c07-18903329-6f386f88_0 is DEAD
2025-10-15T11:01:50.758603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94db41f-59799c07-18903329-6f386f88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:50.758641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94db41f-59799c07-18903329-6f386f88_0] Write session will restart in 0.006732s
2025-10-15T11:01:50.758778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94db41f-59799c07-18903329-6f386f88_0] Write session: Do CDS request
2025-10-15T11:01:50.758830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94db41f-59799c07-18903329-6f386f88_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:50.780965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94db41f-59799c07-18903329-6f386f88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:50.780942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:50.780989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 987
2025-10-15T11:01:50.781601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:50.781784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:50.781801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:50.781814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:50.784139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 987 sessionId:  describe result for acl check
2025-10-15T11:01:50.784311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:50.784332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:50.784354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:50.784385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402066605403657:5684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:50.788191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402066605403657:5684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:50.793773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402066605403657:5684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:50.803275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:50.804955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402066605403657:5684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:50.804999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402066605403657:5684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:50.805017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402066605403657:5684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:50.805053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:50.807615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:50.808404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:50.808438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:50.808490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:50.808728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:50.808923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402069405093637:9283]
2025-10-15T11:01:50.810960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:50.811893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:50.812083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:50.813191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:50.813498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.813520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.813527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.813534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.813541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.813547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.813554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.813560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.813567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.813575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.813581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.813588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.813594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.813600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.813642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.813739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.813784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.813828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.813880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.813926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.813969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.814022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.814062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.814112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.814162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.814211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.814254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.814301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.814344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.814409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:50.814466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.814523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:50.814572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.814626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:50.814674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.814729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:50.814781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.814836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:50.814882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.814937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:50.814986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.815041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:50.815089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.815145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:50.815196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.815249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:50.815298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.815368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:50.815430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.815485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:50.815535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.815591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.815641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.815696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.815747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.815797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.816261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:50.841096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:50.847870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402066605403724:9630]
2025-10-15T11:01:50.851580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:50.851627Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:50.851646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:50.851666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:50.851691Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 986 [2:7561402069405093637:9283]
2025-10-15T11:01:50.851744Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:50.851807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:50.851821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:50.851833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:50.851846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:50.851897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:50.851926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:50.851948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:50.854405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 986
2025-10-15T11:01:50.854462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 986, pipe: [1:7561402066605403724:9630]
2025-10-15T11:01:50.854508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 986
2025-10-15T11:01:50.853703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.853730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.853745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.853757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:50.854027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:50.854044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:50.854191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:50.854385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:50.854620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:50.854700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402066605403707:5684], now have 1 active actors on pipe
2025-10-15T11:01:50.854722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402066605403724:9630], now have 1 active actors on pipe
2025-10-15T11:01:50.854745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402066605403645:2467], now have 1 active actors on pipe
2025-10-15T11:01:50.854771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402069405093631:9283]
2025-10-15T11:01:50.854786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402069405093631:9283]
2025-10-15T11:01:50.854799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402069405093631:9283]
2025-10-15T11:01:50.854839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:50.854860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:50.854871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:50.854878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:50.854933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:50.855123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:50.855140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:50.855196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:50.855217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:50.855903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402069405093631:9283]
2025-10-15T11:01:50.855955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:50.856000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:50.856037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:50.856075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:50.856094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:50.856106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:50.856171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:50.856249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:50.856472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:50.856991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:50.857030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:50.857148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:50.857667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 987 partition: 0 MaxSeqNo: 46 sessionId: src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0
2025-10-15T11:01:50.858589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94db41f-59799c07-18903329-6f386f88_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:50.893478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0] Write session: try to update token
2025-10-15T11:01:50.893539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:51.009374Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:51.009403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:51.009413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:51.009420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:51.009442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402069405093631:9283]
2025-10-15T11:01:51.009460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402069405093631:9283]
2025-10-15T11:01:51.009477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402069405093631:9283]
2025-10-15T11:01:51.009570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:51.009614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:51.009621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:51.009633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:51.009640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:51.009645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:51.009684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:51.009702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:51.010665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:51.047465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId: src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:51.067813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:51.152885Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:51.157757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:51.157796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:51.161833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:51.159410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:51.159439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:51.174530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402066605403724:9630]
2025-10-15T11:01:51.174621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:51.174756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 987 reason: error at write: Disconnected sessionId: src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0
2025-10-15T11:01:51.175621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:51.175668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0] Write session will restart in 0.009374s
2025-10-15T11:01:51.175807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0] Write session: Do CDS request
2025-10-15T11:01:51.175855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:51.175478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 987 sessionId: src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0 is DEAD
2025-10-15T11:01:51.191783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:51.203184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:51.203216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 988
2025-10-15T11:01:51.207659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:51.207815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:51.207832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:51.207843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:51.209248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 988 sessionId:  describe result for acl check
2025-10-15T11:01:51.209372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:51.209383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:51.209391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:51.209410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402070900371057:5671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:51.214050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402070900371057:5671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:51.220542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402070900371057:5671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:51.221980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:51.227611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:51.228989Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:51.229042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:51.229124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:51.229702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:51.230075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402073700061019:9290]
2025-10-15T11:01:51.229489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402070900371057:5671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:51.229573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402070900371057:5671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:51.229617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402070900371057:5671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:51.229684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:51.232764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:51.233541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:51.233699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:51.234511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:51.234723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.234735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.234741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.234745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.234750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.234755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.234759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.234764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.234769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.234773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.234778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.234783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.234788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.234792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.234825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.234905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.234940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.234973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.235004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.235035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.235065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.235099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.235131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.235163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.235194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.235224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.235255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.235294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.235321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.235396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.235437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.235476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.235509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.235555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.235588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.235631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.235667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.235708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.235744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.235782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.235820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.235864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.235898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.235941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.235981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.236040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.236076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.236115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.236152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.236195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.236228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.236269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.236306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.236348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.236383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.236424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.236796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:51.253782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:51.275173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402070900371113:9630]
2025-10-15T11:01:51.274545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:51.274581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:51.274595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:51.274610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:51.274630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 987 [2:7561402073700061019:9290]
2025-10-15T11:01:51.274668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:51.274718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:51.274728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:51.274737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:51.274746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:51.274784Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:51.274801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:51.274819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:51.276638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.276658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.276666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.276674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:51.279077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:51.279114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.279234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.279656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 987, pipe: [1:7561402070900371113:9630]
2025-10-15T11:01:51.279704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 987
2025-10-15T11:01:51.279759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 987
2025-10-15T11:01:51.279389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.279641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:51.279689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402070900371037:2467], now have 1 active actors on pipe
2025-10-15T11:01:51.279715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402070900371096:5671], now have 1 active actors on pipe
2025-10-15T11:01:51.279738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402070900371113:9630], now have 1 active actors on pipe
2025-10-15T11:01:51.279808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402073700061013:9290]
2025-10-15T11:01:51.279822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402073700061013:9290]
2025-10-15T11:01:51.279835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402073700061013:9290]
2025-10-15T11:01:51.279879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:51.279968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:51.279997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:51.280011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:51.280023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:51.280163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:51.280181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:51.280318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:51.280333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:51.280358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402073700061013:9290]
2025-10-15T11:01:51.280383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:51.280515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:51.280547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:51.280567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:51.280578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:51.280617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:51.280660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:51.280751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:51.280869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:51.282350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:51.282384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:51.282449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:51.282740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 988 partition: 0 MaxSeqNo: 46 sessionId: src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0
2025-10-15T11:01:51.283740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8f5aad6-4a73b672-ba83be56-5b867365_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:51.329184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0] Write session: try to update token
2025-10-15T11:01:51.329243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:51.354741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:51.354776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:51.354791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:51.354803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:51.354838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402073700061013:9290]
2025-10-15T11:01:51.354867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402073700061013:9290]
2025-10-15T11:01:51.354892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402073700061013:9290]
2025-10-15T11:01:51.355027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:51.355038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:51.355057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:51.355070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:51.355091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:51.356242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:51.412545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId: src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:51.448872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:51.502226Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:51.503843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:51.503881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:51.506150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:51.506060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:51.506148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402070900371113:9630]
2025-10-15T11:01:51.506244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:51.506257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:51.520349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 988 reason: error at write: Disconnected sessionId: src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0
2025-10-15T11:01:51.521135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:51.521215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0] Write session will restart in 0.008121s
2025-10-15T11:01:51.521371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0] Write session: Do CDS request
2025-10-15T11:01:51.521418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:51.520716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 988 sessionId: src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0 is DEAD
2025-10-15T11:01:51.533632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:51.533479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:51.533522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 989
2025-10-15T11:01:51.534341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:51.534547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:51.534575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:51.534590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:51.537663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 989 sessionId:  describe result for acl check
2025-10-15T11:01:51.537778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:51.537788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:51.537797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:51.537814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402070900371152:5649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:51.540597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402070900371152:5649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:51.546588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402070900371152:5649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:51.553138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402070900371152:5649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:51.553276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402070900371152:5649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:51.553296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402070900371152:5649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:51.553323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:51.556046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:51.562299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:51.563248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:51.563282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:51.563326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:51.563678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:51.563873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402073700061114:9296]
2025-10-15T11:01:51.566213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:51.567367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:51.567612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:51.569023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:51.569387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.569411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.569418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.569426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.569434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.569440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.569448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.569457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.569465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.569472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.569481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.569489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.569496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.569504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.569556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.569680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.569732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.569783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.569847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.569904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.569959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.570010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.570083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.570142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.570198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.570254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.570308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.570362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.570415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.570498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.570568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.570633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.570706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.570775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.570832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.570900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.570960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.571022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.571081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.571144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.571201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.571266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.571316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.571389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.571442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.571500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.571549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.571646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.571697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.571756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.571806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.571864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.571917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.571974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.572022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.572092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.572661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:51.601029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:51.606096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402070900371209:9630]
2025-10-15T11:01:51.610116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:51.612484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 988, pipe: [1:7561402070900371209:9630]
2025-10-15T11:01:51.612504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 988
2025-10-15T11:01:51.612619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 988
2025-10-15T11:01:51.610299Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:51.610325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:51.610346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:51.610372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 988 [2:7561402073700061114:9296]
2025-10-15T11:01:51.610431Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:51.610499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:51.610515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:51.610529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:51.610542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:51.610595Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:51.610621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:51.610646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:51.611705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.611722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.611738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.611751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:51.612038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:51.612057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.612212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.612441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.612709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:51.612798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402070900371209:9630], now have 1 active actors on pipe
2025-10-15T11:01:51.612825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402070900371197:5649], now have 1 active actors on pipe
2025-10-15T11:01:51.612847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402070900371136:2467], now have 1 active actors on pipe
2025-10-15T11:01:51.612900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:51.612922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:51.612962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402073700061109:9296]
2025-10-15T11:01:51.612977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402073700061109:9296]
2025-10-15T11:01:51.612991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402073700061109:9296]
2025-10-15T11:01:51.613036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:51.613080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:51.613105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:51.613113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:51.613115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:51.613317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:51.613336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:51.613421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:51.613453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:51.613471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:51.613483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:51.613521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:51.613565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:51.613693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402073700061109:9296]
2025-10-15T11:01:51.613725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:51.613768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:51.613777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:51.614415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:51.614439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:51.614510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:51.614793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 989 partition: 0 MaxSeqNo: 46 sessionId: src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0
2025-10-15T11:01:51.615469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e4512bf-cb156bc4-c61bbe0b-b0bc3e65_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:51.642281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0] Write session: try to update token
2025-10-15T11:01:51.642338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:51.652051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:51.652086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:51.652119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402073700061109:9296]
2025-10-15T11:01:51.652231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:51.652249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:51.654479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:51.655677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:51.657185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:51.658652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:51.660605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:51.661094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:51.703932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:51.703965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:51.703978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:51.703988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:51.704023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402073700061109:9296]
2025-10-15T11:01:51.704048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402073700061109:9296]
2025-10-15T11:01:51.704071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402073700061109:9296]
2025-10-15T11:01:51.704205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:51.704231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:51.704919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:51.704957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:51.704982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:51.705632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:51.731446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId: src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:51.771606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:51.845350Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:51.846709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:51.846745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:51.847490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:51.847950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402070900371209:9630]
2025-10-15T11:01:51.848057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:51.848075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:51.848090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:51.875651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 989 reason: error at write: Disconnected sessionId: src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0
2025-10-15T11:01:51.875941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 989 sessionId: src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0 is DEAD
2025-10-15T11:01:51.876426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:51.876503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0] Write session will restart in 0.009908s
2025-10-15T11:01:51.876697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0] Write session: Do CDS request
2025-10-15T11:01:51.876769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:51.890807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:51.890978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:51.891015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 990
2025-10-15T11:01:51.891150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:51.891877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:51.892102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:51.892131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:51.892154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:51.893928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 990 sessionId:  describe result for acl check
2025-10-15T11:01:51.894013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:51.894023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:51.894030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:51.894046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402070900371253:5643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:51.896666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402070900371253:5643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:51.897154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:51.897820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:51.897848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:51.897877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:51.898077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:51.898247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402073700061197:9298]
2025-10-15T11:01:51.900052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:51.900892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:51.901094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:51.901558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402070900371253:5643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:51.902269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:51.902538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.902551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.902555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.902559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.902563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.902568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.902571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.902575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.902579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.902584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.902590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.902596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.902602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.902609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.902653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.902723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.902753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.902791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.902821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.902866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.902897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.902923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.902959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.902987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.903019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.903051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.903082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.903118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.903145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.903189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:51.903227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.903261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:51.903293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.903329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:51.903387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.903428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:51.903459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.903496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:51.903526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.903562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:51.903591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.903635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:51.903668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.903706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:51.903739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.903770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:51.903799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.903836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:51.903879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.903926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:51.903966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.904001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.904033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.904068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.904104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.904153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.904577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:51.913623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402070900371253:5643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:51.913658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402070900371253:5643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:51.913672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402070900371253:5643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:51.913698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:51.921408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:51.931295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:51.931336Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:51.931367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:51.931383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:51.931404Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 989 [2:7561402073700061197:9298]
2025-10-15T11:01:51.931453Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:51.931502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:51.931514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:51.931526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:51.931536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:51.931577Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:51.931598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:51.931617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:51.933281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.933310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.933322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.933332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:51.933616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:51.933644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:51.933778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:51.933858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 989
2025-10-15T11:01:51.933864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 989
2025-10-15T11:01:51.933979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:51.934211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:51.934295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402070900371287:5643], now have 1 active actors on pipe
2025-10-15T11:01:51.934323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402070900371216:2467], now have 1 active actors on pipe
2025-10-15T11:01:51.934382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:51.934407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:51.934441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402073700061183:9298]
2025-10-15T11:01:51.934459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402073700061183:9298]
2025-10-15T11:01:51.934472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402073700061183:9298]
2025-10-15T11:01:51.934504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:51.934532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:51.934566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:51.934569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:51.934583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:51.934733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:51.934762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:51.934830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98169baa-e98de204-d7de947c-15d076ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:51.934864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:51.934886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:51.934896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:51.934933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:51.934976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:51.935107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402073700061183:9298]
2025-10-15T11:01:51.935141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:51.935162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:51.935185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:51.935679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:51.935727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:51.935788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:51.936080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 990 partition: 0 MaxSeqNo: 46 sessionId: src_id|98169baa-e98de204-d7de947c-15d076ea_0
2025-10-15T11:01:51.936767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261a61ce-e7e5d736-7fcb2e21-f18ea7be_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|98169baa-e98de204-d7de947c-15d076ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:51.948136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402070900371292:9630]
2025-10-15T11:01:51.948596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402070900371292:9630], now have 1 active actors on pipe
2025-10-15T11:01:51.948675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 989, pipe: [1:7561402070900371292:9630]
2025-10-15T11:01:51.961271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98169baa-e98de204-d7de947c-15d076ea_0] Write session: try to update token
2025-10-15T11:01:51.961324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98169baa-e98de204-d7de947c-15d076ea_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:51.984558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:51.984588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:51.984619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402073700061183:9298]
2025-10-15T11:01:51.984735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:51.984745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:51.986568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:51.987949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:51.989446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:51.991072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:51.993360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:51.994379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:52.052310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:52.052360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:52.052378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:52.052439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:52.052478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:52.052509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:52.052532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:52.052587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402073700061183:9298]
2025-10-15T11:01:52.052614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402073700061183:9298]
2025-10-15T11:01:52.052655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402073700061183:9298]
2025-10-15T11:01:52.052796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:52.052823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:52.052850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:52.052852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:52.052886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:52.055231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:52.058935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId: src_id|98169baa-e98de204-d7de947c-15d076ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:52.079901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:52.194008Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:52.201635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:52.201684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:52.202386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:52.202546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:52.202571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:52.203216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:52.203468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402070900371292:9630]
2025-10-15T11:01:52.215032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 990 reason: error at write: Disconnected sessionId: src_id|98169baa-e98de204-d7de947c-15d076ea_0
2025-10-15T11:01:52.215324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 990 sessionId: src_id|98169baa-e98de204-d7de947c-15d076ea_0 is DEAD
2025-10-15T11:01:52.215763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98169baa-e98de204-d7de947c-15d076ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:52.215797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98169baa-e98de204-d7de947c-15d076ea_0] Write session will restart in 0.009118s
2025-10-15T11:01:52.215891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98169baa-e98de204-d7de947c-15d076ea_0] Write session: Do CDS request
2025-10-15T11:01:52.215954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98169baa-e98de204-d7de947c-15d076ea_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:52.230194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98169baa-e98de204-d7de947c-15d076ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:52.231102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:52.231147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 991
2025-10-15T11:01:52.231494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:52.231613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:52.231631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:52.231642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:52.232953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 991 sessionId:  describe result for acl check
2025-10-15T11:01:52.233053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:52.233070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:52.233079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:52.233094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402075195338609:5642] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:52.235991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402075195338609:5642] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:52.241991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402075195338609:5642] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:52.248496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402075195338609:5642] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:52.248532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402075195338609:5642] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:52.248548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402075195338609:5642] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:52.248573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:52.257523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:52.260059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:52.260889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:52.260914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:52.260951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:52.261171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:52.261346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402077995028568:9306]
2025-10-15T11:01:52.263206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:52.264183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:52.264366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:52.265260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:52.265552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:52.265564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:52.265568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:52.265573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:52.265581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:52.265588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:52.265591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:52.265595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:52.265599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:52.265603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:52.265607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:52.265611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.265615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.265619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.265650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:52.265727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:52.265767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:52.265801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:52.265840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:52.265889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:52.265917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:52.265955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:52.265999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:52.266029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:52.266058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:52.266087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.266119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.266151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.266177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:52.266231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:52.266272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:52.266311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:52.266346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:52.266382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:52.266413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:52.266464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:52.266505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:52.266543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:52.266575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:52.266633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:52.266670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:52.266712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:52.266749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:52.266794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:52.266839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:52.266891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:52.266931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:52.266979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:52.267025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:52.267062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:52.267095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.267132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.267165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.267201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.267240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.267302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.267720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:52.284438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:52.302339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:52.302409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402075195338696:9630]
2025-10-15T11:01:52.302381Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:52.302395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:52.302413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:52.302437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 990 [2:7561402077995028568:9306]
2025-10-15T11:01:52.302484Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:52.302535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:52.302548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:52.302561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:52.302571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:52.302612Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:52.302632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:52.302651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:52.304530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.304565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.304577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.304587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:52.304829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:52.304854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.304973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.305146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.305363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:52.305433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402077995028563:9306]
2025-10-15T11:01:52.305452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402077995028563:9306]
2025-10-15T11:01:52.305465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402077995028563:9306]
2025-10-15T11:01:52.305500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:52.305573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:52.305605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:52.305628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:52.305644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:52.305739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:52.305762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:52.305905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402077995028563:9306]
2025-10-15T11:01:52.305939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:52.305984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402075195338596:2467], now have 1 active actors on pipe
2025-10-15T11:01:52.306001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:52.306008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402075195338654:5642], now have 1 active actors on pipe
2025-10-15T11:01:52.306030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402075195338696:9630], now have 1 active actors on pipe
2025-10-15T11:01:52.307590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:52.307625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:52.307720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:52.307750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:52.307765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:52.307778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:52.307823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:52.307858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:52.307897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:52.308848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:52.308877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:52.308938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:52.310179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98169baa-e98de204-d7de947c-15d076ea_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:52.307046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 990
2025-10-15T11:01:52.307156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 990
2025-10-15T11:01:52.307210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 990, pipe: [1:7561402075195338696:9630]
2025-10-15T11:01:52.309290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 991 partition: 0 MaxSeqNo: 46 sessionId: src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0
2025-10-15T11:01:52.339075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0] Write session: try to update token
2025-10-15T11:01:52.339128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:52.352609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:52.352635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:52.352663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402077995028563:9306]
2025-10-15T11:01:52.352778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:52.354806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:52.355698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:52.356212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:52.357676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:52.359552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:52.361789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:52.362285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:52.421368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:52.421413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:52.421449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:52.471122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId: src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:52.474986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:52.475017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:52.475027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:52.475035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:52.475066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402077995028563:9306]
2025-10-15T11:01:52.475088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402077995028563:9306]
2025-10-15T11:01:52.475108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402077995028563:9306]
2025-10-15T11:01:52.475233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:52.475250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:52.476725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:52.479504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:52.479550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:52.479578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:52.493017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:52.617146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:52.619078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:52.619108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:52.619674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:52.619822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402075195338696:9630]
2025-10-15T11:01:52.619888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:52.619899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:52.620158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:52.627971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 991 reason: error at write: Disconnected sessionId: src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0
2025-10-15T11:01:52.628284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 991 sessionId: src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0 is DEAD
2025-10-15T11:01:52.629503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:52.629538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0] Write session will restart in 0.009814s
2025-10-15T11:01:52.629629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0] Write session: Do CDS request
2025-10-15T11:01:52.629656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:52.650776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:52.655106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:52.655229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 992
2025-10-15T11:01:52.655525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:52.655626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:52.655640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:52.655651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:52.656996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 992 sessionId:  describe result for acl check
2025-10-15T11:01:52.657098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:52.657113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:52.657123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:52.657138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402075195338717:5622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:52.659256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402075195338717:5622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:52.671977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402075195338717:5622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:52.679604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402075195338717:5622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:52.679650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402075195338717:5622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:52.679668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402075195338717:5622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:52.679700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:52.690455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:52.695117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:52.695875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:52.695917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:52.695958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:52.696149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:52.696319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402077995028680:9315]
2025-10-15T11:01:52.697872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:52.698689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:52.698848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:52.699770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:52.700020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:52.700033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:52.700038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:52.700043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:52.700048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:52.700052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:52.700057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:52.700062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:52.700067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:52.700074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:52.700079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:52.700084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.700090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.700095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.700133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:52.700221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:52.700268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:52.700316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:52.700365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:52.700413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:52.700462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:52.700531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:52.700587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:52.700644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:52.700699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:52.700754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.700810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.700865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.700924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:52.701004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:52.701080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:52.701149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:52.701208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:52.701275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:52.701334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:52.701399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:52.701457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:52.701523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:52.701583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:52.701644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:52.701704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:52.701768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:52.701826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:52.701894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:52.701956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:52.702022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:52.702080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:52.702138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:52.702198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:52.702264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:52.702321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.702385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.702443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.702507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.702563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.702634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.703194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:52.720291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402075195338793:9630]
2025-10-15T11:01:52.733505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:52.742024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:52.742069Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:52.742082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:52.742100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:52.742130Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 991 [2:7561402077995028680:9315]
2025-10-15T11:01:52.742192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:52.742265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:52.742282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:52.742297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:52.742310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:52.742365Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:52.742397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:52.742423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:52.743822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.743857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.743872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.743885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:52.744162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:52.744192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:52.744342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:52.744562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:52.744806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:52.744897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402075195338793:9630], now have 1 active actors on pipe
2025-10-15T11:01:52.744924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402075195338767:5622], now have 1 active actors on pipe
2025-10-15T11:01:52.744948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402075195338709:2467], now have 1 active actors on pipe
2025-10-15T11:01:52.744976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402077995028675:9315]
2025-10-15T11:01:52.744993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402077995028675:9315]
2025-10-15T11:01:52.745008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402077995028675:9315]
2025-10-15T11:01:52.745039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:52.745062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:52.745076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:52.745088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:52.745117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:52.745342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:52.745360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:52.745436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:52.745457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:52.745583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402077995028675:9315]
2025-10-15T11:01:52.745616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:52.745648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:52.745697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:52.745731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:52.745750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:52.745761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:52.745800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:52.745846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:52.745983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:52.744373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 991, pipe: [1:7561402075195338793:9630]
2025-10-15T11:01:52.744526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 991
2025-10-15T11:01:52.744620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 991
2025-10-15T11:01:52.746978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:52.747011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:52.747085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:52.747381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 992 partition: 0 MaxSeqNo: 46 sessionId: src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0
2025-10-15T11:01:52.751822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc8dc224-e03d2c40-5194c96a-38eca370_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:52.791699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:52.791737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:52.791772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402077995028675:9315]
2025-10-15T11:01:52.791884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:52.792027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:52.793858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:52.795192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:52.796383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0] Write session: try to update token
2025-10-15T11:01:52.796429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:52.796735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:52.822898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:52.824809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:52.825293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:52.878092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:52.878122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:52.878135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:52.878188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:52.878202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:52.878214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:52.878225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:52.878263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402077995028675:9315]
2025-10-15T11:01:52.878282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402077995028675:9315]
2025-10-15T11:01:52.878298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402077995028675:9315]
2025-10-15T11:01:52.878406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:52.878407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:52.878430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:52.878451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:52.878487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:52.879444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:52.903809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId: src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:52.926826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:53.016982Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:53.021980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.022027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.022599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:53.022627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:53.022739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:53.023818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:53.024080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402075195338793:9630]
2025-10-15T11:01:53.024149Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T11:01:53.024620Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 10 consumer shared/user session shared/user_1_10_14544789689558060916_v1 is DEAD
2025-10-15T11:01:53.025007Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T11:01:53.025654Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T11:01:53.025701Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T11:01:53.025764Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.007146s
2025-10-15T11:01:53.025078Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401881921785270:9627] disconnected; active server actors: 1
2025-10-15T11:01:53.025125Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561401881921785270:9627] client user disconnected session shared/user_1_10_14544789689558060916_v1
2025-10-15T11:01:53.032042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 992 reason: error at write: Disconnected sessionId: src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0
2025-10-15T11:01:53.032303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 992 sessionId: src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0 is DEAD
2025-10-15T11:01:53.034433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:53.034481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0] Write session will restart in 0.008968s
2025-10-15T11:01:53.034639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0] Write session: Do CDS request
2025-10-15T11:01:53.034700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:53.039902Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T11:01:53.040198Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T11:01:53.040219Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 11
2025-10-15T11:01:53.040601Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 11 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T11:01:53.040809Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T11:01:53.041204Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 auth for : user
2025-10-15T11:01:53.042081Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 Handle describe topics response
2025-10-15T11:01:53.042237Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 auth is DEAD
2025-10-15T11:01:53.042339Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 auth ok: topics# 1, initDone# 0
2025-10-15T11:01:53.043390Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T11:01:53.043625Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_11_4626530766257792469_v1
2025-10-15T11:01:53.043663Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T11:01:53.043715Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561402079490306113:5614] connected; active server actors: 1
2025-10-15T11:01:53.043803Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561402079490306113:5614] session shared/user_1_11_4626530766257792469_v1
2025-10-15T11:01:53.043855Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T11:01:53.043841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T11:01:53.043888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T11:01:53.043926Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_11_4626530766257792469_v1" (Sender=[1:7561402079490306110:5614], Pipe=[1:7561402079490306113:5614], Partitions=[], ActiveFamilyCount=0)
2025-10-15T11:01:53.043952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T11:01:53.043993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T11:01:53.044054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_11_4626530766257792469_v1" (Sender=[1:7561402079490306110:5614], Pipe=[1:7561402079490306113:5614], Partitions=[], ActiveFamilyCount=0)
2025-10-15T11:01:53.044101Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_11_4626530766257792469_v1" sender [1:7561402079490306110:5614] lock partition 0 for ReadingSession "shared/user_1_11_4626530766257792469_v1" (Sender=[1:7561402079490306110:5614], Pipe=[1:7561402079490306113:5614], Partitions=[], ActiveFamilyCount=1) generation 1 step 11
2025-10-15T11:01:53.044147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T11:01:53.044173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000157s
2025-10-15T11:01:53.044883Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 11 Session: "shared/user_1_11_4626530766257792469_v1" ClientId: "user" PipeClient { RawX1: 7561402079490306113 RawX2: 4503603922343406 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T11:01:53.044947Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T11:01:53.044980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T11:01:53.045057Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 got read request: guid# 85ebceda-a9a2e437-317aa387-e8bead7f
2025-10-15T11:01:53.047993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:53.048014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 993
2025-10-15T11:01:53.048292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:53.050560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:53.050674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:53.050695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:53.050704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:53.051990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 993 sessionId:  describe result for acl check
2025-10-15T11:01:53.052083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:53.052092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:53.052101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:53.052116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402079490306124:5596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:53.054328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402079490306124:5596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:53.065262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402079490306124:5596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:53.068915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:53.084269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:53.085696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:53.085729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:53.085772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:53.086027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:53.086214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402082289996052:9319]
2025-10-15T11:01:53.088894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402079490306124:5596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:53.088935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402079490306124:5596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:53.088951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402079490306124:5596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:53.088977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:53.092318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:53.093261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:53.093461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:53.094649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:53.094942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.094957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.094963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.094969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.094976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.094983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.094989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.094996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.095002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.095009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.095016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.095023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.095030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.095037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.095082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.095187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.095235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.095283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.095330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.095401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.095448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.095501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.095545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.095595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.095647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.095698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.095748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.095792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.095837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.095906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.095970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.096029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.096080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.096139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.096189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.096249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.096300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.096360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.096403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.096461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.096529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.096581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.096628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.096686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.096737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.096793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.096842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.096893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.096936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.096989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.097034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.097084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.097131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.097180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.097223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.097277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.097762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:53.114166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:53.123914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:53.123962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:53.123979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:53.123997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:53.124022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 992 [2:7561402082289996052:9319]
2025-10-15T11:01:53.124074Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:53.124132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:53.124148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:53.124160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:53.124172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:53.124217Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:53.124238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:53.124259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:53.125315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.127708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 992
2025-10-15T11:01:53.125330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.125343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.125354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:53.125615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:53.127832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 992
2025-10-15T11:01:53.125632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.125775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.125976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.126203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:53.126282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402079490306103:2467], now have 1 active actors on pipe
2025-10-15T11:01:53.126306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402079490306174:5596], now have 1 active actors on pipe
2025-10-15T11:01:53.127944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 992, pipe: [1:7561402079490306116:5602]
2025-10-15T11:01:53.126329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402079490306116:5602], now have 1 active actors on pipe
2025-10-15T11:01:53.126353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402082289996046:9319]
2025-10-15T11:01:53.126368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402082289996046:9319]
2025-10-15T11:01:53.126380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402082289996046:9319]
2025-10-15T11:01:53.126423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:53.126490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:53.126487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:53.126507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:53.126519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:53.126666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:53.126682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:53.126792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402082289996046:9319]
2025-10-15T11:01:53.126822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:53.126853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:53.128905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.128955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.129022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.129038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.129065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_11_4626530766257792469_v1 on pipe: [1:7561402079490306116:5602]
2025-10-15T11:01:53.129143Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_11_4626530766257792469_v1:1 with generation 992
2025-10-15T11:01:53.129153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:53.129184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:53.129200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:53.129210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:53.129243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:53.129281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:53.129322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:53.129341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:53.129350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:53.129402Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_11_4626530766257792469_v1
2025-10-15T11:01:53.129413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:53.129521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:53.129567Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T11:01:53.133852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.133896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.133989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:53.135122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 993 partition: 0 MaxSeqNo: 46 sessionId: src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0
2025-10-15T11:01:53.139633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddb44c41-2a8a7f4c-ade5a39-88b7c7e2_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:53.140036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T11:01:53.140113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T11:01:53.140136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:53.140147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:53.140157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:53.140198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T11:01:53.140233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T11:01:53.140863Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760526113128 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T11:01:53.140913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T11:01:53.140988Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 sending to client partition status
2025-10-15T11:01:53.165946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0] Write session: try to update token
2025-10-15T11:01:53.166000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:53.213785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:53.213820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:53.213833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:53.213843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:53.213876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402082289996046:9319]
2025-10-15T11:01:53.213899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402082289996046:9319]
2025-10-15T11:01:53.213922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402082289996046:9319]
2025-10-15T11:01:53.214105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:53.214135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:53.214340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:53.214358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:53.214374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:53.215247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:53.266620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId: src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:53.288006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:53.356803Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:53.375216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.375266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.375325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:53.375341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:53.375396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402082289996046:9319]
2025-10-15T11:01:53.375677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:53.376015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_11_4626530766257792469_v1
2025-10-15T11:01:53.376043Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:53.377407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:53.377643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:53.380251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402079490306116:5602]
2025-10-15T11:01:53.394161Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_11_4626530766257792469_v1
2025-10-15T11:01:53.398496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 993 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0
2025-10-15T11:01:53.398791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 993 sessionId: src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0 is DEAD
2025-10-15T11:01:53.403985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:53.404041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0] Write session will restart in 0.008029s
2025-10-15T11:01:53.404178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0] Write session: Do CDS request
2025-10-15T11:01:53.404218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:53.418857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:53.418885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 994
2025-10-15T11:01:53.419148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:53.419761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:53.419881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:53.419902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:53.419911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:53.420864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 994 sessionId:  describe result for acl check
2025-10-15T11:01:53.420929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:53.420940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:53.420945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:53.420955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402079490306222:5590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:53.423054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402079490306222:5590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:53.431832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402079490306222:5590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:53.440862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402079490306222:5590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:53.440910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402079490306222:5590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:53.440927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402079490306222:5590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:53.440957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:53.441475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:53.444768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:53.445501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:53.445535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:53.445572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:53.445795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:53.445971Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402082289996157:9328]
2025-10-15T11:01:53.447857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:53.448902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:53.449089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:53.450168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:53.450453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.450459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.450465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.450471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.450476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.450482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.450488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.450493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.450499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.450505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.450511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.450518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.450524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.450531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.450571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.450669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.450711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.450752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.450794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.450836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.450876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.450915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.450952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.450992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.451046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.451086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.451126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.451166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.451204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.451262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.451312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.451378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.451421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.451471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.451511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.451558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.451600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.451649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.451708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.451762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.451804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.451850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.451889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.451944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.451990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.452035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.452073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.452116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.452157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.452200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.452239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.452283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.452324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.452369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.452408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.452452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.454001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:53.477437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:53.480296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402079490306280:5602]
2025-10-15T11:01:53.487908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:53.487951Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:53.487967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:53.487984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:53.488009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 993 [2:7561402082289996157:9328]
2025-10-15T11:01:53.488060Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:53.488115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:53.488130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:53.488141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:53.488153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:53.488196Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:53.488217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:53.488236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:53.490107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.490122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.490136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.490145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:53.490399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:53.490415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.490545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.490713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.490933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:53.490993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402082289996151:9328]
2025-10-15T11:01:53.491006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402082289996151:9328]
2025-10-15T11:01:53.491018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402082289996151:9328]
2025-10-15T11:01:53.491057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:53.491119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:53.491288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:53.491305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:53.491426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402082289996151:9328]
2025-10-15T11:01:53.491458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:53.492094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:53.492126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:53.492137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:53.492164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:53.493272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 993
2025-10-15T11:01:53.493285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 993, pipe: [1:7561402079490306280:5602]
2025-10-15T11:01:53.493392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 993
2025-10-15T11:01:53.493421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402079490306273:5590], now have 1 active actors on pipe
2025-10-15T11:01:53.493463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402079490306206:2467], now have 1 active actors on pipe
2025-10-15T11:01:53.493486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402079490306280:5602], now have 1 active actors on pipe
2025-10-15T11:01:53.493719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.493765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.493850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f31c858-e12bae82-79b8bfff-251db3f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:53.493904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:53.493938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:53.493949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:53.493990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:53.494053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:53.494113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:53.494559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.494592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.494660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:53.494919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 994 partition: 0 MaxSeqNo: 46 sessionId: src_id|f31c858-e12bae82-79b8bfff-251db3f0_0
2025-10-15T11:01:53.499569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08cd30e-b0a3a588-5f56f93-2a9db75f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f31c858-e12bae82-79b8bfff-251db3f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:53.526215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31c858-e12bae82-79b8bfff-251db3f0_0] Write session: try to update token
2025-10-15T11:01:53.526277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31c858-e12bae82-79b8bfff-251db3f0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:53.580381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:53.580424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:53.580438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:53.580448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:53.580481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402082289996151:9328]
2025-10-15T11:01:53.580517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402082289996151:9328]
2025-10-15T11:01:53.580541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402082289996151:9328]
2025-10-15T11:01:53.580699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:53.580722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:53.582454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:53.583539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:53.583580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:53.583608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:53.657439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId: src_id|f31c858-e12bae82-79b8bfff-251db3f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:53.680316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:53.730443Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:53.733668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.733717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.738343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:53.738368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:53.751249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 994 reason: error at write: Disconnected sessionId: src_id|f31c858-e12bae82-79b8bfff-251db3f0_0
2025-10-15T11:01:53.751642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 994 sessionId: src_id|f31c858-e12bae82-79b8bfff-251db3f0_0 is DEAD
2025-10-15T11:01:53.752027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31c858-e12bae82-79b8bfff-251db3f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:53.752096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31c858-e12bae82-79b8bfff-251db3f0_0] Write session will restart in 0.008592s
2025-10-15T11:01:53.752263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31c858-e12bae82-79b8bfff-251db3f0_0] Write session: Do CDS request
2025-10-15T11:01:53.752308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31c858-e12bae82-79b8bfff-251db3f0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:53.766672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:53.766841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402079490306280:5602]
2025-10-15T11:01:53.785102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31c858-e12bae82-79b8bfff-251db3f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:53.791476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:53.791515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 995
2025-10-15T11:01:53.792417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:53.792591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:53.792608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:53.792619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:53.793790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 995 sessionId:  describe result for acl check
2025-10-15T11:01:53.793902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:53.793913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:53.793922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:53.793939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402079490306315:5576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:53.795982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:53.796375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402079490306315:5576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:53.808935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402079490306315:5576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:53.818394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402079490306315:5576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:53.818444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402079490306315:5576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:53.818476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402079490306315:5576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:53.818512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:53.843419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:53.848544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:53.849461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:53.849480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:53.849523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:53.849779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:53.849959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402082289996253:9331]
2025-10-15T11:01:53.852481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:53.853600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:53.853834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:53.855167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:53.855524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.855533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.855539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.855546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.855553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.855560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.855567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.855574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.855582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.855589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.855597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.855604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.855612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.855619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.855671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.855781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.855832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.855880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.855928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.855978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.856022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.856071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.856115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.856163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.856214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.856263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.856311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.856359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.856404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.856475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:53.856556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.856613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:53.856665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.856723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:53.856773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.856829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:53.856877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.856931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:53.856977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.857032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:53.857080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.857141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:53.857189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.857268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:53.857327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.857385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:53.857432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.857487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:53.857539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.857594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:53.857641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.857696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.857745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.857836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.857929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.858040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.858585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:53.867126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402079490306376:5602]
2025-10-15T11:01:53.877622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:53.888334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:53.888388Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:53.888407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:53.888427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:53.888456Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 994 [2:7561402082289996253:9331]
2025-10-15T11:01:53.888524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:53.888593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:53.888618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:53.888631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:53.888644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:53.888697Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:53.888721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:53.888743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:53.890661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.890693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.890709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.890720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:53.890992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:53.891021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:53.891168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:53.891390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:53.891489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 994
2025-10-15T11:01:53.891586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 994, pipe: [1:7561402079490306376:5602]
2025-10-15T11:01:53.891624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:53.891668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 994
2025-10-15T11:01:53.891711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402079490306343:5576], now have 1 active actors on pipe
2025-10-15T11:01:53.891739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402079490306306:2467], now have 1 active actors on pipe
2025-10-15T11:01:53.891764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402079490306376:5602], now have 1 active actors on pipe
2025-10-15T11:01:53.891795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402082289996236:9331]
2025-10-15T11:01:53.891816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402082289996236:9331]
2025-10-15T11:01:53.891829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402082289996236:9331]
2025-10-15T11:01:53.891872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:53.891956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:53.891999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:53.892037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:53.892049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:53.892163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:53.892187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:53.892338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.892368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.892419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402082289996236:9331]
2025-10-15T11:01:53.892450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:53.892484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:53.892579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec545282-75236159-5e4400cd-16ce2f5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:53.892616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:53.892637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:53.892648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:53.892685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:53.892732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:53.892830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:53.893479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:53.893509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:53.893578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:53.894787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31c858-e12bae82-79b8bfff-251db3f0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ec545282-75236159-5e4400cd-16ce2f5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:53.893942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 995 partition: 0 MaxSeqNo: 46 sessionId: src_id|ec545282-75236159-5e4400cd-16ce2f5c_0
2025-10-15T11:01:53.917885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec545282-75236159-5e4400cd-16ce2f5c_0] Write session: try to update token
2025-10-15T11:01:53.917940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec545282-75236159-5e4400cd-16ce2f5c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:54.020882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:54.020944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:54.020966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:54.020982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:54.021026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402082289996236:9331]
2025-10-15T11:01:54.021059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402082289996236:9331]
2025-10-15T11:01:54.021093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402082289996236:9331]
2025-10-15T11:01:54.021215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:54.021270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:54.021277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:54.021290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:54.021306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:54.021308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:54.021422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:54.021449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:54.024397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:54.033218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId: src_id|ec545282-75236159-5e4400cd-16ce2f5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:54.062678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:54.163106Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:54.173145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:54.173198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:54.173266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:54.173280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:54.173319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402082289996236:9331]
2025-10-15T11:01:54.173472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:54.173800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:54.173818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:54.173827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:54.174031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402079490306376:5602]
2025-10-15T11:01:54.174222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:54.208780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 995 reason: error at write: Disconnected sessionId: src_id|ec545282-75236159-5e4400cd-16ce2f5c_0
2025-10-15T11:01:54.209064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 995 sessionId: src_id|ec545282-75236159-5e4400cd-16ce2f5c_0 is DEAD
2025-10-15T11:01:54.209420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec545282-75236159-5e4400cd-16ce2f5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:54.209497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec545282-75236159-5e4400cd-16ce2f5c_0] Write session will restart in 0.006188s
2025-10-15T11:01:54.209632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec545282-75236159-5e4400cd-16ce2f5c_0] Write session: Do CDS request
2025-10-15T11:01:54.209674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec545282-75236159-5e4400cd-16ce2f5c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:54.218032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:54.219783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:54.219807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 996
2025-10-15T11:01:54.219923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec545282-75236159-5e4400cd-16ce2f5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:54.220362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:54.220479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:54.220525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:54.220533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:54.221069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:54.221717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 996 sessionId:  describe result for acl check
2025-10-15T11:01:54.221740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:54.221759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:54.221796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:54.221821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:54.221847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:54.221856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:54.221871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402083785273744:5548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:54.221978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:54.222153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402086584963634:9340]
2025-10-15T11:01:54.223744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:54.224114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402083785273744:5548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:54.224492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:54.224693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:54.225737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:54.226013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.226031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.226038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.226045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.226051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.226057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.226063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.226071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.226077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.226083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.226089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.226096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.226102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.226108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.226149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.226243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.226279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.226318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.226359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.226405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.226452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.226492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.226532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.226584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.226632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.226677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.226726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.226770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.226808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.226867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.226923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.226975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.227026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.227080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.227130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.227182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.227231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.227283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.227327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.227403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.227452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.227506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.227551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.227605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.227653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.227707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.227754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.227808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.227855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.227913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.227968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.228024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.228071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.228124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.228187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.228247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.228725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:54.244000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:54.247600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402083785273744:5548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:54.253714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402083785273744:5548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:54.253744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402083785273744:5548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:54.253754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402083785273744:5548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:54.253780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:54.254386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:54.254419Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:54.254434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:54.254448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:54.254469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 995 [2:7561402086584963634:9340]
2025-10-15T11:01:54.254513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:54.254556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:54.254568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:54.254577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:54.254588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:54.254628Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:54.254646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:54.254663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:54.255712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.255748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.255760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.255769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:54.256040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:54.256063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.256181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.256213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 995
2025-10-15T11:01:54.256225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 995
2025-10-15T11:01:54.256351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.256620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:54.256699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402083785273701:2467], now have 1 active actors on pipe
2025-10-15T11:01:54.256726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402083785273779:5548], now have 1 active actors on pipe
2025-10-15T11:01:54.256772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:54.256801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:54.256847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402086584963629:9340]
2025-10-15T11:01:54.256862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402086584963629:9340]
2025-10-15T11:01:54.256875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402086584963629:9340]
2025-10-15T11:01:54.256906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:54.256942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:54.256962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:54.256972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:54.256974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:54.257153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:54.257176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:54.257230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:54.257260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:54.257275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:54.257283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:54.257318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:54.257351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:54.257478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402086584963629:9340]
2025-10-15T11:01:54.257518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:54.257557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:54.257561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:54.258634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:54.258686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:54.258777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:54.259123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 996 partition: 0 MaxSeqNo: 46 sessionId: src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0
2025-10-15T11:01:54.259791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec545282-75236159-5e4400cd-16ce2f5c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:54.274154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402083785273784:5602]
2025-10-15T11:01:54.274789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 995, pipe: [1:7561402083785273784:5602]
2025-10-15T11:01:54.274879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402083785273784:5602], now have 1 active actors on pipe
2025-10-15T11:01:54.279688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0] Write session: try to update token
2025-10-15T11:01:54.279737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:54.287163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:54.287194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:54.287229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402086584963629:9340]
2025-10-15T11:01:54.287340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:54.287372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:54.289533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:54.290877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:54.292319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:54.293587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:54.295362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:54.327160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:54.359027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId: src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:54.384034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:54.384881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:54.384909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:54.384919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:54.384968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:54.384979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:54.384989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:54.384997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:54.385029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402086584963629:9340]
2025-10-15T11:01:54.385049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402086584963629:9340]
2025-10-15T11:01:54.385069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402086584963629:9340]
2025-10-15T11:01:54.385187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:54.385225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:54.385227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:54.385247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:54.385253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:54.385275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:54.385293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:54.386248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:54.522255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:54.524369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402083785273784:5602]
2025-10-15T11:01:54.524397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:54.524411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:54.524469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:54.524390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:54.561584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 996 reason: error at write: Disconnected sessionId: src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0
2025-10-15T11:01:54.561890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 996 sessionId: src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0 is DEAD
2025-10-15T11:01:54.563753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:54.563780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0] Write session will restart in 0.007934s
2025-10-15T11:01:54.563869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0] Write session: Do CDS request
2025-10-15T11:01:54.563888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:54.574334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:54.575115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:54.575156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 997
2025-10-15T11:01:54.575281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:54.575835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:54.575988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:54.576013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:54.576023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:54.576547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:54.577382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 997 sessionId:  describe result for acl check
2025-10-15T11:01:54.577407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:54.577446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:54.577492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:54.577491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:54.577508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:54.577518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:54.577534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402083785273851:5537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:54.577762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:54.577966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402086584963726:9344]
2025-10-15T11:01:54.580016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402083785273851:5537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:54.580530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:54.581442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:54.581664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:54.582983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:54.583269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.583284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.583290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.583295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.583299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.583304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.583309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.583313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.583318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.583321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.583326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.583330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.583334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.583340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.583405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.583523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.583573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.583618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.583654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.583688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.583722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.583757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.583803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.583836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.583872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.583906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.583940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.583974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.584017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.584091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.584151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.584233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.584295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.584346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.584379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.584419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.584454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.584504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.584572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.584630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.584665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.584704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.584738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.584779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.584822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.584866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.584899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.584940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.584972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.585013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.585058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.585110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.585144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.585191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.585235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.585278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.585985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402083785273851:5537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:54.585763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:54.597408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402083785273851:5537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:54.597454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402083785273851:5537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:54.597470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402083785273851:5537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:54.597501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:54.614666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:54.626055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402083785273885:5602]
2025-10-15T11:01:54.626211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 996
2025-10-15T11:01:54.626288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 996
2025-10-15T11:01:54.626907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 996, pipe: [1:7561402083785273885:5602]
2025-10-15T11:01:54.623806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:54.623864Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:54.623885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:54.623906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:54.623936Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 996 [2:7561402086584963726:9344]
2025-10-15T11:01:54.623995Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:54.624064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:54.624083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:54.624095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:54.624108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:54.624161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:54.624186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:54.624210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:54.625239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.625256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.625271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.625283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:54.625564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:54.625583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.625741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.625949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.626201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:54.626293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402083785273883:5537], now have 1 active actors on pipe
2025-10-15T11:01:54.626318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402083785273805:2467], now have 1 active actors on pipe
2025-10-15T11:01:54.626344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402086584963721:9344]
2025-10-15T11:01:54.626362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402086584963721:9344]
2025-10-15T11:01:54.626375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402086584963721:9344]
2025-10-15T11:01:54.626423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:54.626459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:54.626476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:54.626488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:54.626507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:54.626705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:54.626723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:54.626879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:54.626904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:54.626956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402086584963721:9344]
2025-10-15T11:01:54.626985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:54.627011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:54.627027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402083785273885:5602], now have 1 active actors on pipe
2025-10-15T11:01:54.627132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce79544d-6be10937-21ea37f9-6c91f867_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:54.627163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:54.627182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:54.627192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:54.627231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:54.627274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:54.628400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:54.631900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:54.631948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:54.632045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:54.632450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 997 partition: 0 MaxSeqNo: 46 sessionId: src_id|ce79544d-6be10937-21ea37f9-6c91f867_0
2025-10-15T11:01:54.637669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34eb384-effb2c8e-ca2e6b8c-54ebd81d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ce79544d-6be10937-21ea37f9-6c91f867_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:54.664258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce79544d-6be10937-21ea37f9-6c91f867_0] Write session: try to update token
2025-10-15T11:01:54.664317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce79544d-6be10937-21ea37f9-6c91f867_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:54.715823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:54.715879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:54.715896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:54.715908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:54.715951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402086584963721:9344]
2025-10-15T11:01:54.715979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402086584963721:9344]
2025-10-15T11:01:54.716004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402086584963721:9344]
2025-10-15T11:01:54.716155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:54.716203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:54.716204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:54.716230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:54.716238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:54.718963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:54.806692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId: src_id|ce79544d-6be10937-21ea37f9-6c91f867_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:54.829882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:54.876941Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:54.890131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:54.890177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:54.892457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402083785273885:5602]
2025-10-15T11:01:54.892766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:54.892794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:54.892948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:54.894343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:54.904157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 997 reason: error at write: Disconnected sessionId: src_id|ce79544d-6be10937-21ea37f9-6c91f867_0
2025-10-15T11:01:54.904430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 997 sessionId: src_id|ce79544d-6be10937-21ea37f9-6c91f867_0 is DEAD
2025-10-15T11:01:54.911665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce79544d-6be10937-21ea37f9-6c91f867_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:54.911740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce79544d-6be10937-21ea37f9-6c91f867_0] Write session will restart in 0.006828s
2025-10-15T11:01:54.911911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce79544d-6be10937-21ea37f9-6c91f867_0] Write session: Do CDS request
2025-10-15T11:01:54.911967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce79544d-6be10937-21ea37f9-6c91f867_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:54.924706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:54.924762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 998
2025-10-15T11:01:54.925175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce79544d-6be10937-21ea37f9-6c91f867_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:54.926107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:54.926356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:54.926418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:54.926436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:54.929171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 998 sessionId:  describe result for acl check
2025-10-15T11:01:54.929299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:54.929310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:54.929320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:54.929338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402083785273906:5523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:54.932852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402083785273906:5523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:54.940725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402083785273906:5523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:54.951539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402083785273906:5523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:54.951582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402083785273906:5523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:54.951601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402083785273906:5523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:54.951636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:54.957788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:54.963445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:54.964163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:54.964184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:54.964215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:54.964394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:54.964529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402086584963821:9352]
2025-10-15T11:01:54.966634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:54.967550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:54.967706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:54.968693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:54.969007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.969015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.969021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.969028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.969035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.969042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.969048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.969056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.969063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.969070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.969077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.969084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.969092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.969099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.969148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.969268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.969315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.969362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.969407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.969455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.969500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.969547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.969595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.969643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.969689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.969737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.969785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.969829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.969872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.969941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:54.970001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.970055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:54.970104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.970159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:54.970209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.970261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:54.970308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.970362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:54.970411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.970475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:54.970522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.970575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:54.970620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.970677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:54.970723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.970778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:54.970826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.970878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:54.970923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.970973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:54.971018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.971072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:54.971120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.971175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:54.971222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.971274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:54.973059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:54.992661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402083785273972:5602]
2025-10-15T11:01:55.012863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:55.033972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:55.034024Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:55.034041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:55.034061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:55.034088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 997 [2:7561402086584963821:9352]
2025-10-15T11:01:55.034140Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:55.034201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:55.034216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:55.034229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:55.034241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:55.034293Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:55.034315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:55.034337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:55.036354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.036387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.036403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.036416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:55.036741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:55.036759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.036911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.037106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.037352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:55.037430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402086584963816:9352]
2025-10-15T11:01:55.037448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402086584963816:9352]
2025-10-15T11:01:55.037463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402086584963816:9352]
2025-10-15T11:01:55.037510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:55.037591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:55.037780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:55.037796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:55.037933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402086584963816:9352]
2025-10-15T11:01:55.037954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:55.039296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:55.039319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:55.039331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:55.039369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:55.039545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 997, pipe: [1:7561402083785273972:5602]
2025-10-15T11:01:55.039654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 997
2025-10-15T11:01:55.039791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402083785273892:2467], now have 1 active actors on pipe
2025-10-15T11:01:55.039831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402083785273972:5602], now have 1 active actors on pipe
2025-10-15T11:01:55.039857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402083785273964:5523], now have 1 active actors on pipe
2025-10-15T11:01:55.039896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 997
2025-10-15T11:01:55.040147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:55.040176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:55.040258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:55.040300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:55.040321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:55.040332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:55.040375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:55.040423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:55.040473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:55.041115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:55.041144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:55.041213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:55.041504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 998 partition: 0 MaxSeqNo: 46 sessionId: src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0
2025-10-15T11:01:55.042427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce79544d-6be10937-21ea37f9-6c91f867_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:55.085912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0] Write session: try to update token
2025-10-15T11:01:55.085972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:55.198659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:55.198707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:55.198723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:55.198734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:55.198769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402086584963816:9352]
2025-10-15T11:01:55.198796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402086584963816:9352]
2025-10-15T11:01:55.198822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402086584963816:9352]
2025-10-15T11:01:55.198986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:55.199006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:55.199017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:55.199143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:55.199174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:55.199463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:55.199509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:55.199536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:55.204360Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:55.230709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId: src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:55.262412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:55.360746Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:55.374217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:55.374271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:55.374355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:55.374372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:55.374420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402086584963816:9352]
2025-10-15T11:01:55.374633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:55.375446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:55.375142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:55.375329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402083785273972:5602]
2025-10-15T11:01:55.375437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:55.375450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:55.385570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 998 reason: error at write: Disconnected sessionId: src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0
2025-10-15T11:01:55.385960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 998 sessionId: src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0 is DEAD
2025-10-15T11:01:55.386401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:55.386466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0] Write session will restart in 0.007096s
2025-10-15T11:01:55.386647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0] Write session: Do CDS request
2025-10-15T11:01:55.386695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:55.402301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:55.418513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:55.418544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 999
2025-10-15T11:01:55.418951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:55.419083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:55.419104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:55.419115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:55.420448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 999 sessionId:  describe result for acl check
2025-10-15T11:01:55.420585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:55.420595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:55.420605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:55.420624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402088080241327:5514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:55.423604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402088080241327:5514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:55.429889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402088080241327:5514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:55.440271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:55.440738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402088080241327:5514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:55.440778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402088080241327:5514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:55.440796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402088080241327:5514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:55.440829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:55.442956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:55.443785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:55.443818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:55.443863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:55.444257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:55.444472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402090879931230:9360]
2025-10-15T11:01:55.446763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:55.447721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:55.447932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:55.449205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:55.449547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:55.449563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:55.449570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:55.449578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:55.449584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:55.449590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:55.449596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:55.449603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:55.449610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:55.449617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:55.449623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:55.449629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.449635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.449642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.449698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:55.449801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:55.449847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:55.449891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:55.449942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:55.449989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:55.450033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:55.450077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:55.450123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:55.450172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:55.450332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:55.450382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.450442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.450495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.450550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:55.450621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:55.450687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:55.450747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:55.450801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:55.450860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:55.450909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:55.450970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:55.451025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:55.451084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:55.451136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:55.451196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:55.451251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:55.451311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:55.451380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:55.451443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:55.451493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:55.451556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:55.451609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:55.451668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:55.451726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:55.451789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:55.451859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.451924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.451981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.452060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.452114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.452172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.452724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:55.475325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402088080241396:5602]
2025-10-15T11:01:55.480827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:55.491743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:55.491797Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:55.491817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:55.491840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:55.491867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 998 [2:7561402090879931230:9360]
2025-10-15T11:01:55.491925Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:55.491988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:55.492004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:55.492018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:55.492031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:55.492096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:55.492131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:55.492157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:55.493911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.493940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.493956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.493969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:55.494257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:55.494286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.494441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.494638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.494880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:55.494968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402088080241396:5602], now have 1 active actors on pipe
2025-10-15T11:01:55.495007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402088080241312:2467], now have 1 active actors on pipe
2025-10-15T11:01:55.495031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402088080241385:5514], now have 1 active actors on pipe
2025-10-15T11:01:55.495057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402090879931224:9360]
2025-10-15T11:01:55.495072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402090879931224:9360]
2025-10-15T11:01:55.495088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402090879931224:9360]
2025-10-15T11:01:55.495127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:55.494563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 998, pipe: [1:7561402088080241396:5602]
2025-10-15T11:01:55.495158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:55.495171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:55.494661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 998
2025-10-15T11:01:55.495184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:55.494746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 998
2025-10-15T11:01:55.495208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:55.495433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:55.495471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:55.495648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:55.495671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:55.495705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402090879931224:9360]
2025-10-15T11:01:55.495734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:55.495776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:55.495876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|674f536a-4f47a026-6268f106-892c9ac3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:55.495910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:55.495930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:55.495942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:55.495984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:55.496037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:55.496135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:55.496779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:55.496808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:55.496876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:55.497099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 999 partition: 0 MaxSeqNo: 46 sessionId: src_id|674f536a-4f47a026-6268f106-892c9ac3_0
2025-10-15T11:01:55.498168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b320c3d3-3a15b7a0-e758517-587f82fe_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|674f536a-4f47a026-6268f106-892c9ac3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:55.522068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|674f536a-4f47a026-6268f106-892c9ac3_0] Write session: try to update token
2025-10-15T11:01:55.522127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|674f536a-4f47a026-6268f106-892c9ac3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:55.608546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:55.608585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:55.608600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:55.608612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:55.608646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402090879931224:9360]
2025-10-15T11:01:55.608673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402090879931224:9360]
2025-10-15T11:01:55.608696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402090879931224:9360]
2025-10-15T11:01:55.608964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:55.608978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:55.608990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:55.609040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:55.609060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:55.610023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:55.610056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:55.610087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:55.620016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:55.644413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId: src_id|674f536a-4f47a026-6268f106-892c9ac3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:55.673637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:55.773193Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:55.783819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:55.783877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:55.783959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:55.783976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:55.784021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402090879931224:9360]
2025-10-15T11:01:55.784657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402088080241396:5602]
2025-10-15T11:01:55.784241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:55.784775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:55.784633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:55.784789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:55.785305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:55.836749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 999 reason: error at write: Disconnected sessionId: src_id|674f536a-4f47a026-6268f106-892c9ac3_0
2025-10-15T11:01:55.837143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 999 sessionId: src_id|674f536a-4f47a026-6268f106-892c9ac3_0 is DEAD
2025-10-15T11:01:55.843643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674f536a-4f47a026-6268f106-892c9ac3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:55.843689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674f536a-4f47a026-6268f106-892c9ac3_0] Write session will restart in 0.006939s
2025-10-15T11:01:55.843847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674f536a-4f47a026-6268f106-892c9ac3_0] Write session: Do CDS request
2025-10-15T11:01:55.843902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674f536a-4f47a026-6268f106-892c9ac3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:55.856908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|674f536a-4f47a026-6268f106-892c9ac3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:55.856674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:55.856707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1000
2025-10-15T11:01:55.857459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:55.857597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:55.857614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:55.857625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:55.859384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1000 sessionId:  describe result for acl check
2025-10-15T11:01:55.859515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:55.859533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:55.859545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:55.859565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402088080241462:5503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:55.862417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402088080241462:5503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:55.868220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:55.871190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:55.872028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:55.872057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:55.872096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:55.872111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402088080241462:5503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:55.872346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:55.872513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402090879931320:9365]
2025-10-15T11:01:55.874208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:55.875075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:55.875227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:55.876080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:55.876304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:55.876320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:55.876327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:55.876334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:55.876341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:55.876348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:55.876354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:55.876358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:55.876363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:55.876367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:55.876372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:55.876378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.876382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.876387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.876423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:55.876518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:55.876554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:55.876598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:55.876633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:55.876665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:55.876701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:55.876741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:55.876797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:55.876856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:55.876917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:55.876975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.877022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.877060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.877089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:55.877155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:55.877219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:55.877279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:55.877318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:55.877380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:55.877431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:55.877486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:55.877549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:55.877597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:55.877634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:55.877684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:55.877734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:55.877794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:55.877846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:55.877906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:55.877958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:55.878022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:55.878073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:55.878132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:55.878182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:55.878248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:55.878300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.878358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.878410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.878469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.878522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.878581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.879077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:55.878672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402088080241462:5503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:55.878708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402088080241462:5503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:55.878724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402088080241462:5503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:55.878753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:55.881802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402088080241498:5602]
2025-10-15T11:01:55.902786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:55.912074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:55.912118Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:55.912136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:55.912156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:55.912184Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 999 [2:7561402090879931320:9365]
2025-10-15T11:01:55.912239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:55.912302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:55.912318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:55.912332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:55.912345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:55.912395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:55.912427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:55.912450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:55.913418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.913434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.913448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.913461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:55.913730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:55.913751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:55.913907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:55.914108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:55.914304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:55.914364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402090879931314:9365]
2025-10-15T11:01:55.914379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402090879931314:9365]
2025-10-15T11:01:55.914395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402090879931314:9365]
2025-10-15T11:01:55.914424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:55.914477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:55.914482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:55.914487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:55.914495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:55.914648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:55.914666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:55.914712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402088080241498:5602], now have 1 active actors on pipe
2025-10-15T11:01:55.914736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402088080241419:2467], now have 1 active actors on pipe
2025-10-15T11:01:55.914758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402088080241495:5503], now have 1 active actors on pipe
2025-10-15T11:01:55.914873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402090879931314:9365]
2025-10-15T11:01:55.914902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:55.914747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 999, pipe: [1:7561402088080241498:5602]
2025-10-15T11:01:55.914781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 999
2025-10-15T11:01:55.914850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 999
2025-10-15T11:01:55.914949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:55.915504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:55.915536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:55.915617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:55.915651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:55.915669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:55.915680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:55.915720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:55.915760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:55.915815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:55.916772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:55.916811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:55.916882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:55.917305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1000 partition: 0 MaxSeqNo: 46 sessionId: src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0
2025-10-15T11:01:55.919645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|674f536a-4f47a026-6268f106-892c9ac3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:55.952735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0] Write session: try to update token
2025-10-15T11:01:55.952786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:55.997526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:55.997559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:55.997589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402090879931314:9365]
2025-10-15T11:01:55.997693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:55.998083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:56.010708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:56.021847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:56.023031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:56.024256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:56.039064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:56.039661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:56.039692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:56.039719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:56.039829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:56.100539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:56.100580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:56.100597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:56.100607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:56.100652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402090879931314:9365]
2025-10-15T11:01:56.100679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402090879931314:9365]
2025-10-15T11:01:56.100708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402090879931314:9365]
2025-10-15T11:01:56.100867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:56.100899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:56.101957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:56.103473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:56.103506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:56.103535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:56.121458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId: src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:56.143501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:56.252911Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:56.254555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:56.254587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:56.255132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:56.255166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:56.255284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:56.255533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402088080241498:5602]
2025-10-15T11:01:56.255398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:56.267020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:56.267109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0] Write session will restart in 0.008403s
2025-10-15T11:01:56.267303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0] Write session: Do CDS request
2025-10-15T11:01:56.267378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:56.266173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1000 reason: error at write: Disconnected sessionId: src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0
2025-10-15T11:01:56.266547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1000 sessionId: src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0 is DEAD
2025-10-15T11:01:56.281169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:56.281223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1001
2025-10-15T11:01:56.281605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:56.282435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:56.282677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:56.282709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:56.282731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:56.286122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1001 sessionId:  describe result for acl check
2025-10-15T11:01:56.286251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:56.286269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:56.286281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:56.286300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402092375208819:5491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:56.293613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402092375208819:5491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:56.301123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402092375208819:5491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:56.317483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402092375208819:5491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:56.317524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402092375208819:5491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:56.317541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402092375208819:5491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:56.317577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:56.318161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:56.324719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:56.325651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:56.325672Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:56.325718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:56.326013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:56.326205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402095174898701:9367]
2025-10-15T11:01:56.329269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:56.330507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:56.330766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:56.332388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:56.332799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:56.332810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:56.332818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:56.332826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:56.332834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:56.332842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:56.332851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:56.332858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:56.332866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:56.332876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:56.332883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:56.332891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.332898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.332906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.333329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:56.333476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:56.333532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:56.333584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:56.333635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:56.333688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:56.333741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:56.333792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:56.333844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:56.333898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:56.333948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:56.334001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.334052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.334103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.334154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:56.334227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:56.334289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:56.334349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:56.334403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:56.334463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:56.334511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:56.334570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:56.334622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:56.334678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:56.334727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:56.334787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:56.334839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:56.334896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:56.334945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:56.335006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:56.335058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:56.335119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:56.335166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:56.335223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:56.335272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:56.335325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:56.335405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.335469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.335518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.335576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.335624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.335680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.336222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:56.355955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402092375208894:5602]
2025-10-15T11:01:56.354009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:56.364531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:56.364574Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:56.364592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:56.364613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:56.364640Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1000 [2:7561402095174898701:9367]
2025-10-15T11:01:56.364694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:56.364748Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:56.364766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:56.364777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:56.364789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:56.364841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:56.364870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:56.364892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:56.379237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.379273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.379287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.379299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:56.379587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:56.379605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.379755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.379950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.380197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1000
2025-10-15T11:01:56.380303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1000, pipe: [1:7561402092375208894:5602]
2025-10-15T11:01:56.380383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1000
2025-10-15T11:01:56.380486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:56.380586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402092375208810:2467], now have 1 active actors on pipe
2025-10-15T11:01:56.380611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402092375208894:5602], now have 1 active actors on pipe
2025-10-15T11:01:56.380636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402092375208885:5491], now have 1 active actors on pipe
2025-10-15T11:01:56.380681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402095174898695:9367]
2025-10-15T11:01:56.380697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402095174898695:9367]
2025-10-15T11:01:56.380713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402095174898695:9367]
2025-10-15T11:01:56.380756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:56.380833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:56.380848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:56.380863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:56.380875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:56.381021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:56.381041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:56.381190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:56.381215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:56.381247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402095174898695:9367]
2025-10-15T11:01:56.381278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:56.381348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:56.381391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:56.381424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:56.381442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:56.381454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:56.381492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:56.381539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:56.381619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:56.383200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:56.383236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:56.383822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1001 partition: 0 MaxSeqNo: 46 sessionId: src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0
2025-10-15T11:01:56.384614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f67432-7baa5f7d-db1026dd-32be9892_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:56.383318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:56.409486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0] Write session: try to update token
2025-10-15T11:01:56.409548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:56.468689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:56.468733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:56.468750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:56.468762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:56.468800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402095174898695:9367]
2025-10-15T11:01:56.468829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402095174898695:9367]
2025-10-15T11:01:56.468857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402095174898695:9367]
2025-10-15T11:01:56.469023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:56.469042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:56.469055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:56.469062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:56.469068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:56.469092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:56.469119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:56.469142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:56.470334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:56.519572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId: src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:56.542209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:56.630603Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:56.633842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:56.634085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402092375208894:5602]
2025-10-15T11:01:56.634198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:56.634222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:56.632967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:56.633015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:56.652636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1001 reason: error at write: Disconnected sessionId: src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0
2025-10-15T11:01:56.653008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1001 sessionId: src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0 is DEAD
2025-10-15T11:01:56.665179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:56.665222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0] Write session will restart in 0.009869s
2025-10-15T11:01:56.665339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0] Write session: Do CDS request
2025-10-15T11:01:56.665371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:56.680428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:56.680373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:56.680416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1002
2025-10-15T11:01:56.680985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:56.681136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:56.681159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:56.681168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:56.682666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1002 sessionId:  describe result for acl check
2025-10-15T11:01:56.682785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:56.682804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:56.682814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:56.682832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402092375208940:5475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:56.685678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402092375208940:5475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:56.688758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:56.692627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402092375208940:5475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:56.710990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402092375208940:5475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:56.711031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402092375208940:5475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:56.711051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402092375208940:5475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:56.711084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:56.734939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402092375209004:5602]
2025-10-15T11:01:56.736482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:56.741480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:56.742363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:56.742392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:56.742433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:56.742668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:56.742845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402095174898812:9377]
2025-10-15T11:01:56.744917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:56.745765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:56.745963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:56.747268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:56.747640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:56.747660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:56.747666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:56.747673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:56.747679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:56.747686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:56.747693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:56.747700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:56.747706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:56.747713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:56.747720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:56.747727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.747734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.747739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.747785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:56.747904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:56.747950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:56.747993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:56.748036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:56.748088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:56.748138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:56.748186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:56.748234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:56.748285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:56.748333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:56.748379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.748443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.748491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.748538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:56.748611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:56.748668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:56.748726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:56.748778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:56.748836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:56.748886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:56.748942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:56.748993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:56.749052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:56.749097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:56.749154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:56.749206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:56.749260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:56.749313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:56.749366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:56.749409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:56.749460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:56.749502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:56.749572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:56.749619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:56.749673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:56.749715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.749764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.749811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.749861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.749903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.749954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.750444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:56.767984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:56.778830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:56.778876Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:56.778891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:56.778909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:56.778931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1001 [2:7561402095174898812:9377]
2025-10-15T11:01:56.778977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:56.779027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:56.779039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:56.779052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:56.779062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:56.779108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:56.779130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:56.779151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:56.781273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.781303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.781315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.781325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:56.781582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:56.781605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:56.781735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:56.781911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:56.782131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:56.782205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402095174898807:9377]
2025-10-15T11:01:56.782224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402095174898807:9377]
2025-10-15T11:01:56.782237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402095174898807:9377]
2025-10-15T11:01:56.782275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:56.782352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:56.782409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:56.782430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:56.782442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:56.782522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:56.782545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:56.782931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1001
2025-10-15T11:01:56.783030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1001
2025-10-15T11:01:56.783094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1001, pipe: [1:7561402092375209004:5602]
2025-10-15T11:01:56.782695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402095174898807:9377]
2025-10-15T11:01:56.782724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:56.782733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:56.782814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402092375208969:5475], now have 1 active actors on pipe
2025-10-15T11:01:56.782837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402092375208920:2467], now have 1 active actors on pipe
2025-10-15T11:01:56.782859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402092375209004:5602], now have 1 active actors on pipe
2025-10-15T11:01:56.783203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:56.783227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:56.783296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:56.783328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:56.783362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:56.783374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:56.783408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:56.783450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:56.783509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:56.784060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:56.784079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:56.784167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:56.784496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1002 partition: 0 MaxSeqNo: 46 sessionId: src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0
2025-10-15T11:01:56.786473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5991ea42-3bb761c2-9e9b1d32-8e52cedf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:56.818310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0] Write session: try to update token
2025-10-15T11:01:56.818367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:56.878312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:56.878348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:56.878360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:56.878369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:56.878412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402095174898807:9377]
2025-10-15T11:01:56.878437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402095174898807:9377]
2025-10-15T11:01:56.878458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402095174898807:9377]
2025-10-15T11:01:56.878640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:56.878669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:56.879121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:56.879165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:56.879199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:56.884513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:56.927460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId: src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:56.956613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:57.025437Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:57.049550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:57.049593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:57.049652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:57.049666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:57.049708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402095174898807:9377]
2025-10-15T11:01:57.049870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:57.050456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:57.050620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:57.050654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:57.066617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1002 reason: error at write: Disconnected sessionId: src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0
2025-10-15T11:01:57.066911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1002 sessionId: src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0 is DEAD
2025-10-15T11:01:57.067377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:57.067468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0] Write session will restart in 0.006323s
2025-10-15T11:01:57.067655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0] Write session: Do CDS request
2025-10-15T11:01:57.067709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:57.100906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:57.115311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:57.115383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1003
2025-10-15T11:01:57.115857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:57.116033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402092375209004:5602]
2025-10-15T11:01:57.116261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:57.116397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:57.116414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:57.116423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:57.118326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1003 sessionId:  describe result for acl check
2025-10-15T11:01:57.118437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:57.118456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:57.118466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:57.118482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402096670176343:5455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:57.121202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402096670176343:5455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:57.137116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402096670176343:5455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:57.137407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:57.142805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:57.143688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:57.143715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:57.143757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:57.143992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:57.144171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402099469866217:9384]
2025-10-15T11:01:57.146253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:57.147263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:57.147531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:57.148166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402096670176343:5455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:57.148211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402096670176343:5455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:57.148229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402096670176343:5455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:57.148263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:57.148761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:57.149061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:57.149080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:57.149086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:57.149092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:57.149098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:57.149105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:57.149111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:57.149116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:57.149123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:57.149129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:57.149139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:57.149146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.149152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.149158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.149201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:57.149301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:57.149346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:57.149390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:57.149449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:57.149503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:57.149553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:57.149604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:57.149651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:57.149700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:57.149749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:57.149798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.149847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.149892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.149934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:57.149996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:57.150049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:57.150102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:57.150146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:57.150198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:57.150240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:57.150289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:57.150333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:57.150381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:57.150424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:57.150475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:57.150532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:57.150582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:57.150625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:57.150680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:57.150724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:57.150775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:57.150823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:57.150872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:57.150916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:57.150965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:57.151008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.151057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.151104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.151154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.151199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.151251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.151753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:57.170718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:57.181246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:57.181295Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:57.181313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:57.181334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:57.181358Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1002 [2:7561402099469866217:9384]
2025-10-15T11:01:57.181411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:57.181465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:57.181480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:57.181490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:57.181500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:57.181544Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:57.181565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:57.181585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:57.182798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.182825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.182838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.182850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:57.183119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:57.183142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.183507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1002
2025-10-15T11:01:57.183588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1002
2025-10-15T11:01:57.183277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.183563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.183798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:57.183878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402096670176407:5455], now have 1 active actors on pipe
2025-10-15T11:01:57.183915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402096670176331:2467], now have 1 active actors on pipe
2025-10-15T11:01:57.183945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402099469866212:9384]
2025-10-15T11:01:57.183970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402099469866212:9384]
2025-10-15T11:01:57.183984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402099469866212:9384]
2025-10-15T11:01:57.184012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:57.184083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:57.184090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:57.184103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:57.184114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:57.184261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:57.184283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:57.184333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:57.184357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:57.184494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402099469866212:9384]
2025-10-15T11:01:57.184525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:57.184568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:57.184589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:57.184616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:57.184632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:57.184643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:57.184675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:57.184715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:57.184828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:57.185250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:57.185273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:57.185331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:57.185750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1003 partition: 0 MaxSeqNo: 46 sessionId: src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0
2025-10-15T11:01:57.186480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed7cf1d8-d818b2eb-86fffc59-e9fb8321_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:57.219702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402096670176414:5602]
2025-10-15T11:01:57.220477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1002, pipe: [1:7561402096670176414:5602]
2025-10-15T11:01:57.220632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0] Write session: try to update token
2025-10-15T11:01:57.220601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402096670176414:5602], now have 1 active actors on pipe
2025-10-15T11:01:57.220694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:57.368643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:57.368686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:57.368704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:57.368715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:57.368756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402099469866212:9384]
2025-10-15T11:01:57.368784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402099469866212:9384]
2025-10-15T11:01:57.368812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402099469866212:9384]
2025-10-15T11:01:57.368993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:57.369008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:57.369021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:57.369133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:57.369155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:57.370106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:57.371813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:57.371863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:57.371894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:57.384710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId: src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:57.406196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:57.522485Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:57.533025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:57.533080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:57.533160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:57.533176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:57.533220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402099469866212:9384]
2025-10-15T11:01:57.536335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:57.536373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:57.536374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402096670176414:5602]
2025-10-15T11:01:57.536465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:57.535643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:57.536122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:57.583158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1003 reason: error at write: Disconnected sessionId: src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0
2025-10-15T11:01:57.587801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:57.587861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0] Write session will restart in 0.007604s
2025-10-15T11:01:57.587972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0] Write session: Do CDS request
2025-10-15T11:01:57.588004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:57.583658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1003 sessionId: src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0 is DEAD
2025-10-15T11:01:57.602531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:57.602077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:57.605654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:57.605682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1004
2025-10-15T11:01:57.606094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:57.606213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:57.606228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:57.606239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:57.607709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1004 sessionId:  describe result for acl check
2025-10-15T11:01:57.607827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:57.607839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:57.607849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:57.607866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402096670176487:5449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:57.610746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402096670176487:5449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:57.613798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:57.614743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:57.614763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:57.614808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:57.615094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:57.615282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402099469866318:9390]
2025-10-15T11:01:57.617641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:57.618724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:57.618942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:57.620164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:57.620512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:57.620519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:57.620527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:57.620534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:57.620543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:57.620551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:57.620560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:57.620567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:57.620574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:57.620582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:57.620591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:57.620599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.620606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.620615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.620666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:57.620783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:57.620830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:57.620878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:57.620926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:57.620976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:57.621026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:57.621073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:57.621118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:57.621166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:57.621213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:57.621260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.621307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.621353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.621398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:57.621468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:57.621533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:57.621589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:57.621640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:57.621698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:57.621745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:57.621806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:57.621855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:57.621911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:57.621959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:57.622014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:57.622063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:57.622117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:57.622165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:57.622219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:57.622265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:57.622323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:57.622367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:57.622426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:57.622475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:57.622534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:57.622583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.622638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.622687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.622745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.622794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.622847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.623437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:57.626593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402096670176487:5449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:57.636503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402096670176515:5602]
2025-10-15T11:01:57.645021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:57.647918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402096670176487:5449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:57.647958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402096670176487:5449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:57.647977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402096670176487:5449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:57.648013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:57.656089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:57.656146Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:57.656166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:57.656194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:57.656223Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1003 [2:7561402099469866318:9390]
2025-10-15T11:01:57.656279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:57.656361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:57.656377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:57.656390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:57.656403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:57.656456Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:57.656492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:57.656515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:57.657537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.657555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.657571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.657583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:57.657864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:57.657884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:57.658041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:57.658247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:57.658494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:57.658568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402099469866313:9390]
2025-10-15T11:01:57.658585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402099469866313:9390]
2025-10-15T11:01:57.658600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402099469866313:9390]
2025-10-15T11:01:57.658645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:57.658727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:57.658929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:57.658949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:57.659103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402099469866313:9390]
2025-10-15T11:01:57.659124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:57.659496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:57.659509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:57.659521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:57.659546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:57.661192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402096670176436:2467], now have 1 active actors on pipe
2025-10-15T11:01:57.661234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402096670176520:5449], now have 1 active actors on pipe
2025-10-15T11:01:57.661257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402096670176515:5602], now have 1 active actors on pipe
2025-10-15T11:01:57.663528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1003
2025-10-15T11:01:57.663534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1003
2025-10-15T11:01:57.663618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1003, pipe: [1:7561402096670176515:5602]
2025-10-15T11:01:57.666507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:57.666551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:57.666648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea678a-9940648f-9c0192a3-740ba13e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:57.666686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:57.666706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:57.666717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:57.666763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:57.666812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:57.666862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:57.671824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:57.671870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:57.671967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:57.679141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1004 partition: 0 MaxSeqNo: 46 sessionId: src_id|ea678a-9940648f-9c0192a3-740ba13e_0
2025-10-15T11:01:57.683614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4b33af-3a43b872-fe76ee7b-b256d944_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ea678a-9940648f-9c0192a3-740ba13e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:57.734380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea678a-9940648f-9c0192a3-740ba13e_0] Write session: try to update token
2025-10-15T11:01:57.734493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea678a-9940648f-9c0192a3-740ba13e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:57.764842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:57.764884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:57.764901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:57.764912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:57.764951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402099469866313:9390]
2025-10-15T11:01:57.764979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402099469866313:9390]
2025-10-15T11:01:57.765007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402099469866313:9390]
2025-10-15T11:01:57.765242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:57.765253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:57.765265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:57.765319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:57.765343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:57.765837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:57.765878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:57.765909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:57.773933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:57.840063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId: src_id|ea678a-9940648f-9c0192a3-740ba13e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:57.863507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:57.934278Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:57.946234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:57.946301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:57.946372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:57.946389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:57.946433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402099469866313:9390]
2025-10-15T11:01:57.946684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:57.947176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:57.948027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:57.948050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:57.951734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402096670176515:5602]
2025-10-15T11:01:57.951878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:57.969373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1004 reason: error at write: Disconnected sessionId: src_id|ea678a-9940648f-9c0192a3-740ba13e_0
2025-10-15T11:01:57.969774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1004 sessionId: src_id|ea678a-9940648f-9c0192a3-740ba13e_0 is DEAD
2025-10-15T11:01:57.970490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea678a-9940648f-9c0192a3-740ba13e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:57.970570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea678a-9940648f-9c0192a3-740ba13e_0] Write session will restart in 0.007527s
2025-10-15T11:01:57.970769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea678a-9940648f-9c0192a3-740ba13e_0] Write session: Do CDS request
2025-10-15T11:01:57.970833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea678a-9940648f-9c0192a3-740ba13e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:57.987426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea678a-9940648f-9c0192a3-740ba13e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:57.987620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:57.987651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1005
2025-10-15T11:01:57.988031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:57.988165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:57.988187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:57.988198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:57.989726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1005 sessionId:  describe result for acl check
2025-10-15T11:01:57.989875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:57.989887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:57.989897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:57.989915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402096670176540:5440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:57.993096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402096670176540:5440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:58.002002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402096670176540:5440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:58.013915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402096670176540:5440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:58.013958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402096670176540:5440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:58.013976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402096670176540:5440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:58.014008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:58.034276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:58.038717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:58.039595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:58.039615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:58.039662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:58.039933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:58.040120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402103764833714:9398]
2025-10-15T11:01:58.042678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:58.044359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:58.044602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:58.045925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:58.046249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.046257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.046265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.046272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.046280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.046287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.046295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.046303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.046310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.046317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.046326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.046332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.046339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.046346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.046395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.046510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.046565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.046614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.046666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.046714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.046760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.046804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.046851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.046904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.046954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.046999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.047047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.047096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.047140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.047210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.047273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.047330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.048130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.048210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.048261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.048333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.048389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.048448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.048499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.048556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.048608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.048665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.048714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.048770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.048821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.048877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.048925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.048985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.049037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.049093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.049144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.049201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.049251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.049307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.049356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.049415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.049969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:58.052329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402100965143912:5602]
2025-10-15T11:01:58.070737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:58.081691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:58.081747Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:58.081765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:58.081786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:58.081815Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1004 [2:7561402103764833714:9398]
2025-10-15T11:01:58.081876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:58.081939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:58.081956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:58.081970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:58.081982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:58.082034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:58.082060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:58.082084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:58.095809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.095848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.095863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.095876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:58.096163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:58.096183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.096349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.096547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.096787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:58.096865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402103764833708:9398]
2025-10-15T11:01:58.096881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402103764833708:9398]
2025-10-15T11:01:58.096895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402103764833708:9398]
2025-10-15T11:01:58.097085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:58.097099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:58.097111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:58.097930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1004
2025-10-15T11:01:58.098015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1004, pipe: [1:7561402100965143912:5602]
2025-10-15T11:01:58.098069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1004
2025-10-15T11:01:58.098164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:58.098265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:58.098469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:58.098487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:58.098539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402100965143871:5440], now have 1 active actors on pipe
2025-10-15T11:01:58.098563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402100965143912:5602], now have 1 active actors on pipe
2025-10-15T11:01:58.098587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402096670176529:2467], now have 1 active actors on pipe
2025-10-15T11:01:58.098750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402103764833708:9398]
2025-10-15T11:01:58.098784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:58.099247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:58.099793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:58.099828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:58.099926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|570f2a3c-140820de-51ee043d-1002fcce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:58.099961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:58.099982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:58.099994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:58.100033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:58.100082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:58.100134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:58.103791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:58.103829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:58.103915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:58.104388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1005 partition: 0 MaxSeqNo: 46 sessionId: src_id|570f2a3c-140820de-51ee043d-1002fcce_0
2025-10-15T11:01:58.111261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea678a-9940648f-9c0192a3-740ba13e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|570f2a3c-140820de-51ee043d-1002fcce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:58.149964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:58.150009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:58.150047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402103764833708:9398]
2025-10-15T11:01:58.150175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:58.152848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:58.156780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:58.158344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:58.159647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:58.161060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:58.162989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:58.163542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:58.175632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570f2a3c-140820de-51ee043d-1002fcce_0] Write session: try to update token
2025-10-15T11:01:58.175695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570f2a3c-140820de-51ee043d-1002fcce_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:58.182352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:58.182392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:58.182406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:58.224607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:58.224647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:58.224662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:58.224674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:58.224717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402103764833708:9398]
2025-10-15T11:01:58.224747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402103764833708:9398]
2025-10-15T11:01:58.224776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402103764833708:9398]
2025-10-15T11:01:58.224960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:58.224998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:58.225247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:58.225293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:58.225322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:58.226128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:58.299428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId: src_id|570f2a3c-140820de-51ee043d-1002fcce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:58.325418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:58.377829Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:58.380435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:58.380483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:58.384277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:58.386450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:58.401050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402100965143912:5602]
2025-10-15T11:01:58.401143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:58.401516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1005 reason: status is not ok: tablet will be restarted right now sessionId: src_id|570f2a3c-140820de-51ee043d-1002fcce_0
2025-10-15T11:01:58.401853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1005 sessionId: src_id|570f2a3c-140820de-51ee043d-1002fcce_0 is DEAD
2025-10-15T11:01:58.402439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570f2a3c-140820de-51ee043d-1002fcce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:58.402512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570f2a3c-140820de-51ee043d-1002fcce_0] Write session will restart in 0.005955s
2025-10-15T11:01:58.402695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570f2a3c-140820de-51ee043d-1002fcce_0] Write session: Do CDS request
2025-10-15T11:01:58.402743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570f2a3c-140820de-51ee043d-1002fcce_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:58.414851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|570f2a3c-140820de-51ee043d-1002fcce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:58.433582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:58.433616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1006
2025-10-15T11:01:58.435553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:58.435705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:58.435721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:58.435732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:58.441746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1006 sessionId:  describe result for acl check
2025-10-15T11:01:58.441880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:58.441891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:58.441901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:58.441917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402100965144001:5420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:58.445941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402100965144001:5420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:58.448458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:58.455597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:58.456603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:58.456634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:58.456673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:58.456937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:58.457116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402103764833834:9406]
2025-10-15T11:01:58.459536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:58.460791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402100965144001:5420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:58.460428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:58.460640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:58.461972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:58.462288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.462296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.462303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.462309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.462316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.462324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.462330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.462337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.462343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.462349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.462356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.462362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.462368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.462375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.462414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.462511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.462557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.462604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.462647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.462691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.462743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.462785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.462825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.462868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.462911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.462951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.463004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.463049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.463086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.463146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.463200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.463252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.463298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.463397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.463442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.463493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.463540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.463593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.463637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.463691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.463744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.463807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.463857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.463914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.463963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.464024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.464094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.464158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.464214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.464288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.464353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.464406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.464472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.464546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.464598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.464652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.465141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:58.478292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402100965144001:5420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:58.478336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402100965144001:5420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:58.478353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402100965144001:5420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:58.478384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:58.485779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:58.496082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:58.496119Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:58.496129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:58.496142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:58.496160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1005 [2:7561402103764833834:9406]
2025-10-15T11:01:58.496195Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:58.496239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:58.496250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:58.496259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:58.496267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:58.496314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:58.496329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:58.496344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:58.501209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402100965144039:5602]
2025-10-15T11:01:58.506566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.506595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.506607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.506617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:58.506875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:58.506890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.507014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.507171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.508614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1005, pipe: [1:7561402100965144039:5602]
2025-10-15T11:01:58.508708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1005
2025-10-15T11:01:58.508021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:58.508773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1005
2025-10-15T11:01:58.508101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402100965144039:5602], now have 1 active actors on pipe
2025-10-15T11:01:58.508124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402100965144037:5420], now have 1 active actors on pipe
2025-10-15T11:01:58.508143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402100965143948:2467], now have 1 active actors on pipe
2025-10-15T11:01:58.508167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402103764833829:9406]
2025-10-15T11:01:58.508178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402103764833829:9406]
2025-10-15T11:01:58.508190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402103764833829:9406]
2025-10-15T11:01:58.508232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:58.508281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:58.508312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:58.508318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:58.508331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:58.508485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:58.508502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:58.508605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402103764833829:9406]
2025-10-15T11:01:58.508633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:58.508886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:58.509417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:58.509446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:58.509524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:58.509552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:58.509570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:58.509581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:58.509613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:58.509651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:58.509691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:58.510372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:58.510395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:58.510452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:58.510733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1006 partition: 0 MaxSeqNo: 46 sessionId: src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0
2025-10-15T11:01:58.511560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|570f2a3c-140820de-51ee043d-1002fcce_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:58.557449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0] Write session: try to update token
2025-10-15T11:01:58.557499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:58.570883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:58.570918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:58.570953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402103764833829:9406]
2025-10-15T11:01:58.571074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:58.571121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:58.574134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:58.575641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:58.576960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:58.578348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:58.580442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:58.580861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:58.695944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId: src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:58.723407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:58.723449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:58.723463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:58.723528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:58.723546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:58.723563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:58.723576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:58.723623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402103764833829:9406]
2025-10-15T11:01:58.723655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402103764833829:9406]
2025-10-15T11:01:58.723683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402103764833829:9406]
2025-10-15T11:01:58.723784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:58.723825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:58.723860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:58.724130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:58.724163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:58.725164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:58.735222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:58.871163Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:58.874296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:58.874353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:58.878110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402100965144039:5602]
2025-10-15T11:01:58.878184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:58.878199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:58.878216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:58.881184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:58.934571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1006 reason: error at write: Disconnected sessionId: src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0
2025-10-15T11:01:58.934866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1006 sessionId: src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0 is DEAD
2025-10-15T11:01:58.935333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:58.935404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0] Write session will restart in 0.006365s
2025-10-15T11:01:58.935555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0] Write session: Do CDS request
2025-10-15T11:01:58.935602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:58.944892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:58.949937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:58.949968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1007
2025-10-15T11:01:58.950624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:58.951426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:58.951444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:58.951485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:58.951733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:58.951911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402103764833929:9411]
2025-10-15T11:01:58.953343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:58.954173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:58.954377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:58.955331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:58.955597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.955613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.955619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.955626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.955634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.955639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.955647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.955654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.955661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.955667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.955673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.955679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.955686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.955692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.955734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.955830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.955874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.955919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.956284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:58.957070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:58.957184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:58.957200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:58.957209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:58.955961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.956019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.956050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.956081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.956113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.956157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.956203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.956240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.956284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.956321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.956360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.956422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:58.956474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.956525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:58.956562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.956597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:58.956630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.956679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:58.956713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.956761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:58.956790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.956833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:58.956872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.956918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:58.956958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.958076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:58.958137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.958193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:58.958238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.958291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:58.958336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.958388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:58.958432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.958483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.958526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.958577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.958620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.958670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.959120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:58.958601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1007 sessionId:  describe result for acl check
2025-10-15T11:01:58.958700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:58.958710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:58.958718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:58.958733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402100965144120:5409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:58.960898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402100965144120:5409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:58.965823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402100965144120:5409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:58.971992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402100965144120:5409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:58.972032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402100965144120:5409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:58.972048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402100965144120:5409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:58.972074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:58.978455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402100965144149:5602]
2025-10-15T11:01:58.979293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:58.989163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:58.989212Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:58.989229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:58.989246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:58.989269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1006 [2:7561402103764833929:9411]
2025-10-15T11:01:58.989314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:58.989371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:58.989386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:58.989398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:58.989409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:58.989452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:58.989471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:58.989490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:58.990522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.990547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.990561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.990573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:58.990824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:58.991093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1006
2025-10-15T11:01:58.991128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1006, pipe: [1:7561402100965144149:5602]
2025-10-15T11:01:58.991195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1006
2025-10-15T11:01:58.991044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:58.991180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:58.991375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:58.991591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:58.991670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402100965144062:2467], now have 1 active actors on pipe
2025-10-15T11:01:58.991698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402100965144149:5602], now have 1 active actors on pipe
2025-10-15T11:01:58.991721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402100965144148:5409], now have 1 active actors on pipe
2025-10-15T11:01:58.991781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:58.991802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:58.991835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402103764833924:9411]
2025-10-15T11:01:58.991850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402103764833924:9411]
2025-10-15T11:01:58.991861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402103764833924:9411]
2025-10-15T11:01:58.991901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:58.991969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:58.992141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:58.992157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:58.992216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|909fb976-250c930d-681a3a2b-ad20d786_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:58.992244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:58.992276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:58.992286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:58.992320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:58.992356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:58.992469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402103764833924:9411]
2025-10-15T11:01:58.992489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:58.992530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:58.995447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:58.995464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:58.995476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:58.995503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:58.995928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:58.995952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:58.996069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:58.996415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1007 partition: 0 MaxSeqNo: 46 sessionId: src_id|909fb976-250c930d-681a3a2b-ad20d786_0
2025-10-15T11:01:58.998410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7dfd265-e4500a9e-d7ce0adc-56d11d6f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|909fb976-250c930d-681a3a2b-ad20d786_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:59.026163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909fb976-250c930d-681a3a2b-ad20d786_0] Write session: try to update token
2025-10-15T11:01:59.026240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909fb976-250c930d-681a3a2b-ad20d786_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:59.078546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:59.078581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:59.078616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402103764833924:9411]
2025-10-15T11:01:59.078739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:59.078800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:59.082553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:59.084183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:59.095892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:59.100455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:59.129618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:59.130354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:59.130376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:59.130387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:59.130442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:59.175012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId: src_id|909fb976-250c930d-681a3a2b-ad20d786_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:59.202242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:59.202278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:59.202292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:59.202302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:59.202338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402103764833924:9411]
2025-10-15T11:01:59.202363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402103764833924:9411]
2025-10-15T11:01:59.202387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402103764833924:9411]
2025-10-15T11:01:59.202491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:59.202519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:59.202529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:59.202540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:59.202556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:59.204481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:59.203758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:59.355221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402100965144149:5602]
2025-10-15T11:01:59.355288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:01:59.355299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:01:59.355529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:59.352269Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:59.354429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:59.354449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:59.356255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:59.379247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1007 reason: error at write: Disconnected sessionId: src_id|909fb976-250c930d-681a3a2b-ad20d786_0
2025-10-15T11:01:59.379550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1007 sessionId: src_id|909fb976-250c930d-681a3a2b-ad20d786_0 is DEAD
2025-10-15T11:01:59.383981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fb976-250c930d-681a3a2b-ad20d786_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:01:59.384044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fb976-250c930d-681a3a2b-ad20d786_0] Write session will restart in 0.005640s
2025-10-15T11:01:59.384218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fb976-250c930d-681a3a2b-ad20d786_0] Write session: Do CDS request
2025-10-15T11:01:59.384280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fb976-250c930d-681a3a2b-ad20d786_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:59.396040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|909fb976-250c930d-681a3a2b-ad20d786_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:59.395864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:59.395893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1008
2025-10-15T11:01:59.396562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:59.396678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:59.396700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:59.396709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:59.398260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1008 sessionId:  describe result for acl check
2025-10-15T11:01:59.398350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:59.398360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:59.398369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:59.398384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402105260111474:5405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:59.400709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402105260111474:5405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:59.414151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402105260111474:5405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:59.423312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402105260111474:5405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:59.423364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402105260111474:5405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:59.423380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402105260111474:5405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:59.423410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:59.426283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:59.429582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:59.430345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:59.430366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:59.430400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:59.430634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:59.430821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402108059801332:9420]
2025-10-15T11:01:59.432660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:59.433426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:59.433596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:59.434596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:59.434894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:59.434901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:59.434908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:59.434912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:59.434916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:59.434920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:59.434924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:59.434928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:59.434933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:59.434937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:59.434941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:59.434945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.434949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.434953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.434984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:59.435062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:59.435099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:59.435131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:59.435171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:59.435201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:59.435230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:59.435260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:59.435290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:59.435320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:59.435382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:59.435418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.435447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.435478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.435505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:59.435550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:59.435602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:59.435649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:59.435697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:59.435746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:59.435775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:59.435807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:59.435836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:59.435869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:59.435904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:59.435942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:59.435970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:59.436007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:59.436036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:59.436074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:59.436113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:59.436150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:59.436190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:59.436225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:59.436267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:59.436300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:59.436330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.436363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.436393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.436437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.436464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.436499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.436846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:59.455236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402105260111561:5602]
2025-10-15T11:01:59.458495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:59.469714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:59.469759Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:59.469773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:59.469789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:59.469814Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1007 [2:7561402108059801332:9420]
2025-10-15T11:01:59.469860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:59.469906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:59.469918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:59.469929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:59.469940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:59.469981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:59.470000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:59.470019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:59.471815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.471843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.471858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.471868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:59.472125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:59.472155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.472293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.472462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.472679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:59.472749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402108059801327:9420]
2025-10-15T11:01:59.472775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402108059801327:9420]
2025-10-15T11:01:59.472788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402108059801327:9420]
2025-10-15T11:01:59.472825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:59.472891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:59.473016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:59.473029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:59.473039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:59.473045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:59.473061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:59.473194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402105260111542:5405], now have 1 active actors on pipe
2025-10-15T11:01:59.473215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402108059801327:9420]
2025-10-15T11:01:59.473234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:59.473252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:59.473313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402105260111461:2467], now have 1 active actors on pipe
2025-10-15T11:01:59.473333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402105260111561:5602], now have 1 active actors on pipe
2025-10-15T11:01:59.474498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:59.474561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:59.474652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:59.474709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:59.474734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:59.474749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:59.474786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:59.474822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:59.473814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1007
2025-10-15T11:01:59.473889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1007
2025-10-15T11:01:59.473937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1007, pipe: [1:7561402105260111561:5602]
2025-10-15T11:01:59.474883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:59.483609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:59.483648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:59.483723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:59.484306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1008 partition: 0 MaxSeqNo: 46 sessionId: src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0
2025-10-15T11:01:59.487911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|909fb976-250c930d-681a3a2b-ad20d786_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:59.524005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0] Write session: try to update token
2025-10-15T11:01:59.524057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:59.566525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:59.566564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:59.566576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:59.566586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:59.566618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402108059801327:9420]
2025-10-15T11:01:59.566642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402108059801327:9420]
2025-10-15T11:01:59.566666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402108059801327:9420]
2025-10-15T11:01:59.566855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:59.566884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:59.567447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:59.567476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:59.567502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:59.568260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:59.630112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId: src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:01:59.651604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:01:59.713104Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:01:59.733711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:01:59.733920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402105260111561:5602]
2025-10-15T11:01:59.734044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:01:59.731984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:59.732039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:59.732101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:59.732115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:59.732151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402108059801327:9420]
2025-10-15T11:01:59.732368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:59.732717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:01:59.749930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1008 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0
2025-10-15T11:01:59.750349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1008 sessionId: src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0 is DEAD
2025-10-15T11:01:59.751802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:01:59.751844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0] Write session will restart in 0.006347s
2025-10-15T11:01:59.751975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0] Write session: Do CDS request
2025-10-15T11:01:59.752008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:01:59.762194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:59.771023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:01:59.771053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1009
2025-10-15T11:01:59.771518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:01:59.771621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:01:59.771634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:01:59.771643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:01:59.772878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1009 sessionId:  describe result for acl check
2025-10-15T11:01:59.772978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:01:59.772987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:01:59.772995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:01:59.773010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402105260111604:5374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:01:59.775226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402105260111604:5374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:01:59.783288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402105260111604:5374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:01:59.790190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402105260111604:5374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:01:59.790225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402105260111604:5374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:01:59.790240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402105260111604:5374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:01:59.790268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:01:59.790790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:01:59.794340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:01:59.794964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:01:59.794989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:01:59.795026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:01:59.795195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:01:59.795339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402108059801454:9424]
2025-10-15T11:01:59.797063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:01:59.797827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:01:59.798017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:01:59.799085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:01:59.799361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:59.799370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:59.799377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:59.799383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:59.799389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:59.799395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:59.799400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:59.799407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:59.799413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:59.799419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:59.799425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:59.799431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.799437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.799442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.799481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:59.799577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:59.799620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:59.799662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:59.799701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:59.799742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:59.799782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:59.799824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:59.799875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:59.799924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:59.799967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:59.800012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.800060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.800108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.800150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:59.800209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:01:59.800279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:59.800336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:01:59.800384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:59.800434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:01:59.800482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:59.800536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:01:59.800581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:59.800639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:01:59.800682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:59.800734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:01:59.800783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:59.800836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:01:59.800880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:59.800931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:01:59.800978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:59.801032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:01:59.801078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:59.801132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:01:59.801179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:59.801231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:01:59.801276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.801328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.801375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.801428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.801472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.801522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.801979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:01:59.825912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:01:59.832951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402105260111675:5602]
2025-10-15T11:01:59.838339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:01:59.838385Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:01:59.838401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:01:59.838419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:01:59.838442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1008 [2:7561402108059801454:9424]
2025-10-15T11:01:59.838486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:01:59.838535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:01:59.838548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:59.838559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:59.838569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:59.838613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:01:59.838637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:01:59.838656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:01:59.841120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.841151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.841163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.841173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:01:59.841439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:01:59.841463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:01:59.842105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1008, pipe: [1:7561402105260111675:5602]
2025-10-15T11:01:59.842202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1008
2025-10-15T11:01:59.842284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1008
2025-10-15T11:01:59.841591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:01:59.841774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:01:59.842012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:01:59.842088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402105260111675:5602], now have 1 active actors on pipe
2025-10-15T11:01:59.842109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402105260111586:2467], now have 1 active actors on pipe
2025-10-15T11:01:59.842128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402105260111667:5374], now have 1 active actors on pipe
2025-10-15T11:01:59.842151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402108059801448:9424]
2025-10-15T11:01:59.842164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402108059801448:9424]
2025-10-15T11:01:59.842176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402108059801448:9424]
2025-10-15T11:01:59.842213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:01:59.842276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:01:59.842438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:01:59.842452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:01:59.842478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:01:59.842491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:01:59.842502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:01:59.842553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402108059801448:9424]
2025-10-15T11:01:59.842570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:01:59.842602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:01:59.842703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:59.842721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:59.842783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:01:59.842809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:59.842824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:59.842833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:01:59.842865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:59.842901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:01:59.842941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:59.843748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:01:59.843776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:01:59.843838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:01:59.845585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1009 partition: 0 MaxSeqNo: 46 sessionId: src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0
2025-10-15T11:01:59.846361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c52c747e-9198f3b2-603d2156-ad92d2ca_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:01:59.877063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0] Write session: try to update token
2025-10-15T11:01:59.877131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:01:59.904659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:01:59.904693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:59.904733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402108059801448:9424]
2025-10-15T11:01:59.904851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:01:59.906696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:01:59.913594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:01:59.914898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:59.916236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:59.917632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:01:59.919485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:01:59.920445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:01:59.979448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:01:59.979479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:01:59.979489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:01:59.979534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:01:59.979546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:01:59.979557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:01:59.979567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:01:59.979599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402108059801448:9424]
2025-10-15T11:01:59.979623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402108059801448:9424]
2025-10-15T11:01:59.979645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402108059801448:9424]
2025-10-15T11:01:59.979760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:01:59.979787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:01:59.980817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:01:59.982071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:01:59.982114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:01:59.982141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:01:59.996025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId: src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:00.026321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:00.140340Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:00.161392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:00.161440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:00.161967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:00.162257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402105260111675:5602]
2025-10-15T11:02:00.162352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:00.162370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:00.163566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:00.182523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1009 reason: error at write: Disconnected sessionId: src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0
2025-10-15T11:02:00.182799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1009 sessionId: src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0 is DEAD
2025-10-15T11:02:00.187657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:00.187693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0] Write session will restart in 0.008613s
2025-10-15T11:02:00.187788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0] Write session: Do CDS request
2025-10-15T11:02:00.187818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:00.207920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:00.207470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:00.207501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1010
2025-10-15T11:02:00.208945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:00.209049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:00.209063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:00.209071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:00.212805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1010 sessionId:  describe result for acl check
2025-10-15T11:02:00.212927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:00.212938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:00.212947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:00.212963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402109555079053:5357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:00.215452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402109555079053:5357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:00.221217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:00.226240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402109555079053:5357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:00.227840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:00.228836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:00.228857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:00.228907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:00.229213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:00.229418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402112354768847:9432]
2025-10-15T11:02:00.232385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402109555079053:5357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:00.232431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402109555079053:5357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:00.232447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402109555079053:5357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:00.232474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:00.231769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:00.233669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:00.233919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:00.235195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:00.235547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:00.235572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:00.235578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:00.235585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:00.235593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:00.235600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:00.235607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:00.235613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:00.235620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:00.235626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:00.235633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:00.235640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.235647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.235653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.235696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:00.235799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:00.235847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:00.235892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:00.235935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:00.235980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:00.236032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:00.236077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:00.236127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:00.236173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:00.236229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:00.236272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.236312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.236355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.236403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:00.236471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:00.236535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:00.236593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:00.236645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:00.236698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:00.236749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:00.236802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:00.236854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:00.236909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:00.236960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:00.237012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:00.237062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:00.237117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:00.237164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:00.237217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:00.237269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:00.237324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:00.237375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:00.237432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:00.237479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:00.237537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:00.237586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.237644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.237693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.237747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.237795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.237849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.238498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:00.262426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:00.263505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402109555079089:5602]
2025-10-15T11:02:00.272472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:00.272525Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:00.272543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:00.272562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:00.272589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1009 [2:7561402112354768847:9432]
2025-10-15T11:02:00.272640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:00.272697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:00.272712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:00.272725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:00.272737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:00.272783Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:00.272805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:00.272825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:00.299058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1009
2025-10-15T11:02:00.299059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1009, pipe: [1:7561402109555079089:5602]
2025-10-15T11:02:00.299176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1009
2025-10-15T11:02:00.298350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.298379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.298391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.298401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:00.298676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:00.298691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.298820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.298980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.299186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:00.299261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402109555079089:5602], now have 1 active actors on pipe
2025-10-15T11:02:00.299282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402109555079001:2467], now have 1 active actors on pipe
2025-10-15T11:02:00.299303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402109555079083:5357], now have 1 active actors on pipe
2025-10-15T11:02:00.299324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402112354768842:9432]
2025-10-15T11:02:00.299337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402112354768842:9432]
2025-10-15T11:02:00.299719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402112354768842:9432]
2025-10-15T11:02:00.299771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:00.299812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:00.299826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:00.299837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:00.299849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:00.300022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:00.300051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:00.300106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:00.300132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:00.300282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402112354768842:9432]
2025-10-15T11:02:00.300321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:00.300386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:00.300420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:00.300443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:00.300454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:00.300485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:00.300522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:00.300650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:00.300657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:00.301388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:00.301424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:00.301488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:00.302289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1010 partition: 0 MaxSeqNo: 46 sessionId: src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0
2025-10-15T11:02:00.303081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|634cbdb8-b5af7fa7-dc12659b-f74982dc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:00.336542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0] Write session: try to update token
2025-10-15T11:02:00.336613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:00.369420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:00.369455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:00.369490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402112354768842:9432]
2025-10-15T11:02:00.369602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:00.370850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:00.380916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:00.382185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:00.384437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:00.385810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:00.387472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:00.387943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:00.387963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:00.387973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:00.388028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:00.486556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:00.486601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:00.486617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:00.486631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:00.486678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402112354768842:9432]
2025-10-15T11:02:00.486708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402112354768842:9432]
2025-10-15T11:02:00.486734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402112354768842:9432]
2025-10-15T11:02:00.486895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:00.486921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:00.488240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:00.491594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:00.491654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:00.491690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:00.503707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId: src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:00.530792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:00.667045Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:00.668610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:00.668666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:00.674974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:00.673364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402109555079089:5602]
2025-10-15T11:02:00.673455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:00.673588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:00.673601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:00.734782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1010 reason: error at write: Disconnected sessionId: src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0
2025-10-15T11:02:00.735112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1010 sessionId: src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0 is DEAD
2025-10-15T11:02:00.735920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:00.735968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0] Write session will restart in 0.007535s
2025-10-15T11:02:00.736140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0] Write session: Do CDS request
2025-10-15T11:02:00.736205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:00.748987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:00.750124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:00.750154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1011
2025-10-15T11:02:00.750449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:00.750563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:00.750585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:00.750596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:00.754193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1011 sessionId:  describe result for acl check
2025-10-15T11:02:00.754313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:00.754330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:00.754340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:00.754360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402109555079170:5352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:00.756612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402109555079170:5352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:00.755481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:00.761564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:00.762308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:00.762320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:00.762352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:00.762541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:00.762657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402112354768957:9436]
2025-10-15T11:02:00.764090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:00.765130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:00.765266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:00.766068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:00.766293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:00.766304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:00.766309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:00.766313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:00.766318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:00.766322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:00.766326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:00.766331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:00.766335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:00.766339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:00.766343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:00.766347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.766352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.766358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.766389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:00.766459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:00.766492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:00.766440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402109555079170:5352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:00.766524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:00.766573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:00.766610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:00.766641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:00.766673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:00.766701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:00.766734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:00.766764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:00.766796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.766826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.766855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.766880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:00.766923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:00.766958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:00.766993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:00.767024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:00.767059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:00.767097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:00.767133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:00.767163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:00.767197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:00.767227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:00.767260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:00.767289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:00.767325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:00.767379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:00.767429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:00.767474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:00.767525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:00.767569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:00.767616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:00.767659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:00.767709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:00.767761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.767819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.767866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.767913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.767953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.768001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.768396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:00.773528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402109555079170:5352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:00.773574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402109555079170:5352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:00.773593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402109555079170:5352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:00.773625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:00.775711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402109555079205:5602]
2025-10-15T11:02:00.791580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:00.803666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:00.803714Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:00.803731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:00.803750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:00.803775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1010 [2:7561402112354768957:9436]
2025-10-15T11:02:00.803834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:00.803891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:00.803905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:00.803917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:00.803929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:00.803982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:00.804005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:00.804028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:00.815183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.815221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.815233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.815244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:00.816129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:00.816170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:00.816312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:00.816502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:00.816733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:00.816818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402109555079205:5602], now have 1 active actors on pipe
2025-10-15T11:02:00.816842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402109555079203:5352], now have 1 active actors on pipe
2025-10-15T11:02:00.816864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402109555079114:2467], now have 1 active actors on pipe
2025-10-15T11:02:00.816891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402112354768950:9436]
2025-10-15T11:02:00.816908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402112354768950:9436]
2025-10-15T11:02:00.816920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402112354768950:9436]
2025-10-15T11:02:00.816959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:00.817039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:00.817222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:00.817240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:00.817366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402112354768950:9436]
2025-10-15T11:02:00.817384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:00.818084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:00.818106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:00.818117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:00.818141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:00.818752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1010, pipe: [1:7561402109555079205:5602]
2025-10-15T11:02:00.818884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1010
2025-10-15T11:02:00.818955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1010
2025-10-15T11:02:00.823468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:00.823517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:00.823628Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|300ea382-f7248ec-48f8fe93-e166077c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:00.823667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:00.823686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:00.823698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:00.823739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:00.823789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:00.823840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:00.828436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:00.828479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:00.828566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:00.829024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1011 partition: 0 MaxSeqNo: 46 sessionId: src_id|300ea382-f7248ec-48f8fe93-e166077c_0
2025-10-15T11:02:00.830006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52ea17c-b6aec88d-e8afaa8f-e12b807c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|300ea382-f7248ec-48f8fe93-e166077c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:00.887743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|300ea382-f7248ec-48f8fe93-e166077c_0] Write session: try to update token
2025-10-15T11:02:00.887802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|300ea382-f7248ec-48f8fe93-e166077c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:00.967022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:00.967064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:00.967077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:00.967137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:00.967152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:00.967168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:00.967179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:00.971435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402112354768950:9436]
2025-10-15T11:02:00.971515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402112354768950:9436]
2025-10-15T11:02:00.971544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402112354768950:9436]
2025-10-15T11:02:00.971863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:00.971919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:00.973051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:00.975529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:00.975611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:00.975651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:01.052646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId: src_id|300ea382-f7248ec-48f8fe93-e166077c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:01.080665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:01.147934Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:01.166399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:01.166452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:01.167220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:01.167244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:01.167284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402112354768950:9436]
2025-10-15T11:02:01.167910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:01.171607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402109555079205:5602]
2025-10-15T11:02:01.171717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:01.171731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:01.171711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:01.205834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:01.206045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1011 reason: error at write: Disconnected sessionId: src_id|300ea382-f7248ec-48f8fe93-e166077c_0
2025-10-15T11:02:01.206359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1011 sessionId: src_id|300ea382-f7248ec-48f8fe93-e166077c_0 is DEAD
2025-10-15T11:02:01.211664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300ea382-f7248ec-48f8fe93-e166077c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:01.211731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300ea382-f7248ec-48f8fe93-e166077c_0] Write session will restart in 0.006776s
2025-10-15T11:02:01.211905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300ea382-f7248ec-48f8fe93-e166077c_0] Write session: Do CDS request
2025-10-15T11:02:01.211955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300ea382-f7248ec-48f8fe93-e166077c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:01.230244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|300ea382-f7248ec-48f8fe93-e166077c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:01.235075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:01.235107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1012
2025-10-15T11:02:01.235498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:01.235611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:01.235631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:01.235640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:01.238095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1012 sessionId:  describe result for acl check
2025-10-15T11:02:01.238194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:01.238205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:01.238213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:01.238230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402113850046553:5324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:01.240683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402113850046553:5324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:01.248376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402113850046553:5324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:01.258164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:01.262707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:01.263569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:01.263603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:01.263642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:01.263876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:01.264064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402116649736360:9444]
2025-10-15T11:02:01.266302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:01.267784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:01.268646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402113850046553:5324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:01.268691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402113850046553:5324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:01.268710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402113850046553:5324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:01.268745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:01.268041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:01.269230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:01.269506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:01.269515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:01.269523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:01.269530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:01.269536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:01.269543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:01.269550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:01.269556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:01.269563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:01.269570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:01.269576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:01.269582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.269589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.269597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.269641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:01.269744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:01.269791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:01.269836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:01.269877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:01.269930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:01.269976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:01.270035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:01.270102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:01.270153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:01.270196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:01.270239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.270282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.270325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.270365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:01.270427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:01.270480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:01.270533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:01.270582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:01.270633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:01.270675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:01.270726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:01.270772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:01.270823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:01.270865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:01.270915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:01.270962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:01.271008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:01.271059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:01.271110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:01.271159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:01.271209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:01.271253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:01.271303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:01.272304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:01.272373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:01.272422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.272473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.272518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.272570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.272615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.272666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.273155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:01.275462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402113850046620:5602]
2025-10-15T11:02:01.308041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:01.317071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:01.317126Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:01.317143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:01.317173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:01.317202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1011 [2:7561402116649736360:9444]
2025-10-15T11:02:01.317255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:01.317312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:01.317341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:01.317352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:01.317363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:01.317413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:01.317435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:01.317455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:01.319866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1011
2025-10-15T11:02:01.319946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1011, pipe: [1:7561402113850046620:5602]
2025-10-15T11:02:01.320018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1011
2025-10-15T11:02:01.319053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.319073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.319082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.319090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:01.320352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:01.320373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.320501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.320625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.320817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:01.320892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402113850046616:5324], now have 1 active actors on pipe
2025-10-15T11:02:01.320912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402113850046620:5602], now have 1 active actors on pipe
2025-10-15T11:02:01.320925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402113850046532:2467], now have 1 active actors on pipe
2025-10-15T11:02:01.320966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:01.320984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:01.321023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402116649736355:9444]
2025-10-15T11:02:01.321037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402116649736355:9444]
2025-10-15T11:02:01.321047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402116649736355:9444]
2025-10-15T11:02:01.321074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:01.321110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:01.321130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:01.321141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:01.321145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:01.321290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:01.321314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:01.321367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4842d74-77de401c-8c894bdc-178bfd46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:01.321390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:01.321406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:01.321412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:01.321438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:01.321469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:01.321560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402116649736355:9444]
2025-10-15T11:02:01.321584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:01.321611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:01.321635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:01.324402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1012 partition: 0 MaxSeqNo: 46 sessionId: src_id|e4842d74-77de401c-8c894bdc-178bfd46_0
2025-10-15T11:02:01.323909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:01.323960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:01.324047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:01.327946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300ea382-f7248ec-48f8fe93-e166077c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e4842d74-77de401c-8c894bdc-178bfd46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:01.368002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4842d74-77de401c-8c894bdc-178bfd46_0] Write session: try to update token
2025-10-15T11:02:01.368067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4842d74-77de401c-8c894bdc-178bfd46_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:01.452077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:01.452128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:01.452138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:01.452196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:01.452211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:01.452224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:01.452235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:01.452268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402116649736355:9444]
2025-10-15T11:02:01.452296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402116649736355:9444]
2025-10-15T11:02:01.452322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402116649736355:9444]
2025-10-15T11:02:01.452468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:01.452499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:01.452716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:01.452766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:01.452793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:01.453556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:01.506508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId: src_id|e4842d74-77de401c-8c894bdc-178bfd46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:01.545043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:01.617050Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:01.619336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:01.619401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:01.622736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:01.628794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:01.650565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4842d74-77de401c-8c894bdc-178bfd46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:01.650639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4842d74-77de401c-8c894bdc-178bfd46_0] Write session will restart in 0.009609s
2025-10-15T11:02:01.650797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4842d74-77de401c-8c894bdc-178bfd46_0] Write session: Do CDS request
2025-10-15T11:02:01.650851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4842d74-77de401c-8c894bdc-178bfd46_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:01.649741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1012 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e4842d74-77de401c-8c894bdc-178bfd46_0
2025-10-15T11:02:01.650098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1012 sessionId: src_id|e4842d74-77de401c-8c894bdc-178bfd46_0 is DEAD
2025-10-15T11:02:01.669831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4842d74-77de401c-8c894bdc-178bfd46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:01.679582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402113850046620:5602]
2025-10-15T11:02:01.679662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:01.679812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:01.679827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1013
2025-10-15T11:02:01.690788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:01.690985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:01.691020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:01.691035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:01.694057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1013 sessionId:  describe result for acl check
2025-10-15T11:02:01.694222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:01.694245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:01.694261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:01.694289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402113850046693:5326] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:01.698510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402113850046693:5326] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:01.705440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402113850046693:5326] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:01.708110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:01.711815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:01.712809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:01.712828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:01.712873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:01.713125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:01.713294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402116649736494:9453]
2025-10-15T11:02:01.715743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:01.716704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:01.716903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:01.718119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:01.718427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:01.718435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:01.718440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:01.718448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:01.718454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:01.718461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:01.718467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:01.718474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:01.718479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:01.718486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:01.718492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:01.718498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.718504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.718510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.718557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:01.718655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:01.718701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:01.718748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:01.718793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:01.718835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:01.718878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:01.718922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:01.718963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:01.719006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:01.719052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:01.719095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.719140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.719181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.719221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:01.719282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:01.719337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:01.719418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:01.719467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:01.719518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:01.719565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:01.719616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:01.719665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:01.719721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:01.719765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:01.719818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:01.719866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:01.719918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:01.719964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:01.720014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:01.720061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:01.720130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:01.720175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:01.720228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:01.720273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:01.720323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:01.720369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.720420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.720467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.720518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.720562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.720612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.721095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:01.721180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402113850046693:5326] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:01.721221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402113850046693:5326] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:01.721236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402113850046693:5326] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:01.721264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:01.768201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:01.782120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402113850046746:5602]
2025-10-15T11:02:01.790032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:01.790081Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:01.790099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:01.790115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:01.790141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1012 [2:7561402116649736494:9453]
2025-10-15T11:02:01.790191Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:01.790246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:01.790260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:01.790272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:01.790283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:01.790328Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:01.790349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:01.790367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:01.796719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.796754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.797476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1012
2025-10-15T11:02:01.796767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.796777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:01.797591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1012
2025-10-15T11:02:01.797051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:01.797645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1012, pipe: [1:7561402113850046746:5602]
2025-10-15T11:02:01.800549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1013 partition: 0 MaxSeqNo: 46 sessionId: src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0
2025-10-15T11:02:01.797070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:01.803367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4842d74-77de401c-8c894bdc-178bfd46_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:01.797206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:01.797381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:01.797598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:01.797675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402113850046655:2467], now have 1 active actors on pipe
2025-10-15T11:02:01.797699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402113850046743:5326], now have 1 active actors on pipe
2025-10-15T11:02:01.797720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402113850046746:5602], now have 1 active actors on pipe
2025-10-15T11:02:01.797742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402116649736489:9453]
2025-10-15T11:02:01.797754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402116649736489:9453]
2025-10-15T11:02:01.797767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402116649736489:9453]
2025-10-15T11:02:01.797807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:01.797862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:01.797874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:01.797876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:01.797888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:01.798040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:01.798056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:01.798201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:01.798221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:01.798248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402116649736489:9453]
2025-10-15T11:02:01.798278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:01.798382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:01.798410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:01.798425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:01.798435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:01.798467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:01.798501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:01.798575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:01.798828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:01.800112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:01.800131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:01.800207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:01.836956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0] Write session: try to update token
2025-10-15T11:02:01.837022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:02.005505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId: src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:02.047842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:02.049228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:02.049265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:02.049278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:02.049338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:02.049355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:02.049369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:02.049380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:02.049678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402116649736489:9453]
2025-10-15T11:02:02.049709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402116649736489:9453]
2025-10-15T11:02:02.049736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402116649736489:9453]
2025-10-15T11:02:02.049983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:02.050009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:02.050047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:02.050072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:02.050601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:02.050635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:02.050667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:02.051288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:02.214720Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:02.225268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:02.225305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:02.225359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402116649736489:9453]
2025-10-15T11:02:02.225610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:02.225971Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:02.225890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402113850046746:5602]
2025-10-15T11:02:02.225987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:02.226115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:02.226129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:02.234950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1013 reason: error at write: Disconnected sessionId: src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0
2025-10-15T11:02:02.235311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1013 sessionId: src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0 is DEAD
2025-10-15T11:02:02.237829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:02.237914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0] Write session will restart in 0.009449s
2025-10-15T11:02:02.238138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0] Write session: Do CDS request
2025-10-15T11:02:02.238203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:02.253780Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:02.253989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:02.253813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1014
2025-10-15T11:02:02.258360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:02.258511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:02.258527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:02.258538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:02.265728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1014 sessionId:  describe result for acl check
2025-10-15T11:02:02.265926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:02.265960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:02.265987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:02.266017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402118145014078:5302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:02.271075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402118145014078:5302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:02.283823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402118145014078:5302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:02.300184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402118145014078:5302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:02.300229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402118145014078:5302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:02.300247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402118145014078:5302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:02.300282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:02.310258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:02.317251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:02.318222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:02.318241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:02.318287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:02.318591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:02.318795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402120944703902:9457]
2025-10-15T11:02:02.327675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402118145014155:5602]
2025-10-15T11:02:02.327397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:02.328916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:02.329192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:02.330583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:02.330954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:02.330963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:02.330971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:02.330978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:02.330985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:02.330993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:02.331000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:02.331008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:02.331015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:02.331022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:02.331029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:02.331036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.331043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.331050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.331103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:02.331223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:02.331275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:02.331328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:02.331399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:02.331452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:02.331502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:02.331552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:02.331604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:02.331669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:02.331723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:02.331771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.331818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.331867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.331924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:02.331999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:02.332088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:02.332151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:02.332206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:02.332265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:02.332316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:02.332386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:02.332442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:02.332506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:02.332560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:02.332618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:02.332667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:02.332724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:02.332781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:02.332842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:02.332897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:02.332960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:02.333009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:02.333065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:02.333117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:02.333177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:02.333225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.333283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.333333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.333391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.333448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.333509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.334074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:02.369699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:02.381192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:02.381245Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:02.381262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:02.381281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:02.381308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1013 [2:7561402120944703902:9457]
2025-10-15T11:02:02.381362Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:02.381419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:02.381435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:02.381447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:02.381457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:02.381507Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:02.381532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:02.381556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:02.384816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.384852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.384866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.384879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:02.385166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:02.385192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.385345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.385536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.385772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:02.385858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402120944703889:9457]
2025-10-15T11:02:02.385879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402120944703889:9457]
2025-10-15T11:02:02.385894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402120944703889:9457]
2025-10-15T11:02:02.385935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:02.386017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:02.386212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:02.386237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:02.386364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402120944703889:9457]
2025-10-15T11:02:02.386390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:02.386849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:02.386874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:02.386886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:02.386912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:02.388213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1013
2025-10-15T11:02:02.388292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1013, pipe: [1:7561402118145014155:5602]
2025-10-15T11:02:02.388379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1013
2025-10-15T11:02:02.388264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402118145014150:5302], now have 1 active actors on pipe
2025-10-15T11:02:02.388304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402118145014155:5602], now have 1 active actors on pipe
2025-10-15T11:02:02.388326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402118145014062:2467], now have 1 active actors on pipe
2025-10-15T11:02:02.388817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:02.388851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:02.388949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:02.389002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:02.389024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:02.389037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:02.389078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:02.389127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:02.389179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:02.390069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:02.390097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:02.390170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:02.390467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1014 partition: 0 MaxSeqNo: 46 sessionId: src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0
2025-10-15T11:02:02.391880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58300c9-713bb4b3-2181b8e0-856c14f4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:02.423375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0] Write session: try to update token
2025-10-15T11:02:02.423439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:02.439700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:02.439738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:02.439778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402120944703889:9457]
2025-10-15T11:02:02.439907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:02.440168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:02.441757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:02.443247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:02.452375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:02.503664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:02.515022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:02.516372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:02.516390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:02.516401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:02.516461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:02.569928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:02.569964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:02.569979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:02.569990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:02.570033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402120944703889:9457]
2025-10-15T11:02:02.570061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402120944703889:9457]
2025-10-15T11:02:02.570086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402120944703889:9457]
2025-10-15T11:02:02.570242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:02.570269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:02.571313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:02.571523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:02.571558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:02.571593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:02.597599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId: src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:02.622738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:02.726315Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:02.729145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:02.729188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:02.730847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:02.730874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:02.730632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:02.746947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402118145014155:5602]
2025-10-15T11:02:02.747031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:02.747151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1014 reason: error at write: Disconnected sessionId: src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0
2025-10-15T11:02:02.753156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:02.753224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0] Write session will restart in 0.006600s
2025-10-15T11:02:02.751648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1014 sessionId: src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0 is DEAD
2025-10-15T11:02:02.753366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0] Write session: Do CDS request
2025-10-15T11:02:02.753440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:02.765501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:02.775705Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:02.775739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1015
2025-10-15T11:02:02.776243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:02.776391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:02.776416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:02.776429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:02.777772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1015 sessionId:  describe result for acl check
2025-10-15T11:02:02.777889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:02.777900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:02.777909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:02.777930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402118145014207:5291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:02.781662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402118145014207:5291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:02.788229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402118145014207:5291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:02.800984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402118145014207:5291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:02.801028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402118145014207:5291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:02.801044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402118145014207:5291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:02.801074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:02.829141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:02.835496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:02.836417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:02.836437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:02.836484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:02.836757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:02.836941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402120944704014:9467]
2025-10-15T11:02:02.839250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:02.840412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:02.840660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:02.841976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:02.842340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:02.842364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:02.842371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:02.842379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:02.842386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:02.842393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:02.842399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:02.842406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:02.842413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:02.842420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:02.842427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:02.842434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.842442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.842449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.842496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:02.842606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:02.842654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:02.842704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:02.842756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:02.842809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:02.842856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:02.842906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:02.842958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:02.843008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:02.843055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:02.843106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.843156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.843414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.843476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:02.843546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:02.843608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:02.843673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:02.843725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:02.843780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:02.843827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:02.843881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:02.843929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:02.843984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:02.844079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:02.844137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:02.844192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:02.844244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:02.844294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:02.844366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:02.844421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:02.844478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:02.844526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:02.844581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:02.844627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:02.844680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:02.844726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.844784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.844833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.844890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.844936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.844991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.845505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:02.845784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402118145014288:5602]
2025-10-15T11:02:02.888666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:02.899966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:02.900032Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:02.900050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:02.900070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:02.900098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1014 [2:7561402120944704014:9467]
2025-10-15T11:02:02.900152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:02.900218Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:02.900237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:02.900251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:02.900262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:02.900311Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:02.900342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:02.900364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:02.919132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1014
2025-10-15T11:02:02.919252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1014
2025-10-15T11:02:02.919321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1014, pipe: [1:7561402118145014288:5602]
2025-10-15T11:02:02.918443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.918476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.918485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.918494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:02.918753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:02.918768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:02.918883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:02.919029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:02.919224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:02.919300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402118145014189:2467], now have 1 active actors on pipe
2025-10-15T11:02:02.919323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402118145014248:5291], now have 1 active actors on pipe
2025-10-15T11:02:02.919342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402118145014288:5602], now have 1 active actors on pipe
2025-10-15T11:02:02.919444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402120944704008:9467]
2025-10-15T11:02:02.919459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402120944704008:9467]
2025-10-15T11:02:02.919473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402120944704008:9467]
2025-10-15T11:02:02.919513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:02.919586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:02.919644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:02.919662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:02.919674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:02.919761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:02.919779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:02.919890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402120944704008:9467]
2025-10-15T11:02:02.919915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:02.919958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:02.919989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:02.920010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:02.920172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2762f167-e1159b6c-a3df0189-89e89e18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:02.920203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:02.920221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:02.920232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:02.920268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:02.920308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:02.920365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:02.923179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:02.923232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:02.923324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:02.923675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1015 partition: 0 MaxSeqNo: 46 sessionId: src_id|2762f167-e1159b6c-a3df0189-89e89e18_0
2025-10-15T11:02:02.927587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13eab4a5-e49699f6-1c05ad05-9d7b9e68_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2762f167-e1159b6c-a3df0189-89e89e18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:03.003268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2762f167-e1159b6c-a3df0189-89e89e18_0] Write session: try to update token
2025-10-15T11:02:03.003329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2762f167-e1159b6c-a3df0189-89e89e18_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:03.123462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:03.123502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:03.123513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:03.123637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:03.123652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:03.123666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:03.123676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:03.123708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402120944704008:9467]
2025-10-15T11:02:03.123736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402120944704008:9467]
2025-10-15T11:02:03.123761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402120944704008:9467]
2025-10-15T11:02:03.124952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:03.125000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:03.125030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:03.170842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId: src_id|2762f167-e1159b6c-a3df0189-89e89e18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:03.173678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:03.173735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:03.181749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:03.204090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:03.359215Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:03.362366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:03.362411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:03.362464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402120944704008:9467]
2025-10-15T11:02:03.362630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:03.362646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:03.362677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:03.365926Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:03.365385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:03.365415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:03.367639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402118145014288:5602]
2025-10-15T11:02:03.367775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:03.374452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1015 reason: error at write: Disconnected sessionId: src_id|2762f167-e1159b6c-a3df0189-89e89e18_0
2025-10-15T11:02:03.375224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762f167-e1159b6c-a3df0189-89e89e18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:03.375292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762f167-e1159b6c-a3df0189-89e89e18_0] Write session will restart in 0.008678s
2025-10-15T11:02:03.375484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762f167-e1159b6c-a3df0189-89e89e18_0] Write session: Do CDS request
2025-10-15T11:02:03.375538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762f167-e1159b6c-a3df0189-89e89e18_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:03.374775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1015 sessionId: src_id|2762f167-e1159b6c-a3df0189-89e89e18_0 is DEAD
2025-10-15T11:02:03.390731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2762f167-e1159b6c-a3df0189-89e89e18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:03.391785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:03.391818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1016
2025-10-15T11:02:03.392169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:03.392301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:03.392317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:03.392329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:03.393593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1016 sessionId:  describe result for acl check
2025-10-15T11:02:03.393698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:03.393708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:03.393717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:03.393732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402122439981632:5277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:03.396360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402122439981632:5277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:03.419705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402122439981632:5277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:03.439895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402122439981632:5277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:03.439942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402122439981632:5277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:03.439959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402122439981632:5277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:03.440005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:03.449094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:03.456702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:03.457720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:03.457742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:03.457792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:03.458105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:03.458304Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402125239671436:9476]
2025-10-15T11:02:03.460756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:03.462733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:03.463007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:03.464417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:03.464798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:03.464807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:03.464814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:03.464819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:03.464825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:03.464833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:03.464839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:03.464845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:03.464852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:03.464858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:03.464866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:03.464872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:03.464878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:03.464884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:03.464933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:03.465046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:03.465092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:03.465139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:03.465184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:03.465228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:03.465272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:03.465317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:03.465359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:03.465407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:03.465451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:03.465495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:03.465537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:03.465579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:03.465623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:03.465816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:03.465883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:03.465939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:03.466000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:03.466056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:03.466100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:03.466154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:03.466202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:03.466255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:03.466299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:03.466350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:03.466438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:03.466493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:03.466538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:03.466607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:03.466658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:03.466711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:03.466751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:03.466813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:03.466859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:03.466908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:03.466950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:03.467010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:03.467056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:03.467106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:03.467150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:03.467200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:03.467706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:03.467664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402122439981713:5602]
2025-10-15T11:02:03.512807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:03.535240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:03.535285Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:03.535302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:03.535322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:03.535374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1015 [2:7561402125239671436:9476]
2025-10-15T11:02:03.535428Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:03.535486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:03.535501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:03.535513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:03.535525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:03.535569Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:03.535589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:03.535610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:03.538481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1015
2025-10-15T11:02:03.538608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1015
2025-10-15T11:02:03.538665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1015, pipe: [1:7561402122439981713:5602]
2025-10-15T11:02:03.537031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:03.537059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:03.537072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:03.537084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:03.537379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:03.537398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:03.537550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:03.537755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:03.537999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:03.538082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402122439981619:2467], now have 1 active actors on pipe
2025-10-15T11:02:03.538110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402122439981707:5277], now have 1 active actors on pipe
2025-10-15T11:02:03.538131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402122439981713:5602], now have 1 active actors on pipe
2025-10-15T11:02:03.538155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402125239671431:9476]
2025-10-15T11:02:03.538174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402125239671431:9476]
2025-10-15T11:02:03.538192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402125239671431:9476]
2025-10-15T11:02:03.538247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:03.538320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:03.538521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:03.538540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:03.538671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402125239671431:9476]
2025-10-15T11:02:03.538693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:03.539330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:03.539371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:03.539383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:03.539410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:03.540396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:03.543083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1016 partition: 0 MaxSeqNo: 46 sessionId: src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0
2025-10-15T11:02:03.540426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:03.540501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:03.540535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:03.540553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:03.540565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:03.540599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:03.540638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:03.540678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:03.542648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:03.542678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:03.542755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:03.547607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2762f167-e1159b6c-a3df0189-89e89e18_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:03.589997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0] Write session: try to update token
2025-10-15T11:02:03.590073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:03.720906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId: src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:03.758167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:03.775707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:03.775741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:03.775752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:03.775804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:03.775819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:03.775832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:03.775842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:03.775875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402125239671431:9476]
2025-10-15T11:02:03.775901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402125239671431:9476]
2025-10-15T11:02:03.775928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402125239671431:9476]
2025-10-15T11:02:03.776050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:03.776094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:03.776126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:03.776171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:03.776206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:03.776238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:03.776257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:03.777243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:03.929812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:03.944862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:03.944895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:03.944937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402125239671431:9476]
2025-10-15T11:02:03.946874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:03.947628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402122439981713:5602]
2025-10-15T11:02:03.947714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:03.947745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:03.947758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:03.948303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:03.959243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:03.959290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0] Write session will restart in 0.007723s
2025-10-15T11:02:03.956354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1016 reason: error at write: Disconnected sessionId: src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0
2025-10-15T11:02:03.959433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0] Write session: Do CDS request
2025-10-15T11:02:03.956672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1016 sessionId: src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0 is DEAD
2025-10-15T11:02:03.959487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:03.975769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:03.975991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:03.976022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1017
2025-10-15T11:02:03.976437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:03.976547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:03.976561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:03.976570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:03.977913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1017 sessionId:  describe result for acl check
2025-10-15T11:02:03.978019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:03.978029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:03.978038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:03.978052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402122439981749:5265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:03.980826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402122439981749:5265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:03.992702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402122439981749:5265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:04.024825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402122439981749:5265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:04.024865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402122439981749:5265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:04.024882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402122439981749:5265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:04.024911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:04.047873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402126734949126:5602]
2025-10-15T11:02:04.057809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:04.064340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:04.065281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:04.065314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:04.065359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:04.065623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:04.065804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402129534638858:9486]
2025-10-15T11:02:04.068440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:04.069593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:04.069817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:04.071009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:04.071327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:04.071336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:04.071342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:04.071376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:04.071382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:04.071389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:04.071397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:04.071404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:04.071411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:04.071418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:04.071424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:04.071432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.071439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.071446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.071490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:04.071599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:04.071647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:04.071694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:04.071738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:04.071782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:04.071825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:04.071873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:04.071923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:04.071985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:04.072030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:04.072075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.072118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.072163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.072206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:04.072266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:04.072322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:04.072376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:04.072421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:04.072472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:04.072513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:04.072563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:04.072609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:04.072662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:04.072705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:04.072813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:04.072862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:04.072914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:04.072957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:04.073008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:04.073056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:04.073107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:04.073152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:04.073203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:04.073248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:04.073300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:04.073346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.073395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.073439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.073492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.073536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.073590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.075404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:04.111958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:04.134448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:04.134494Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:04.134509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:04.134524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:04.134547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1016 [2:7561402129534638858:9486]
2025-10-15T11:02:04.134596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:04.134645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:04.134658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:04.134669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:04.134678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:04.134719Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:04.134740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:04.134759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:04.136236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.136258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.136271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.136282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:04.136529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:04.136545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.136681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.136861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.137090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:04.137162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402122439981738:2467], now have 1 active actors on pipe
2025-10-15T11:02:04.137187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402126734949126:5602], now have 1 active actors on pipe
2025-10-15T11:02:04.137208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402126734949079:5265], now have 1 active actors on pipe
2025-10-15T11:02:04.137232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402129534638853:9486]
2025-10-15T11:02:04.137246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402129534638853:9486]
2025-10-15T11:02:04.137259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402129534638853:9486]
2025-10-15T11:02:04.137301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:04.137366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:04.137367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:04.137385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:04.137399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:04.137535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:04.137553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:04.137658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402129534638853:9486]
2025-10-15T11:02:04.137686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:04.137807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:04.139706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1016
2025-10-15T11:02:04.139807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1016, pipe: [1:7561402126734949126:5602]
2025-10-15T11:02:04.139900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1016
2025-10-15T11:02:04.143481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:04.143520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:04.143594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:04.143623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:04.143641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:04.143651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:04.143684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:04.143721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:04.143762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:04.148793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:04.148838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:04.148924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:04.149419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1017 partition: 0 MaxSeqNo: 46 sessionId: src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0
2025-10-15T11:02:04.151581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a442dd-f239b436-376f4a55-809a0c9c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:04.199487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0] Write session: try to update token
2025-10-15T11:02:04.199552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0] Send 10 message(s) (0 left), first sequence number is 47
E1015 11:02:04.216246234  821865 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:02:04.256417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:04.256458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:04.256469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:04.256480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:04.256512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402129534638853:9486]
2025-10-15T11:02:04.256530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402129534638853:9486]
2025-10-15T11:02:04.256554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402129534638853:9486]
2025-10-15T11:02:04.256730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:04.256744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:04.256756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:04.256854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:04.256878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:04.258040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:04.258067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:04.258097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:04.259665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:04.337190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId: src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:04.358560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:04.418002Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:04.433010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:04.433071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:04.433143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:04.433159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:04.433203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402129534638853:9486]
2025-10-15T11:02:04.433726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:04.434760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:04.435773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:04.436039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402126734949126:5602]
2025-10-15T11:02:04.436189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:04.436215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:04.451320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1017 reason: error at write: Disconnected sessionId: src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0
2025-10-15T11:02:04.455988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1017 sessionId: src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0 is DEAD
2025-10-15T11:02:04.459564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:04.459606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0] Write session will restart in 0.008560s
2025-10-15T11:02:04.459769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0] Write session: Do CDS request
2025-10-15T11:02:04.459823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:04.488850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:04.488884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1018
2025-10-15T11:02:04.491565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:04.492304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:04.492451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:04.492469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:04.492480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:04.495256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1018 sessionId:  describe result for acl check
2025-10-15T11:02:04.495377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:04.495391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:04.495402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:04.495420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402126734949217:5246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:04.497521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402126734949217:5246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:04.515525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402126734949217:5246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:04.521667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:04.525587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:04.527200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:04.527236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:04.527305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:04.527862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:04.528192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402129534638977:9494]
2025-10-15T11:02:04.531049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:04.535622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:04.535881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:04.535280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402126734949217:5246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:04.535316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402126734949217:5246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:04.535328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402126734949217:5246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:04.535374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:04.537152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:04.537501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:04.537510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:04.537517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:04.537525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:04.537531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:04.537538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:04.537546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:04.537553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:04.537559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:04.537565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:04.537572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:04.537579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.537585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.537592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.537638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:04.537757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:04.537806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:04.537853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:04.537897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:04.537942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:04.537986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:04.538029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:04.538073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:04.538123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:04.538167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:04.538227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.538270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.538320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.538370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:04.538441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:04.538513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:04.538572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:04.538620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:04.538677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:04.538722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:04.538776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:04.538825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:04.538887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:04.538937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:04.538991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:04.539038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:04.539093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:04.539138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:04.539192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:04.539236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:04.539290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:04.539336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:04.539949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402126734949276:5602]
2025-10-15T11:02:04.543487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:04.543576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:04.543636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:04.543687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.543745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.543793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.543850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.543898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.543969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.544505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:04.575574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:04.587132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:04.587188Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:04.587208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:04.587229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:04.587257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1017 [2:7561402129534638977:9494]
2025-10-15T11:02:04.587317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:04.587598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:04.587620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:04.587633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:04.587646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:04.587704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:04.587730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:04.587753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:04.589570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.589588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.589604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.589616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:04.589906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:04.589923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:04.590091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:04.590307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:04.590557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:04.590932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1017, pipe: [1:7561402126734949276:5602]
2025-10-15T11:02:04.591071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1017
2025-10-15T11:02:04.591165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1017
2025-10-15T11:02:04.593353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1018 partition: 0 MaxSeqNo: 46 sessionId: src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0
2025-10-15T11:02:04.595991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3ac8b5-5506e017-c8ca9be6-6ec50b96_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:04.590646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402126734949165:2467], now have 1 active actors on pipe
2025-10-15T11:02:04.590687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402126734949268:5246], now have 1 active actors on pipe
2025-10-15T11:02:04.590710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402126734949276:5602], now have 1 active actors on pipe
2025-10-15T11:02:04.590736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402129534638969:9494]
2025-10-15T11:02:04.590751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402129534638969:9494]
2025-10-15T11:02:04.590763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402129534638969:9494]
2025-10-15T11:02:04.590801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:04.590841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:04.590855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:04.590867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:04.590880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:04.591071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:04.591093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:04.591223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402129534638969:9494]
2025-10-15T11:02:04.591247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:04.591262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:04.591863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:04.591890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:04.592021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:04.592055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:04.592075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:04.592086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:04.592128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:04.592178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:04.592222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:04.592942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:04.592965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:04.593035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:04.648289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0] Write session: try to update token
2025-10-15T11:02:04.648353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:04.768461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:04.768500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:04.768515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:04.768529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:04.768564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402129534638969:9494]
2025-10-15T11:02:04.768600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402129534638969:9494]
2025-10-15T11:02:04.768625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402129534638969:9494]
2025-10-15T11:02:04.768791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:04.768806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:04.768818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:04.768929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:04.768951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:04.769975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:04.772066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:04.772110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:04.772138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:04.783474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId: src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:04.865730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:04.924906Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:04.934530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:04.934590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:04.934669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:04.934687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:04.934733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402129534638969:9494]
2025-10-15T11:02:04.935466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:04.936708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:04.936869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:04.936889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:04.939589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402126734949276:5602]
2025-10-15T11:02:04.937903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:04.992850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1018 reason: error at write: Disconnected sessionId: src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0
2025-10-15T11:02:04.993217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1018 sessionId: src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0 is DEAD
2025-10-15T11:02:04.996046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:04.996133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0] Write session will restart in 0.009159s
2025-10-15T11:02:04.996310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0] Write session: Do CDS request
2025-10-15T11:02:04.996362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:05.009504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:05.009537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1019
2025-10-15T11:02:05.009666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:05.010221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:05.010359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:05.010383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:05.010392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:05.011969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1019 sessionId:  describe result for acl check
2025-10-15T11:02:05.012089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:05.012104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:05.012115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:05.012134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402131029916661:5229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:05.015473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402131029916661:5229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:05.017329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:05.023244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402131029916661:5229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:05.027117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:05.028052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:05.028072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:05.028118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:05.028387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:05.028578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402133829606392:9499]
2025-10-15T11:02:05.030857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:05.033093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402131029916661:5229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:05.033137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402131029916661:5229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:05.033154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402131029916661:5229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:05.033186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:05.031906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:05.032156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:05.033465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:05.033792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:05.033801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:05.033808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:05.033815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:05.033822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:05.033830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:05.033839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:05.033847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:05.033856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:05.033864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:05.033869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:05.033878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.033885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.033893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.033945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:05.034062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:05.034115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:05.034164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:05.034210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:05.034258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:05.034307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:05.034357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:05.034404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:05.034454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:05.034501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:05.034551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.034601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.034647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.034696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:05.034766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:05.034829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:05.034887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:05.034938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:05.035926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:05.036004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:05.036087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:05.036139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:05.036199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:05.036248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:05.036306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:05.036359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:05.036417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:05.036466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:05.036521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:05.036572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:05.036629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:05.036677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:05.036736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:05.036784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:05.036842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:05.036889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.036964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.037014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.037069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.037117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.037175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.037719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:05.040585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402131029916697:5602]
2025-10-15T11:02:05.061308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:05.071958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:05.072008Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:05.072028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:05.072053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:05.072082Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1018 [2:7561402133829606392:9499]
2025-10-15T11:02:05.072145Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:05.072215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:05.072232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:05.072246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:05.072260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:05.072314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:05.072340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:05.072365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:05.101817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.101854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.101866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.101878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:05.102166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:05.102185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.102322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.102498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.102712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:05.102785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402133829606386:9499]
2025-10-15T11:02:05.102799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402133829606386:9499]
2025-10-15T11:02:05.102813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402133829606386:9499]
2025-10-15T11:02:05.102858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:05.102936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:05.103129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:05.103149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:05.103272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402133829606386:9499]
2025-10-15T11:02:05.103292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:05.103465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:05.103477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:05.103485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:05.103512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:05.104118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1018, pipe: [1:7561402131029916697:5602]
2025-10-15T11:02:05.104223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1018
2025-10-15T11:02:05.104312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1018
2025-10-15T11:02:05.108966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1019 partition: 0 MaxSeqNo: 46 sessionId: src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0
2025-10-15T11:02:05.110027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc33b2a-e425b3b6-b9613813-429dceb0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:05.107443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402131029916697:5602], now have 1 active actors on pipe
2025-10-15T11:02:05.107496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402126734949302:2467], now have 1 active actors on pipe
2025-10-15T11:02:05.107520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402131029916693:5229], now have 1 active actors on pipe
2025-10-15T11:02:05.107594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:05.107617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:05.107703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:05.107738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:05.107757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:05.107769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:05.107810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:05.107859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:05.107925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:05.108553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:05.108573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:05.108640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:05.129632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0] Write session: try to update token
2025-10-15T11:02:05.129682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:05.197707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:05.199113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:05.199146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:05.199221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:05.199240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:05.199256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:05.199268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:05.199308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402133829606386:9499]
2025-10-15T11:02:05.199338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402133829606386:9499]
2025-10-15T11:02:05.199390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402133829606386:9499]
2025-10-15T11:02:05.199531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:05.199550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:05.199573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:05.199574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:05.199604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:05.220511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:05.288803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId: src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:05.311547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:05.380790Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:05.385554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:05.385603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:05.388823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:05.388774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402131029916697:5602]
2025-10-15T11:02:05.388849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:05.388976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:05.388989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:05.399972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1019 reason: error at write: Disconnected sessionId: src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0
2025-10-15T11:02:05.400259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1019 sessionId: src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0 is DEAD
2025-10-15T11:02:05.405668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:05.405733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0] Write session will restart in 0.005033s
2025-10-15T11:02:05.405892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0] Write session: Do CDS request
2025-10-15T11:02:05.405939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:05.421821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:05.427995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:05.428023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1020
2025-10-15T11:02:05.431618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:05.431802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:05.431828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:05.431841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:05.433501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1020 sessionId:  describe result for acl check
2025-10-15T11:02:05.433647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:05.433659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:05.433669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:05.433687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402131029916726:5221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:05.441373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402131029916726:5221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:05.466499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402131029916726:5221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:05.482690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402131029916726:5221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:05.482736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402131029916726:5221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:05.482754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402131029916726:5221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:05.482789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:05.489186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:05.489473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402131029916808:5602]
2025-10-15T11:02:05.494925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:05.495819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:05.495848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:05.495905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:05.496132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:05.496303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402133829606512:9508]
2025-10-15T11:02:05.498414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:05.499774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:05.499977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:05.501124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:05.501434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:05.501452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:05.501461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:05.501467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:05.501474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:05.501481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:05.501487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:05.501493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:05.501500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:05.501507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:05.501514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:05.501520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.501526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.501533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.501575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:05.501677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:05.501723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:05.501768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:05.501812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:05.501855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:05.501898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:05.501966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:05.502010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:05.502063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:05.502112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:05.502160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.502205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.502253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.502297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:05.502364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:05.502421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:05.502487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:05.502540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:05.502596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:05.502643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:05.502700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:05.502749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:05.502804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:05.502854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:05.502910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:05.502954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:05.503004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:05.503045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:05.503096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:05.503142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:05.503191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:05.503234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:05.503283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:05.503326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:05.503392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:05.503437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.503488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.503535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.503583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.503627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.503678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.504165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:05.529740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:05.540537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:05.540577Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:05.540590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:05.540607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:05.540628Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1019 [2:7561402133829606512:9508]
2025-10-15T11:02:05.540671Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:05.540721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:05.540733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:05.540745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:05.540754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:05.540800Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:05.540818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:05.540836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:05.556125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.556155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.556165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.556173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:05.556410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:05.556430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:05.558800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1019
2025-10-15T11:02:05.556534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:05.558890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1019, pipe: [1:7561402131029916808:5602]
2025-10-15T11:02:05.556692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:05.558964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1019
2025-10-15T11:02:05.556905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:05.556978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402131029916713:2467], now have 1 active actors on pipe
2025-10-15T11:02:05.557000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402131029916808:5602], now have 1 active actors on pipe
2025-10-15T11:02:05.557018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402131029916805:5221], now have 1 active actors on pipe
2025-10-15T11:02:05.557042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402133829606506:9508]
2025-10-15T11:02:05.557055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402133829606506:9508]
2025-10-15T11:02:05.557066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402133829606506:9508]
2025-10-15T11:02:05.557100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:05.557143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:05.557158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:05.557167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:05.557170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:05.557320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:05.557334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:05.557435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402133829606506:9508]
2025-10-15T11:02:05.557460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:05.557547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:05.559485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:05.559511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:05.559606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:05.559647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:05.559675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:05.559686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:05.559730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:05.559771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:05.559826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:05.562264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:05.562307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:05.562378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:05.563572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1020 partition: 0 MaxSeqNo: 46 sessionId: src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0
2025-10-15T11:02:05.565447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae6a0d-e3a7d3e3-e8b67290-8e3b3c6a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:05.620173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:05.620221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:05.620263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402133829606506:9508]
2025-10-15T11:02:05.620385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:05.621308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:05.632481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:05.634421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:05.643102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0] Write session: try to update token
2025-10-15T11:02:05.643163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:05.653597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:05.673483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:05.675148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:05.675533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:05.675549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:05.675564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:05.675629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:05.741711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:05.741751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:05.741764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:05.741776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:05.741816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402133829606506:9508]
2025-10-15T11:02:05.741845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402133829606506:9508]
2025-10-15T11:02:05.741869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402133829606506:9508]
2025-10-15T11:02:05.742035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:05.742039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:05.742059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:05.742076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:05.742106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:05.764349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:05.811273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId: src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:05.833429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:05.935311Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:05.941170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:05.941223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:05.944440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:05.944589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402131029916808:5602]
2025-10-15T11:02:05.944677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:05.944696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:05.950849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:05.984250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:05.984314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0] Write session will restart in 0.008259s
2025-10-15T11:02:05.984479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0] Write session: Do CDS request
2025-10-15T11:02:05.984532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:05.982538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1020 reason: error at write: Disconnected sessionId: src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0
2025-10-15T11:02:05.982911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1020 sessionId: src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0 is DEAD
2025-10-15T11:02:06.003691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:06.009580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:06.009612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1021
2025-10-15T11:02:06.011709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:06.011915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:06.011935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:06.011948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:06.013712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1021 sessionId:  describe result for acl check
2025-10-15T11:02:06.013861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:06.013876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:06.013894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:06.013913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402135324884163:5211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:06.017319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402135324884163:5211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:06.025142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402135324884163:5211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:06.035469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:06.035616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402135324884163:5211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:06.035658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402135324884163:5211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:06.035675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402135324884163:5211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:06.035706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:06.045482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402135324884241:5602]
2025-10-15T11:02:06.047971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:06.048911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:06.048932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:06.048979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:06.049253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:06.049449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402138124573942:9511]
2025-10-15T11:02:06.052241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:06.053710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:06.053973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:06.055302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:06.055683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:06.055692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:06.055699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:06.055710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:06.055719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:06.055727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:06.055734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:06.055742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:06.055750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:06.055757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:06.055766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:06.055773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.055781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.055789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.055855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:06.055977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:06.056029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:06.056079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:06.056128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:06.056177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:06.056225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:06.056272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:06.056325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:06.056374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:06.056420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:06.056470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.056516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.056563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.056614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:06.056684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:06.056746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:06.056807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:06.056861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:06.056919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:06.056964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:06.057020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:06.057075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:06.057133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:06.057182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:06.057241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:06.057290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:06.057343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:06.057391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:06.057448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:06.057497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:06.057557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:06.057607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:06.057660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:06.057709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:06.057768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:06.057815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.057869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.057920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.057977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.058026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.058082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.058619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:06.095069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:06.110162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:06.110221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:06.110241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:06.110262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:06.110291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1020 [2:7561402138124573942:9511]
2025-10-15T11:02:06.110348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:06.110415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:06.110433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:06.110448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:06.110460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:06.110516Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:06.110541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:06.110568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:06.114042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1020, pipe: [1:7561402135324884241:5602]
2025-10-15T11:02:06.114151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1020
2025-10-15T11:02:06.114210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1020
2025-10-15T11:02:06.112882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.112913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.112929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.112942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:06.113257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:06.113278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.113455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.113697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.113942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:06.114042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402135324884241:5602], now have 1 active actors on pipe
2025-10-15T11:02:06.114068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402135324884238:5211], now have 1 active actors on pipe
2025-10-15T11:02:06.114091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402131029916849:2467], now have 1 active actors on pipe
2025-10-15T11:02:06.114118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402138124573935:9511]
2025-10-15T11:02:06.114136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402138124573935:9511]
2025-10-15T11:02:06.114148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402138124573935:9511]
2025-10-15T11:02:06.114195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:06.114255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:06.114271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:06.114283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:06.114286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:06.114505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:06.114524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:06.114698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:06.114723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:06.114777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402138124573935:9511]
2025-10-15T11:02:06.114814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:06.114855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:06.114935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:06.114971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:06.114991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:06.115003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:06.115044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:06.115090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:06.115185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:06.117304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:06.117345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:06.117440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:06.117988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1021 partition: 0 MaxSeqNo: 46 sessionId: src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0
2025-10-15T11:02:06.118794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d503acc-a8d871b4-75035c8e-46fd51ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:06.164960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0] Write session: try to update token
2025-10-15T11:02:06.165013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:06.213547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:06.213587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:06.213600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:06.332454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:06.332494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:06.332508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:06.332520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:06.332552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402138124573935:9511]
2025-10-15T11:02:06.332577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402138124573935:9511]
2025-10-15T11:02:06.332604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402138124573935:9511]
2025-10-15T11:02:06.332702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:06.332733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:06.332760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:06.333053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:06.333077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:06.333087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:06.333129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:06.333151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:06.334488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:06.345708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId: src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:06.372539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:06.485407Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:06.502326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:06.502371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:06.502420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:06.502432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:06.502467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402138124573935:9511]
2025-10-15T11:02:06.503195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:06.503897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402135324884241:5602]
2025-10-15T11:02:06.503971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:06.503983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:06.503992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:06.505086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:06.566278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1021 reason: error at write: Disconnected sessionId: src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0
2025-10-15T11:02:06.566583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1021 sessionId: src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0 is DEAD
2025-10-15T11:02:06.567952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:06.568005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0] Write session will restart in 0.006657s
2025-10-15T11:02:06.568152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0] Write session: Do CDS request
2025-10-15T11:02:06.568200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:06.586084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:06.588316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:06.590538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:06.590569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1022
2025-10-15T11:02:06.590935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:06.591051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:06.591067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:06.591077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:06.592507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1022 sessionId:  describe result for acl check
2025-10-15T11:02:06.592604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:06.592615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:06.592626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:06.592644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402135324884361:5193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:06.590822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:06.591634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:06.591649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:06.591691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:06.591960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:06.592128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402138124574052:9521]
2025-10-15T11:02:06.594197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:06.595167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402135324884361:5193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:06.600713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402135324884361:5193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:06.599772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:06.600026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:06.601227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:06.601515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:06.601524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:06.601530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:06.601537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:06.601544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:06.601550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:06.601557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:06.601563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:06.601569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:06.601574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:06.601580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:06.601586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.601593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.601598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.601641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:06.601736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:06.601778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:06.601819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:06.601862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:06.601913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:06.601956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:06.601996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:06.602034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:06.602077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:06.602116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:06.602157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.602197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.602239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.602277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:06.602338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:06.602389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:06.602437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:06.602479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:06.602527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:06.602566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:06.602612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:06.602656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:06.602704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:06.602750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:06.602803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:06.602846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:06.602915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:06.602962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:06.603013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:06.603058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:06.603108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:06.603150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:06.603200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:06.603244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:06.603294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:06.603336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.604735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402135324884385:5602]
2025-10-15T11:02:06.608268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.608344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.608402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.608454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.608511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.609000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:06.609684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402135324884361:5193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:06.609726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402135324884361:5193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:06.609743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402135324884361:5193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:06.609772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:06.637316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:06.656540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:06.656587Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:06.656602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:06.656620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:06.656645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1021 [2:7561402138124574052:9521]
2025-10-15T11:02:06.656692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:06.656747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:06.656761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:06.656773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:06.656782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:06.656825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:06.656848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:06.656869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:06.666183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.666207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.666213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.666221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:06.666428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:06.666437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:06.666518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:06.668064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1021, pipe: [1:7561402135324884385:5602]
2025-10-15T11:02:06.668160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1021
2025-10-15T11:02:06.668234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1021
2025-10-15T11:02:06.666624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:06.666755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:06.666796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402138124574047:9521]
2025-10-15T11:02:06.666805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402138124574047:9521]
2025-10-15T11:02:06.666812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402138124574047:9521]
2025-10-15T11:02:06.666836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:06.666890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:06.667004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:06.667016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:06.667100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402138124574047:9521]
2025-10-15T11:02:06.667118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:06.667776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:06.667788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:06.667809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:06.667831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:06.667995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402135324884385:5602], now have 1 active actors on pipe
2025-10-15T11:02:06.668012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402135324884276:2467], now have 1 active actors on pipe
2025-10-15T11:02:06.668027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402135324884392:5193], now have 1 active actors on pipe
2025-10-15T11:02:06.669018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:06.669054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:06.669143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:06.669181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:06.669201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:06.669212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:06.669255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:06.669296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:06.669340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:06.671270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T11:02:06.671325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-10-15T11:02:06.673517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:06.673570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:06.673768Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:02:06.673871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:06.674274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1022 partition: 0 MaxSeqNo: 46 sessionId: src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0
2025-10-15T11:02:06.675548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eadf49b2-e9e26ee0-1f03a529-a9759a06_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:06.674545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 19 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:02:06.674678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:02:06.706890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0] Write session: try to update token
2025-10-15T11:02:06.706949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:06.766614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:06.766654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:06.766668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:06.766681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:06.766726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402138124574047:9521]
2025-10-15T11:02:06.766753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402138124574047:9521]
2025-10-15T11:02:06.766778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402138124574047:9521]
2025-10-15T11:02:06.766923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:06.766944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:06.766956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:06.766999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:06.767019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:06.767232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:06.767270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:06.767300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:06.777012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:06.874497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId: src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:06.908403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:06.929893Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:06.934798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402135324884385:5602]
2025-10-15T11:02:06.934888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:06.934946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-15T11:02:06.935071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:06.935085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:06.931518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:06.931559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:06.941495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1022 reason: error at write: Disconnected sessionId: src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0
2025-10-15T11:02:06.941793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1022 sessionId: src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0 is DEAD
2025-10-15T11:02:06.947789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:06.947832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0] Write session will restart in 0.009741s
2025-10-15T11:02:06.947926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0] Write session: Do CDS request
2025-10-15T11:02:06.947952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:06.967454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:06.967483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1023
2025-10-15T11:02:06.966333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:06.968320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:06.968872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:06.968983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:06.968997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:06.969006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:06.971645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1023 sessionId:  describe result for acl check
2025-10-15T11:02:06.971744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:06.971753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:06.971762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:06.971789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402135324884421:5188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:06.974490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402135324884421:5188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:06.986878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402135324884421:5188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:06.995321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402135324884421:5188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:06.995405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402135324884421:5188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:06.995428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402135324884421:5188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:06.995470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:07.035219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402139619851800:5602]
2025-10-15T11:02:07.046120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:07.051843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:07.052639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:07.052665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:07.052709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:07.052963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:07.053174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402142419541482:9524]
2025-10-15T11:02:07.055586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:07.056661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:07.056871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:07.058102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:07.058418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:07.058426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:07.058433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:07.058439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:07.058445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:07.058450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:07.058462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:07.058470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:07.058476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:07.058484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:07.058490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:07.058497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.058504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.058511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.058559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:07.058681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:07.058737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:07.058782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:07.059427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:07.059487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:07.059531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:07.059572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:07.059616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:07.059661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:07.059705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:07.059749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.059806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.059850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.059890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:07.059951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:07.060002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:07.060055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:07.060098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:07.060147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:07.060189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:07.060240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:07.060285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:07.060336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:07.060377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:07.060427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:07.060472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:07.060520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:07.060562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:07.060613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:07.060659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:07.060709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:07.060751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:07.060800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:07.060845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:07.060897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:07.060939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.060989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.061033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.061084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.061124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.061174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.061652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:07.083134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:07.102048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:07.102104Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:07.102119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:07.102137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:07.102160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1022 [2:7561402142419541482:9524]
2025-10-15T11:02:07.102207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:07.102257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:07.102271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:07.102282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:07.102293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:07.102334Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:07.102355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:07.102375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:07.108816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.108843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.108851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.108860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:07.109611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1022
2025-10-15T11:02:07.109710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1022, pipe: [1:7561402139619851800:5602]
2025-10-15T11:02:07.109781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1022
2025-10-15T11:02:07.109147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:07.109175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.109306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.109467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.109683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:07.109763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402135324884408:2467], now have 1 active actors on pipe
2025-10-15T11:02:07.109786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402139619851800:5602], now have 1 active actors on pipe
2025-10-15T11:02:07.109807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402135324884452:5188], now have 1 active actors on pipe
2025-10-15T11:02:07.109831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402142419541476:9524]
2025-10-15T11:02:07.109845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402142419541476:9524]
2025-10-15T11:02:07.109857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402142419541476:9524]
2025-10-15T11:02:07.109885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:07.109908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:07.109922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:07.109933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:07.109949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:07.110109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:07.110127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:07.110222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:07.110239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:07.110346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402142419541476:9524]
2025-10-15T11:02:07.110390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:07.110528Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:02:07.110636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:07.110670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:07.110686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:07.110696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:07.110730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:07.110770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:07.110866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:07.110897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:07.111783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 20 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:02:07.111920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:02:07.115451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:07.115491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:07.115559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:07.115889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1023 partition: 0 MaxSeqNo: 46 sessionId: src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0
2025-10-15T11:02:07.119256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e36d84a-c13dbb00-f4e78e1f-f9e7d68c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:07.166851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0] Write session: try to update token
2025-10-15T11:02:07.166901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:07.230639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:07.230676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:07.230687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:07.230696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:07.230725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402142419541476:9524]
2025-10-15T11:02:07.230749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402142419541476:9524]
2025-10-15T11:02:07.230772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402142419541476:9524]
2025-10-15T11:02:07.230892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:07.230917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:07.230928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:07.230929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:07.230939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:07.230954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:07.230976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:07.230993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:07.238505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:07.313736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId: src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:07.338644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:07.437978Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:07.446793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:07.447080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:07.449696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:07.449751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:07.451587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:07.451844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402139619851800:5602]
2025-10-15T11:02:07.456112Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:07.467852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1023 reason: error at write: Disconnected sessionId: src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0
2025-10-15T11:02:07.468173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1023 sessionId: src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0 is DEAD
2025-10-15T11:02:07.479698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:07.479768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0] Write session will restart in 0.007957s
2025-10-15T11:02:07.479866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0] Write session: Do CDS request
2025-10-15T11:02:07.479911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:07.495329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:07.496884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:07.496921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1024
2025-10-15T11:02:07.497273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:07.497413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:07.497435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:07.497445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:07.520837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1024 sessionId:  describe result for acl check
2025-10-15T11:02:07.521001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:07.521022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:07.521030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:07.521046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402139619851845:5184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:07.523306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402139619851845:5184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:07.537239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402139619851845:5184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:07.552683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402139619851891:5602]
2025-10-15T11:02:07.580903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402139619851845:5184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:07.580945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402139619851845:5184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:07.580961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402139619851845:5184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:07.580993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:07.593241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:07.594758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:07.595551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:07.595570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:07.595611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:07.595864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:07.596044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402142419541610:9535]
2025-10-15T11:02:07.598246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:07.599570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:07.599765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:07.600944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:07.601262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:07.601270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:07.601277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:07.601283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:07.601290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:07.601296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:07.601303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:07.601309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:07.601315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:07.601321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:07.601327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:07.601334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.601340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.601347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.601387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:07.601486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:07.601530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:07.601572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:07.601614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:07.601660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:07.601703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:07.601747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:07.601790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:07.601832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:07.601875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:07.601920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.601971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.602016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.602057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:07.602114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:07.602166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:07.602216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:07.602259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:07.602307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:07.602347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:07.602394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:07.602438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:07.602491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:07.602530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:07.602578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:07.602621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:07.602669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:07.602712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:07.602761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:07.602821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:07.602871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:07.602916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:07.602965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:07.603008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:07.603054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:07.603095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.603142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.603187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.603233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.603274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.603321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.603840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:07.639549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:07.653740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:07.653788Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:07.653803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:07.653820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:07.653842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1023 [2:7561402142419541610:9535]
2025-10-15T11:02:07.653889Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:07.653939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:07.653952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:07.653964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:07.653974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:07.654018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:07.654038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:07.654058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:07.656172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.656200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.656213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.656223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:07.656499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:07.656516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:07.656641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:07.656816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:07.657039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:07.657123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402139619851935:5184], now have 1 active actors on pipe
2025-10-15T11:02:07.657157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402139619851829:2467], now have 1 active actors on pipe
2025-10-15T11:02:07.657181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402139619851891:5602], now have 1 active actors on pipe
2025-10-15T11:02:07.657204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402142419541604:9535]
2025-10-15T11:02:07.657219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402142419541604:9535]
2025-10-15T11:02:07.657234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402142419541604:9535]
2025-10-15T11:02:07.657275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:07.657344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:07.657527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:07.657545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:07.657658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402142419541604:9535]
2025-10-15T11:02:07.657678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:07.657875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:07.657893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:07.657905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:07.657933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:07.658493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1023
2025-10-15T11:02:07.658596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1023
2025-10-15T11:02:07.658657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1023, pipe: [1:7561402139619851891:5602]
2025-10-15T11:02:07.659264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:07.659297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:07.659400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:07.659430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:07.659450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:07.659460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:07.659495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:07.659534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:07.659579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:07.661375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:07.661407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:07.661473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:07.663124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1024 partition: 0 MaxSeqNo: 46 sessionId: src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0
2025-10-15T11:02:07.664220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85bca74-a8fcb989-a8eed63a-1b5afc18_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:07.693734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0] Write session: try to update token
2025-10-15T11:02:07.693794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:07.755798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:07.755830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:07.755843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:07.755853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:07.755884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402142419541604:9535]
2025-10-15T11:02:07.755908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402142419541604:9535]
2025-10-15T11:02:07.755932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402142419541604:9535]
2025-10-15T11:02:07.756072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:07.756084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:07.756095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:07.756133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:07.756150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:07.757244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:07.759830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:07.759870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:07.759898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:07.853508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId: src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:07.897796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:08.047388Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:08.049530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:08.049560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:08.053053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:08.051971Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:08.060493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:08.060627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402139619851891:5602]
2025-10-15T11:02:08.062659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1024 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0
2025-10-15T11:02:08.062904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1024 sessionId: src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0 is DEAD
2025-10-15T11:02:08.066217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:08.066254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0] Write session will restart in 0.008081s
2025-10-15T11:02:08.066376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0] Write session: Do CDS request
2025-10-15T11:02:08.066412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:08.085218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:08.084945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:08.084994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1025
2025-10-15T11:02:08.089834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:08.089939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:08.089950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:08.089957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:08.090980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1025 sessionId:  describe result for acl check
2025-10-15T11:02:08.091067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:08.091077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:08.091087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:08.091103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402143914819300:5150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:08.092905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402143914819300:5150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:08.100609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402143914819300:5150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:08.115171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402143914819300:5150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:08.115214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402143914819300:5150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:08.115231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402143914819300:5150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:08.115261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:08.124456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:08.129207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:08.130114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:08.130127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:08.130159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:08.130353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:08.130489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402146714509033:9545]
2025-10-15T11:02:08.138290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:08.140155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:08.140321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:08.141441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:08.141740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:08.141745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:08.141750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:08.141754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:08.141759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:08.141763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:08.141768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:08.141772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:08.141777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:08.141782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:08.141785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:08.141789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.141794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.141799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.141832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:08.141909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:08.141946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:08.141977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:08.142008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:08.142053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:08.142101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:08.142132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:08.142161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:08.142202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:08.142232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:08.142265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.142297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.142328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.142354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:08.142402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:08.142442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:08.142476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:08.142506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:08.142542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:08.142576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:08.142627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:08.142675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:08.142713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:08.142742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:08.142776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:08.142806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:08.142843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:08.142872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:08.142911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:08.142941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:08.142977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:08.143005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:08.143041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:08.143071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:08.143119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:08.143148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.143184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.143215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.143251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.143280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.143314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.143717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:08.162080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402143914819391:5602]
2025-10-15T11:02:08.178927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:08.189248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:08.189299Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:08.189315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:08.189335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:08.189360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1024 [2:7561402146714509033:9545]
2025-10-15T11:02:08.189409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:08.189465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:08.189478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:08.189505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:08.189518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:08.189564Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:08.189585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:08.189604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:08.190725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.190753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.190766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.190777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:08.191048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:08.191075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.191213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.191413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.191654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:08.191739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402146714509028:9545]
2025-10-15T11:02:08.191754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402146714509028:9545]
2025-10-15T11:02:08.191768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402146714509028:9545]
2025-10-15T11:02:08.191807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:08.191878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:08.192047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:08.192063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:08.192175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402146714509028:9545]
2025-10-15T11:02:08.192194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:08.192640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:08.192653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:08.192662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:08.192683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:08.195559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1024
2025-10-15T11:02:08.195613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1024
2025-10-15T11:02:08.195640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1024, pipe: [1:7561402143914819391:5602]
2025-10-15T11:02:08.195209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402143914819286:2467], now have 1 active actors on pipe
2025-10-15T11:02:08.195243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402143914819376:5150], now have 1 active actors on pipe
2025-10-15T11:02:08.195264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402143914819391:5602], now have 1 active actors on pipe
2025-10-15T11:02:08.196052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:08.196082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:08.196165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:08.196195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:08.196212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:08.196223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:08.196255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:08.196295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:08.196342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:08.197172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:08.197197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:08.197256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:08.197656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1025 partition: 0 MaxSeqNo: 46 sessionId: src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0
2025-10-15T11:02:08.199871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca6ca7e-91e64471-e10338d0-dd4d47a4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:08.235257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0] Write session: try to update token
2025-10-15T11:02:08.235311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:08.267019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:08.267053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:08.267068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:08.267079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:08.267112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402146714509028:9545]
2025-10-15T11:02:08.267140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402146714509028:9545]
2025-10-15T11:02:08.267166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402146714509028:9545]
2025-10-15T11:02:08.267296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:08.267317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:08.268082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:08.268124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:08.268149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:08.269393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:08.345064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId: src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:08.369336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:08.421876Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:08.423925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:08.423959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:08.426930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:08.427489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:08.427515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:08.427569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402143914819391:5602]
2025-10-15T11:02:08.427745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:08.491092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1025 reason: error at write: Disconnected sessionId: src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0
2025-10-15T11:02:08.495526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:08.495562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0] Write session will restart in 0.009301s
2025-10-15T11:02:08.495733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0] Write session: Do CDS request
2025-10-15T11:02:08.495780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:08.495414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1025 sessionId: src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0 is DEAD
2025-10-15T11:02:08.512563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:08.511187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:08.511843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:08.512496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:08.512511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:08.512548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:08.512754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:08.512931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402146714509139:9547]
2025-10-15T11:02:08.514924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:08.515638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:08.515663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1026
2025-10-15T11:02:08.516016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:08.516117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:08.516293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:08.516131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:08.516140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:08.516489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:08.517648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:08.517958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:08.517965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:08.517972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:08.517979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:08.517985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:08.517992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:08.517999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:08.518005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:08.518010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:08.518017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:08.518023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:08.518030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.518036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.518043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.518086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:08.518177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:08.518220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:08.518264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:08.518304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:08.518347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:08.518387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:08.518428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:08.518467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:08.518510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:08.518550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:08.518589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.518628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.518667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.518705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:08.518764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:08.518813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:08.518866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:08.518910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:08.518957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:08.518997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:08.519046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:08.519090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:08.519141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:08.519184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:08.519233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:08.519274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:08.519327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:08.519478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:08.519532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:08.519577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:08.519626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:08.519668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:08.519734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:08.519779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:08.519827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:08.519868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.519932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.519976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.520024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.520063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.520111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.520569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:08.522986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1026 sessionId:  describe result for acl check
2025-10-15T11:02:08.523080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:08.523092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:08.523101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:08.523117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402143914819480:5145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:08.525523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402143914819480:5145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:08.531271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402143914819484:5602]
2025-10-15T11:02:08.541413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402143914819480:5145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:08.546504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:08.557543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:08.557584Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:08.557597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:08.557613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:08.557637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1025 [2:7561402146714509139:9547]
2025-10-15T11:02:08.557681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:08.557730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:08.557742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:08.557752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:08.557763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:08.557806Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:08.557827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:08.557846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:08.559935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.559960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.559972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.559983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:08.560233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:08.560247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:08.560362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:08.560522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:08.560729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:08.560785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402146714509133:9547]
2025-10-15T11:02:08.560799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402146714509133:9547]
2025-10-15T11:02:08.560810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402146714509133:9547]
2025-10-15T11:02:08.560846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:08.560909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:08.561055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:08.561073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:08.561172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402146714509133:9547]
2025-10-15T11:02:08.561188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:08.562070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:08.562089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:08.562101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:08.562649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1025, pipe: [1:7561402143914819484:5602]
2025-10-15T11:02:08.562122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:08.562741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1025
2025-10-15T11:02:08.563624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402143914819484:5602], now have 1 active actors on pipe
2025-10-15T11:02:08.563656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402143914819406:2467], now have 1 active actors on pipe
2025-10-15T11:02:08.565909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402143914819480:5145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:08.565945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402143914819480:5145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:08.565959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402143914819480:5145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:08.565987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:08.568134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402143914819511:5145], now have 1 active actors on pipe
2025-10-15T11:02:08.568316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1025
2025-10-15T11:02:08.568632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:08.568661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:08.568725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:08.568752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:08.568770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:08.568780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:08.568810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:08.568846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:08.568887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:08.569476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:08.569498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:08.569550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:08.569850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1026 partition: 0 MaxSeqNo: 46 sessionId: src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0
2025-10-15T11:02:08.570918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a0758f4-7e8d8a91-18ea71a-ad6a35be_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:08.606376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:08.610489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0] Write session: try to update token
2025-10-15T11:02:08.610544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:08.612137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:08.612193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402146714509133:9547]
2025-10-15T11:02:08.612318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:08.613949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:08.615599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:08.622048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:08.623165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:08.640335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:08.641923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:08.642361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:08.659394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:08.659426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:08.659437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:08.768463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:08.768501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:08.768514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:08.768524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:08.768561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402146714509133:9547]
2025-10-15T11:02:08.768586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402146714509133:9547]
2025-10-15T11:02:08.768607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402146714509133:9547]
2025-10-15T11:02:08.768724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:08.768756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:08.768767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:08.768767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:08.768778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:08.768796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:08.768817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:08.768836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:08.776523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:08.824137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId: src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:08.859974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:08.918267Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:08.925750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:08.925792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:08.927292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:08.927463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:08.927488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:08.935505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402143914819484:5602]
2025-10-15T11:02:08.935667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:08.946665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1026 reason: error at write: Disconnected sessionId: src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0
2025-10-15T11:02:08.946947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1026 sessionId: src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0 is DEAD
2025-10-15T11:02:08.951878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:08.951915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0] Write session will restart in 0.006554s
2025-10-15T11:02:08.952003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0] Write session: Do CDS request
2025-10-15T11:02:08.952029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:08.962218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:08.962249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1027
2025-10-15T11:02:08.963086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:08.964396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:08.964520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:08.964540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:08.964549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:08.966533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1027 sessionId:  describe result for acl check
2025-10-15T11:02:08.966641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:08.966658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:08.966666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:08.966683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402143914819548:5135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:08.968818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402143914819548:5135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:08.985693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402143914819548:5135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:08.999081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402143914819548:5135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:08.999122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402143914819548:5135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:08.999136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402143914819548:5135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:08.999171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:09.034278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:09.035548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402148209786932:5602]
2025-10-15T11:02:09.036709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:09.037449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:09.037473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:09.037511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:09.046988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:09.047210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402151009476574:9556]
2025-10-15T11:02:09.049175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:09.050300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:09.050499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:09.051725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:09.052020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:09.052041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:09.052048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:09.052055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:09.052062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:09.052068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:09.052073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:09.052079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:09.052086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:09.052092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:09.052098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:09.052104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.052110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.052116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.052156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:09.052252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:09.052296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:09.052336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:09.052377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:09.052417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:09.052458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:09.052496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:09.052536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:09.052577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:09.052617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:09.052656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.052696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.052737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.052773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:09.052830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:09.052880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:09.052927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:09.052970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:09.053017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:09.053058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:09.053104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:09.053145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:09.053193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:09.053236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:09.053285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:09.053327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:09.053374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:09.053407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:09.053454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:09.053497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:09.053544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:09.053584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:09.053645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:09.053689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:09.053751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:09.053793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.053840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.053882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.053930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.053972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.054008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.054382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:09.074525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:09.085148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:09.085189Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:09.085206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:09.085221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:09.085242Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1026 [2:7561402151009476574:9556]
2025-10-15T11:02:09.085287Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:09.085333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:09.085348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:09.085359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:09.085370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:09.085413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:09.085437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:09.085467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:09.087068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.087093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.087106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.087115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:09.087400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:09.087424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.087551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.087767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1026
2025-10-15T11:02:09.087892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1026
2025-10-15T11:02:09.087954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1026, pipe: [1:7561402148209786932:5602]
2025-10-15T11:02:09.087744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.087971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:09.088043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402143914819535:2467], now have 1 active actors on pipe
2025-10-15T11:02:09.088065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402143914819600:5135], now have 1 active actors on pipe
2025-10-15T11:02:09.088085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402148209786932:5602], now have 1 active actors on pipe
2025-10-15T11:02:09.088126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402151009476568:9556]
2025-10-15T11:02:09.088141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402151009476568:9556]
2025-10-15T11:02:09.088152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402151009476568:9556]
2025-10-15T11:02:09.088185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:09.088218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:09.088235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:09.088247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:09.088254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:09.088420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:09.088435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:09.088563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:09.088582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:09.088609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402151009476568:9556]
2025-10-15T11:02:09.088635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:09.088674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:09.088730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:09.088755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:09.088773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:09.088781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:09.088823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:09.088869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:09.088946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:09.090196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:09.090223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:09.090281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:09.090903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1027 partition: 0 MaxSeqNo: 46 sessionId: src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0
2025-10-15T11:02:09.091845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46475e8b-3966a7e7-2fa2f891-3cde5a81_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:09.145358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0] Write session: try to update token
2025-10-15T11:02:09.145411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:09.189686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:09.189720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:09.189733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:09.189744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:09.189777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402151009476568:9556]
2025-10-15T11:02:09.189802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402151009476568:9556]
2025-10-15T11:02:09.189827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402151009476568:9556]
2025-10-15T11:02:09.189971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:09.189983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:09.189994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:09.190034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:09.190052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:09.190089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:09.190144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:09.190182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:09.191232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
E1015 11:02:09.261476159  821866 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:02:09.264575Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:02:09.333566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId: src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:09.345724Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:09.368632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:09.368777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402148209786932:5602]
2025-10-15T11:02:09.368860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:09.368871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:09.397199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1027 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0
2025-10-15T11:02:09.398291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1027 sessionId: src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0 is DEAD
2025-10-15T11:02:09.403522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T11:02:09.403554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0] Write session will restart in 0.007903s
2025-10-15T11:02:09.403651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0] Write session: Do CDS request
2025-10-15T11:02:09.403676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:09.428160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:09.441511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:09.441541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1028
2025-10-15T11:02:09.443605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:09.443772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:09.443797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:09.443808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:09.445990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1028 sessionId:  describe result for acl check
2025-10-15T11:02:09.446070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:09.446077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:09.446084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:09.446096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402148209787012:5112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:09.448569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402148209787012:5112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:09.463839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402148209787012:5112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:09.475161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402148209787070:5602]
2025-10-15T11:02:09.484831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:09.492409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:09.493167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:09.493185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:09.493223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:09.493441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:09.493614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402151009476700:9564]
2025-10-15T11:02:09.492252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402148209787012:5112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:09.492289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402148209787012:5112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:09.492307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402148209787012:5112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:09.492336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:09.497774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:09.502547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:09.502757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:09.504044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:09.504340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:09.504348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:09.504354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:09.504361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:09.504367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:09.504373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:09.504379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:09.504385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:09.504390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:09.504396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:09.504402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:09.504408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.504414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.504421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.504465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:09.504561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:09.504604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:09.504647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:09.504690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:09.504730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:09.504766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:09.504806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:09.504844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:09.504885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:09.504922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:09.504960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.504997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.505038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.505077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:09.505134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:09.505184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:09.505228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:09.505272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:09.505324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:09.505365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:09.505413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:09.505459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:09.505504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:09.505546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:09.505593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:09.505651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:09.505698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:09.505740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:09.505786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:09.505830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:09.505876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:09.505912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:09.505959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:09.505998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:09.506044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:09.506081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.506125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.506166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.506214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.506252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.506298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.506734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:09.536639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:09.547445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:09.547494Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:09.547511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:09.547531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:09.547555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1027 [2:7561402151009476700:9564]
2025-10-15T11:02:09.547603Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:09.547676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:09.547691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:09.547704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:09.547715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:09.547759Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:09.547780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:09.547799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:09.548965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.548981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.548995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.549005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:09.549282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:09.549297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:09.549432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:09.549636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:09.549858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:09.549923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402151009476694:9564]
2025-10-15T11:02:09.549937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402151009476694:9564]
2025-10-15T11:02:09.549950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402151009476694:9564]
2025-10-15T11:02:09.549988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:09.550054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:09.550940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:09.550968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:09.550981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:09.551442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:09.551468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:09.551610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402148209787070:5602], now have 1 active actors on pipe
2025-10-15T11:02:09.551650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402148209786965:2467], now have 1 active actors on pipe
2025-10-15T11:02:09.551671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402148209787080:5112], now have 1 active actors on pipe
2025-10-15T11:02:09.551692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402151009476694:9564]
2025-10-15T11:02:09.551722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:09.552024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:09.558235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1027, pipe: [1:7561402148209787070:5602]
2025-10-15T11:02:09.558348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1027
2025-10-15T11:02:09.558420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1027
2025-10-15T11:02:09.559466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:09.559505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:09.559577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:09.559608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:09.559638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:09.559649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:09.559683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:09.559722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:09.559768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:09.563644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:09.563681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:09.563749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:09.564124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1028 partition: 0 MaxSeqNo: 46 sessionId: src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0
2025-10-15T11:02:09.564980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dfd49d22-10656021-ab53dbf2-2bc61179_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:09.622941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0] Write session: try to update token
2025-10-15T11:02:09.622995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:09.648036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:09.648075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:09.648088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:09.789705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:09.789736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:09.789746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:09.789755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:09.789786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402151009476694:9564]
2025-10-15T11:02:09.789810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402151009476694:9564]
2025-10-15T11:02:09.789829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402151009476694:9564]
2025-10-15T11:02:09.789967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:09.789977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:09.789988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:09.790078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:09.790098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:09.791066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:09.791749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:09.791775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:09.791806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:09.847446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId: src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:09.875322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:09.947342Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:09.959565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:09.959624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:09.959674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:09.959687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:09.959725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402151009476694:9564]
2025-10-15T11:02:09.959944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:09.960246Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:09.961753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402148209787070:5602]
2025-10-15T11:02:09.961939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:09.962185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:09.993015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1028 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0
2025-10-15T11:02:09.993295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1028 sessionId: src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0 is DEAD
2025-10-15T11:02:09.997143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 432 BytesWritten: 103628882 MessagesWritten: 46 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-15T11:02:09.997311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:09.997356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0] Write session will restart in 0.006473s
2025-10-15T11:02:09.997519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0] Write session: Do CDS request
2025-10-15T11:02:09.997562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:10.009621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:10.011806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:10.011850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1029
2025-10-15T11:02:10.016099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:10.016234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:10.016250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:10.016259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:10.017601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1029 sessionId:  describe result for acl check
2025-10-15T11:02:10.017706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:10.017725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:10.017733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:10.017749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402152504754463:5082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:10.020340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402152504754463:5082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:10.038306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402152504754463:5082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:10.049120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402152504754463:5082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:10.049159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402152504754463:5082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:10.049177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402152504754463:5082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:10.049207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:10.051328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:10.062774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402152504754532:5602]
2025-10-15T11:02:10.066279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:10.067114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:10.067145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:10.067186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:10.067470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:10.067667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402155304444134:9569]
2025-10-15T11:02:10.069753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:10.073043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:10.073267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:10.074469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:10.074777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:10.074785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:10.074792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:10.074798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:10.074804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:10.074811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:10.074820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:10.074825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:10.074831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:10.074838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:10.074844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:10.074850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.074857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.074862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.074907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:10.075009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:10.075058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:10.075105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:10.075150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:10.075203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:10.075374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:10.075421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:10.075466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:10.075515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:10.075579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:10.075638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.075696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.075741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.075785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:10.075849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:10.075910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:10.075966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:10.076011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:10.076061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:10.076102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:10.076150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:10.076195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:10.076257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:10.076313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:10.076382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:10.076428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:10.076477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:10.076525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:10.076579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:10.076630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:10.076684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:10.076738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:10.076788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:10.076840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:10.076894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:10.076936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.076995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.077041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.077088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.077139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.077190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.077658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:10.110287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:10.123068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1028
2025-10-15T11:02:10.123171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1028
2025-10-15T11:02:10.119765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:10.123232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1028, pipe: [1:7561402152504754532:5602]
2025-10-15T11:02:10.119815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:10.119832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:10.119852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:10.119879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1028 [2:7561402155304444134:9569]
2025-10-15T11:02:10.119934Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:10.119996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:10.120012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:10.120026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:10.120037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:10.120089Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:10.120111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:10.120134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:10.121658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.121675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.121689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.121700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:10.121965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:10.121983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.122128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.122321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.122558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:10.122641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402148209787133:2467], now have 1 active actors on pipe
2025-10-15T11:02:10.122666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402152504754528:5082], now have 1 active actors on pipe
2025-10-15T11:02:10.122688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402152504754532:5602], now have 1 active actors on pipe
2025-10-15T11:02:10.122715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402155304444122:9569]
2025-10-15T11:02:10.122731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402155304444122:9569]
2025-10-15T11:02:10.122745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402155304444122:9569]
2025-10-15T11:02:10.122785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:10.122859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:10.123047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:10.123064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:10.123189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402155304444122:9569]
2025-10-15T11:02:10.123211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:10.124070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:10.124086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:10.124098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:10.124122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:10.124726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:10.124764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:10.124841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:10.124875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:10.124894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:10.124905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:10.124944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:10.124990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:10.125038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:10.125830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:10.125865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:10.125954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:10.126422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1029 partition: 0 MaxSeqNo: 46 sessionId: src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0
2025-10-15T11:02:10.127571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a5dbdd-5725ddd4-3f38cc0a-61f266ab_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:10.162607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0] Write session: try to update token
2025-10-15T11:02:10.162664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:10.199219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:10.215450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:10.215512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402155304444122:9569]
2025-10-15T11:02:10.215673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:10.215982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:10.219868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:10.223949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:10.225113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:10.226269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:10.239744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:10.241143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:10.241156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:10.241166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:10.241216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:10.325396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:10.325436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:10.325448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:10.325459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:10.325496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402155304444122:9569]
2025-10-15T11:02:10.325520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402155304444122:9569]
2025-10-15T11:02:10.325541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402155304444122:9569]
2025-10-15T11:02:10.325671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:10.325691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:10.326666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:10.331469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:10.331520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:10.331548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:10.373435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId: src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:10.400598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:10.487913Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:10.497217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:10.497470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:10.499167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:10.499292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:10.499304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:10.502170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402152504754532:5602]
2025-10-15T11:02:10.505350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:10.533183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1029 reason: error at write: Disconnected sessionId: src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0
2025-10-15T11:02:10.533472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1029 sessionId: src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0 is DEAD
2025-10-15T11:02:10.535909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:10.535940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0] Write session will restart in 0.009037s
2025-10-15T11:02:10.536029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0] Write session: Do CDS request
2025-10-15T11:02:10.536052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:10.551285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:10.560078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:10.560113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1030
2025-10-15T11:02:10.560972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:10.561088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:10.561104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:10.561114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:10.563191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1030 sessionId:  describe result for acl check
2025-10-15T11:02:10.563311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:10.563321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:10.563330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:10.563368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402152504754584:5073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:10.566396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402152504754584:5073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:10.605875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402152504754659:5602]
2025-10-15T11:02:10.607846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402152504754584:5073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:10.611972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:10.620959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:10.621760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:10.621779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:10.621817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:10.622054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:10.622228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402155304444257:9578]
2025-10-15T11:02:10.624354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:10.625428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402152504754584:5073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:10.625475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402152504754584:5073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:10.625494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402152504754584:5073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:10.625526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:10.625861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:10.626072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:10.627211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:10.627569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:10.627577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:10.627584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:10.627590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:10.627596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:10.627603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:10.627608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:10.627614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:10.627621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:10.627627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:10.627636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:10.627642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.627648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.627654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.627696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:10.627794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:10.627837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:10.627879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:10.627923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:10.627967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:10.628007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:10.628047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:10.628086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:10.628129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:10.628171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:10.628215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.628256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.628293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.628333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:10.628391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:10.628444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:10.628498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:10.628544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:10.628592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:10.628633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:10.628682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:10.628726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:10.628777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:10.628820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:10.628868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:10.628913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:10.628960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:10.629004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:10.629051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:10.629093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:10.629145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:10.629186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:10.629234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:10.629278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:10.629327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:10.629371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.629422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.629465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.629515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.629558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.629609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.630072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:10.657526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:10.669905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:10.669952Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:10.669968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:10.669985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:10.670006Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1029 [2:7561402155304444257:9578]
2025-10-15T11:02:10.670053Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:10.670101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:10.670114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:10.670124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:10.670134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:10.670174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:10.670194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:10.670213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:10.673711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.673745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.673768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.673783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:10.674056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:10.674083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:10.674208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:10.674389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:10.674618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:10.674696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402155304444250:9578]
2025-10-15T11:02:10.674719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402155304444250:9578]
2025-10-15T11:02:10.674732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402155304444250:9578]
2025-10-15T11:02:10.674760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:10.674828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:10.675001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:10.675025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:10.675133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402155304444250:9578]
2025-10-15T11:02:10.675159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:10.675535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:10.675569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:10.675578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:10.675601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:10.676523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402152504754659:5602], now have 1 active actors on pipe
2025-10-15T11:02:10.676561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402152504754673:5073], now have 1 active actors on pipe
2025-10-15T11:02:10.676581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402152504754551:2467], now have 1 active actors on pipe
2025-10-15T11:02:10.678656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1029, pipe: [1:7561402152504754659:5602]
2025-10-15T11:02:10.678775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1029
2025-10-15T11:02:10.678857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1029
2025-10-15T11:02:10.686074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e0b49bd-db7eba3f-5f7f15c9-b3b6db7d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:10.682943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:10.682987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:10.683085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:10.683117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:10.683134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:10.683145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:10.683178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:10.683217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:10.683261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:10.684101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:10.684123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:10.684185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:10.685129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1030 partition: 0 MaxSeqNo: 46 sessionId: src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0
2025-10-15T11:02:10.724560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0] Write session: try to update token
2025-10-15T11:02:10.724626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:10.802502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:10.802535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:10.802548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:10.802650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:10.802662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:10.802674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:10.802684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:10.802716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402155304444250:9578]
2025-10-15T11:02:10.802739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402155304444250:9578]
2025-10-15T11:02:10.802764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402155304444250:9578]
2025-10-15T11:02:10.802854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:10.802888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:10.802916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:10.886919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:10.886954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:10.894136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:10.983476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId: src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:11.027470Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 10 CurrentSessionLifetimeMs: 482319 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T11:02:11.033590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:11.095265Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:11.097331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:11.097363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:11.097405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402155304444250:9578]
2025-10-15T11:02:11.097537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:11.097559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:11.097709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:11.098411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402152504754659:5602]
2025-10-15T11:02:11.098501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:11.098512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:11.100924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:11.110997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:11.111121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1030 reason: error at write: Disconnected sessionId: src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0
2025-10-15T11:02:11.111428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1030 sessionId: src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0 is DEAD
2025-10-15T11:02:11.115790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:11.115864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0] Write session will restart in 0.007633s
2025-10-15T11:02:11.116035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0] Write session: Do CDS request
2025-10-15T11:02:11.116086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:11.132058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:11.132089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1031
2025-10-15T11:02:11.133717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:11.135967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:11.136219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:11.136254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:11.136274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:11.138336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1031 sessionId:  describe result for acl check
2025-10-15T11:02:11.138451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:11.138462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:11.138472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:11.138487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402156799722006:5057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:11.141140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402156799722006:5057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:11.154321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402156799722006:5057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:11.165324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402156799722006:5057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:11.165369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402156799722006:5057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:11.165386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402156799722006:5057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:11.165418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:11.198539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402156799722108:5602]
2025-10-15T11:02:11.212504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:11.220336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:11.221147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:11.221164Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:11.221205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:11.221445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:11.221628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402159599411705:9587]
2025-10-15T11:02:11.224159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:11.225111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:11.225332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:11.226458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:11.226763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:11.226772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:11.226783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:11.226789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:11.226797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:11.226804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:11.226811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:11.226818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:11.226824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:11.226831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:11.226838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:11.226844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.226850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.226858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.226903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:11.227007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:11.227053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:11.227096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:11.227139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:11.227181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:11.227222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:11.227268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:11.227310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:11.227385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:11.227427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:11.227469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.227511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.227567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.227609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:11.227672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:11.227726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:11.227779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:11.227826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:11.227877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:11.227919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:11.227969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:11.228014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:11.228063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:11.228107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:11.228161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:11.228207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:11.228254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:11.228297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:11.228347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:11.228391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:11.228445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:11.228486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:11.228536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:11.228581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:11.228631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:11.228672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.228721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.229908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.229979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.230026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.230076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.230568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:11.255475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:11.298096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:11.298158Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:11.298177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:11.298198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:11.298227Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1030 [2:7561402159599411705:9587]
2025-10-15T11:02:11.298283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:11.298353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:11.298370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:11.298385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:11.298398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:11.298454Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:11.298481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:11.298506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:11.301907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1030, pipe: [1:7561402156799722108:5602]
2025-10-15T11:02:11.302009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1030
2025-10-15T11:02:11.302079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1030
2025-10-15T11:02:11.300036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.300073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.300088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.300102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:11.300413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:11.300434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.300590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.300799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.301061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:11.301143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402159599411699:9587]
2025-10-15T11:02:11.301161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402159599411699:9587]
2025-10-15T11:02:11.301175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402159599411699:9587]
2025-10-15T11:02:11.301222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:11.301306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:11.301377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:11.301394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:11.301406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:11.301512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:11.301531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:11.301676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402159599411699:9587]
2025-10-15T11:02:11.301712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:11.301771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402156799722108:5602], now have 1 active actors on pipe
2025-10-15T11:02:11.301800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402156799722042:5057], now have 1 active actors on pipe
2025-10-15T11:02:11.301825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402156799722000:2467], now have 1 active actors on pipe
2025-10-15T11:02:11.301848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:11.303005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:11.303034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:11.303130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:11.303165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:11.303185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:11.303197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:11.303239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:11.303287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:11.303341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:11.305223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1031 partition: 0 MaxSeqNo: 46 sessionId: src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0
2025-10-15T11:02:11.304793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:11.304836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:11.304908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:11.307997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c00b7-f3b42848-8aeaca93-85295c46_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:11.332558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0] Write session: try to update token
2025-10-15T11:02:11.332635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:11.355785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:11.355821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:11.355855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402159599411699:9587]
2025-10-15T11:02:11.355968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:11.359200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:11.361360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:11.362628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:11.366642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:11.375527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:11.386267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:11.386620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:11.399702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:11.399734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:11.399746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:11.499701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId: src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:11.524213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:11.524262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:11.524279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:11.524292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:11.524340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402159599411699:9587]
2025-10-15T11:02:11.524374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402159599411699:9587]
2025-10-15T11:02:11.524401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402159599411699:9587]
2025-10-15T11:02:11.524596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:11.524610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:11.524622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:11.524673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:11.524696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:11.525666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:11.527520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:11.527561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:11.527592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:11.532230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:11.722155Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:11.724488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:11.724546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:11.726269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402156799722108:5602]
2025-10-15T11:02:11.726371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:11.725377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:11.727625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:11.737951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1031 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0
2025-10-15T11:02:11.738461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1031 sessionId: src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0 is DEAD
2025-10-15T11:02:11.740163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:11.740203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0] Write session will restart in 0.005528s
2025-10-15T11:02:11.740307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0] Write session: Do CDS request
2025-10-15T11:02:11.740367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:11.750690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:11.750469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:11.750507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1032
2025-10-15T11:02:11.751208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:11.751320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:11.751344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:11.751366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:11.752573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1032 sessionId:  describe result for acl check
2025-10-15T11:02:11.752684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:11.752694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:11.752701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:11.752714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402156799722161:5042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:11.754971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402156799722161:5042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:11.763266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402156799722161:5042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:11.769026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402156799722161:5042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:11.769064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402156799722161:5042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:11.769079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402156799722161:5042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:11.769106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:11.826571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402156799722281:5602]
2025-10-15T11:02:11.828389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:11.833538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:11.834261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:11.834288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:11.834324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:11.834534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:11.834705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402159599411836:9598]
2025-10-15T11:02:11.836953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:11.837688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:11.837881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:11.839041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:11.839308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:11.839323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:11.839329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:11.839334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:11.839340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:11.839362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:11.839369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:11.839374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:11.839379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:11.839385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:11.839392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:11.839398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.839403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.839410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.839448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:11.839551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:11.839590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:11.839627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:11.839664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:11.839702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:11.839748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:11.839786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:11.839821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:11.839859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:11.839895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:11.839930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.839966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.840002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.840036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:11.840089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:11.840137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:11.840180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:11.840218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:11.840262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:11.840296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:11.840341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:11.840378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:11.840421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:11.840456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:11.840499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:11.840535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:11.840576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:11.840611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:11.840652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:11.840689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:11.840733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:11.840767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:11.840808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:11.840842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:11.840884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:11.840918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.840961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.840996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.841036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.841068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.841109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.841494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:11.872269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:11.883440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:11.883504Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:11.883520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:11.883538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:11.883561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1031 [2:7561402159599411836:9598]
2025-10-15T11:02:11.883607Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:11.883660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:11.883673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:11.883683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:11.883692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:11.883737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:11.883757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:11.883778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:11.885507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.885523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.885535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.885545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:11.885802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:11.885818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:11.885943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:11.886109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:11.886317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:11.886377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402159599411831:9598]
2025-10-15T11:02:11.886393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402159599411831:9598]
2025-10-15T11:02:11.886404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402159599411831:9598]
2025-10-15T11:02:11.886524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:11.886534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:11.886544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:11.887152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1031, pipe: [1:7561402156799722281:5602]
2025-10-15T11:02:11.887232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1031
2025-10-15T11:02:11.887280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1031
2025-10-15T11:02:11.887817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:11.887909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:11.888080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:11.888095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:11.888136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402156799722281:5602], now have 1 active actors on pipe
2025-10-15T11:02:11.888158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402156799722190:5042], now have 1 active actors on pipe
2025-10-15T11:02:11.888178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402156799722150:2467], now have 1 active actors on pipe
2025-10-15T11:02:11.888218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:11.888236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:11.888364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402159599411831:9598]
2025-10-15T11:02:11.888392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:11.888454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:11.888480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:11.888498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:11.888507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:11.888539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:11.888573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:11.888686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:11.888782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:11.893149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:11.893186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:11.893280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:11.894011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1032 partition: 0 MaxSeqNo: 46 sessionId: src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0
2025-10-15T11:02:11.895115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff43a318-5936d6a-5fdec179-bdac2a4f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:11.944917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0] Write session: try to update token
2025-10-15T11:02:11.944966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:12.070226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:12.070260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:12.070272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:12.070330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:12.070345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:12.070361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:12.070374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:12.070405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402159599411831:9598]
2025-10-15T11:02:12.070434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402159599411831:9598]
2025-10-15T11:02:12.070461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402159599411831:9598]
2025-10-15T11:02:12.070660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:12.070692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:12.071312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:12.071379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:12.071409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:12.075846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:12.132123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId: src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:12.154196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:12.243637Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:12.268548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:12.268603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:12.268681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:12.268696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:12.268739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402159599411831:9598]
2025-10-15T11:02:12.270692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402156799722281:5602]
2025-10-15T11:02:12.270800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:12.270812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:12.269472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:12.276293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:12.287811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:12.287985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1032 reason: error at write: Disconnected sessionId: src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0
2025-10-15T11:02:12.288330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1032 sessionId: src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0 is DEAD
2025-10-15T11:02:12.291825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:12.291862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0] Write session will restart in 0.009963s
2025-10-15T11:02:12.291955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0] Write session: Do CDS request
2025-10-15T11:02:12.291980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:12.308124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:12.308436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:12.308470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1033
2025-10-15T11:02:12.315392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:12.315575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:12.315594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:12.315604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:12.317180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1033 sessionId:  describe result for acl check
2025-10-15T11:02:12.317293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:12.317304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:12.317314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:12.317333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402161094689639:5021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:12.321842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402161094689639:5021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:12.335723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402161094689639:5021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:12.364182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402161094689639:5021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:12.364224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402161094689639:5021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:12.364242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402161094689639:5021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:12.364274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:12.371542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402161094689711:5602]
2025-10-15T11:02:12.398166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:12.415974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:12.416962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:12.416998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:12.417050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:12.417327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:12.417520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402163894379276:9606]
2025-10-15T11:02:12.420114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:12.427662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:12.427941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:12.429357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:12.429701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:12.429712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:12.429719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:12.429728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:12.429735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:12.429741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:12.429748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:12.429754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:12.429760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:12.429767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:12.429774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:12.429781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.429788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.429793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.429840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:12.429948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:12.429994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:12.430038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:12.430083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:12.430129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:12.430170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:12.430213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:12.430257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:12.430304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:12.430347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:12.430389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.430432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.430475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.430518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:12.430581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:12.430639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:12.430693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:12.430740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:12.430794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:12.430836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:12.430887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:12.430934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:12.430985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:12.431029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:12.431081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:12.431125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:12.431175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:12.431218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:12.431269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:12.431313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:12.432334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:12.432404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:12.432460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:12.432505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:12.432559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:12.432618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.432671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.432716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.432769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.432816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.432872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.433362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:12.457466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:12.472991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:12.473039Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:12.473057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:12.473077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:12.473105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1032 [2:7561402163894379276:9606]
2025-10-15T11:02:12.473174Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:12.473238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:12.473253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:12.473265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:12.473278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:12.473329Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:12.473354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:12.473377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:12.475066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.475086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.475102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.475114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:12.476526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1032
2025-10-15T11:02:12.476617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1032, pipe: [1:7561402161094689711:5602]
2025-10-15T11:02:12.476698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1032
2025-10-15T11:02:12.475955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:12.475991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.476141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.476335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.476578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:12.476662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402161094689630:2467], now have 1 active actors on pipe
2025-10-15T11:02:12.476686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402161094689711:5602], now have 1 active actors on pipe
2025-10-15T11:02:12.476710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402161094689692:5021], now have 1 active actors on pipe
2025-10-15T11:02:12.476735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402163894379270:9606]
2025-10-15T11:02:12.476751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402163894379270:9606]
2025-10-15T11:02:12.476765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402163894379270:9606]
2025-10-15T11:02:12.476806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:12.476894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:12.477091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:12.477108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:12.477224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:12.477236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402163894379270:9606]
2025-10-15T11:02:12.477239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:12.477251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:12.477257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:12.477275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:12.478181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:12.478215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:12.478289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a82f49b-176ea009-625a5853-8ed8226b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:12.478321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:12.478340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:12.478350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:12.478389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:12.478433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:12.478477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:12.489767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:12.489831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:12.489932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:12.490410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1033 partition: 0 MaxSeqNo: 46 sessionId: src_id|3a82f49b-176ea009-625a5853-8ed8226b_0
2025-10-15T11:02:12.491813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe3c92d6-e1fe3b2c-58828592-4b770c3b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3a82f49b-176ea009-625a5853-8ed8226b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:12.532250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a82f49b-176ea009-625a5853-8ed8226b_0] Write session: try to update token
2025-10-15T11:02:12.532320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a82f49b-176ea009-625a5853-8ed8226b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:12.572553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:12.572601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:12.572616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:12.650790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:12.650831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:12.650844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:12.650856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:12.650889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402163894379270:9606]
2025-10-15T11:02:12.650917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402163894379270:9606]
2025-10-15T11:02:12.650943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402163894379270:9606]
2025-10-15T11:02:12.651067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:12.651114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:12.651154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:12.670947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:12.670999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:12.672283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:12.710479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId: src_id|3a82f49b-176ea009-625a5853-8ed8226b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:12.732065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:12.829399Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:12.830822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:12.830842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:12.830894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402163894379270:9606]
2025-10-15T11:02:12.831062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:12.831088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:12.831493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:12.832815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:12.833250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402161094689711:5602]
2025-10-15T11:02:12.833305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:12.833320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:12.833327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:12.872566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a82f49b-176ea009-625a5853-8ed8226b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:12.872646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a82f49b-176ea009-625a5853-8ed8226b_0] Write session will restart in 0.007041s
2025-10-15T11:02:12.872862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a82f49b-176ea009-625a5853-8ed8226b_0] Write session: Do CDS request
2025-10-15T11:02:12.872925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a82f49b-176ea009-625a5853-8ed8226b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:12.871788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1033 reason: error at write: Disconnected sessionId: src_id|3a82f49b-176ea009-625a5853-8ed8226b_0
2025-10-15T11:02:12.872154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1033 sessionId: src_id|3a82f49b-176ea009-625a5853-8ed8226b_0 is DEAD
2025-10-15T11:02:12.886403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a82f49b-176ea009-625a5853-8ed8226b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:12.887506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:12.887550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1034
2025-10-15T11:02:12.888136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:12.888312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:12.888339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:12.888355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:12.892771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1034 sessionId:  describe result for acl check
2025-10-15T11:02:12.892903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:12.892914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:12.892924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:12.892943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402161094689840:5012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:12.896142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402161094689840:5012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:12.912292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402161094689840:5012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:12.920156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:12.927033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402161094689840:5012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:12.927084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402161094689840:5012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:12.927104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402161094689840:5012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:12.927137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:12.929562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:12.930604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:12.930627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:12.930679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:12.930971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:12.931171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402163894379401:9611]
2025-10-15T11:02:12.933190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:12.933559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402161094689893:5602]
2025-10-15T11:02:12.934306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:12.934517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:12.935525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:12.935810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:12.935827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:12.935833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:12.935841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:12.935849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:12.935857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:12.935866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:12.935873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:12.935880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:12.935888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:12.935897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:12.935904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.935911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.935919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.935969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:12.936087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:12.936139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:12.936197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:12.936254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:12.936310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:12.936366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:12.936421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:12.936475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:12.936530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:12.936585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:12.936640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.936695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.936751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.936802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:12.936873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:12.936941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:12.937005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:12.937064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:12.937124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:12.937179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:12.937238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:12.937288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:12.937343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:12.937393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:12.937449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:12.937501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:12.937558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:12.937609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:12.937667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:12.937721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:12.937778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:12.937827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:12.937885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:12.937934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:12.937993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:12.938042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.938114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.938171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.938237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.938292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.938354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.938821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:12.963148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:12.996548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1033, pipe: [1:7561402161094689893:5602]
2025-10-15T11:02:12.996686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1033
2025-10-15T11:02:12.996778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1033
2025-10-15T11:02:12.994055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:12.994106Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:12.994122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:12.994139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:12.994166Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1033 [2:7561402163894379401:9611]
2025-10-15T11:02:12.994216Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:12.994273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:12.994287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:12.994298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:12.994309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:12.994356Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:12.994377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:12.994396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:12.995816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.995832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.995844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.995855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:12.996113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:12.996129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:12.996261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:12.996438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:12.996663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:12.996741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402161094689893:5602], now have 1 active actors on pipe
2025-10-15T11:02:12.996765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402161094689781:2467], now have 1 active actors on pipe
2025-10-15T11:02:12.996786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402161094689891:5012], now have 1 active actors on pipe
2025-10-15T11:02:12.996808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402163894379394:9611]
2025-10-15T11:02:12.996821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402163894379394:9611]
2025-10-15T11:02:12.996833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402163894379394:9611]
2025-10-15T11:02:12.996878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:12.996920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:12.996939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:12.996945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:12.996952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:12.997114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:12.997132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:12.997275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:12.997296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:12.997326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402163894379394:9611]
2025-10-15T11:02:12.997360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:12.997477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:12.997507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:12.997523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:12.997533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:12.997563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:12.997598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:12.997680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:12.998712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:13.004823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1034 partition: 0 MaxSeqNo: 46 sessionId: src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0
2025-10-15T11:02:13.005449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a82f49b-176ea009-625a5853-8ed8226b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:13.003599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:13.003656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:13.003739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:13.027686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0] Write session: try to update token
2025-10-15T11:02:13.027764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:13.112600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:13.112641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:13.112653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:13.112714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:13.112728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:13.112740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:13.112750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:13.112785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402163894379394:9611]
2025-10-15T11:02:13.112809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402163894379394:9611]
2025-10-15T11:02:13.112833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402163894379394:9611]
2025-10-15T11:02:13.112976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:13.112978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:13.112997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:13.113017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:13.113056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:13.139935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:13.261459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId: src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:13.286169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:13.298689Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:13.301503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:13.301546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:13.304645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:13.304811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:13.304822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:13.305218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402161094689893:5602]
2025-10-15T11:02:13.317518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1034 reason: error at write: Disconnected sessionId: src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0
2025-10-15T11:02:13.318347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:13.318371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0] Write session will restart in 0.005504s
2025-10-15T11:02:13.318446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0] Write session: Do CDS request
2025-10-15T11:02:13.318467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:13.317824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1034 sessionId: src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0 is DEAD
2025-10-15T11:02:13.324723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:13.332700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:13.333825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:13.333858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1035
2025-10-15T11:02:13.335744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:13.335867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:13.335882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:13.335892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:13.337112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1035 sessionId:  describe result for acl check
2025-10-15T11:02:13.337217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:13.337233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:13.337242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:13.337256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402165389657215:4999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:13.339684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402165389657215:4999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:13.368814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402165389657215:4999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:13.390589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402165389657215:4999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:13.390624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402165389657215:4999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:13.390635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402165389657215:4999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:13.390658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:13.404566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:13.405552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402165389657320:5602]
2025-10-15T11:02:13.407096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:13.408032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:13.408052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:13.408099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:13.408390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:13.408567Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402168189346842:9620]
2025-10-15T11:02:13.410738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:13.412008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:13.412246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:13.413509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:13.413851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:13.413859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:13.413867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:13.413874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:13.413881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:13.413888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:13.413896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:13.413903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:13.413911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:13.413918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:13.413926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:13.413934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.413942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.413949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.414001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:13.414110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:13.414160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:13.414207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:13.414258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:13.414308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:13.414356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:13.414405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:13.414450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:13.414496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:13.414544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:13.414593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.414639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.414687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.414732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:13.414802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:13.414861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:13.414919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:13.414966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:13.415023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:13.415065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:13.415121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:13.415172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:13.415225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:13.415273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:13.415326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:13.416417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:13.416498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:13.416548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:13.416604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:13.416657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:13.416723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:13.416772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:13.416830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:13.416878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:13.416934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:13.416982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.417038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.417086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.417138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.417185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.417241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.417757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:13.443267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:13.453903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:13.453962Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:13.453979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:13.453998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:13.454024Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1034 [2:7561402168189346842:9620]
2025-10-15T11:02:13.454076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:13.454137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:13.454153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:13.454166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:13.454178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:13.454233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:13.454257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:13.454279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:13.462651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.462692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.462707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.462720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:13.463017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:13.463037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.463197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.463802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.464090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:13.464185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402165389657320:5602], now have 1 active actors on pipe
2025-10-15T11:02:13.464213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402165389657315:4999], now have 1 active actors on pipe
2025-10-15T11:02:13.464236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402165389657206:2467], now have 1 active actors on pipe
2025-10-15T11:02:13.464270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402168189346836:9620]
2025-10-15T11:02:13.464289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402168189346836:9620]
2025-10-15T11:02:13.464303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402168189346836:9620]
2025-10-15T11:02:13.464349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:13.464434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:13.464641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:13.464661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:13.464792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402168189346836:9620]
2025-10-15T11:02:13.464814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:13.465006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:13.465021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:13.465034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:13.465059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:13.466397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1034, pipe: [1:7561402165389657320:5602]
2025-10-15T11:02:13.466538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1034
2025-10-15T11:02:13.466607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1034
2025-10-15T11:02:13.473056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:13.473106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:13.473223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:13.473264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:13.473285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:13.473297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:13.473344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:13.473397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:13.473458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:13.476862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:13.476905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:13.476986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:13.477451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1035 partition: 0 MaxSeqNo: 46 sessionId: src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0
2025-10-15T11:02:13.479599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab5f4188-c6b7158c-a627f272-7717fd40_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:13.554379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0] Write session: try to update token
2025-10-15T11:02:13.554425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:13.578950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:13.578980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:13.578986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:13.579029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:13.579039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:13.579048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:13.579055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:13.579076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402168189346836:9620]
2025-10-15T11:02:13.579093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402168189346836:9620]
2025-10-15T11:02:13.579107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402168189346836:9620]
2025-10-15T11:02:13.579198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:13.579213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:13.579262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:13.579305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:13.579368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:13.580397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:13.674233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId: src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:13.695589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:13.732128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:13.734365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:13.734393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:13.738368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:13.740034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:13.740065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:13.742817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:13.750720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402165389657320:5602]
2025-10-15T11:02:13.770180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1035 reason: error at write: Disconnected sessionId: src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0
2025-10-15T11:02:13.770469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1035 sessionId: src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0 is DEAD
2025-10-15T11:02:13.775477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:13.775517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0] Write session will restart in 0.005840s
2025-10-15T11:02:13.775594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0] Write session: Do CDS request
2025-10-15T11:02:13.775621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:13.788276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:13.788304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1036
2025-10-15T11:02:13.793023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:13.797919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:13.798081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:13.798097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:13.798106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:13.800578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1036 sessionId:  describe result for acl check
2025-10-15T11:02:13.800682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:13.800692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:13.800702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:13.800718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402165389657388:4979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:13.804174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402165389657388:4979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:13.816101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402165389657388:4979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:13.830457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:13.831397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402165389657388:4979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:13.831436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402165389657388:4979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:13.831451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402165389657388:4979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:13.831479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:13.840322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:13.841152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:13.841171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:13.841212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:13.841455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:13.841652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402168189346978:9622]
2025-10-15T11:02:13.845230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:13.846180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:13.846378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:13.847536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:13.847834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:13.847842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:13.847849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:13.847856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:13.847862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:13.847869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:13.847875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:13.851730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402165389657477:5602]
2025-10-15T11:02:13.847883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:13.847888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:13.847895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:13.847902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:13.847908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.847915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.847923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.847968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:13.848070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:13.848114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:13.848158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:13.848200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:13.848244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:13.848288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:13.848329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:13.848371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:13.848414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:13.848459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:13.848502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.848545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.848587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.848625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:13.848704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:13.848771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:13.848823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:13.848867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:13.848919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:13.848963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:13.849013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:13.849062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:13.849112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:13.849157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:13.849210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:13.849257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:13.849309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:13.849353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:13.849404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:13.849454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:13.849505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:13.849550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:13.849604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:13.849650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:13.849702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:13.849745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.849797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.849843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.849894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.849936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.849988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.850452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:13.883789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:13.894671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:13.894716Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:13.894732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:13.894750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:13.894773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1035 [2:7561402168189346978:9622]
2025-10-15T11:02:13.894821Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:13.894873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:13.894892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:13.894904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:13.894913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:13.894955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:13.894980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:13.894998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:13.907188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.907215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.907225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.907235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:13.907506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:13.907520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:13.907632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:13.907778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:13.907963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:13.908023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402168189346971:9622]
2025-10-15T11:02:13.908035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402168189346971:9622]
2025-10-15T11:02:13.908046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402168189346971:9622]
2025-10-15T11:02:13.908080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:13.908161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:13.908319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:13.908333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:13.908435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402168189346971:9622]
2025-10-15T11:02:13.908450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:13.908650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:13.908661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:13.908672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:13.908695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:13.909356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402165389657477:5602], now have 1 active actors on pipe
2025-10-15T11:02:13.910094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1035, pipe: [1:7561402165389657477:5602]
2025-10-15T11:02:13.909377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402165389657339:2467], now have 1 active actors on pipe
2025-10-15T11:02:13.909397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402165389657469:4979], now have 1 active actors on pipe
2025-10-15T11:02:13.910189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1035
2025-10-15T11:02:13.910257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1035
2025-10-15T11:02:13.912735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1036 partition: 0 MaxSeqNo: 46 sessionId: src_id|24717b30-161c7e3-d6aceeef-bbd21161_0
2025-10-15T11:02:13.914724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e4302fc-547eb27b-5cf4286-ac2984cd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|24717b30-161c7e3-d6aceeef-bbd21161_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:13.911679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:13.911713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:13.911782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24717b30-161c7e3-d6aceeef-bbd21161_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:13.911809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:13.911827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:13.911837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:13.911870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:13.911908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:13.911951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:13.912400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:13.912419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:13.912478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:13.995511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:13.995543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:13.995553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:13.996358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24717b30-161c7e3-d6aceeef-bbd21161_0] Write session: try to update token
2025-10-15T11:02:13.996419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24717b30-161c7e3-d6aceeef-bbd21161_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:14.077864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:14.077918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:14.077936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:14.077953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:14.078000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402168189346971:9622]
2025-10-15T11:02:14.078039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402168189346971:9622]
2025-10-15T11:02:14.078074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402168189346971:9622]
2025-10-15T11:02:14.078575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:14.078636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:14.078682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:14.139322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:14.139394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:14.146259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:14.165056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId: src_id|24717b30-161c7e3-d6aceeef-bbd21161_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:14.186275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:14.287045Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:14.289119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:14.289148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:14.289187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402168189346971:9622]
2025-10-15T11:02:14.289298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:14.289324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:14.289349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:14.290896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402165389657477:5602]
2025-10-15T11:02:14.290983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:14.291204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:14.290017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:14.305177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1036 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24717b30-161c7e3-d6aceeef-bbd21161_0
2025-10-15T11:02:14.305408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1036 sessionId: src_id|24717b30-161c7e3-d6aceeef-bbd21161_0 is DEAD
2025-10-15T11:02:14.315522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24717b30-161c7e3-d6aceeef-bbd21161_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:14.315558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24717b30-161c7e3-d6aceeef-bbd21161_0] Write session will restart in 0.006395s
2025-10-15T11:02:14.315646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24717b30-161c7e3-d6aceeef-bbd21161_0] Write session: Do CDS request
2025-10-15T11:02:14.315670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24717b30-161c7e3-d6aceeef-bbd21161_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:14.326749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24717b30-161c7e3-d6aceeef-bbd21161_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:14.331798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:14.331830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1037
2025-10-15T11:02:14.332643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:14.332758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:14.332777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:14.332786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:14.334940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1037 sessionId:  describe result for acl check
2025-10-15T11:02:14.335046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:14.335057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:14.335067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:14.335082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402169684624812:4969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:14.337563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402169684624812:4969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:14.349810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402169684624812:4969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:14.374811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402169684624812:4969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:14.374855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402169684624812:4969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:14.374872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402169684624812:4969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:14.374905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:14.375181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:14.381116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:14.382050Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:14.382087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:14.382133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:14.382419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:14.382641Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402172484314413:9631]
2025-10-15T11:02:14.385140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:14.386645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:14.386923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:14.391127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402169684624919:5602]
2025-10-15T11:02:14.388460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:14.388855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:14.388865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:14.388873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:14.388880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:14.388888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:14.388896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:14.388904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:14.388912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:14.388919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:14.388927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:14.388935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:14.388942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.388950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.388958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.389013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:14.389140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:14.389196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:14.389251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:14.389304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:14.389358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:14.389413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:14.389463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:14.389516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:14.389572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:14.389623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:14.389677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.389729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.389780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.389837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:14.389913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:14.389988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:14.390053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:14.390114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:14.390180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:14.390240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:14.390307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:14.390365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:14.390425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:14.390475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:14.390540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:14.390595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:14.390658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:14.390710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:14.390768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:14.390825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:14.390889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:14.390938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:14.390999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:14.391053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:14.391111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:14.391164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.391223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.391272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.394401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.394523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.394614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.395249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:14.430170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:14.447212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1036
2025-10-15T11:02:14.447228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1036
2025-10-15T11:02:14.444047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:14.444108Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:14.444128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:14.444150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:14.444181Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1036 [2:7561402172484314413:9631]
2025-10-15T11:02:14.444241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:14.444312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:14.444329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:14.444343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:14.447559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1036, pipe: [1:7561402169684624919:5602]
2025-10-15T11:02:14.444356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:14.444413Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:14.444459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:14.444483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:14.445544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.445563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.445577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.445589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:14.445877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:14.445899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.446057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.446263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.446508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:14.446589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402172484314407:9631]
2025-10-15T11:02:14.446605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402172484314407:9631]
2025-10-15T11:02:14.446618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402172484314407:9631]
2025-10-15T11:02:14.446666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:14.446752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:14.446951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:14.446970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:14.446996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:14.447012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:14.447023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:14.447126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402169684624912:4969], now have 1 active actors on pipe
2025-10-15T11:02:14.447152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402169684624791:2467], now have 1 active actors on pipe
2025-10-15T11:02:14.447173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402172484314407:9631]
2025-10-15T11:02:14.447196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:14.447218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:14.447278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402169684624919:5602], now have 1 active actors on pipe
2025-10-15T11:02:14.448319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:14.448362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:14.448489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:14.448532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:14.448552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:14.448563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:14.448602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:14.448652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:14.448706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:14.456050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:14.456125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:14.456244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:14.457499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24717b30-161c7e3-d6aceeef-bbd21161_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:14.456641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1037 partition: 0 MaxSeqNo: 46 sessionId: src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0
2025-10-15T11:02:14.480073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0] Write session: try to update token
2025-10-15T11:02:14.480128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:14.578183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:14.578222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:14.578235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:14.578245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:14.578277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402172484314407:9631]
2025-10-15T11:02:14.578301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402172484314407:9631]
2025-10-15T11:02:14.578323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402172484314407:9631]
2025-10-15T11:02:14.578527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:14.578539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:14.578549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:14.578590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:14.578609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:14.579598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:14.579630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:14.579659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:14.579758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:14.598207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId: src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:14.618402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:14.718070Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:14.739344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:14.739428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:14.739492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:14.739506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:14.739544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402172484314407:9631]
2025-10-15T11:02:14.740257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:14.740398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:14.743572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:14.743585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:14.743836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402169684624919:5602]
2025-10-15T11:02:14.755937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:14.755973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0] Write session will restart in 0.008464s
2025-10-15T11:02:14.756064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0] Write session: Do CDS request
2025-10-15T11:02:14.756092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:14.754625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1037 reason: status is not ok: tablet will be restarted right now sessionId: src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0
2025-10-15T11:02:14.758553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1037 sessionId: src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0 is DEAD
2025-10-15T11:02:14.770085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:14.770111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1038
2025-10-15T11:02:14.770286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:14.770842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:14.770954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:14.770968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:14.770986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:14.772261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1038 sessionId:  describe result for acl check
2025-10-15T11:02:14.772368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:14.772381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:14.772390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:14.772405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402169684624948:4945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:14.774653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402169684624948:4945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:14.781116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402169684624948:4945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:14.797067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402169684624948:4945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:14.797108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402169684624948:4945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:14.797123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402169684624948:4945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:14.797147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:14.812666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:14.814280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:14.814995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:14.815025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:14.815063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:14.815281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:14.815509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402172484314540:9635]
2025-10-15T11:02:14.817553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:14.818421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:14.818604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:14.820644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:14.820969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:14.820992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:14.820998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:14.821006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:14.821012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:14.821019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:14.821025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:14.821031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:14.821037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:14.821043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:14.821049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:14.821055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.821062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.821068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.821109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:14.821205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:14.821250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:14.821296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:14.821338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:14.821380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:14.821422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:14.821463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:14.821501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:14.821545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:14.821585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:14.821641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.821705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.821755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.821800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:14.821857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:14.821914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:14.821967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:14.822017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:14.822072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:14.822149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:14.822207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:14.822256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:14.822310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:14.822357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:14.822413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:14.822462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:14.822518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:14.822563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:14.822618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:14.822661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:14.822709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:14.822751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:14.822799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:14.822840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:14.822886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:14.822925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.822972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.823011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.823058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.823099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.823145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.823638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:14.846920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402169684625064:5602]
2025-10-15T11:02:14.857854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:14.868374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:14.868422Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:14.868437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:14.868453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:14.868475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1037 [2:7561402172484314540:9635]
2025-10-15T11:02:14.868520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:14.868572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:14.868585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:14.868595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:14.868605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:14.868645Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:14.868665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:14.868683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:14.870335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.870349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.870362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.870372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:14.870632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:14.870648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:14.870777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:14.870949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:14.871757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1037
2025-10-15T11:02:14.871839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1037, pipe: [1:7561402169684625064:5602]
2025-10-15T11:02:14.871881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1037
2025-10-15T11:02:14.871508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:14.871591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402169684625043:4945], now have 1 active actors on pipe
2025-10-15T11:02:14.871612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402169684625064:5602], now have 1 active actors on pipe
2025-10-15T11:02:14.871633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402169684624936:2467], now have 1 active actors on pipe
2025-10-15T11:02:14.871653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402172484314535:9635]
2025-10-15T11:02:14.871666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402172484314535:9635]
2025-10-15T11:02:14.871680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402172484314535:9635]
2025-10-15T11:02:14.871713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:14.871780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:14.871896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:14.871911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:14.871921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:14.871942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:14.871957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:14.872059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402172484314535:9635]
2025-10-15T11:02:14.872084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:14.872138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:14.872155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:14.872292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:14.872318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:14.872333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:14.872342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:14.872353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:14.872372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:14.872405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:14.872463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:14.873607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:14.873637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:14.873712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:14.874874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1038 partition: 0 MaxSeqNo: 46 sessionId: src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0
2025-10-15T11:02:14.876308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150d94a6-3d4583-1ae76a04-6d0a1588_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:14.903919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0] Write session: try to update token
2025-10-15T11:02:14.903967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:14.918252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:14.918286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:14.918319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402172484314535:9635]
2025-10-15T11:02:14.918432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:14.919448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:14.955857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:14.957129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:14.958345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:14.959600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:14.962595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:14.964433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:14.989058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:14.989089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:14.989099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:14.989149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:14.989161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:14.989172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:14.989181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:14.989215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402172484314535:9635]
2025-10-15T11:02:14.989240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402172484314535:9635]
2025-10-15T11:02:14.989261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402172484314535:9635]
2025-10-15T11:02:14.989379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:14.989386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:14.989404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:14.989421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:14.989465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:14.990474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:15.116383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId: src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:15.141470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:15.142277Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:15.146850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:15.146895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:15.147614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:15.147641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:15.148220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:15.148442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402169684625064:5602]
2025-10-15T11:02:15.148078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:15.171179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1038 reason: error at write: Disconnected sessionId: src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0
2025-10-15T11:02:15.171508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1038 sessionId: src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0 is DEAD
2025-10-15T11:02:15.176456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:15.176493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0] Write session will restart in 0.005875s
2025-10-15T11:02:15.176580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0] Write session: Do CDS request
2025-10-15T11:02:15.176607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:15.188094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:15.188120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1039
2025-10-15T11:02:15.188845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:15.189287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:15.189396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:15.189410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:15.189418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:15.190767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1039 sessionId:  describe result for acl check
2025-10-15T11:02:15.190870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:15.190879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:15.190889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:15.190903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402173979592394:4937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:15.193305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402173979592394:4937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:15.205879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402173979592394:4937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:15.207662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:15.215235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:15.216420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402173979592394:4937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:15.216459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402173979592394:4937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:15.216474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402173979592394:4937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:15.216501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:15.216057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:15.216084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:15.216124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:15.216390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:15.216562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402176779281969:9644]
2025-10-15T11:02:15.218611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:15.219668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:15.219871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:15.221045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:15.221379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:15.221395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:15.221401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:15.221408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:15.221414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:15.221421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:15.221426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:15.221433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:15.221439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:15.221446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:15.221452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:15.221458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.221463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.221470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.221510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:15.221610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:15.221656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:15.221698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:15.221748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:15.221793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:15.221840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:15.221888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:15.221935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:15.221982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:15.222029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:15.222073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.222120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.222174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.222220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:15.222285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:15.222343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:15.222396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:15.222443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:15.222496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:15.222541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:15.222592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:15.222640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:15.222694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:15.222741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:15.222794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:15.222838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:15.222893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:15.222938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:15.222989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:15.223034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:15.223093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:15.223135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:15.223187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:15.223233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:15.223296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:15.223374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.223433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.223476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.223530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.223576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.223624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.224071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:15.240447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:15.249752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402173979592493:5602]
2025-10-15T11:02:15.260129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:15.260172Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:15.260187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:15.260205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:15.260229Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1038 [2:7561402176779281969:9644]
2025-10-15T11:02:15.260274Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:15.260326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:15.260338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:15.260349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:15.260359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:15.260405Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:15.260425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:15.260445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:15.261895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.261918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.261931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.261942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:15.262188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:15.262204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.262332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.262505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.262722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:15.262786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402176779281959:9644]
2025-10-15T11:02:15.262801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402176779281959:9644]
2025-10-15T11:02:15.262813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402176779281959:9644]
2025-10-15T11:02:15.262861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:15.262929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:15.263496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1038, pipe: [1:7561402173979592493:5602]
2025-10-15T11:02:15.263595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1038
2025-10-15T11:02:15.263667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1038
2025-10-15T11:02:15.263101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:15.263115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:15.263186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:15.263199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:15.263210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:15.263239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402173979592493:5602], now have 1 active actors on pipe
2025-10-15T11:02:15.263258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402176779281959:9644]
2025-10-15T11:02:15.263291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:15.263295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:15.263328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402173979592373:2467], now have 1 active actors on pipe
2025-10-15T11:02:15.263368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402173979592487:4937], now have 1 active actors on pipe
2025-10-15T11:02:15.264203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:15.264231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:15.264299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:15.264325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:15.264340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:15.264350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:15.264380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:15.264414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:15.264454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:15.265394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:15.265421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:15.265479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:15.265882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1039 partition: 0 MaxSeqNo: 46 sessionId: src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0
2025-10-15T11:02:15.268205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfd13ea7-cb170bcd-6ccf1c2f-3023d5a7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:15.310147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:15.310187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:15.310228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402176779281959:9644]
2025-10-15T11:02:15.310324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:15.312656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:15.319987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:15.327713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:15.329375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:15.330530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0] Write session: try to update token
2025-10-15T11:02:15.330586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:15.330621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:15.332469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:15.332987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:15.370233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:15.370268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:15.370283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:15.370294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:15.370337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402176779281959:9644]
2025-10-15T11:02:15.370366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402176779281959:9644]
2025-10-15T11:02:15.370395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402176779281959:9644]
2025-10-15T11:02:15.370560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:15.370585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:15.371804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:15.371846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:15.371873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:15.372295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:15.464190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId: src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:15.485854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:15.524761Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:15.526657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:15.526698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:15.527472Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:15.527561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402173979592493:5602]
2025-10-15T11:02:15.527641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:15.527763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:15.527775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:15.556011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:15.556072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0] Write session will restart in 0.005868s
2025-10-15T11:02:15.556218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0] Write session: Do CDS request
2025-10-15T11:02:15.556262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:15.554701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1039 reason: error at write: Disconnected sessionId: src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0
2025-10-15T11:02:15.555085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1039 sessionId: src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0 is DEAD
2025-10-15T11:02:15.566182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:15.574208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:15.574440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1040
2025-10-15T11:02:15.574913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:15.575036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:15.575052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:15.575062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:15.576683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1040 sessionId:  describe result for acl check
2025-10-15T11:02:15.576811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:15.576823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:15.576831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:15.576848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402173979592577:4905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:15.580711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402173979592577:4905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:15.590752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402173979592577:4905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:15.606884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:15.608326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402173979592577:4905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:15.608370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402173979592577:4905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:15.608388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402173979592577:4905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:15.608424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:15.611968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:15.612790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:15.612808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:15.612849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:15.613099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:15.613270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402176779282118:9652]
2025-10-15T11:02:15.615655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:15.616769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:15.616997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:15.618305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:15.618669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:15.618687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:15.618695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:15.618703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:15.618712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:15.618719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:15.618725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:15.618733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:15.618739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:15.618746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:15.618752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:15.618759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.618766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.618774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.618822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:15.618935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:15.618984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:15.619032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:15.619076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:15.619124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:15.619171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:15.619217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:15.619297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:15.619366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:15.619413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:15.619460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.619508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.619554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.619604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:15.619671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:15.619732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:15.619791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:15.619844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:15.619903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:15.619949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:15.620008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:15.620059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:15.620117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:15.620162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:15.620216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:15.620265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:15.620317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:15.620365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:15.620416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:15.620466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:15.620520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:15.620567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:15.620624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:15.620674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:15.620729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:15.620778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.620835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.620886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.620943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.620996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.621053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.621583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:15.627690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402173979592640:5602]
2025-10-15T11:02:15.671222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:15.680884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:15.680936Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:15.680953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:15.680973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:15.680998Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1039 [2:7561402176779282118:9652]
2025-10-15T11:02:15.681052Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:15.681117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:15.681133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:15.681146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:15.681157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:15.681211Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:15.681235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:15.681259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:15.682961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.682980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.682993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.683005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:15.683304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:15.683323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:15.683956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:15.684162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:15.684404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:15.684503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402173979592633:4905], now have 1 active actors on pipe
2025-10-15T11:02:15.684536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402173979592519:2467], now have 1 active actors on pipe
2025-10-15T11:02:15.684564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402173979592640:5602], now have 1 active actors on pipe
2025-10-15T11:02:15.684621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:15.684648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:15.684705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402176779282111:9652]
2025-10-15T11:02:15.684732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402176779282111:9652]
2025-10-15T11:02:15.684746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402176779282111:9652]
2025-10-15T11:02:15.684784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:15.684833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:15.684850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:15.684863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:15.684864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:15.685058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:15.685084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:15.685151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:15.685190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:15.685209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:15.685220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:15.685260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:15.685307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:15.685457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402176779282111:9652]
2025-10-15T11:02:15.685491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:15.685512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:15.685539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:15.684187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1039
2025-10-15T11:02:15.684279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1039
2025-10-15T11:02:15.684343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1039, pipe: [1:7561402173979592640:5602]
2025-10-15T11:02:15.686096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:15.686125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:15.686194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:15.686560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1040 partition: 0 MaxSeqNo: 46 sessionId: src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0
2025-10-15T11:02:15.687395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c5e8b8c-58ac7143-258beb4e-bc097805_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:15.735562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0] Write session: try to update token
2025-10-15T11:02:15.735626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:15.744631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:15.744667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:15.744695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402176779282111:9652]
2025-10-15T11:02:15.744802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:15.744844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:15.753834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:15.754931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:15.761695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:15.762931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:15.764637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:15.765197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:15.781940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:15.781986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:15.782002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:15.907933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId: src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:15.942348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:15.942382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:15.942395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:15.942461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:15.942478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:15.942494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:15.942506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:15.942548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402176779282111:9652]
2025-10-15T11:02:15.942576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402176779282111:9652]
2025-10-15T11:02:15.942605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402176779282111:9652]
2025-10-15T11:02:15.942755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:15.942778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:15.943809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:15.943853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:15.943884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:15.960913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:15.969668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:16.109943Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:16.111693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:16.111746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:16.118525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:16.118563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0] Write session will restart in 0.009070s
2025-10-15T11:02:16.118670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0] Write session: Do CDS request
2025-10-15T11:02:16.118700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:16.113576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:16.113606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:16.117174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:16.117552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402173979592640:5602]
2025-10-15T11:02:16.117843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1040 reason: error at write: Disconnected sessionId: src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0
2025-10-15T11:02:16.118434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:16.122999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1040 sessionId: src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0 is DEAD
2025-10-15T11:02:16.135958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:16.135769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:16.135804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1041
2025-10-15T11:02:16.136609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:16.136824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:16.136853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:16.136870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:16.144497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1041 sessionId:  describe result for acl check
2025-10-15T11:02:16.144671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:16.144697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:16.144717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:16.144750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402178274559985:4895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:16.149920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402178274559985:4895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:16.164917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402178274559985:4895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:16.181643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402178274559985:4895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:16.181690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402178274559985:4895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:16.181711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402178274559985:4895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:16.181751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:16.219525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:16.219542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402178274560093:5602]
2025-10-15T11:02:16.221998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:16.222895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:16.222914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:16.222963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:16.223257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:16.223476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402181074249548:9657]
2025-10-15T11:02:16.226772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:16.228793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:16.229028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:16.234786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:16.235412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:16.235421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:16.235428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:16.235435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:16.235443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:16.235450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:16.235458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:16.235465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:16.235473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:16.235481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:16.235490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:16.235498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.235506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.235513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.235570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:16.235707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:16.235762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:16.235818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:16.235868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:16.235923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:16.235972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:16.236020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:16.236070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:16.236121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:16.236172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:16.236225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.236277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.236325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.236378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:16.236457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:16.236522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:16.236583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:16.236638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:16.236698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:16.236748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:16.236806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:16.236863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:16.236919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:16.236969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:16.237030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:16.237079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:16.237138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:16.237183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:16.237240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:16.237294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:16.237350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:16.237401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:16.237461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:16.237511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:16.237572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:16.237622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.237682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.237732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.237788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.237834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.237889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.238432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:16.262171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:16.277738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:16.278063Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:16.278093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:16.278112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:16.278139Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1040 [2:7561402181074249548:9657]
2025-10-15T11:02:16.278193Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:16.278256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:16.278270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:16.278282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:16.278293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:16.278348Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:16.278374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:16.278396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:16.310327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.310365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.310380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.310392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:16.310685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:16.310705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.310861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.311058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.311315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:16.311671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402178274560021:4895], now have 1 active actors on pipe
2025-10-15T11:02:16.311705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402178274560093:5602], now have 1 active actors on pipe
2025-10-15T11:02:16.311728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402178274559976:2467], now have 1 active actors on pipe
2025-10-15T11:02:16.311756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402181074249542:9657]
2025-10-15T11:02:16.311773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402181074249542:9657]
2025-10-15T11:02:16.311785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402181074249542:9657]
2025-10-15T11:02:16.311826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:16.311904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:16.312099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:16.312118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:16.312165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:16.312181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:16.312192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:16.312260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402181074249542:9657]
2025-10-15T11:02:16.312286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:16.312385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:16.312407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:16.312517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:16.312550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:16.312570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:16.312581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:16.311497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1040, pipe: [1:7561402178274560093:5602]
2025-10-15T11:02:16.312620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:16.312663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:16.311509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1040
2025-10-15T11:02:16.312728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:16.311592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1040
2025-10-15T11:02:16.315627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:16.317336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:16.317371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:16.317452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:16.317971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1041 partition: 0 MaxSeqNo: 46 sessionId: src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0
2025-10-15T11:02:16.322022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70fa2f7e-892c902c-ab0e368e-e7009813_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:16.375760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0] Write session: try to update token
2025-10-15T11:02:16.375828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:16.377681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:16.377717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:16.377729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:16.478517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:16.478558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:16.478571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:16.478581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:16.478612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402181074249542:9657]
2025-10-15T11:02:16.478637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402181074249542:9657]
2025-10-15T11:02:16.478659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402181074249542:9657]
2025-10-15T11:02:16.478758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:16.478788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:16.478814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:16.479194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:16.479231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:16.479243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:16.479294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:16.479316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:16.495034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:16.547966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId: src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:16.572915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:16.687009Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:16.707874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:16.707920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:16.707978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:16.707993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:16.708031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402181074249542:9657]
2025-10-15T11:02:16.708624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:16.709767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:16.709797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:16.711568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402178274560093:5602]
2025-10-15T11:02:16.711691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:16.709470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:16.763574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1041 reason: error at write: Disconnected sessionId: src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0
2025-10-15T11:02:16.763871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1041 sessionId: src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0 is DEAD
2025-10-15T11:02:16.766398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:16.766429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0] Write session will restart in 0.008024s
2025-10-15T11:02:16.766524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0] Write session: Do CDS request
2025-10-15T11:02:16.766552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:16.784705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:16.785054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:16.785083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1042
2025-10-15T11:02:16.787780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:16.787943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:16.787968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:16.787977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:16.790401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1042 sessionId:  describe result for acl check
2025-10-15T11:02:16.790521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:16.790533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:16.790543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:16.790560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402178274560176:4892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:16.793408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402178274560176:4892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:16.805970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402178274560176:4892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:16.813328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402178274560227:5602]
2025-10-15T11:02:16.814724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:16.821724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:16.822563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:16.822594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:16.822639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:16.822871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:16.823068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402181074249717:9666]
2025-10-15T11:02:16.823907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402178274560176:4892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:16.823958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402178274560176:4892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:16.823976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402178274560176:4892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:16.824004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:16.825203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:16.826126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:16.826356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:16.827658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:16.828014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:16.828029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:16.828037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:16.828056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:16.828063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:16.828071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:16.828077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:16.828084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:16.828092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:16.828099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:16.828106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:16.828113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.828119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.828127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.828177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:16.828292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:16.828338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:16.828397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:16.828451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:16.828500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:16.828550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:16.828605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:16.828655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:16.828708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:16.828760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:16.828806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.828856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.828908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.828961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:16.829030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:16.829089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:16.829144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:16.829192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:16.829249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:16.829291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:16.829347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:16.829396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:16.829448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:16.829491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:16.829544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:16.829596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:16.829649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:16.829693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:16.829746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:16.829795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:16.829849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:16.829896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:16.829948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:16.829993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:16.830050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:16.830094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.830145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.830190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.830245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.830291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.830343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.830839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:16.860642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:16.870226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:16.870276Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:16.870296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:16.870318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:16.870349Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1041 [2:7561402181074249717:9666]
2025-10-15T11:02:16.870406Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:16.870470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:16.870487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:16.870500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:16.870512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:16.870565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:16.870590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:16.870615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:16.872238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.872265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.872280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.872293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:16.872571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:16.872592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:16.872755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:16.872962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:16.873219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:16.873291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402181074249710:9666]
2025-10-15T11:02:16.873308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402181074249710:9666]
2025-10-15T11:02:16.873322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402181074249710:9666]
2025-10-15T11:02:16.873370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:16.873451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:16.873654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:16.873672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:16.873809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402181074249710:9666]
2025-10-15T11:02:16.873833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:16.874262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:16.874275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:16.874287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:16.874312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:16.874444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402178274560242:4892], now have 1 active actors on pipe
2025-10-15T11:02:16.874484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402178274560227:5602], now have 1 active actors on pipe
2025-10-15T11:02:16.874508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402178274560113:2467], now have 1 active actors on pipe
2025-10-15T11:02:16.874515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1041, pipe: [1:7561402178274560227:5602]
2025-10-15T11:02:16.874580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1041
2025-10-15T11:02:16.874652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1041
2025-10-15T11:02:16.874953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:16.874997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:16.875092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:16.875124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:16.875155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:16.875171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:16.875223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:16.875271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:16.875324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:16.875917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:16.875939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:16.875990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:16.876300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1042 partition: 0 MaxSeqNo: 46 sessionId: src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0
2025-10-15T11:02:16.879665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeaaf270-e7b6e099-53e8819b-8bcbfacd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:16.951024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0] Write session: try to update token
2025-10-15T11:02:16.951082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:16.970597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:16.970649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:16.970662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:17.063744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:17.063771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:17.063781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:17.063790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:17.063812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402181074249710:9666]
2025-10-15T11:02:17.063830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402181074249710:9666]
2025-10-15T11:02:17.063846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402181074249710:9666]
2025-10-15T11:02:17.064008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:17.064017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:17.064032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:17.064046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:17.064086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:17.064881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:17.106233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId: src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:17.133683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:17.214897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:17.226977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402178274560227:5602]
2025-10-15T11:02:17.227054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:17.227137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:17.227144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:17.225627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:17.225673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:17.225730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:17.225743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:17.225781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402181074249710:9666]
2025-10-15T11:02:17.226678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:17.227332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:17.277337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:17.277389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0] Write session will restart in 0.008979s
2025-10-15T11:02:17.277540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0] Write session: Do CDS request
2025-10-15T11:02:17.277587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:17.276734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1042 reason: error at write: Disconnected sessionId: src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0
2025-10-15T11:02:17.277035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1042 sessionId: src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0 is DEAD
2025-10-15T11:02:17.297248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:17.303659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:17.303690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1043
2025-10-15T11:02:17.304172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:17.304301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:17.304332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:17.304342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:17.306054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:17.306532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1043 sessionId:  describe result for acl check
2025-10-15T11:02:17.306639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:17.306650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:17.306658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:17.306673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402182569527660:4859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:17.308906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402182569527660:4859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:17.308594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:17.309352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:17.309370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:17.309405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:17.309622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:17.309789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402185369217136:9674]
2025-10-15T11:02:17.311885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:17.314009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:17.314204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:17.315627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:17.315952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:17.315973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:17.315980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:17.315987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:17.315992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:17.315999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:17.316006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:17.316013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:17.316019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:17.316026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:17.316033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:17.316040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.316046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.316053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.316095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:17.316193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:17.316237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:17.316280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:17.316323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:17.316368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:17.316430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:17.316482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:17.316535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:17.316585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:17.316632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:17.316675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.316723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.316780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.316831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:17.316899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:17.316951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:17.317008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:17.317061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:17.317119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:17.317168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:17.317226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:17.317277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:17.318093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402182569527660:4859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:17.317331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:17.317382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:17.317431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:17.317477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:17.317527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:17.317571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:17.317620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:17.317663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:17.317713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:17.317755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:17.317805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:17.317846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:17.317894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:17.317933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.317982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.318027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.318077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.318117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.318166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.318648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:17.327620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402182569527689:5602]
2025-10-15T11:02:17.330851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402182569527660:4859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:17.330891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402182569527660:4859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:17.330909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402182569527660:4859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:17.330951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:17.337396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:17.347650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:17.347690Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:17.347705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:17.347724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:17.347749Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1042 [2:7561402185369217136:9674]
2025-10-15T11:02:17.347799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:17.347853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:17.347866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:17.347878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:17.347888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:17.347931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:17.347951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:17.347972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:17.350533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1042
2025-10-15T11:02:17.350615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1042, pipe: [1:7561402182569527689:5602]
2025-10-15T11:02:17.350696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1042
2025-10-15T11:02:17.349855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.349880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.349896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.349906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:17.350160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:17.350177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.350327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.350516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.350734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:17.350820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402182569527694:4859], now have 1 active actors on pipe
2025-10-15T11:02:17.350843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402182569527689:5602], now have 1 active actors on pipe
2025-10-15T11:02:17.350863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402182569527570:2467], now have 1 active actors on pipe
2025-10-15T11:02:17.350907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:17.350925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:17.350959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402185369217131:9674]
2025-10-15T11:02:17.350972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402185369217131:9674]
2025-10-15T11:02:17.350984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402185369217131:9674]
2025-10-15T11:02:17.351024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:17.351062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:17.351075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:17.351086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:17.351090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:17.351265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:17.351279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:17.351838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:17.351879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:17.351895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:17.351906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:17.351938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:17.351972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:17.352090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402185369217131:9674]
2025-10-15T11:02:17.352125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:17.352181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:17.352262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:17.353058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:17.353090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:17.353148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:17.353463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1043 partition: 0 MaxSeqNo: 46 sessionId: src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0
2025-10-15T11:02:17.354201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a5382c-a34dd74e-dc1bbc8-fed77f86_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:17.413330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0] Write session: try to update token
2025-10-15T11:02:17.413392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:17.495610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:17.495638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:17.495650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:17.495702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:17.495716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:17.495729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:17.495740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:17.495772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402185369217131:9674]
2025-10-15T11:02:17.495812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402185369217131:9674]
2025-10-15T11:02:17.495837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402185369217131:9674]
2025-10-15T11:02:17.496027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:17.496056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:17.496875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:17.496926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:17.496954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:17.518329Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:17.587834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId: src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:17.609822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:17.678847Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:17.695999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:17.696068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:17.696140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:17.696156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:17.696204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402185369217131:9674]
2025-10-15T11:02:17.696489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:17.697085Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:17.697158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:17.697189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:17.699806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402182569527689:5602]
2025-10-15T11:02:17.699935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:17.728586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1043 reason: error at write: Disconnected sessionId: src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0
2025-10-15T11:02:17.728868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1043 sessionId: src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0 is DEAD
2025-10-15T11:02:17.732885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:17.732997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0] Write session will restart in 0.007000s
2025-10-15T11:02:17.733203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0] Write session: Do CDS request
2025-10-15T11:02:17.733258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:17.750030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:17.750010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:17.750044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1044
2025-10-15T11:02:17.750529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:17.750667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:17.750690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:17.750701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:17.756823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1044 sessionId:  describe result for acl check
2025-10-15T11:02:17.756932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:17.756941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:17.756951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:17.756966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402182569527763:4854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:17.759291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402182569527763:4854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:17.772971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402182569527763:4854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:17.783153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:17.788946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402182569527763:4854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:17.788987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402182569527763:4854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:17.789002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402182569527763:4854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:17.789030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:17.792067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:17.792802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:17.792820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:17.792856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:17.793083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:17.793253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402185369217289:9679]
2025-10-15T11:02:17.795308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:17.800147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402182569527843:5602]
2025-10-15T11:02:17.801559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:17.801793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:17.803004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:17.803315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:17.803322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:17.803329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:17.803335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:17.803342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:17.803370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:17.803377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:17.803384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:17.803392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:17.803399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:17.803406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:17.803412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.803419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.803425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.803468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:17.803568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:17.803614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:17.803656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:17.803698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:17.803738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:17.803779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:17.803819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:17.803857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:17.803900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:17.803940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:17.803981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.804024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.804062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.804101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:17.804157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:17.804210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:17.804259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:17.804304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:17.804356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:17.804398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:17.804448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:17.804492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:17.804541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:17.804581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:17.804628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:17.804673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:17.804724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:17.804766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:17.804815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:17.804859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:17.804906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:17.804947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:17.804996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:17.805039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:17.805087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:17.805128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.805179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.805221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.805268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.805307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.805356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.805819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:17.830940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:17.841658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:17.841710Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:17.841730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:17.841750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:17.841777Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1043 [2:7561402185369217289:9679]
2025-10-15T11:02:17.841833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:17.841893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:17.841910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:17.841924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:17.841936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:17.841991Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:17.842015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:17.842039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:17.877435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.877467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.877485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.877498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:17.877808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:17.877827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:17.877979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:17.878178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:17.878422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:17.878495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402185369217278:9679]
2025-10-15T11:02:17.878513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402185369217278:9679]
2025-10-15T11:02:17.878527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402185369217278:9679]
2025-10-15T11:02:17.878572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:17.878651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:17.878835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:17.878852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:17.878882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:17.878894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:17.878906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:17.878988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402182569527723:2467], now have 1 active actors on pipe
2025-10-15T11:02:17.879013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402182569527839:4854], now have 1 active actors on pipe
2025-10-15T11:02:17.879031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402185369217278:9679]
2025-10-15T11:02:17.879050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:17.879069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:17.879145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402182569527843:5602], now have 1 active actors on pipe
2025-10-15T11:02:17.880005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1043
2025-10-15T11:02:17.880133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1043
2025-10-15T11:02:17.880192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1043, pipe: [1:7561402182569527843:5602]
2025-10-15T11:02:17.881042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:17.881078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:17.881157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:17.881191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:17.881212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:17.881222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:17.881260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:17.881307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:17.881358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:17.882663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:17.882693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:17.882763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:17.883154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1044 partition: 0 MaxSeqNo: 46 sessionId: src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0
2025-10-15T11:02:17.884995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db563685-3bf4e7f4-f0dad2ac-414dff41_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:17.927850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0] Write session: try to update token
2025-10-15T11:02:17.927902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:17.940895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:17.940934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:17.940948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:18.052652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:18.052696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:18.052715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:18.052730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:18.052780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402185369217278:9679]
2025-10-15T11:02:18.052818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402185369217278:9679]
2025-10-15T11:02:18.052852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402185369217278:9679]
2025-10-15T11:02:18.053064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:18.053082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:18.053099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:18.053226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:18.053255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:18.053650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:18.053684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:18.053710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:18.058761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:18.113329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId: src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:18.135220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:18.221237Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:18.235344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:18.235441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:18.236209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:18.236224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:18.236268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402185369217278:9679]
2025-10-15T11:02:18.236799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:18.237966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402182569527843:5602]
2025-10-15T11:02:18.238022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:18.238095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:18.238102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:18.237907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:18.250501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1044 reason: error at write: Disconnected sessionId: src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0
2025-10-15T11:02:18.250748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1044 sessionId: src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0 is DEAD
2025-10-15T11:02:18.252010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:18.252043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0] Write session will restart in 0.006714s
2025-10-15T11:02:18.252134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0] Write session: Do CDS request
2025-10-15T11:02:18.252161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:18.271369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:18.275665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:18.275707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1045
2025-10-15T11:02:18.279616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:18.279756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:18.279773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:18.279784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:18.281179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1045 sessionId:  describe result for acl check
2025-10-15T11:02:18.281275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:18.281285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:18.281295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:18.281310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402186864495190:4852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:18.284287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402186864495190:4852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:18.298300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402186864495190:4852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:18.316629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402186864495190:4852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:18.316670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402186864495190:4852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:18.316688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402186864495190:4852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:18.316718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:18.322859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:18.331441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:18.332312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:18.332330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:18.332374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:18.332620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:18.332786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402189664184751:9688]
2025-10-15T11:02:18.334918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:18.336811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:18.337048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:18.338180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402186864495294:5602]
2025-10-15T11:02:18.338354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:18.338675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:18.338691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:18.338699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:18.338706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:18.338712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:18.338719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:18.338726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:18.338732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:18.338738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:18.338745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:18.338752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:18.338758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.338765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.338772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.338813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:18.338918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:18.338963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:18.339010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:18.339056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:18.339124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:18.339173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:18.339222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:18.339274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:18.339325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:18.339396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:18.339448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.339497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.340590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.340691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:18.340764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:18.340827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:18.340886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:18.340942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:18.341002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:18.341054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:18.341114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:18.341167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:18.341228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:18.341279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:18.341335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:18.341387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:18.341449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:18.341499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:18.341554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:18.341607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:18.341664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:18.341710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:18.341761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:18.341816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:18.341873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:18.341916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.341969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.342017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.342069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.342114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.342161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.342652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:18.365750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:18.373765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:18.373809Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:18.373827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:18.373845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:18.373871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1044 [2:7561402189664184751:9688]
2025-10-15T11:02:18.373924Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:18.373981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:18.373993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:18.374004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:18.374014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:18.374060Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:18.374081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:18.374107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:18.375267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.375282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.375296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.375306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:18.375662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:18.375689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.375833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.376021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.376256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:18.376340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402186864495169:2467], now have 1 active actors on pipe
2025-10-15T11:02:18.376362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402186864495294:5602], now have 1 active actors on pipe
2025-10-15T11:02:18.376383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402186864495288:4852], now have 1 active actors on pipe
2025-10-15T11:02:18.376405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402189664184734:9688]
2025-10-15T11:02:18.376419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402189664184734:9688]
2025-10-15T11:02:18.376432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402189664184734:9688]
2025-10-15T11:02:18.376484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:18.376514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:18.376530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:18.376541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:18.376551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:18.376891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1044
2025-10-15T11:02:18.376968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1044, pipe: [1:7561402186864495294:5602]
2025-10-15T11:02:18.377032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1044
2025-10-15T11:02:18.377000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:18.377022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:18.377135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402189664184734:9688]
2025-10-15T11:02:18.377164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:18.377198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:18.377827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:18.377857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:18.377943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79b58998-8a601775-7faa2718-ea43ef63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:18.377971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:18.377988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:18.377999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:18.378041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:18.378079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:18.378131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:18.386799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:18.386844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:18.386932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:18.390886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1045 partition: 0 MaxSeqNo: 46 sessionId: src_id|79b58998-8a601775-7faa2718-ea43ef63_0
2025-10-15T11:02:18.392128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab3958b3-843b8148-94f76cbe-a7ad9738_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|79b58998-8a601775-7faa2718-ea43ef63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:18.433437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58998-8a601775-7faa2718-ea43ef63_0] Write session: try to update token
2025-10-15T11:02:18.433494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58998-8a601775-7faa2718-ea43ef63_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:18.481721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:18.481757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:18.481773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:18.481784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:18.481819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402189664184734:9688]
2025-10-15T11:02:18.481846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402189664184734:9688]
2025-10-15T11:02:18.481871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402189664184734:9688]
2025-10-15T11:02:18.482047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:18.482063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:18.482075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:18.483733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:18.483781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:18.483845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:18.538411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:18.538457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:18.539671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:18.562190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId: src_id|79b58998-8a601775-7faa2718-ea43ef63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:18.586585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:18.706051Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:18.708030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:18.708053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:18.708090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402189664184734:9688]
2025-10-15T11:02:18.708219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:18.708241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:18.708806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:18.708982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:18.709142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402186864495294:5602]
2025-10-15T11:02:18.709212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:18.709223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:18.709714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:18.757674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1045 reason: error at write: Disconnected sessionId: src_id|79b58998-8a601775-7faa2718-ea43ef63_0
2025-10-15T11:02:18.757904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1045 sessionId: src_id|79b58998-8a601775-7faa2718-ea43ef63_0 is DEAD
2025-10-15T11:02:18.759674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58998-8a601775-7faa2718-ea43ef63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:18.759699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58998-8a601775-7faa2718-ea43ef63_0] Write session will restart in 0.005673s
2025-10-15T11:02:18.759758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58998-8a601775-7faa2718-ea43ef63_0] Write session: Do CDS request
2025-10-15T11:02:18.759774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58998-8a601775-7faa2718-ea43ef63_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:18.777456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58998-8a601775-7faa2718-ea43ef63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:18.779175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:18.779206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1046
2025-10-15T11:02:18.783613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:18.783781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:18.783802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:18.783813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:18.787321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1046 sessionId:  describe result for acl check
2025-10-15T11:02:18.787456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:18.787468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:18.787478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:18.787497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402186864495401:4828] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:18.789899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402186864495401:4828] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:18.800122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402186864495401:4828] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:18.804700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:18.809148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402186864495439:5602]
2025-10-15T11:02:18.812032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:18.812556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402186864495401:4828] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:18.812596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402186864495401:4828] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:18.812612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402186864495401:4828] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:18.812643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:18.812996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:18.813024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:18.813066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:18.813309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:18.813482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402189664184881:9696]
2025-10-15T11:02:18.815705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:18.816566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:18.816753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:18.817983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:18.818301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:18.818309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:18.818316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:18.818321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:18.818327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:18.818332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:18.818339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:18.818345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:18.818351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:18.818358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:18.818364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:18.818370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.818376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.818383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.818424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:18.818516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:18.818557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:18.818600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:18.818639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:18.818681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:18.818724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:18.818763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:18.818804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:18.818844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:18.818885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:18.818924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.818967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.819009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.819048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:18.819125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:18.819194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:18.819244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:18.819288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:18.819335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:18.819406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:18.819454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:18.819496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:18.819546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:18.819588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:18.819639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:18.819681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:18.819861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:18.819906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:18.819955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:18.820014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:18.820067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:18.820108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:18.820158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:18.820200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:18.820248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:18.820286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.820351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.820396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.820444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.820494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.820549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.821009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:18.841086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:18.858572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:18.858610Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:18.858624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:18.858641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:18.858662Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1045 [2:7561402189664184881:9696]
2025-10-15T11:02:18.858707Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:18.858753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:18.858764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:18.858774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:18.858784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:18.858825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:18.858844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:18.858863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:18.860513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.860539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.860551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.860562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:18.860830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:18.860859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:18.860981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:18.861147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:18.861359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:18.861437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402186864495442:4828], now have 1 active actors on pipe
2025-10-15T11:02:18.861464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402186864495322:2467], now have 1 active actors on pipe
2025-10-15T11:02:18.861484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402186864495439:5602], now have 1 active actors on pipe
2025-10-15T11:02:18.861511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402189664184875:9696]
2025-10-15T11:02:18.861524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402189664184875:9696]
2025-10-15T11:02:18.861537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402189664184875:9696]
2025-10-15T11:02:18.861575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:18.861646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:18.861502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1045
2025-10-15T11:02:18.861606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1045
2025-10-15T11:02:18.861674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1045, pipe: [1:7561402186864495439:5602]
2025-10-15T11:02:18.861810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:18.861832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:18.861938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402189664184875:9696]
2025-10-15T11:02:18.861955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:18.861960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:18.861968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:18.861977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:18.861997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:18.862077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:18.862103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:18.862188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:18.862221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:18.862240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:18.862250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:18.862280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:18.862313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:18.862361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:18.863819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:18.863847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:18.863906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:18.864159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1046 partition: 0 MaxSeqNo: 46 sessionId: src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0
2025-10-15T11:02:18.864821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b58998-8a601775-7faa2718-ea43ef63_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:18.913127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0] Write session: try to update token
2025-10-15T11:02:18.913171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:19.009398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:19.009426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:19.009437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:19.009484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:19.009498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:19.009511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:19.009522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:19.009554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402189664184875:9696]
2025-10-15T11:02:19.009580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402189664184875:9696]
2025-10-15T11:02:19.009606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402189664184875:9696]
2025-10-15T11:02:19.009774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:19.009798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:19.010944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:19.011443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:19.011475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:19.011503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:19.125846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId: src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:19.148263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:19.158649Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:19.169207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:19.169252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:19.169308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:19.169321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:19.169360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402189664184875:9696]
2025-10-15T11:02:19.170023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:19.173237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:19.173516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402186864495439:5602]
2025-10-15T11:02:19.173690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:19.173727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:19.170688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:19.213165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1046 reason: error at write: Disconnected sessionId: src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0
2025-10-15T11:02:19.213520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1046 sessionId: src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0 is DEAD
2025-10-15T11:02:19.215967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:19.216001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0] Write session will restart in 0.007341s
2025-10-15T11:02:19.216103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0] Write session: Do CDS request
2025-10-15T11:02:19.216134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:19.229176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:19.231723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:19.231755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1047
2025-10-15T11:02:19.234939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:19.235119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:19.235138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:19.235150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:19.237562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1047 sessionId:  describe result for acl check
2025-10-15T11:02:19.237689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:19.237701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:19.237712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:19.237729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402191159462837:4803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:19.240914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402191159462837:4803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:19.254390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402191159462837:4803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:19.261906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:19.266524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:19.267364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:19.267382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:19.267420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:19.267656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:19.267815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402193959152313:9701]
2025-10-15T11:02:19.269874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:19.269291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402191159462837:4803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:19.269339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402191159462837:4803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:19.269368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402191159462837:4803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:19.269399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:19.273591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402191159462911:5602]
2025-10-15T11:02:19.270922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:19.271123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:19.272258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:19.272566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:19.272573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:19.272581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:19.272587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:19.272593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:19.272600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:19.272606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:19.272613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:19.272619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:19.272625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:19.272633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:19.272650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.272656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.272663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.272708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:19.272808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:19.272855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:19.272900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:19.272943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:19.272988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:19.273030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:19.273074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:19.273118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:19.273162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:19.273208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:19.273251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.273294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.273337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.273376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:19.273438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:19.273491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:19.273542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:19.273585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:19.273639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:19.273683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:19.273734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:19.273781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:19.273832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:19.273875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:19.273928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:19.273973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:19.274027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:19.274071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:19.274122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:19.274167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:19.274220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:19.274264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:19.274315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:19.274360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:19.274413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:19.274456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.274507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.274550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.274601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.274645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.274695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.275196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:19.300716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:19.310854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:19.310894Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:19.310909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:19.310927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:19.310952Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1046 [2:7561402193959152313:9701]
2025-10-15T11:02:19.310999Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:19.311065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:19.311079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:19.311090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:19.311097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:19.311141Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:19.311160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:19.311180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:19.313071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.313093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.313105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.313114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:19.313356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:19.313370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.313505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.313675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.313889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:19.313947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402193959152308:9701]
2025-10-15T11:02:19.313960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402193959152308:9701]
2025-10-15T11:02:19.313971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402193959152308:9701]
2025-10-15T11:02:19.314010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:19.314079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:19.314239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:19.314256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:19.314369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402193959152308:9701]
2025-10-15T11:02:19.314388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:19.315147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:19.315162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:19.315171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:19.315192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:19.316722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1046
2025-10-15T11:02:19.316830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1046
2025-10-15T11:02:19.316863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1046, pipe: [1:7561402191159462911:5602]
2025-10-15T11:02:19.317391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402191159462785:2467], now have 1 active actors on pipe
2025-10-15T11:02:19.317420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402191159462907:4803], now have 1 active actors on pipe
2025-10-15T11:02:19.317439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402191159462911:5602], now have 1 active actors on pipe
2025-10-15T11:02:19.317493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:19.317512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:19.317574Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:19.317604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:19.317618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:19.317627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:19.317654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:19.317691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:19.317728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:19.319023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:19.319075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:19.319117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:19.319388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1047 partition: 0 MaxSeqNo: 46 sessionId: src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0
2025-10-15T11:02:19.320367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94d4d47a-fac101b7-7e52ca01-abcdd95e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:19.404800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0] Write session: try to update token
2025-10-15T11:02:19.404874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:19.413916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:19.413950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:19.413960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:19.471059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:19.471090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:19.471103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:19.471113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:19.471141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402193959152308:9701]
2025-10-15T11:02:19.471165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402193959152308:9701]
2025-10-15T11:02:19.471195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402193959152308:9701]
2025-10-15T11:02:19.471324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:19.471342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:19.471424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:19.471446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:19.471473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:19.483478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:19.568894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId: src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:19.602105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:19.648743Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:19.651536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:19.651564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:19.656419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:19.656568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:19.656582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:19.656030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:19.659525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402191159462911:5602]
2025-10-15T11:02:19.683596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1047 reason: error at write: Disconnected sessionId: src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0
2025-10-15T11:02:19.683953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1047 sessionId: src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0 is DEAD
2025-10-15T11:02:19.685163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:19.685221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0] Write session will restart in 0.007298s
2025-10-15T11:02:19.685388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0] Write session: Do CDS request
2025-10-15T11:02:19.685440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:19.701931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:19.701965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1048
2025-10-15T11:02:19.702400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:19.702965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:19.703119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:19.703135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:19.703147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:19.704551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1048 sessionId:  describe result for acl check
2025-10-15T11:02:19.704663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:19.704674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:19.704685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:19.704703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402191159462950:4791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:19.708190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402191159462950:4791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:19.727734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402191159462950:4791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:19.738945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402191159462950:4791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:19.738982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402191159462950:4791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:19.738997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402191159462950:4791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:19.739035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:19.752413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:19.755195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:19.755953Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:19.755973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:19.756005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:19.756196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:19.756350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402193959152471:9710]
2025-10-15T11:02:19.758342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:19.759976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402191159463060:5602]
2025-10-15T11:02:19.759216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:19.759417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:19.760517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:19.760781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:19.760789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:19.760795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:19.760801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:19.760807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:19.760814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:19.760820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:19.760827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:19.760833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:19.760839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:19.760846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:19.760852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.760858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.760863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.760916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:19.761010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:19.761053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:19.761096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:19.761137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:19.761179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:19.761222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:19.761260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:19.761303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:19.761344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:19.761386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:19.761427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.761468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.761510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.761546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:19.761617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:19.761670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:19.761720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:19.761765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:19.761814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:19.761853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:19.761904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:19.761949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:19.762000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:19.762040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:19.762089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:19.762130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:19.762174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:19.762214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:19.762261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:19.762306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:19.762355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:19.762393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:19.762440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:19.762482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:19.762533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:19.762576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.776947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.777026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.777083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.777132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.777191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.777599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:19.801792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:19.814128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:19.814170Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:19.814185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:19.814202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:19.814226Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1047 [2:7561402193959152471:9710]
2025-10-15T11:02:19.814275Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:19.814327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:19.814340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:19.814352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:19.814362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:19.814408Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:19.814430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:19.814449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:19.815687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.815708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.815722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.815732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:19.815960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:19.815978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:19.816109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:19.816288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:19.816470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:19.816535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402193959152466:9710]
2025-10-15T11:02:19.816548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402193959152466:9710]
2025-10-15T11:02:19.816560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402193959152466:9710]
2025-10-15T11:02:19.816596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:19.816659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:19.816820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:19.816835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:19.816937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402193959152466:9710]
2025-10-15T11:02:19.816954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:19.817395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:19.817407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:19.817418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:19.817439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:19.818779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402191159463060:5602], now have 1 active actors on pipe
2025-10-15T11:02:19.818808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402191159463032:4791], now have 1 active actors on pipe
2025-10-15T11:02:19.818829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402191159462934:2467], now have 1 active actors on pipe
2025-10-15T11:02:19.819732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1047, pipe: [1:7561402191159463060:5602]
2025-10-15T11:02:19.819809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1047
2025-10-15T11:02:19.819851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1047
2025-10-15T11:02:19.820614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:19.820642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:19.820709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:19.820745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:19.820765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:19.820776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:19.820808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:19.820843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:19.820883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:19.824945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e21b0f65-4f3a2d21-911e5a35-938d0b3d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:19.823755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:19.823782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:19.823851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:19.824156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1048 partition: 0 MaxSeqNo: 46 sessionId: src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0
2025-10-15T11:02:19.858764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0] Write session: try to update token
2025-10-15T11:02:19.858811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:19.902307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:19.902339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:19.902351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:19.902363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:19.902394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402193959152466:9710]
2025-10-15T11:02:19.902420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402193959152466:9710]
2025-10-15T11:02:19.902445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402193959152466:9710]
2025-10-15T11:02:19.902527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:19.902549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:19.902573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:19.902592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:19.902611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:19.903796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:19.985158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId: src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:20.005493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:20.041199Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:20.054767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:20.054808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:20.054864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:20.054877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:20.054913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402193959152466:9710]
2025-10-15T11:02:20.055231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:20.055635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402191159463060:5602]
2025-10-15T11:02:20.055705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:20.055812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:20.055823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:20.057024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:20.089728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1048 reason: error at write: Disconnected sessionId: src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0
2025-10-15T11:02:20.090034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1048 sessionId: src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0 is DEAD
2025-10-15T11:02:20.090551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:20.090594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0] Write session will restart in 0.007008s
2025-10-15T11:02:20.090721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0] Write session: Do CDS request
2025-10-15T11:02:20.090759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:20.102827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:20.109005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:20.109043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1049
2025-10-15T11:02:20.109382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:20.109489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:20.109510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:20.109519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:20.110964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1049 sessionId:  describe result for acl check
2025-10-15T11:02:20.111081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:20.111091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:20.111101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:20.111116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402195454430463:4779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:20.113451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402195454430463:4779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:20.124139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402195454430463:4779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:20.127275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:20.130974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:20.131766Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:20.131785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:20.131816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:20.132041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:20.132220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402198254119916:9718]
2025-10-15T11:02:20.134103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:20.134323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402195454430463:4779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:20.134369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402195454430463:4779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:20.134384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402195454430463:4779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:20.134413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:20.135887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:20.136080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:20.136988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:20.137259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:20.137266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:20.137272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:20.137280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:20.137285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:20.137289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:20.137293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:20.137298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:20.137302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:20.137306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:20.137311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:20.137316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.137320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.137324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.137354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:20.137433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:20.137465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:20.137507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:20.137537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:20.137568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:20.137611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:20.137651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:20.137692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:20.137737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:20.137779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:20.137821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.137865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.137908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.137951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:20.138012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:20.138065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:20.138119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:20.138165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:20.138225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:20.138269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:20.138319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:20.138364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:20.138412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:20.138453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:20.138502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:20.138545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:20.138594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:20.138639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:20.138690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:20.138736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:20.138785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:20.138827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:20.138879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:20.138921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:20.138971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:20.139030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.139080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.139125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.139177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.139218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.139268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.140382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:20.155908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402195454430525:5602]
2025-10-15T11:02:20.158371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:20.183113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:20.183159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:20.183172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:20.183188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:20.183209Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1048 [2:7561402198254119916:9718]
2025-10-15T11:02:20.183252Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:20.183300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:20.183313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:20.183324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:20.183333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:20.183679Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:20.183705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:20.183725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:20.185802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.185823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.185835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.185846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:20.186101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:20.186116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.186245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.186421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.186630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:20.186706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402195454430525:5602], now have 1 active actors on pipe
2025-10-15T11:02:20.186726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402195454430521:4779], now have 1 active actors on pipe
2025-10-15T11:02:20.186745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402195454430385:2467], now have 1 active actors on pipe
2025-10-15T11:02:20.186766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402198254119911:9718]
2025-10-15T11:02:20.186780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402198254119911:9718]
2025-10-15T11:02:20.186793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402198254119911:9718]
2025-10-15T11:02:20.186836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:20.186891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:20.186902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:20.186905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:20.186916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:20.187079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:20.187095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:20.187202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402198254119911:9718]
2025-10-15T11:02:20.187228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:20.187263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:20.191557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1048, pipe: [1:7561402195454430525:5602]
2025-10-15T11:02:20.191696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1048
2025-10-15T11:02:20.191773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1048
2025-10-15T11:02:20.195467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:20.195506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:20.195601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f27281b-ba49b839-8d494d7-c771af63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:20.195634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:20.195651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:20.195662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:20.195699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:20.195740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:20.195792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:20.203200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:20.203237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:20.203314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:20.203818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1049 partition: 0 MaxSeqNo: 46 sessionId: src_id|3f27281b-ba49b839-8d494d7-c771af63_0
2025-10-15T11:02:20.210202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4811bdf-9f521a0b-65f342d1-5445080b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3f27281b-ba49b839-8d494d7-c771af63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:20.253181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f27281b-ba49b839-8d494d7-c771af63_0] Write session: try to update token
2025-10-15T11:02:20.253230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f27281b-ba49b839-8d494d7-c771af63_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:20.382996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:20.383022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:20.383032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:20.383128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:20.383140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:20.383153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:20.383163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:20.383194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402198254119911:9718]
2025-10-15T11:02:20.383217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402198254119911:9718]
2025-10-15T11:02:20.383236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402198254119911:9718]
2025-10-15T11:02:20.387705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:20.387761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:20.387823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:20.417903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:20.417944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:20.418857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:20.430138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId: src_id|3f27281b-ba49b839-8d494d7-c771af63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:20.452962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:20.565405Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:20.566762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:20.566778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:20.566818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402198254119911:9718]
2025-10-15T11:02:20.566946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:20.566949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:20.566981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:20.568480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:20.568619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402195454430525:5602]
2025-10-15T11:02:20.568685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:20.568694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:20.567894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
E1015 11:02:20.581136880  944343 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:02:20.585456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1049 reason: error at write: Disconnected sessionId: src_id|3f27281b-ba49b839-8d494d7-c771af63_0
2025-10-15T11:02:20.585700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1049 sessionId: src_id|3f27281b-ba49b839-8d494d7-c771af63_0 is DEAD
2025-10-15T11:02:20.585932Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:02:20.588131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f27281b-ba49b839-8d494d7-c771af63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:20.588167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f27281b-ba49b839-8d494d7-c771af63_0] Write session will restart in 0.007415s
2025-10-15T11:02:20.588274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f27281b-ba49b839-8d494d7-c771af63_0] Write session: Do CDS request
2025-10-15T11:02:20.588306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f27281b-ba49b839-8d494d7-c771af63_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:20.604604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f27281b-ba49b839-8d494d7-c771af63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:20.607657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:20.607686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1050
2025-10-15T11:02:20.612228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:20.612367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:20.612382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:20.612393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:20.615938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1050 sessionId:  describe result for acl check
2025-10-15T11:02:20.616045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:20.616055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:20.616064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:20.616080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402195454430588:4765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:20.618535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402195454430588:4765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:20.641315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402195454430588:4765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:20.655384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402195454430588:4765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:20.655430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402195454430588:4765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:20.655446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402195454430588:4765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:20.655478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:20.664099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:20.667470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:20.668314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:20.668332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:20.668372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:20.668617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:20.668792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402198254120069:9723]
2025-10-15T11:02:20.670833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:20.668767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402195454430681:5602]
2025-10-15T11:02:20.672382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:20.672610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:20.674250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:20.674609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:20.674617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:20.674625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:20.674631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:20.674638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:20.674644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:20.674652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:20.674658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:20.674665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:20.674673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:20.674680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:20.674687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.674694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.674702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.674747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:20.674849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:20.674899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:20.674946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:20.675004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:20.675052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:20.675096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:20.675141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:20.675185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:20.675228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:20.675275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:20.675320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.675380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.675424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.675469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:20.675535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:20.675593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:20.675645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:20.675692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:20.675745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:20.675790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:20.675841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:20.675886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:20.675935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:20.675981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:20.676029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:20.676074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:20.676127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:20.676169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:20.676218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:20.676265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:20.676316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:20.676356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:20.676407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:20.676451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:20.676503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:20.676545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.676596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.676641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.676690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.676732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.676783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.677245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:20.718589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:20.739468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1049
2025-10-15T11:02:20.739555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1049, pipe: [1:7561402195454430681:5602]
2025-10-15T11:02:20.739613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1049
2025-10-15T11:02:20.736432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:20.736475Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:20.736490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:20.736507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:20.736530Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1049 [2:7561402198254120069:9723]
2025-10-15T11:02:20.736579Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:20.736633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:20.736647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:20.736658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:20.736668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:20.736709Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:20.736729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:20.736748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:20.737677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.737691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.737703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.737714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:20.737948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:20.737963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:20.738082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:20.738248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:20.738448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:20.738504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402198254120063:9723]
2025-10-15T11:02:20.738517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402198254120063:9723]
2025-10-15T11:02:20.738529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402198254120063:9723]
2025-10-15T11:02:20.738566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:20.738626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:20.738716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:20.738731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:20.738754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:20.738779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:20.738794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:20.738900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402198254120063:9723]
2025-10-15T11:02:20.738918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:20.738986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:20.739035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402195454430678:4765], now have 1 active actors on pipe
2025-10-15T11:02:20.739057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402195454430554:2467], now have 1 active actors on pipe
2025-10-15T11:02:20.739098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402195454430681:5602], now have 1 active actors on pipe
2025-10-15T11:02:20.739887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:20.739909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:20.739974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:20.740002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:20.740017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:20.740028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:20.740070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:20.740105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:20.740144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:20.742914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:20.742966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:20.743040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:20.743428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1050 partition: 0 MaxSeqNo: 46 sessionId: src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0
2025-10-15T11:02:20.744166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f27281b-ba49b839-8d494d7-c771af63_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:20.807105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0] Write session: try to update token
2025-10-15T11:02:20.807161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:20.839541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:20.839566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:20.839576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:20.958511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:20.958544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:20.958559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:20.958571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:20.958607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402198254120063:9723]
2025-10-15T11:02:20.958637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402198254120063:9723]
2025-10-15T11:02:20.958662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402198254120063:9723]
2025-10-15T11:02:20.958897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:20.958913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:20.958924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:20.958989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:20.959010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:20.960221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:20.961981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:20.962041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:20.962099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:21.145265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId: src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:21.180925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:21.263562Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:21.298229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402195454430681:5602]
2025-10-15T11:02:21.298326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:21.298339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:21.296195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:21.296242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:21.296309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:21.296322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:21.296363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402198254120063:9723]
2025-10-15T11:02:21.297111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:21.299789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:21.304112Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:21.313665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:21.312884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1050 reason: error at write: Disconnected sessionId: src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0
2025-10-15T11:02:21.313709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0] Write session will restart in 0.008338s
2025-10-15T11:02:21.313821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0] Write session: Do CDS request
2025-10-15T11:02:21.313849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:21.316409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1050 sessionId: src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0 is DEAD
2025-10-15T11:02:21.335635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:21.336383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:21.336416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1051
2025-10-15T11:02:21.336758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:21.336900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:21.336917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:21.336930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:21.348801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1051 sessionId:  describe result for acl check
2025-10-15T11:02:21.348950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:21.348962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:21.348974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:21.348993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402199749398020:4741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:21.354284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402199749398020:4741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:21.368825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402199749398020:4741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:21.393844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402199749398062:5602]
2025-10-15T11:02:21.397715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402199749398020:4741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:21.397762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402199749398020:4741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:21.397778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402199749398020:4741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:21.397809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:21.431645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:21.436353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:21.437171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:21.437192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:21.437232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:21.437476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:21.437651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402202549087528:9732]
2025-10-15T11:02:21.440153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:21.441238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:21.441449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:21.442630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:21.442971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:21.442980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:21.442988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:21.442994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:21.443001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:21.443008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:21.443014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:21.443021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:21.443027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:21.443034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:21.443040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:21.443047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:21.443053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:21.443060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:21.443106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:21.443212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:21.443261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:21.443311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:21.443398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:21.443444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:21.443490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:21.443538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:21.443582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:21.443629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:21.443674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:21.443720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:21.443766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:21.443812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:21.443860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:21.443926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:21.443985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:21.444041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:21.444091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:21.444145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:21.444191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:21.444244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:21.444292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:21.444344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:21.444390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:21.444442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:21.444492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:21.444543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:21.444587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:21.444636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:21.444685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:21.444737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:21.444783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:21.444834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:21.444881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:21.444932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:21.444979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:21.445032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:21.445076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:21.445129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:21.445171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:21.445220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:21.447120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:21.479247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:21.502616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:21.502655Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:21.502669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:21.502686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:21.502709Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1050 [2:7561402202549087528:9732]
2025-10-15T11:02:21.502755Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:21.502801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:21.502815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:21.502826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:21.502836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:21.502880Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:21.502899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:21.502931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:21.505646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:21.505669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:21.505683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:21.505694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:21.505947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:21.505964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:21.506095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:21.506272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:21.506492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:21.506550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402202549087522:9732]
2025-10-15T11:02:21.506564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402202549087522:9732]
2025-10-15T11:02:21.506576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402202549087522:9732]
2025-10-15T11:02:21.506606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:21.506668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:21.506834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:21.506848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:21.506964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402202549087522:9732]
2025-10-15T11:02:21.506982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:21.508370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:21.508393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:21.508404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:21.508428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:21.509142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402199749398062:5602], now have 1 active actors on pipe
2025-10-15T11:02:21.509177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402199749398012:2467], now have 1 active actors on pipe
2025-10-15T11:02:21.509198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402199749398087:4741], now have 1 active actors on pipe
2025-10-15T11:02:21.509779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1050, pipe: [1:7561402199749398062:5602]
2025-10-15T11:02:21.509867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1050
2025-10-15T11:02:21.509939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1050
2025-10-15T11:02:21.511832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:21.511863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:21.511938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:21.511967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:21.511984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:21.511994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:21.512029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:21.512068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:21.512108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:21.515148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1051 partition: 0 MaxSeqNo: 46 sessionId: src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0
2025-10-15T11:02:21.514717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:21.514761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:21.514829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:21.516014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820ad1ed-1f84e67f-1f53f5b9-8bb989fd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:21.566088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0] Write session: try to update token
2025-10-15T11:02:21.566152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:21.701492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:21.701529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:21.701544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:21.701614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:21.701632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:21.701648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:21.701661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:21.701699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402202549087522:9732]
2025-10-15T11:02:21.701726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402202549087522:9732]
2025-10-15T11:02:21.701751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402202549087522:9732]
2025-10-15T11:02:21.701889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:21.701943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:21.701976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:21.701978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:21.702010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:21.703065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:21.803463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId: src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:21.835653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:21.884296Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:21.906581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:21.906621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:21.906678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:21.906689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:21.906723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402202549087522:9732]
2025-10-15T11:02:21.907021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:21.907304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:21.907657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402199749398062:5602]
2025-10-15T11:02:21.907716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:21.907801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:21.966311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1051 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0
2025-10-15T11:02:21.966690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1051 sessionId: src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0 is DEAD
2025-10-15T11:02:21.975696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:21.975767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0] Write session will restart in 0.005956s
2025-10-15T11:02:21.975942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0] Write session: Do CDS request
2025-10-15T11:02:21.975996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:21.989928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:21.988997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:21.989035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1052
2025-10-15T11:02:21.990695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:21.990819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:21.990836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:21.990847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:21.992304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1052 sessionId:  describe result for acl check
2025-10-15T11:02:21.992421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:21.992434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:21.992444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:21.992461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402199749398245:4735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:22.002949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402199749398245:4735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:22.008239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402204044365589:5602]
2025-10-15T11:02:22.015698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402199749398245:4735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:22.031214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402199749398245:4735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:22.031260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402199749398245:4735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:22.031278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402199749398245:4735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:22.031309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:22.048743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:22.052576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:22.053584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:22.053605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:22.053653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:22.053941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:22.054165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402206844054979:9741]
2025-10-15T11:02:22.056616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:22.057859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:22.058119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:22.059633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:22.060026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:22.060035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:22.060042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:22.060051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:22.060058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:22.060065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:22.060072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:22.060080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:22.060088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:22.060095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:22.060102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:22.060110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.060117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.060124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.060174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:22.060289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:22.060341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:22.060413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:22.060461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:22.060511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:22.060565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:22.060628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:22.060677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:22.060728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:22.060787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:22.060838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.060895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.060945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.061001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:22.061079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:22.061140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:22.061213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:22.061266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:22.061322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:22.061370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:22.061426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:22.061480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:22.061541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:22.061593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:22.061668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:22.061722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:22.061792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:22.061843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:22.061901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:22.061958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:22.062025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:22.062082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:22.062154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:22.062219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:22.062280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:22.062328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.062395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.062458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.062529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.062580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.062641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.063205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:22.090092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:22.101570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:22.101632Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:22.101663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:22.101686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:22.101716Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1051 [2:7561402206844054979:9741]
2025-10-15T11:02:22.101773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:22.101852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:22.101870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:22.101885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:22.101897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:22.101954Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:22.101980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:22.102007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:22.138509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.138541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.138554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.138567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:22.138884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:22.138915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.139067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.139341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1051
2025-10-15T11:02:22.139447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1051, pipe: [1:7561402204044365589:5602]
2025-10-15T11:02:22.139485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1051
2025-10-15T11:02:22.139270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.139533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:22.139655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402204044365611:4735], now have 1 active actors on pipe
2025-10-15T11:02:22.139683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402199749398175:2467], now have 1 active actors on pipe
2025-10-15T11:02:22.139705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402204044365589:5602], now have 1 active actors on pipe
2025-10-15T11:02:22.139734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402206844054974:9741]
2025-10-15T11:02:22.139748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402206844054974:9741]
2025-10-15T11:02:22.139761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402206844054974:9741]
2025-10-15T11:02:22.139802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:22.139939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:22.139962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:22.140003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:22.140204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:22.140224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:22.140422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:22.140458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:22.140479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:22.140490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:22.140528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:22.140548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:22.140565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:22.140573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:22.140578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:22.140616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402206844054974:9741]
2025-10-15T11:02:22.140650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:22.140661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:22.140748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:22.142210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:22.142245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:22.142322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:22.142627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1052 partition: 0 MaxSeqNo: 46 sessionId: src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0
2025-10-15T11:02:22.147253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceaed6ae-b8bcb515-a0d47bef-118f7c28_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:22.179877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0] Write session: try to update token
2025-10-15T11:02:22.179935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:22.202235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:22.202270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:22.202284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:22.311236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:22.311266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:22.311278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:22.311288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:22.311322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402206844054974:9741]
2025-10-15T11:02:22.311366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402206844054974:9741]
2025-10-15T11:02:22.311391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402206844054974:9741]
2025-10-15T11:02:22.311618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:22.311636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:22.311648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:22.311690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:22.311708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:22.312807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:22.315474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:22.315517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:22.315547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:22.335134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId: src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:22.357998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:22.478041Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:22.489346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:22.489396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:22.489467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:22.489479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:22.489519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402206844054974:9741]
2025-10-15T11:02:22.490658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:22.490689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:22.490184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:22.493194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:22.493500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402204044365589:5602]
2025-10-15T11:02:22.494865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:22.546271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1052 reason: error at write: Disconnected sessionId: src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0
2025-10-15T11:02:22.547840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:22.547868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0] Write session will restart in 0.007304s
2025-10-15T11:02:22.547950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0] Write session: Do CDS request
2025-10-15T11:02:22.547972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:22.551684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1052 sessionId: src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0 is DEAD
2025-10-15T11:02:22.561697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:22.570190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:22.570223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1053
2025-10-15T11:02:22.571820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:22.571956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:22.571971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:22.571980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:22.574211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1053 sessionId:  describe result for acl check
2025-10-15T11:02:22.574326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:22.574336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:22.574347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:22.574362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402204044365709:4708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:22.577017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402204044365709:4708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:22.586673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402204044365709:4708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:22.593901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402204044365767:5602]
2025-10-15T11:02:22.600442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402204044365709:4708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:22.600482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402204044365709:4708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:22.600496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402204044365709:4708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:22.600524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:22.601068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:22.612378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:22.613263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:22.613282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:22.613326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:22.613593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:22.613785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402206844055134:9746]
2025-10-15T11:02:22.616145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:22.626427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:22.626696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:22.628019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:22.628352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:22.628361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:22.628368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:22.628376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:22.628385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:22.628391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:22.628398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:22.628405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:22.628412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:22.628418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:22.628425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:22.628432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.628439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.628446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.628496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:22.628605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:22.628653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:22.628699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:22.628740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:22.628783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:22.628829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:22.628875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:22.628921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:22.628965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:22.629008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:22.629052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.629112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.629157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.629200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:22.629262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:22.629314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:22.629362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:22.629406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:22.629456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:22.629499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:22.629562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:22.629614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:22.629666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:22.629713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:22.629777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:22.629825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:22.629875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:22.629921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:22.629976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:22.630023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:22.630087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:22.630134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:22.630186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:22.630230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:22.630281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:22.630321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.630368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.630410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.630461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.630503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.630552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.631807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:22.704074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:22.721403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:22.721447Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:22.721461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:22.721477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:22.721499Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1052 [2:7561402206844055134:9746]
2025-10-15T11:02:22.721546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:22.721599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:22.721612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:22.721622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:22.721632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:22.721677Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:22.721697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:22.721716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:22.731566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.731595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.731609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.731618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:22.731891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:22.731910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:22.732041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:22.732210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:22.732424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:22.732488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402206844055128:9746]
2025-10-15T11:02:22.732501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402206844055128:9746]
2025-10-15T11:02:22.732514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402206844055128:9746]
2025-10-15T11:02:22.732553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:22.732623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:22.732791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:22.732806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:22.732914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402206844055128:9746]
2025-10-15T11:02:22.732933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:22.736052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1052
2025-10-15T11:02:22.736155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1052
2025-10-15T11:02:22.736227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1052, pipe: [1:7561402204044365767:5602]
2025-10-15T11:02:22.733702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:22.733719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:22.733729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:22.733751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:22.743442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402204044365650:2467], now have 1 active actors on pipe
2025-10-15T11:02:22.743480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402204044365776:4708], now have 1 active actors on pipe
2025-10-15T11:02:22.743502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402204044365767:5602], now have 1 active actors on pipe
2025-10-15T11:02:22.743593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:22.743613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:22.743694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:22.743729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:22.743744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:22.743753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:22.743793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:22.743830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:22.743870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:22.746113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:22.746147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:22.746220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:22.749939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1053 partition: 0 MaxSeqNo: 46 sessionId: src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0
2025-10-15T11:02:22.751835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0d0aaf-3cad8f19-d0e0436f-4baabe23_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:22.852744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0] Write session: try to update token
2025-10-15T11:02:22.852794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:22.933443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:22.933477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:22.933489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:22.933546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:22.933557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:22.933590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402206844055128:9746]
2025-10-15T11:02:22.933776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:22.937252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:22.968695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:22.969948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:22.971208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:22.972843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:22.983431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:23.086671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId: src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:23.120060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:23.120208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:23.120219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:23.120228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:23.120272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:23.120283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:23.120293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:23.120302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:23.120333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402206844055128:9746]
2025-10-15T11:02:23.120355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402206844055128:9746]
2025-10-15T11:02:23.120374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402206844055128:9746]
2025-10-15T11:02:23.120494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:23.120513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:23.121466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:23.123540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:23.123580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:23.123608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:23.132741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:23.289066Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:23.290956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:23.290983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:23.294496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:23.295776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402204044365767:5602]
2025-10-15T11:02:23.295937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:23.296154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:23.311947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1053 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0
2025-10-15T11:02:23.312258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1053 sessionId: src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0 is DEAD
2025-10-15T11:02:23.314675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:23.314706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0] Write session will restart in 0.005218s
2025-10-15T11:02:23.314812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0] Write session: Do CDS request
2025-10-15T11:02:23.314839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:23.339025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:23.349345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:23.349484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1054
2025-10-15T11:02:23.349904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:23.350011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:23.350026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:23.350036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:23.351418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1054 sessionId:  describe result for acl check
2025-10-15T11:02:23.351522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:23.351532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:23.351542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:23.351558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402208339333143:4700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:23.353825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402208339333143:4700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:23.373554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402208339333143:4700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:23.395774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402208339333253:5602]
2025-10-15T11:02:23.398211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402208339333143:4700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:23.398254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402208339333143:4700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:23.398268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402208339333143:4700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:23.398295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:23.399618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:23.404575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:23.405493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:23.405516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:23.405559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:23.405797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:23.406169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402211139022613:9760]
2025-10-15T11:02:23.408409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:23.409530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:23.409751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:23.410650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:23.410881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:23.410886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:23.410891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:23.410895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:23.410899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:23.410903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:23.410907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:23.410912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:23.410917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:23.410921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:23.410925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:23.410929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:23.410932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:23.410936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:23.410966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:23.411072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:23.411124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:23.411171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:23.411216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:23.411262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:23.411304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:23.411387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:23.411433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:23.411478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:23.411522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:23.411564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:23.411607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:23.411649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:23.411691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:23.411765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:23.411821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:23.411876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:23.411922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:23.411975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:23.412019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:23.412073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:23.412121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:23.412171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:23.412214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:23.412265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:23.412308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:23.412386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:23.412437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:23.412489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:23.412535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:23.412590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:23.412633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:23.412682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:23.412725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:23.412776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:23.412822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:23.412872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:23.412916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:23.412965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:23.413009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:23.413059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:23.415068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:23.446300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:23.459909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:23.459943Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:23.459958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:23.459973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:23.459995Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1053 [2:7561402211139022613:9760]
2025-10-15T11:02:23.460042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:23.460092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:23.460106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:23.460126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:23.460139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:23.460185Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:23.460206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:23.460226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:23.463503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1053
2025-10-15T11:02:23.461977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:23.463599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1053
2025-10-15T11:02:23.461999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:23.462007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:23.462014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:23.463666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1053, pipe: [1:7561402208339333253:5602]
2025-10-15T11:02:23.462278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:23.462295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:23.462422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:23.462630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:23.462865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:23.462944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402208339333253:5602], now have 1 active actors on pipe
2025-10-15T11:02:23.462966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402208339333256:4700], now have 1 active actors on pipe
2025-10-15T11:02:23.462986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402208339333129:2467], now have 1 active actors on pipe
2025-10-15T11:02:23.463009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402211139022605:9760]
2025-10-15T11:02:23.463022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402211139022605:9760]
2025-10-15T11:02:23.463035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402211139022605:9760]
2025-10-15T11:02:23.463071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:23.463112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:23.463124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:23.463135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:23.463139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:23.463280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:23.463289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:23.463398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402211139022605:9760]
2025-10-15T11:02:23.463423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:23.463569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:23.464780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:23.464808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:23.464881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:23.464915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:23.464933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:23.464944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:23.464978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:23.465021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:23.465078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:23.465490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:23.465520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:23.465586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:23.466339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1054 partition: 0 MaxSeqNo: 46 sessionId: src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0
2025-10-15T11:02:23.471554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcac78a-79e95b39-38e408fe-56ff1ad7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:23.539715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0] Write session: try to update token
2025-10-15T11:02:23.539787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:23.712528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:23.712554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:23.712584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402211139022605:9760]
2025-10-15T11:02:23.712680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:23.712692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:23.712702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:23.712810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:23.714490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:23.714875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:23.716035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:23.717435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:23.718646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:23.720318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:23.732723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId: src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:23.770142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:23.780628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:23.780772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:23.780791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:23.780803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:23.780813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:23.780849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402211139022605:9760]
2025-10-15T11:02:23.780875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402211139022605:9760]
2025-10-15T11:02:23.780898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402211139022605:9760]
2025-10-15T11:02:23.781072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:23.781100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:23.781131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:23.781150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:23.781504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:23.781534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:23.781559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:23.782150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:23.920710Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:23.925315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402208339333253:5602]
2025-10-15T11:02:23.925503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:23.925525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:23.926546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:23.923891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:24.025635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402212634300693:5602]
2025-10-15T11:02:24.032156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:24.039763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:24.041507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:24.041573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:24.041672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:24.042256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:24.042545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402215433990053:9765]
2025-10-15T11:02:24.045119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1054 reason: error at write: Disconnected sessionId: src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0
2025-10-15T11:02:24.045430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1054 sessionId: src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0 is DEAD
2025-10-15T11:02:24.046605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:24.047725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:24.047950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:24.049150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:24.049457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:24.049466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:24.049472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:24.049480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:24.049486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:24.049493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:24.049499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:24.049505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:24.049512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:24.049520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:24.049527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:24.049533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.049539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.049546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.049589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:24.049704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:24.049752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:24.049798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:24.049842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:24.049888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:24.049930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:24.049986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:24.050030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:24.050076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:24.050121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:24.050164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.050217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.050263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.050305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:24.050368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:24.050422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:24.050475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:24.050522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:24.050571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:24.050613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:24.050670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:24.050718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:24.050787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:24.050834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:24.050888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:24.050932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:24.050978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:24.051021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:24.051077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:24.051122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:24.051176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:24.051215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:24.051270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:24.051315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:24.052421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:24.052474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0] Write session will restart in 0.005011s
2025-10-15T11:02:24.052564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0] Write session: Do CDS request
2025-10-15T11:02:24.052590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:24.052334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:24.052389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.052457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.052509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.052562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.052604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.052653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.053130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:24.068278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:24.068310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1055
2025-10-15T11:02:24.072165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:24.073909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:24.074067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:24.074084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:24.074093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:24.075440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1055 sessionId:  describe result for acl check
2025-10-15T11:02:24.075583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:24.075592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:24.075609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:24.075633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402212634300701:4681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:24.078146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402212634300701:4681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:24.085652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402212634300701:4681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:24.098222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402212634300701:4681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:24.098300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402212634300701:4681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:24.098334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402212634300701:4681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:24.098387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:24.100001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:24.116431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:24.116469Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:24.116485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:24.116515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:24.116538Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1054 [2:7561402215433990053:9765]
2025-10-15T11:02:24.116588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:24.116650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:24.116668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:24.116678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:24.116688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:24.116729Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:24.116750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:24.116769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:24.117703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.117725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.117738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.117748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:24.118011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:24.118034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.118165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.118353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.118576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:24.118641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402215433990048:9765]
2025-10-15T11:02:24.118661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402215433990048:9765]
2025-10-15T11:02:24.118674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402215433990048:9765]
2025-10-15T11:02:24.118807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:24.118825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:24.118836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:24.119663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1054
2025-10-15T11:02:24.119737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1054, pipe: [1:7561402212634300693:5602]
2025-10-15T11:02:24.119801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1054
2025-10-15T11:02:24.120481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:24.120596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:24.120771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:24.120794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:24.120839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402212634300729:4681], now have 1 active actors on pipe
2025-10-15T11:02:24.120868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402212634300693:5602], now have 1 active actors on pipe
2025-10-15T11:02:24.120893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402208339333289:2467], now have 1 active actors on pipe
2025-10-15T11:02:24.120938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:24.120962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:24.121094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402215433990048:9765]
2025-10-15T11:02:24.121132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:24.121186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:24.121214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:24.121241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:24.121263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:24.121273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:24.121305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:24.121357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:24.121507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:24.124997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:24.125046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:24.125132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:24.125505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1055 partition: 0 MaxSeqNo: 46 sessionId: src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0
2025-10-15T11:02:24.127878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd93304d-94f5a810-ed99010e-100cfe2e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:24.205948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0] Write session: try to update token
2025-10-15T11:02:24.206000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:24.347742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:24.347767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:24.347777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:24.347878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:24.347890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:24.348141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:24.348154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:24.348183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402215433990048:9765]
2025-10-15T11:02:24.348208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402215433990048:9765]
2025-10-15T11:02:24.348241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402215433990048:9765]
2025-10-15T11:02:24.351471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:24.351504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:24.351526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:24.369426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:24.369464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:24.379860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:24.398080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId: src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:24.430040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:24.519766Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:24.522257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:24.522272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:24.522311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402215433990048:9765]
2025-10-15T11:02:24.522407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:24.522883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:24.522913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:24.527649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:24.527771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:24.527781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:24.531517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402212634300693:5602]
2025-10-15T11:02:24.536146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:24.570676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:24.570744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0] Write session will restart in 0.005754s
2025-10-15T11:02:24.570857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0] Write session: Do CDS request
2025-10-15T11:02:24.570885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:24.570003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1055 reason: error at write: Disconnected sessionId: src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0
2025-10-15T11:02:24.570296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1055 sessionId: src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0 is DEAD
2025-10-15T11:02:24.588420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:24.588156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:24.588198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1056
2025-10-15T11:02:24.589293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:24.589532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:24.589570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:24.589583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:24.591996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1056 sessionId:  describe result for acl check
2025-10-15T11:02:24.592155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:24.592174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:24.592199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:24.592228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402212634300783:4673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:24.596197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402212634300783:4673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:24.601571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402212634300783:4673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:24.611279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402212634300783:4673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:24.611322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402212634300783:4673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:24.611338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402212634300783:4673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:24.611379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:24.631089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402212634300898:5602]
2025-10-15T11:02:24.634914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:24.640595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:24.641507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:24.641526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:24.641567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:24.641841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:24.642061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402215433990220:9775]
2025-10-15T11:02:24.644504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:24.645526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:24.645740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:24.646971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:24.647289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:24.647297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:24.647304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:24.647310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:24.647316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:24.647322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:24.647330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:24.647338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:24.647344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:24.647370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:24.647377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:24.647383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.647390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.647397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.647440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:24.647538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:24.647580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:24.647622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:24.647663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:24.647704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:24.647749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:24.647791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:24.647833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:24.647877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:24.647917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:24.647970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.648012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.648071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.648115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:24.648176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:24.648230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:24.648278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:24.648322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:24.648372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:24.648413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:24.648461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:24.648505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:24.648554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:24.648598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:24.648645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:24.648688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:24.648737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:24.648777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:24.648824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:24.648870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:24.648920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:24.648964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:24.649011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:24.649055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:24.649295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:24.649350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.649406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.649451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.649501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.649543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.649593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.650090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:24.674645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:24.688572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:24.688610Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:24.688625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:24.688642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:24.688666Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1055 [2:7561402215433990220:9775]
2025-10-15T11:02:24.688713Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:24.688763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:24.688777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:24.688788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:24.688797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:24.688841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:24.688862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:24.688881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:24.691081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.691093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.691105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.691116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:24.691572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1055
2025-10-15T11:02:24.691656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1055, pipe: [1:7561402212634300898:5602]
2025-10-15T11:02:24.691732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1055
2025-10-15T11:02:24.692112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:24.692137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:24.692275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:24.692598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:24.692844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:24.692919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402212634300854:4673], now have 1 active actors on pipe
2025-10-15T11:02:24.692942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402212634300898:5602], now have 1 active actors on pipe
2025-10-15T11:02:24.692964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402212634300763:2467], now have 1 active actors on pipe
2025-10-15T11:02:24.693006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:24.693027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:24.693075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402215433990215:9775]
2025-10-15T11:02:24.693088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402215433990215:9775]
2025-10-15T11:02:24.693099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402215433990215:9775]
2025-10-15T11:02:24.693136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:24.693204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:24.693308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:24.693324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:24.693335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:24.693384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:24.693403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:24.693464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:24.693490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:24.693505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:24.693515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:24.693548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:24.693583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:24.693698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402215433990215:9775]
2025-10-15T11:02:24.693729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:24.693762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:24.693771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:24.694984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:24.695009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:24.695072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:24.696726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1056 partition: 0 MaxSeqNo: 46 sessionId: src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0
2025-10-15T11:02:24.697567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4f266d-90fa3cf-23bbdc11-7c01a334_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:24.758337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0] Write session: try to update token
2025-10-15T11:02:24.758393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:24.781723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:24.781753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:24.781786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402215433990215:9775]
2025-10-15T11:02:24.781903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:24.782484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:24.783555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:24.784617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:24.785651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:24.786704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:24.789803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:24.790199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:24.790213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:24.790224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:24.790272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:24.860429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:24.860461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:24.860477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:24.860489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:24.860527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402215433990215:9775]
2025-10-15T11:02:24.860555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402215433990215:9775]
2025-10-15T11:02:24.860580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402215433990215:9775]
2025-10-15T11:02:24.860715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:24.860739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:24.861307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:24.861340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:24.861373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:24.863372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:24.923723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId: src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:24.959118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:25.002951Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:25.007075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:25.007116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:25.011988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:25.023592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:25.104205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:25.107008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:25.108155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:25.108179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:25.108224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:25.108464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:25.108659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402219728957669:9782]
2025-10-15T11:02:25.110791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:25.119891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:25.120160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:25.121418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:25.121750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:25.121768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:25.121775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:25.121783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:25.121790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:25.121797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:25.121804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:25.121811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:25.121818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:25.121825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:25.121831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:25.121838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.121844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.121851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.121895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:25.121997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:25.122042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:25.122085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:25.122131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:25.122177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:25.122219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:25.122263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:25.122309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:25.122355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:25.122400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:25.122445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.122490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.122529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.122571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:25.122635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:25.122705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:25.122755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:25.122797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:25.122845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:25.122889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:25.122942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:25.122991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:25.123042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:25.123085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:25.123139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:25.123184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:25.123233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:25.123276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:25.123326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:25.123511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402212634300898:5602]
2025-10-15T11:02:25.123665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1056 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0
2025-10-15T11:02:25.127456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:25.123955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1056 sessionId: src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0 is DEAD
2025-10-15T11:02:25.127490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0] Write session will restart in 0.005451s
2025-10-15T11:02:25.127581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0] Write session: Do CDS request
2025-10-15T11:02:25.127609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:25.127862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:25.127997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:25.128060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:25.128122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:25.128173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:25.128226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:25.128269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.128360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.128472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.128600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.128709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.128790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.129769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:25.137320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:25.158542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:25.162028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:25.162105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:25.162118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1057
2025-10-15T11:02:25.162852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:25.162951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:25.162974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:25.162984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:25.166346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1057 sessionId:  describe result for acl check
2025-10-15T11:02:25.166465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:25.166475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:25.166484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:25.166499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402216929268335:4658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:25.169128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402216929268335:4658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:25.173043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:25.173082Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:25.173097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:25.173113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:25.173135Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1056 [2:7561402219728957669:9782]
2025-10-15T11:02:25.173181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:25.173229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:25.173242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:25.173253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:25.173263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:25.173305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:25.173326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:25.173345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:25.175176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.175200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.175212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.175222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:25.175481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:25.175503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.175622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.175796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.176015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:25.176089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402216929268330:2467], now have 1 active actors on pipe
2025-10-15T11:02:25.176114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402219728957664:9782]
2025-10-15T11:02:25.176132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402219728957664:9782]
2025-10-15T11:02:25.176145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402219728957664:9782]
2025-10-15T11:02:25.176181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:25.176249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:25.175924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1056
2025-10-15T11:02:25.176343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:25.176362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:25.176373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:25.176419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:25.176441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:25.176590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402219728957664:9782]
2025-10-15T11:02:25.176617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:25.177417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:25.189775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402216929268335:4658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:25.209079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402216929268335:4658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:25.209120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402216929268335:4658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:25.209136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402216929268335:4658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:25.209164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:25.211888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402216929268367:4658], now have 1 active actors on pipe
2025-10-15T11:02:25.211991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1056
2025-10-15T11:02:25.212243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:25.212279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:25.212363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2af76969-43e9b80c-85353918-55eda0dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:25.212411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:25.212431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:25.212444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:25.212487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:25.212551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:25.212615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:25.213071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:25.213107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:25.213186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:25.213441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1057 partition: 0 MaxSeqNo: 46 sessionId: src_id|2af76969-43e9b80c-85353918-55eda0dc_0
2025-10-15T11:02:25.215031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec774c3-aff44091-9784d7c8-5b74ce61_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2af76969-43e9b80c-85353918-55eda0dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:25.224941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402216929268383:5602]
2025-10-15T11:02:25.225893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1056, pipe: [1:7561402216929268383:5602]
2025-10-15T11:02:25.258953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2af76969-43e9b80c-85353918-55eda0dc_0] Write session: try to update token
2025-10-15T11:02:25.259004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2af76969-43e9b80c-85353918-55eda0dc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:25.290813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402216929268383:5602], now have 1 active actors on pipe
2025-10-15T11:02:25.290860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:25.290876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:25.290891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:25.290903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:25.290936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402219728957664:9782]
2025-10-15T11:02:25.290962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402219728957664:9782]
2025-10-15T11:02:25.290987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402219728957664:9782]
2025-10-15T11:02:25.291198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:25.291213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:25.291224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:25.291238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:25.291250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:25.291279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:25.291282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:25.291304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:25.292710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:25.357229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId: src_id|2af76969-43e9b80c-85353918-55eda0dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:25.380659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:25.435769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:25.447219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:25.447256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:25.447313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:25.447321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:25.447361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402219728957664:9782]
2025-10-15T11:02:25.447588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:25.448026Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:25.453623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:25.459498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:25.459635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402216929268383:5602]
2025-10-15T11:02:25.467215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1057 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2af76969-43e9b80c-85353918-55eda0dc_0
2025-10-15T11:02:25.467536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1057 sessionId: src_id|2af76969-43e9b80c-85353918-55eda0dc_0 is DEAD
2025-10-15T11:02:25.471539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af76969-43e9b80c-85353918-55eda0dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:25.471577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af76969-43e9b80c-85353918-55eda0dc_0] Write session will restart in 0.007764s
2025-10-15T11:02:25.471673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af76969-43e9b80c-85353918-55eda0dc_0] Write session: Do CDS request
2025-10-15T11:02:25.471701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af76969-43e9b80c-85353918-55eda0dc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:25.484956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2af76969-43e9b80c-85353918-55eda0dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:25.487889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:25.487919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1058
2025-10-15T11:02:25.491291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:25.491430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:25.491446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:25.491455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:25.493015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1058 sessionId:  describe result for acl check
2025-10-15T11:02:25.493104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:25.493115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:25.493124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:25.493139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402216929268415:4648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:25.495237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402216929268415:4648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:25.514390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402216929268415:4648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:25.528795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402216929268415:4648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:25.528834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402216929268415:4648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:25.528861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402216929268415:4648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:25.528891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:25.561656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402216929268535:5602]
2025-10-15T11:02:25.573736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:25.575279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:25.576000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:25.576018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:25.576056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:25.576279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:25.576487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402219728957822:9787]
2025-10-15T11:02:25.578231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:25.583618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:25.583854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:25.585058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:25.585380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:25.585388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:25.585396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:25.585403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:25.585410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:25.585416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:25.585423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:25.585428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:25.585434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:25.585440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:25.585447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:25.585454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.585460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.585467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.585513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:25.585618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:25.585665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:25.585710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:25.585753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:25.585800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:25.585847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:25.585892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:25.585935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:25.585978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:25.586023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:25.586069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.586111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.586153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.586196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:25.586260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:25.586317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:25.586367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:25.586416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:25.586470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:25.586514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:25.586567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:25.586614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:25.586681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:25.586724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:25.586776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:25.586821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:25.586874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:25.586918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:25.586968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:25.587015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:25.587065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:25.587110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:25.587159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:25.587203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:25.587255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:25.587299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.595656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.595744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.595814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.595867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.595926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.596462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:25.628655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:25.640306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:25.640346Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:25.640361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:25.640379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:25.640408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1057 [2:7561402219728957822:9787]
2025-10-15T11:02:25.640459Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:25.640521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:25.640536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:25.640549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:25.640561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:25.640612Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:25.640633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:25.640652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:25.662582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.662609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.662620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.662628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:25.662833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:25.662856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:25.663012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:25.663131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:25.663268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:25.664487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402219728957817:9787]
2025-10-15T11:02:25.664512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402219728957817:9787]
2025-10-15T11:02:25.664523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402219728957817:9787]
2025-10-15T11:02:25.664553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:25.664584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:25.664596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:25.664606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:25.664626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402216929268406:2467], now have 1 active actors on pipe
2025-10-15T11:02:25.664648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402216929268535:5602], now have 1 active actors on pipe
2025-10-15T11:02:25.664675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402216929268474:4648], now have 1 active actors on pipe
2025-10-15T11:02:25.664733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:25.664752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:25.664785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:25.664919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:25.664936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:25.665077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7869a03c-9de679fd-816d9804-c70798fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:25.665096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:25.665107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:25.665113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:25.665136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:25.665164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:25.665186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402219728957817:9787]
2025-10-15T11:02:25.665210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:25.665239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:25.665286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:25.666712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:25.666735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:25.666799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:25.667797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af76969-43e9b80c-85353918-55eda0dc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7869a03c-9de679fd-816d9804-c70798fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:25.663942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1057
2025-10-15T11:02:25.663955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1057
2025-10-15T11:02:25.664031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1057, pipe: [1:7561402216929268535:5602]
2025-10-15T11:02:25.667122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1058 partition: 0 MaxSeqNo: 46 sessionId: src_id|7869a03c-9de679fd-816d9804-c70798fd_0
2025-10-15T11:02:25.706201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7869a03c-9de679fd-816d9804-c70798fd_0] Write session: try to update token
2025-10-15T11:02:25.706252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7869a03c-9de679fd-816d9804-c70798fd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:25.743628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:25.743654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:25.743664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:25.875643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:25.875671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:25.875682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:25.875692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:25.875725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402219728957817:9787]
2025-10-15T11:02:25.875751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402219728957817:9787]
2025-10-15T11:02:25.875774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402219728957817:9787]
2025-10-15T11:02:25.875918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:25.875930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:25.875940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:25.875981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:25.876000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:25.876928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:25.879785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:25.879823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:25.879849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:25.894338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId: src_id|7869a03c-9de679fd-816d9804-c70798fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:25.929658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:26.041491Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:26.043723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:26.043754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:26.049515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:26.049679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402216929268535:5602]
2025-10-15T11:02:26.049794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:26.049808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:26.059473Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:26.063902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7869a03c-9de679fd-816d9804-c70798fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:26.063949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7869a03c-9de679fd-816d9804-c70798fd_0] Write session will restart in 0.007165s
2025-10-15T11:02:26.064108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7869a03c-9de679fd-816d9804-c70798fd_0] Write session: Do CDS request
2025-10-15T11:02:26.064144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7869a03c-9de679fd-816d9804-c70798fd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:26.063218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1058 reason: error at write: Disconnected sessionId: src_id|7869a03c-9de679fd-816d9804-c70798fd_0
2025-10-15T11:02:26.063511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1058 sessionId: src_id|7869a03c-9de679fd-816d9804-c70798fd_0 is DEAD
2025-10-15T11:02:26.089681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7869a03c-9de679fd-816d9804-c70798fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:26.089520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:26.089553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1059
2025-10-15T11:02:26.091622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:26.091756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:26.091770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:26.091780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:26.094164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1059 sessionId:  describe result for acl check
2025-10-15T11:02:26.094338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:26.094358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:26.094379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:26.094407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402221224235861:4645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:26.098186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402221224235861:4645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:26.128847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402221224235861:4645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:26.151467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402221224235920:5602]
2025-10-15T11:02:26.153820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402221224235861:4645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:26.153869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402221224235861:4645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:26.153888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402221224235861:4645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:26.153920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:26.191750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:26.193811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:26.194587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:26.194605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:26.194663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:26.194883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:26.195048Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402224023925286:9796]
2025-10-15T11:02:26.197366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:26.198368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:26.198545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:26.199688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:26.199986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:26.199993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:26.199998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:26.200005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:26.200011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:26.200017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:26.200023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:26.200030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:26.200035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:26.200043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:26.200049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:26.200056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.200062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.200068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.200106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:26.200195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:26.200237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:26.200278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:26.200318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:26.200361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:26.200400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:26.200437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:26.200475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:26.200516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:26.200554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:26.200591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.200629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.200696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.200733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:26.200788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:26.200838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:26.200886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:26.200923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:26.200964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:26.201001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:26.201043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:26.201083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:26.201127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:26.201164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:26.201211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:26.201251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:26.201296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:26.201333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:26.201376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:26.201418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:26.201462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:26.201499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:26.201544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:26.201582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:26.201624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:26.201664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.201707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.201747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.201790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.201828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.201869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.202275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:26.238740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:26.248243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:26.248287Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:26.248304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:26.248323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:26.248350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1058 [2:7561402224023925286:9796]
2025-10-15T11:02:26.248403Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:26.248459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:26.248474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:26.248486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:26.248497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:26.248541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:26.248561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:26.248581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:26.249929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.249951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.249965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.249974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:26.250224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:26.250246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.250380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.250555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.250803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:26.250866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402224023925281:9796]
2025-10-15T11:02:26.250881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402224023925281:9796]
2025-10-15T11:02:26.250894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402224023925281:9796]
2025-10-15T11:02:26.250935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:26.251003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:26.251176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:26.251192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:26.251305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402224023925281:9796]
2025-10-15T11:02:26.251323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:26.251408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:26.251421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:26.251433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:26.251453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:26.252093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1058, pipe: [1:7561402221224235920:5602]
2025-10-15T11:02:26.252191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1058
2025-10-15T11:02:26.252275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1058
2025-10-15T11:02:26.252476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402221224235920:5602], now have 1 active actors on pipe
2025-10-15T11:02:26.252505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402221224235924:4645], now have 1 active actors on pipe
2025-10-15T11:02:26.252528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402221224235851:2467], now have 1 active actors on pipe
2025-10-15T11:02:26.252570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:26.252591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:26.252673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50446577-5b759b32-220483db-fd3029f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:26.252701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:26.252716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:26.252726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:26.252758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:26.252793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:26.252850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:26.253739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:26.253763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:26.253824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:26.254398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1059 partition: 0 MaxSeqNo: 46 sessionId: src_id|50446577-5b759b32-220483db-fd3029f4_0
2025-10-15T11:02:26.255870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7869a03c-9de679fd-816d9804-c70798fd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|50446577-5b759b32-220483db-fd3029f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:26.293312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50446577-5b759b32-220483db-fd3029f4_0] Write session: try to update token
2025-10-15T11:02:26.293361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50446577-5b759b32-220483db-fd3029f4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:26.412693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:26.412746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:26.412792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:26.412816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:26.412890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402224023925281:9796]
2025-10-15T11:02:26.412940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402224023925281:9796]
2025-10-15T11:02:26.412984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402224023925281:9796]
2025-10-15T11:02:26.413178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:26.413226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:26.413247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:26.413253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:26.413277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:26.413322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:26.413432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:26.413474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:26.422440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:26.468213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId: src_id|50446577-5b759b32-220483db-fd3029f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:26.490783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:26.593533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:26.614230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:26.614269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:26.614326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:26.614337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:26.614368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402224023925281:9796]
2025-10-15T11:02:26.615875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402221224235920:5602]
2025-10-15T11:02:26.615987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:26.616001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:26.614860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:26.615689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:26.652634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:26.652765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1059 reason: error at write: Disconnected sessionId: src_id|50446577-5b759b32-220483db-fd3029f4_0
2025-10-15T11:02:26.653039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1059 sessionId: src_id|50446577-5b759b32-220483db-fd3029f4_0 is DEAD
2025-10-15T11:02:26.656059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50446577-5b759b32-220483db-fd3029f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:26.656103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50446577-5b759b32-220483db-fd3029f4_0] Write session will restart in 0.005564s
2025-10-15T11:02:26.656224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50446577-5b759b32-220483db-fd3029f4_0] Write session: Do CDS request
2025-10-15T11:02:26.656255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50446577-5b759b32-220483db-fd3029f4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:26.680873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50446577-5b759b32-220483db-fd3029f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:26.686978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:26.687020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1060
2025-10-15T11:02:26.691914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:26.692076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:26.692093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:26.692105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:26.693122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1060 sessionId:  describe result for acl check
2025-10-15T11:02:26.693202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:26.693213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:26.693223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:26.693240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402221224236078:4630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:26.699331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402221224236078:4630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:26.717777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402221224236138:5602]
2025-10-15T11:02:26.724372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402221224236078:4630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:26.752209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:26.755885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402221224236078:4630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:26.755926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402221224236078:4630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:26.755943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402221224236078:4630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:26.755973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:26.757258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:26.758417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:26.758444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:26.758489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:26.758758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:26.758946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402224023925458:9805]
2025-10-15T11:02:26.761115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:26.762307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:26.762523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:26.763753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:26.764086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:26.764093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:26.764099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:26.764106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:26.764113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:26.764120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:26.764126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:26.764133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:26.764140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:26.764147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:26.764154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:26.764161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.764168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.764174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.764222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:26.764323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:26.764370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:26.764418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:26.764474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:26.764518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:26.764562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:26.764608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:26.764652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:26.764701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:26.764747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:26.764793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.764838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.764883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.764928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:26.764995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:26.765051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:26.765104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:26.765154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:26.765209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:26.765256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:26.765312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:26.765365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:26.765417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:26.765463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:26.765518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:26.765567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:26.765625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:26.765665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:26.765713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:26.765756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:26.765807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:26.765852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:26.765904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:26.765945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:26.765999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:26.766046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.766097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.766141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.766190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.766232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.766284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.766789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:26.793283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:26.812754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:26.812798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:26.812814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:26.812833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:26.812857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1059 [2:7561402224023925458:9805]
2025-10-15T11:02:26.812909Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:26.812968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:26.812982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:26.812994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:26.813006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:26.813052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:26.813074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:26.813096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:26.814754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.814771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.814784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.814794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:26.815073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:26.815091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:26.815234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:26.815447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:26.815693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:26.815755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402224023925453:9805]
2025-10-15T11:02:26.815768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402224023925453:9805]
2025-10-15T11:02:26.815781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402224023925453:9805]
2025-10-15T11:02:26.815818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:26.815887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:26.818583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1059, pipe: [1:7561402221224236138:5602]
2025-10-15T11:02:26.818700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1059
2025-10-15T11:02:26.818776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1059
2025-10-15T11:02:26.816057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:26.816081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:26.816197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402224023925453:9805]
2025-10-15T11:02:26.816218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:26.816478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:26.816490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:26.816501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:26.816522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:26.823663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50446577-5b759b32-220483db-fd3029f4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|66b1491a-e41351ff-52079dd4-609ca55a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:26.821262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1060 partition: 0 MaxSeqNo: 46 sessionId: src_id|66b1491a-e41351ff-52079dd4-609ca55a_0
2025-10-15T11:02:26.819706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402221224236138:5602], now have 1 active actors on pipe
2025-10-15T11:02:26.819745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402221224236037:2467], now have 1 active actors on pipe
2025-10-15T11:02:26.819775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402221224236167:4630], now have 1 active actors on pipe
2025-10-15T11:02:26.819839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:26.819873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:26.819953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66b1491a-e41351ff-52079dd4-609ca55a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:26.819990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:26.820007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:26.820018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:26.820050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:26.820086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:26.820127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:26.820902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:26.820922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:26.820984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:26.872137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b1491a-e41351ff-52079dd4-609ca55a_0] Write session: try to update token
2025-10-15T11:02:26.872191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b1491a-e41351ff-52079dd4-609ca55a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:27.008105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:27.008131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:27.008142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:27.008194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:27.008207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:27.008218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:27.008227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:27.008257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402224023925453:9805]
2025-10-15T11:02:27.008281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402224023925453:9805]
2025-10-15T11:02:27.008304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402224023925453:9805]
2025-10-15T11:02:27.008482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:27.008499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:27.009047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:27.009076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:27.009101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:27.014722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:27.048044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId: src_id|66b1491a-e41351ff-52079dd4-609ca55a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:27.089235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:27.182771Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:27.194602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:27.194648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:27.194716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:27.194733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:27.194774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402224023925453:9805]
2025-10-15T11:02:27.195717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:27.196811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:27.196839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:27.196686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:27.202385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402221224236138:5602]
2025-10-15T11:02:27.202549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:27.238957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1060 reason: error at write: Disconnected sessionId: src_id|66b1491a-e41351ff-52079dd4-609ca55a_0
2025-10-15T11:02:27.239775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1060 sessionId: src_id|66b1491a-e41351ff-52079dd4-609ca55a_0 is DEAD
2025-10-15T11:02:27.243659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b1491a-e41351ff-52079dd4-609ca55a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:27.243735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b1491a-e41351ff-52079dd4-609ca55a_0] Write session will restart in 0.009087s
2025-10-15T11:02:27.243910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b1491a-e41351ff-52079dd4-609ca55a_0] Write session: Do CDS request
2025-10-15T11:02:27.243966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b1491a-e41351ff-52079dd4-609ca55a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:27.259949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:27.259981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1061
2025-10-15T11:02:27.264196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b1491a-e41351ff-52079dd4-609ca55a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:27.265185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:27.265338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:27.265353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:27.265363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:27.266789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1061 sessionId:  describe result for acl check
2025-10-15T11:02:27.266895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:27.266911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:27.266920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:27.266936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402225519203548:4617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:27.269101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402225519203548:4617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:27.279897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402225519203548:4617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:27.290553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402225519203548:4617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:27.290608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402225519203548:4617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:27.290624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402225519203548:4617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:27.290653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:27.290383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:27.293169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:27.294123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:27.294145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:27.294195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:27.294503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:27.294724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402228318892920:9811]
2025-10-15T11:02:27.297103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:27.298521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:27.298768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:27.300103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:27.300498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:27.300520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:27.300528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:27.300536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:27.300543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:27.300549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:27.300557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:27.300566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:27.300574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:27.300583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:27.300590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:27.300598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.300605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.300611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.300664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:27.300783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:27.300833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:27.300887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:27.300947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:27.301008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:27.301064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:27.301120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:27.301180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:27.301237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:27.301292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:27.301346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.301399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.301454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.301507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:27.301586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:27.301659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:27.301727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:27.301788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:27.301856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:27.301913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:27.301981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:27.302042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:27.302108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:27.302161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:27.302232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:27.302292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:27.302357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:27.302412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:27.302475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:27.302531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:27.302602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:27.302662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:27.302722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:27.302782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:27.302847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:27.302899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.302962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.303018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.303079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.303134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.303201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.303760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:27.303822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402225519203645:5602]
2025-10-15T11:02:27.329954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:27.343856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:27.343918Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:27.343936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:27.343957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:27.343986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1060 [2:7561402228318892920:9811]
2025-10-15T11:02:27.344058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:27.344124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:27.344141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:27.344154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:27.344166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:27.344221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:27.344246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:27.344270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:27.347779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.347813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.347828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.347841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:27.348133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:27.348163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.348316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.348536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.348785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:27.348864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402228318892913:9811]
2025-10-15T11:02:27.348880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402228318892913:9811]
2025-10-15T11:02:27.348894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402228318892913:9811]
2025-10-15T11:02:27.348936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:27.349020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:27.349206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:27.349226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:27.349358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402228318892913:9811]
2025-10-15T11:02:27.349378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:27.351515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:27.351543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:27.351555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:27.351583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:27.354459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1060
2025-10-15T11:02:27.354592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1060, pipe: [1:7561402225519203645:5602]
2025-10-15T11:02:27.354690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1060
2025-10-15T11:02:27.355761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402225519203494:2467], now have 1 active actors on pipe
2025-10-15T11:02:27.355801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402225519203645:5602], now have 1 active actors on pipe
2025-10-15T11:02:27.355825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402225519203641:4617], now have 1 active actors on pipe
2025-10-15T11:02:27.356256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:27.356285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:27.356371Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31e2545b-e1c896b5-325f79bf-d4549551_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:27.356406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:27.356424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:27.356435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:27.356475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:27.356523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:27.356571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:27.358458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:27.358488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:27.358584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:27.359020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1061 partition: 0 MaxSeqNo: 46 sessionId: src_id|31e2545b-e1c896b5-325f79bf-d4549551_0
2025-10-15T11:02:27.361656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b1491a-e41351ff-52079dd4-609ca55a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|31e2545b-e1c896b5-325f79bf-d4549551_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:27.416379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2545b-e1c896b5-325f79bf-d4549551_0] Write session: try to update token
2025-10-15T11:02:27.416446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2545b-e1c896b5-325f79bf-d4549551_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:27.565214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:27.565245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:27.565256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:27.565361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:27.565373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:27.565385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:27.565394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:27.565422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402228318892913:9811]
2025-10-15T11:02:27.565445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402228318892913:9811]
2025-10-15T11:02:27.565468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402228318892913:9811]
2025-10-15T11:02:27.567471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:27.567504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:27.567530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:27.581870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:27.587504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:27.597638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:27.643011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId: src_id|31e2545b-e1c896b5-325f79bf-d4549551_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:27.668154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:27.741550Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:27.743799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:27.743834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:27.743884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402228318892913:9811]
2025-10-15T11:02:27.744065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:27.744102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:27.752275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:27.752429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:27.752603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402225519203645:5602]
2025-10-15T11:02:27.752683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:27.752701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:27.753238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:27.763417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1061 reason: error at write: Disconnected sessionId: src_id|31e2545b-e1c896b5-325f79bf-d4549551_0
2025-10-15T11:02:27.763741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1061 sessionId: src_id|31e2545b-e1c896b5-325f79bf-d4549551_0 is DEAD
2025-10-15T11:02:27.768051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2545b-e1c896b5-325f79bf-d4549551_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:27.768085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2545b-e1c896b5-325f79bf-d4549551_0] Write session will restart in 0.005616s
2025-10-15T11:02:27.768181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2545b-e1c896b5-325f79bf-d4549551_0] Write session: Do CDS request
2025-10-15T11:02:27.768208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2545b-e1c896b5-325f79bf-d4549551_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:27.782074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:27.782116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1062
2025-10-15T11:02:27.783043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2545b-e1c896b5-325f79bf-d4549551_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:27.783774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:27.783910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:27.783926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:27.783940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:27.786477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1062 sessionId:  describe result for acl check
2025-10-15T11:02:27.786619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:27.786654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:27.786669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:27.786700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402225519203678:4601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:27.789642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402225519203678:4601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:27.795409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402225519203678:4601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:27.808993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402225519203678:4601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:27.809033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402225519203678:4601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:27.809051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402225519203678:4601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:27.809079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:27.852241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:27.852618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402225519203800:5602]
2025-10-15T11:02:27.857272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:27.858188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:27.858221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:27.858269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:27.858577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:27.858785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402228318893096:9824]
2025-10-15T11:02:27.861181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:27.862628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:27.862871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:27.864281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:27.864637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:27.864647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:27.864656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:27.864663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:27.864671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:27.864679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:27.864688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:27.864695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:27.864704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:27.864712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:27.864719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:27.864725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.864732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.864740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.864794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:27.864940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:27.864996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:27.865048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:27.865101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:27.865157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:27.865210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:27.865263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:27.865321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:27.865376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:27.865429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:27.865482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.865531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.865582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.865635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:27.865711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:27.865777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:27.865842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:27.865896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:27.865958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:27.866008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:27.866068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:27.866126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:27.866188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:27.866242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:27.866305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:27.866361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:27.866421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:27.866472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:27.866547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:27.866605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:27.866668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:27.866719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:27.866780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:27.866834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:27.866895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:27.866946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.867010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.867062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.867121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.867173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.867236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.869186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:27.887193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:27.898776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:27.898831Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:27.898850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:27.898871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:27.898899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1061 [2:7561402228318893096:9824]
2025-10-15T11:02:27.898954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:27.899021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:27.899037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:27.899050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:27.899062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:27.899111Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:27.899136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:27.899159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:27.901883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1061, pipe: [1:7561402225519203800:5602]
2025-10-15T11:02:27.901971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1061
2025-10-15T11:02:27.902018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1061
2025-10-15T11:02:27.900665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.900688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.900703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.900715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:27.900992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:27.901018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:27.901176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:27.901383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:27.901631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:27.901710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402225519203800:5602], now have 1 active actors on pipe
2025-10-15T11:02:27.901735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402225519203724:4601], now have 1 active actors on pipe
2025-10-15T11:02:27.901758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402225519203665:2467], now have 1 active actors on pipe
2025-10-15T11:02:27.901784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402228318893090:9824]
2025-10-15T11:02:27.901798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402228318893090:9824]
2025-10-15T11:02:27.901812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402228318893090:9824]
2025-10-15T11:02:27.901852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:27.901901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:27.901917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:27.901926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:27.901929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:27.902107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:27.902125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:27.902244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402228318893090:9824]
2025-10-15T11:02:27.902272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:27.902324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:27.903233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:27.903262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:27.903375Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:27.903410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:27.903429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:27.903440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:27.903481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:27.903529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:27.903590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:27.904883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:27.904912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:27.904985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:27.905334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1062 partition: 0 MaxSeqNo: 46 sessionId: src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0
2025-10-15T11:02:27.906162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e2545b-e1c896b5-325f79bf-d4549551_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:27.979369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0] Write session: try to update token
2025-10-15T11:02:27.979426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:27.999595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:27.999626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:27.999644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:28.143890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:28.143922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:28.143934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:28.143944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:28.143975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402228318893090:9824]
2025-10-15T11:02:28.143999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402228318893090:9824]
2025-10-15T11:02:28.144022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402228318893090:9824]
2025-10-15T11:02:28.144165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:28.144176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:28.144187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:28.144276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:28.144293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:28.145230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:28.146750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:28.146780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:28.146803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:28.199453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId: src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:28.230449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:28.298486Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:28.322242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:28.322284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:28.322348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:28.322361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:28.322400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402228318893090:9824]
2025-10-15T11:02:28.322738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:28.323661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:28.325887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402225519203800:5602]
2025-10-15T11:02:28.326001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:28.340826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:28.340889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0] Write session will restart in 0.005927s
2025-10-15T11:02:28.341045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0] Write session: Do CDS request
2025-10-15T11:02:28.341107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:28.339925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:28.340076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1062 reason: status is not ok: tablet will be restarted right now sessionId: src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0
2025-10-15T11:02:28.340381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1062 sessionId: src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0 is DEAD
2025-10-15T11:02:28.368862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:28.371214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:28.371263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1063
2025-10-15T11:02:28.372589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:28.372730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:28.372747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:28.372757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:28.374167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1063 sessionId:  describe result for acl check
2025-10-15T11:02:28.374283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:28.374296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:28.374307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:28.374323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402229814171156:4570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:28.377876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402229814171156:4570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:28.397494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402229814171156:4570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:28.412637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402229814171156:4570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:28.412678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402229814171156:4570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:28.412695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402229814171156:4570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:28.412727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:28.423909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:28.427641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402229814171282:5602]
2025-10-15T11:02:28.425131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:28.425883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:28.425899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:28.425941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:28.426186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:28.426368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402232613860539:9827]
2025-10-15T11:02:28.428551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:28.429577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:28.429800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:28.431006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:28.431332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:28.431372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:28.431380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:28.431386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:28.431393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:28.431399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:28.431406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:28.431414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:28.431420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:28.431426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:28.431433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:28.431440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.431447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.431454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.431501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:28.431626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:28.431674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:28.431722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:28.431767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:28.431813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:28.431857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:28.431901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:28.431948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:28.431993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:28.432041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:28.432089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.432131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.432176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.432221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:28.432287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:28.432348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:28.432403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:28.432455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:28.432511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:28.432554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:28.432609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:28.432660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:28.432718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:28.432763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:28.432817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:28.432864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:28.432919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:28.432966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:28.433018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:28.433066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:28.433117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:28.433162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:28.433216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:28.433261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:28.433314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:28.433359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.433412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.433459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.433512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.433555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.433609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.434105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:28.459069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:28.470153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:28.470197Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:28.470215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:28.470234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:28.470258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1062 [2:7561402232613860539:9827]
2025-10-15T11:02:28.470309Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:28.470368Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:28.470382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:28.470395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:28.470406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:28.470453Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:28.470474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:28.470507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:28.490989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.491016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.491027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.491038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:28.491297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:28.491320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.492021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1062, pipe: [1:7561402229814171282:5602]
2025-10-15T11:02:28.492124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1062
2025-10-15T11:02:28.492633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.492199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1062
2025-10-15T11:02:28.492813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.493025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:28.493114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402229814171282:5602], now have 1 active actors on pipe
2025-10-15T11:02:28.493139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402229814171145:2467], now have 1 active actors on pipe
2025-10-15T11:02:28.493161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402229814171277:4570], now have 1 active actors on pipe
2025-10-15T11:02:28.493204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:28.493225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:28.493273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402232613860534:9827]
2025-10-15T11:02:28.493287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402232613860534:9827]
2025-10-15T11:02:28.493299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402232613860534:9827]
2025-10-15T11:02:28.493334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:28.493402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:28.493567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:28.493583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:28.493636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:28.493662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:28.493678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:28.493689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:28.493720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:28.493758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:28.493876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402232613860534:9827]
2025-10-15T11:02:28.493895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:28.493935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:28.494101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:28.494115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:28.494127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:28.494152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:28.496269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:28.496302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:28.496370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:28.497362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422781c3-7e12eba9-c5cc59e8-404ed60c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:28.496656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1063 partition: 0 MaxSeqNo: 46 sessionId: src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0
2025-10-15T11:02:28.530986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0] Write session: try to update token
2025-10-15T11:02:28.531046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:28.632854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:28.632881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:28.632891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:28.632951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:28.632964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:28.632978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:28.632986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:28.633015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402232613860534:9827]
2025-10-15T11:02:28.633039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402232613860534:9827]
2025-10-15T11:02:28.633061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402232613860534:9827]
2025-10-15T11:02:28.633186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:28.633204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:28.634237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:28.637753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:28.637798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:28.637828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:28.731145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId: src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:28.758017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:28.809611Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:28.815833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:28.815883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:28.819954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402229814171282:5602]
2025-10-15T11:02:28.820023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:28.820121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:28.820131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:28.820766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:28.864196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:28.864263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0] Write session will restart in 0.006018s
2025-10-15T11:02:28.864418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0] Write session: Do CDS request
2025-10-15T11:02:28.864473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:28.863419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1063 reason: error at write: Disconnected sessionId: src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0
2025-10-15T11:02:28.863741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1063 sessionId: src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0 is DEAD
2025-10-15T11:02:28.874619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:28.874652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1064
2025-10-15T11:02:28.881029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:28.881582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:28.881715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:28.881731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:28.881740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:28.882938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1064 sessionId:  describe result for acl check
2025-10-15T11:02:28.883030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:28.883040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:28.883050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:28.883065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402229814171326:4553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:28.885205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402229814171326:4553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:28.894527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402229814171326:4553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:28.902450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402229814171326:4553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:28.902501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402229814171326:4553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:28.902517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402229814171326:4553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:28.902547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:28.919684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402229814171447:5602]
2025-10-15T11:02:28.927466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:28.933079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:28.933978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:28.934008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:28.934053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:28.934327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:28.934535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402232613860719:9838]
2025-10-15T11:02:28.936764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:28.937827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:28.938082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:28.939566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:28.939907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:28.939916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:28.939923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:28.939930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:28.939937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:28.939945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:28.939952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:28.939959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:28.939966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:28.939974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:28.939982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:28.939989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.939995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.940002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.940050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:28.940169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:28.940220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:28.940278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:28.940324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:28.940376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:28.940422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:28.940469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:28.940516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:28.940566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:28.940614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:28.940662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.940711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.940757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.940801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:28.940873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:28.940945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:28.941010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:28.941059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:28.941115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:28.941166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:28.941223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:28.941272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:28.941329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:28.941377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:28.941434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:28.941485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:28.941540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:28.941588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:28.941644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:28.941694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:28.941745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:28.941791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:28.941850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:28.941902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:28.941957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:28.942009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.942065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:28.942111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.942170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:28.942218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.942274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:28.943423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:28.989320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:28.999797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:28.999847Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:28.999866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:28.999887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:28.999913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1063 [2:7561402232613860719:9838]
2025-10-15T11:02:28.999968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:29.000033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:29.000047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:29.000061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:29.000074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:29.000127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:29.000151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:29.000175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:29.010614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:29.010646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:29.010662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:29.010673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:29.010952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:29.010969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:29.011120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:29.011317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:29.011523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1063
2025-10-15T11:02:29.011613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1063
2025-10-15T11:02:29.011637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1063, pipe: [1:7561402229814171447:5602]
2025-10-15T11:02:29.011863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:29.011965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402229814171373:4553], now have 1 active actors on pipe
2025-10-15T11:02:29.011992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402229814171447:5602], now have 1 active actors on pipe
2025-10-15T11:02:29.012017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402229814171311:2467], now have 1 active actors on pipe
2025-10-15T11:02:29.012046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402232613860714:9838]
2025-10-15T11:02:29.012061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402232613860714:9838]
2025-10-15T11:02:29.012075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402232613860714:9838]
2025-10-15T11:02:29.012117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:29.012146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:29.012161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:29.012173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:29.012196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:29.012376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:29.012394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:29.012452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:29.012475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:29.012616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402232613860714:9838]
2025-10-15T11:02:29.012647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:29.012688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:29.012721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:29.012754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:29.012771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:29.012782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:29.012821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:29.012867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:29.013040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:29.013953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:29.013982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:29.014050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:29.016858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1064 partition: 0 MaxSeqNo: 46 sessionId: src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0
2025-10-15T11:02:29.017691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07dee8a-9e4741b1-d80ba45f-47e303d7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:29.043384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0] Write session: try to update token
2025-10-15T11:02:29.043453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:29.186932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:29.186965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:29.186976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:29.187042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:29.187060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:29.187078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:29.187090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:29.187126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402232613860714:9838]
2025-10-15T11:02:29.191491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402232613860714:9838]
2025-10-15T11:02:29.191578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402232613860714:9838]
2025-10-15T11:02:29.191685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:29.191716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:29.191734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:29.191822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:29.191853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:29.192813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:29.209475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId: src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:29.237111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:29.344498Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:29.364723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:29.364773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:29.364843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:29.364857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:29.364897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402232613860714:9838]
2025-10-15T11:02:29.365260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:29.366505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:29.366040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:29.366072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:29.367563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402229814171447:5602]
2025-10-15T11:02:29.367682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:29.376892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:29.376958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0] Write session will restart in 0.006321s
2025-10-15T11:02:29.377148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0] Write session: Do CDS request
2025-10-15T11:02:29.377207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:29.375957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1064 reason: error at write: Disconnected sessionId: src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0
2025-10-15T11:02:29.376302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1064 sessionId: src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0 is DEAD
2025-10-15T11:02:29.395982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:29.396017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1065
2025-10-15T11:02:29.400139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:29.403499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:29.403670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:29.403701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:29.403713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:29.405272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1065 sessionId:  describe result for acl check
2025-10-15T11:02:29.405506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:29.405537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:29.405554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:29.405600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402234109138794:4537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:29.415893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402234109138794:4537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:29.446072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402234109138794:4537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:29.460695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402234109138794:4537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:29.460747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402234109138794:4537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:29.460767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402234109138794:4537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:29.460800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:29.465315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402234109138921:5602]
2025-10-15T11:02:29.478829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:29.484935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:29.485872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:29.485908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:29.485956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:29.486240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:29.486464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402236908828181:9846]
2025-10-15T11:02:29.489146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:29.490334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:29.490609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:29.492004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:29.492358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:29.492368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:29.492375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:29.492383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:29.492391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:29.492400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:29.492408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:29.492415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:29.492423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:29.492431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:29.492439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:29.492446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:29.492452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:29.492460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:29.492512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:29.492634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:29.492686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:29.492738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:29.492789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:29.492843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:29.492896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:29.492947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:29.492998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:29.493047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:29.493096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:29.493145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:29.493193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:29.493243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:29.493292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:29.493367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:29.493433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:29.493493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:29.493548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:29.493608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:29.493655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:29.493715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:29.493768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:29.493827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:29.493876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:29.493939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:29.493989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:29.494049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:29.494099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:29.494157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:29.494212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:29.494270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:29.494319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:29.494376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:29.494430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:29.494506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:29.494556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:29.494616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:29.494670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:29.494724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:29.494770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:29.494828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:29.496769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:29.529114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:29.541055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:29.541347Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:29.541371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:29.541391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:29.541427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1064 [2:7561402236908828181:9846]
2025-10-15T11:02:29.541481Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:29.541541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:29.541555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:29.541568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:29.541580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:29.541634Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:29.541658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:29.541689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:29.580480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:29.580507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:29.580516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:29.580525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:29.580785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:29.580807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:29.580935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:29.581097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1064, pipe: [1:7561402234109138921:5602]
2025-10-15T11:02:29.581106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:29.581250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1064
2025-10-15T11:02:29.581310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:29.581343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1064
2025-10-15T11:02:29.581396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402234109138921:5602], now have 1 active actors on pipe
2025-10-15T11:02:29.581428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402234109138906:4537], now have 1 active actors on pipe
2025-10-15T11:02:29.581446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402234109138779:2467], now have 1 active actors on pipe
2025-10-15T11:02:29.581472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402236908828176:9846]
2025-10-15T11:02:29.581486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402236908828176:9846]
2025-10-15T11:02:29.581499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402236908828176:9846]
2025-10-15T11:02:29.581538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:29.581592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:29.581606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:29.581610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:29.581615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:29.581782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:29.581806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:29.581949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:29.581975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:29.582022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402236908828176:9846]
2025-10-15T11:02:29.582046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:29.582085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:29.582158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:29.582194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:29.582215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:29.582233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:29.582281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:29.582338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:29.582423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:29.582945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:29.582975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:29.583054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:29.583356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1065 partition: 0 MaxSeqNo: 46 sessionId: src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0
2025-10-15T11:02:29.587741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4d2b7f8-7ee73ef2-8d32a3e1-385011ed_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:29.631335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0] Write session: try to update token
2025-10-15T11:02:29.635578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:29.683228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:29.683262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:29.683274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:29.683337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:29.687626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:29.687695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:29.687720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:29.687778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402236908828176:9846]
2025-10-15T11:02:29.687822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402236908828176:9846]
2025-10-15T11:02:29.687871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402236908828176:9846]
2025-10-15T11:02:29.688114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:29.688158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:29.688317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:29.688341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:29.688361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:29.689486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:29.767117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId: src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:29.789248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:29.861951Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:29.863987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:29.864021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:29.875555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402234109138921:5602]
2025-10-15T11:02:29.875680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:29.875692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:29.886448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:29.918083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:29.918231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1065 reason: error at write: Disconnected sessionId: src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0
2025-10-15T11:02:29.918571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1065 sessionId: src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0 is DEAD
2025-10-15T11:02:29.919897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:29.919930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0] Write session will restart in 0.005300s
2025-10-15T11:02:29.920029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0] Write session: Do CDS request
2025-10-15T11:02:29.920057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:29.932609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:29.949668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:29.949704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1066
2025-10-15T11:02:29.955692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:29.955849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:29.955866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:29.955877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:29.960617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1066 sessionId:  describe result for acl check
2025-10-15T11:02:29.960748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:29.960760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:29.960771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:29.960787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402234109139042:4503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:29.963880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402234109139042:4503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:29.976241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402234109139073:5602]
2025-10-15T11:02:29.982634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402234109139042:4503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:29.989723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:29.995491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:29.996370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:29.996390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:29.996431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:29.996700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:29.996886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402236908828341:9849]
2025-10-15T11:02:29.999139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:30.003771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:30.004042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:30.005377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:30.005762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:30.005770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:30.005777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:30.005785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:30.005791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:30.005799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:30.005806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:30.005812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:30.005818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:30.005826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:30.005832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:30.005839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.005846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.005853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.005901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:30.006011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:30.006060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:30.006107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:30.006155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:30.006200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:30.006243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:30.006289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:30.006333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:30.006379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:30.006440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:30.006487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.006532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.006576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.006622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:30.006687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:30.006744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:30.006800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:30.006850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:30.006903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:30.006949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:30.007001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:30.007050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:30.007105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:30.007149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:30.007200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:30.007247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:30.007300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:30.007343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:30.012929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:30.013002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:30.013062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:30.013114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:30.013173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:30.013221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:30.013277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:30.013324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.013379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.013449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.013505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.013549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.013605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.014138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:30.022141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402234109139042:4503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:30.022188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402234109139042:4503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:30.022206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402234109139042:4503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:30.022240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:30.081284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:30.091751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:30.091800Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:30.091822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:30.091843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:30.091872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1065 [2:7561402236908828341:9849]
2025-10-15T11:02:30.091929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:30.091998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:30.092014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:30.092029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:30.092041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:30.092097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:30.092123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:30.092148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:30.093649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.093667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.093684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.093696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:30.093978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:30.093997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.094160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.094389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.094669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:30.094762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402234109139073:5602], now have 1 active actors on pipe
2025-10-15T11:02:30.094790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402234109138964:2467], now have 1 active actors on pipe
2025-10-15T11:02:30.094814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402238404106394:4503], now have 1 active actors on pipe
2025-10-15T11:02:30.094841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402236908828336:9849]
2025-10-15T11:02:30.094860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402236908828336:9849]
2025-10-15T11:02:30.094875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402236908828336:9849]
2025-10-15T11:02:30.094917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:30.094999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:30.095201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:30.095221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:30.095454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:30.095467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:30.095480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:30.096068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402236908828336:9849]
2025-10-15T11:02:30.096109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:30.096355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:30.097576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1065, pipe: [1:7561402234109139073:5602]
2025-10-15T11:02:30.097672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1065
2025-10-15T11:02:30.097738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1065
2025-10-15T11:02:30.099435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:30.099479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:30.099592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:30.099631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:30.099650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:30.099662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:30.099712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:30.099770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:30.099830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:30.102782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:30.102817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:30.102903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:30.103846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1066 partition: 0 MaxSeqNo: 46 sessionId: src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0
2025-10-15T11:02:30.105608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbf39b9-6ec95567-9a91cf1b-2373360f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:30.175671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0] Write session: try to update token
2025-10-15T11:02:30.175729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:30.250830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:30.263423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:30.263455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:30.263545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:30.263564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:30.263579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:30.263593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:30.263629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402236908828336:9849]
2025-10-15T11:02:30.263654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402236908828336:9849]
2025-10-15T11:02:30.263680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402236908828336:9849]
2025-10-15T11:02:30.263964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:30.264016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:30.264174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:30.264204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:30.264236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:30.269114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:30.333423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId: src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:30.359250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:30.455021Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:30.482565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:30.482612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:30.482668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:30.482680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:30.482720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402236908828336:9849]
2025-10-15T11:02:30.483253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:30.484292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:30.484100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:30.484236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:30.484252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:30.484274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402234109139073:5602]
2025-10-15T11:02:30.495934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1066 reason: error at write: Disconnected sessionId: src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0
2025-10-15T11:02:30.496334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1066 sessionId: src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0 is DEAD
2025-10-15T11:02:30.499642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:30.499706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0] Write session will restart in 0.008929s
2025-10-15T11:02:30.499855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0] Write session: Do CDS request
2025-10-15T11:02:30.499900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:30.513876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:30.516248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:30.516284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1067
2025-10-15T11:02:30.516752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:30.516883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:30.516901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:30.516913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:30.518573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1067 sessionId:  describe result for acl check
2025-10-15T11:02:30.518726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:30.518738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:30.518748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:30.518767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402238404106450:4483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:30.523172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402238404106450:4483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:30.535494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402238404106450:4483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:30.549208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402238404106450:4483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:30.549249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402238404106450:4483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:30.549266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402238404106450:4483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:30.549298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:30.590268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402238404106520:5602]
2025-10-15T11:02:30.650949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:30.652804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:30.653819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:30.653841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:30.653891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:30.654194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:30.654394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402241203795810:9860]
2025-10-15T11:02:30.656751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:30.658190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:30.658438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:30.659825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:30.660192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:30.660203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:30.660210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:30.660218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:30.660226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:30.660234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:30.660241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:30.660250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:30.660257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:30.660264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:30.660273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:30.660280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.660288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.660295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.660349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:30.660470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:30.660522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:30.660584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:30.660634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:30.660686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:30.660738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:30.660790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:30.660838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:30.660908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:30.660959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:30.661011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.661064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.661114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.661160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:30.661235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:30.661301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:30.661359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:30.661411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:30.661469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:30.661519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:30.661574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:30.661626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:30.661685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:30.661736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:30.661792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:30.661843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:30.661900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:30.661950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:30.662008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:30.662060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:30.662116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:30.662163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:30.662223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:30.662270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:30.662328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:30.662388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.662449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.662502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.662557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.662608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.662666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.663219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:30.700134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:30.711119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:30.711175Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:30.711195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:30.711217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:30.711245Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1066 [2:7561402241203795810:9860]
2025-10-15T11:02:30.711301Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:30.711620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:30.711641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:30.711655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:30.711667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:30.711736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:30.711764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:30.711788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:30.713670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.713690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.713705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.713717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:30.714008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:30.714026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:30.714186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:30.714409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:30.714667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:30.714749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402241203795805:9860]
2025-10-15T11:02:30.714765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402241203795805:9860]
2025-10-15T11:02:30.714780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402241203795805:9860]
2025-10-15T11:02:30.714816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:30.714902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:30.715099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:30.715120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:30.715262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402241203795805:9860]
2025-10-15T11:02:30.715285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:30.718501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1066
2025-10-15T11:02:30.718609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1066
2025-10-15T11:02:30.718694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1066, pipe: [1:7561402238404106520:5602]
2025-10-15T11:02:30.716402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:30.716425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:30.716436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:30.716463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:30.723572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402238404106483:4483], now have 1 active actors on pipe
2025-10-15T11:02:30.723613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402238404106439:2467], now have 1 active actors on pipe
2025-10-15T11:02:30.723640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402238404106520:5602], now have 1 active actors on pipe
2025-10-15T11:02:30.723696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:30.723720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:30.723864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a900a797-f088bb99-3ea29d54-f650cf18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:30.723903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:30.723922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:30.723935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:30.723975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:30.724021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:30.724075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:30.725630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:30.725661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:30.725740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:30.726117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1067 partition: 0 MaxSeqNo: 46 sessionId: src_id|a900a797-f088bb99-3ea29d54-f650cf18_0
2025-10-15T11:02:30.727082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaa984b5-6bb06404-d3ecc322-3b1f6cac_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a900a797-f088bb99-3ea29d54-f650cf18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:30.779929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a900a797-f088bb99-3ea29d54-f650cf18_0] Write session: try to update token
2025-10-15T11:02:30.779985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a900a797-f088bb99-3ea29d54-f650cf18_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:30.868081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:30.868112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:30.868125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:30.868254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:30.868270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:30.868284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:30.868296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:30.868332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402241203795805:9860]
2025-10-15T11:02:30.868360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402241203795805:9860]
2025-10-15T11:02:30.868385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402241203795805:9860]
2025-10-15T11:02:30.868501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:30.868533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:30.868561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:30.910845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:30.910892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:30.912028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:30.931468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId: src_id|a900a797-f088bb99-3ea29d54-f650cf18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:30.984950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:31.080362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:31.081759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:31.081779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:31.081831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402241203795805:9860]
2025-10-15T11:02:31.081948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:31.082000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:31.082031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:31.082947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:31.086098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:31.091401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:31.091537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402238404106520:5602]
2025-10-15T11:02:31.105144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a900a797-f088bb99-3ea29d54-f650cf18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:31.105234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a900a797-f088bb99-3ea29d54-f650cf18_0] Write session will restart in 0.009701s
2025-10-15T11:02:31.105456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a900a797-f088bb99-3ea29d54-f650cf18_0] Write session: Do CDS request
2025-10-15T11:02:31.105510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a900a797-f088bb99-3ea29d54-f650cf18_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:31.104159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1067 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a900a797-f088bb99-3ea29d54-f650cf18_0
2025-10-15T11:02:31.104451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1067 sessionId: src_id|a900a797-f088bb99-3ea29d54-f650cf18_0 is DEAD
2025-10-15T11:02:31.124890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a900a797-f088bb99-3ea29d54-f650cf18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:31.125971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:31.125999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1068
2025-10-15T11:02:31.131563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:31.131731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:31.131748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:31.131760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:31.133336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1068 sessionId:  describe result for acl check
2025-10-15T11:02:31.133459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:31.133471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:31.133481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:31.133500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402242699073914:4471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:31.138296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402242699073914:4471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:31.161002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402242699073914:4471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:31.181756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402242699073914:4471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:31.181793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402242699073914:4471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:31.181805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402242699073914:4471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:31.181830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:31.190800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402242699073982:5602]
2025-10-15T11:02:31.247746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:31.253486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:31.254286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:31.254302Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:31.254357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:31.254605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:31.254766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402245498763287:9868]
2025-10-15T11:02:31.257164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:31.258364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:31.258569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:31.259748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:31.260052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:31.260058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:31.260065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:31.260072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:31.260079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:31.260086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:31.260094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:31.260100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:31.260106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:31.260113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:31.260121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:31.260128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.260136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.260141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.260188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:31.260296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:31.260344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:31.260391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:31.260437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:31.260484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:31.260528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:31.260591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:31.260638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:31.260686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:31.260730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:31.260772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.260816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.260860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.260901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:31.260965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:31.261018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:31.261069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:31.261115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:31.261165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:31.261210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:31.261261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:31.261310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:31.261364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:31.261405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:31.261463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:31.261508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:31.261555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:31.261599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:31.261652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:31.261698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:31.261751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:31.261796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:31.261846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:31.261888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:31.261937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:31.261982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.262030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.262071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.262121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.262165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.262213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.262718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:31.286445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:31.297501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:31.297542Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:31.297559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:31.297580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:31.297602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1067 [2:7561402245498763287:9868]
2025-10-15T11:02:31.297650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:31.297708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:31.297722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:31.297734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:31.297745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:31.297789Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:31.297812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:31.297834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:31.299561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.299577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.299591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.299602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:31.299869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:31.299887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.300021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.300203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.300438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:31.300498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402245498763282:9868]
2025-10-15T11:02:31.300512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402245498763282:9868]
2025-10-15T11:02:31.300523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402245498763282:9868]
2025-10-15T11:02:31.300563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:31.300630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:31.300798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:31.300814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:31.300925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402245498763282:9868]
2025-10-15T11:02:31.300942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:31.302835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1067
2025-10-15T11:02:31.302934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1067
2025-10-15T11:02:31.303007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1067, pipe: [1:7561402242699073982:5602]
2025-10-15T11:02:31.301798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:31.301816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:31.301827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:31.301847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:31.311397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402242699073953:4471], now have 1 active actors on pipe
2025-10-15T11:02:31.311439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402242699073904:2467], now have 1 active actors on pipe
2025-10-15T11:02:31.311463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402242699073982:5602], now have 1 active actors on pipe
2025-10-15T11:02:31.311521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:31.311542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:31.311633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:31.311667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:31.311684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:31.311695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:31.311729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:31.311772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:31.311817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:31.319026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:31.319060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:31.319137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:31.323717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1068 partition: 0 MaxSeqNo: 46 sessionId: src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0
2025-10-15T11:02:31.327588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a900a797-f088bb99-3ea29d54-f650cf18_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:31.374808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0] Write session: try to update token
2025-10-15T11:02:31.374865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:31.398967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:31.398993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:31.399004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:31.481598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:31.481633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:31.481645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:31.481657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:31.481690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402245498763282:9868]
2025-10-15T11:02:31.481717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402245498763282:9868]
2025-10-15T11:02:31.481742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402245498763282:9868]
2025-10-15T11:02:31.481888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:31.481920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:31.483291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:31.483336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:31.483380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:31.528658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:31.594275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId: src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:31.619864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:31.713818Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:31.715294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:31.715321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:31.718610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:31.718640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:31.718077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:31.720419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:31.720656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402242699073982:5602]
2025-10-15T11:02:31.745151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1068 reason: error at write: Disconnected sessionId: src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0
2025-10-15T11:02:31.750399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:31.750435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0] Write session will restart in 0.005761s
2025-10-15T11:02:31.750524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0] Write session: Do CDS request
2025-10-15T11:02:31.750551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:31.745598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1068 sessionId: src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0 is DEAD
2025-10-15T11:02:31.760261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:31.760531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:31.760298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1069
2025-10-15T11:02:31.763970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:31.764162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:31.764180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:31.764191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:31.765971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1069 sessionId:  describe result for acl check
2025-10-15T11:02:31.766107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:31.766118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:31.766130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:31.766149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402242699074124:4449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:31.769131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402242699074124:4449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:31.777171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402242699074124:4449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:31.791987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402242699074124:4449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:31.792029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402242699074124:4449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:31.792046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402242699074124:4449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:31.792076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:31.823615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402242699074253:5602]
2025-10-15T11:02:31.822800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:31.825505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:31.826464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:31.826484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:31.826531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:31.826807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:31.827004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402245498763463:9873]
2025-10-15T11:02:31.829297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:31.830443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:31.830689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:31.832037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:31.832422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:31.832430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:31.832438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:31.832445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:31.832450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:31.832457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:31.832463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:31.832470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:31.832477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:31.832483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:31.832489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:31.832496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.832502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.832508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.832554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:31.832656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:31.832705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:31.832750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:31.832791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:31.832834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:31.832876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:31.832919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:31.832965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:31.833009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:31.833053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:31.833093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.833137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.833181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.833221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:31.833284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:31.833339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:31.833389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:31.833434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:31.833484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:31.833528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:31.833578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:31.833624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:31.833671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:31.833715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:31.833765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:31.833809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:31.833859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:31.833900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:31.833953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:31.833998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:31.834048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:31.834089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:31.834618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:31.834682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:31.834737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:31.834783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.834833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.834879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.834926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.834967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.835014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.835537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:31.856918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:31.866115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:31.866158Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:31.866174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:31.866192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:31.866218Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1068 [2:7561402245498763463:9873]
2025-10-15T11:02:31.866269Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:31.866344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:31.866359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:31.866371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:31.866386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:31.866434Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:31.866453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:31.866473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:31.868262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.868282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.868290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.868298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:31.868545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:31.868560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:31.868691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:31.868872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:31.869091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:31.869450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402242699074110:2467], now have 1 active actors on pipe
2025-10-15T11:02:31.869480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402242699074253:5602], now have 1 active actors on pipe
2025-10-15T11:02:31.869501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402242699074196:4449], now have 1 active actors on pipe
2025-10-15T11:02:31.869525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402245498763457:9873]
2025-10-15T11:02:31.869538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402245498763457:9873]
2025-10-15T11:02:31.869550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402245498763457:9873]
2025-10-15T11:02:31.869583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:31.869653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:31.869817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:31.869833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:31.869948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402245498763457:9873]
2025-10-15T11:02:31.869967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:31.870296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:31.870331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:31.870344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:31.870365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:31.871008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:31.871035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:31.869401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1068
2025-10-15T11:02:31.871103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:31.871129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:31.869490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1068, pipe: [1:7561402242699074253:5602]
2025-10-15T11:02:31.871146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:31.869558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1068
2025-10-15T11:02:31.871156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:31.871188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:31.871227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:31.871269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:31.872421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:31.872446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:31.872505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:31.875483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1069 partition: 0 MaxSeqNo: 46 sessionId: src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0
2025-10-15T11:02:31.879700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|180c0160-c96a0ea7-1aa2bebd-8ec489ac_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:31.939840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0] Write session: try to update token
2025-10-15T11:02:31.939901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:31.968833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:31.968872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:31.968919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402245498763457:9873]
2025-10-15T11:02:31.969057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:31.969071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:31.969084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:31.969156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:31.969616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:31.972013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:31.983897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:31.995865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:32.006233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:32.007873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:32.008318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:32.123464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId: src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:32.137824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:32.137858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:32.137869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:32.137924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:32.137938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:32.137952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:32.137962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:32.137999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402245498763457:9873]
2025-10-15T11:02:32.138028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402245498763457:9873]
2025-10-15T11:02:32.138051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402245498763457:9873]
2025-10-15T11:02:32.138192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:32.138212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:32.138233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:32.138296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:32.138334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:32.139210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:32.176529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:32.312067Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:32.314117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:32.314154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:32.316360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402242699074253:5602]
2025-10-15T11:02:32.316442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:32.316454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:32.317753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:32.320703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:32.331999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1069 reason: error at write: Disconnected sessionId: src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0
2025-10-15T11:02:32.332296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1069 sessionId: src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0 is DEAD
2025-10-15T11:02:32.335810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:32.335840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0] Write session will restart in 0.007993s
2025-10-15T11:02:32.335926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0] Write session: Do CDS request
2025-10-15T11:02:32.335969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:32.355913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:32.355941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1070
2025-10-15T11:02:32.360497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:32.363068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:32.363198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:32.363213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:32.363222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:32.364532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1070 sessionId:  describe result for acl check
2025-10-15T11:02:32.364635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:32.364645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:32.364653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:32.364669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402246994041600:4431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:32.367148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402246994041600:4431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:32.375169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402246994041600:4431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:32.393752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402246994041600:4431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:32.393795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402246994041600:4431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:32.393813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402246994041600:4431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:32.393843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:32.418571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402246994041704:5602]
2025-10-15T11:02:32.444262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:32.463570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:32.464578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:32.464600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:32.464648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:32.464933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:32.465122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402249793730944:9883]
2025-10-15T11:02:32.467745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:32.472120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:32.472643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:32.474006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:32.474382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:32.474391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:32.474399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:32.474407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:32.474415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:32.474422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:32.474431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:32.474439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:32.474447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:32.474455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:32.474463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:32.474471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:32.474479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:32.474488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:32.474544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:32.474670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:32.474723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:32.474774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:32.474824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:32.474878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:32.474932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:32.474985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:32.475038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:32.475088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:32.475141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:32.475192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:32.475241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:32.475296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:32.475986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:32.476083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:32.476156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:32.476223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:32.476281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:32.476341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:32.476390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:32.476452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:32.476503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:32.476562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:32.476614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:32.476675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:32.476728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:32.476785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:32.476837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:32.476894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:32.476949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:32.477009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:32.477059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:32.477117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:32.477172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:32.477234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:32.477283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:32.477344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:32.477395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:32.477453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:32.477502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:32.477562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:32.478124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:32.502885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:32.512948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:32.512997Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:32.513016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:32.513039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:32.513065Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1069 [2:7561402249793730944:9883]
2025-10-15T11:02:32.513126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:32.513193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:32.513211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:32.513226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:32.513240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:32.513294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:32.513317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:32.513342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:32.514463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:32.514481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:32.514496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:32.514507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:32.514793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:32.514813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:32.514985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:32.515201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:32.516076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:32.516173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402246994041584:2467], now have 1 active actors on pipe
2025-10-15T11:02:32.516201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402246994041658:4431], now have 1 active actors on pipe
2025-10-15T11:02:32.516224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402246994041704:5602], now have 1 active actors on pipe
2025-10-15T11:02:32.516253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402249793730938:9883]
2025-10-15T11:02:32.516277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402249793730938:9883]
2025-10-15T11:02:32.516292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402249793730938:9883]
2025-10-15T11:02:32.516337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:32.516411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:32.516419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:32.516426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:32.516438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:32.516639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:32.516656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:32.516783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402249793730938:9883]
2025-10-15T11:02:32.516811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:32.516841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:32.516894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:32.516916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:32.517075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:32.517108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:32.517125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:32.517137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:32.517176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:32.517221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:32.517289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:32.516313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1069
2025-10-15T11:02:32.516323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1069
2025-10-15T11:02:32.516401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1069, pipe: [1:7561402246994041704:5602]
2025-10-15T11:02:32.529255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:32.529302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:32.529399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:32.530773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ef07bb-9660c1a7-bf8614cc-63cddecb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:32.529883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1070 partition: 0 MaxSeqNo: 46 sessionId: src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0
2025-10-15T11:02:32.558166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0] Write session: try to update token
2025-10-15T11:02:32.558237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:32.614990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:32.615021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:32.615029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:32.712739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:32.712767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:32.712779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:32.712789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:32.712818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402249793730938:9883]
2025-10-15T11:02:32.712841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402249793730938:9883]
2025-10-15T11:02:32.712865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402249793730938:9883]
2025-10-15T11:02:32.713045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:32.713083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:32.713112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:32.747134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:32.747174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:32.748213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:32.754695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId: src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:32.801281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:32.938749Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:32.942350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:32.942376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:32.942415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402249793730938:9883]
2025-10-15T11:02:32.942542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:32.942564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:32.943009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:32.944166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:32.948549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402246994041704:5602]
2025-10-15T11:02:32.948730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:32.948940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:32.964927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1070 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0
2025-10-15T11:02:32.965442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1070 sessionId: src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0 is DEAD
2025-10-15T11:02:32.968138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:32.968181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0] Write session will restart in 0.007507s
2025-10-15T11:02:32.968286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0] Write session: Do CDS request
2025-10-15T11:02:32.968319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:32.994052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:33.011581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:33.011612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1071
2025-10-15T11:02:33.016725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:33.016835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:33.016850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:33.016860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:33.022450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1071 sessionId:  describe result for acl check
2025-10-15T11:02:33.022573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:33.022583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:33.022592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:33.022608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402251289009078:4419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:33.025146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402251289009078:4419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:33.037915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402251289009078:4419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:33.056399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402251289009176:5602]
2025-10-15T11:02:33.073317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402251289009078:4419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:33.073366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402251289009078:4419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:33.073383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402251289009078:4419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:33.073421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:33.082133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:33.088026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:33.088939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:33.088959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:33.089006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:33.089292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:33.089488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402254088698406:9891]
2025-10-15T11:02:33.092757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:33.093962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:33.094200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:33.095542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:33.095885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:33.095893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:33.095901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:33.095909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:33.095916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:33.095924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:33.095932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:33.095939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:33.095947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:33.095955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:33.095964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:33.095972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.095979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.095986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.096037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:33.096157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:33.096209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:33.096256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:33.096306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:33.096353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:33.096403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:33.096453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:33.096502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:33.096553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:33.096601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:33.096648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.096697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.096748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.096797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:33.096870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:33.096935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:33.096991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:33.097045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:33.097101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:33.097148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:33.097209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:33.097260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:33.097316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:33.097366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:33.097426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:33.097480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:33.097539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:33.097585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:33.097643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:33.097696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:33.097756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:33.097806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:33.097867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:33.097915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:33.097972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:33.098023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.098084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.098133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.098194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.098259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.099747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.100342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:33.125321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:33.168626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:33.168679Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:33.168699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:33.168719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:33.168749Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1070 [2:7561402254088698406:9891]
2025-10-15T11:02:33.168804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:33.168871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:33.168889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:33.168902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:33.168915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:33.168970Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:33.168995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:33.169023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:33.170025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.170043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.170059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.170071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:33.170364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:33.170384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.170549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.170756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.171006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:33.171086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402254088698401:9891]
2025-10-15T11:02:33.171102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402254088698401:9891]
2025-10-15T11:02:33.171118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402254088698401:9891]
2025-10-15T11:02:33.171165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:33.171246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:33.173524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1070
2025-10-15T11:02:33.173629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1070
2025-10-15T11:02:33.173694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1070, pipe: [1:7561402251289009176:5602]
2025-10-15T11:02:33.172243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:33.172264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:33.172277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:33.175374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:33.175405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:33.175585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402246994041763:2467], now have 1 active actors on pipe
2025-10-15T11:02:33.175612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402251289009202:4419], now have 1 active actors on pipe
2025-10-15T11:02:33.175638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402251289009176:5602], now have 1 active actors on pipe
2025-10-15T11:02:33.175708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:33.175732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:33.175775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402254088698401:9891]
2025-10-15T11:02:33.175813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:33.175959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:33.175995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:33.176016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:33.176027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:33.176067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:33.176117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:33.176212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:33.176691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:33.180480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:33.180519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:33.180606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:33.181049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1071 partition: 0 MaxSeqNo: 46 sessionId: src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0
2025-10-15T11:02:33.183578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bbcb061-f3ea9b3a-3152669a-ddb7b653_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:33.215083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0] Write session: try to update token
2025-10-15T11:02:33.215147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:33.323747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:33.323776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:33.323788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:33.323849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:33.323865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:33.323879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:33.323890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:33.323928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402254088698401:9891]
2025-10-15T11:02:33.323956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402254088698401:9891]
2025-10-15T11:02:33.323985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402254088698401:9891]
2025-10-15T11:02:33.324200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:33.324225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:33.325265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:33.327708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:33.327745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:33.327777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:33.390827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId: src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:33.412527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:33.485898Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:33.500898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:33.500940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:33.501008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:33.501021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:33.501058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402254088698401:9891]
2025-10-15T11:02:33.501449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:33.502502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:33.502528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:33.503169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402251289009176:5602]
2025-10-15T11:02:33.503308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:33.502050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:33.565582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1071 reason: error at write: Disconnected sessionId: src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0
2025-10-15T11:02:33.565901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1071 sessionId: src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0 is DEAD
2025-10-15T11:02:33.568076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:33.568111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0] Write session will restart in 0.006852s
2025-10-15T11:02:33.568209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0] Write session: Do CDS request
2025-10-15T11:02:33.568238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:33.582601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:33.584420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:33.584477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1072
2025-10-15T11:02:33.585321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:33.585534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:33.585554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:33.585566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:33.587625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1072 sessionId:  describe result for acl check
2025-10-15T11:02:33.587741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:33.587751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:33.587760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:33.587777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402251289009304:4409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:33.592246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402251289009304:4409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:33.602579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402251289009304:4409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:33.603470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402251289009359:5602]
2025-10-15T11:02:33.621989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402251289009304:4409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:33.622039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402251289009304:4409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:33.622057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402251289009304:4409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:33.622092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:33.629515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:33.636721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:33.637668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:33.637699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:33.637744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:33.638010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:33.638190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402254088698581:9902]
2025-10-15T11:02:33.640399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:33.641612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:33.641832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:33.643168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:33.643519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:33.643528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:33.643535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:33.643544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:33.643552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:33.643558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:33.643566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:33.643573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:33.643580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:33.643588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:33.643596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:33.643603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.643610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.643617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.643668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:33.643784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:33.643835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:33.643887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:33.643934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:33.643986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:33.644035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:33.644083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:33.644132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:33.644181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:33.644227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:33.644276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.644329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.644379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.644429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:33.644505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:33.644570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:33.644630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:33.644684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:33.644745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:33.644791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:33.644854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:33.644906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:33.644965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:33.645014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:33.645073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:33.645126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:33.645183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:33.645232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:33.645290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:33.645340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:33.645397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:33.645445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:33.645502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:33.645554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:33.645612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:33.645660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.645715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.645766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.645821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.645870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.645928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.646476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:33.677600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:33.688345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:33.688389Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:33.688405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:33.688421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:33.688446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1071 [2:7561402254088698581:9902]
2025-10-15T11:02:33.688495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:33.688569Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:33.688585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:33.688597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:33.688608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:33.688651Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:33.688670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:33.688691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:33.703241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.703268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.703280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.703291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:33.703686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:33.703703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:33.703835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:33.704005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:33.704243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:33.704309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402254088698575:9902]
2025-10-15T11:02:33.704324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402254088698575:9902]
2025-10-15T11:02:33.704335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402254088698575:9902]
2025-10-15T11:02:33.704377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:33.704447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:33.704610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:33.704625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:33.704733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402254088698575:9902]
2025-10-15T11:02:33.704752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:33.705667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:33.705683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:33.705694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:33.705716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:33.707531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1071, pipe: [1:7561402251289009359:5602]
2025-10-15T11:02:33.707644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402251289009359:5602], now have 1 active actors on pipe
2025-10-15T11:02:33.707611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1071
2025-10-15T11:02:33.707674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402251289009398:4409], now have 1 active actors on pipe
2025-10-15T11:02:33.707697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402251289009252:2467], now have 1 active actors on pipe
2025-10-15T11:02:33.707644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1071
2025-10-15T11:02:33.707960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:33.707999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:33.708093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:33.708127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:33.708144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:33.708153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:33.708184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:33.708222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:33.708270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:33.713034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:33.713070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:33.713144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:33.713455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1072 partition: 0 MaxSeqNo: 46 sessionId: src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0
2025-10-15T11:02:33.719585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ceaf3ce-59395988-53f80a89-ca58210a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:33.764431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0] Write session: try to update token
2025-10-15T11:02:33.764484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:33.847274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:33.847308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:33.847318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:33.847647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:33.847674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:33.847687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:33.847696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:33.847726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402254088698575:9902]
2025-10-15T11:02:33.847750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402254088698575:9902]
2025-10-15T11:02:33.847776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402254088698575:9902]
2025-10-15T11:02:33.848370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:33.848419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:33.848478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:33.931903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:33.931940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:33.933033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:33.974231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId: src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:34.006498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:34.109666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:34.115695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:34.115730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:34.115839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:34.116113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402251289009359:5602]
2025-10-15T11:02:34.111039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:34.111065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:34.111106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402254088698575:9902]
2025-10-15T11:02:34.111243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:34.111266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:34.111418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:34.112446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:34.123965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1072 reason: error at write: Disconnected sessionId: src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0
2025-10-15T11:02:34.124404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1072 sessionId: src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0 is DEAD
2025-10-15T11:02:34.124866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:34.124957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0] Write session will restart in 0.007434s
2025-10-15T11:02:34.125207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0] Write session: Do CDS request
2025-10-15T11:02:34.125282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:34.144471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:34.148792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:34.148836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1073
2025-10-15T11:02:34.149233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:34.149353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:34.149368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:34.149377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:34.156664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1073 sessionId:  describe result for acl check
2025-10-15T11:02:34.156773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:34.156783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:34.156792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:34.156807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402255583976725:4404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:34.159081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402255583976725:4404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:34.177935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402255583976725:4404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:34.188040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402255583976725:4404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:34.188085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402255583976725:4404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:34.188102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402255583976725:4404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:34.188130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:34.216297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402255583976796:5602]
2025-10-15T11:02:34.266265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:34.280554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:34.281353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:34.281371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:34.281419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:34.281660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:34.281836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402258383666063:9910]
2025-10-15T11:02:34.288328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:34.289483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:34.289705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:34.291367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:34.291729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:34.291738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:34.291745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:34.291751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:34.291758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:34.291765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:34.291772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:34.291780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:34.291787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:34.291794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:34.291801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:34.291808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.291815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.291821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.291869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:34.291976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:34.292024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:34.292070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:34.292116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:34.292165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:34.292209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:34.292254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:34.292297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:34.292345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:34.292392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:34.292435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.292479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.292523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.292574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:34.292638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:34.292699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:34.292762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:34.292811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:34.292862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:34.292904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:34.292957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:34.293003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:34.293057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:34.293102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:34.293154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:34.293199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:34.293250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:34.293292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:34.293340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:34.293384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:34.293433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:34.293476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:34.293527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:34.293571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:34.293620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:34.293667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.293717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.293761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.293811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.293852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.293902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.294406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:34.339552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:34.353546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:34.353583Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:34.353598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:34.353615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:34.353636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1072 [2:7561402258383666063:9910]
2025-10-15T11:02:34.353681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:34.353731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:34.353744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:34.353755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:34.353767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:34.353810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:34.353828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:34.353847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:34.389075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.389098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.389109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.389117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:34.389368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:34.389382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.389519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.389675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.389872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:34.389932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402258383666057:9910]
2025-10-15T11:02:34.389946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402258383666057:9910]
2025-10-15T11:02:34.389958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402258383666057:9910]
2025-10-15T11:02:34.389992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:34.390059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:34.390229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:34.390246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:34.390351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402258383666057:9910]
2025-10-15T11:02:34.390371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:34.390954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:34.390973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:34.390984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:34.391006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:34.391744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402255583976769:4404], now have 1 active actors on pipe
2025-10-15T11:02:34.391770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402255583976796:5602], now have 1 active actors on pipe
2025-10-15T11:02:34.391790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402255583976715:2467], now have 1 active actors on pipe
2025-10-15T11:02:34.394458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1072
2025-10-15T11:02:34.394539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1072, pipe: [1:7561402255583976796:5602]
2025-10-15T11:02:34.394614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1072
2025-10-15T11:02:34.395435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:34.395470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:34.395536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:34.395565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:34.395583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:34.395594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:34.395626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:34.395666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:34.395710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:34.399436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:34.399465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:34.399535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:34.400979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1073 partition: 0 MaxSeqNo: 46 sessionId: src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0
2025-10-15T11:02:34.401748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d78f1d0c-cb0751ca-3cd73b83-484bbc58_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:34.454842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:34.454865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:34.454877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:34.462638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0] Write session: try to update token
2025-10-15T11:02:34.462689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:34.590332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:34.590378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:34.590396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:34.590482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:34.590504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:34.590527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:34.590546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:34.590612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402258383666057:9910]
2025-10-15T11:02:34.590659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402258383666057:9910]
2025-10-15T11:02:34.590689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402258383666057:9910]
2025-10-15T11:02:34.590828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:34.590848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:34.591488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:34.591540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:34.591569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:34.592341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:34.686358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId: src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:34.726513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:34.745295Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:34.746778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:34.746806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:34.750022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:34.751503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:34.751535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:34.752967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402255583976796:5602]
2025-10-15T11:02:34.753077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:34.760718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1073 reason: error at write: Disconnected sessionId: src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0
2025-10-15T11:02:34.761039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1073 sessionId: src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0 is DEAD
2025-10-15T11:02:34.763962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:34.764001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0] Write session will restart in 0.007077s
2025-10-15T11:02:34.764098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0] Write session: Do CDS request
2025-10-15T11:02:34.764126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:34.780005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:34.779759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:34.779792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1074
2025-10-15T11:02:34.787682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:34.787868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:34.787888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:34.787900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:34.791640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1074 sessionId:  describe result for acl check
2025-10-15T11:02:34.791764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:34.791776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:34.791785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:34.791801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402255583976939:4375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:34.794303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402255583976939:4375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:34.815816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402255583976939:4375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:34.839483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402255583976939:4375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:34.839525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402255583976939:4375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:34.839541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402255583976939:4375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:34.839571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:34.859544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402255583977030:5602]
2025-10-15T11:02:34.895717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:34.907717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:34.908693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:34.908713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:34.908755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:34.909047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:34.909232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402258383666229:9915]
2025-10-15T11:02:34.911570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:34.917650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:34.917945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:34.919667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:34.920092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:34.920102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:34.920109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:34.920118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:34.920127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:34.920136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:34.920145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:34.920151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:34.920160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:34.920167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:34.920176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:34.920183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.920190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.920198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.920251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:34.920370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:34.920418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:34.920484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:34.920539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:34.920608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:34.920658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:34.920707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:34.920762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:34.920813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:34.920864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:34.920916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.920966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.921017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.921067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:34.921143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:34.921210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:34.921270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:34.921325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:34.921383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:34.921437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:34.921495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:34.921546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:34.921608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:34.921660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:34.921722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:34.921773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:34.921830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:34.921881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:34.921938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:34.921994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:34.922052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:34.922101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:34.922174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:34.922228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:34.922286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:34.922335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.922392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:34.922438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.922495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:34.922545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.922603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:34.923165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:34.956334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:34.974891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:34.974941Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:34.974961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:34.974985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:34.975016Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1073 [2:7561402258383666229:9915]
2025-10-15T11:02:34.975077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:34.975147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:34.975166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:34.975180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:34.975194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:34.975251Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:34.975274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:34.975300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:35.005319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:35.005359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:35.005375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:35.005389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:35.005698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:35.005725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:35.005899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:35.006152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:35.006109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1073, pipe: [1:7561402255583977030:5602]
2025-10-15T11:02:35.006229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1073
2025-10-15T11:02:35.006239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1073
2025-10-15T11:02:35.006414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:35.006509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402255583977030:5602], now have 1 active actors on pipe
2025-10-15T11:02:35.006535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402255583976992:4375], now have 1 active actors on pipe
2025-10-15T11:02:35.006561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402255583976931:2467], now have 1 active actors on pipe
2025-10-15T11:02:35.006589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402258383666223:9915]
2025-10-15T11:02:35.006611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402258383666223:9915]
2025-10-15T11:02:35.006627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402258383666223:9915]
2025-10-15T11:02:35.006667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:35.006755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:35.006775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:35.006790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:35.006802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:35.006955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:35.006978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:35.007136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:35.007164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:35.007221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402258383666223:9915]
2025-10-15T11:02:35.007251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:35.007273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:35.008052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:35.008100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:35.008119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:35.008130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:35.008170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:35.008217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:35.008325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:35.014920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:35.014969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:35.015065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:35.015397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1074 partition: 0 MaxSeqNo: 46 sessionId: src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0
2025-10-15T11:02:35.016089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88bf9afc-10d7146b-d6371b90-e3a4ebe_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:35.076851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:35.076884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:35.076895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:35.108365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0] Write session: try to update token
2025-10-15T11:02:35.108431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:35.265105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:35.265761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:35.265779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:35.265889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:35.265901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:35.265912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:35.265920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:35.265947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402258383666223:9915]
2025-10-15T11:02:35.265981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402258383666223:9915]
2025-10-15T11:02:35.266000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402258383666223:9915]
2025-10-15T11:02:35.269251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:35.269290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:35.269315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
E1015 11:02:35.276968323  821071 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:02:35.277870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId: src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:35.317777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:35.324437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:35.324467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:35.325397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:35.499303Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:35.518188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:35.518223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:35.518262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402258383666223:9915]
2025-10-15T11:02:35.518396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:35.518417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:35.518455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:35.519191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:35.523547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402255583977030:5602]
2025-10-15T11:02:35.523658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:35.524634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:35.549292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1074 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0
2025-10-15T11:02:35.549588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1074 sessionId: src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0 is DEAD
2025-10-15T11:02:35.551846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:35.551899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0] Write session will restart in 0.005692s
2025-10-15T11:02:35.552040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0] Write session: Do CDS request
2025-10-15T11:02:35.552084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:35.565304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:35.567490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:35.567530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1075
2025-10-15T11:02:35.567892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:35.568004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:35.568019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:35.568029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:35.569266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1075 sessionId:  describe result for acl check
2025-10-15T11:02:35.569375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:35.569386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:35.569394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:35.569411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402259878944425:4365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:35.571980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402259878944425:4365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:35.601749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402259878944425:4365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:35.624697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402259878944425:4365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:35.624748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402259878944425:4365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:35.624765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402259878944425:4365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:35.624796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:35.625338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402259878944556:5602]
2025-10-15T11:02:35.641147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:35.645155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:35.646125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:35.646145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:35.646192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:35.646466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:35.646657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402262678633728:9925]
2025-10-15T11:02:35.649093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:35.650342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:35.650570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:35.651962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:35.652309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:35.652318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:35.652326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:35.652335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:35.652342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:35.652349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:35.652357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:35.652364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:35.652372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:35.652380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:35.652387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:35.652395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:35.652401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:35.652409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:35.652459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:35.652578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:35.652636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:35.652687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:35.652740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:35.652789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:35.652842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:35.652892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:35.652944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:35.652994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:35.653045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:35.653094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:35.653142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:35.653191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:35.653239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:35.653312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:35.653376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:35.653437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:35.653491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:35.653548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:35.653599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:35.653658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:35.653712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:35.653769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:35.653821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:35.653885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:35.653939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:35.653997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:35.654047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:35.654126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:35.654177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:35.654237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:35.654283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:35.654345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:35.654397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:35.654455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:35.654503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:35.654560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:35.654610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:35.654669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:35.654718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:35.654773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:35.657770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:35.701202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:35.712233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:35.712276Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:35.712296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:35.712319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:35.712346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1074 [2:7561402262678633728:9925]
2025-10-15T11:02:35.712405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:35.712472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:35.712491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:35.712504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:35.712517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:35.712570Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:35.712595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:35.712619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:35.714051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:35.714069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:35.714097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:35.714109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:35.714381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:35.714399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:35.714556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:35.714762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:35.715011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:35.715085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402262678633723:9925]
2025-10-15T11:02:35.715101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402262678633723:9925]
2025-10-15T11:02:35.715115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402262678633723:9925]
2025-10-15T11:02:35.715148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:35.715230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:35.719529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1074
2025-10-15T11:02:35.719625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1074, pipe: [1:7561402259878944556:5602]
2025-10-15T11:02:35.719697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1074
2025-10-15T11:02:35.716152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:35.716173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:35.716186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:35.724228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:35.724263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:35.724488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402259878944413:2467], now have 1 active actors on pipe
2025-10-15T11:02:35.724518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402259878944556:5602], now have 1 active actors on pipe
2025-10-15T11:02:35.724545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402259878944555:4365], now have 1 active actors on pipe
2025-10-15T11:02:35.724611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:35.724636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:35.724698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402262678633723:9925]
2025-10-15T11:02:35.724743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:35.724880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:35.724916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:35.724935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:35.724947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:35.724989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:35.725036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:35.725139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:35.727836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:35.728998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:35.729027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:35.729097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:35.729448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1075 partition: 0 MaxSeqNo: 46 sessionId: src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0
2025-10-15T11:02:35.730392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a3630c0-d7b6d431-4abc3b3b-17ef345_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:35.762027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0] Write session: try to update token
2025-10-15T11:02:35.762108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:35.843728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:35.843763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:35.843776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:35.843839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:35.843856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:35.843871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:35.843883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:35.843923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402262678633723:9925]
2025-10-15T11:02:35.843954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402262678633723:9925]
2025-10-15T11:02:35.843981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402262678633723:9925]
2025-10-15T11:02:35.844206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:35.844231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:35.845252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:35.847836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:35.847878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:35.847909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:35.907702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId: src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:35.926902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:36.003078Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:36.015516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:36.015566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:36.015642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:36.015658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:36.015703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402262678633723:9925]
2025-10-15T11:02:36.016232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:36.018083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:36.019315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:36.019508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402259878944556:5602]
2025-10-15T11:02:36.019627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:36.096069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1075 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0
2025-10-15T11:02:36.096345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1075 sessionId: src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0 is DEAD
2025-10-15T11:02:36.100085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:36.100130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0] Write session will restart in 0.008118s
2025-10-15T11:02:36.100241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0] Write session: Do CDS request
2025-10-15T11:02:36.100272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:36.115967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:36.117440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402264173911983:5602]
2025-10-15T11:02:36.123278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:36.123304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1076
2025-10-15T11:02:36.123925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:36.124064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:36.124078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:36.124087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:36.125222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1076 sessionId:  describe result for acl check
2025-10-15T11:02:36.125319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:36.125329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:36.125338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:36.125352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402264173912008:4354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:36.127803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402264173912008:4354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:36.134908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402264173912008:4354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:36.135043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:36.142361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:36.143149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:36.143179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:36.143219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:36.143484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:36.143676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402266973601194:9932]
2025-10-15T11:02:36.145813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:36.147944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402264173912008:4354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:36.147985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402264173912008:4354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:36.148002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402264173912008:4354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:36.148029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:36.148560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:36.148788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:36.149950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:36.150255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:36.150263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:36.150270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:36.150276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:36.150282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:36.150288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:36.150294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:36.150300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:36.150307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:36.150313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:36.150320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:36.150326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.150332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.150338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.150380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:36.150476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:36.150521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:36.150564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:36.150610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:36.150652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:36.150697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:36.150741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:36.150784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:36.150829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:36.150871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:36.150913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.150954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.150996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.151034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:36.151113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:36.151168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:36.151218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:36.151263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:36.151316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:36.151374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:36.151426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:36.151470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:36.151520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:36.151562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:36.151614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:36.151659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:36.151708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:36.151750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:36.151798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:36.151842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:36.151893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:36.151934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:36.151983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:36.152027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:36.152076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:36.152117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.152166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.152211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.152262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.152305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.152356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.152819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:36.195460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:36.206663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:36.207482Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:36.207507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:36.207523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:36.207546Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1075 [2:7561402266973601194:9932]
2025-10-15T11:02:36.207595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:36.207649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:36.207661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:36.207673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:36.207683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:36.207728Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:36.207749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:36.207770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:36.237178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.237201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.237211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.237220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:36.237447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:36.237461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.237594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.237757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.237950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:36.238032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402264173911888:2467], now have 1 active actors on pipe
2025-10-15T11:02:36.238067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402264173911983:5602], now have 1 active actors on pipe
2025-10-15T11:02:36.238086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402264173912041:4354], now have 1 active actors on pipe
2025-10-15T11:02:36.238107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402266973601188:9932]
2025-10-15T11:02:36.238120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402266973601188:9932]
2025-10-15T11:02:36.238131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402266973601188:9932]
2025-10-15T11:02:36.238157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:36.238218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:36.238371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:36.238385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:36.238423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:36.238435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:36.238445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:36.238488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402266973601188:9932]
2025-10-15T11:02:36.238509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:36.238513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:36.238618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:36.238638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:36.238729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:36.238755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:36.238769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:36.238777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:36.238808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:36.238843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:36.238896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:36.237832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1075
2025-10-15T11:02:36.237909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1075, pipe: [1:7561402264173911983:5602]
2025-10-15T11:02:36.237969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1075
2025-10-15T11:02:36.241046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:36.241074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:36.241146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:36.241526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1076 partition: 0 MaxSeqNo: 46 sessionId: src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0
2025-10-15T11:02:36.242431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2316304c-660c0355-3e3e37a0-3c4635ec_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:36.299590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:36.299629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:36.299683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402266973601188:9932]
2025-10-15T11:02:36.299802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:02:36.301610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:02:36.302825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:36.303065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:36.307496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:36.312388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:02:36.315506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0] Write session: try to update token
2025-10-15T11:02:36.315571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:36.317137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:02:36.317678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:36.317693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:36.317707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:36.317807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:02:36.374949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:36.374986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:36.375001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:36.375012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:36.375054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402266973601188:9932]
2025-10-15T11:02:36.375081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402266973601188:9932]
2025-10-15T11:02:36.375106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402266973601188:9932]
2025-10-15T11:02:36.375263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:36.375289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:36.376242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:36.380194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:36.380270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:36.380317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:36.435454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId: src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:36.465245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:36.535486Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:36.536882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:36.536914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:36.538107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:36.541713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402264173911983:5602]
2025-10-15T11:02:36.541807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:36.547495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:36.587963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1076 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0
2025-10-15T11:02:36.588214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1076 sessionId: src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0 is DEAD
2025-10-15T11:02:36.590139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:36.590181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0] Write session will restart in 0.005887s
2025-10-15T11:02:36.590273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0] Write session: Do CDS request
2025-10-15T11:02:36.590298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:36.602486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:36.607854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:36.607906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1077
2025-10-15T11:02:36.611690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:36.611886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:36.611905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:36.611916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:36.613947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1077 sessionId:  describe result for acl check
2025-10-15T11:02:36.614080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:36.614092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:36.614103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:36.614131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402264173912129:4337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:36.617091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402264173912129:4337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:36.626790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402264173912129:4337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:36.640144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402264173912200:5602]
2025-10-15T11:02:36.644872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402264173912129:4337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:36.644918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402264173912129:4337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:36.644933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402264173912129:4337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:36.644962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:36.672486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:36.671831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T11:02:36.671881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-15T11:02:36.681615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:36.682586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:36.682618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:36.682664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:36.682956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:36.683150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402266973601377:9938]
2025-10-15T11:02:36.685681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:36.686971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:36.687224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:36.688562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:36.688912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:36.688930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:36.688938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:36.688945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:36.688953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:36.688961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:36.688968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:36.688975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:36.688981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:36.688988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:36.688995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:36.689003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.689011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.689019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.689068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:36.689187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:36.689237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:36.689286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:36.689338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:36.689389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:36.689435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:36.689481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:36.689528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:36.689577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:36.689627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:36.689674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.689720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.689766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.689811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:36.689882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:36.689944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:36.690001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:36.690071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:36.690130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:36.693287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:36.693381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:36.693459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:36.693532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:36.693583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:36.693644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:36.693700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:36.693760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:36.693813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:36.693873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:36.693927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:36.693986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:36.694048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:36.694109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:36.694164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:36.694221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:36.694274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.694332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.694388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.694448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.694497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.694555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.695106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:36.721637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:36.733708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:36.733984Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:36.734009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:36.734044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:36.734072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1076 [2:7561402266973601377:9938]
2025-10-15T11:02:36.734131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:36.734198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:36.734213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:36.734228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:36.734241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:36.734294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:36.734321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:36.734345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:36.758431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.758463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.758474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.758485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:36.758758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:36.758774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:36.758906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:36.759076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:36.759303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:36.759643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402264173912085:2467], now have 1 active actors on pipe
2025-10-15T11:02:36.759678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402264173912200:5602], now have 1 active actors on pipe
2025-10-15T11:02:36.759701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402264173912212:4337], now have 1 active actors on pipe
2025-10-15T11:02:36.759725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402266973601372:9938]
2025-10-15T11:02:36.759742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402266973601372:9938]
2025-10-15T11:02:36.759754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402266973601372:9938]
2025-10-15T11:02:36.759793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:36.759837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:36.759852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:36.759863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:36.759873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:36.760073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:36.760106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:36.760232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402266973601372:9938]
2025-10-15T11:02:36.760261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:36.760282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:36.760387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:36.760410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:36.760556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:36.760588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:36.760606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:36.760617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:36.760654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:36.760698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:36.760877Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:02:36.760965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:36.759688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1076
2025-10-15T11:02:36.759804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1076, pipe: [1:7561402264173912200:5602]
2025-10-15T11:02:36.759885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1076
2025-10-15T11:02:36.761735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 21 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:02:36.761868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:02:36.763467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:36.763502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:36.763591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:36.764719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1077 partition: 0 MaxSeqNo: 46 sessionId: src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0
2025-10-15T11:02:36.767975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e5ed56a-b4b241a4-cfe40bbc-98437594_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:36.819675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0] Write session: try to update token
2025-10-15T11:02:36.819725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:36.906630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:36.906660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:36.906671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:36.906719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:36.906734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:36.906745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:36.906758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:36.906789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402266973601372:9938]
2025-10-15T11:02:36.906813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402266973601372:9938]
2025-10-15T11:02:36.906835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402266973601372:9938]
2025-10-15T11:02:36.907014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:36.907043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:36.907511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:36.907551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:36.907574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:36.908394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:37.004386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId: src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:37.031002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:37.060211Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:37.076109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:37.076179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:37.076226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:37.076239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:37.076274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402266973601372:9938]
2025-10-15T11:02:37.080826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:37.081021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402264173912200:5602]
2025-10-15T11:02:37.081119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:37.081138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:37.079332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:37.079795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:37.115806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1077 reason: error at write: Disconnected sessionId: src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0
2025-10-15T11:02:37.116087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1077 sessionId: src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0 is DEAD
2025-10-15T11:02:37.119708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:37.119779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0] Write session will restart in 0.006189s
2025-10-15T11:02:37.119983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0] Write session: Do CDS request
2025-10-15T11:02:37.120041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:37.130958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:37.130994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1078
2025-10-15T11:02:37.140197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:37.144272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:37.144417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:37.144432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:37.144442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:37.150154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1078 sessionId:  describe result for acl check
2025-10-15T11:02:37.150275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:37.150287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:37.150296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:37.150313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402268468879589:4336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:37.152805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402268468879589:4336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:37.172475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402268468879589:4336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:37.183447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402268468879686:5602]
2025-10-15T11:02:37.188850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402268468879589:4336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:37.188891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402268468879589:4336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:37.188907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402268468879589:4336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:37.188935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:37.205562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:37.210698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:37.211566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:37.211585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:37.211626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:37.211875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:37.212054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402271268568866:9948]
2025-10-15T11:02:37.214566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:37.215591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:37.215829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:37.217053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:37.217378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:37.217386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:37.217393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:37.217400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:37.217407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:37.217414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:37.217420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:37.217426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:37.217434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:37.217441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:37.217450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:37.217457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.217463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.217470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.217538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:37.217642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:37.217691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:37.217739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:37.217785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:37.217832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:37.217879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:37.217927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:37.217976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:37.218040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:37.218086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:37.218130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.218174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.218220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.218267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:37.218336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:37.218393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:37.218450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:37.218501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:37.218555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:37.218602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:37.218660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:37.218711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:37.218763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:37.218809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:37.218863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:37.218914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:37.218967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:37.219015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:37.219067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:37.219113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:37.219167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:37.219212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:37.219265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:37.219314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:37.220545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:37.220612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.220674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.220722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.220775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.220822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.220878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.221393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:37.239089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:37.270461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:37.270643Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:37.270663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:37.270680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:37.270703Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1077 [2:7561402271268568866:9948]
2025-10-15T11:02:37.270752Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:37.270802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:37.270815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:37.270826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:37.270836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:37.270879Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:37.270900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:37.270919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:37.272460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.272477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.272490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.272500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:37.272772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:37.272791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.272927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.273102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.274313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1077, pipe: [1:7561402268468879686:5602]
2025-10-15T11:02:37.274406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1077
2025-10-15T11:02:37.274478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1077
2025-10-15T11:02:37.274880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:37.274972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402268468879686:5602], now have 1 active actors on pipe
2025-10-15T11:02:37.274994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402268468879561:2467], now have 1 active actors on pipe
2025-10-15T11:02:37.275014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402268468879700:4336], now have 1 active actors on pipe
2025-10-15T11:02:37.275073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:37.275092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:37.275127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402271268568860:9948]
2025-10-15T11:02:37.275140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402271268568860:9948]
2025-10-15T11:02:37.275153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402271268568860:9948]
2025-10-15T11:02:37.275191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:37.275248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:37.275263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:37.275263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:37.275274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:37.275454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:37.275473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:37.275539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:37.275567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:37.275582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:37.275592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:37.275623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:37.275659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:37.275774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402271268568860:9948]
2025-10-15T11:02:37.275808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:37.275852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:37.275863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:37.277204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:37.277234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:37.277294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:37.277781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1078 partition: 0 MaxSeqNo: 46 sessionId: src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0
2025-10-15T11:02:37.278698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e9bdbb4-b0f44b0-4e1eabcf-93c98d42_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:37.314249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0] Write session: try to update token
2025-10-15T11:02:37.314315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:37.442329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId: src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:37.469119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:37.469152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:37.469165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:37.469306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:37.469324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:37.469340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:37.469352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:37.469392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402271268568860:9948]
2025-10-15T11:02:37.469423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402271268568860:9948]
2025-10-15T11:02:37.469452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402271268568860:9948]
2025-10-15T11:02:37.469795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:37.469840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:37.469875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:37.486389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:37.486424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:37.487512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:37.490918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:37.642257Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:37.644137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:37.644162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:37.644212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402271268568860:9948]
2025-10-15T11:02:37.644346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:37.644387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:37.644520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:37.646071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:37.646467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:37.646500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:37.645151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:37.706635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1078 reason: error at write: Disconnected sessionId: src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0
2025-10-15T11:02:37.707258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1078 sessionId: src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0 is DEAD
2025-10-15T11:02:37.707307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:37.707363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0] Write session will restart in 0.006534s
2025-10-15T11:02:37.707479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0] Write session: Do CDS request
2025-10-15T11:02:37.707542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:37.723299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:37.729315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402268468879686:5602]
2025-10-15T11:02:37.729379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:37.729392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1079
2025-10-15T11:02:37.729771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:37.729895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:37.729916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:37.729927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:37.731555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1079 sessionId:  describe result for acl check
2025-10-15T11:02:37.731670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:37.731687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:37.731697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:37.731714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402268468879886:4317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:37.734418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402268468879886:4317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:37.742142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:37.741290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402268468879886:4317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:37.752896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:37.753711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:37.753729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:37.753770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:37.754033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:37.754202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402271268569028:9956]
2025-10-15T11:02:37.756435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:37.756334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402268468879886:4317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:37.756379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402268468879886:4317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:37.756397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402268468879886:4317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:37.756430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:37.758349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:37.758584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:37.759759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:37.760061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:37.760069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:37.760076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:37.760083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:37.760092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:37.760099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:37.760106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:37.760113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:37.760120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:37.760127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:37.760135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:37.760143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.760148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.760154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.760200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:37.760308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:37.760356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:37.760404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:37.760457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:37.760507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:37.760554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:37.760599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:37.760645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:37.760694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:37.760739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:37.760784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.760827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.760874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.760914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:37.760979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:37.761036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:37.761093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:37.761141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:37.761940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:37.762032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:37.762094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:37.762143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:37.762197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:37.762244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:37.762296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:37.762342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:37.762392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:37.762436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:37.762489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:37.762536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:37.762589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:37.762630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:37.762680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:37.762724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:37.762776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:37.762818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.762868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.762911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.762959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.763004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.763054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.763540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:37.786371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:37.794961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:37.795013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:37.795031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:37.795052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:37.795081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1078 [2:7561402271268569028:9956]
2025-10-15T11:02:37.795138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:37.795205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:37.795223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:37.795237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:37.795249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:37.795303Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:37.795327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:37.795687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:37.807028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.807058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.807074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.807088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:37.807411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:37.807432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:37.807592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:37.807795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:37.808048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:37.808123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402271268569022:9956]
2025-10-15T11:02:37.808140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402271268569022:9956]
2025-10-15T11:02:37.808155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402271268569022:9956]
2025-10-15T11:02:37.808201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:37.808287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:37.808469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:37.808485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:37.808499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:37.808504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:37.808524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:37.808680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402268468879761:2467], now have 1 active actors on pipe
2025-10-15T11:02:37.808703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402271268569022:9956]
2025-10-15T11:02:37.808732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:37.808752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:37.808815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402268468879927:4317], now have 1 active actors on pipe
2025-10-15T11:02:37.810466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:37.810507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:37.810594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:37.810629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:37.810650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:37.810662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:37.810706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:37.810753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:37.810802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:37.808659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1078
2025-10-15T11:02:37.808826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1078
2025-10-15T11:02:37.811632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:37.811661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:37.811739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:37.812337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1079 partition: 0 MaxSeqNo: 46 sessionId: src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0
2025-10-15T11:02:37.818754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4ff2dc-16bcde05-b5a2ac9b-e0c35f5c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:37.832343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402268468879938:5602], now have 1 active actors on pipe
2025-10-15T11:02:37.831556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402268468879938:5602]
2025-10-15T11:02:37.833725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1078, pipe: [1:7561402268468879938:5602]
2025-10-15T11:02:37.877229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0] Write session: try to update token
2025-10-15T11:02:37.877301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:37.919400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:37.919434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:37.919445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:37.919498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:37.919514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:37.919527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:37.919538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:37.919571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402271268569022:9956]
2025-10-15T11:02:37.919599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402271268569022:9956]
2025-10-15T11:02:37.919624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402271268569022:9956]
2025-10-15T11:02:37.919755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:37.919765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:37.919776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:37.919796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:37.919817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:37.930980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:38.019578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId: src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:38.056805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:38.091168Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:38.092781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:38.092829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:38.096864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402268468879938:5602]
2025-10-15T11:02:38.096979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:38.096992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:38.097136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:38.119743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:38.159035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1079 reason: error at write: Disconnected sessionId: src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0
2025-10-15T11:02:38.159402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1079 sessionId: src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0 is DEAD
2025-10-15T11:02:38.160080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:38.160139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0] Write session will restart in 0.006539s
2025-10-15T11:02:38.160346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0] Write session: Do CDS request
2025-10-15T11:02:38.160407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:38.176686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:38.179650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:38.179686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1080
2025-10-15T11:02:38.180037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:38.180154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:38.180169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:38.180181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:38.181495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1080 sessionId:  describe result for acl check
2025-10-15T11:02:38.181602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:38.181613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:38.181622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:38.181639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402272763847257:4300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:38.184268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402272763847257:4300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:38.199530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402272763847293:5602]
2025-10-15T11:02:38.207689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402272763847257:4300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:38.228010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402272763847257:4300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:38.228056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402272763847257:4300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:38.228074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402272763847257:4300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:38.228107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:38.246713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:38.255632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:38.256577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:38.256605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:38.256653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:38.256964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:38.257162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402275563536519:9960]
2025-10-15T11:02:38.259525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:38.260613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:38.260849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:38.262182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:38.262516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:38.262526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:38.262534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:38.262542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:38.262549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:38.262556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:38.262563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:38.262570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:38.262576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:38.262582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:38.262590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:38.262598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.262605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.262613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.262663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:38.262777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:38.262830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:38.262880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:38.262932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:38.262985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:38.263031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:38.263076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:38.263124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:38.263178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:38.263232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:38.263283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.263337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.263409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.263460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:38.263532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:38.263595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:38.263655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:38.263707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:38.263769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:38.263822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:38.263880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:38.263934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:38.263991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:38.264040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:38.264097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:38.264149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:38.264206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:38.264256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:38.264311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:38.264360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:38.264418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:38.264466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:38.264525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:38.264574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:38.264631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:38.264678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.264735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.264780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.264835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.264879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.264935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.265465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:38.291267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:38.300046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:38.300090Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:38.300107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:38.300127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:38.300154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1079 [2:7561402275563536519:9960]
2025-10-15T11:02:38.300208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:38.300268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:38.300289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:38.300303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:38.300314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:38.300365Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:38.300392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:38.300416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:38.310611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.310638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.310648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.310659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:38.311303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1079
2025-10-15T11:02:38.311433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1079
2025-10-15T11:02:38.311497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1079, pipe: [1:7561402272763847293:5602]
2025-10-15T11:02:38.311314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:38.311339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.311477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.311637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.311804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:38.311832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402272763847241:2467], now have 1 active actors on pipe
2025-10-15T11:02:38.311847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402272763847365:4300], now have 1 active actors on pipe
2025-10-15T11:02:38.311861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402272763847293:5602], now have 1 active actors on pipe
2025-10-15T11:02:38.311906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402275563536514:9960]
2025-10-15T11:02:38.311917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402275563536514:9960]
2025-10-15T11:02:38.311927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402275563536514:9960]
2025-10-15T11:02:38.311955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:38.312007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:38.312140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:38.312153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:38.312250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402275563536514:9960]
2025-10-15T11:02:38.312264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:38.312426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:38.312434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:38.312442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:38.312456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:38.313460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:38.313489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:38.313565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c360099c-16f7b50d-a9c5014-69504a72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:38.313596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:38.313614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:38.313623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:38.313649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:38.313687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:38.313733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:38.315792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:38.315837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:38.315910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:38.317241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51bded96-bb2c5ea3-341f4a56-c79bc857_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c360099c-16f7b50d-a9c5014-69504a72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:38.316312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1080 partition: 0 MaxSeqNo: 46 sessionId: src_id|c360099c-16f7b50d-a9c5014-69504a72_0
2025-10-15T11:02:38.343680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c360099c-16f7b50d-a9c5014-69504a72_0] Write session: try to update token
2025-10-15T11:02:38.343742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c360099c-16f7b50d-a9c5014-69504a72_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:38.437489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:38.437517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:38.437529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:38.437588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:38.437605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:38.437619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:38.437630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:38.437673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402275563536514:9960]
2025-10-15T11:02:38.437709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402275563536514:9960]
2025-10-15T11:02:38.437753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402275563536514:9960]
2025-10-15T11:02:38.437976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:38.438015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:38.438293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:38.438343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:38.438372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:38.439169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:38.530512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId: src_id|c360099c-16f7b50d-a9c5014-69504a72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:38.566810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:38.601939Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:38.612394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:38.612450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:38.616729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:38.616756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:38.616592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:38.621059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402272763847293:5602]
2025-10-15T11:02:38.621212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:38.678686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1080 reason: error at write: Disconnected sessionId: src_id|c360099c-16f7b50d-a9c5014-69504a72_0
2025-10-15T11:02:38.678997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1080 sessionId: src_id|c360099c-16f7b50d-a9c5014-69504a72_0 is DEAD
2025-10-15T11:02:38.679589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c360099c-16f7b50d-a9c5014-69504a72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:38.679630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c360099c-16f7b50d-a9c5014-69504a72_0] Write session will restart in 0.006718s
2025-10-15T11:02:38.679738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c360099c-16f7b50d-a9c5014-69504a72_0] Write session: Do CDS request
2025-10-15T11:02:38.679769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c360099c-16f7b50d-a9c5014-69504a72_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:38.694773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c360099c-16f7b50d-a9c5014-69504a72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:38.695280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:38.695313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1081
2025-10-15T11:02:38.695873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:38.695987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:38.696002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:38.696011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:38.697502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1081 sessionId:  describe result for acl check
2025-10-15T11:02:38.697620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:38.697630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:38.697640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:38.697655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402272763847491:4292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:38.700233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402272763847491:4292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:38.710541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402272763847491:4292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:38.721515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402272763847576:5602]
2025-10-15T11:02:38.724116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402272763847491:4292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:38.724158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402272763847491:4292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:38.724175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402272763847491:4292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:38.724203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:38.736134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:38.739806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:38.740728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:38.740758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:38.740799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:38.741068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:38.741266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402275563536703:9970]
2025-10-15T11:02:38.743611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:38.744857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:38.745110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:38.746561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:38.746934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:38.746952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:38.746961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:38.746969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:38.746977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:38.746986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:38.746994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:38.747003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:38.747011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:38.747020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:38.747027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:38.747036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.747044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.747051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.747105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:38.747234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:38.747291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:38.747374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:38.747436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:38.747496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:38.747553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:38.747610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:38.747666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:38.747718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:38.747789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:38.747849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.747904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.747962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.748015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:38.748098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:38.748170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:38.748242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:38.748305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:38.748370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:38.748428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:38.748495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:38.748555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:38.748620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:38.748680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:38.748742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:38.748797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:38.748857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:38.748908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:38.748971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:38.749026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:38.749084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:38.749135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:38.749201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:38.749253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:38.749311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:38.749360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.749420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.749472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.749533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.749585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.749646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.750244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:38.771997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:38.782974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:38.783022Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:38.783040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:38.783060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:38.783087Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1080 [2:7561402275563536703:9970]
2025-10-15T11:02:38.783141Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:38.783220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:38.783236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:38.783266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:38.783281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:38.783333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:38.783372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:38.783395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:38.784615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.784639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.784652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.784666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:38.784928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:38.784947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:38.785091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:38.785283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:38.785539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:38.785620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402272763847576:5602], now have 1 active actors on pipe
2025-10-15T11:02:38.785645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402272763847432:2467], now have 1 active actors on pipe
2025-10-15T11:02:38.785670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402272763847584:4292], now have 1 active actors on pipe
2025-10-15T11:02:38.785697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402275563536697:9970]
2025-10-15T11:02:38.785711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402275563536697:9970]
2025-10-15T11:02:38.785725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402275563536697:9970]
2025-10-15T11:02:38.785765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:38.785843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:38.786043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:38.786062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:38.786148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:38.786166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:38.787532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1080, pipe: [1:7561402272763847576:5602]
2025-10-15T11:02:38.787680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1080
2025-10-15T11:02:38.787769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1080
2025-10-15T11:02:38.786178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:38.786185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402275563536697:9970]
2025-10-15T11:02:38.786207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:38.786214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:38.793553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:38.793594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:38.793680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:38.793717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:38.793737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:38.793749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:38.793788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:38.793838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:38.793885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:38.797918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:38.797957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:38.798045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:38.800269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1081 partition: 0 MaxSeqNo: 46 sessionId: src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0
2025-10-15T11:02:38.805328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c360099c-16f7b50d-a9c5014-69504a72_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:38.878690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0] Write session: try to update token
2025-10-15T11:02:38.878754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:38.920491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:38.920525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:38.920536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:38.920587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:38.920603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:38.920618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:38.920630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:38.920660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402275563536697:9970]
2025-10-15T11:02:38.920679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402275563536697:9970]
2025-10-15T11:02:38.920696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402275563536697:9970]
2025-10-15T11:02:38.920806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:38.920821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:38.921072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:38.921108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:38.921138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:38.921655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:39.029230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId: src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:39.050757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:39.080593Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:39.082873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:39.082913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:39.086453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:39.086642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:39.086654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:39.086836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:39.132538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1081 reason: error at write: Disconnected sessionId: src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0
2025-10-15T11:02:39.132838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1081 sessionId: src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0 is DEAD
2025-10-15T11:02:39.135894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:39.135947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0] Write session will restart in 0.006797s
2025-10-15T11:02:39.136050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0] Write session: Do CDS request
2025-10-15T11:02:39.136086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:39.151676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:39.159558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402272763847576:5602]
2025-10-15T11:02:39.159611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:39.159624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1082
2025-10-15T11:02:39.166132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:39.166258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:39.166273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:39.166282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:39.175258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1082 sessionId:  describe result for acl check
2025-10-15T11:02:39.175389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:39.175400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:39.175409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:39.175423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402277058814955:4273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:39.177865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402277058814955:4273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:39.211223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402277058814955:4273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:39.238066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402277058814955:4273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:39.238111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402277058814955:4273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:39.238128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402277058814955:4273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:39.238155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:39.241774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:39.252796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:39.253671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:39.253689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:39.253729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:39.254001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:39.254177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402279858504175:9977]
2025-10-15T11:02:39.258212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:39.262643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:39.262946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:39.263439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402277058815074:5602]
2025-10-15T11:02:39.264238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:39.264560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:39.264567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:39.264573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:39.264579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:39.264586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:39.264592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:39.264598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:39.264605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:39.264611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:39.264617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:39.264623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:39.264629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.264635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.264642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.264684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:39.264785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:39.264832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:39.264874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:39.264917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:39.264957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:39.264997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:39.265037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:39.265079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:39.265119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:39.265161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:39.265203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.265244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.265285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.265326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:39.265385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:39.267412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:39.267487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:39.267560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:39.267622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:39.267666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:39.267729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:39.267784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:39.267834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:39.267876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:39.267925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:39.267998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:39.268060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:39.268104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:39.268162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:39.268206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:39.268253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:39.268295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:39.268345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:39.268387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:39.268449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:39.268492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.268540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.268584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.268632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.268676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.268723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.269206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:39.292485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
E1015 11:02:39.302911057  821871 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:02:39.305276Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:02:39.318064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:39.318100Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:39.318110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:39.318121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:39.318139Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1081 [2:7561402279858504175:9977]
2025-10-15T11:02:39.318175Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:39.318216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:39.318226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:39.318234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:39.318241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:39.318273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:39.318286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:39.318300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:39.320383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.320403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.320415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.320426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:39.320683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:39.320700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.320830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.321000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.321217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:39.321279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402279858504168:9977]
2025-10-15T11:02:39.321293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402279858504168:9977]
2025-10-15T11:02:39.321307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402279858504168:9977]
2025-10-15T11:02:39.321350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:39.321414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:39.321577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:39.321593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:39.321703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402279858504168:9977]
2025-10-15T11:02:39.321722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:39.322057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:39.322080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:39.322092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:39.322126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:39.322992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402277058815074:5602], now have 1 active actors on pipe
2025-10-15T11:02:39.323023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402277058814912:2467], now have 1 active actors on pipe
2025-10-15T11:02:39.323043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402277058815068:4273], now have 1 active actors on pipe
2025-10-15T11:02:39.325095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1081, pipe: [1:7561402277058815074:5602]
2025-10-15T11:02:39.325193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1081
2025-10-15T11:02:39.325264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1081
2025-10-15T11:02:39.325644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:39.325675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:39.325744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:39.325774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:39.325791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:39.325802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:39.325834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:39.325886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:39.325930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:39.328793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:39.328821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:39.328891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:39.329258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1082 partition: 0 MaxSeqNo: 46 sessionId: src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0
2025-10-15T11:02:39.330008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c43065a-f5424b18-8fbc2708-4b5ff12_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:39.378673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0] Write session: try to update token
2025-10-15T11:02:39.378728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:39.465943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:39.465969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:39.465979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:39.466070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:39.466083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:39.466096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:39.466106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:39.466134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402279858504168:9977]
2025-10-15T11:02:39.466156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402279858504168:9977]
2025-10-15T11:02:39.466180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402279858504168:9977]
2025-10-15T11:02:39.466308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:39.466344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:39.466380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:39.482780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:39.482816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:39.496334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:39.562121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId: src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:39.633614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:39.659338Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:39.665805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:39.665834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:39.665891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402279858504168:9977]
2025-10-15T11:02:39.666032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:39.666058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:39.666134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:39.667098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:39.667502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402277058815074:5602]
2025-10-15T11:02:39.667581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:39.667688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:39.667699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:39.675644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1082 reason: error at write: Disconnected sessionId: src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0
2025-10-15T11:02:39.675946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1082 sessionId: src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0 is DEAD
2025-10-15T11:02:39.676653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:39.676711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0] Write session will restart in 0.005506s
2025-10-15T11:02:39.676860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0] Write session: Do CDS request
2025-10-15T11:02:39.676897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:39.690569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:39.690624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1083
2025-10-15T11:02:39.696298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:39.697807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:39.697951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:39.697973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:39.697982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:39.699100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1083 sessionId:  describe result for acl check
2025-10-15T11:02:39.699189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:39.699199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:39.699207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:39.699222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402277058815128:4247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:39.701461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402277058815128:4247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:39.714742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402277058815128:4247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:39.726842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402277058815128:4247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:39.726883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402277058815128:4247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:39.726899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402277058815128:4247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:39.726928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:39.768432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402277058815259:5602]
2025-10-15T11:02:39.787511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:39.789591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:39.790413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:39.790431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:39.790471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:39.790695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:39.790866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402279858504364:9983]
2025-10-15T11:02:39.792963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:39.794058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:39.794238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:39.795485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:39.795821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:39.795829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:39.795835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:39.795841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:39.795848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:39.795854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:39.795860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:39.795868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:39.795874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:39.795880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:39.795886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:39.795893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.795899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.795906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.795949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:39.796048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:39.796092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:39.796136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:39.796181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:39.796228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:39.796270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:39.796312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:39.796354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:39.796401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:39.796446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:39.796489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.796533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.796575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.796610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:39.796671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:39.796726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:39.796781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:39.796827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:39.796875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:39.796916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:39.796968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:39.797009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:39.797058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:39.797100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:39.797148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:39.797191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:39.797240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:39.797281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:39.797330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:39.797372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:39.797425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:39.797467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:39.797515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:39.797559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:39.797608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:39.797648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.797695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.797737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.797788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.797833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.797896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.798359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:39.830409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:39.850527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:39.850569Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:39.850583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:39.850599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:39.850619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1082 [2:7561402279858504364:9983]
2025-10-15T11:02:39.850667Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:39.850717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:39.850730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:39.850741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:39.850752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:39.850795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:39.850814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:39.850833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:39.852102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.852115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.852128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.852138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:39.855218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:39.855496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1082, pipe: [1:7561402277058815259:5602]
2025-10-15T11:02:39.855562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1082
2025-10-15T11:02:39.855588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1082
2025-10-15T11:02:39.855330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:39.855481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:39.855656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:39.855857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:39.855895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402277058815259:5602], now have 1 active actors on pipe
2025-10-15T11:02:39.855916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402277058815118:2467], now have 1 active actors on pipe
2025-10-15T11:02:39.855935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402277058815163:4247], now have 1 active actors on pipe
2025-10-15T11:02:39.856024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:39.856043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:39.856074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402279858504359:9983]
2025-10-15T11:02:39.856087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402279858504359:9983]
2025-10-15T11:02:39.856098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402279858504359:9983]
2025-10-15T11:02:39.856136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:39.856175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:39.856189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:39.856197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:39.856199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:39.856353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:39.856368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:39.856425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0993343-43d73024-32f10de9-23643122_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:39.856453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:39.856470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:39.856478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:39.856510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:39.856547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:39.856656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402279858504359:9983]
2025-10-15T11:02:39.856685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:39.856704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:39.856725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:39.859755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:39.859783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:39.859845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:39.860110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1083 partition: 0 MaxSeqNo: 46 sessionId: src_id|f0993343-43d73024-32f10de9-23643122_0
2025-10-15T11:02:39.861066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad23ea0-c0852f2f-a87b4ede-52650a0_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f0993343-43d73024-32f10de9-23643122_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:39.911175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0993343-43d73024-32f10de9-23643122_0] Write session: try to update token
2025-10-15T11:02:39.911225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0993343-43d73024-32f10de9-23643122_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:40.029810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:40.029850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:40.029860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:40.029909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:40.029923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:40.029934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:40.029943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:40.029972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402279858504359:9983]
2025-10-15T11:02:40.029995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402279858504359:9983]
2025-10-15T11:02:40.030018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402279858504359:9983]
2025-10-15T11:02:40.030198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:40.030221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:40.031167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:40.031680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:40.031728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:40.031751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:40.071583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId: src_id|f0993343-43d73024-32f10de9-23643122_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:40.097304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:40.171443Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:40.182727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:40.182774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:40.182842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:40.182856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:40.182897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402279858504359:9983]
2025-10-15T11:02:40.183542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:40.184387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:40.184041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402277058815259:5602]
2025-10-15T11:02:40.184142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:40.184263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:40.184274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:40.224202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1083 reason: error at write: Disconnected sessionId: src_id|f0993343-43d73024-32f10de9-23643122_0
2025-10-15T11:02:40.224505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1083 sessionId: src_id|f0993343-43d73024-32f10de9-23643122_0 is DEAD
2025-10-15T11:02:40.225074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0993343-43d73024-32f10de9-23643122_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:40.225143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0993343-43d73024-32f10de9-23643122_0] Write session will restart in 0.006153s
2025-10-15T11:02:40.225328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0993343-43d73024-32f10de9-23643122_0] Write session: Do CDS request
2025-10-15T11:02:40.225392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0993343-43d73024-32f10de9-23643122_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:40.242671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0993343-43d73024-32f10de9-23643122_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:40.243620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:40.243653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1084
2025-10-15T11:02:40.247625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:40.247759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:40.247774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:40.247784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:40.249785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1084 sessionId:  describe result for acl check
2025-10-15T11:02:40.249906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:40.249915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:40.249925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:40.249941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402281353782649:4240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:40.252528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402281353782649:4240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:40.265925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402281353782649:4240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:40.276446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402281353782649:4240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:40.276488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402281353782649:4240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:40.276502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402281353782649:4240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:40.276531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:40.280170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:40.283626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402281353782752:5602]
2025-10-15T11:02:40.285521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:40.286380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:40.286401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:40.286444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:40.286690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:40.286888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402284153471855:9997]
2025-10-15T11:02:40.289032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:40.290416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:40.290647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:40.291964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:40.292305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:40.292313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:40.292320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:40.292327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:40.292333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:40.292340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:40.292346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:40.292352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:40.292359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:40.292366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:40.292372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:40.292378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.292385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.292392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.292437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:40.292542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:40.292589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:40.292634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:40.292679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:40.292723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:40.292768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:40.292824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:40.292868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:40.292913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:40.292955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:40.293001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.293045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.293092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.293135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:40.293208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:40.293264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:40.293319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:40.293383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:40.293439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:40.293480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:40.293535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:40.293583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:40.293640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:40.293682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:40.293733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:40.293779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:40.293847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:40.293890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:40.293943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:40.293989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:40.294050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:40.294092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:40.294140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:40.294178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:40.294225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:40.294265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.294315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.294362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.294400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.294430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.294464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.294909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:40.318533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:40.327199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:40.327238Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:40.327255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:40.327273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:40.327297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1083 [2:7561402284153471855:9997]
2025-10-15T11:02:40.328777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:40.328847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:40.328862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:40.328874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:40.328884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:40.328948Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:40.328971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:40.329000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:40.355448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.355467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.355474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.355482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:40.355718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:40.355732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.355830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.355930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.356048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:40.356089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402284153471849:9997]
2025-10-15T11:02:40.356099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402284153471849:9997]
2025-10-15T11:02:40.356106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402284153471849:9997]
2025-10-15T11:02:40.356131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:40.356174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:40.356282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:40.356291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:40.356370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402284153471849:9997]
2025-10-15T11:02:40.356380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:40.356406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:40.356410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402281353782748:4240], now have 1 active actors on pipe
2025-10-15T11:02:40.356418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:40.356428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:40.356436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402281353782752:5602], now have 1 active actors on pipe
2025-10-15T11:02:40.356450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:40.356472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402281353782592:2467], now have 1 active actors on pipe
2025-10-15T11:02:40.360530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1083
2025-10-15T11:02:40.360637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1083, pipe: [1:7561402281353782752:5602]
2025-10-15T11:02:40.360711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1083
2025-10-15T11:02:40.363485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:40.363526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:40.363622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:40.363655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:40.363672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:40.363683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:40.363716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:40.363758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:40.363807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:40.370007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1084 partition: 0 MaxSeqNo: 46 sessionId: src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0
2025-10-15T11:02:40.368346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:40.368384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:40.368485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:40.371805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0993343-43d73024-32f10de9-23643122_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:40.411485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0] Write session: try to update token
2025-10-15T11:02:40.411555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:40.431455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:40.431485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:40.431497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:40.500594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:40.500624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:40.500638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:40.500650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:40.500682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402284153471849:9997]
2025-10-15T11:02:40.500707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402284153471849:9997]
2025-10-15T11:02:40.500734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402284153471849:9997]
2025-10-15T11:02:40.500864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:40.500891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:40.501338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:40.501376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:40.501403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:40.501855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:40.579444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId: src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:40.599631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:40.719866Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:40.722006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:40.722033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:40.725777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:40.725593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402281353782752:5602]
2025-10-15T11:02:40.725683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:40.725843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:40.725857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:40.745893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1084 reason: error at write: Disconnected sessionId: src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0
2025-10-15T11:02:40.746292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1084 sessionId: src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0 is DEAD
2025-10-15T11:02:40.751606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:40.751645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0] Write session will restart in 0.009769s
2025-10-15T11:02:40.751814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0] Write session: Do CDS request
2025-10-15T11:02:40.751857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:40.770043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:40.782857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:40.782890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1085
2025-10-15T11:02:40.785828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:40.785984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:40.786002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:40.786011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:40.788959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1085 sessionId:  describe result for acl check
2025-10-15T11:02:40.789080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:40.789092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:40.789103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:40.789121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402281353782810:4205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:40.792223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402281353782810:4205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:40.800212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402281353782810:4205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:40.817485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402281353782810:4205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:40.817531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402281353782810:4205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:40.817550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402281353782810:4205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:40.817583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:40.824170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402281353782842:5602]
2025-10-15T11:02:40.934019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:40.946704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:40.947672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:40.947702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:40.947744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:40.948032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:40.948220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402284153472032:10000]
2025-10-15T11:02:40.950395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:40.958401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:40.958671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:40.960028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:40.960380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:40.960388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:40.960395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:40.960402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:40.960410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:40.960416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:40.960423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:40.960430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:40.960437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:40.960443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:40.960450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:40.960456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.960463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.960470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.960514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:40.960616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:40.960664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:40.960709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:40.960753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:40.960797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:40.960841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:40.960883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:40.960928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:40.960974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:40.961015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:40.961058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.961099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.961147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.961192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:40.961257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:40.961312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:40.961363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:40.961411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:40.961474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:40.961517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:40.962534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:40.962599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:40.962655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:40.962699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:40.962748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:40.962808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:40.962860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:40.962903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:40.962964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:40.963014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:40.963064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:40.963105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:40.963155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:40.963200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:40.963251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:40.963295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.963359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:40.963407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.963462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:40.963506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.963565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:40.964043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:40.998008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:41.017002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:41.017054Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:41.017075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:41.017098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:41.017128Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1084 [2:7561402284153472032:10000]
2025-10-15T11:02:41.017187Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:41.017255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:41.017273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:41.017287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:41.017299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:41.017352Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:41.017375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:41.017400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:41.018424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:41.018442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:41.018469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:41.018482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:41.018778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:41.018798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:41.018958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:41.019171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:41.020104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:41.020212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402281353782797:2467], now have 1 active actors on pipe
2025-10-15T11:02:41.020241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402281353782842:5602], now have 1 active actors on pipe
2025-10-15T11:02:41.020266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402281353782840:4205], now have 1 active actors on pipe
2025-10-15T11:02:41.020297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402284153472026:10000]
2025-10-15T11:02:41.020312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402284153472026:10000]
2025-10-15T11:02:41.020327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402284153472026:10000]
2025-10-15T11:02:41.020368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:41.020449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:41.020647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:41.020667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:41.020796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402284153472026:10000]
2025-10-15T11:02:41.020818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:41.021198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:41.021211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:41.021220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:41.021238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:41.023575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1084
2025-10-15T11:02:41.023676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1084, pipe: [1:7561402281353782842:5602]
2025-10-15T11:02:41.023768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1084
2025-10-15T11:02:41.023993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:41.024041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:41.024143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:41.024176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:41.024197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:41.024217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:41.024268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:41.024326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:41.024375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:41.028458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:41.028498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:41.028586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:41.032831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1085 partition: 0 MaxSeqNo: 46 sessionId: src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0
2025-10-15T11:02:41.035606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6113a86-8b14bd50-32db0da2-78cbd18e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:41.081117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0] Write session: try to update token
2025-10-15T11:02:41.081192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:41.198032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:41.198066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:41.198078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:41.198139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:41.198155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:41.198168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:41.198179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:41.198218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402284153472026:10000]
2025-10-15T11:02:41.198246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402284153472026:10000]
2025-10-15T11:02:41.198273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402284153472026:10000]
2025-10-15T11:02:41.198477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:41.198499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:41.199565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:41.199612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:41.199646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:41.209454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:41.283448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId: src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:41.320061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:41.376427Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:41.400482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:41.400531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:41.400594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:41.400607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:41.400652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402284153472026:10000]
2025-10-15T11:02:41.401199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:41.402216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:41.407407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:41.407556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402281353782842:5602]
2025-10-15T11:02:41.407631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:41.474060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1085 reason: status is not ok: tablet will be restarted right now sessionId: src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0
2025-10-15T11:02:41.474344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1085 sessionId: src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0 is DEAD
2025-10-15T11:02:41.475203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:41.475233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0] Write session will restart in 0.009435s
2025-10-15T11:02:41.475326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0] Write session: Do CDS request
2025-10-15T11:02:41.475371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:41.491811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:41.491841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1086
2025-10-15T11:02:41.493016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:41.499562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:41.499692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:41.499708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:41.499717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:41.501824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1086 sessionId:  describe result for acl check
2025-10-15T11:02:41.501931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:41.501941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:41.501950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:41.501965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402285648750375:4198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:41.504551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402285648750375:4198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:41.507707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402285648750391:5602]
2025-10-15T11:02:41.528536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402285648750375:4198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:41.542217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402285648750375:4198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:41.542269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402285648750375:4198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:41.542287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402285648750375:4198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:41.542320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:41.549815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:41.555434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:41.556412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:41.556435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:41.556483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:41.556790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:41.556983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402288448439523:10011]
2025-10-15T11:02:41.559238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:41.560535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:41.560770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:41.562198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:41.562555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:41.562564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:41.562571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:41.562579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:41.562586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:41.562594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:41.562602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:41.562609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:41.562617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:41.562624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:41.562632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:41.562639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:41.562647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:41.562654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:41.562704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:41.562824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:41.562874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:41.562924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:41.562969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:41.563020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:41.563070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:41.563120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:41.563170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:41.563222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:41.563274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:41.563324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:41.563847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:41.563892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:41.563938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:41.563992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:41.564036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:41.564077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:41.564111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:41.564150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:41.564184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:41.564226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:41.564263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:41.564302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:41.564336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:41.564376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:41.564410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:41.564462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:41.564502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:41.564545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:41.564591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:41.564646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:41.564680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:41.564719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:41.564753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:41.564791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:41.564826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:41.564868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:41.564900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:41.564938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:41.564973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:41.565013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:41.565373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:41.587009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:41.624486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:41.624532Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:41.624550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:41.624571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:41.624598Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1085 [2:7561402288448439523:10011]
2025-10-15T11:02:41.624650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:41.624711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:41.624728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:41.624741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:41.624752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:41.624804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:41.624829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:41.624852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:41.634713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:41.634746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:41.634761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:41.634773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:41.635055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:41.635073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:41.635225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:41.636105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:41.636367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:41.636453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402285648750448:4198], now have 1 active actors on pipe
2025-10-15T11:02:41.636480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402285648750391:5602], now have 1 active actors on pipe
2025-10-15T11:02:41.636502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402285648750286:2467], now have 1 active actors on pipe
2025-10-15T11:02:41.636528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402288448439517:10011]
2025-10-15T11:02:41.636543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402288448439517:10011]
2025-10-15T11:02:41.636557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402288448439517:10011]
2025-10-15T11:02:41.636593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:41.636674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:41.636870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:41.636887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:41.637013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402288448439517:10011]
2025-10-15T11:02:41.637033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:41.637628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:41.637645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:41.637658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:41.637682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:41.639554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1085
2025-10-15T11:02:41.639644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1085, pipe: [1:7561402285648750391:5602]
2025-10-15T11:02:41.639719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1085
2025-10-15T11:02:41.643388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:41.643429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:41.643529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:41.643569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:41.643589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:41.643601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:41.643639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:41.643687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:41.643741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:41.647671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:41.647710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:41.647794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:41.648314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1086 partition: 0 MaxSeqNo: 46 sessionId: src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0
2025-10-15T11:02:41.651862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21796420-9215c301-e5bcd0f9-d24d3d41_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:41.686257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0] Write session: try to update token
2025-10-15T11:02:41.686314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:41.848356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:41.848390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:41.848403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:41.848462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:41.848479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:41.848493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:41.848505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:41.848541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402288448439517:10011]
2025-10-15T11:02:41.848570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402288448439517:10011]
2025-10-15T11:02:41.848593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402288448439517:10011]
2025-10-15T11:02:41.848792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:41.848826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:41.849193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:41.849237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:41.849268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:41.865620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:41.874086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId: src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:41.894567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:42.029284Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:42.039839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:42.039873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:42.039921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:42.039930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:42.039967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402288448439517:10011]
2025-10-15T11:02:42.040318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:42.041597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:42.043519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:42.043566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:42.060255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402285648750391:5602]
2025-10-15T11:02:42.060330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:42.060434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1086 reason: error at write: Disconnected sessionId: src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0
2025-10-15T11:02:42.060706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1086 sessionId: src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0 is DEAD
2025-10-15T11:02:42.063798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:42.063844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0] Write session will restart in 0.006972s
2025-10-15T11:02:42.063943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0] Write session: Do CDS request
2025-10-15T11:02:42.063969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:42.078960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:42.094129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:42.094180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1087
2025-10-15T11:02:42.095659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:42.095805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:42.095822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:42.095832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:42.097690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1087 sessionId:  describe result for acl check
2025-10-15T11:02:42.097829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:42.097842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:42.097852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:42.097871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402289943717806:4189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:42.101019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402289943717806:4189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:42.114999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402289943717806:4189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:42.125153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402289943717806:4189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:42.125196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402289943717806:4189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:42.125214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402289943717806:4189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:42.125237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:42.163806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402289943717954:5602]
2025-10-15T11:02:42.168089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:42.180613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:42.181422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:42.181440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:42.181480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:42.181667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:42.181812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402292743407009:10019]
2025-10-15T11:02:42.183113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:42.184301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:42.184437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:42.185214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:42.185417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:42.185421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:42.185426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:42.185430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:42.185434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:42.185438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:42.185443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:42.185446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:42.185450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:42.185454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:42.185458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:42.185463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.185466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.185470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.185500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:42.185570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:42.185600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:42.185630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:42.185661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:42.185691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:42.185736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:42.185765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:42.185792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:42.185822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:42.185851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:42.185880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.185908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.185936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.185960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:42.185999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:42.186035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:42.186069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:42.186097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:42.186139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:42.186686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:42.186733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:42.186767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:42.186799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:42.186828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:42.186861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:42.186898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:42.186989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:42.187021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:42.187053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:42.187085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:42.187120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:42.187148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:42.187183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:42.187219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:42.187256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:42.187285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.187321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.187378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.187430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.187471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.187520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.187933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:42.212259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:42.256448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:42.256491Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:42.256508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:42.256529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:42.256555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1086 [2:7561402292743407009:10019]
2025-10-15T11:02:42.256604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:42.256661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:42.256676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:42.256688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:42.256701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:42.256750Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:42.256772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:42.256795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:42.258318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.258336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.258351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.258362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:42.258633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:42.258651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.258788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.258974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.259199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:42.259271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402292743407004:10019]
2025-10-15T11:02:42.259287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402292743407004:10019]
2025-10-15T11:02:42.259300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402292743407004:10019]
2025-10-15T11:02:42.259568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:42.259582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:42.259595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:42.260565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:42.260660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:42.260855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:42.260872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:42.260922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402289943717797:2467], now have 1 active actors on pipe
2025-10-15T11:02:42.260945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402289943717837:4189], now have 1 active actors on pipe
2025-10-15T11:02:42.260977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402289943717954:5602], now have 1 active actors on pipe
2025-10-15T11:02:42.261094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402292743407004:10019]
2025-10-15T11:02:42.261119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:42.261486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:42.268342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1086
2025-10-15T11:02:42.268448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1086
2025-10-15T11:02:42.268506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1086, pipe: [1:7561402289943717954:5602]
2025-10-15T11:02:42.269023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:42.269056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:42.269132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db854380-58a48f55-b89e0dce-8107c16c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:42.269165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:42.269182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:42.269193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:42.269228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:42.269266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:42.269308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:42.269972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:42.269997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:42.270057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:42.271127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffabc7f3-facc030a-5ad1adf4-1ce39db3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|db854380-58a48f55-b89e0dce-8107c16c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:42.270397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1087 partition: 0 MaxSeqNo: 46 sessionId: src_id|db854380-58a48f55-b89e0dce-8107c16c_0
2025-10-15T11:02:42.311599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db854380-58a48f55-b89e0dce-8107c16c_0] Write session: try to update token
2025-10-15T11:02:42.311655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db854380-58a48f55-b89e0dce-8107c16c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:42.418423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:42.421425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:42.421450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:42.421520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:42.421536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:42.421552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:42.421564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:42.421601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402292743407004:10019]
2025-10-15T11:02:42.421628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402292743407004:10019]
2025-10-15T11:02:42.421653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402292743407004:10019]
2025-10-15T11:02:42.421860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:42.421883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:42.423552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:42.423599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:42.423633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:42.425495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:42.479246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId: src_id|db854380-58a48f55-b89e0dce-8107c16c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:42.506444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:42.578252Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:42.593814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:42.593866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:42.593941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:42.593957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:42.593999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402292743407004:10019]
2025-10-15T11:02:42.594245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:42.594554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:42.598669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:42.599292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402289943717954:5602]
2025-10-15T11:02:42.599437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:42.632375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1087 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db854380-58a48f55-b89e0dce-8107c16c_0
2025-10-15T11:02:42.632748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1087 sessionId: src_id|db854380-58a48f55-b89e0dce-8107c16c_0 is DEAD
2025-10-15T11:02:42.636009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db854380-58a48f55-b89e0dce-8107c16c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:42.636045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db854380-58a48f55-b89e0dce-8107c16c_0] Write session will restart in 0.007450s
2025-10-15T11:02:42.636151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db854380-58a48f55-b89e0dce-8107c16c_0] Write session: Do CDS request
2025-10-15T11:02:42.636182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db854380-58a48f55-b89e0dce-8107c16c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:42.652283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:42.652319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1088
2025-10-15T11:02:42.656178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db854380-58a48f55-b89e0dce-8107c16c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:42.657178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:42.657323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:42.657341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:42.657350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:42.659623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1088 sessionId:  describe result for acl check
2025-10-15T11:02:42.659738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:42.659749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:42.659761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:42.659779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402289943718019:4167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:42.666153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402289943718019:4167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:42.687211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402289943718019:4167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:42.699373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402289943718117:5602]
2025-10-15T11:02:42.700164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402289943718019:4167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:42.700201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402289943718019:4167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:42.700218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402289943718019:4167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:42.700251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:42.730368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:42.734406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:42.735113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:42.735126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:42.735156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:42.735366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:42.735551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402292743407201:10024]
2025-10-15T11:02:42.737096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:42.738051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:42.738235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:42.739209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:42.739479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:42.739485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:42.739490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:42.739495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:42.739500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:42.739505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:42.739509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:42.739513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:42.739518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:42.739523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:42.739527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:42.739535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.739542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.739549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.739588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:42.739685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:42.739722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:42.739758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:42.739797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:42.739845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:42.739878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:42.739914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:42.739948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:42.739983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:42.740018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:42.740055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.740090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.740123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.740157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:42.740212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:42.740255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:42.740306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:42.740355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:42.740394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:42.740426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:42.740467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:42.740500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:42.740536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:42.740575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:42.740630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:42.740682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:42.740722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:42.740755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:42.740793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:42.740838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:42.740894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:42.740936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:42.740993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:42.741045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:42.741101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:42.741138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.741185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.741233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.741274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.741309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.741364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.741814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:42.773357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:42.787558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:42.787596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:42.787611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:42.787632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:42.787660Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1087 [2:7561402292743407201:10024]
2025-10-15T11:02:42.787715Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:42.787778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:42.787794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:42.787808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:42.787821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:42.787875Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:42.787899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:42.787923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:42.800823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.800848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.800858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.800866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:42.801125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:42.801137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:42.801273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:42.801418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:42.801616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:42.801684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402289943718120:4167], now have 1 active actors on pipe
2025-10-15T11:02:42.801701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402289943718117:5602], now have 1 active actors on pipe
2025-10-15T11:02:42.801717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402289943717993:2467], now have 1 active actors on pipe
2025-10-15T11:02:42.801738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402292743407196:10024]
2025-10-15T11:02:42.801750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402292743407196:10024]
2025-10-15T11:02:42.801759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402292743407196:10024]
2025-10-15T11:02:42.801787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:42.801842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:42.801988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:42.801999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:42.802108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402292743407196:10024]
2025-10-15T11:02:42.802122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:42.802809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:42.802824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:42.802832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:42.802850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:42.805243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1087
2025-10-15T11:02:42.805330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1087, pipe: [1:7561402289943718117:5602]
2025-10-15T11:02:42.805402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1087
2025-10-15T11:02:42.812925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:42.812972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:42.813086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:42.813118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:42.813135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:42.813160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:42.813196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:42.813237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:42.813286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:42.827684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:42.827732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:42.827824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:42.831730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1088 partition: 0 MaxSeqNo: 46 sessionId: src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0
2025-10-15T11:02:42.835945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db854380-58a48f55-b89e0dce-8107c16c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:42.884908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0] Write session: try to update token
2025-10-15T11:02:42.884970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:42.895459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:42.895491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:42.895503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:43.054994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId: src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:43.100556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:43.128344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:43.128379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:43.128394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:43.128404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:43.128446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402292743407196:10024]
2025-10-15T11:02:43.128472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402292743407196:10024]
2025-10-15T11:02:43.128508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402292743407196:10024]
2025-10-15T11:02:43.128682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:43.128697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:43.128708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:43.128865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:43.128892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:43.128928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:43.128949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:43.130021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:43.131516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:43.131552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:43.131585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:43.276674Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:43.288699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:43.288732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:43.288780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402292743407196:10024]
2025-10-15T11:02:43.289177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:43.289412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:43.291097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:43.291456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402289943718117:5602]
2025-10-15T11:02:43.291592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:43.331282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1088 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0
2025-10-15T11:02:43.331656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1088 sessionId: src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0 is DEAD
2025-10-15T11:02:43.336122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:43.336187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0] Write session will restart in 0.005323s
2025-10-15T11:02:43.336371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0] Write session: Do CDS request
2025-10-15T11:02:43.336423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:43.348830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:43.349393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:43.349440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1089
2025-10-15T11:02:43.349843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:43.349948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:43.349961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:43.349970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:43.353160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1089 sessionId:  describe result for acl check
2025-10-15T11:02:43.353295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:43.353311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:43.353322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:43.353340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402294238685501:4149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:43.356297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402294238685501:4149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:43.369455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402294238685501:4149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:43.383905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402294238685501:4149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:43.383947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402294238685501:4149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:43.383965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402294238685501:4149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:43.383994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:43.391479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402294238685590:5602]
2025-10-15T11:02:43.428178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:43.432468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:43.433242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:43.433256Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:43.433297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:43.433522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:43.433712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402297038374712:10033]
2025-10-15T11:02:43.436047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:43.436966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:43.437146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:43.438323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:43.438616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:43.438623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:43.438630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:43.438636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:43.438644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:43.438652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:43.438658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:43.438665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:43.438672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:43.438679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:43.438685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:43.438692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.438698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.438705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.438746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:43.438847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:43.438894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:43.438939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:43.438982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:43.439028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:43.439070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:43.439112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:43.439667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:43.439724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:43.439769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:43.439813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.439855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.439900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.439944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:43.440005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:43.440061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:43.440114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:43.440162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:43.440216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:43.440258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:43.440310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:43.440354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:43.440406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:43.440451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:43.440503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:43.440550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:43.440606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:43.440653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:43.440703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:43.440748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:43.440797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:43.440842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:43.440894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:43.440940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:43.440988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:43.441032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.441084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.441127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.441178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.441221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.441273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.441755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:43.468296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:43.479311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:43.479364Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:43.479382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:43.479400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:43.479424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1088 [2:7561402297038374712:10033]
2025-10-15T11:02:43.479472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:43.479526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:43.479540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:43.479552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:43.479563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:43.479607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:43.479627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:43.479649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:43.480750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.480772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.480785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.480796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:43.482807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1088, pipe: [1:7561402294238685590:5602]
2025-10-15T11:02:43.481053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:43.481070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.482897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1088
2025-10-15T11:02:43.481202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.482959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1088
2025-10-15T11:02:43.481380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.481620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:43.481692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402297038374707:10033]
2025-10-15T11:02:43.481706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402297038374707:10033]
2025-10-15T11:02:43.481719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402297038374707:10033]
2025-10-15T11:02:43.481758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:43.481825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:43.481882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:43.481897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:43.481910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:43.482023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:43.482041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:43.482153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402297038374707:10033]
2025-10-15T11:02:43.482173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:43.482205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:43.482251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402294238685590:5602], now have 1 active actors on pipe
2025-10-15T11:02:43.482275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402294238685570:4149], now have 1 active actors on pipe
2025-10-15T11:02:43.482324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402294238685489:2467], now have 1 active actors on pipe
2025-10-15T11:02:43.483177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:43.483199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:43.483259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:43.483287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:43.483303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:43.483313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:43.483361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:43.483400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:43.483444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:43.484528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:43.484558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:43.484635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:43.484942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1089 partition: 0 MaxSeqNo: 46 sessionId: src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0
2025-10-15T11:02:43.489060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5521124d-b823b1fc-1ee0486e-b5eb1791_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:43.525550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0] Write session: try to update token
2025-10-15T11:02:43.525619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:43.605038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:43.605063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:43.605073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:43.605125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:43.605137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:43.605149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:43.605158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:43.605188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402297038374707:10033]
2025-10-15T11:02:43.605223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402297038374707:10033]
2025-10-15T11:02:43.605248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402297038374707:10033]
2025-10-15T11:02:43.605368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:43.605391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:43.605659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:43.605691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:43.605716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:43.620480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:43.732902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId: src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:43.781882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:43.837183Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:43.839162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:43.839190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:43.842827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:43.843512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402294238685590:5602]
2025-10-15T11:02:43.843598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:43.859749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:43.859871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1089 reason: status is not ok: tablet will be restarted right now sessionId: src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0
2025-10-15T11:02:43.860161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1089 sessionId: src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0 is DEAD
2025-10-15T11:02:43.867858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:43.867908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0] Write session will restart in 0.007222s
2025-10-15T11:02:43.868023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0] Write session: Do CDS request
2025-10-15T11:02:43.868057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:43.888923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:43.899343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:43.899403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1090
2025-10-15T11:02:43.900102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:43.900341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:43.900372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:43.900388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:43.904801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1090 sessionId:  describe result for acl check
2025-10-15T11:02:43.904916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:43.904926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:43.904936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:43.904952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402294238685720:4130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:43.907321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402294238685720:4130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:43.919820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402294238685720:4130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:43.941282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402294238685720:4130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:43.941325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402294238685720:4130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:43.941341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402294238685720:4130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:43.941371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:43.947521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402294238685859:5602]
2025-10-15T11:02:43.966220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:43.968753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:43.969558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:43.969587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:43.969644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:43.969888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:43.970103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402297038374887:10042]
2025-10-15T11:02:43.972226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:43.975867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:43.976106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:43.977655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:43.978029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:43.978038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:43.978044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:43.978050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:43.978057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:43.978065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:43.978073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:43.978079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:43.978086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:43.978093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:43.978101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:43.978107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.978115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.978122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.978263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:43.978373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:43.978422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:43.978472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:43.978536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:43.978579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:43.978627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:43.978671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:43.978715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:43.978762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:43.978817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:43.978861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.978905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.978947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.978990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:43.979055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:43.979112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:43.979163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:43.979207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:43.979253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:43.979296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:43.979357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:43.979403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:43.979453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:43.979496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:43.979545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:43.979588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:43.979640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:43.979683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:43.979734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:43.979783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:43.979833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:43.979876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:43.979927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:43.979972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:43.980024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:43.980068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.980120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:43.980166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.980218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:43.980261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.980310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:43.980795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:44.003664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:44.017889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:44.017923Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:44.017938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:44.017955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:44.017978Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1089 [2:7561402297038374887:10042]
2025-10-15T11:02:44.018023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:44.018071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:44.018083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:44.018095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:44.018106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:44.018148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:44.018169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:44.018189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:44.031496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:44.031520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:44.031532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:44.031543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:44.031743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:44.031753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:44.031837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:44.031938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:44.032064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:44.032107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402297038374882:10042]
2025-10-15T11:02:44.032116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402297038374882:10042]
2025-10-15T11:02:44.032124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402297038374882:10042]
2025-10-15T11:02:44.032157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:44.032210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:44.032224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:44.032224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:44.032234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:44.032384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:44.032401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:44.032511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402297038374882:10042]
2025-10-15T11:02:44.032530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:44.032538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:44.032577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402294238685859:5602], now have 1 active actors on pipe
2025-10-15T11:02:44.032598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402294238685856:4130], now have 1 active actors on pipe
2025-10-15T11:02:44.032611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402294238685700:2467], now have 1 active actors on pipe
2025-10-15T11:02:44.033907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1089, pipe: [1:7561402294238685859:5602]
2025-10-15T11:02:44.034037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1089
2025-10-15T11:02:44.034130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1089
2025-10-15T11:02:44.034545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:44.034576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:44.034661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:44.034692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:44.034709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:44.034718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:44.034751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:44.034791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:44.034833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:44.035554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:44.035595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:44.035676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:44.039778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1090 partition: 0 MaxSeqNo: 46 sessionId: src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0
2025-10-15T11:02:44.044033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73beeb91-8eb2084a-5cb43710-9573da5c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:44.085651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0] Write session: try to update token
2025-10-15T11:02:44.085719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:44.224222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:44.224252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:44.224262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:44.224314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:44.224327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:44.224340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:44.224348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:44.224378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402297038374882:10042]
2025-10-15T11:02:44.224407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402297038374882:10042]
2025-10-15T11:02:44.224433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402297038374882:10042]
2025-10-15T11:02:44.224683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:44.224710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:44.225882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:44.227979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:44.228057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:44.228116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:44.319039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId: src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:44.353643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:44.405063Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:44.421535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:44.421581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:44.421654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:44.421666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:44.421702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402297038374882:10042]
2025-10-15T11:02:44.422767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402294238685859:5602]
2025-10-15T11:02:44.422831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:44.422848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:44.422849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:44.422132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:44.425917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:44.439545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1090 reason: error at write: Disconnected sessionId: src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0
2025-10-15T11:02:44.439899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1090 sessionId: src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0 is DEAD
2025-10-15T11:02:44.443927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:44.443961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0] Write session will restart in 0.008799s
2025-10-15T11:02:44.444063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0] Write session: Do CDS request
2025-10-15T11:02:44.444094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:44.467644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:44.467767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:44.467820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1091
2025-10-15T11:02:44.468366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:44.468568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:44.468603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:44.468622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:44.471409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1091 sessionId:  describe result for acl check
2025-10-15T11:02:44.471520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:44.471530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:44.471539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:44.471555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402298533653201:4118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:44.474105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402298533653201:4118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:44.484006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402298533653201:4118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:44.508774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402298533653201:4118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:44.508817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402298533653201:4118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:44.508832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402298533653201:4118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:44.508860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:44.522715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402298533653262:5602]
2025-10-15T11:02:44.588594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:44.592762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:44.593678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:44.593695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:44.593739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:44.593990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:44.594177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402301333342388:10049]
2025-10-15T11:02:44.596357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:44.597449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:44.597698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:44.598874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:44.599181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:44.599189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:44.599196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:44.599202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:44.599208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:44.599214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:44.599221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:44.599227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:44.599233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:44.599239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:44.599246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:44.599253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:44.599261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:44.599267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:44.599307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:44.599426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:44.599472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:44.599523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:44.599565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:44.599610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:44.599655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:44.599712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:44.599762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:44.599804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:44.599848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:44.599902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:44.599944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:44.599994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:44.600034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:44.600092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:44.600144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:44.600199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:44.600244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:44.600293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:44.600334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:44.600382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:44.600431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:44.600480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:44.600525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:44.600575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:44.600620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:44.600671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:44.600713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:44.600762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:44.600807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:44.600857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:44.601223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:44.601277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:44.601324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:44.601387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:44.601436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:44.601485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:44.601528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:44.601593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:44.601646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:44.601697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:44.602476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:44.631280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:44.651223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:44.651951Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:44.651976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:44.651994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:44.652017Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1090 [2:7561402301333342388:10049]
2025-10-15T11:02:44.652065Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:44.652117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:44.652131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:44.652141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:44.652151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:44.652196Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:44.652216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:44.652235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:44.658823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:44.658851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:44.658863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:44.658873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:44.659132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:44.659146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:44.659274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:44.660752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1090
2025-10-15T11:02:44.660843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1090
2025-10-15T11:02:44.660897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1090, pipe: [1:7561402298533653262:5602]
2025-10-15T11:02:44.661365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:44.661619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:44.661700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402298533653186:2467], now have 1 active actors on pipe
2025-10-15T11:02:44.661723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402298533653242:4118], now have 1 active actors on pipe
2025-10-15T11:02:44.661743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402298533653262:5602], now have 1 active actors on pipe
2025-10-15T11:02:44.661784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:44.661804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:44.661851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402301333342383:10049]
2025-10-15T11:02:44.661864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402301333342383:10049]
2025-10-15T11:02:44.661876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402301333342383:10049]
2025-10-15T11:02:44.661918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:44.661984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:44.662146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:44.662161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:44.662216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:44.662244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:44.662261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:44.662272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:44.662305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:44.662341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:44.662458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402301333342383:10049]
2025-10-15T11:02:44.662477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:44.662518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:44.663647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:44.663668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:44.663678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:44.663698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:44.668154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:44.668198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:44.668287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:44.668801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1091 partition: 0 MaxSeqNo: 46 sessionId: src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0
2025-10-15T11:02:44.669748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b124aa46-96eb52eb-8ae231ba-8ce10001_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:44.735811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0] Write session: try to update token
2025-10-15T11:02:44.735863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:44.755927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:44.755960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:44.755970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:44.898589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:44.898622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:44.898633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:44.898642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:44.898674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402301333342383:10049]
2025-10-15T11:02:44.898697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402301333342383:10049]
2025-10-15T11:02:44.898720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402301333342383:10049]
2025-10-15T11:02:44.898833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:44.898864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:44.898881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:44.898910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:44.898922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:44.898933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:44.898973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:44.898991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:44.900385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:44.929459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId: src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:44.981598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:45.077866Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:45.089799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:45.089843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:45.089910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:45.089925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:45.089964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402301333342383:10049]
2025-10-15T11:02:45.090771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:45.091485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:45.096953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402298533653262:5602]
2025-10-15T11:02:45.097103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:45.097342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:45.116746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1091 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0
2025-10-15T11:02:45.117568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:45.117299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1091 sessionId: src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0 is DEAD
2025-10-15T11:02:45.117616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0] Write session will restart in 0.005311s
2025-10-15T11:02:45.117716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0] Write session: Do CDS request
2025-10-15T11:02:45.117744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:45.160576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:45.193430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:45.193460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1092
2025-10-15T11:02:45.195505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:45.195643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:45.195658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:45.195667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:45.196948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402302828620721:5602]
2025-10-15T11:02:45.198017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1092 sessionId:  describe result for acl check
2025-10-15T11:02:45.198112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:45.198123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:45.198132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:45.198146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402302828620723:4102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:45.200675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402302828620723:4102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:45.214390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402302828620723:4102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:45.229854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402302828620723:4102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:45.229898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402302828620723:4102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:45.229913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402302828620723:4102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:45.229944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:45.242703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:45.248316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:45.249138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:45.249151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:45.249181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:45.249368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:45.249558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402305628309879:10061]
2025-10-15T11:02:45.250995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:45.251945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:45.252102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:45.253150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:45.253427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:45.253435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:45.253443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:45.253450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:45.253457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:45.253462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:45.253466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:45.253471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:45.253476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:45.253480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:45.253485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:45.253489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.253493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.253497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.253532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:45.253644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:45.253681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:45.253714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:45.253746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:45.253779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:45.253810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:45.253852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:45.253895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:45.253931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:45.253963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:45.253996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.254027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.254059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.254085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:45.254142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:45.254194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:45.254233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:45.254266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:45.254306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:45.254336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:45.254379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:45.254424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:45.254476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:45.254509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:45.254548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:45.254579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:45.254619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:45.254663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:45.254703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:45.254734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:45.254770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:45.254804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:45.254841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:45.254875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:45.254922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:45.254954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.254991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.255021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.255057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.255087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.255124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.255785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:45.278884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:45.293228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:45.293277Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:45.293295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:45.293317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:45.293342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1091 [2:7561402305628309879:10061]
2025-10-15T11:02:45.293395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:45.293453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:45.293468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:45.293481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:45.293492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:45.293549Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:45.293572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:45.293594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:45.363392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.363418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.363430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.363440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:45.363695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:45.363715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.363831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.363980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.364161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:45.364222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402305628309873:10061]
2025-10-15T11:02:45.364236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402305628309873:10061]
2025-10-15T11:02:45.364248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402305628309873:10061]
2025-10-15T11:02:45.364284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:45.364345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:45.364499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:45.364524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:45.364629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402305628309873:10061]
2025-10-15T11:02:45.364646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:45.364853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:45.364864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:45.364876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:45.364895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:45.365971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1091, pipe: [1:7561402302828620721:5602]
2025-10-15T11:02:45.366067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1091
2025-10-15T11:02:45.366136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1091
2025-10-15T11:02:45.371650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402302828620721:5602], now have 1 active actors on pipe
2025-10-15T11:02:45.371687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402302828620698:2467], now have 1 active actors on pipe
2025-10-15T11:02:45.371707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402302828620845:4102], now have 1 active actors on pipe
2025-10-15T11:02:45.371750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:45.371771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:45.371859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:45.371888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:45.371905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:45.371915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:45.371947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:45.371986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:45.372030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:45.378261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:45.378299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:45.378377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:45.378856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1092 partition: 0 MaxSeqNo: 46 sessionId: src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0
2025-10-15T11:02:45.383645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0bb20d7-aa6ec77b-22ad2e21-23183425_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:45.395629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:45.395656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:45.395667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:45.435733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0] Write session: try to update token
2025-10-15T11:02:45.435802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:45.509433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:45.509469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:45.509484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:45.509498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:45.509549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402305628309873:10061]
2025-10-15T11:02:45.509579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402305628309873:10061]
2025-10-15T11:02:45.509609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402305628309873:10061]
2025-10-15T11:02:45.509780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:45.509801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:45.509814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:45.509921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:45.509945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:45.510935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:45.511617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:45.511652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:45.511683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:45.607103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId: src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:45.645717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:45.705783Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:45.717656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:45.718121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:45.718212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:45.718247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:45.718297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402305628309873:10061]
2025-10-15T11:02:45.720603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:45.720755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:45.720768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:45.718858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:45.723972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:45.723883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402302828620721:5602]
2025-10-15T11:02:45.723943Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 closed with error: reason# too much attempts to restart pipe
2025-10-15T11:02:45.724342Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 11 consumer shared/user session shared/user_1_11_4626530766257792469_v1 is DEAD
2025-10-15T11:02:45.727687Z :ERROR: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-15T11:02:45.728133Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561402079490306113:5614] disconnected; active server actors: 1
2025-10-15T11:02:45.728184Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561402079490306113:5614] client user disconnected session shared/user_1_11_4626530766257792469_v1
2025-10-15T11:02:45.728438Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In Reconnect, ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T11:02:45.728480Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T11:02:45.728533Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Reconnecting session to cluster  in 0.006268s
2025-10-15T11:02:45.744989Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Successfully connected. Initializing session
2025-10-15T11:02:45.747503Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T11:02:45.747528Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 12
2025-10-15T11:02:45.751732Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 12 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T11:02:45.751920Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 read init: from# ipv6:[::1]:53654, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T11:02:45.752237Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 auth for : user
2025-10-15T11:02:45.753873Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 Handle describe topics response
2025-10-15T11:02:45.753973Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 auth is DEAD
2025-10-15T11:02:45.754024Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 auth ok: topics# 1, initDone# 0
2025-10-15T11:02:45.754965Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T11:02:45.756275Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] Got InitResponse. ReadSessionId: shared/user_1_12_8704868778275197978_v1
2025-10-15T11:02:45.756312Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T11:02:45.756495Z :DEBUG: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T11:02:45.757062Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T11:02:45.757186Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 got read request: guid# 28824f0c-168a0b98-f449424b-c8dcc6d
2025-10-15T11:02:45.758770Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561402302828620927:4092] connected; active server actors: 1
2025-10-15T11:02:45.759241Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561402302828620927:4092] session shared/user_1_12_8704868778275197978_v1
2025-10-15T11:02:45.759282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T11:02:45.759326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T11:02:45.759379Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_12_8704868778275197978_v1" (Sender=[1:7561402302828620919:4092], Pipe=[1:7561402302828620927:4092], Partitions=[], ActiveFamilyCount=0)
2025-10-15T11:02:45.759400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T11:02:45.759465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T11:02:45.759508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_12_8704868778275197978_v1" (Sender=[1:7561402302828620919:4092], Pipe=[1:7561402302828620927:4092], Partitions=[], ActiveFamilyCount=0)
2025-10-15T11:02:45.759556Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_12_8704868778275197978_v1" sender [1:7561402302828620919:4092] lock partition 0 for ReadingSession "shared/user_1_12_8704868778275197978_v1" (Sender=[1:7561402302828620919:4092], Pipe=[1:7561402302828620927:4092], Partitions=[], ActiveFamilyCount=1) generation 1 step 12
2025-10-15T11:02:45.759595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T11:02:45.759618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000132s
2025-10-15T11:02:45.760340Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 12 Session: "shared/user_1_12_8704868778275197978_v1" ClientId: "user" PipeClient { RawX1: 7561402302828620927 RawX2: 4503603922341884 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T11:02:45.760411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T11:02:45.769190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1092 reason: error at write: Disconnected sessionId: src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0
2025-10-15T11:02:45.769480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1092 sessionId: src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0 is DEAD
2025-10-15T11:02:45.772741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:45.772829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0] Write session will restart in 0.005333s
2025-10-15T11:02:45.773041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0] Write session: Do CDS request
2025-10-15T11:02:45.773109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:45.790720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:45.795476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:45.795508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1093
2025-10-15T11:02:45.796260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:45.796388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:45.796404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:45.796413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:45.799751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1093 sessionId:  describe result for acl check
2025-10-15T11:02:45.799866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:45.799877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:45.799885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:45.799900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402302828620979:4080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:45.802459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402302828620979:4080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:45.818302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402302828620979:4080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:45.831939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402302828620979:4080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:45.831980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402302828620979:4080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:45.831996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402302828620979:4080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:45.832028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:45.844907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:45.849648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:45.850435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:45.850458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:45.850498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:45.850681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:45.850799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402305628310076:10067]
2025-10-15T11:02:45.852266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:45.856298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:45.856459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:45.857471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:45.857771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:45.857784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:45.857790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:45.857794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:45.857798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:45.857802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:45.857806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:45.857810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:45.857815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:45.857820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:45.857824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:45.857828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.857832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.857836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.857874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:45.857951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:45.857986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:45.858019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:45.858050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:45.858084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:45.858115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:45.858147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:45.858193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:45.858227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:45.858259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:45.858291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.858320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.858351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.858387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:45.858432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:45.858473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:45.858509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:45.858540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:45.858575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:45.858606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:45.858641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:45.858679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:45.858733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:45.858779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:45.858833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:45.858880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:45.858933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:45.858978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:45.859032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:45.859080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:45.859131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:45.859176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:45.859229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:45.859274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:45.859327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:45.859393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.859448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.859496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.859548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.859594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.859645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.860150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:45.883044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:45.905127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1092, pipe: [1:7561402302828620931:4077]
2025-10-15T11:02:45.905205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1092
2025-10-15T11:02:45.905265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1092
2025-10-15T11:02:45.903329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:45.903381Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:45.903398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:45.903416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:45.903441Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1092 [2:7561402305628310076:10067]
2025-10-15T11:02:45.903487Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:45.903539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:45.903553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:45.903564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:45.903576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:45.903620Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:45.903640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:45.903660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:45.904534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.904550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.904562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.904573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:45.904809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:45.904823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:45.906475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:45.906632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:45.906842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:45.906903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402302828620931:4077], now have 1 active actors on pipe
2025-10-15T11:02:45.906919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402302828621078:4080], now have 1 active actors on pipe
2025-10-15T11:02:45.906933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402302828620913:2467], now have 1 active actors on pipe
2025-10-15T11:02:45.906973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:45.906988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:45.907006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_12_8704868778275197978_v1 on pipe: [1:7561402302828620931:4077]
2025-10-15T11:02:45.907058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:45.907071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:45.907075Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_12_8704868778275197978_v1:1 with generation 1092
2025-10-15T11:02:45.907117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402305628310071:10067]
2025-10-15T11:02:45.907132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402305628310071:10067]
2025-10-15T11:02:45.907142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402305628310071:10067]
2025-10-15T11:02:45.907171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:45.907210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:45.907221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:45.907231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:45.907237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:45.907400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:45.907411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:45.907438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:45.907453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:45.907459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:45.907499Z node 2 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_12_8704868778275197978_v1
2025-10-15T11:02:45.907508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:45.907627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:45.907650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T11:02:45.907764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402305628310071:10067]
2025-10-15T11:02:45.907791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:45.907822Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T11:02:45.907913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:45.915425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T11:02:45.915501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T11:02:45.915524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:45.915547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:45.915559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:45.915596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:45.915637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:45.915663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T11:02:45.915700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T11:02:45.915750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:45.916396Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 46 WriteTimestampMS: 1760525649000 SizeLag: 17206678 WriteTimestampEstimateMS: 1760526165903 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T11:02:45.916443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 readOffset 0 committedOffset 0
2025-10-15T11:02:45.916598Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 sending to client partition status
2025-10-15T11:02:45.917220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:45.917253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:45.917327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:45.917721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1093 partition: 0 MaxSeqNo: 46 sessionId: src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0
2025-10-15T11:02:45.919489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79ed094b-f51e56b9-d06c140d-cffb19c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:45.984025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0] Write session: try to update token
2025-10-15T11:02:45.984094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:46.089135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:46.089183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:46.089207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:46.089284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:46.089318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:46.089341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:46.089368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:46.089419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402305628310071:10067]
2025-10-15T11:02:46.089470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402305628310071:10067]
2025-10-15T11:02:46.089535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402305628310071:10067]
2025-10-15T11:02:46.089704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:46.089764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:46.089833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:46.089838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:46.089868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:46.091595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:46.119463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId: src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:46.160727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:46.241074Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:46.264394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:46.264442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:46.264512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:46.264527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:46.264568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402305628310071:10067]
2025-10-15T11:02:46.267182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:46.267339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402302828620931:4077]
2025-10-15T11:02:46.267440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:46.267451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:46.265862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:46.273407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_12_8704868778275197978_v1
2025-10-15T11:02:46.273446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:46.291614Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_12_8704868778275197978_v1
2025-10-15T11:02:46.310892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1093 reason: error at write: Disconnected sessionId: src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0
2025-10-15T11:02:46.311226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1093 sessionId: src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0 is DEAD
2025-10-15T11:02:46.317402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:46.317438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0] Write session will restart in 0.009186s
2025-10-15T11:02:46.317547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0] Write session: Do CDS request
2025-10-15T11:02:46.317588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:46.334196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:46.339739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:46.339782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1094
2025-10-15T11:02:46.340261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:46.340390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:46.340406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:46.340417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:46.341816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1094 sessionId:  describe result for acl check
2025-10-15T11:02:46.341920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:46.341937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:46.341946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:46.341963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402307123588429:4073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:46.344472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402307123588429:4073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:46.356953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402307123588429:4073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:46.367036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402307123588538:4077]
2025-10-15T11:02:46.370204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402307123588429:4073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:46.370245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402307123588429:4073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:46.370260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402307123588429:4073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:46.370288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:46.388281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:46.392292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:46.393055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:46.393073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:46.393115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:46.393378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:46.393561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402309923277577:10075]
2025-10-15T11:02:46.395721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:46.396684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:46.396892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:46.398075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:46.398376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:46.398384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:46.398393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:46.398400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:46.398406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:46.398413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:46.398420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:46.398427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:46.398433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:46.398441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:46.398448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:46.398454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.398460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.398466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.398511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:46.398623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:46.398670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:46.398717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:46.398759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:46.398801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:46.398846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:46.398888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:46.398929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:46.398972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:46.399013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:46.399055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.399097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.399142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.399182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:46.399244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:46.399299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:46.399366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:46.399416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:46.399467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:46.399509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:46.399565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:46.399614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:46.399667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:46.399713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:46.399762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:46.399806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:46.399858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:46.399903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:46.399954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:46.400000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:46.400051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:46.400095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:46.400146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:46.400192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:46.400242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:46.400286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.400337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.400382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.400433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.400475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.400523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.401029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:46.424712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:46.434009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:46.434049Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:46.434065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:46.434081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:46.434104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1093 [2:7561402309923277577:10075]
2025-10-15T11:02:46.434151Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:46.434205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:46.434218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:46.434228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:46.434240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:46.434280Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:46.434299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:46.434317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:46.435235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.435248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.435261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.435272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:46.435549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:46.435568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.435694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.435864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.436076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:46.436137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402309923277572:10075]
2025-10-15T11:02:46.436152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402309923277572:10075]
2025-10-15T11:02:46.436164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402309923277572:10075]
2025-10-15T11:02:46.436207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:46.436271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:46.436348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:46.436363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:46.436375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:46.436434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:46.436449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:46.436570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402309923277572:10075]
2025-10-15T11:02:46.436588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:46.436638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:46.436667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402307123588538:4077], now have 1 active actors on pipe
2025-10-15T11:02:46.436690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402307123588555:4073], now have 1 active actors on pipe
2025-10-15T11:02:46.436737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402307123588402:2467], now have 1 active actors on pipe
2025-10-15T11:02:46.437904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:46.437936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:46.438016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:46.438042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:46.438059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:46.438068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:46.438096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:46.438130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:46.438191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:46.438724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:46.438744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:46.438863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:46.436968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1093, pipe: [1:7561402307123588538:4077]
2025-10-15T11:02:46.437022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1093
2025-10-15T11:02:46.437042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1093
2025-10-15T11:02:46.439114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1094 partition: 0 MaxSeqNo: 46 sessionId: src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0
2025-10-15T11:02:46.439723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c675a-614bc7fb-6b521d1d-190c2158_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:46.479313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0] Write session: try to update token
2025-10-15T11:02:46.479387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:46.637993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:46.647631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:46.647656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:46.647713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:46.647725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:46.647735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:46.647743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:46.647767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402309923277572:10075]
2025-10-15T11:02:46.647784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402309923277572:10075]
2025-10-15T11:02:46.647799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402309923277572:10075]
2025-10-15T11:02:46.647968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:46.647982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:46.648732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:46.649158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:46.649198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:46.649228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:46.659509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId: src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:46.691634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:46.798264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:46.812049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:46.812090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:46.812146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:46.812159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:46.812196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402309923277572:10075]
2025-10-15T11:02:46.812631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:46.815693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402307123588538:4077]
2025-10-15T11:02:46.815907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:46.815930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:46.813618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:46.827085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1094 reason: error at write: Disconnected sessionId: src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0
2025-10-15T11:02:46.828480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:46.828517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0] Write session will restart in 0.006801s
2025-10-15T11:02:46.828626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0] Write session: Do CDS request
2025-10-15T11:02:46.828655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:46.830258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1094 sessionId: src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0 is DEAD
2025-10-15T11:02:46.843282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:46.849118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:46.849904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:46.849936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1095
2025-10-15T11:02:46.850244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:46.850365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:46.850382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:46.850393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:46.857504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1095 sessionId:  describe result for acl check
2025-10-15T11:02:46.857644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:46.857655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:46.857664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:46.857683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402307123588633:4055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:46.860575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402307123588633:4055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:46.868138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402307123588633:4055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:46.881410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402307123588633:4055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:46.881467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402307123588633:4055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:46.881484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402307123588633:4055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:46.881516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:46.914467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402307123588718:4077]
2025-10-15T11:02:46.948447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:46.960064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:46.960931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:46.960950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:46.960993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:46.961255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:46.961469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402309923277775:10084]
2025-10-15T11:02:46.964094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:46.968329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:46.968570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:46.970043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:46.970515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:46.970524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:46.970531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:46.970538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:46.970552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:46.970561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:46.970573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:46.970581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:46.970589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:46.970597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:46.970604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:46.970611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.970619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.970626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.970675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:46.970795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:46.970845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:46.970895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:46.970942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:46.970991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:46.971039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:46.971084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:46.971131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:46.971178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:46.971268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:46.971409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.971486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.971556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.971605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:46.971701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:46.971763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:46.971820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:46.971872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:46.971937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:46.971993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:46.972048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:46.972099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:46.972168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:46.972215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:46.972270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:46.972344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:46.972468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:46.972562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:46.972633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:46.972684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:46.972737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:46.972781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:46.972835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:46.972883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:46.972937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:46.972983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.973033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:46.973078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.973131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:46.973177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.973227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:46.973788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:46.998456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:47.014910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:47.015144Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:47.015167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:47.015184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:47.015207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1094 [2:7561402309923277775:10084]
2025-10-15T11:02:47.015259Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:47.015315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:47.015329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:47.015341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:47.015371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:47.015420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:47.015442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:47.015462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:47.017189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:47.017205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:47.017219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:47.017228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:47.017499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:47.017516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:47.017652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:47.017839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:47.018067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:47.018132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402309923277770:10084]
2025-10-15T11:02:47.018148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402309923277770:10084]
2025-10-15T11:02:47.018160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402309923277770:10084]
2025-10-15T11:02:47.018289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:47.018302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:47.018312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:47.019296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:47.019404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:47.019545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1094
2025-10-15T11:02:47.019647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1094
2025-10-15T11:02:47.019711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1094, pipe: [1:7561402307123588718:4077]
2025-10-15T11:02:47.022286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1095 partition: 0 MaxSeqNo: 46 sessionId: src_id|b0d79573-de83e13e-bc58677b-45282081_0
2025-10-15T11:02:47.019586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:47.019609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:47.019654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402307123588660:4055], now have 1 active actors on pipe
2025-10-15T11:02:47.019678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402307123588624:2467], now have 1 active actors on pipe
2025-10-15T11:02:47.019699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402307123588718:4077], now have 1 active actors on pipe
2025-10-15T11:02:47.019816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402309923277770:10084]
2025-10-15T11:02:47.019844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:47.020083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:47.020874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:47.020899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:47.020978Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0d79573-de83e13e-bc58677b-45282081_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:47.021005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:47.021022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:47.021032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:47.021062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:47.021098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:47.021141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:47.021793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:47.021825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:47.021883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:47.024021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84f3eafa-e76ee44f-1cf81c1d-20dceaa7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b0d79573-de83e13e-bc58677b-45282081_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:47.087477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d79573-de83e13e-bc58677b-45282081_0] Write session: try to update token
2025-10-15T11:02:47.087548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d79573-de83e13e-bc58677b-45282081_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:47.290667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:47.290703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:47.290715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:47.290775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:47.290789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:47.290802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:47.290811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:47.290848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402309923277770:10084]
2025-10-15T11:02:47.290873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402309923277770:10084]
2025-10-15T11:02:47.290897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402309923277770:10084]
2025-10-15T11:02:47.291030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:47.291064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:47.291093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:47.291109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:47.291132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:47.292817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:47.301007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId: src_id|b0d79573-de83e13e-bc58677b-45282081_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:47.329940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:47.445830Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:47.496772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:47.496826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:47.496911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:47.496926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:47.496974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402309923277770:10084]
2025-10-15T11:02:47.497335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:47.498410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:47.501454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:47.505878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402307123588718:4077]
2025-10-15T11:02:47.506032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:47.519921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1095 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b0d79573-de83e13e-bc58677b-45282081_0
2025-10-15T11:02:47.520314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1095 sessionId: src_id|b0d79573-de83e13e-bc58677b-45282081_0 is DEAD
2025-10-15T11:02:47.523831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d79573-de83e13e-bc58677b-45282081_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:47.523877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d79573-de83e13e-bc58677b-45282081_0] Write session will restart in 0.006213s
2025-10-15T11:02:47.523992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d79573-de83e13e-bc58677b-45282081_0] Write session: Do CDS request
2025-10-15T11:02:47.524028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d79573-de83e13e-bc58677b-45282081_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:47.548693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d79573-de83e13e-bc58677b-45282081_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:47.555071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:47.555110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1096
2025-10-15T11:02:47.555655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:47.555797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:47.555818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:47.555831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:47.559826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1096 sessionId:  describe result for acl check
2025-10-15T11:02:47.559964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:47.559977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:47.559987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:47.560007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402311418556136:4044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:47.566892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402311418556136:4044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:47.582074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402311418556136:4044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:47.596975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402311418556136:4044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:47.597054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402311418556136:4044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:47.597072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402311418556136:4044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:47.597105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:47.605588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402311418556289:4077]
2025-10-15T11:02:47.622241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:47.624641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:47.625425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:47.625440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:47.625478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:47.625704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:47.625878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402314218245269:10089]
2025-10-15T11:02:47.628081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:47.629755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:47.629954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:47.631129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:47.631460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:47.631467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:47.631474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:47.631482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:47.631489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:47.631495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:47.631500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:47.631508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:47.631514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:47.631521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:47.631528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:47.631535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:47.631541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:47.631549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:47.631592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:47.631698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:47.631745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:47.631794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:47.631839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:47.631884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:47.631943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:47.631990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:47.632036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:47.632085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:47.632130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:47.632177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:47.632222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:47.632266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:47.632306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:47.632369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:47.632426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:47.632482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:47.632530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:47.632581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:47.632628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:47.632680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:47.632728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:47.632779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:47.632827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:47.632878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:47.632924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:47.632977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:47.633023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:47.633075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:47.633123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:47.633174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:47.633220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:47.633273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:47.633316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:47.633367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:47.633426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:47.633479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:47.633525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:47.633578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:47.633622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:47.633673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:47.634172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:47.663098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:47.672259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:47.672301Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:47.672319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:47.672338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:47.672362Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1095 [2:7561402314218245269:10089]
2025-10-15T11:02:47.672411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:47.672466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:47.672480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:47.672494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:47.672505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:47.672549Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:47.672571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:47.672589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:47.697833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:47.697855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:47.701201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1095, pipe: [1:7561402311418556289:4077]
2025-10-15T11:02:47.697864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:47.701305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1095
2025-10-15T11:02:47.697873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:47.701375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1095
2025-10-15T11:02:47.698130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:47.698144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:47.698252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:47.698401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:47.698589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:47.698658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402311418556123:2467], now have 1 active actors on pipe
2025-10-15T11:02:47.698678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402311418556289:4077], now have 1 active actors on pipe
2025-10-15T11:02:47.698696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402311418556269:4044], now have 1 active actors on pipe
2025-10-15T11:02:47.698718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402314218245264:10089]
2025-10-15T11:02:47.698731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402314218245264:10089]
2025-10-15T11:02:47.698743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402314218245264:10089]
2025-10-15T11:02:47.698779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:47.698832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:47.698841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:47.698848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:47.698866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:47.698998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:47.699013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:47.699114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402314218245264:10089]
2025-10-15T11:02:47.699138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:47.699311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:47.702633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:47.702668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:47.702796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:47.702836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:47.702857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:47.702870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:47.702914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:47.702965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:47.703023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:47.703898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:47.703923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:47.703998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:47.706291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1096 partition: 0 MaxSeqNo: 46 sessionId: src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0
2025-10-15T11:02:47.707850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0d79573-de83e13e-bc58677b-45282081_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:47.745496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0] Write session: try to update token
2025-10-15T11:02:47.745564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:47.815901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:47.815935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:47.815948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:47.816008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:47.816026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:47.816043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:47.816057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:47.816096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402314218245264:10089]
2025-10-15T11:02:47.816124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402314218245264:10089]
2025-10-15T11:02:47.816154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402314218245264:10089]
2025-10-15T11:02:47.816377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:47.816403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:47.816729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:47.816772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:47.816804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:47.821593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:47.911450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId: src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:47.935384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:47.994469Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:48.006927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:48.006982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:48.007056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:48.007072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:48.007119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402314218245264:10089]
2025-10-15T11:02:48.007734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:48.008259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:48.011201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:48.011456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402311418556289:4077]
2025-10-15T11:02:48.011542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:48.074932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1096 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0
2025-10-15T11:02:48.075338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1096 sessionId: src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0 is DEAD
2025-10-15T11:02:48.083768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:48.083845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0] Write session will restart in 0.005612s
2025-10-15T11:02:48.084038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0] Write session: Do CDS request
2025-10-15T11:02:48.084092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:48.097011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:48.098521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:48.098561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1097
2025-10-15T11:02:48.098923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:48.099041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:48.099058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:48.099069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:48.102681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1097 sessionId:  describe result for acl check
2025-10-15T11:02:48.102820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:48.102838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:48.102848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:48.102866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402315713523692:4042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:48.105908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402315713523692:4042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:48.112444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402315713523719:4077]
2025-10-15T11:02:48.129480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402315713523692:4042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:48.144351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402315713523692:4042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:48.144402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402315713523692:4042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:48.144420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402315713523692:4042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:48.144450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:48.153036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:48.156426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:48.157298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:48.157329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:48.157372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:48.157601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:48.157738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402318513212760:10098]
2025-10-15T11:02:48.159414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:48.160258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:48.160490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:48.161847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:48.162206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:48.162224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:48.162232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:48.162240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:48.162246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:48.162254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:48.162260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:48.162268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:48.162276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:48.162283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:48.162290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:48.162297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.162304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.162311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.162371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:48.162486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:48.162541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:48.162595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:48.162649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:48.162702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:48.162753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:48.162808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:48.162861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:48.162915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:48.162970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:48.163022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.163073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.163127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.163180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:48.163257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:48.163325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:48.163584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:48.163654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:48.163716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:48.163773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:48.163834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:48.163887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:48.163958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:48.164009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:48.164067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:48.164119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:48.164179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:48.164248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:48.164312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:48.164367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:48.164429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:48.164481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:48.164571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:48.164621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:48.164679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:48.164729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.164789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.164840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.164898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.164981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.165046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.165628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:48.188341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:48.203294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:48.203675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:48.203702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:48.203725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:48.203751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1096 [2:7561402318513212760:10098]
2025-10-15T11:02:48.203807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:48.203874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:48.203889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:48.203902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:48.203913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:48.203969Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:48.203995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:48.204019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:48.231107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.231133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.231142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.231152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:48.231715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1096
2025-10-15T11:02:48.231739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1096, pipe: [1:7561402315713523719:4077]
2025-10-15T11:02:48.231818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1096
2025-10-15T11:02:48.231685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:48.231708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.231838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.232001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.232200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:48.232282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402315713523790:4042], now have 1 active actors on pipe
2025-10-15T11:02:48.232303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402315713523719:4077], now have 1 active actors on pipe
2025-10-15T11:02:48.232326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402315713523618:2467], now have 1 active actors on pipe
2025-10-15T11:02:48.232351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402318513212755:10098]
2025-10-15T11:02:48.232366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402318513212755:10098]
2025-10-15T11:02:48.232379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402318513212755:10098]
2025-10-15T11:02:48.232446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:48.232460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:48.232475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:48.232486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:48.232524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:48.232706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:48.232724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:48.232902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:48.232923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:48.232958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402318513212755:10098]
2025-10-15T11:02:48.232993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:48.233073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:48.233116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:48.233148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:48.233167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:48.233178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:48.233214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:48.233259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:48.233342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:48.234525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:48.234559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:48.234631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:48.238361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1097 partition: 0 MaxSeqNo: 46 sessionId: src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0
2025-10-15T11:02:48.239706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d186bf0-779abfb9-101accdb-d8361ec5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:48.289086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0] Write session: try to update token
2025-10-15T11:02:48.289156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:48.369142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:48.369177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:48.369189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:48.369246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:48.369260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:48.369275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:48.369286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:48.369326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402318513212755:10098]
2025-10-15T11:02:48.369355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402318513212755:10098]
2025-10-15T11:02:48.369397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402318513212755:10098]
2025-10-15T11:02:48.369548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:48.369573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:48.370657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:48.371792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:48.371832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:48.371862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:48.489375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId: src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:48.536904Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:48.561698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:48.561732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:48.572737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T11:02:48.572791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0] Write session will restart in 0.007851s
2025-10-15T11:02:48.572930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0] Write session: Do CDS request
2025-10-15T11:02:48.572969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:48.572074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1097 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0
2025-10-15T11:02:48.572352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1097 sessionId: src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0 is DEAD
2025-10-15T11:02:48.589602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:48.602383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402315713523719:4077]
2025-10-15T11:02:48.602457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:48.602574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:48.602587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1098
2025-10-15T11:02:48.603337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:48.603459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:48.603481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:48.603490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:48.604495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1098 sessionId:  describe result for acl check
2025-10-15T11:02:48.604594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:48.604610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:48.604617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:48.604633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402315713523844:4024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:48.606396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402315713523844:4024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:48.621840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402315713523844:4024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:48.643921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402315713523844:4024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:48.643979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402315713523844:4024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:48.643998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402315713523844:4024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:48.644034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:48.674195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:48.683995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:48.684809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:48.684828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:48.684869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:48.685108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:48.685299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402318513212968:10106]
2025-10-15T11:02:48.687468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:48.688555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:48.688748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:48.689875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:48.690180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:48.690188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:48.690194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:48.690201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:48.690207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:48.690213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:48.690220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:48.690226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:48.690234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:48.690241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:48.690247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:48.690254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.690261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.690268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.690310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:48.690413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:48.690459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:48.690504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:48.690544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:48.690585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:48.690626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:48.690669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:48.690710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:48.690752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:48.690793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:48.690849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.690891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.690934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.690974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:48.691031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:48.691081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:48.691131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:48.691176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:48.691227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:48.691270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:48.691320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:48.691384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:48.691435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:48.691479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:48.691529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:48.691575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:48.691624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:48.691664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:48.691712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:48.691757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:48.691805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:48.691847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:48.691896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:48.691940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:48.691987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:48.692027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.692079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.692122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.692173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.692214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.692264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.692763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:48.702094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402315713524004:4077]
2025-10-15T11:02:48.730121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:48.742193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:48.742235Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:48.742249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:48.742267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:48.742290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1097 [2:7561402318513212968:10106]
2025-10-15T11:02:48.742338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:48.742389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:48.742404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:48.742416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:48.742426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:48.742468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:48.742489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:48.742508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:48.747945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1097, pipe: [1:7561402315713524004:4077]
2025-10-15T11:02:48.748097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1097
2025-10-15T11:02:48.748184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1097
2025-10-15T11:02:48.746384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.746408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.746422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.746433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:48.746697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:48.746714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:48.746840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:48.747008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:48.747229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:48.747309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402315713524004:4077], now have 1 active actors on pipe
2025-10-15T11:02:48.747337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402315713523942:4024], now have 1 active actors on pipe
2025-10-15T11:02:48.747375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402315713523840:2467], now have 1 active actors on pipe
2025-10-15T11:02:48.747405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402318513212962:10106]
2025-10-15T11:02:48.747420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402318513212962:10106]
2025-10-15T11:02:48.747433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402318513212962:10106]
2025-10-15T11:02:48.747476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:48.747549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:48.747720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:48.747736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:48.747846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402318513212962:10106]
2025-10-15T11:02:48.747866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:48.752161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:48.752192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:48.752205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:48.752239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:48.753227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:48.753264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:48.753388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:48.753427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:48.753446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:48.753457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:48.753498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:48.753561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:48.753635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:48.754516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:48.754544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:48.754618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:48.757804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1098 partition: 0 MaxSeqNo: 46 sessionId: src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0
2025-10-15T11:02:48.758575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab1a0-e444a7b2-c2b8181f-cbe0a20f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:48.790147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0] Write session: try to update token
2025-10-15T11:02:48.790197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:48.936166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId: src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:48.950606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:48.950665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:48.950679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:48.950763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:48.950778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:48.950793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:48.950806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:48.950843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402318513212962:10106]
2025-10-15T11:02:48.950871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402318513212962:10106]
2025-10-15T11:02:48.950898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402318513212962:10106]
2025-10-15T11:02:48.951135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:48.951160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:48.951167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:48.951211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:48.951240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:48.953188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:48.965956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:49.108985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:49.127662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:49.127708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:49.127785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:49.127800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:49.127841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402318513212962:10106]
2025-10-15T11:02:49.128091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:49.128419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:49.129125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402315713524004:4077]
2025-10-15T11:02:49.129215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:49.129381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:49.187594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1098 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0
2025-10-15T11:02:49.187957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1098 sessionId: src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0 is DEAD
2025-10-15T11:02:49.195622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:49.195672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0] Write session will restart in 0.006303s
2025-10-15T11:02:49.195786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0] Write session: Do CDS request
2025-10-15T11:02:49.195821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:49.211863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:49.211892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1099
2025-10-15T11:02:49.216224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:49.216946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:49.217106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:49.217123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:49.217134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:49.219055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1099 sessionId:  describe result for acl check
2025-10-15T11:02:49.219184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:49.219196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:49.219206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:49.219225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402320008491400:4015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:49.222094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402320008491400:4015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:49.229187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402320008491427:4077]
2025-10-15T11:02:49.235483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402320008491400:4015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:49.248995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402320008491400:4015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:49.249038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402320008491400:4015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:49.249055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402320008491400:4015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:49.249081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:49.259895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:49.272628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:49.273591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:49.273613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:49.273662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:49.273945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:49.274126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402322808180456:10111]
2025-10-15T11:02:49.276734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:49.280330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:49.280588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:49.281942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:49.282316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:49.282324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:49.282331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:49.282339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:49.282346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:49.282353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:49.282361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:49.282369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:49.282376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:49.282383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:49.282391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:49.282398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.282405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.282412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.282465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:49.282585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:49.282634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:49.282681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:49.282731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:49.282778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:49.282826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:49.282873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:49.282921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:49.282973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:49.283019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:49.283065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.283116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.283161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.283209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:49.283282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:49.284188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:49.284267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:49.284333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:49.284387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:49.284435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:49.284494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:49.284545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:49.284601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:49.284651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:49.284709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:49.284760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:49.284819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:49.284871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:49.284924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:49.284974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:49.285033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:49.285081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:49.285137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:49.285183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:49.285238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:49.285287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.285360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.285410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.285465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.285510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.285564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.286099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:49.312390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:49.322440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:49.322493Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:49.322512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:49.322533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:49.322562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1098 [2:7561402322808180456:10111]
2025-10-15T11:02:49.322622Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:49.322692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:49.322708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:49.322723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:49.322736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:49.322793Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:49.322820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:49.322847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:49.324626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.324654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.324669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.324682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:49.324988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:49.325009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.326617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1098
2025-10-15T11:02:49.325167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.325391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.326711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1098
2025-10-15T11:02:49.325666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:49.326752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1098, pipe: [1:7561402320008491427:4077]
2025-10-15T11:02:49.325758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402320008491338:2467], now have 1 active actors on pipe
2025-10-15T11:02:49.325784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402320008491513:4015], now have 1 active actors on pipe
2025-10-15T11:02:49.325808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402320008491427:4077], now have 1 active actors on pipe
2025-10-15T11:02:49.325836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402322808180451:10111]
2025-10-15T11:02:49.325853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402322808180451:10111]
2025-10-15T11:02:49.325874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402322808180451:10111]
2025-10-15T11:02:49.325921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:49.326001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:49.326197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:49.326215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:49.326342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402322808180451:10111]
2025-10-15T11:02:49.326362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:49.326573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:49.326590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:49.326601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:49.326629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:49.327332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:49.327379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:49.327461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b273b83b-551e7752-7349c222-b5e2ca35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:49.327495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:49.327515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:49.327527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:49.327568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:49.327613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:49.327661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:49.329905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:49.329936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:49.330011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:49.330355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1099 partition: 0 MaxSeqNo: 46 sessionId: src_id|b273b83b-551e7752-7349c222-b5e2ca35_0
2025-10-15T11:02:49.335607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39f92a7-4ae5238d-44ffe44b-b0eda323_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b273b83b-551e7752-7349c222-b5e2ca35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:49.378153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b273b83b-551e7752-7349c222-b5e2ca35_0] Write session: try to update token
2025-10-15T11:02:49.378222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b273b83b-551e7752-7349c222-b5e2ca35_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:49.512049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:49.512073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:49.512080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:49.512124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:49.512135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:49.512145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:49.512153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:49.512176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402322808180451:10111]
2025-10-15T11:02:49.512194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402322808180451:10111]
2025-10-15T11:02:49.512210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402322808180451:10111]
2025-10-15T11:02:49.512406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:49.512429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:49.512534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:49.512572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:49.512591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:49.513793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:49.527468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId: src_id|b273b83b-551e7752-7349c222-b5e2ca35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:49.574573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:49.665676Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:49.689589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:49.689633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:49.690441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:49.690454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:49.690489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402322808180451:10111]
2025-10-15T11:02:49.691004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:49.691493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:49.691646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:49.691659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:49.695519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402320008491427:4077]
2025-10-15T11:02:49.695576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:49.735891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1099 reason: error at write: Disconnected sessionId: src_id|b273b83b-551e7752-7349c222-b5e2ca35_0
2025-10-15T11:02:49.736185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1099 sessionId: src_id|b273b83b-551e7752-7349c222-b5e2ca35_0 is DEAD
2025-10-15T11:02:49.741140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b273b83b-551e7752-7349c222-b5e2ca35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:49.741176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b273b83b-551e7752-7349c222-b5e2ca35_0] Write session will restart in 0.007953s
2025-10-15T11:02:49.741272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b273b83b-551e7752-7349c222-b5e2ca35_0] Write session: Do CDS request
2025-10-15T11:02:49.741310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b273b83b-551e7752-7349c222-b5e2ca35_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:49.756377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b273b83b-551e7752-7349c222-b5e2ca35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:49.757229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:49.757257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1100
2025-10-15T11:02:49.757598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:49.757698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:49.757712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:49.757720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:49.760128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1100 sessionId:  describe result for acl check
2025-10-15T11:02:49.760251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:49.760262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:49.760271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:49.760288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402320008491556:4004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:49.763809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402320008491556:4004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:49.779491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402320008491556:4004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:49.795432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402320008491556:4004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:49.795473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402320008491556:4004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:49.795490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402320008491556:4004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:49.795518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:49.795908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402320008491651:4077]
2025-10-15T11:02:49.829194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:49.834583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:49.835520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:49.835538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:49.835584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:49.835849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:49.836055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402322808180667:10120]
2025-10-15T11:02:49.838189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:49.839207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:49.839425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:49.840549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:49.840897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:49.840905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:49.840912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:49.840918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:49.840924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:49.840930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:49.840937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:49.840944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:49.840950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:49.840956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:49.840963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:49.840969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.840975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.840982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.841021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:49.841113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:49.841156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:49.841199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:49.841243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:49.841298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:49.841338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:49.841377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:49.841416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:49.841460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:49.841502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:49.841542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.841583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.841621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.841657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:49.841714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:49.841764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:49.841812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:49.841857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:49.841902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:49.841943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:49.841989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:49.842031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:49.842077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:49.842117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:49.842164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:49.842207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:49.842265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:49.842305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:49.842352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:49.842393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:49.842441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:49.842478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:49.842525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:49.842566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:49.842611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:49.842652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.842702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.842744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.842790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.842830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.842876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.843310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:49.868933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:49.894018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:49.894059Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:49.894075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:49.894093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:49.894116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1099 [2:7561402322808180667:10120]
2025-10-15T11:02:49.894162Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:49.894216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:49.894230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:49.894241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:49.894251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:49.894295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:49.894315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:49.894335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:49.896580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.896608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.896621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.896632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:49.896903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:49.896919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:49.897049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:49.897220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:49.897438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:49.897509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402322808180662:10120]
2025-10-15T11:02:49.897524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402322808180662:10120]
2025-10-15T11:02:49.897536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402322808180662:10120]
2025-10-15T11:02:49.897583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:49.897652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:49.897822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:49.897838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:49.897947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402322808180662:10120]
2025-10-15T11:02:49.897967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:49.898543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:49.898565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:49.898574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:49.898595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:49.899315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402320008491651:4077], now have 1 active actors on pipe
2025-10-15T11:02:49.899363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402320008491650:4004], now have 1 active actors on pipe
2025-10-15T11:02:49.899386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402320008491539:2467], now have 1 active actors on pipe
2025-10-15T11:02:49.899481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1099, pipe: [1:7561402320008491651:4077]
2025-10-15T11:02:49.899594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1099
2025-10-15T11:02:49.899667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1099
2025-10-15T11:02:49.901197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1100 partition: 0 MaxSeqNo: 46 sessionId: src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0
2025-10-15T11:02:49.899963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:49.899995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:49.900091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:49.900119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:49.900136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:49.900147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:49.900180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:49.900230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:49.900274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:49.900882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:49.900901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:49.900959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:49.904620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b273b83b-551e7752-7349c222-b5e2ca35_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:49.954947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0] Write session: try to update token
2025-10-15T11:02:49.954998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:49.996459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:49.996480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:49.996486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:50.057216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:50.057247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:50.057261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:50.057287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:50.057320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402322808180662:10120]
2025-10-15T11:02:50.057346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402322808180662:10120]
2025-10-15T11:02:50.057373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402322808180662:10120]
2025-10-15T11:02:50.057524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:50.057552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:50.058691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:50.060142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:50.060182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:50.060210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:50.210149Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:50.226366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId: src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:50.254513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:50.254684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402320008491651:4077]
2025-10-15T11:02:50.254745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:50.254752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:50.272086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1100 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0
2025-10-15T11:02:50.272991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1100 sessionId: src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0 is DEAD
2025-10-15T11:02:50.275604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T11:02:50.275656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0] Write session will restart in 0.007741s
2025-10-15T11:02:50.275788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0] Write session: Do CDS request
2025-10-15T11:02:50.275838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:50.290447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:50.293889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:50.293925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1101
2025-10-15T11:02:50.294426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:50.294537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:50.294552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:50.294563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:50.295980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1101 sessionId:  describe result for acl check
2025-10-15T11:02:50.296101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:50.296112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:50.296121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:50.296139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402324303459066:3980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:50.298545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402324303459066:3980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:50.326499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402324303459066:3980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:50.352264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402324303459154:4077]
2025-10-15T11:02:50.357888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402324303459066:3980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:50.357938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402324303459066:3980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:50.357972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402324303459066:3980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:50.358005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:50.420036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:50.422447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:50.423375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:50.423397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:50.423442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:50.423722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:50.423915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402327103148165:10128]
2025-10-15T11:02:50.426346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:50.427500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:50.427724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:50.429217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:50.429598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:50.429607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:50.429615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:50.429623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:50.429632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:50.429640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:50.429649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:50.429657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:50.429665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:50.429672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:50.429680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:50.429688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:50.429695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:50.429701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:50.429753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:50.429881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:50.429937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:50.429990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:50.430041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:50.430092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:50.430145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:50.430195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:50.430248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:50.430305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:50.430357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:50.430411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:50.430462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:50.430512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:50.430559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:50.430634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:50.430701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:50.430760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:50.430816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:50.430878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:50.430931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:50.430987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:50.431043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:50.431101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:50.431150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:50.431209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:50.431260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:50.431319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:50.431414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:50.431472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:50.431524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:50.431584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:50.431631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:50.431691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:50.431741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:50.431799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:50.431850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:50.431912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:50.431966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:50.432027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:50.432077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:50.432175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:50.432781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:50.459259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:50.470404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:50.470455Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:50.470475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:50.470497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:50.470523Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1100 [2:7561402327103148165:10128]
2025-10-15T11:02:50.470581Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:50.470645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:50.470662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:50.470675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:50.470689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:50.470741Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:50.470765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:50.470790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:50.473159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:50.473184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:50.473199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:50.473213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:50.473512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:50.473533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:50.473691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:50.473905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:50.474148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:50.474224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402327103148159:10128]
2025-10-15T11:02:50.474242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402327103148159:10128]
2025-10-15T11:02:50.474257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402327103148159:10128]
2025-10-15T11:02:50.474301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:50.474384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:50.474586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:50.474607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:50.474739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402327103148159:10128]
2025-10-15T11:02:50.474761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:50.476790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1100
2025-10-15T11:02:50.476877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1100, pipe: [1:7561402324303459154:4077]
2025-10-15T11:02:50.476945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1100
2025-10-15T11:02:50.475543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:50.475562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:50.475575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:50.475599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:50.491481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402324303459166:3980], now have 1 active actors on pipe
2025-10-15T11:02:50.491537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402324303459154:4077], now have 1 active actors on pipe
2025-10-15T11:02:50.491563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402324303459055:2467], now have 1 active actors on pipe
2025-10-15T11:02:50.491632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:50.491659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:50.491767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:50.491808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:50.491829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:50.491843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:50.491888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:50.491937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:50.491996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:50.497083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:50.497124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:50.497216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:50.497765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1101 partition: 0 MaxSeqNo: 46 sessionId: src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0
2025-10-15T11:02:50.509444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3752d4bd-5bf28618-4932c691-bbe89e10_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:50.545032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0] Write session: try to update token
2025-10-15T11:02:50.545094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:50.571804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:50.571833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:50.571847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:50.732735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:50.732767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:50.732785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:50.732799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:50.732839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402327103148159:10128]
2025-10-15T11:02:50.732871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402327103148159:10128]
2025-10-15T11:02:50.732900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402327103148159:10128]
2025-10-15T11:02:50.733072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:50.733087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:50.733101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:50.733212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:50.733254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:50.733495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:50.733540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:50.733574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:50.736569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:50.770279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId: src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:50.806708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:50.892819Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:50.911117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:50.911170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:50.911245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:50.911262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:50.911308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402327103148159:10128]
2025-10-15T11:02:50.911951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:50.913807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:50.915628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402324303459154:4077]
2025-10-15T11:02:50.915787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:50.916044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:50.916073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:50.938314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1101 reason: error at write: Disconnected sessionId: src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0
2025-10-15T11:02:50.938670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1101 sessionId: src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0 is DEAD
2025-10-15T11:02:50.940066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:50.940133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0] Write session will restart in 0.007115s
2025-10-15T11:02:50.940295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0] Write session: Do CDS request
2025-10-15T11:02:50.940333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:50.955482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:50.955615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:50.955653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1102
2025-10-15T11:02:50.963617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:50.963786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:50.963803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:50.963814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:50.965658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1102 sessionId:  describe result for acl check
2025-10-15T11:02:50.965778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:50.965793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:50.965802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:50.965818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402324303459293:3968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:50.968320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402324303459293:3968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:51.004004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402324303459293:3968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:51.016017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402328598426669:4077]
2025-10-15T11:02:51.022517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402324303459293:3968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:51.022562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402324303459293:3968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:51.022580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402324303459293:3968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:51.022614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:51.060866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:51.064666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:51.065371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:51.065398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:51.065438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:51.065648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:51.065843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402331398115671:10134]
2025-10-15T11:02:51.072202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:51.073625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:51.073853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:51.075306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:51.075685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:51.075693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:51.075701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:51.075708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:51.075716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:51.075723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:51.075730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:51.075738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:51.075744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:51.075751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:51.075758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:51.075765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.075773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.075780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.075831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:51.075946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:51.075996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:51.076049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:51.076101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:51.076149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:51.076195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:51.076243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:51.076290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:51.076337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:51.076382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:51.076427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.076476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.076525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.076567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:51.076637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:51.076700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:51.076756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:51.076806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:51.076858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:51.076904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:51.076958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:51.077008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:51.077065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:51.077114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:51.077173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:51.077235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:51.077294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:51.077343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:51.077396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:51.077449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:51.077503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:51.077547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:51.077602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:51.077651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:51.077708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:51.077755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.077812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.077863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.077921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.077967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.078021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.078539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:51.109889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:51.134734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:51.139437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:51.139478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:51.139499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:51.139526Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1101 [2:7561402331398115671:10134]
2025-10-15T11:02:51.139582Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:51.139649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:51.139666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:51.139679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:51.139691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:51.139747Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:51.139772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:51.139796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:51.141468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.141486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.141500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.141512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:51.141790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:51.141808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.141959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.142157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.142399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:51.142472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402331398115666:10134]
2025-10-15T11:02:51.142488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402331398115666:10134]
2025-10-15T11:02:51.142502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402331398115666:10134]
2025-10-15T11:02:51.142647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:51.142659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:51.142672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:51.145864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1101, pipe: [1:7561402328598426669:4077]
2025-10-15T11:02:51.145994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1101
2025-10-15T11:02:51.146080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1101
2025-10-15T11:02:51.148879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:51.148999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:51.149208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:51.149242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:51.149292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402328598426669:4077], now have 1 active actors on pipe
2025-10-15T11:02:51.149319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402324303459276:2467], now have 1 active actors on pipe
2025-10-15T11:02:51.149343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402328598426693:3968], now have 1 active actors on pipe
2025-10-15T11:02:51.149413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:51.149435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:51.149570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402331398115666:10134]
2025-10-15T11:02:51.149603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:51.149684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:51.149716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:51.149735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:51.149746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:51.149786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:51.149832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:51.149957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:51.150519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:51.152592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:51.152621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:51.152700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:51.153070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1102 partition: 0 MaxSeqNo: 46 sessionId: src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0
2025-10-15T11:02:51.159760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d6c88-aefcbddf-a937de1-2ad6e723_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:51.239107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0] Write session: try to update token
2025-10-15T11:02:51.239161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:51.247452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:51.247486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:51.247499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:51.402427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:51.402455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:51.402470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:51.402479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:51.402514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402331398115666:10134]
2025-10-15T11:02:51.402540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402331398115666:10134]
2025-10-15T11:02:51.402562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402331398115666:10134]
2025-10-15T11:02:51.402720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:51.402732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:51.402743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:51.402850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:51.402868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:51.403510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:51.403541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:51.403565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:51.415975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:51.439449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId: src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:51.486881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1015 11:02:51.507394234  821866 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:02:51.618291Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:51.641325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:51.641369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:51.641433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:51.641447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:51.641490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402331398115666:10134]
2025-10-15T11:02:51.646309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:51.646562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:51.646585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:51.644031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:51.644704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:51.670464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402328598426669:4077]
2025-10-15T11:02:51.682383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1102 reason: error at write: Disconnected sessionId: src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0
2025-10-15T11:02:51.684103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:51.684174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0] Write session will restart in 0.006811s
2025-10-15T11:02:51.684337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0] Write session: Do CDS request
2025-10-15T11:02:51.684395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:51.682751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1102 sessionId: src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0 is DEAD
2025-10-15T11:02:51.698694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:51.698726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1103
2025-10-15T11:02:51.699060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:51.700419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:51.700565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:51.700582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:51.700595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:51.702125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1103 sessionId:  describe result for acl check
2025-10-15T11:02:51.702246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:51.702257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:51.702267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:51.702285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402328598426802:3946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:51.705151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402328598426802:3946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:51.717530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402328598426802:3946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:51.752525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402328598426802:3946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:51.752570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402328598426802:3946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:51.752588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402328598426802:3946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:51.752622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:51.779759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402328598426907:4077]
2025-10-15T11:02:51.830500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:51.841314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:51.842303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:51.842321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:51.842366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:51.842654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:51.842845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402331398115881:10143]
2025-10-15T11:02:51.845189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:51.846552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:51.846747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:51.848026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:51.848350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:51.848359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:51.848366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:51.848373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:51.848380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:51.848387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:51.848393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:51.848401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:51.848409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:51.848416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:51.848423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:51.848429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.848435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.848442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.848486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:51.848593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:51.848639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:51.848688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:51.848734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:51.848781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:51.848827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:51.848870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:51.848911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:51.848954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:51.848995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:51.849039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.849082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.849125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.849184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:51.849249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:51.849306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:51.849356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:51.849403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:51.849457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:51.849501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:51.849553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:51.849600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:51.849652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:51.849695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:51.850655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:51.850718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:51.850775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:51.850818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:51.850871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:51.850916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:51.850968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:51.851013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:51.851063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:51.851109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:51.851158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:51.851202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.851254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.851298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.851362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.851407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.851456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.851949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:51.885537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:51.910533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:51.910572Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:51.910588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:51.910606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:51.910630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1102 [2:7561402331398115881:10143]
2025-10-15T11:02:51.910679Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:51.910734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:51.910749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:51.910761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:51.910772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:51.910817Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:51.910838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:51.910856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:51.952386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.952413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.952425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.952435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:51.952695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:51.952711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:51.952840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:51.953017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:51.953258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:51.953319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402331398115876:10143]
2025-10-15T11:02:51.953334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402331398115876:10143]
2025-10-15T11:02:51.953345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402331398115876:10143]
2025-10-15T11:02:51.953374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:51.953441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:51.953613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:51.953628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:51.953735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402331398115876:10143]
2025-10-15T11:02:51.953757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:51.954030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:51.954045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:51.954057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:51.954081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:51.962008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402328598426907:4077], now have 1 active actors on pipe
2025-10-15T11:02:51.962053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402328598426780:2467], now have 1 active actors on pipe
2025-10-15T11:02:51.959499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1102, pipe: [1:7561402328598426907:4077]
2025-10-15T11:02:51.962078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402328598426878:3946], now have 1 active actors on pipe
2025-10-15T11:02:51.962150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:51.959635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1102
2025-10-15T11:02:51.962174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:51.959727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1102
2025-10-15T11:02:51.962256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:51.962290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:51.962308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:51.962318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:51.962354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:51.962398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:51.962441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:51.966857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:51.966893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:51.966972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:51.967420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1103 partition: 0 MaxSeqNo: 46 sessionId: src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0
2025-10-15T11:02:51.968200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c09389c-2c3070ac-4dd933eb-f5a0547_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:52.004674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0] Write session: try to update token
2025-10-15T11:02:52.004734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:52.009609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:52.009636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:52.009645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:52.179382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:52.179425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:52.179439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:52.179448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:52.179479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402331398115876:10143]
2025-10-15T11:02:52.179500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402331398115876:10143]
2025-10-15T11:02:52.179522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402331398115876:10143]
2025-10-15T11:02:52.179680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:52.179692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:52.179701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:52.179795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:52.179812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:52.181138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:52.181184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:52.181208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:52.181670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:52.283112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId: src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:52.326948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:52.364585Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:52.378380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:52.378430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:52.378504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:52.378519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:52.378565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402331398115876:10143]
2025-10-15T11:02:52.379616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:52.380541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:52.383490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402328598426907:4077]
2025-10-15T11:02:52.383572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:52.383696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:52.383707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:52.423387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1103 reason: error at write: Disconnected sessionId: src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0
2025-10-15T11:02:52.423729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1103 sessionId: src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0 is DEAD
2025-10-15T11:02:52.427611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:52.427676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0] Write session will restart in 0.006719s
2025-10-15T11:02:52.427835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0] Write session: Do CDS request
2025-10-15T11:02:52.427880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:52.448660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:52.449379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:52.449411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1104
2025-10-15T11:02:52.449952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:52.450061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:52.450074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:52.450083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:52.451558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1104 sessionId:  describe result for acl check
2025-10-15T11:02:52.451660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:52.451671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:52.451680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:52.451696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402332893394330:3925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:52.454625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402332893394330:3925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:52.460253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402332893394330:3925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:52.475737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402332893394330:3925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:52.475790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402332893394330:3925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:52.475807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402332893394330:3925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:52.475837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:52.483567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402332893394384:4077]
2025-10-15T11:02:52.556209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:52.564398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:52.565303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:52.565333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:52.565376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:52.565618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:52.565803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402335693083389:10151]
2025-10-15T11:02:52.567977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:52.578767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:52.579045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:52.580335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:52.580671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:52.580679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:52.580686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:52.580692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:52.580700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:52.580706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:52.580713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:52.580720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:52.580727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:52.580733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:52.580741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:52.580747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:52.580755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:52.580762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:52.580810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:52.580917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:52.580965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:52.581013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:52.581061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:52.581106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:52.581162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:52.581211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:52.581255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:52.581299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:52.581343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:52.581389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:52.581435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:52.581482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:52.581528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:52.581595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:52.581656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:52.581716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:52.581766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:52.581822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:52.581869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:52.581925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:52.581976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:52.582031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:52.582080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:52.582132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:52.582182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:52.582236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:52.582286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:52.582338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:52.582388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:52.582439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:52.582481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:52.582530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:52.582571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:52.582620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:52.582665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:52.582721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:52.582765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:52.582815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:52.582857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:52.582909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:52.591607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:52.619446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:52.629566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:52.629614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:52.629634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:52.629656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:52.629687Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1103 [2:7561402335693083389:10151]
2025-10-15T11:02:52.629745Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:52.629818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:52.629836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:52.629850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:52.629862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:52.629915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:52.629940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:52.629964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:52.631104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:52.631121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:52.631137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:52.631153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:52.632488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1103, pipe: [1:7561402332893394384:4077]
2025-10-15T11:02:52.632580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1103
2025-10-15T11:02:52.632640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1103
2025-10-15T11:02:52.633301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:52.633332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:52.633491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:52.633699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:52.633943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:52.633989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402332893394384:4077], now have 1 active actors on pipe
2025-10-15T11:02:52.634030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402332893394300:2467], now have 1 active actors on pipe
2025-10-15T11:02:52.634056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402332893394366:3925], now have 1 active actors on pipe
2025-10-15T11:02:52.634129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402335693083384:10151]
2025-10-15T11:02:52.634147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402335693083384:10151]
2025-10-15T11:02:52.634163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402335693083384:10151]
2025-10-15T11:02:52.634205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:52.634290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:52.634497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:52.634515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:52.634648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402335693083384:10151]
2025-10-15T11:02:52.634669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:52.635646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:52.635658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:52.635666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:52.635685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:52.636834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:52.636868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:52.636950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:52.636983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:52.637003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:52.637015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:52.637054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:52.637100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:52.637165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:52.637977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:52.638006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:52.638088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:52.639407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb349b9-8c80c39f-ebf3594-2c714c72_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:52.638515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1104 partition: 0 MaxSeqNo: 46 sessionId: src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0
2025-10-15T11:02:52.668321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0] Write session: try to update token
2025-10-15T11:02:52.668384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:52.730154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:52.730186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:52.730194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:52.885176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId: src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:52.937564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:52.958233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:52.958445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:52.958464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:52.958477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:52.958515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402335693083384:10151]
2025-10-15T11:02:52.958545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402335693083384:10151]
2025-10-15T11:02:52.958574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402335693083384:10151]
2025-10-15T11:02:52.958808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:52.958822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:52.958836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:52.958934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:52.958961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:52.958997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:52.959020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:52.959623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:52.959659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:52.959688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:52.960064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:53.137394Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:53.173535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:53.173567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:53.173614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402335693083384:10151]
2025-10-15T11:02:53.174057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:53.175495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:53.175659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:53.175673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:53.176491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402332893394384:4077]
2025-10-15T11:02:53.177904Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:53.196067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1104 reason: error at write: Disconnected sessionId: src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0
2025-10-15T11:02:53.196418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1104 sessionId: src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0 is DEAD
2025-10-15T11:02:53.199828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:53.199867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0] Write session will restart in 0.007190s
2025-10-15T11:02:53.199964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0] Write session: Do CDS request
2025-10-15T11:02:53.199994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:53.221818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:53.219968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:53.220003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1105
2025-10-15T11:02:53.222612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:53.222737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:53.222753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:53.222764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:53.224129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1105 sessionId:  describe result for acl check
2025-10-15T11:02:53.224240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:53.224250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:53.224259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:53.224276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402337188361836:3916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:53.226695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402337188361836:3916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:53.235492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402337188361836:3916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:53.259982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402337188361836:3916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:53.260028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402337188361836:3916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:53.260047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402337188361836:3916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:53.260081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:53.279281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402337188361871:4077]
2025-10-15T11:02:53.352331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:53.361079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:53.361996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:53.362015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:53.362061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:53.362346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:53.362568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402339988050900:10163]
2025-10-15T11:02:53.365037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:53.368287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:53.368543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:53.369847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:53.370210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:53.370219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:53.370227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:53.370235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:53.370243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:53.370251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:53.370259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:53.370267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:53.370274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:53.370281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:53.370288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:53.370294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:53.370302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:53.370309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:53.370359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:53.370477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:53.370531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:53.370579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:53.370630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:53.370678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:53.370731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:53.370780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:53.370824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:53.370874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:53.370918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:53.370966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:53.371014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:53.371057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:53.371105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:53.371178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:53.371242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:53.371301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:53.372079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:53.372156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:53.372208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:53.372268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:53.372319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:53.372371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:53.372417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:53.372469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:53.372516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:53.372572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:53.372620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:53.372674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:53.372726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:53.372783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:53.372828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:53.372882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:53.372930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:53.372983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:53.373026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:53.373079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:53.373142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:53.373194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:53.373240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:53.373290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:53.373787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:53.416519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:53.426866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:53.426912Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:53.426930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:53.426950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:53.426974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1104 [2:7561402339988050900:10163]
2025-10-15T11:02:53.427030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:53.427086Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:53.427101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:53.427113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:53.427124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:53.427174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:53.427198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:53.427222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:53.429167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:53.429196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:53.429211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:53.429223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:53.429505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:53.429524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:53.429669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:53.429873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:53.430107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:53.430183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402339988050895:10163]
2025-10-15T11:02:53.430200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402339988050895:10163]
2025-10-15T11:02:53.430213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402339988050895:10163]
2025-10-15T11:02:53.430266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:53.430345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:53.430539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:53.430557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:53.430684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402339988050895:10163]
2025-10-15T11:02:53.430703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:53.431407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:53.431428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:53.431440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:53.431467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:53.432503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402337188361871:4077], now have 1 active actors on pipe
2025-10-15T11:02:53.432537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402337188361823:2467], now have 1 active actors on pipe
2025-10-15T11:02:53.432561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402337188361868:3916], now have 1 active actors on pipe
2025-10-15T11:02:53.435521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1104, pipe: [1:7561402337188361871:4077]
2025-10-15T11:02:53.435544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1104
2025-10-15T11:02:53.435641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1104
2025-10-15T11:02:53.436050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:53.436088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:53.436164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fedd1bad-f4affb80-81615da5-4466733c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:53.436210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:53.436229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:53.436240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:53.436280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:53.436327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:53.436375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:53.440255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:53.440292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:53.440372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:53.446208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0e97bb-5949f92f-5e1de4e-8e8c1e7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fedd1bad-f4affb80-81615da5-4466733c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:53.443552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1105 partition: 0 MaxSeqNo: 46 sessionId: src_id|fedd1bad-f4affb80-81615da5-4466733c_0
2025-10-15T11:02:53.520568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd1bad-f4affb80-81615da5-4466733c_0] Write session: try to update token
2025-10-15T11:02:53.520629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd1bad-f4affb80-81615da5-4466733c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:53.527556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:53.527591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:53.527603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:53.647617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:53.647658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:53.647673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:53.647685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:53.647722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402339988050895:10163]
2025-10-15T11:02:53.647749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402339988050895:10163]
2025-10-15T11:02:53.647777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402339988050895:10163]
2025-10-15T11:02:53.647988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:53.648000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:53.648011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:53.648059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:53.648080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:53.649084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:53.651542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:53.651575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:53.651604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:53.701396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId: src_id|fedd1bad-f4affb80-81615da5-4466733c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:53.743329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:53.817647Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:53.837188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:53.838071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:53.838174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:53.838191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:53.838238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402339988050895:10163]
2025-10-15T11:02:53.838700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:53.839405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402337188361871:4077]
2025-10-15T11:02:53.839517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:53.839644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:53.839667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:53.839727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:53.887934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1105 reason: error at write: Disconnected sessionId: src_id|fedd1bad-f4affb80-81615da5-4466733c_0
2025-10-15T11:02:53.888244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1105 sessionId: src_id|fedd1bad-f4affb80-81615da5-4466733c_0 is DEAD
2025-10-15T11:02:53.891860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd1bad-f4affb80-81615da5-4466733c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:53.891910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd1bad-f4affb80-81615da5-4466733c_0] Write session will restart in 0.009956s
2025-10-15T11:02:53.892074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd1bad-f4affb80-81615da5-4466733c_0] Write session: Do CDS request
2025-10-15T11:02:53.892121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd1bad-f4affb80-81615da5-4466733c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:53.910656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd1bad-f4affb80-81615da5-4466733c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:53.913159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:53.913188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1106
2025-10-15T11:02:53.913553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:53.913672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:53.913688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:53.913698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:53.916560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1106 sessionId:  describe result for acl check
2025-10-15T11:02:53.916671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:53.916682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:53.916692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:53.916708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402337188362069:3888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:53.919248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402337188362069:3888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:53.931048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402337188362069:3888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:53.953746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402337188362147:4077]
2025-10-15T11:02:53.971816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402337188362069:3888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:53.971864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402337188362069:3888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:53.971883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402337188362069:3888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:53.971914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:54.019498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:54.028282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:54.029225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:54.029246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:54.029292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:54.029569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:54.029783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402344283018417:10172]
2025-10-15T11:02:54.032654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:54.041019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:54.041325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:54.042715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:54.043078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:54.043086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:54.043093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:54.043100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:54.043108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:54.043115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:54.043122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:54.043128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:54.043135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:54.043142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:54.043149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:54.043156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.043163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.043170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.043216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:54.043325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:54.043388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:54.043428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:54.043471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:54.043521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:54.043568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:54.043613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:54.043660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:54.043708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:54.043756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:54.043801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.043846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.043887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.043933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:54.044000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:54.044062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:54.044126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:54.044181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:54.044257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:54.044305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:54.044375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:54.044424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:54.044477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:54.044519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:54.044575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:54.044620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:54.044673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:54.044714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:54.044773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:54.044816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:54.044878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:54.044938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:54.044994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:54.045037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:54.045100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:54.045140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.045193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.045234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.045357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.045436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.045525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.046038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:54.080881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:54.093894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:54.093940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:54.093958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:54.093981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:54.094007Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1105 [2:7561402344283018417:10172]
2025-10-15T11:02:54.094062Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:54.094139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:54.094155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:54.094169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:54.094181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:54.094238Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:54.094266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:54.094289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:54.147444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1105, pipe: [1:7561402337188362147:4077]
2025-10-15T11:02:54.147567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1105
2025-10-15T11:02:54.144317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.144348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.147653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1105
2025-10-15T11:02:54.144359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.144370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:54.144662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:54.144680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.144823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.144994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.145249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:54.145328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402344283018411:10172]
2025-10-15T11:02:54.145343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402344283018411:10172]
2025-10-15T11:02:54.145355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402344283018411:10172]
2025-10-15T11:02:54.145398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:54.145475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:54.145653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:54.145671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:54.145802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402344283018411:10172]
2025-10-15T11:02:54.145819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:54.146174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:54.146187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:54.146200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:54.146225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:54.148687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402337188362147:4077], now have 1 active actors on pipe
2025-10-15T11:02:54.148726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402337188362042:2467], now have 1 active actors on pipe
2025-10-15T11:02:54.148750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402337188362188:3888], now have 1 active actors on pipe
2025-10-15T11:02:54.148828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:54.148863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:54.148954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:54.148990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:54.149010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:54.149022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:54.149074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:54.149121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:54.149172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:54.152001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:54.152043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:54.152130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:54.153114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1106 partition: 0 MaxSeqNo: 46 sessionId: src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0
2025-10-15T11:02:54.158656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd1bad-f4affb80-81615da5-4466733c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:54.195481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:54.195517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:54.195531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:54.207249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0] Write session: try to update token
2025-10-15T11:02:54.207321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:54.330308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:54.330343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:54.330358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:54.330369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:54.330408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402344283018411:10172]
2025-10-15T11:02:54.330436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402344283018411:10172]
2025-10-15T11:02:54.330462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402344283018411:10172]
2025-10-15T11:02:54.330694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:54.330708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:54.330721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:54.330775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:54.330804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:54.331242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:54.331278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:54.331313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:54.340416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:54.394520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId: src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:54.415692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:54.500892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:54.527123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:54.527169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:54.527241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:54.527256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:54.527301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402344283018411:10172]
2025-10-15T11:02:54.527589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:54.528092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:54.532002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402337188362147:4077]
2025-10-15T11:02:54.532081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:54.532203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:54.540869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1106 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0
2025-10-15T11:02:54.542848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1106 sessionId: src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0 is DEAD
2025-10-15T11:02:54.546330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:54.546401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0] Write session will restart in 0.006835s
2025-10-15T11:02:54.546570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0] Write session: Do CDS request
2025-10-15T11:02:54.546623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:54.560143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:54.564156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:54.564189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1107
2025-10-15T11:02:54.564553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:54.564679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:54.564696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:54.564707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:54.566678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1107 sessionId:  describe result for acl check
2025-10-15T11:02:54.566798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:54.566808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:54.566818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:54.566836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402341483329581:3876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:54.570719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402341483329581:3876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:54.581099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402341483329581:3876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:54.590301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402341483329581:3876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:54.590332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402341483329581:3876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:54.590349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402341483329581:3876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:54.590382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:54.633567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402341483329720:4077]
2025-10-15T11:02:54.659993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:54.666048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:54.667475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:54.667504Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:54.667549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:54.667839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:54.668024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402344283018614:10176]
2025-10-15T11:02:54.670282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:54.671684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:54.671952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:54.673318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:54.673624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:54.673633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:54.673640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:54.673647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:54.673654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:54.673662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:54.673671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:54.673679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:54.673685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:54.673693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:54.673700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:54.673706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.673714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.673720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.673771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:54.673888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:54.673941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:54.673992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:54.674040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:54.674089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:54.674136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:54.674186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:54.674234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:54.674286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:54.674333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:54.674379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.674428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.674477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.674525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:54.674604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:54.674671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:54.674730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:54.674784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:54.674844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:54.674892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:54.674948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:54.675000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:54.675058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:54.675107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:54.675169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:54.675220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:54.675286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:54.675335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:54.675498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:54.675551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:54.675610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:54.675661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:54.675715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:54.675765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:54.675822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:54.675870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.675927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.675975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.676031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.676080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.676135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.676696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:54.705219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:54.721139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:54.721185Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:54.721202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:54.721225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:54.721253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1106 [2:7561402344283018614:10176]
2025-10-15T11:02:54.721309Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:54.721372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:54.721387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:54.721400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:54.721412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:54.721467Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:54.721493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:54.721519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:54.722628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.722645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.722662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.722675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:54.722947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:54.722967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:54.723122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:54.723323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:54.723775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1106
2025-10-15T11:02:54.723881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1106
2025-10-15T11:02:54.723954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1106, pipe: [1:7561402341483329720:4077]
2025-10-15T11:02:54.724558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:54.724654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402341483329612:3876], now have 1 active actors on pipe
2025-10-15T11:02:54.724679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402341483329568:2467], now have 1 active actors on pipe
2025-10-15T11:02:54.724703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402341483329720:4077], now have 1 active actors on pipe
2025-10-15T11:02:54.724751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:54.724779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:54.724837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402344283018609:10176]
2025-10-15T11:02:54.724855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402344283018609:10176]
2025-10-15T11:02:54.724871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402344283018609:10176]
2025-10-15T11:02:54.724914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:54.724953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:54.724980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:54.724992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:54.724994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:54.725198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:54.725216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:54.725283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b56da00-14373620-a7d6bf0-2039e73e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:54.725314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:54.725337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:54.725348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:54.725386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:54.725429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:54.725591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402344283018609:10176]
2025-10-15T11:02:54.725616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:54.725628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:54.725663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:54.727403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:54.727427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:54.727509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:54.728381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1107 partition: 0 MaxSeqNo: 46 sessionId: src_id|1b56da00-14373620-a7d6bf0-2039e73e_0
2025-10-15T11:02:54.729645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ea1395c-b183e2e4-79577135-aa2780f7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1b56da00-14373620-a7d6bf0-2039e73e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:54.779833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b56da00-14373620-a7d6bf0-2039e73e_0] Write session: try to update token
2025-10-15T11:02:54.779894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b56da00-14373620-a7d6bf0-2039e73e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:54.924875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:54.924906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:54.924917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:54.924974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:54.924986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:54.924999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:54.925019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:54.925051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402344283018609:10176]
2025-10-15T11:02:54.925075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402344283018609:10176]
2025-10-15T11:02:54.925096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402344283018609:10176]
2025-10-15T11:02:54.925291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:54.925313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:54.925908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:54.925945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:54.925973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:54.927034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:54.953581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId: src_id|1b56da00-14373620-a7d6bf0-2039e73e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:54.975010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:55.101577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:55.133651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:55.133699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:55.133766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:55.133781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:55.133822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402344283018609:10176]
2025-10-15T11:02:55.135311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:55.138406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:55.138757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:55.138785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:55.156878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402341483329720:4077]
2025-10-15T11:02:55.157223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:55.195245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1107 reason: error at write: Disconnected sessionId: src_id|1b56da00-14373620-a7d6bf0-2039e73e_0
2025-10-15T11:02:55.199729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1107 sessionId: src_id|1b56da00-14373620-a7d6bf0-2039e73e_0 is DEAD
2025-10-15T11:02:55.204064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b56da00-14373620-a7d6bf0-2039e73e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:55.204103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b56da00-14373620-a7d6bf0-2039e73e_0] Write session will restart in 0.005251s
2025-10-15T11:02:55.204211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b56da00-14373620-a7d6bf0-2039e73e_0] Write session: Do CDS request
2025-10-15T11:02:55.204247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b56da00-14373620-a7d6bf0-2039e73e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:55.224204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b56da00-14373620-a7d6bf0-2039e73e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:55.247642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:55.247681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1108
2025-10-15T11:02:55.248247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:55.248382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:55.248398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:55.248410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:55.249931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1108 sessionId:  describe result for acl check
2025-10-15T11:02:55.250055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:55.250067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:55.250076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:55.250096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402345778297173:3858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:55.252826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402345778297173:3858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:55.260446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402345778297197:4077]
2025-10-15T11:02:55.287227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402345778297173:3858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:55.303140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:55.309238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:55.310116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402345778297173:3858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:55.310166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402345778297173:3858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:55.310185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402345778297173:3858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:55.310220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:55.310196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:55.310215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:55.310249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:55.310450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:55.310575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402348577986144:10186]
2025-10-15T11:02:55.312723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:55.314627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:55.314854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:55.316247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:55.316584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:55.316602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:55.316610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:55.316617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:55.316624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:55.316631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:55.316639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:55.316646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:55.316653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:55.316659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:55.316666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:55.316674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.316680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.316686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.316732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:55.316843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:55.316899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:55.316949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:55.317014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:55.317069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:55.317120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:55.317171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:55.317219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:55.317267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:55.317316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:55.317364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.317412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.317462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.317509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:55.317579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:55.317644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:55.317707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:55.317762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:55.317822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:55.317875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:55.317931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:55.317984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:55.318043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:55.318096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:55.318157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:55.318210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:55.318272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:55.318324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:55.318386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:55.318441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:55.318502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:55.318551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:55.318610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:55.318662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:55.318729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:55.318773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.318829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.318873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.318928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.318972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.319029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.319910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:55.339285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:55.372958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:55.373014Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:55.373031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:55.373052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:55.373078Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1107 [2:7561402348577986144:10186]
2025-10-15T11:02:55.373131Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:55.373193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:55.373208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:55.373220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:55.373230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:55.373282Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:55.373304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:55.373328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:55.375064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.375082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.375096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.375108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:55.376446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1107, pipe: [1:7561402345778297197:4077]
2025-10-15T11:02:55.376575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1107
2025-10-15T11:02:55.376649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1107
2025-10-15T11:02:55.375898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:55.375928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.376078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.376271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.376527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:55.376621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402345778297278:3858], now have 1 active actors on pipe
2025-10-15T11:02:55.376647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402345778297090:2467], now have 1 active actors on pipe
2025-10-15T11:02:55.376668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402345778297197:4077], now have 1 active actors on pipe
2025-10-15T11:02:55.376695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402348577986122:10186]
2025-10-15T11:02:55.376711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402348577986122:10186]
2025-10-15T11:02:55.376725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402348577986122:10186]
2025-10-15T11:02:55.376768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:55.376819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:55.376838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:55.376851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:55.376853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:55.377054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:55.377073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:55.377207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402348577986122:10186]
2025-10-15T11:02:55.377230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:55.377286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:55.377370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:55.377392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:55.377533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:55.377568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:55.377590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:55.377602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:55.377643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:55.377692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:55.377748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:55.378973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:55.379009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:55.379095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:55.379408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1108 partition: 0 MaxSeqNo: 46 sessionId: src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0
2025-10-15T11:02:55.380354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b56da00-14373620-a7d6bf0-2039e73e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:55.421177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0] Write session: try to update token
2025-10-15T11:02:55.421239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:55.517544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:55.517577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:55.517590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:55.517650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:55.517665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:55.517681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:55.517694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:55.517732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402348577986122:10186]
2025-10-15T11:02:55.517763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402348577986122:10186]
2025-10-15T11:02:55.517791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402348577986122:10186]
2025-10-15T11:02:55.517933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:55.517955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:55.519018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:55.519471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:55.519510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:55.519540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:55.579456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId: src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:55.627453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:55.695230Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:55.697211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:55.697255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:55.703554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:55.703587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:55.712786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1108 reason: error at write: Disconnected sessionId: src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0
2025-10-15T11:02:55.713354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1108 sessionId: src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0 is DEAD
2025-10-15T11:02:55.715595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:55.715646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0] Write session will restart in 0.006462s
2025-10-15T11:02:55.715751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0] Write session: Do CDS request
2025-10-15T11:02:55.714829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:55.715783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:55.714986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402345778297197:4077]
2025-10-15T11:02:55.726117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:55.730874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:55.730936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1109
2025-10-15T11:02:55.731054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:55.737312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:55.737552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:55.737569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:55.737580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:55.743018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1109 sessionId:  describe result for acl check
2025-10-15T11:02:55.743146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:55.743158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:55.743168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:55.743186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402345778297319:3846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:55.746112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402345778297319:3846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:55.753853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402345778297319:3846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:55.779012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402345778297319:3846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:55.779057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402345778297319:3846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:55.779075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402345778297319:3846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:55.779104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:55.815099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402345778297368:4077]
2025-10-15T11:02:55.890444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:55.900908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:55.901868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:55.901888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:55.901936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:55.902213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:55.902390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402348577986360:10193]
2025-10-15T11:02:55.904671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:55.907973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:55.908219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:55.909596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:55.909938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:55.909948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:55.909954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:55.909962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:55.909970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:55.909977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:55.909984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:55.909991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:55.909999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:55.910007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:55.910015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:55.910023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.910030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.910037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.910088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:55.910212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:55.910262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:55.910311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:55.910355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:55.910404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:55.910450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:55.910497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:55.910540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:55.910586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:55.910632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:55.910681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.910731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.910779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.910829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:55.910899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:55.910962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:55.911016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:55.911066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:55.911121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:55.911171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:55.911228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:55.911278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:55.911334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:55.912272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:55.912349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:55.912406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:55.912463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:55.912511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:55.912569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:55.912619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:55.912676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:55.912724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:55.912781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:55.912829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:55.912883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:55.912933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.913004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.913054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.913113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.913159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.913219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.913742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:55.952456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:55.965948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:55.965999Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:55.966019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:55.966042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:55.966069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1108 [2:7561402348577986360:10193]
2025-10-15T11:02:55.966127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:55.966196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:55.966212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:55.966225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:55.966237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:55.966292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:55.966318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:55.966343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:55.968040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.968066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.968082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.968096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:55.968360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:55.968379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:55.968560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:55.968772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:55.969040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:55.969117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402348577986354:10193]
2025-10-15T11:02:55.969134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402348577986354:10193]
2025-10-15T11:02:55.969149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402348577986354:10193]
2025-10-15T11:02:55.969194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:55.969275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:55.969478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:55.969498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:55.969635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402348577986354:10193]
2025-10-15T11:02:55.969656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:55.972833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1108, pipe: [1:7561402345778297368:4077]
2025-10-15T11:02:55.972942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1108
2025-10-15T11:02:55.973032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1108
2025-10-15T11:02:55.970924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:55.970945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:55.970959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:55.970982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:55.971491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402345778297368:4077], now have 1 active actors on pipe
2025-10-15T11:02:55.971530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402345778297351:3846], now have 1 active actors on pipe
2025-10-15T11:02:55.971555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402345778297301:2467], now have 1 active actors on pipe
2025-10-15T11:02:55.975802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:55.975834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:55.975933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9caee881-e481aa8d-a949258c-b4170dfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:55.975968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:55.975988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:55.975999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:55.976042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:55.976092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:55.976147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:55.977012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:55.977040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:55.977112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:55.977426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1109 partition: 0 MaxSeqNo: 46 sessionId: src_id|9caee881-e481aa8d-a949258c-b4170dfd_0
2025-10-15T11:02:55.983650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c0e77ce-b34aa552-13c245ab-b22b1f9f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9caee881-e481aa8d-a949258c-b4170dfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:56.032683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9caee881-e481aa8d-a949258c-b4170dfd_0] Write session: try to update token
2025-10-15T11:02:56.032740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9caee881-e481aa8d-a949258c-b4170dfd_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:56.140112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:56.140140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:56.140149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:56.140198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:56.140212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:56.140223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:56.140233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:56.140261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402348577986354:10193]
2025-10-15T11:02:56.140284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402348577986354:10193]
2025-10-15T11:02:56.140305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402348577986354:10193]
2025-10-15T11:02:56.140503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:56.140522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:56.141582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:56.143891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:56.143931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:56.143970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:56.208554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId: src_id|9caee881-e481aa8d-a949258c-b4170dfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:56.229322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:56.299443Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:56.311767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:56.311819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:56.311895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:56.311912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:56.311965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402348577986354:10193]
2025-10-15T11:02:56.312485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:56.315597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402345778297368:4077]
2025-10-15T11:02:56.313517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:56.315781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:56.318031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:56.336405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9caee881-e481aa8d-a949258c-b4170dfd_0
2025-10-15T11:02:56.336706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1109 sessionId: src_id|9caee881-e481aa8d-a949258c-b4170dfd_0 is DEAD
2025-10-15T11:02:56.338859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caee881-e481aa8d-a949258c-b4170dfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:56.338905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caee881-e481aa8d-a949258c-b4170dfd_0] Write session will restart in 0.008689s
2025-10-15T11:02:56.339010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caee881-e481aa8d-a949258c-b4170dfd_0] Write session: Do CDS request
2025-10-15T11:02:56.339039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caee881-e481aa8d-a949258c-b4170dfd_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:56.354472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9caee881-e481aa8d-a949258c-b4170dfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:56.355769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:56.355826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1110
2025-10-15T11:02:56.356362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:56.356534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:56.356552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:56.356563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:56.357912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1110 sessionId:  describe result for acl check
2025-10-15T11:02:56.358048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:56.358060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:56.358072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:56.358090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402350073264832:3831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:56.361411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402350073264832:3831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:56.389835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402350073264832:3831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:56.415815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402350073264875:4077]
2025-10-15T11:02:56.417205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402350073264832:3831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:56.417247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402350073264832:3831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:56.417264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402350073264832:3831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:56.417292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:56.538575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:56.544471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:56.545379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:56.545398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:56.545439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:56.545696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:56.545874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402352872953862:10201]
2025-10-15T11:02:56.549023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:56.550691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:56.550922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:56.552230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:56.552600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:56.552609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:56.552617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:56.552625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:56.552633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:56.552640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:56.552648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:56.552656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:56.552665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:56.552672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:56.552680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:56.552686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:56.552694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:56.552701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:56.552753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:56.552875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:56.552945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:56.552995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:56.553045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:56.553096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:56.553145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:56.553192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:56.553241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:56.553288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:56.553338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:56.553382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:56.553430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:56.553477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:56.553529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:56.553603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:56.553668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:56.553726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:56.553780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:56.553838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:56.553887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:56.553945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:56.553998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:56.554055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:56.554105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:56.554162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:56.554212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:56.554267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:56.554318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:56.554374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:56.554425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:56.554485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:56.554530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:56.554587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:56.554635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:56.554691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:56.554737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:56.554795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:56.554844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:56.556509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:56.556584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:56.556651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:56.557251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:56.599682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:56.617075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:56.617122Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:56.617139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:56.617159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:56.617188Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1109 [2:7561402352872953862:10201]
2025-10-15T11:02:56.617241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:56.617302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:56.617316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:56.617329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:56.617344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:56.617396Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:56.617421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:56.617443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:56.620545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:56.620575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:56.620589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:56.620601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:56.620876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:56.620895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:56.621071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:56.624537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:56.624873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:56.625009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402350073264820:2467], now have 1 active actors on pipe
2025-10-15T11:02:56.625035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402350073264875:4077], now have 1 active actors on pipe
2025-10-15T11:02:56.625060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402350073264878:3831], now have 1 active actors on pipe
2025-10-15T11:02:56.625085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402352872953857:10201]
2025-10-15T11:02:56.625104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402352872953857:10201]
2025-10-15T11:02:56.625118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402352872953857:10201]
2025-10-15T11:02:56.625164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:56.625256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:56.625471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:56.625491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:56.625631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402352872953857:10201]
2025-10-15T11:02:56.625650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:56.626608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1109
2025-10-15T11:02:56.626157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:56.626708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1109
2025-10-15T11:02:56.626175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:56.626778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1109, pipe: [1:7561402350073264875:4077]
2025-10-15T11:02:56.626187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:56.626212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:56.631948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:56.631989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:56.632097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d81ef1e8-d277852-47869062-73a33196_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:56.632135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:56.632156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:56.632166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:56.632208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:56.632256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:56.632312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:56.633363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1110 partition: 0 MaxSeqNo: 46 sessionId: src_id|d81ef1e8-d277852-47869062-73a33196_0
2025-10-15T11:02:56.632960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:56.632987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:56.633056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:56.634302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9caee881-e481aa8d-a949258c-b4170dfd_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d81ef1e8-d277852-47869062-73a33196_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:56.688560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d81ef1e8-d277852-47869062-73a33196_0] Write session: try to update token
2025-10-15T11:02:56.688620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d81ef1e8-d277852-47869062-73a33196_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:56.836756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:56.836791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:56.836804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:56.836945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:56.836961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:56.836976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:56.836995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:56.837033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402352872953857:10201]
2025-10-15T11:02:56.837062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402352872953857:10201]
2025-10-15T11:02:56.837086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402352872953857:10201]
2025-10-15T11:02:56.837217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:56.837252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:56.837281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:56.844304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId: src_id|d81ef1e8-d277852-47869062-73a33196_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:56.882345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:56.882390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:56.886890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:56.888815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:57.042854Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:57.044994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:57.045030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:57.045081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402352872953857:10201]
2025-10-15T11:02:57.045245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:57.045273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:57.045435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:57.046169Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:57.050111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:57.050241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402350073264875:4077]
2025-10-15T11:02:57.050295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:02:57.070422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1110 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d81ef1e8-d277852-47869062-73a33196_0
2025-10-15T11:02:57.070784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1110 sessionId: src_id|d81ef1e8-d277852-47869062-73a33196_0 is DEAD
2025-10-15T11:02:57.073396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d81ef1e8-d277852-47869062-73a33196_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:02:57.073428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d81ef1e8-d277852-47869062-73a33196_0] Write session will restart in 0.008272s
2025-10-15T11:02:57.073498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d81ef1e8-d277852-47869062-73a33196_0] Write session: Do CDS request
2025-10-15T11:02:57.073518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d81ef1e8-d277852-47869062-73a33196_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:57.086496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d81ef1e8-d277852-47869062-73a33196_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:57.125475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:57.136434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1111
2025-10-15T11:02:57.137012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:57.137164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:57.137181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:57.137193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:57.139116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1111 sessionId:  describe result for acl check
2025-10-15T11:02:57.139220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:57.139230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:57.139239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:57.139254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402354368232382:3812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:57.143156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402354368232382:3812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:57.148215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402354368232396:4077]
2025-10-15T11:02:57.173688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402354368232382:3812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:57.207519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402354368232382:3812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:57.207558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402354368232382:3812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:57.207575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402354368232382:3812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:57.207605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:57.219716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:57.221258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:57.222039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:57.222056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:57.222094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:57.222329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:57.222508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402357167921384:10214]
2025-10-15T11:02:57.224749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:57.225925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:57.226109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:57.227326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:57.227675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:57.227693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:57.227701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:57.227708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:57.227716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:57.227724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:57.227731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:57.227739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:57.227746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:57.227753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:57.227761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:57.227768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.227776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.227782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.227828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:57.227936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:57.227986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:57.228033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:57.228087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:57.228133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:57.228215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:57.228263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:57.228308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:57.228354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:57.228399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:57.228442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.228488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.228532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.228573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:57.228637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:57.228694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:57.228747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:57.228794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:57.228845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:57.228900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:57.228949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:57.228996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:57.229049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:57.229091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:57.229142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:57.229190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:57.229241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:57.229285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:57.229336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:57.229382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:57.229434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:57.229480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:57.229533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:57.229575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:57.229625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:57.229703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.229759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.229805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.229862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.231087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.231150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.231662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:57.257389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:57.269168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:57.269206Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:57.269220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:57.269234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:57.269257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1110 [2:7561402357167921384:10214]
2025-10-15T11:02:57.269302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:57.269355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:57.269368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:57.269379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:57.269389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:57.269433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:57.269454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:57.269474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:57.311681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.311707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.311719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.311729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:57.311983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:57.311996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.312119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.312279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.312481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:57.312541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402357167921377:10214]
2025-10-15T11:02:57.312554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402357167921377:10214]
2025-10-15T11:02:57.312567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402357167921377:10214]
2025-10-15T11:02:57.312604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:57.312667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:57.312826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:57.312842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:57.312956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402357167921377:10214]
2025-10-15T11:02:57.312973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:57.313473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:57.313491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:57.313502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:57.313527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:57.314098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402354368232340:2467], now have 1 active actors on pipe
2025-10-15T11:02:57.314130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402354368232536:3812], now have 1 active actors on pipe
2025-10-15T11:02:57.314149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402354368232396:4077], now have 1 active actors on pipe
2025-10-15T11:02:57.314420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1110
2025-10-15T11:02:57.314533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1110
2025-10-15T11:02:57.314601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1110, pipe: [1:7561402354368232396:4077]
2025-10-15T11:02:57.315444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:57.315473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:57.315550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:57.315580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:57.315599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:57.315610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:57.315643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:57.315679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:57.315720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:57.320711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:57.320748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:57.320818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:57.327765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1111 partition: 0 MaxSeqNo: 46 sessionId: src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0
2025-10-15T11:02:57.328786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d81ef1e8-d277852-47869062-73a33196_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:57.371534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:57.371561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:57.371572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:57.380071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0] Write session: try to update token
2025-10-15T11:02:57.380135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:57.433453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:57.433492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:57.433508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:57.433520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:57.433558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402357167921377:10214]
2025-10-15T11:02:57.433586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402357167921377:10214]
2025-10-15T11:02:57.433612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402357167921377:10214]
2025-10-15T11:02:57.433768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:57.433764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:57.433796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:57.433802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:57.433836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:57.434812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:57.557734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId: src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:57.602491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:57.621426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:57.623293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:57.623336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:57.626948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:57.627477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:57.627499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:57.627512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:57.627696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402354368232396:4077]
2025-10-15T11:02:57.671193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1111 reason: error at write: Disconnected sessionId: src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0
2025-10-15T11:02:57.671659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1111 sessionId: src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0 is DEAD
2025-10-15T11:02:57.676030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:57.676074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0] Write session will restart in 0.008053s
2025-10-15T11:02:57.676192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0] Write session: Do CDS request
2025-10-15T11:02:57.676244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:57.695915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:57.695954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1112
2025-10-15T11:02:57.700287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:57.700938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:57.701120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:57.701137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:57.701147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:57.703279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1112 sessionId:  describe result for acl check
2025-10-15T11:02:57.703428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:57.703440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:57.703449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:57.703467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402354368232613:3782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:57.706312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402354368232613:3782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:57.723954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402354368232613:3782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:57.727732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402354368232680:4077]
2025-10-15T11:02:57.743541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402354368232613:3782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:57.743588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402354368232613:3782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:57.743608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402354368232613:3782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:57.743642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:57.776404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:57.780525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:57.781281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:57.781310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:57.781351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:57.781563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:57.781740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402357167921584:10218]
2025-10-15T11:02:57.783335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:57.784183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:57.784401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:57.785458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:57.785739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:57.785753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:57.785761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:57.785770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:57.785778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:57.785786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:57.785794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:57.785802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:57.785809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:57.785816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:57.785823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:57.785831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.785837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.785844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.785897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:57.786015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:57.786068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:57.786126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:57.786182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:57.786238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:57.786289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:57.786341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:57.786394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:57.786449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:57.786502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:57.786554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.786605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.786658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.786707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:57.786781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:57.786846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:57.786915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:57.786969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:57.787028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:57.787080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:57.787143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:57.787197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:57.787258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:57.787314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:57.787463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:57.787521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:57.787584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:57.787638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:57.787700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:57.787756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:57.787818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:57.787870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:57.787932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:57.787981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:57.788038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:57.788082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.788136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.788187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.788241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.788292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.788350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.788905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:57.818556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:57.829050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:57.829105Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:57.829125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:57.829148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:57.829179Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1111 [2:7561402357167921584:10218]
2025-10-15T11:02:57.829237Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:57.829305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:57.829322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:57.829336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:57.829349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:57.829402Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:57.829426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:57.829451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:57.830584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.830602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.830619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.830632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:57.830911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:57.830930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:57.831087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:57.831293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:57.835011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:57.835116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402357167921579:10218]
2025-10-15T11:02:57.835133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402357167921579:10218]
2025-10-15T11:02:57.835147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402357167921579:10218]
2025-10-15T11:02:57.835193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:57.835278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:57.835506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:57.835526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:57.835611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:57.835629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:57.835641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:57.835663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402357167921579:10218]
2025-10-15T11:02:57.835687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:57.836350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:57.838586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402354368232573:2467], now have 1 active actors on pipe
2025-10-15T11:02:57.838617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402354368232708:3782], now have 1 active actors on pipe
2025-10-15T11:02:57.838641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402354368232680:4077], now have 1 active actors on pipe
2025-10-15T11:02:57.840272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1111
2025-10-15T11:02:57.840374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1111
2025-10-15T11:02:57.840431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1111, pipe: [1:7561402354368232680:4077]
2025-10-15T11:02:57.843929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:57.843965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:57.844040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:57.844071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:57.844087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:57.844098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:57.844131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:57.844172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:57.844214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:57.845114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:57.845140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:57.845198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:57.845525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1112 partition: 0 MaxSeqNo: 46 sessionId: src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0
2025-10-15T11:02:57.851614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffc9b9c-586da2e4-651a1280-20f32b55_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:57.901368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0] Write session: try to update token
2025-10-15T11:02:57.901421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:57.963942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:57.963970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:57.963983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:57.964091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:57.964106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:57.964122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:57.964134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:57.964166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402357167921579:10218]
2025-10-15T11:02:57.964191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402357167921579:10218]
2025-10-15T11:02:57.964218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402357167921579:10218]
2025-10-15T11:02:57.967276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:57.967310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:57.967469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:58.044744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:58.044801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:58.064535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:58.110534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId: src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:58.145754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:58.214006Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:58.216103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:58.216125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:58.216161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402357167921579:10218]
2025-10-15T11:02:58.216285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:58.216307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:58.216596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:58.217676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:58.222728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:58.222885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:58.222911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:58.224806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402354368232680:4077]
2025-10-15T11:02:58.234253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1112 reason: error at write: Disconnected sessionId: src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0
2025-10-15T11:02:58.234625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1112 sessionId: src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0 is DEAD
2025-10-15T11:02:58.236999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:58.237070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0] Write session will restart in 0.009135s
2025-10-15T11:02:58.237275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0] Write session: Do CDS request
2025-10-15T11:02:58.237337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:58.280978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:58.283603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:58.283640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1113
2025-10-15T11:02:58.284865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:58.285014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:58.285031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:58.285040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:58.286603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1113 sessionId:  describe result for acl check
2025-10-15T11:02:58.286717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:58.286729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:58.286739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:58.286757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402358663200098:3771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:58.290243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402358663200098:3771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:58.312562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402358663200098:3771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:58.327297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402358663200147:4077]
2025-10-15T11:02:58.328359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402358663200098:3771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:58.328402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402358663200098:3771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:58.328418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402358663200098:3771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:58.328445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:58.390043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:58.398407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:58.399225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:58.399243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:58.399281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:58.399547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:58.399731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402361462889103:10228]
2025-10-15T11:02:58.402209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:58.403131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:58.403322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:58.404567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:58.404879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:58.404887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:58.404894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:58.404901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:58.404909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:58.404914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:58.404921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:58.404927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:58.404933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:58.404940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:58.404947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:58.404955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:58.404962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:58.404968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:58.405013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:58.405115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:58.405162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:58.405209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:58.405255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:58.405301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:58.405343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:58.405388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:58.405432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:58.405477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:58.405522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:58.405568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:58.405611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:58.405656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:58.405696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:58.405757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:58.405811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:58.405861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:58.405908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:58.405959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:58.406002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:58.406054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:58.406099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:58.406150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:58.406190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:58.406241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:58.406290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:58.406341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:58.406386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:58.406437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:58.406484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:58.406534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:58.406578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:58.406630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:58.406675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:58.406725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:58.406768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:58.406817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:58.406863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:58.406915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:58.406957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:58.407007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:58.407512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:58.427442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:58.436190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:58.436233Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:58.436249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:58.436268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:58.436293Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1112 [2:7561402361462889103:10228]
2025-10-15T11:02:58.436342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:58.436399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:58.436415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:58.436425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:58.436435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:58.436497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:58.436518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:58.436539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:58.438724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:58.438740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:58.438756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:58.438767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:58.440849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:58.440876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:58.441014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:58.441205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:58.441421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:58.441460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402358663200083:2467], now have 1 active actors on pipe
2025-10-15T11:02:58.441496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402358663200150:3771], now have 1 active actors on pipe
2025-10-15T11:02:58.441517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402358663200147:4077], now have 1 active actors on pipe
2025-10-15T11:02:58.441578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402361462889098:10228]
2025-10-15T11:02:58.441593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402361462889098:10228]
2025-10-15T11:02:58.441605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402361462889098:10228]
2025-10-15T11:02:58.441641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:58.441711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:58.441884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:58.441901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:58.442017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402361462889098:10228]
2025-10-15T11:02:58.442086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:58.443513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1112
2025-10-15T11:02:58.443598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1112, pipe: [1:7561402358663200147:4077]
2025-10-15T11:02:58.443668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1112
2025-10-15T11:02:58.442834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:58.442852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:58.442863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:58.442887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:58.447654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:58.447693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:58.447808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a791209f-a97336f1-406094db-54931076_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:58.447850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:58.447867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:58.447878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:58.447920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:58.447960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:58.448007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:58.451630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:58.451669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:58.451760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:58.452253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1113 partition: 0 MaxSeqNo: 46 sessionId: src_id|a791209f-a97336f1-406094db-54931076_0
2025-10-15T11:02:58.455556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76d435c3-e361a545-1a30ac7b-9e3fcd66_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a791209f-a97336f1-406094db-54931076_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:58.496377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a791209f-a97336f1-406094db-54931076_0] Write session: try to update token
2025-10-15T11:02:58.496432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a791209f-a97336f1-406094db-54931076_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:58.654446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:58.665838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:58.665866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:58.665943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:58.665957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:58.665969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:58.665979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:58.666010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402361462889098:10228]
2025-10-15T11:02:58.666035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402361462889098:10228]
2025-10-15T11:02:58.666057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402361462889098:10228]
2025-10-15T11:02:58.666186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:58.666239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:58.666255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:58.666268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:58.666276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:58.693991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:58.727555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId: src_id|a791209f-a97336f1-406094db-54931076_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:58.756353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:58.897920Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:58.922245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:58.922290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:58.922357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:58.922370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:58.922411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402361462889098:10228]
2025-10-15T11:02:58.922707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:58.922999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:58.923283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:58.923313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:58.962092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402358663200147:4077]
2025-10-15T11:02:58.962177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1113 reason: error at write: Disconnected sessionId: src_id|a791209f-a97336f1-406094db-54931076_0
2025-10-15T11:02:58.962464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1113 sessionId: src_id|a791209f-a97336f1-406094db-54931076_0 is DEAD
2025-10-15T11:02:58.967612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a791209f-a97336f1-406094db-54931076_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:58.967667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a791209f-a97336f1-406094db-54931076_0] Write session will restart in 0.009481s
2025-10-15T11:02:58.967810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a791209f-a97336f1-406094db-54931076_0] Write session: Do CDS request
2025-10-15T11:02:58.967858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a791209f-a97336f1-406094db-54931076_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:58.982432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a791209f-a97336f1-406094db-54931076_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:58.990740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:58.995371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:58.995414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1114
2025-10-15T11:02:58.999644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:58.999802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:58.999819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:58.999831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:59.001279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1114 sessionId:  describe result for acl check
2025-10-15T11:02:59.001403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:59.001414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:59.001423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:59.001441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402362958167658:3740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:59.008481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402362958167658:3740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:59.037746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402362958167658:3740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:59.047985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402362958167658:3740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:59.048036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402362958167658:3740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:59.048055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402362958167658:3740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:59.048088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:59.062249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:59.062934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402362958167795:4077]
2025-10-15T11:02:59.065846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:59.066533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:59.066551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:59.066590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:59.066841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:59.066962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402365757856628:10235]
2025-10-15T11:02:59.068741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:59.069591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:59.069773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:59.070987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:59.071295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:59.071310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:59.071318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:59.071324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:59.071332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:59.071339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:59.071380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:59.071388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:59.071396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:59.071403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:59.071411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:59.071418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.071425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.071432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.071481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:59.071591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:59.071639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:59.071689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:59.071746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:59.071824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:59.071878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:59.071932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:59.071982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:59.072034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:59.072081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:59.072129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.072175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.072220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.072264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:59.072333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:59.072393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:59.072448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:59.072499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:59.072553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:59.072595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:59.072650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:59.072699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:59.072759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:59.072818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:59.072875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:59.072926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:59.072980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:59.073022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:59.073075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:59.073132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:59.073196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:59.073247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:59.073299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:59.073344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:59.073430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:59.073479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.073534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.073582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.073636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.073683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.073738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.074249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:59.107966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:59.118762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:59.118816Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:59.118835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:59.118857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:59.118885Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1113 [2:7561402365757856628:10235]
2025-10-15T11:02:59.118942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:59.119007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:59.119034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:59.119046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:59.119059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:59.119112Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:59.119137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:59.119163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:59.121224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.121252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.121268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.121279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:59.121572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:59.121601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.123040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1113
2025-10-15T11:02:59.123135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1113, pipe: [1:7561402362958167795:4077]
2025-10-15T11:02:59.123203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1113
2025-10-15T11:02:59.121750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.121952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.122195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:59.122274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402365757856622:10235]
2025-10-15T11:02:59.122291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402365757856622:10235]
2025-10-15T11:02:59.122305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402365757856622:10235]
2025-10-15T11:02:59.122351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:59.122431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:59.122620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:59.122636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:59.122717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:59.122731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:59.122744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:59.122787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402362958167791:3740], now have 1 active actors on pipe
2025-10-15T11:02:59.122809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402365757856622:10235]
2025-10-15T11:02:59.122842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:59.122909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402362958167795:4077], now have 1 active actors on pipe
2025-10-15T11:02:59.122939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402358663200350:2467], now have 1 active actors on pipe
2025-10-15T11:02:59.123101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:59.124320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:59.124356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:59.124456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cdb669e-f1554628-36e53c91-7974549c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:59.124491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:59.124509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:59.124521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:59.124560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:59.124604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:59.124660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:59.125665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:59.125695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:59.125763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:59.126610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1114 partition: 0 MaxSeqNo: 46 sessionId: src_id|3cdb669e-f1554628-36e53c91-7974549c_0
2025-10-15T11:02:59.128422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a791209f-a97336f1-406094db-54931076_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3cdb669e-f1554628-36e53c91-7974549c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:59.192277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdb669e-f1554628-36e53c91-7974549c_0] Write session: try to update token
2025-10-15T11:02:59.192346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdb669e-f1554628-36e53c91-7974549c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:59.219306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:59.219338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:59.219571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
E1015 11:02:59.353738270  821271 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:02:59.359814Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:02:59.366723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:59.366756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:59.366768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:59.366901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:59.366920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:59.366936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:59.366947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:59.366986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402365757856622:10235]
2025-10-15T11:02:59.367016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402365757856622:10235]
2025-10-15T11:02:59.367045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402365757856622:10235]
2025-10-15T11:02:59.367667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:59.367704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:59.367736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:59.390907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:59.393854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:59.396517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:02:59.432001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId: src_id|3cdb669e-f1554628-36e53c91-7974549c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:02:59.468416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:02:59.572442Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:02:59.574021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:02:59.574045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:59.574096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402365757856622:10235]
2025-10-15T11:02:59.574264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:59.574292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:59.574651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:02:59.575886Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:02:59.577901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:02:59.578201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:02:59.578227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:02:59.580007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402362958167795:4077]
2025-10-15T11:02:59.591928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1114 reason: error at write: Disconnected sessionId: src_id|3cdb669e-f1554628-36e53c91-7974549c_0
2025-10-15T11:02:59.592255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1114 sessionId: src_id|3cdb669e-f1554628-36e53c91-7974549c_0 is DEAD
2025-10-15T11:02:59.597107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdb669e-f1554628-36e53c91-7974549c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:02:59.597147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdb669e-f1554628-36e53c91-7974549c_0] Write session will restart in 0.008003s
2025-10-15T11:02:59.597247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdb669e-f1554628-36e53c91-7974549c_0] Write session: Do CDS request
2025-10-15T11:02:59.597272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdb669e-f1554628-36e53c91-7974549c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:02:59.609363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:02:59.609395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1115
2025-10-15T11:02:59.610326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdb669e-f1554628-36e53c91-7974549c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:59.611667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:02:59.611807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:02:59.611825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:02:59.611834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:02:59.613122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1115 sessionId:  describe result for acl check
2025-10-15T11:02:59.613222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:02:59.613241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:02:59.613250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:02:59.613266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402362958167856:3737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:02:59.615797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402362958167856:3737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:02:59.631615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402362958167856:3737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:02:59.640472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402362958167856:3737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:02:59.640518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402362958167856:3737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:02:59.640535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402362958167856:3737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:02:59.640570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:02:59.680723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402362958167936:4077]
2025-10-15T11:02:59.722727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:02:59.730221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:02:59.731162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:02:59.731182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:02:59.731230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:02:59.731585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:02:59.731780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402365757856833:10241]
2025-10-15T11:02:59.733434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:02:59.734584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:02:59.734747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:02:59.735726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:02:59.736034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:59.736043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:59.736051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:59.736061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:59.736068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:59.736076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:59.736083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:59.736091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:59.736099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:59.736107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:59.736115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:59.736122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.736130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.736139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.736178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:59.736270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:59.736313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:59.736367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:59.736414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:59.736451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:59.736488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:59.736525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:59.736562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:59.736600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:59.736636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:59.736671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.736706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.736756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.736787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:59.736850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:02:59.736898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:59.736939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:02:59.736986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:59.737027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:02:59.737063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:59.737105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:02:59.737143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:59.737182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:02:59.737217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:59.737259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:02:59.737294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:59.737344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:02:59.737395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:59.737454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:02:59.737499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:59.737541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:02:59.737574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:59.737613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:02:59.737646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:59.737687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:02:59.737722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.737762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.737796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.737834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.737876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.737917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.738306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:02:59.764564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:02:59.776980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:02:59.777026Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:02:59.777044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:02:59.777063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:02:59.777090Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1114 [2:7561402365757856833:10241]
2025-10-15T11:02:59.777146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:02:59.777205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:02:59.777221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:59.777233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:59.777244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:59.777294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:02:59.777318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:02:59.777340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:02:59.779578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.779595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.779612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.779624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:02:59.779920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:02:59.780771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1114
2025-10-15T11:02:59.780892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1114
2025-10-15T11:02:59.780955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1114, pipe: [1:7561402362958167936:4077]
2025-10-15T11:02:59.779952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:02:59.780107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:02:59.780306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:02:59.780540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:02:59.780627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402362958167842:2467], now have 1 active actors on pipe
2025-10-15T11:02:59.780652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402362958167889:3737], now have 1 active actors on pipe
2025-10-15T11:02:59.780673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402362958167936:4077], now have 1 active actors on pipe
2025-10-15T11:02:59.780699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402365757856827:10241]
2025-10-15T11:02:59.780715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402365757856827:10241]
2025-10-15T11:02:59.780728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402365757856827:10241]
2025-10-15T11:02:59.780786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:02:59.780864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:02:59.781050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:02:59.781069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:02:59.781190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402365757856827:10241]
2025-10-15T11:02:59.781210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:02:59.781304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:02:59.781319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:02:59.781331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:02:59.781356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:02:59.790144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1115 partition: 0 MaxSeqNo: 46 sessionId: src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0
2025-10-15T11:02:59.791495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdb669e-f1554628-36e53c91-7974549c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:02:59.788719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:59.788771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:59.788860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:02:59.788897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:59.788916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:59.788927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:02:59.788969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:59.789021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:02:59.789069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:59.789737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:02:59.789758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:02:59.789823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:02:59.843151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0] Write session: try to update token
2025-10-15T11:02:59.843208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:02:59.968239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:02:59.968274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:02:59.968284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:02:59.968332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:02:59.968346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:02:59.968358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:02:59.968368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:02:59.968397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402365757856827:10241]
2025-10-15T11:02:59.968419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402365757856827:10241]
2025-10-15T11:02:59.968440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402365757856827:10241]
2025-10-15T11:02:59.968531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:02:59.968559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:02:59.968585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:02:59.975939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:02:59.975987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:02:59.977067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:00.071204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId: src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:00.094452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:00.149367Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:00.165398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:00.165445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:00.168359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:00.168515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:00.168527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:00.175193Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:00.190196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:00.190279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0] Write session will restart in 0.005553s
2025-10-15T11:03:00.190464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0] Write session: Do CDS request
2025-10-15T11:03:00.190529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:00.188925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1115 reason: error at write: Disconnected sessionId: src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0
2025-10-15T11:03:00.189300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1115 sessionId: src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0 is DEAD
2025-10-15T11:03:00.225094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402362958167936:4077]
2025-10-15T11:03:00.227206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:00.231472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:00.231512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1116
2025-10-15T11:03:00.238279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:00.238456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:00.238473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:00.238482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:00.243220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1116 sessionId:  describe result for acl check
2025-10-15T11:03:00.243324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:00.243334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:00.243376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:00.243396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402367253135367:3726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:00.245959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402367253135367:3726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:00.268140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402367253135367:3726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:00.280433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402367253135367:3726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:00.280476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402367253135367:3726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:00.280507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402367253135367:3726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:00.280538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:00.327732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402367253135465:4077]
2025-10-15T11:03:00.392486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:00.401441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:00.402543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:00.402563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:00.402613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:00.402920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:00.403115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402370052824373:10250]
2025-10-15T11:03:00.405519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:00.406787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:00.407009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:00.408432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:00.408809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:00.408818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:00.408826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:00.408834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:00.408842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:00.408850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:00.408859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:00.408867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:00.408874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:00.408882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:00.408890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:00.408898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:00.408905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:00.408913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:00.408962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:00.409078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:00.409126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:00.409191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:00.409242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:00.409301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:00.409349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:00.409395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:00.409453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:00.409504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:00.409553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:00.409601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:00.409650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:00.409695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:00.409741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:00.409817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:00.409879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:00.409937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:00.409987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:00.410041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:00.410092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:00.410153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:00.410206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:00.410263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:00.410310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:00.410365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:00.410413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:00.410464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:00.410511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:00.410565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:00.410615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:00.410668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:00.410715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:00.410769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:00.410821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:00.410877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:00.410924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:00.410976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:00.411025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:00.411079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:00.411128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:00.411180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:00.413147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:00.439203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:00.449658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:00.449844Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:00.449865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:00.449885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:00.449913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1115 [2:7561402370052824373:10250]
2025-10-15T11:03:00.449971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:00.450032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:00.450047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:00.450061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:00.450073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:00.450124Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:00.450150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:00.450174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:00.452005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:00.452027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:00.452043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:00.452055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:00.452338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:00.452357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:00.452510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:00.452723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:00.452972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:00.453045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402370052824367:10250]
2025-10-15T11:03:00.453061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402370052824367:10250]
2025-10-15T11:03:00.453077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402370052824367:10250]
2025-10-15T11:03:00.453151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:00.453165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:00.453177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:00.454456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:00.454551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:00.454769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:00.454789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:00.454839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402367253135419:3726], now have 1 active actors on pipe
2025-10-15T11:03:00.454868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402367253135465:4077], now have 1 active actors on pipe
2025-10-15T11:03:00.454891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402367253135353:2467], now have 1 active actors on pipe
2025-10-15T11:03:00.455014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402370052824367:10250]
2025-10-15T11:03:00.455045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:00.455227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:00.455582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1115
2025-10-15T11:03:00.455674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1115, pipe: [1:7561402367253135465:4077]
2025-10-15T11:03:00.455740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1115
2025-10-15T11:03:00.457649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:00.457688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:00.457791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:00.457826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:00.457846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:00.457857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:00.457898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:00.457946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:00.458000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:00.459539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:00.459570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:00.459645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:00.463930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1116 partition: 0 MaxSeqNo: 46 sessionId: src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0
2025-10-15T11:03:00.464787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bb6e2d5-9a32e10b-27d5cb6d-29e72f5c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:00.506731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0] Write session: try to update token
2025-10-15T11:03:00.506798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:00.589091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:00.589126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:00.589138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:00.589202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:00.589217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:00.589232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:00.589243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:00.589279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402370052824367:10250]
2025-10-15T11:03:00.589308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402370052824367:10250]
2025-10-15T11:03:00.589334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402370052824367:10250]
2025-10-15T11:03:00.589464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:00.589488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:00.589501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:00.589511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:00.589532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:00.603115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:00.716835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId: src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:00.755119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:00.834292Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:00.845167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:00.845212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:00.846873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:00.846928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:00.847310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402367253135465:4077]
2025-10-15T11:03:00.847719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:00.849584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:00.893546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1116 reason: error at write: Disconnected sessionId: src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0
2025-10-15T11:03:00.893893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1116 sessionId: src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0 is DEAD
2025-10-15T11:03:00.896237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:00.896304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0] Write session will restart in 0.006330s
2025-10-15T11:03:00.896451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0] Write session: Do CDS request
2025-10-15T11:03:00.896497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:00.910711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:00.911944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:00.911988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1117
2025-10-15T11:03:00.912325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:00.912451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:00.912466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:00.912476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:00.914805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1117 sessionId:  describe result for acl check
2025-10-15T11:03:00.914913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:00.914925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:00.914935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:00.914953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402367253135631:3706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:00.917939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402367253135631:3706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:00.943918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402367253135631:3706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:00.947945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402367253135720:4077]
2025-10-15T11:03:00.963063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402367253135631:3706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:00.963107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402367253135631:3706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:00.963125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402367253135631:3706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:00.963157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:00.990346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:00.996671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:00.997559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:00.997578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:00.997620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:00.997879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:00.998047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402370052824580:10260]
2025-10-15T11:03:01.000450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:01.001695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:01.001940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:01.003303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:01.003676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:01.003695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:01.003704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:01.003712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:01.003721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:01.003729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:01.003736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:01.003745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:01.003753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:01.003762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:01.003770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:01.003778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.003785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.003794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.003845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:01.003969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:01.004022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:01.004075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:01.004122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:01.004173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:01.004221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:01.004273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:01.004332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:01.004385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:01.004434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:01.004484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.004537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.004587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.004637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:01.004728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:01.004793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:01.004850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:01.004904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:01.004967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:01.005019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:01.005076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:01.005137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:01.005199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:01.005249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:01.005311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:01.005362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:01.005419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:01.005468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:01.005526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:01.005576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:01.005632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:01.005682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:01.005742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:01.005789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:01.005843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:01.005895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.005952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.006000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.006058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.006101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.006153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.006665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:01.028880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:01.045824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:01.045870Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:01.045889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:01.045911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:01.045940Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1116 [2:7561402370052824580:10260]
2025-10-15T11:03:01.045999Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:01.046066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:01.046087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:01.046102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:01.046115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:01.046171Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:01.046203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:01.046235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:01.047038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.047063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.047078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.047091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:01.047306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:01.047334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.047487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.047655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.047852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:01.047926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402370052824574:10260]
2025-10-15T11:03:01.047946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402370052824574:10260]
2025-10-15T11:03:01.047961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402370052824574:10260]
2025-10-15T11:03:01.048091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:01.048108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:01.048120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:01.048654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1116, pipe: [1:7561402367253135720:4077]
2025-10-15T11:03:01.048786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1116
2025-10-15T11:03:01.048864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1116
2025-10-15T11:03:01.049032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:01.049134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:01.049351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:01.049376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:01.049436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402367253135720:4077], now have 1 active actors on pipe
2025-10-15T11:03:01.049462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402367253135764:3706], now have 1 active actors on pipe
2025-10-15T11:03:01.049484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402367253135605:2467], now have 1 active actors on pipe
2025-10-15T11:03:01.049536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:01.049558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:01.049708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402370052824574:10260]
2025-10-15T11:03:01.049740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:01.049811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89723599-595f25ef-b00fe22a-25cedd02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:01.049847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:01.049865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:01.049876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:01.049915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:01.049960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:01.050096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:01.050258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:01.051366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:01.051397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:01.051472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:01.051919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1117 partition: 0 MaxSeqNo: 46 sessionId: src_id|89723599-595f25ef-b00fe22a-25cedd02_0
2025-10-15T11:03:01.056080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c65427-2e5d1aa0-5abca44f-24931df3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|89723599-595f25ef-b00fe22a-25cedd02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:01.085955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89723599-595f25ef-b00fe22a-25cedd02_0] Write session: try to update token
2025-10-15T11:03:01.086023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89723599-595f25ef-b00fe22a-25cedd02_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:01.132016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:01.132053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:01.132097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402370052824574:10260]
2025-10-15T11:03:01.132241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:01.132251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:01.144127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:01.145346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:01.146381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:01.153969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:01.176834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:01.177256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:01.177271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:01.177284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:01.177347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:01.232360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId: src_id|89723599-595f25ef-b00fe22a-25cedd02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:01.317731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:01.317764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:01.317777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:01.317790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:01.317827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402370052824574:10260]
2025-10-15T11:03:01.317853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402370052824574:10260]
2025-10-15T11:03:01.317873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402370052824574:10260]
2025-10-15T11:03:01.318024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:01.318035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:01.318047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:01.318087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:01.318106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:01.318186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:01.318212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:01.318244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:01.320787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:01.322367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:01.522912Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:01.542569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:01.542609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:01.545576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402367253135720:4077]
2025-10-15T11:03:01.545788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:01.546992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:01.543952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:01.580046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1117 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89723599-595f25ef-b00fe22a-25cedd02_0
2025-10-15T11:03:01.580360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1117 sessionId: src_id|89723599-595f25ef-b00fe22a-25cedd02_0 is DEAD
2025-10-15T11:03:01.583831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89723599-595f25ef-b00fe22a-25cedd02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:01.583866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89723599-595f25ef-b00fe22a-25cedd02_0] Write session will restart in 0.008144s
2025-10-15T11:03:01.583958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89723599-595f25ef-b00fe22a-25cedd02_0] Write session: Do CDS request
2025-10-15T11:03:01.583985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89723599-595f25ef-b00fe22a-25cedd02_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:01.599112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89723599-595f25ef-b00fe22a-25cedd02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:01.600004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:01.600065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1118
2025-10-15T11:03:01.603576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:01.603734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:01.603752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:01.603764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:01.605453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1118 sessionId:  describe result for acl check
2025-10-15T11:03:01.605589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:01.605602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:01.605613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:01.605632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402371548103146:3698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:01.608853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402371548103146:3698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:01.620991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402371548103146:3698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:01.634111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402371548103146:3698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:01.634165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402371548103146:3698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:01.634187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402371548103146:3698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:01.634234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:01.645740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402371548103203:4077]
2025-10-15T11:03:01.704554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:01.706653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:01.707608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:01.707641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:01.707684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:01.707940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:01.708098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402374347792106:10270]
2025-10-15T11:03:01.709844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:01.714595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:01.714868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:01.716420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:01.716829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:01.716845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:01.716853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:01.716861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:01.716867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:01.716875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:01.716883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:01.716890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:01.716897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:01.716905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:01.716912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:01.716920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.716927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.716934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.716985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:01.717102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:01.717150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:01.717201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:01.717251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:01.717303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:01.717352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:01.717399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:01.717447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:01.717496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:01.717547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:01.717595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.717640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.717689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.717736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:01.717804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:01.717866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:01.717924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:01.717980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:01.718039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:01.718091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:01.718147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:01.718197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:01.718255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:01.718306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:01.718368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:01.718419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:01.718479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:01.718529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:01.718586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:01.718641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:01.718701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:01.718753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:01.718809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:01.718859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:01.718914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:01.718962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.719021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.719072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.719130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.719178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.719235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.721194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:01.759997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:01.771460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:01.771513Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:01.771531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:01.771551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:01.771579Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1117 [2:7561402374347792106:10270]
2025-10-15T11:03:01.771633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:01.771694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:01.771708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:01.771719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:01.771731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:01.771784Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:01.771807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:01.771831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:01.773567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.773605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.773619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.773632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:01.773923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:01.773950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:01.774099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:01.774883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1117
2025-10-15T11:03:01.774990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1117, pipe: [1:7561402371548103203:4077]
2025-10-15T11:03:01.775092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1117
2025-10-15T11:03:01.775663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:01.775934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:01.776029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402371548103131:2467], now have 1 active actors on pipe
2025-10-15T11:03:01.776055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402371548103203:4077], now have 1 active actors on pipe
2025-10-15T11:03:01.776080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402371548103183:3698], now have 1 active actors on pipe
2025-10-15T11:03:01.776146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:01.776168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:01.776209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402374347792101:10270]
2025-10-15T11:03:01.776225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402374347792101:10270]
2025-10-15T11:03:01.776240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402374347792101:10270]
2025-10-15T11:03:01.776284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:01.776369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:01.776573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:01.776594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:01.776694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:01.776728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:01.776748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:01.776758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:01.776800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:01.776848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:01.776988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402374347792101:10270]
2025-10-15T11:03:01.777011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:01.777061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:01.777770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:01.777788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:01.777801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:01.777829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:01.778648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:01.778675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:01.778745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:01.779163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1118 partition: 0 MaxSeqNo: 46 sessionId: src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0
2025-10-15T11:03:01.780049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89723599-595f25ef-b00fe22a-25cedd02_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:01.808029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0] Write session: try to update token
2025-10-15T11:03:01.808094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:01.909573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:01.909607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:01.909619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:01.909681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:01.909698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:01.909712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:01.909725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:01.909760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402374347792101:10270]
2025-10-15T11:03:01.909787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402374347792101:10270]
2025-10-15T11:03:01.909811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402374347792101:10270]
2025-10-15T11:03:01.909916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:01.909946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:01.909975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:01.921059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:01.921101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:01.926676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:01.996572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId: src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:02.041185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:02.113405Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:02.132885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:02.134709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:02.134810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:02.134827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:02.134870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402374347792101:10270]
2025-10-15T11:03:02.135763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:02.136515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:02.143529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:02.143734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402371548103203:4077]
2025-10-15T11:03:02.143830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:02.183582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1118 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0
2025-10-15T11:03:02.183944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1118 sessionId: src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0 is DEAD
2025-10-15T11:03:02.188085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:02.188150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0] Write session will restart in 0.008274s
2025-10-15T11:03:02.188318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0] Write session: Do CDS request
2025-10-15T11:03:02.188371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:02.206177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:02.212333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:02.212370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1119
2025-10-15T11:03:02.215651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:02.215815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:02.215833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:02.215845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:02.217385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1119 sessionId:  describe result for acl check
2025-10-15T11:03:02.217514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:02.217526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:02.217535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:02.217555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402375843070669:3681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:02.224433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402375843070669:3681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:02.245345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402375843070669:3681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:02.247831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402375843070700:4077]
2025-10-15T11:03:02.282986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402375843070669:3681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:02.283031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402375843070669:3681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:02.283049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402375843070669:3681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:02.283082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:02.363570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:02.374623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:02.375550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:02.375572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:02.375623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:02.375957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:02.376170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402378642759636:10277]
2025-10-15T11:03:02.377751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:02.378861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:02.379084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:02.380421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:02.380782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:02.380804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:02.380811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:02.380818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:02.380826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:02.380833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:02.380840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:02.380847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:02.380854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:02.380862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:02.380869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:02.380875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:02.380883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:02.380890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:02.380940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:02.381051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:02.381101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:02.381152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:02.381197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:02.381243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:02.381290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:02.381334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:02.381375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:02.381421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:02.381466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:02.381511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:02.381570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:02.381616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:02.381659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:02.381727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:02.381788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:02.381841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:02.381889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:02.381941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:02.381984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:02.382038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:02.382087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:02.382140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:02.382187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:02.382241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:02.382289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:02.382343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:02.382388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:02.382441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:02.382491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:02.382547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:02.382591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:02.382646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:02.382691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:02.382748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:02.382792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:02.382845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:02.382897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:02.382951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:02.382992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:02.383044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:02.383579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:02.415082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:02.425066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:02.425111Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:02.425129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:02.425148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:02.425175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1118 [2:7561402378642759636:10277]
2025-10-15T11:03:02.425232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:02.425292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:02.425308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:02.425323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:02.425335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:02.425387Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:02.425411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:02.425434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:02.427303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:02.427322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:02.427339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:02.427384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:02.427689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:02.427711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:02.427862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:02.428064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:02.428316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:02.428404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402375843070761:3681], now have 1 active actors on pipe
2025-10-15T11:03:02.428429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402375843070654:2467], now have 1 active actors on pipe
2025-10-15T11:03:02.428450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402375843070700:4077], now have 1 active actors on pipe
2025-10-15T11:03:02.428479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402378642759631:10277]
2025-10-15T11:03:02.428495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402378642759631:10277]
2025-10-15T11:03:02.428507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402378642759631:10277]
2025-10-15T11:03:02.428547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:02.428641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:02.428840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:02.428861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:02.429034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402378642759631:10277]
2025-10-15T11:03:02.429056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:02.429337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1118
2025-10-15T11:03:02.429430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1118
2025-10-15T11:03:02.429500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1118, pipe: [1:7561402375843070700:4077]
2025-10-15T11:03:02.429724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:02.429747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:02.429759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:02.429784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:02.430083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:02.430115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:02.430207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:02.430244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:02.430264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:02.430275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:02.430313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:02.430361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:02.430414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:02.432497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:02.432527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:02.432623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:02.432933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1119 partition: 0 MaxSeqNo: 46 sessionId: src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0
2025-10-15T11:03:02.435657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30b2e300-cf079b52-1a3b308d-ef264d71_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:02.542143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0] Write session: try to update token
2025-10-15T11:03:02.542208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:02.676377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId: src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:02.707197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:02.707235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:02.707247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:02.707309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:02.707326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:02.707341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:02.707854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:02.707903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402378642759631:10277]
2025-10-15T11:03:02.707936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402378642759631:10277]
2025-10-15T11:03:02.707964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402378642759631:10277]
2025-10-15T11:03:02.708193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:02.708218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:02.709144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:02.711700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:02.711738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:02.711770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:02.721111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:02.876232Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:02.888820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:02.888881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:02.888969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:02.888986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:02.889036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402378642759631:10277]
2025-10-15T11:03:02.889794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:02.890703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:02.895470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:02.896874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:02.897019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402375843070700:4077]
2025-10-15T11:03:02.903256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1119 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0
2025-10-15T11:03:02.907879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1119 sessionId: src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0 is DEAD
2025-10-15T11:03:02.915622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:02.915670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0] Write session will restart in 0.005206s
2025-10-15T11:03:02.915765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0] Write session: Do CDS request
2025-10-15T11:03:02.915793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:02.928821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:02.930373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:02.930409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1120
2025-10-15T11:03:02.930836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:02.930977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:02.930995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:02.931008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:02.934409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1120 sessionId:  describe result for acl check
2025-10-15T11:03:02.934624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:02.934652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:02.934674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:02.934718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402375843070906:3654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:02.941669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402375843070906:3654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:02.960481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402375843070906:3654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:03.001172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402380138038272:4077]
2025-10-15T11:03:03.013308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402375843070906:3654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:03.013346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402375843070906:3654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:03.013361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402375843070906:3654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:03.013389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:03.118093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:03.122334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:03.123193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:03.123211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:03.123255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:03.123530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:03.123717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402382937727155:10283]
2025-10-15T11:03:03.125878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:03.127212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:03.127440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:03.128648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:03.128965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:03.128979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:03.128986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:03.128992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:03.128999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:03.129006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:03.129012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:03.129018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:03.129024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:03.129031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:03.129038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:03.129045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.129051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.129076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.129117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:03.129237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:03.129286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:03.129330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:03.129371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:03.129415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:03.129459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:03.129502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:03.129548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:03.129593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:03.129635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:03.129687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.129748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.129809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.129868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:03.129929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:03.129986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:03.130053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:03.130119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:03.130170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:03.130214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:03.130264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:03.130310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:03.130357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:03.131395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:03.131468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:03.131517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:03.131569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:03.131624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:03.131677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:03.131725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:03.131991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:03.132044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:03.132099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:03.132144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:03.132197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:03.132240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.132290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.132338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.132389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.132435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.132483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.132973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:03.180714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:03.196049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:03.196087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:03.196102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:03.196118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:03.196140Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1119 [2:7561402382937727155:10283]
2025-10-15T11:03:03.196186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:03.196234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:03.196247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:03.196259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:03.196268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:03.196310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:03.196331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:03.196350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:03.198055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.198071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.198082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.198092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:03.198335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:03.198350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.198478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.198639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.198849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:03.198914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402382937727150:10283]
2025-10-15T11:03:03.198929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402382937727150:10283]
2025-10-15T11:03:03.198940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402382937727150:10283]
2025-10-15T11:03:03.198976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:03.199041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:03.199201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:03.199219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:03.199330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402382937727150:10283]
2025-10-15T11:03:03.201322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1119, pipe: [1:7561402380138038272:4077]
2025-10-15T11:03:03.201416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1119
2025-10-15T11:03:03.201479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1119
2025-10-15T11:03:03.200083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:03.200104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:03.200114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:03.200136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:03.204955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:03.205093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402380138038272:4077], now have 1 active actors on pipe
2025-10-15T11:03:03.205117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402380138038293:3654], now have 1 active actors on pipe
2025-10-15T11:03:03.205149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402375843070899:2467], now have 1 active actors on pipe
2025-10-15T11:03:03.205198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:03.205219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:03.205450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:03.205483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:03.205499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:03.205510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:03.205546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:03.205584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:03.205654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:03.208069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:03.208100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:03.208167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:03.208648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1120 partition: 0 MaxSeqNo: 46 sessionId: src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0
2025-10-15T11:03:03.209570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3dca86a-ccaff16-60f4b69f-eb33e580_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:03.254574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0] Write session: try to update token
2025-10-15T11:03:03.254629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:03.402885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:03.402910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:03.402919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:03.402975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:03.402988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:03.402999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:03.403009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:03.403038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402382937727150:10283]
2025-10-15T11:03:03.403063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402382937727150:10283]
2025-10-15T11:03:03.403085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402382937727150:10283]
2025-10-15T11:03:03.403191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:03.403220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:03.403243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:03.403262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:03.403282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:03.424294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:03.471537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId: src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:03.515748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:03.608665Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:03.625867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:03.623737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:03.623790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:03.623859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:03.623875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:03.623920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402382937727150:10283]
2025-10-15T11:03:03.624160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:03.624598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:03.711673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:03.711710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0] Write session will restart in 0.007834s
2025-10-15T11:03:03.711799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0] Write session: Do CDS request
2025-10-15T11:03:03.711825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:03.710090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:03.710493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1120 reason: status is not ok: tablet will be restarted right now sessionId: src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0
2025-10-15T11:03:03.710785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1120 sessionId: src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0 is DEAD
2025-10-15T11:03:03.732081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:03.741220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:03.741254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1121
2025-10-15T11:03:03.741593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402380138038272:4077]
2025-10-15T11:03:03.741980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:03.742098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:03.742114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:03.742123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:03.745164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1121 sessionId:  describe result for acl check
2025-10-15T11:03:03.745289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:03.745301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:03.745311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:03.745326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402380138038506:3646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:03.748192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402380138038506:3646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:03.775040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402380138038506:3646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:03.801184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402380138038506:3646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:03.801229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402380138038506:3646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:03.801245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402380138038506:3646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:03.801275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:03.821357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:03.827850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:03.828658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:03.828676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:03.828718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:03.828969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:03.829154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402382937727390:10298]
2025-10-15T11:03:03.831267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:03.832390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:03.832555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:03.833407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:03.833634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:03.833638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:03.833643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:03.833647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:03.833651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:03.833655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:03.833659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:03.833663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:03.833668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:03.833672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:03.833677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:03.833682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.833686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.833691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.833723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:03.833797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:03.833829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:03.833861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:03.833893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:03.833925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:03.833957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:03.833987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:03.834015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:03.834047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:03.834082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:03.834125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.834160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.834189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.834214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:03.834257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:03.834293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:03.834340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:03.834375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:03.834411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:03.834438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:03.834473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:03.834504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:03.834537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:03.834565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:03.834609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:03.834642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:03.834676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:03.834707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:03.834743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:03.834778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:03.834813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:03.834843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:03.834880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:03.834911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:03.834945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:03.834972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.835008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.835039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.835072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.835105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.835149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.835744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:03.843934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402380138038639:4077]
2025-10-15T11:03:03.862145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:03.881176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:03.881222Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:03.881241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:03.881261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:03.881289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1120 [2:7561402382937727390:10298]
2025-10-15T11:03:03.881343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:03.881409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:03.881426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:03.881437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:03.881448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:03.881501Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:03.881524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:03.881547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:03.883415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.883433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.883447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.883460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:03.883728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:03.883747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:03.883904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:03.884103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:03.884340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:03.884417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402382937727385:10298]
2025-10-15T11:03:03.884434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402382937727385:10298]
2025-10-15T11:03:03.884449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402382937727385:10298]
2025-10-15T11:03:03.884497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:03.884592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:03.884783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:03.884828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:03.884965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402382937727385:10298]
2025-10-15T11:03:03.884986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:03.887804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1120
2025-10-15T11:03:03.887910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1120
2025-10-15T11:03:03.887970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1120, pipe: [1:7561402380138038639:4077]
2025-10-15T11:03:03.885539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:03.885561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:03.885571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:03.889931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1121 partition: 0 MaxSeqNo: 46 sessionId: src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0
2025-10-15T11:03:03.891007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45208a54-2fb0cbb6-d10755ca-71b79e39_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:03.885595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:03.888158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402380138038458:2467], now have 1 active actors on pipe
2025-10-15T11:03:03.888191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402380138038607:3646], now have 1 active actors on pipe
2025-10-15T11:03:03.888218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402380138038639:4077], now have 1 active actors on pipe
2025-10-15T11:03:03.888504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:03.888550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:03.888635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:03.888670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:03.888689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:03.888701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:03.888739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:03.888789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:03.888836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:03.889379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:03.889399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:03.889473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:03.914165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0] Write session: try to update token
2025-10-15T11:03:03.914222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:04.086258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:04.086291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:04.086305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:04.086361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:04.086375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:04.086387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:04.086397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:04.086432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402382937727385:10298]
2025-10-15T11:03:04.086458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402382937727385:10298]
2025-10-15T11:03:04.086482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402382937727385:10298]
2025-10-15T11:03:04.086633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:04.086661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:04.088005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:04.088045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:04.088074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:04.088621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:04.119868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId: src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:04.140657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:04.256001Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:04.257532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:04.257564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:04.260216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:04.260426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:04.260441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:04.269076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1121 reason: error at write: Disconnected sessionId: src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0
2025-10-15T11:03:04.269454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1121 sessionId: src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0 is DEAD
2025-10-15T11:03:04.274690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:04.274727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0] Write session will restart in 0.006008s
2025-10-15T11:03:04.274837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0] Write session: Do CDS request
2025-10-15T11:03:04.274867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:04.307471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402380138038639:4077]
2025-10-15T11:03:04.307883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:04.307904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1122
2025-10-15T11:03:04.308847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:04.309494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:04.309625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:04.309640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:04.309651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:04.311055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1122 sessionId:  describe result for acl check
2025-10-15T11:03:04.311165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:04.311174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:04.311182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:04.311197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402384433005955:3636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:04.313680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402384433005955:3636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:04.321500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:04.328110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402384433005955:3636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:04.343744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402384433005955:3636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:04.343791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402384433005955:3636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:04.343809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402384433005955:3636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:04.343840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:04.407997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402384433006165:4077]
2025-10-15T11:03:04.418371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:04.424462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:04.425396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:04.425430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:04.425474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:04.425756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:04.425967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402387232694913:10301]
2025-10-15T11:03:04.428505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:04.429897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:04.430151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:04.431479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:04.431827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:04.431836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:04.431844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:04.431852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:04.431859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:04.431866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:04.431873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:04.431880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:04.431888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:04.431895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:04.431902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:04.431908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.431915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.431921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.431974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:04.432093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:04.432144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:04.432193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:04.432245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:04.432296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:04.432346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:04.432391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:04.432440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:04.432503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:04.432550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:04.432598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.432646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.432692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.432739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:04.432809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:04.432872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:04.432930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:04.432981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:04.433040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:04.433087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:04.433142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:04.433192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:04.433249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:04.433294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:04.434158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:04.434218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:04.434275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:04.434323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:04.434382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:04.434437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:04.434489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:04.434537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:04.434593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:04.434642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:04.434699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:04.434749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.434807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.434857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.434916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.434963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.435018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.435584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:04.469242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:04.478174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:04.478225Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:04.478245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:04.478267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:04.478299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1121 [2:7561402387232694913:10301]
2025-10-15T11:03:04.478359Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:04.478425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:04.478441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:04.478454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:04.478466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:04.478522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:04.478547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:04.478571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:04.509989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.510018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.510028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.510039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:04.510309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:04.510325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.510464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.510625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.510825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:04.510896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402387232694908:10301]
2025-10-15T11:03:04.510910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402387232694908:10301]
2025-10-15T11:03:04.510923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402387232694908:10301]
2025-10-15T11:03:04.511054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:04.511066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:04.511076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:04.512468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:04.512586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:04.512927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:04.512952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:04.513004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402384433005990:3636], now have 1 active actors on pipe
2025-10-15T11:03:04.513032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402384433006165:4077], now have 1 active actors on pipe
2025-10-15T11:03:04.513055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402384433005946:2467], now have 1 active actors on pipe
2025-10-15T11:03:04.513106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:04.513128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:04.513277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402387232694908:10301]
2025-10-15T11:03:04.513306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:04.513381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:04.513414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:04.513433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:04.513444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:04.513482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:04.513540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:04.513666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:04.513790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:04.511718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1121
2025-10-15T11:03:04.511794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1121, pipe: [1:7561402384433006165:4077]
2025-10-15T11:03:04.511861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1121
2025-10-15T11:03:04.515589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:04.515621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:04.515697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:04.516477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1122 partition: 0 MaxSeqNo: 46 sessionId: src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0
2025-10-15T11:03:04.520158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e64f1071-cfe2f118-ec17a1ce-d78714e4_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:04.579565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:04.579597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:04.579619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:04.592509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0] Write session: try to update token
2025-10-15T11:03:04.592565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:04.667840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:04.667872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:04.667885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:04.667896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:04.667931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402387232694908:10301]
2025-10-15T11:03:04.667957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402387232694908:10301]
2025-10-15T11:03:04.667983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402387232694908:10301]
2025-10-15T11:03:04.668123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:04.668145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:04.669402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:04.671483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:04.671519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:04.671548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:04.787864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId: src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:04.808238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:04.818966Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:04.821165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:04.821202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:04.824136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:04.824195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:04.824825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402384433006165:4077]
2025-10-15T11:03:04.824948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:04.825291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:04.866881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:04.866922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0] Write session will restart in 0.007008s
2025-10-15T11:03:04.867021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0] Write session: Do CDS request
2025-10-15T11:03:04.867050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:04.866368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1122 reason: error at write: Disconnected sessionId: src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0
2025-10-15T11:03:04.866650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1122 sessionId: src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0 is DEAD
2025-10-15T11:03:04.883872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:04.884494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:04.884531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1123
2025-10-15T11:03:04.884951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:04.885068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:04.885085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:04.885095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:04.886559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1123 sessionId:  describe result for acl check
2025-10-15T11:03:04.886667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:04.886677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:04.886687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:04.886705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402384433006208:3607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:04.893759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402384433006208:3607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:04.925529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402384433006299:4077]
2025-10-15T11:03:04.927730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402384433006208:3607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:04.945137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402384433006208:3607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:04.945182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402384433006208:3607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:04.945197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402384433006208:3607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:04.945226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:04.963285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:04.969430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:04.970208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:04.970226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:04.970283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:04.970517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:04.970694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402387232695132:10312]
2025-10-15T11:03:04.972902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:04.974234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:04.974444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:04.975636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:04.975941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:04.975950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:04.975957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:04.975964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:04.975971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:04.975978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:04.975985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:04.975992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:04.975999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:04.976006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:04.976012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:04.976018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.976025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.976032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.976094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:04.976203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:04.976249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:04.976293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:04.976336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:04.976380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:04.976423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:04.976483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:04.976528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:04.976575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:04.976620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:04.976664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.976710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.976753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.976796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:04.976860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:04.976917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:04.976968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:04.977016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:04.977069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:04.977115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:04.977166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:04.977213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:04.977266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:04.977314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:04.977366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:04.977411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:04.977463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:04.977506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:04.977556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:04.977601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:04.977651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:04.977698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:04.977751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:04.977797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:04.977850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:04.977897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.977948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:04.977994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.978044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:04.978087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.978135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:04.978626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:04.999611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:05.011010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:05.011054Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:05.011072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:05.011090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:05.011116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1122 [2:7561402387232695132:10312]
2025-10-15T11:03:05.011167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:05.011222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:05.011237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:05.011249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:05.011261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:05.011304Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:05.011323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:05.011697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:05.021984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:05.022004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:05.022013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:05.022020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:05.022209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:05.022221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:05.022346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:05.022498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:05.022695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:05.022757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402387232695126:10312]
2025-10-15T11:03:05.022771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402387232695126:10312]
2025-10-15T11:03:05.022784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402387232695126:10312]
2025-10-15T11:03:05.022824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:05.022890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:05.023065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:05.023086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:05.023212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402387232695126:10312]
2025-10-15T11:03:05.023231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:05.023833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:05.023851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:05.023862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:05.023885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:05.024617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402384433006299:4077], now have 1 active actors on pipe
2025-10-15T11:03:05.024646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402384433006387:3607], now have 1 active actors on pipe
2025-10-15T11:03:05.024667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402384433006192:2467], now have 1 active actors on pipe
2025-10-15T11:03:05.027598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1122, pipe: [1:7561402384433006299:4077]
2025-10-15T11:03:05.027622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1122
2025-10-15T11:03:05.027712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1122
2025-10-15T11:03:05.032175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:05.032205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:05.032274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc9f3174-99215556-f34bc693-80c8190_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:05.032299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:05.032312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:05.032323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:05.032357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:05.032387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:05.032421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:05.035867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:05.035893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:05.035953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:05.037475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1123 partition: 0 MaxSeqNo: 46 sessionId: src_id|dc9f3174-99215556-f34bc693-80c8190_0
2025-10-15T11:03:05.041244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec74ee38-a5eacb93-5e64d3d8-a031d227_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dc9f3174-99215556-f34bc693-80c8190_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:05.089526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9f3174-99215556-f34bc693-80c8190_0] Write session: try to update token
2025-10-15T11:03:05.089591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9f3174-99215556-f34bc693-80c8190_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:05.176170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:05.176203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:05.176215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:05.176273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:05.176290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:05.176304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:05.176315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:05.176352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402387232695126:10312]
2025-10-15T11:03:05.176379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402387232695126:10312]
2025-10-15T11:03:05.176405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402387232695126:10312]
2025-10-15T11:03:05.176633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:05.176660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:05.177604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:05.179626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:05.179659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:05.179684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:05.214681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId: src_id|dc9f3174-99215556-f34bc693-80c8190_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:05.246065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:05.369248Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:05.398032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:05.398081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:05.398153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:05.398170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:05.398216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402387232695126:10312]
2025-10-15T11:03:05.399988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:05.400987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:05.406569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:05.406915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402384433006299:4077]
2025-10-15T11:03:05.407102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:05.462989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1123 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dc9f3174-99215556-f34bc693-80c8190_0
2025-10-15T11:03:05.463778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9f3174-99215556-f34bc693-80c8190_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:05.463818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9f3174-99215556-f34bc693-80c8190_0] Write session will restart in 0.008639s
2025-10-15T11:03:05.463950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9f3174-99215556-f34bc693-80c8190_0] Write session: Do CDS request
2025-10-15T11:03:05.463996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9f3174-99215556-f34bc693-80c8190_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:05.463678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1123 sessionId: src_id|dc9f3174-99215556-f34bc693-80c8190_0 is DEAD
2025-10-15T11:03:05.480145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9f3174-99215556-f34bc693-80c8190_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:05.484892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:05.484930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1124
2025-10-15T11:03:05.486579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:05.486706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:05.486724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:05.486734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:05.488241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1124 sessionId:  describe result for acl check
2025-10-15T11:03:05.488364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:05.488376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:05.488387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:05.488403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402388727973740:3597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:05.497885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402388727973740:3597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:05.505334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402388727973762:4077]
2025-10-15T11:03:05.514122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402388727973740:3597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:05.532681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402388727973740:3597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:05.532735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402388727973740:3597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:05.532754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402388727973740:3597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:05.532790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:05.625792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:05.633421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:05.634223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:05.634241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:05.634280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:05.634521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:05.634693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402391527662667:10321]
2025-10-15T11:03:05.637913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:05.639017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:05.639225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:05.640580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:05.640915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:05.640923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:05.640930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:05.640936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:05.640944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:05.640951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:05.640958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:05.640965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:05.640972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:05.640979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:05.640986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:05.640993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:05.641000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:05.641006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:05.641052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:05.641159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:05.641210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:05.641257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:05.641307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:05.641356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:05.641400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:05.641446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:05.641491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:05.641542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:05.641589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:05.641635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:05.641681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:05.641726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:05.641769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:05.641836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:05.641892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:05.641950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:05.642000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:05.642056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:05.642102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:05.642158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:05.642208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:05.642264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:05.642309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:05.642367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:05.642416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:05.642471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:05.642514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:05.642565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:05.642610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:05.642660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:05.642703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:05.642755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:05.642802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:05.642859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:05.642903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:05.642958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:05.643003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:05.643056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:05.643101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:05.643154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:05.645371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:05.673966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:05.687432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:05.687477Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:05.687495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:05.687514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:05.687539Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1123 [2:7561402391527662667:10321]
2025-10-15T11:03:05.687589Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:05.687644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:05.687657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:05.687669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:05.687679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:05.687724Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:05.687745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:05.687768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:05.689480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:05.689504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:05.689517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:05.689529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:05.689784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:05.689804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:05.689943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:05.690120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:05.690348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:05.690410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402391527662661:10321]
2025-10-15T11:03:05.690424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402391527662661:10321]
2025-10-15T11:03:05.690439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402391527662661:10321]
2025-10-15T11:03:05.690479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:05.690545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:05.690712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:05.690728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:05.690834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402391527662661:10321]
2025-10-15T11:03:05.690852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:05.691182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:05.691194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:05.691205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:05.691227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:05.695533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1123, pipe: [1:7561402388727973762:4077]
2025-10-15T11:03:05.695676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1123
2025-10-15T11:03:05.695765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1123
2025-10-15T11:03:05.699458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402388727973762:4077], now have 1 active actors on pipe
2025-10-15T11:03:05.699511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402388727973710:2467], now have 1 active actors on pipe
2025-10-15T11:03:05.699533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402388727973799:3597], now have 1 active actors on pipe
2025-10-15T11:03:05.704726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:05.704764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:05.704848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:05.704881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:05.704899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:05.704909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:05.704943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:05.704985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:05.705030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:05.709532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:05.709567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:05.709647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:05.712287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1124 partition: 0 MaxSeqNo: 46 sessionId: src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0
2025-10-15T11:03:05.716143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9f3174-99215556-f34bc693-80c8190_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:05.748585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0] Write session: try to update token
2025-10-15T11:03:05.748638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:05.787873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:05.787902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:05.787915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:05.886375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:05.886411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:05.886451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402391527662661:10321]
2025-10-15T11:03:05.886562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:05.886582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:05.936210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:05.937412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:05.938513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:05.954495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:05.956135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:05.956587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:05.956603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:05.956615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:05.956676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:05.974747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId: src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:06.010797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:06.010834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:06.010848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:06.010860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:06.010903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402391527662661:10321]
2025-10-15T11:03:06.010931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402391527662661:10321]
2025-10-15T11:03:06.010955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402391527662661:10321]
2025-10-15T11:03:06.011117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:06.011147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:06.012283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:06.012326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:06.012355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:06.022166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:06.029281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:06.246135Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:06.259877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:06.259921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:06.261194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:06.263017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402388727973762:4077]
2025-10-15T11:03:06.263168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:06.263394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:06.283630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1124 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0
2025-10-15T11:03:06.283978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1124 sessionId: src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0 is DEAD
2025-10-15T11:03:06.288192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:06.288223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0] Write session will restart in 0.008941s
2025-10-15T11:03:06.288321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0] Write session: Do CDS request
2025-10-15T11:03:06.288350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:06.311956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:06.311990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1125
2025-10-15T11:03:06.312248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:06.318645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:06.318802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:06.318820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:06.318830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:06.320347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1125 sessionId:  describe result for acl check
2025-10-15T11:03:06.320502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:06.320514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:06.320525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:06.320543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402393022941276:3578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:06.327098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402393022941276:3578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:06.339763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402393022941276:3578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:06.351551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402393022941276:3578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:06.351596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402393022941276:3578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:06.351613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402393022941276:3578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:06.351645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:06.364263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402393022941311:4077]
2025-10-15T11:03:06.472786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:06.474651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:06.475591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:06.475612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:06.475662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:06.475974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:06.476163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402395822630205:10332]
2025-10-15T11:03:06.478779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:06.484081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:06.484401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:06.485925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:06.486346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:06.486356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:06.486363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:06.486370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:06.486377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:06.486385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:06.486393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:06.486399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:06.486408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:06.486415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:06.486424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:06.486431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:06.486439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:06.486446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:06.486498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:06.486619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:06.486669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:06.486719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:06.486768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:06.486819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:06.486867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:06.486915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:06.486962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:06.487011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:06.487060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:06.487111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:06.487161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:06.487212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:06.487262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:06.487338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:06.488269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:06.488349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:06.488420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:06.488478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:06.488536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:06.488593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:06.488642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:06.488698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:06.488745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:06.488797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:06.488848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:06.488905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:06.488952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:06.489009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:06.489062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:06.489117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:06.489162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:06.489218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:06.489267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:06.489323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:06.489371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:06.489424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:06.489471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:06.489526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:06.489577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:06.489636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:06.490183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:06.512477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:06.625396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:06.625444Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:06.625461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:06.625482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:06.625508Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1124 [2:7561402395822630205:10332]
2025-10-15T11:03:06.625563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:06.625624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:06.625639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:06.625652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:06.626139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:06.626204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:06.626229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:06.626251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:06.629034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:06.629049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:06.629063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:06.629075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:06.630555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:06.630677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:06.630822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:06.631009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:06.631242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:06.631330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402393022941266:2467], now have 1 active actors on pipe
2025-10-15T11:03:06.631378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402393022941311:4077], now have 1 active actors on pipe
2025-10-15T11:03:06.631403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402393022941309:3578], now have 1 active actors on pipe
2025-10-15T11:03:06.631429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402395822630199:10332]
2025-10-15T11:03:06.631446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402395822630199:10332]
2025-10-15T11:03:06.631458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402395822630199:10332]
2025-10-15T11:03:06.631498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:06.631575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:06.631774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:06.631792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:06.631926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402395822630199:10332]
2025-10-15T11:03:06.631946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:06.632795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:06.632815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:06.632826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:06.632850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:06.635604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:06.635650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:06.635733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbb5560e-58864400-1119b3e4-52980f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:06.635768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:06.635786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:06.635797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:06.635835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:06.635881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:06.635928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:06.634782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1124
2025-10-15T11:03:06.634880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1124, pipe: [1:7561402393022941311:4077]
2025-10-15T11:03:06.634956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1124
2025-10-15T11:03:06.641131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:06.641172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:06.641256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:06.647177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1125 partition: 0 MaxSeqNo: 46 sessionId: src_id|dbb5560e-58864400-1119b3e4-52980f3_0
2025-10-15T11:03:06.648172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf7adafe-34f66a52-36fde223-c75ffecb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dbb5560e-58864400-1119b3e4-52980f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:06.675003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T11:03:06.675063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-15T11:03:06.683689Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:03:06.688939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 22 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:03:06.689091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:03:06.712581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbb5560e-58864400-1119b3e4-52980f3_0] Write session: try to update token
2025-10-15T11:03:06.712641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbb5560e-58864400-1119b3e4-52980f3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:06.722151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:06.722182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:06.722193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:06.850020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:06.850056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:06.850073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:06.850086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:06.850125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402395822630199:10332]
2025-10-15T11:03:06.850157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402395822630199:10332]
2025-10-15T11:03:06.850185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402395822630199:10332]
2025-10-15T11:03:06.850372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:06.850387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:06.850399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:06.851793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:06.851831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:06.851864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:06.878584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:06.878633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:06.880015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:06.915510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId: src_id|dbb5560e-58864400-1119b3e4-52980f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:06.952670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:07.058642Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:07.060693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:07.060725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:07.060770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402395822630199:10332]
2025-10-15T11:03:07.060927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:07.060949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:07.060959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:07.062732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:07.062881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402393022941311:4077]
2025-10-15T11:03:07.062953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:07.062964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:07.063674Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:07.079714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1125 reason: error at write: Disconnected sessionId: src_id|dbb5560e-58864400-1119b3e4-52980f3_0
2025-10-15T11:03:07.080068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1125 sessionId: src_id|dbb5560e-58864400-1119b3e4-52980f3_0 is DEAD
2025-10-15T11:03:07.082953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbb5560e-58864400-1119b3e4-52980f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:07.082990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbb5560e-58864400-1119b3e4-52980f3_0] Write session will restart in 0.009084s
2025-10-15T11:03:07.083086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbb5560e-58864400-1119b3e4-52980f3_0] Write session: Do CDS request
2025-10-15T11:03:07.083116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbb5560e-58864400-1119b3e4-52980f3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:07.102579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbb5560e-58864400-1119b3e4-52980f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:07.103043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:07.103082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1126
2025-10-15T11:03:07.103408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:07.103539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:07.103557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:07.103568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:07.106872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1126 sessionId:  describe result for acl check
2025-10-15T11:03:07.106976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:07.106984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:07.106990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:07.107002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402397317908835:3557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:07.109456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402397317908835:3557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:07.123560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402397317908835:3557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:07.140505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402397317908835:3557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:07.140548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402397317908835:3557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:07.140565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402397317908835:3557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:07.140597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:07.160172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402397317908906:4077]
2025-10-15T11:03:07.253686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:07.263864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:07.264907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:07.264930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:07.264978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:07.265272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:07.265468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402400117597731:10341]
2025-10-15T11:03:07.268715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:07.276072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:07.276428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:07.277953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:07.278512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:07.278534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:07.278542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:07.278550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:07.278557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:07.278565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:07.278573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:07.278581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:07.278588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:07.278596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:07.278605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:07.278612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.278618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.278625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.278679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:07.278823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:07.278879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:07.278932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:07.278986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:07.279038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:07.279090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:07.279143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:07.279194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:07.279248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:07.279296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:07.279363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.279415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.279466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.279520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:07.279592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:07.279658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:07.279717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:07.279771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:07.279850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:07.279903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:07.279962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:07.280013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:07.280073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:07.280123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:07.280179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:07.280229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:07.280289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:07.280350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:07.280406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:07.280459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:07.280521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:07.280570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:07.280626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:07.280676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:07.280733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:07.280780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.280837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.280886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.280944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.280993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.281051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.281580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:07.309394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:07.336292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:07.336354Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:07.336370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:07.336387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:07.336409Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1125 [2:7561402400117597731:10341]
2025-10-15T11:03:07.336457Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:07.336512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:07.336525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:07.336536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:07.336546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:07.336590Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:07.336611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:07.336631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:07.338385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.338401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.338412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.338422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:07.338683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:07.338700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.338826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.338996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.339206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:07.339270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402400117597723:10341]
2025-10-15T11:03:07.339283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402400117597723:10341]
2025-10-15T11:03:07.339296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402400117597723:10341]
2025-10-15T11:03:07.339339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:07.339615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:07.339627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:07.339636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:07.341299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1125, pipe: [1:7561402397317908906:4077]
2025-10-15T11:03:07.341435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1125
2025-10-15T11:03:07.341519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1125
2025-10-15T11:03:07.340548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:07.340729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:07.340747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:07.340789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402397317908906:4077], now have 1 active actors on pipe
2025-10-15T11:03:07.340814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402397317908815:2467], now have 1 active actors on pipe
2025-10-15T11:03:07.340834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402397317908878:3557], now have 1 active actors on pipe
2025-10-15T11:03:07.340939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402400117597723:10341]
2025-10-15T11:03:07.340969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:07.341140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:07.343294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:07.343318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:07.343404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:07.343432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:07.343450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:07.343461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:07.343510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:07.343555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:07.343601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:07.347500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:07.347538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:07.347611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:07.355672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1126 partition: 0 MaxSeqNo: 46 sessionId: src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0
2025-10-15T11:03:07.356520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbb5560e-58864400-1119b3e4-52980f3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:07.408908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0] Write session: try to update token
2025-10-15T11:03:07.408963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:07.439460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:07.439493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:07.439504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:07.499864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:07.499895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:07.499910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:07.499921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:07.499955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402400117597723:10341]
2025-10-15T11:03:07.499981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402400117597723:10341]
2025-10-15T11:03:07.500003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402400117597723:10341]
2025-10-15T11:03:07.500136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:07.500157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:07.501254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:07.501282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:07.501306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:07.501606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:07.586323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId: src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:07.619077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:07.658026Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:07.659548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:07.659581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:07.663464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:07.663502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:07.662961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:07.670267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402397317908906:4077]
2025-10-15T11:03:07.670354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:07.683791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1126 reason: error at write: Disconnected sessionId: src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0
2025-10-15T11:03:07.684109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1126 sessionId: src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0 is DEAD
2025-10-15T11:03:07.687977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:07.688023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0] Write session will restart in 0.009053s
2025-10-15T11:03:07.688135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0] Write session: Do CDS request
2025-10-15T11:03:07.688169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:07.702118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:07.708178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:07.708211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1127
2025-10-15T11:03:07.708627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:07.708730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:07.708744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:07.708754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:07.710135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1127 sessionId:  describe result for acl check
2025-10-15T11:03:07.710226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:07.710233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:07.710239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:07.710250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402397317909087:3534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:07.712062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402397317909087:3534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:07.721042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402397317909087:3534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:07.760677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402397317909087:3534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:07.760730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402397317909087:3534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:07.760748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402397317909087:3534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:07.760782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:07.775493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402397317909200:4077]
2025-10-15T11:03:07.838823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:07.840888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:07.841786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:07.841807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:07.841855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:07.842174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:07.842364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402400117597974:10347]
2025-10-15T11:03:07.844867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:07.848397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:07.848677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:07.855715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:07.856086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:07.856093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:07.856099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:07.856105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:07.856111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:07.856116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:07.856119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:07.856125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:07.856130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:07.856136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:07.856142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:07.856147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.856153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.856159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.856189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:07.856274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:07.856324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:07.856365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:07.856403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:07.856439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:07.856465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:07.856492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:07.856524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:07.856562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:07.856599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:07.856637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.856676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.856715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.856750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:07.856804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:07.856853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:07.856900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:07.856942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:07.856985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:07.857014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:07.857054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:07.857084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:07.857132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:07.857169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:07.857217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:07.857253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:07.857301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:07.857342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:07.857377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:07.857407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:07.857440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:07.857467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:07.857502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:07.857530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:07.857570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:07.857595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.857638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.857679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.857713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.857740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.857784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.858140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:07.882910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:07.894731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:07.894758Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:07.894768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:07.894779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:07.894796Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1126 [2:7561402400117597974:10347]
2025-10-15T11:03:07.894829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:07.894867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:07.894877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:07.894886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:07.894897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:07.894926Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:07.894942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:07.894956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:07.898026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.898045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.898052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.898060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:07.898236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:07.898251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:07.898341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:07.898464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:07.898622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:07.898673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402400117597968:10347]
2025-10-15T11:03:07.898685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402400117597968:10347]
2025-10-15T11:03:07.898697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402400117597968:10347]
2025-10-15T11:03:07.898724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:07.898790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:07.898916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:07.898925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:07.899004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402400117597968:10347]
2025-10-15T11:03:07.899021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:07.899554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:07.899575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:07.899585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:07.899605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:07.901088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1126
2025-10-15T11:03:07.901162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1126, pipe: [1:7561402397317909200:4077]
2025-10-15T11:03:07.901227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1126
2025-10-15T11:03:07.901466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402397317909166:3534], now have 1 active actors on pipe
2025-10-15T11:03:07.901487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402397317909200:4077], now have 1 active actors on pipe
2025-10-15T11:03:07.901501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402397317909073:2467], now have 1 active actors on pipe
2025-10-15T11:03:07.903589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:07.903624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:07.903728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:07.903761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:07.903778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:07.903788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:07.903822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:07.903872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:07.903942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:07.904568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:07.904594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:07.904647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:07.905026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1127 partition: 0 MaxSeqNo: 46 sessionId: src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0
2025-10-15T11:03:07.907625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|671db7af-f522e4a6-1fcb99a8-443ffaeb_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:07.971029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0] Write session: try to update token
2025-10-15T11:03:07.971095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:07.999681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:07.999713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:07.999725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:08.119034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:08.119073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:08.119087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:08.119154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:08.119171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:08.119187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:08.119199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:08.119242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402400117597968:10347]
2025-10-15T11:03:08.119275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402400117597968:10347]
2025-10-15T11:03:08.119304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402400117597968:10347]
2025-10-15T11:03:08.119494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:08.119518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:08.119783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:08.119823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:08.119853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:08.152010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:08.211470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId: src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:08.236164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:08.310880Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:08.323684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:08.323735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:08.326359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:08.326923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:08.326952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:08.327536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402397317909200:4077]
2025-10-15T11:03:08.327650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:08.356758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1127 reason: error at write: Disconnected sessionId: src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0
2025-10-15T11:03:08.357112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1127 sessionId: src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0 is DEAD
2025-10-15T11:03:08.360219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:08.360257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0] Write session will restart in 0.008707s
2025-10-15T11:03:08.360364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0] Write session: Do CDS request
2025-10-15T11:03:08.360395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:08.379732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:08.379880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:08.379915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1128
2025-10-15T11:03:08.380373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:08.380513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:08.380531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:08.380543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:08.382045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1128 sessionId:  describe result for acl check
2025-10-15T11:03:08.382166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:08.382178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:08.382188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:08.382205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402401612876610:3532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:08.385112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402401612876610:3532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:08.404024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402401612876610:3532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:08.422423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402401612876610:3532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:08.422470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402401612876610:3532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:08.422488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402401612876610:3532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:08.422523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:08.428811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402401612876707:4077]
2025-10-15T11:03:08.487226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:08.497014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:08.497913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:08.497935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:08.497983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:08.498286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:08.498475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402404412565513:10361]
2025-10-15T11:03:08.500815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:08.503579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:08.503858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:08.505256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:08.505644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:08.505653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:08.505661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:08.505668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:08.505676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:08.505683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:08.505691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:08.505699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:08.505707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:08.505714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:08.505722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:08.505729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:08.505737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:08.505744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:08.505797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:08.505920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:08.505976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:08.506028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:08.506080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:08.506132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:08.506183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:08.506233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:08.506287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:08.506339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:08.506393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:08.506443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:08.506495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:08.507745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:08.507834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:08.507931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:08.508001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:08.508065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:08.508116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:08.508177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:08.508229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:08.508304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:08.508360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:08.508417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:08.508467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:08.508526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:08.508578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:08.508641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:08.508690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:08.508748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:08.508799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:08.508856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:08.508907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:08.508965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:08.509016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:08.509075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:08.509126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:08.509185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:08.509239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:08.509303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:08.509349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:08.509408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:08.509974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:08.561512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:08.574084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:08.574145Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:08.574165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:08.574187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:08.574214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1127 [2:7561402404412565513:10361]
2025-10-15T11:03:08.574273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:08.574341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:08.574359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:08.574372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:08.574384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:08.574439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:08.574464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:08.574490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:08.576541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:08.576568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:08.576583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:08.576596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:08.576881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:08.576901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:08.577070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:08.577280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:08.577529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:08.577608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402404412565507:10361]
2025-10-15T11:03:08.577624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402404412565507:10361]
2025-10-15T11:03:08.577639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402404412565507:10361]
2025-10-15T11:03:08.577684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:08.577759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:08.577958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:08.577976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:08.578140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402404412565507:10361]
2025-10-15T11:03:08.578164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:08.582285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1127, pipe: [1:7561402401612876707:4077]
2025-10-15T11:03:08.582510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1127
2025-10-15T11:03:08.582594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1127
2025-10-15T11:03:08.579570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:08.579597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:08.579610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:08.579638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:08.583426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402401612876594:2467], now have 1 active actors on pipe
2025-10-15T11:03:08.583463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402401612876687:3532], now have 1 active actors on pipe
2025-10-15T11:03:08.583488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402401612876707:4077], now have 1 active actors on pipe
2025-10-15T11:03:08.583559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:08.583582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:08.583672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:08.583711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:08.583732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:08.583742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:08.583783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:08.583834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:08.583884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:08.584718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:08.584744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:08.584813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:08.585171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1128 partition: 0 MaxSeqNo: 46 sessionId: src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0
2025-10-15T11:03:08.586151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c8070b-21346525-18ccb4f8-c9bfa68e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:08.675656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:08.675694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:08.675708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:08.695111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0] Write session: try to update token
2025-10-15T11:03:08.695179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:08.781173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:08.781201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:08.781212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:08.781223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:08.781258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402404412565507:10361]
2025-10-15T11:03:08.781283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402404412565507:10361]
2025-10-15T11:03:08.781306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402404412565507:10361]
2025-10-15T11:03:08.781456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:08.781467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:08.781478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:08.781568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:08.781585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:08.782826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:08.786415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:08.800013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:08.800069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:08.875825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId: src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:08.931969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:08.972763Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:09.012677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:09.012726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:09.012792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:09.012807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:09.012847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402404412565507:10361]
2025-10-15T11:03:09.013384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:09.013433Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:09.014909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:09.051065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402401612876707:4077]
2025-10-15T11:03:09.053704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1128 reason: status is not ok: tablet will be restarted right now sessionId: src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0
2025-10-15T11:03:09.053996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1128 sessionId: src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0 is DEAD
2025-10-15T11:03:09.063527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:09.063570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0] Write session will restart in 0.009582s
2025-10-15T11:03:09.063659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0] Write session: Do CDS request
2025-10-15T11:03:09.063682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:09.073271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:09.078771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:09.078800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1129
2025-10-15T11:03:09.081279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:09.081924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:09.082056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:09.082072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:09.082082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:09.083495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1129 sessionId:  describe result for acl check
2025-10-15T11:03:09.083607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:09.083617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:09.083626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:09.083640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402405907844158:3507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:09.086065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402405907844158:3507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:09.097274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402405907844158:3507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:09.137344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402405907844158:3507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:09.137388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402405907844158:3507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:09.137404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402405907844158:3507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:09.137433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:09.153227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402405907844294:4077]
2025-10-15T11:03:09.194178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:09.200049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:09.200840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:09.200852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:09.200882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:09.201095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:09.201210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402408707533028:10364]
2025-10-15T11:03:09.202830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:09.203611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:09.203773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:09.204725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:09.204957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:09.204961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:09.204966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:09.204970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:09.204975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:09.204979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:09.204983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:09.204987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:09.204991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:09.204996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:09.205000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:09.205004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.205009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.205015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.205047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:09.205133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:09.205167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:09.205198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:09.205231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:09.205275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:09.205317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:09.205352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:09.205383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:09.205415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:09.205448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:09.205480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.205510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.205539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.205564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:09.205622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:09.205675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:09.205721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:09.205753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:09.205788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:09.205818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:09.205866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:09.205902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:09.205938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:09.205965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:09.206000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:09.206030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:09.206065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:09.206098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:09.206141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:09.206171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:09.206217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:09.206246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:09.206282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:09.206314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:09.206349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:09.206386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.206421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.206451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.206486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.206514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.206550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.206912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:09.251834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:09.264849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:09.264885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:09.264899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:09.264916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:09.264937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1128 [2:7561402408707533028:10364]
2025-10-15T11:03:09.264984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:09.265035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:09.265050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:09.265062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:09.265071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:09.265113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:09.265132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:09.265150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:09.266925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.266939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.266951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.266961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:09.267203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:09.267219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.267343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.267521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.267725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:09.267793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402408707533022:10364]
2025-10-15T11:03:09.267807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402408707533022:10364]
2025-10-15T11:03:09.267819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402408707533022:10364]
2025-10-15T11:03:09.267937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:09.267948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:09.267958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:09.269123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:09.269216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:09.269383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:09.269397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:09.269435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402405907844294:4077], now have 1 active actors on pipe
2025-10-15T11:03:09.269458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402405907844152:2467], now have 1 active actors on pipe
2025-10-15T11:03:09.269477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402405907844256:3507], now have 1 active actors on pipe
2025-10-15T11:03:09.269570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402408707533022:10364]
2025-10-15T11:03:09.269597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:09.270010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:09.270838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1128, pipe: [1:7561402405907844294:4077]
2025-10-15T11:03:09.270958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1128
2025-10-15T11:03:09.271048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1128
2025-10-15T11:03:09.275618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:09.275656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:09.275738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:09.275769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:09.275785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:09.275795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:09.275827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:09.275868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:09.275923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:09.284165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:09.284202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:09.284289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:09.287657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1129 partition: 0 MaxSeqNo: 46 sessionId: src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0
2025-10-15T11:03:09.292706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abd97be6-ac1f91b7-13a62a9-6280e492_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:09.390223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0] Write session: try to update token
2025-10-15T11:03:09.390284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:09.534396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:09.534422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:09.534431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:09.534475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:09.534486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:09.534497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:09.534506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:09.534531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402408707533022:10364]
2025-10-15T11:03:09.534550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402408707533022:10364]
2025-10-15T11:03:09.534565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402408707533022:10364]
2025-10-15T11:03:09.534664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:09.534700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:09.534725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:09.534728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:09.534744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:09.531930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId: src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:09.536618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:09.562360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:09.690163Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:09.706721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:09.706767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:09.706830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:09.706846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:09.706887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402408707533022:10364]
2025-10-15T11:03:09.707281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:09.707771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:09.708935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402405907844294:4077]
2025-10-15T11:03:09.709034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:09.709263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:09.709279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:09.718087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1129 reason: error at write: Disconnected sessionId: src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0
2025-10-15T11:03:09.718385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1129 sessionId: src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0 is DEAD
2025-10-15T11:03:09.723822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:09.723867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0] Write session will restart in 0.006940s
2025-10-15T11:03:09.723975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0] Write session: Do CDS request
2025-10-15T11:03:09.724008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:09.739835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:09.745409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:09.745443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1130
2025-10-15T11:03:09.745883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:09.746049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:09.746092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:09.746103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:09.748583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1130 sessionId:  describe result for acl check
2025-10-15T11:03:09.748712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:09.748722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:09.748731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:09.748748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402405907844402:3492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:09.751080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402405907844402:3492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:09.771796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402405907844402:3492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:09.782232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402405907844402:3492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:09.782279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402405907844402:3492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:09.782296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402405907844402:3492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:09.782327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:09.807555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402405907844441:4077]
2025-10-15T11:03:09.938585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:09.943069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:09.944102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:09.944124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:09.944174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:09.944529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:09.944729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402408707533286:10376]
2025-10-15T11:03:09.946980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:09.948249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:09.948495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:09.949880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:09.950254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:09.950263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:09.950271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:09.950279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:09.950288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:09.950296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:09.950304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:09.950311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:09.950319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:09.950327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:09.950335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:09.950342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.950349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.950357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.950405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:09.950528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:09.950582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:09.950633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:09.950681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:09.950729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:09.950779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:09.950824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:09.950871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:09.950920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:09.950968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:09.951017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.951066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.951113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.951164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:09.951239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:09.951305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:09.952282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:09.952356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:09.952422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:09.952471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:09.952531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:09.952583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:09.952640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:09.952686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:09.952743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:09.952810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:09.952871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:09.952919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:09.952974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:09.953027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:09.953086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:09.953146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:09.953207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:09.953256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:09.953313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:09.953361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.953417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.953469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.953526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.953573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.953628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.954156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:09.981493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:09.995727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:09.995786Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:09.995806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:09.995830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:09.995860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1129 [2:7561402408707533286:10376]
2025-10-15T11:03:09.995920Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:09.995988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:09.996006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:09.996021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:09.996033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:09.996088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:09.996112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:09.996138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:09.997114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.997132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.997145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.997158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:09.997443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:09.997463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:09.997623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:09.997828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:09.998073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:09.998149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402408707533281:10376]
2025-10-15T11:03:09.998167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402408707533281:10376]
2025-10-15T11:03:09.998182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402408707533281:10376]
2025-10-15T11:03:09.998224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:09.998304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:09.998503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:09.998522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:09.998645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402408707533281:10376]
2025-10-15T11:03:09.998666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:10.000386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:10.000410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:10.000422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:10.000446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:10.001102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402405907844441:4077], now have 1 active actors on pipe
2025-10-15T11:03:10.001135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402405907844437:3492], now have 1 active actors on pipe
2025-10-15T11:03:10.001161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402405907844382:2467], now have 1 active actors on pipe
2025-10-15T11:03:10.003575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1129, pipe: [1:7561402405907844441:4077]
2025-10-15T11:03:10.003701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1129
2025-10-15T11:03:10.003772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1129
2025-10-15T11:03:10.004755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:10.004794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:10.004890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:10.004926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:10.004946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:10.004957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:10.004996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:10.005045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:10.005099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:10.011242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:10.011302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:10.011424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:10.015620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1130 partition: 0 MaxSeqNo: 46 sessionId: src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0
2025-10-15T11:03:10.019868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 727 BytesWritten: 103628882 MessagesWritten: 46 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-15T11:03:10.019984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244b12a4-5762ce06-3395dcb3-7c6a9d7c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:10.057675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0] Write session: try to update token
2025-10-15T11:03:10.057744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:10.099556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:10.099590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:10.099603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:10.199746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:10.199786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:10.199799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:10.225110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId: src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:10.270887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:10.270920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:10.270935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:10.270947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:10.270986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402408707533281:10376]
2025-10-15T11:03:10.271016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402408707533281:10376]
2025-10-15T11:03:10.271045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402408707533281:10376]
2025-10-15T11:03:10.271179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:10.271198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:10.271223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:10.271224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:10.271253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:10.276664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:10.290807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:10.428350Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:10.435724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:10.435772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:10.443564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402405907844441:4077]
2025-10-15T11:03:10.443682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:10.443697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:10.458872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1130 reason: error at write: Disconnected sessionId: src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0
2025-10-15T11:03:10.459496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1130 sessionId: src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0 is DEAD
2025-10-15T11:03:10.467579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:10.467625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0] Write session will restart in 0.007682s
2025-10-15T11:03:10.467726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0] Write session: Do CDS request
2025-10-15T11:03:10.467755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:10.482726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:10.492191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:10.547137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402410202811960:4077]
2025-10-15T11:03:10.555003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:10.555171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:10.555186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1131
2025-10-15T11:03:10.558346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:10.558509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:10.558525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:10.558536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:10.560196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1131 sessionId:  describe result for acl check
2025-10-15T11:03:10.560322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:10.560335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:10.560345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:10.560362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402410202811991:3466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:10.563170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402410202811991:3466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:10.590442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402410202811991:3466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:10.606654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402410202811991:3466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:10.606702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402410202811991:3466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:10.606718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402410202811991:3466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:10.606746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:10.654007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:10.655674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:10.656604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:10.656624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:10.656669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:10.656942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:10.657122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402413002500800:10384]
2025-10-15T11:03:10.659332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:10.666710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:10.666995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:10.668353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:10.668737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:10.668745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:10.668753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:10.668760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:10.668766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:10.668772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:10.668779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:10.668784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:10.668790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:10.668797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:10.668803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:10.668810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:10.668817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:10.668824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:10.668871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:10.668976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:10.669026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:10.669070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:10.669113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:10.669159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:10.669204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:10.669250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:10.669294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:10.669341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:10.669386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:10.669431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:10.669477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:10.669520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:10.669566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:10.669633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:10.669690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:10.669748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:10.669796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:10.669849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:10.669896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:10.669950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:10.670000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:10.670053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:10.670118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:10.670175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:10.670222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:10.670275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:10.670317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:10.670370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:10.670415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:10.670468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:10.670510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:10.670561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:10.670604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:10.670658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:10.670702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:10.670753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:10.670797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:10.670850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:10.670898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:10.670948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:10.679151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:10.704381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:10.716559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:10.716604Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:10.716623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:10.716642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:10.716668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1130 [2:7561402413002500800:10384]
2025-10-15T11:03:10.716723Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:10.716780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:10.716795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:10.716807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:10.716817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:10.716862Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:10.716899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:10.716923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:10.718895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:10.718912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:10.718926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:10.718937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:10.719215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:10.719234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:10.719956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:10.720166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:10.720415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:10.720481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402413002500795:10384]
2025-10-15T11:03:10.720495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402413002500795:10384]
2025-10-15T11:03:10.720508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402413002500795:10384]
2025-10-15T11:03:10.720979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:10.721066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:10.721263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:10.721279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:10.721401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402413002500795:10384]
2025-10-15T11:03:10.721424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:10.723190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:10.723221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:10.723234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:10.723259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:10.724473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1130
2025-10-15T11:03:10.724584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1130, pipe: [1:7561402410202811960:4077]
2025-10-15T11:03:10.724678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1130
2025-10-15T11:03:10.725790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402410202811978:2467], now have 1 active actors on pipe
2025-10-15T11:03:10.725836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402410202811960:4077], now have 1 active actors on pipe
2025-10-15T11:03:10.725861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402410202812100:3466], now have 1 active actors on pipe
2025-10-15T11:03:10.725929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:10.725951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:10.726033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:10.726069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:10.726087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:10.726099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:10.726138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:10.726188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:10.726240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:10.729510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:10.729547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:10.729629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:10.730457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1131 partition: 0 MaxSeqNo: 46 sessionId: src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0
2025-10-15T11:03:10.732046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcddca38-bba1799-6f6a8827-75d22cbe_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:10.818762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0] Write session: try to update token
2025-10-15T11:03:10.818819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:10.820355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:10.820393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:10.820424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:10.961811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:10.961864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:10.961889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:10.961916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:10.961989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402413002500795:10384]
2025-10-15T11:03:10.962044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402413002500795:10384]
2025-10-15T11:03:10.962095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402413002500795:10384]
2025-10-15T11:03:10.962245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:10.962322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:10.962380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:10.965225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:10.965252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:10.965262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:10.965348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:10.965364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:10.966689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:10.999900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId: src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:11.033794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:11.118316Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:11.139865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:11.139920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:11.139983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:11.139997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:11.140035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402413002500795:10384]
2025-10-15T11:03:11.141430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:11.143126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:11.147505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:11.147663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402410202811960:4077]
2025-10-15T11:03:11.147732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:11.214975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1131 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0
2025-10-15T11:03:11.215284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1131 sessionId: src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0 is DEAD
2025-10-15T11:03:11.218244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:11.218322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0] Write session will restart in 0.006708s
2025-10-15T11:03:11.218526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0] Write session: Do CDS request
2025-10-15T11:03:11.218581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:11.232621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:11.238533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:11.238574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1132
2025-10-15T11:03:11.239057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:11.239169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:11.239184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:11.239194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:11.240598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1132 sessionId:  describe result for acl check
2025-10-15T11:03:11.240701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:11.240711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:11.240719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:11.240734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402414497779512:3450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:11.243139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402414497779512:3450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:11.251485Z :INFO: [/Root] [/Root] [3ef85178-19db39ee-6ffb7760-e7759355] Counters: { Errors: 11 CurrentSessionLifetimeMs: 542543 BytesRead: 31539218 MessagesRead: 14 BytesReadCompressed: 31539218 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T11:03:11.251723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402414497779539:4077]
2025-10-15T11:03:11.262167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402414497779512:3450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:11.282683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402414497779512:3450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:11.282723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402414497779512:3450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:11.282741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402414497779512:3450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:11.282771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:11.336379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:11.337717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:11.338538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:11.338556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:11.338596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:11.338819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:11.338978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402417297468345:10395]
2025-10-15T11:03:11.341199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:11.342333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:11.342524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:11.343702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:11.343994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:11.344002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:11.344009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:11.344015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:11.344020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:11.344027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:11.344033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:11.344040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:11.344046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:11.344053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:11.344059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:11.344066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:11.344072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:11.344079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:11.344137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:11.344241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:11.344287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:11.344330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:11.344374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:11.344416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:11.344458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:11.344502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:11.344547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:11.344592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:11.344634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:11.344677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:11.344719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:11.344763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:11.344801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:11.344862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:11.344915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:11.344970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:11.345014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:11.345063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:11.345104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:11.345154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:11.345199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:11.345251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:11.345292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:11.345341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:11.345385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:11.345436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:11.345477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:11.345528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:11.345573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:11.345621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:11.345664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:11.345714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:11.345758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:11.345809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:11.345859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:11.345913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:11.345961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:11.346014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:11.346058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:11.346111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:11.348000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:11.375636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:11.385957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:11.385992Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:11.386003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:11.386015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:11.386039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1131 [2:7561402417297468345:10395]
2025-10-15T11:03:11.386087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:11.386138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:11.386152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:11.386162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:11.386173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:11.386214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:11.386232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:11.386252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:11.387198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:11.387214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:11.387227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:11.387238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:11.388354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1131, pipe: [1:7561402414497779539:4077]
2025-10-15T11:03:11.388475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1131
2025-10-15T11:03:11.388546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1131
2025-10-15T11:03:11.388969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:11.388997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:11.389128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:11.389320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:11.389545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:11.389623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402414497779539:4077], now have 1 active actors on pipe
2025-10-15T11:03:11.389647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402414497779622:3450], now have 1 active actors on pipe
2025-10-15T11:03:11.389669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402414497779486:2467], now have 1 active actors on pipe
2025-10-15T11:03:11.389714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:11.389733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:11.389785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402417297468340:10395]
2025-10-15T11:03:11.389801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402417297468340:10395]
2025-10-15T11:03:11.389813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402417297468340:10395]
2025-10-15T11:03:11.389849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:11.389912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:11.390087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:11.390102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:11.390159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:11.390185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:11.390202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:11.390212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:11.390243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:11.390280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:11.390393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402417297468340:10395]
2025-10-15T11:03:11.390411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:11.390449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:11.391218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:11.391237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:11.391249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:11.391270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:11.395386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:11.395430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:11.395510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:11.399655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1132 partition: 0 MaxSeqNo: 46 sessionId: src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0
2025-10-15T11:03:11.403662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c454c5a-18cbc67d-d0e0e036-4804bacf_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:11.463307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0] Write session: try to update token
2025-10-15T11:03:11.471563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:11.491765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:11.491791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:11.491802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:11.595674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:11.595718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:11.595731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:11.645794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId: src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:11.695008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:11.698966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:11.699000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:11.699013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:11.699023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:11.699055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402417297468340:10395]
2025-10-15T11:03:11.699079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402417297468340:10395]
2025-10-15T11:03:11.699103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402417297468340:10395]
2025-10-15T11:03:11.699497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:11.699536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:11.699568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:11.709194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:11.709246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:11.710270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:11.910036Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:11.911874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:11.911920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:11.911969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:11.911985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:11.912034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402417297468340:10395]
2025-10-15T11:03:11.912276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:11.913187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:11.920619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402414497779539:4077]
2025-10-15T11:03:11.920721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:11.920735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:11.925347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1132 reason: error at write: Disconnected sessionId: src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0
2025-10-15T11:03:11.925699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1132 sessionId: src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0 is DEAD
2025-10-15T11:03:11.931580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:11.931635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0] Write session will restart in 0.007414s
2025-10-15T11:03:11.931742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0] Write session: Do CDS request
2025-10-15T11:03:11.931773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:11.948764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:11.974225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:11.974411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:11.974426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1133
2025-10-15T11:03:11.976145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:11.976279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:11.976294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:11.976304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:11.977772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1133 sessionId:  describe result for acl check
2025-10-15T11:03:11.977891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:11.977902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:11.977913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:11.977930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402414497779760:3434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:11.986566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402414497779760:3434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:12.001243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402414497779760:3434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:12.018317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402414497779760:3434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:12.018358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402414497779760:3434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:12.018375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402414497779760:3434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:12.018407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:12.020324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402418792747095:4077]
2025-10-15T11:03:12.159236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:12.159740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:12.160447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:12.160479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:12.160517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:12.160731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:12.160903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402421592435888:10404]
2025-10-15T11:03:12.162974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:12.169275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:12.169665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:12.171075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:12.171447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:12.171455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:12.171462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:12.171469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:12.171476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:12.171484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:12.171490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:12.171496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:12.171503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:12.171509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:12.171516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:12.171524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.171531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.171539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.171587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:12.171696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:12.171745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:12.171793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:12.171837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:12.171886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:12.171932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:12.171978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:12.172024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:12.172073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:12.172134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:12.172181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.172227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.172273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.172317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:12.172383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:12.172441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:12.172495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:12.172545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:12.172601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:12.172646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:12.172700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:12.172747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:12.172797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:12.172842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:12.172893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:12.172939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:12.172991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:12.173035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:12.173087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:12.173135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:12.173184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:12.173228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:12.173276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:12.173322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:12.173373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:12.173417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.173469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.173512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.173564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.173607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.173658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.174148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:12.202127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:12.214845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:12.218543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1132
2025-10-15T11:03:12.218643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1132, pipe: [1:7561402418792747095:4077]
2025-10-15T11:03:12.215879Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:12.215910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:12.215927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:12.215953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1132 [2:7561402421592435888:10404]
2025-10-15T11:03:12.215998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:12.216056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:12.216071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:12.216094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:12.216105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:12.218722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1132
2025-10-15T11:03:12.216145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:12.216165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:12.216184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:12.217860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.217874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.217888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.217898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:12.218152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:12.218169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.218297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.218477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.218986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:12.219060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402418792747093:3434], now have 1 active actors on pipe
2025-10-15T11:03:12.219083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402414497779755:2467], now have 1 active actors on pipe
2025-10-15T11:03:12.219103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402418792747095:4077], now have 1 active actors on pipe
2025-10-15T11:03:12.219124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402421592435883:10404]
2025-10-15T11:03:12.219137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402421592435883:10404]
2025-10-15T11:03:12.219147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402421592435883:10404]
2025-10-15T11:03:12.219184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:12.219250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:12.219439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:12.219464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:12.219537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:12.219557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:12.219646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:12.219660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:12.219665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402421592435883:10404]
2025-10-15T11:03:12.219670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:12.219683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:12.219690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:12.219746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:12.219771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:12.219787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:12.219795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:12.219824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:12.219860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:12.219970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:12.221116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:12.221140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:12.221202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:12.222092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1133 partition: 0 MaxSeqNo: 46 sessionId: src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0
2025-10-15T11:03:12.224041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a357b48c-5b061cf7-98aa8285-6d42d70_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:12.272609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0] Write session: try to update token
2025-10-15T11:03:12.272668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:12.336706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:12.336738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:12.336749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:12.336798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:12.336812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:12.336825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:12.336834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:12.336868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402421592435883:10404]
2025-10-15T11:03:12.336894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402421592435883:10404]
2025-10-15T11:03:12.336920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402421592435883:10404]
2025-10-15T11:03:12.337053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:12.337078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:12.338164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:12.338677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:12.338727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:12.338757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:12.419589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId: src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:12.440877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:12.519255Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:12.521347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:12.521373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:12.525466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:12.525855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:12.525892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:12.530239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:12.530393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402418792747095:4077]
2025-10-15T11:03:12.608211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1133 reason: error at write: Disconnected sessionId: src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0
2025-10-15T11:03:12.608493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1133 sessionId: src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0 is DEAD
2025-10-15T11:03:12.615604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:12.615651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0] Write session will restart in 0.006751s
2025-10-15T11:03:12.615765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0] Write session: Do CDS request
2025-10-15T11:03:12.615799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:12.624563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402418792747327:4077]
2025-10-15T11:03:12.630863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:12.627791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:12.627825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1134
2025-10-15T11:03:12.632957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:12.633207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:12.633237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:12.633257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:12.639708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1134 sessionId:  describe result for acl check
2025-10-15T11:03:12.639849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:12.639860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:12.639872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:12.639892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402418792747347:3419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:12.642758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402418792747347:3419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:12.664079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402418792747347:3419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:12.680748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402418792747347:3419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:12.680788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402418792747347:3419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:12.680805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402418792747347:3419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:12.680832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:12.728953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:12.735992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:12.736798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:12.736818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:12.736858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:12.737099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:12.737269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402421592436127:10411]
2025-10-15T11:03:12.739270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:12.740583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:12.740779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:12.741944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:12.742236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:12.742243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:12.742249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:12.742256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:12.742262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:12.742269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:12.742275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:12.742281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:12.742286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:12.742292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:12.742297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:12.742303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.742309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.742315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.742356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:12.742452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:12.742498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:12.742538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:12.742578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:12.742619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:12.742661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:12.742703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:12.742743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:12.742787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:12.742826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:12.742867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.742908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.742947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.742984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:12.743044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:12.743095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:12.743144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:12.743189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:12.743239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:12.743283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:12.743333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:12.743406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:12.743458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:12.743498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:12.743549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:12.743591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:12.743642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:12.743683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:12.743732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:12.743779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:12.743829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:12.743871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:12.743922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:12.743963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:12.744011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:12.744069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.744118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.744159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.744205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.744245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.744293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.744739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:12.777712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:12.804573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:12.804613Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:12.804628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:12.804644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:12.804665Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1133 [2:7561402421592436127:10411]
2025-10-15T11:03:12.804709Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:12.804760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:12.804772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:12.804783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:12.804794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:12.804836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:12.804857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:12.804877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:12.805909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.805923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.805936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.805946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:12.806200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:12.806218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:12.806345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:12.806509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:12.806719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:12.806782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402421592436121:10411]
2025-10-15T11:03:12.806799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402421592436121:10411]
2025-10-15T11:03:12.806810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402421592436121:10411]
2025-10-15T11:03:12.806851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:12.806916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:12.807075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:12.807090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:12.807201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402421592436121:10411]
2025-10-15T11:03:12.807221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:12.808135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:12.808156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:12.808168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:12.808189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:12.812388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1133
2025-10-15T11:03:12.812487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1133
2025-10-15T11:03:12.812540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1133, pipe: [1:7561402418792747327:4077]
2025-10-15T11:03:12.818165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402418792747290:2467], now have 1 active actors on pipe
2025-10-15T11:03:12.818201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402418792747457:3419], now have 1 active actors on pipe
2025-10-15T11:03:12.818221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402418792747327:4077], now have 1 active actors on pipe
2025-10-15T11:03:12.818283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:12.818302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:12.818363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:12.818392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:12.818409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:12.818420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:12.818452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:12.818490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:12.818528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:12.825689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:12.825732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:12.825813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:12.828890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1134 partition: 0 MaxSeqNo: 46 sessionId: src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0
2025-10-15T11:03:12.832439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5a49c44-d239461f-15b1fac1-2a73406f_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:12.886315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0] Write session: try to update token
2025-10-15T11:03:12.886383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:12.973226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:12.973265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:12.973274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:12.973393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:12.973406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:12.973416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:12.973424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:12.973454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402421592436121:10411]
2025-10-15T11:03:12.973476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402421592436121:10411]
2025-10-15T11:03:12.973496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402421592436121:10411]
2025-10-15T11:03:12.974436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:12.974472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:12.974499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:13.049171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:13.049218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:13.056406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:13.147339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId: src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:13.220968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:13.307616Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:13.309036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:13.309056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:13.309105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402421592436121:10411]
2025-10-15T11:03:13.309238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:13.309270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:13.309298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:13.310704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:13.311812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:13.311971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:13.312682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402418792747327:4077]
2025-10-15T11:03:13.330068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1134 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0
2025-10-15T11:03:13.330424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1134 sessionId: src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0 is DEAD
2025-10-15T11:03:13.331541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:13.331574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0] Write session will restart in 0.007722s
2025-10-15T11:03:13.331641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0] Write session: Do CDS request
2025-10-15T11:03:13.331660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:13.348593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:13.350593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:13.350658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1135
2025-10-15T11:03:13.351505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:13.351926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:13.351968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:13.351988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:13.355037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1135 sessionId:  describe result for acl check
2025-10-15T11:03:13.355252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:13.355277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:13.355298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:13.355340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402423087714849:3415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:13.358222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402423087714849:3415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:13.391598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402423087714849:3415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:13.407491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402423087714849:3415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:13.407538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402423087714849:3415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:13.407556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402423087714849:3415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:13.407590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:13.415844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402423087714953:4077]
2025-10-15T11:03:13.468874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:13.521067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:13.521954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:13.521975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:13.522019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:13.522293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:13.522477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402425887403673:10424]
2025-10-15T11:03:13.525046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:13.527913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:13.528179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:13.529470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:13.529794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:13.529804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:13.529812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:13.529820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:13.529827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:13.529835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:13.529844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:13.529851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:13.529858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:13.529864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:13.529874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:13.529882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:13.529888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:13.529894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:13.529941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:13.530046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:13.530097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:13.530144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:13.530191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:13.530237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:13.530281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:13.530326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:13.530369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:13.530414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:13.530460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:13.530504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:13.530548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:13.530592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:13.530634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:13.530700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:13.530759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:13.530820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:13.530868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:13.530922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:13.530968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:13.531024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:13.531070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:13.531122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:13.531168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:13.531221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:13.531266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:13.531322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:13.533853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:13.533948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:13.534006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:13.534066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:13.534110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:13.534171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:13.534220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:13.534275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:13.534326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:13.534380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:13.534430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:13.534487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:13.534532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:13.534586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:13.535104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:13.579549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:13.597671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:13.597735Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:13.597755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:13.597776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:13.597804Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1134 [2:7561402425887403673:10424]
2025-10-15T11:03:13.597858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:13.597921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:13.597936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:13.597949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:13.597962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:13.598014Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:13.598038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:13.598063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:13.606046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:13.606082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:13.606100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:13.606113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:13.606425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:13.606444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:13.606609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:13.606816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:13.607071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:13.607149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402425887403667:10424]
2025-10-15T11:03:13.607168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402425887403667:10424]
2025-10-15T11:03:13.607183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402425887403667:10424]
2025-10-15T11:03:13.607238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:13.607319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:13.607408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:13.607426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:13.607439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:13.607542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:13.607562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:13.607695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402425887403667:10424]
2025-10-15T11:03:13.607717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:13.607809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402423087714923:3415], now have 1 active actors on pipe
2025-10-15T11:03:13.607845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402423087714835:2467], now have 1 active actors on pipe
2025-10-15T11:03:13.607875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402423087714953:4077], now have 1 active actors on pipe
2025-10-15T11:03:13.608415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:13.615576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1134
2025-10-15T11:03:13.615685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1134
2025-10-15T11:03:13.615760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1134, pipe: [1:7561402423087714953:4077]
2025-10-15T11:03:13.618661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:13.618710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:13.618827Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:13.618868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:13.618888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:13.618901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:13.618946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:13.618997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:13.619055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:13.623488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:13.623539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:13.623635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:13.624893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1135 partition: 0 MaxSeqNo: 46 sessionId: src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0
2025-10-15T11:03:13.625912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e5da66-58b02ed9-51403cca-767cdf7d_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:13.676704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0] Write session: try to update token
2025-10-15T11:03:13.676753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:13.694580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:13.694619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:13.694631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
E1015 11:03:13.709255656  821071 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:03:13.885794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId: src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:13.920208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:13.927745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:13.927785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:13.927801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:13.927814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:13.927851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402425887403667:10424]
2025-10-15T11:03:13.927881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402425887403667:10424]
2025-10-15T11:03:13.927910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402425887403667:10424]
2025-10-15T11:03:13.928147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:13.928161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:13.928174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:13.928271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:13.928296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:13.928330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:13.928353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:13.929321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:13.932322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:13.932369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:13.932405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:14.149328Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:14.160254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:14.160288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:14.160343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402425887403667:10424]
2025-10-15T11:03:14.160742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:14.165102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:14.165136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:14.161850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:14.176723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:14.176885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402423087714953:4077]
2025-10-15T11:03:14.186620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1135 reason: error at write: Disconnected sessionId: src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0
2025-10-15T11:03:14.187020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1135 sessionId: src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0 is DEAD
2025-10-15T11:03:14.191636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:14.191692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0] Write session will restart in 0.006105s
2025-10-15T11:03:14.191799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0] Write session: Do CDS request
2025-10-15T11:03:14.191832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:14.213016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:14.216072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:14.216108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1136
2025-10-15T11:03:14.216672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:14.216819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:14.216841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:14.216852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:14.218529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1136 sessionId:  describe result for acl check
2025-10-15T11:03:14.218652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:14.218669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:14.218680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:14.218697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402427382682415:3388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:14.223662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402427382682415:3388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:14.235902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402427382682415:3388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:14.255126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402427382682415:3388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:14.255172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402427382682415:3388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:14.255191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402427382682415:3388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:14.255224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:14.277947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402427382682462:4077]
E1015 11:03:14.356821833  821272 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:03:14.359575Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:03:14.411330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:14.421062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:14.422086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:14.422109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:14.422159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:14.422463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:14.422652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402430182371223:10430]
2025-10-15T11:03:14.424969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:14.426716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:14.426974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:14.428332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:14.428695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:14.428704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:14.428713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:14.428720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:14.428727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:14.428735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:14.428741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:14.428748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:14.428755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:14.428762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:14.428770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:14.428776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:14.428785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:14.428793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:14.428841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:14.428956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:14.429009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:14.429059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:14.429104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:14.429151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:14.429194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:14.429238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:14.429284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:14.429332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:14.429378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:14.429426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:14.429475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:14.429525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:14.429574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:14.429646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:14.429706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:14.429765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:14.429814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:14.429871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:14.429914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:14.429967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:14.430015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:14.430068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:14.430112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:14.430170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:14.430221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:14.430277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:14.430324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:14.430381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:14.430430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:14.430485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:14.430533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:14.430587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:14.430635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:14.430688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:14.430733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:14.430789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:14.430840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:14.430892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:14.430938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:14.430995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:14.432850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:14.457979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:14.466873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:14.467038Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:14.467058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:14.467080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:14.467109Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1135 [2:7561402430182371223:10430]
2025-10-15T11:03:14.467163Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:14.467220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:14.467234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:14.467248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:14.467260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:14.467314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:14.467338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:14.467373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:14.468967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:14.468986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:14.469001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:14.469013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:14.469334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:14.469354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:14.469508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:14.469702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:14.469942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:14.470014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402430182371217:10430]
2025-10-15T11:03:14.470030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402430182371217:10430]
2025-10-15T11:03:14.470043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402430182371217:10430]
2025-10-15T11:03:14.470194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:14.470207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:14.470219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:14.471786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1135, pipe: [1:7561402427382682462:4077]
2025-10-15T11:03:14.471903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1135
2025-10-15T11:03:14.471991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1135
2025-10-15T11:03:14.472544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:14.472636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:14.472845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:14.472864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:14.472905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402427382682462:4077], now have 1 active actors on pipe
2025-10-15T11:03:14.472924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402427382682450:3388], now have 1 active actors on pipe
2025-10-15T11:03:14.472950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402427382682396:2467], now have 1 active actors on pipe
2025-10-15T11:03:14.473007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:14.473029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:14.473176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402430182371217:10430]
2025-10-15T11:03:14.473213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:14.473288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:14.473321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:14.473339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:14.473352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:14.473390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:14.473435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:14.473559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:14.474086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:14.481434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:14.481471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:14.481537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:14.483868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1136 partition: 0 MaxSeqNo: 46 sessionId: src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0
2025-10-15T11:03:14.486555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1996b7-88e91cbd-189ac36e-4e4a789a_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:14.550832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0] Write session: try to update token
2025-10-15T11:03:14.550902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:14.568710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:14.568751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:14.568764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:14.704183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:14.704212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:14.704224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:14.704233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:14.704262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402430182371217:10430]
2025-10-15T11:03:14.704287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402430182371217:10430]
2025-10-15T11:03:14.704310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402430182371217:10430]
2025-10-15T11:03:14.704483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:14.704495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:14.704505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:14.704542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:14.704559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:14.705552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:14.707674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:14.707736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:14.707800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:14.763504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId: src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:14.801238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:14.902655Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:14.924651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:14.924699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:14.924764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:14.924779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:14.924816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402430182371217:10430]
2025-10-15T11:03:14.927136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402427382682462:4077]
2025-10-15T11:03:14.927230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:14.927243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:14.931486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:14.925934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:14.931996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:15.009876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1136 reason: error at write: Disconnected sessionId: src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0
2025-10-15T11:03:15.010140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1136 sessionId: src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0 is DEAD
2025-10-15T11:03:15.015661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:15.015738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0] Write session will restart in 0.005866s
2025-10-15T11:03:15.015917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0] Write session: Do CDS request
2025-10-15T11:03:15.015999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:15.026120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402431677650000:4077]
2025-10-15T11:03:15.030040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:15.031648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:15.031687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1137
2025-10-15T11:03:15.036601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:15.036755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:15.036771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:15.036782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:15.040685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1137 sessionId:  describe result for acl check
2025-10-15T11:03:15.040830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:15.040852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:15.040864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:15.040884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402431677650021:3362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:15.046099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402431677650021:3362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:15.100162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402431677650021:3362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:15.141938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402431677650021:3362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:15.141986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402431677650021:3362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:15.142005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402431677650021:3362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:15.142039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:15.155598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:15.161977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:15.162908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:15.162928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:15.162969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:15.163228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:15.163423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402434477338769:10439]
2025-10-15T11:03:15.165620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:15.170007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:15.170242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:15.171627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:15.171988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:15.171996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:15.172002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:15.172009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:15.172015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:15.172022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:15.172029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:15.172034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:15.172039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:15.172046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:15.172054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:15.172061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.172067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.172074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.172119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:15.172226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:15.172271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:15.172317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:15.172364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:15.172411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:15.172454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:15.172499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:15.172540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:15.172585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:15.172631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:15.172676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.172717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.172762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.172804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:15.172867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:15.172921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:15.172975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:15.173019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:15.173069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:15.173114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:15.173165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:15.173212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:15.173261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:15.173303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:15.173354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:15.173396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:15.173450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:15.173490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:15.173541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:15.173586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:15.173637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:15.173681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:15.173731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:15.173777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:15.173828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:15.173872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.179530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.179626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.179692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.179740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.179790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.180455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:15.218909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:15.234873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:15.234923Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:15.234938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:15.234957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:15.234981Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1136 [2:7561402434477338769:10439]
2025-10-15T11:03:15.235030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:15.235084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:15.235097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:15.235109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:15.235119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:15.235164Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:15.235184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:15.235204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:15.236580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.236605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.236618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.236628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:15.236891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:15.236907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.237037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.237210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.237428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:15.237491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402434477338764:10439]
2025-10-15T11:03:15.237504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402434477338764:10439]
2025-10-15T11:03:15.237515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402434477338764:10439]
2025-10-15T11:03:15.237556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:15.237622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:15.237792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:15.237808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:15.237916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402434477338764:10439]
2025-10-15T11:03:15.237935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:15.238677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:15.238694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:15.238704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:15.238726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:15.240353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402431677650000:4077], now have 1 active actors on pipe
2025-10-15T11:03:15.240392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402427382682657:2467], now have 1 active actors on pipe
2025-10-15T11:03:15.240416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402431677650168:3362], now have 1 active actors on pipe
2025-10-15T11:03:15.241638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1136, pipe: [1:7561402431677650000:4077]
2025-10-15T11:03:15.241786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1136
2025-10-15T11:03:15.241920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1136
2025-10-15T11:03:15.242649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:15.242681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:15.242765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:15.242798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:15.242816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:15.242828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:15.242863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:15.242903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:15.242957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:15.245379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:15.245422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:15.245513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:15.245946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1137 partition: 0 MaxSeqNo: 46 sessionId: src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0
2025-10-15T11:03:15.248492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2249ccb7-3179aef2-d4bc869-7ef8bbc5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:15.279055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0] Write session: try to update token
2025-10-15T11:03:15.279112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:15.401318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:15.401354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:15.401367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:15.401425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:15.401441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:15.401456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:15.401468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:15.401503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402434477338764:10439]
2025-10-15T11:03:15.401533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402434477338764:10439]
2025-10-15T11:03:15.401562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402434477338764:10439]
2025-10-15T11:03:15.401763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:15.401786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:15.403239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:15.407491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:15.407541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:15.407570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:15.527438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId: src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:15.572327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:15.689650Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:15.718991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:15.719047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:15.719118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:15.719134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:15.719181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402434477338764:10439]
2025-10-15T11:03:15.719485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:15.719936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:15.723532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:15.801988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1137 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0
2025-10-15T11:03:15.802362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1137 sessionId: src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0 is DEAD
2025-10-15T11:03:15.803942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:15.803979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0] Write session will restart in 0.005419s
2025-10-15T11:03:15.804085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0] Write session: Do CDS request
2025-10-15T11:03:15.804114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:15.814216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:15.826411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402431677650000:4077]
2025-10-15T11:03:15.826489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:15.826852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:15.826866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1138
2025-10-15T11:03:15.833117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:15.833267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:15.833283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:15.833294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:15.837784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1138 sessionId:  describe result for acl check
2025-10-15T11:03:15.837906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:15.837917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:15.837927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:15.837946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402431677650273:3357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:15.840703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402431677650273:3357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:15.867800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402431677650273:3357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:15.883715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402431677650273:3357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:15.883761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402431677650273:3357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:15.883777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402431677650273:3357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:15.883804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:15.906601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:15.910987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:15.911871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:15.911901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:15.911942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:15.912179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:15.912386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402434477338998:10447]
2025-10-15T11:03:15.914332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:15.916675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:15.916900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:15.919303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:15.919715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:15.919734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:15.919741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:15.919747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:15.919754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:15.919761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:15.919767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:15.919774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:15.919782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:15.919788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:15.919794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:15.919801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.919809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.919816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.919864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:15.919985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:15.920034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:15.920085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:15.920137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:15.920193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:15.920245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:15.920291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:15.920337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:15.920383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:15.920429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:15.920472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.920516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.920560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.920603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:15.920665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:15.920723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:15.920777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:15.920824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:15.920877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:15.920921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:15.920973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:15.921019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:15.921070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:15.921118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:15.921170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:15.921216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:15.921267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:15.921313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:15.921364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:15.921414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:15.921465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:15.921507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:15.921558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:15.921605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:15.921657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:15.921701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.921753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.921802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.921854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.921899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.921951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.927449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:15.931472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402431677650445:4077]
2025-10-15T11:03:15.961042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:15.990241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:15.990284Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:15.990301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:15.990319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:15.990342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1137 [2:7561402434477338998:10447]
2025-10-15T11:03:15.990391Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:15.990445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:15.990459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:15.990470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:15.990481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:15.990522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:15.990542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:15.990562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:15.992529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.992544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.992559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.992570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:15.992828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:15.992845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:15.992976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:15.993156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:15.993420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:15.993486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402434477338993:10447]
2025-10-15T11:03:15.993501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402434477338993:10447]
2025-10-15T11:03:15.993514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402434477338993:10447]
2025-10-15T11:03:15.993551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:15.993614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:15.993779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:15.993794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:15.993898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402434477338993:10447]
2025-10-15T11:03:15.993915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:15.994499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:15.994512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:15.994523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:15.994544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:15.995087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402431677650251:2467], now have 1 active actors on pipe
2025-10-15T11:03:15.995110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402431677650410:3357], now have 1 active actors on pipe
2025-10-15T11:03:15.995130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402431677650445:4077], now have 1 active actors on pipe
2025-10-15T11:03:15.995990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1137, pipe: [1:7561402431677650445:4077]
2025-10-15T11:03:15.996093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1137
2025-10-15T11:03:15.996176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1137
2025-10-15T11:03:15.996562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:15.996592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:15.996664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:15.996700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:15.996734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:15.996745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:15.996776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:15.996831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:15.996874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:15.999175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:15.999205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:15.999270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:16.000866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f40d4e-acea03bb-501de623-e5e1ade7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:15.999962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1138 partition: 0 MaxSeqNo: 46 sessionId: src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0
2025-10-15T11:03:16.090901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:16.090931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:16.090941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:16.100955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0] Write session: try to update token
2025-10-15T11:03:16.101025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:16.214146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:16.214192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:16.214207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:16.214219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:16.214259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402434477338993:10447]
2025-10-15T11:03:16.214288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402434477338993:10447]
2025-10-15T11:03:16.214316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402434477338993:10447]
2025-10-15T11:03:16.214551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:16.214574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:16.214586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:16.214635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:16.214667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:16.215460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:16.215511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:16.215543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:16.220727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:16.383488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId: src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:16.417808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:16.420196Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:16.432617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:16.432676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:16.432749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:16.432764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:16.432810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402434477338993:10447]
2025-10-15T11:03:16.435482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:16.436610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:16.440671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402431677650445:4077]
2025-10-15T11:03:16.440775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:16.440894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:16.449681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1138 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0
2025-10-15T11:03:16.449976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1138 sessionId: src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0 is DEAD
2025-10-15T11:03:16.451829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:16.451900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0] Write session will restart in 0.008572s
2025-10-15T11:03:16.452007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0] Write session: Do CDS request
2025-10-15T11:03:16.452044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:16.470074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:16.471987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:16.472024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1139
2025-10-15T11:03:16.475474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:16.475653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:16.475673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:16.475685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:16.477280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1139 sessionId:  describe result for acl check
2025-10-15T11:03:16.477413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:16.477424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:16.477434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:16.477453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402435972617764:3342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:16.480773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402435972617764:3342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:16.506203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402435972617764:3342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:16.526677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402435972617764:3342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:16.526729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402435972617764:3342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:16.526747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402435972617764:3342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:16.526782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:16.543468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402435972617800:4077]
2025-10-15T11:03:16.705152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:16.715274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:16.716327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:16.716364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:16.716415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:16.716727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:16.716943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402438772306562:10459]
2025-10-15T11:03:16.719333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:16.721359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:16.721624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:16.723056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:16.723477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:16.723496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:16.723504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:16.723512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:16.723520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:16.723529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:16.723539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:16.723547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:16.723556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:16.723564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:16.723571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:16.723579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:16.723588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:16.723595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:16.723650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:16.723775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:16.723827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:16.723893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:16.723949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:16.724001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:16.724052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:16.724098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:16.724149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:16.724197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:16.724245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:16.724293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:16.724345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:16.724394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:16.724444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:16.724519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:16.724585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:16.724645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:16.724698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:16.724768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:16.724823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:16.724887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:16.724943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:16.725005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:16.725062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:16.725123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:16.725179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:16.725236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:16.725287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:16.725347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:16.725398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:16.725454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:16.725504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:16.725564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:16.725611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:16.725670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:16.725717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:16.725783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:16.725837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:16.725899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:16.725954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:16.726014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:16.726563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:16.749969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:16.793359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:16.793415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:16.793429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:16.793445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:16.793467Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1138 [2:7561402438772306562:10459]
2025-10-15T11:03:16.793508Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:16.793566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:16.793577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:16.793589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:16.793600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:16.793640Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:16.793660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:16.793678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:16.794690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:16.794704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:16.794715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:16.794724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:16.794998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:16.795014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:16.795136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:16.795301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:16.795530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:16.795594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402438772306557:10459]
2025-10-15T11:03:16.795609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402438772306557:10459]
2025-10-15T11:03:16.795621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402438772306557:10459]
2025-10-15T11:03:16.795659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:16.795726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:16.795908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:16.795924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:16.796028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402438772306557:10459]
2025-10-15T11:03:16.796047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:16.797115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:16.797138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:16.797149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:16.797173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:16.798183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402435972617755:2467], now have 1 active actors on pipe
2025-10-15T11:03:16.798216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402435972617800:4077], now have 1 active actors on pipe
2025-10-15T11:03:16.798237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402435972617796:3342], now have 1 active actors on pipe
2025-10-15T11:03:16.799032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1138
2025-10-15T11:03:16.799131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1138, pipe: [1:7561402435972617800:4077]
2025-10-15T11:03:16.799208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1138
2025-10-15T11:03:16.810177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:16.810227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:16.810324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f49100ea-80dff24d-91c7c04-23593c34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:16.810356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:16.810374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:16.810396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:16.810432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:16.810486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:16.810530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:16.811622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:16.811654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:16.812101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1139 partition: 0 MaxSeqNo: 46 sessionId: src_id|f49100ea-80dff24d-91c7c04-23593c34_0
2025-10-15T11:03:16.811755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:16.819410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48089f7-858fc935-65b12a82-f70d0b2b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f49100ea-80dff24d-91c7c04-23593c34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:16.870926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f49100ea-80dff24d-91c7c04-23593c34_0] Write session: try to update token
2025-10-15T11:03:16.870983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f49100ea-80dff24d-91c7c04-23593c34_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:16.999056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:16.999085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:16.999094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:16.999138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:16.999150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:16.999160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:16.999168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:16.999194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402438772306557:10459]
2025-10-15T11:03:16.999216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402438772306557:10459]
2025-10-15T11:03:16.999236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402438772306557:10459]
2025-10-15T11:03:16.999713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:16.999749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:16.999772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:16.999968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:16.999995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:17.023992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:17.062391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId: src_id|f49100ea-80dff24d-91c7c04-23593c34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:17.101554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:17.229807Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:17.243075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:17.243134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:17.243204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:17.243221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:17.243270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402438772306557:10459]
2025-10-15T11:03:17.243558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:17.244168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:17.248361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:17.248674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402435972617800:4077]
2025-10-15T11:03:17.248820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:17.268096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49100ea-80dff24d-91c7c04-23593c34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:17.268161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49100ea-80dff24d-91c7c04-23593c34_0] Write session will restart in 0.009217s
2025-10-15T11:03:17.268378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49100ea-80dff24d-91c7c04-23593c34_0] Write session: Do CDS request
2025-10-15T11:03:17.268436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49100ea-80dff24d-91c7c04-23593c34_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:17.266915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1139 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f49100ea-80dff24d-91c7c04-23593c34_0
2025-10-15T11:03:17.267286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1139 sessionId: src_id|f49100ea-80dff24d-91c7c04-23593c34_0 is DEAD
2025-10-15T11:03:17.289909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f49100ea-80dff24d-91c7c04-23593c34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:17.302000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:17.302038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1140
2025-10-15T11:03:17.303856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:17.304001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:17.304018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:17.304030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:17.319401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1140 sessionId:  describe result for acl check
2025-10-15T11:03:17.319540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:17.319552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:17.319562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:17.319581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402440267585332:3325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:17.322393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402440267585332:3325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:17.333957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402440267585332:3325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:17.344447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402440267585332:3325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:17.344494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402440267585332:3325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:17.344512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402440267585332:3325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:17.344544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:17.349329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402440267585407:4077]
2025-10-15T11:03:17.409503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:17.418210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:17.419122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:17.419142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:17.419186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:17.419486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:17.419676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402443067274102:10467]
2025-10-15T11:03:17.422384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:17.423666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:17.424008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:17.425363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:17.425705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:17.425714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:17.425723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:17.425731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:17.425738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:17.425745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:17.425753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:17.425761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:17.425768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:17.425774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:17.425782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:17.425789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:17.425798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:17.425805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:17.425856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:17.425981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:17.426034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:17.426089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:17.426140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:17.426191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:17.426240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:17.426290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:17.426340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:17.426395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:17.426451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:17.426498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:17.426545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:17.426593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:17.426642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:17.426718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:17.426782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:17.426840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:17.426891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:17.426947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:17.426997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:17.427060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:17.427116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:17.427171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:17.427222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:17.427278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:17.427328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:17.428278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:17.428344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:17.428404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:17.428458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:17.428523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:17.428571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:17.428630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:17.428681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:17.428737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:17.428785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:17.428842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:17.428894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:17.428952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:17.429002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:17.429059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:17.429592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:17.456018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:17.465842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:17.465897Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:17.465919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:17.465940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:17.465969Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1139 [2:7561402443067274102:10467]
2025-10-15T11:03:17.466028Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:17.466094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:17.466109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:17.466122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:17.466134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:17.466184Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:17.466210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:17.466232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:17.530893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:17.530928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:17.530942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:17.530954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:17.531253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:17.531273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:17.532358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1139
2025-10-15T11:03:17.532459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1139, pipe: [1:7561402440267585407:4077]
2025-10-15T11:03:17.532538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1139
2025-10-15T11:03:17.535950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:17.536197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:17.536446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:17.536550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402440267585314:2467], now have 1 active actors on pipe
2025-10-15T11:03:17.536580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402440267585407:4077], now have 1 active actors on pipe
2025-10-15T11:03:17.536604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402440267585386:3325], now have 1 active actors on pipe
2025-10-15T11:03:17.536681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:17.536704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:17.536746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402443067274095:10467]
2025-10-15T11:03:17.536762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402443067274095:10467]
2025-10-15T11:03:17.536775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402443067274095:10467]
2025-10-15T11:03:17.536820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:17.536919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:17.537123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:17.537141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:17.537216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:17.537250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:17.537270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:17.537282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:17.537319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:17.537370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:17.537502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402443067274095:10467]
2025-10-15T11:03:17.537523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:17.537572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:17.537683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:17.537700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:17.537713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:17.537741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:17.541219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:17.541264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:17.541367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:17.541968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1140 partition: 0 MaxSeqNo: 46 sessionId: src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0
2025-10-15T11:03:17.543043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f49100ea-80dff24d-91c7c04-23593c34_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:17.564888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:17.564919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:17.564928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:17.629774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0] Write session: try to update token
2025-10-15T11:03:17.629832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:17.731771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:17.731826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:17.731839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:17.731909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:17.731927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:17.731943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:17.731957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:17.731997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402443067274095:10467]
2025-10-15T11:03:17.732028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402443067274095:10467]
2025-10-15T11:03:17.732057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402443067274095:10467]
2025-10-15T11:03:17.732237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:17.732260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:17.732327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:17.732366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:17.732399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:17.735825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:17.814089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId: src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:17.836174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:17.935719Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:17.938351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:17.938396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:17.942278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:17.941105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:17.941409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402440267585407:4077]
2025-10-15T11:03:17.941513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:17.941526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:18.007941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:18.007984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0] Write session will restart in 0.006460s
2025-10-15T11:03:18.008087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0] Write session: Do CDS request
2025-10-15T11:03:18.008116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:18.005388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1140 reason: error at write: Disconnected sessionId: src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0
2025-10-15T11:03:18.005742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1140 sessionId: src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0 is DEAD
2025-10-15T11:03:18.018962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:18.019009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1141
2025-10-15T11:03:18.020125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:18.020795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:18.020927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:18.020944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:18.020955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:18.022816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1141 sessionId:  describe result for acl check
2025-10-15T11:03:18.022935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:18.022946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:18.022955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:18.022971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402444562552902:3305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:18.025799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402444562552902:3305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:18.040010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402444562552915:4077]
2025-10-15T11:03:18.044862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402444562552902:3305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:18.069845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402444562552902:3305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:18.069893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402444562552902:3305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:18.069912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402444562552902:3305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:18.069947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:18.152767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:18.161279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:18.162157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:18.162177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:18.162222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:18.162489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:18.162669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402447362241651:10478]
2025-10-15T11:03:18.164938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:18.167037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:18.167294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:18.168673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:18.169028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:18.169036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:18.169045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:18.169052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:18.169060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:18.169066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:18.169074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:18.169081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:18.169088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:18.169095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:18.169102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:18.169110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.169117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.169124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.169176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:18.169291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:18.169343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:18.169390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:18.169449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:18.169503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:18.169551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:18.169601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:18.169648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:18.169699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:18.169747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:18.169795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.169843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.169892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.169940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:18.170011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:18.170093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:18.170156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:18.170213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:18.170267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:18.170317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:18.170372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:18.170422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:18.170485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:18.170532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:18.170589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:18.170638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:18.170695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:18.170742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:18.170799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:18.170850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:18.170906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:18.170956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:18.171010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:18.171060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:18.171117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:18.171165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.171220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.171268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.171323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.172761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.172845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.173385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:18.228646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:18.241632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:18.241686Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:18.241706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:18.241728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:18.241756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1140 [2:7561402447362241651:10478]
2025-10-15T11:03:18.241820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:18.241886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:18.241903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:18.241916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:18.241928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:18.241981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:18.242005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:18.242033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:18.243060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.243077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.243094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.243106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:18.243955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:18.243987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.244146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.244353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.244743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:18.244827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402447362241643:10478]
2025-10-15T11:03:18.244844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402447362241643:10478]
2025-10-15T11:03:18.244863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402447362241643:10478]
2025-10-15T11:03:18.244907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:18.244989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:18.245201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:18.245220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:18.245353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402447362241643:10478]
2025-10-15T11:03:18.245373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:18.247108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1140
2025-10-15T11:03:18.247204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1140
2025-10-15T11:03:18.247275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1140, pipe: [1:7561402444562552915:4077]
2025-10-15T11:03:18.245849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:18.245870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:18.245883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:18.245906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:18.248429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402444562552983:3305], now have 1 active actors on pipe
2025-10-15T11:03:18.248470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402440267585565:2467], now have 1 active actors on pipe
2025-10-15T11:03:18.248494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402444562552915:4077], now have 1 active actors on pipe
2025-10-15T11:03:18.248547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:18.248573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:18.248671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:18.248704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:18.248724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:18.248736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:18.248776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:18.248824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:18.248876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:18.249625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:18.249651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:18.249720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:18.250082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1141 partition: 0 MaxSeqNo: 46 sessionId: src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0
2025-10-15T11:03:18.253391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a68fe2c-3e64e429-96ced09a-7b4a931c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:18.317553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0] Write session: try to update token
2025-10-15T11:03:18.317622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:18.342020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:18.342066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:18.342079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:18.447249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:18.447282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:18.447294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:18.483489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId: src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:18.539317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:18.541760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:18.542220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:18.542250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:18.542260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:18.542290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402447362241643:10478]
2025-10-15T11:03:18.542317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402447362241643:10478]
2025-10-15T11:03:18.542341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402447362241643:10478]
2025-10-15T11:03:18.542558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:18.542583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:18.542615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:18.542635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:18.543680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:18.547694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:18.547732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:18.547771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:18.713569Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:18.725880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:18.725910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:18.725952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402447362241643:10478]
2025-10-15T11:03:18.726345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:18.728257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:18.728281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:18.732015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:18.806811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1141 reason: error at write: Disconnected sessionId: src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0
2025-10-15T11:03:18.807111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1141 sessionId: src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0 is DEAD
2025-10-15T11:03:18.807985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:18.808050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0] Write session will restart in 0.008396s
2025-10-15T11:03:18.808219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0] Write session: Do CDS request
2025-10-15T11:03:18.808274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:18.822068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:18.852995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:18.853162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402444562552915:4077]
2025-10-15T11:03:18.853676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:18.853698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1142
2025-10-15T11:03:18.856020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:18.856166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:18.856182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:18.856191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:18.860348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1142 sessionId:  describe result for acl check
2025-10-15T11:03:18.860493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:18.860505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:18.860515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:18.860534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402444562553179:3288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:18.863514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402444562553179:3288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:18.893193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402444562553179:3288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:18.917307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402444562553179:3288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:18.917355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402444562553179:3288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:18.917370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402444562553179:3288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:18.917400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:18.953048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402444562553356:4077]
2025-10-15T11:03:18.961106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:18.964573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:18.965396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:18.965415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:18.965455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:18.965701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:18.965904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402447362241901:10487]
2025-10-15T11:03:18.968452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:18.969469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:18.969666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:18.970788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:18.971084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:18.971091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:18.971098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:18.971105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:18.971110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:18.971117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:18.971123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:18.971129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:18.971135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:18.971142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:18.971147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:18.971153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.971159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.971164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.971210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:18.971310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:18.971374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:18.971420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:18.971462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:18.971506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:18.971546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:18.971588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:18.971630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:18.971673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:18.971715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:18.971774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.971816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.971859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.971903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:18.971968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:18.972024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:18.972076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:18.972124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:18.972191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:18.972234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:18.972285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:18.972332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:18.972385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:18.972428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:18.972477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:18.972524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:18.972578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:18.972622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:18.972672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:18.972718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:18.972771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:18.972815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:18.972870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:18.972912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:18.972965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:18.973009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.973061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:18.973110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.973160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:18.973203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.973254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:18.973745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:19.000938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:19.152669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:19.152730Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:19.152750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:19.152771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:19.152800Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1141 [2:7561402447362241901:10487]
2025-10-15T11:03:19.152855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:19.152921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:19.152936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:19.152950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:19.152964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:19.153013Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:19.153035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:19.153058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:19.153962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:19.153979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:19.153995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:19.154007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:19.154283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:19.154301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:19.154456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:19.154668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:19.154912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:19.154993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402444562553293:3288], now have 1 active actors on pipe
2025-10-15T11:03:19.155018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402444562553159:2467], now have 1 active actors on pipe
2025-10-15T11:03:19.155043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402444562553356:4077], now have 1 active actors on pipe
2025-10-15T11:03:19.155071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402447362241896:10487]
2025-10-15T11:03:19.155087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402447362241896:10487]
2025-10-15T11:03:19.155101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402447362241896:10487]
2025-10-15T11:03:19.155144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:19.155219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:19.155582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:19.155601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:19.155751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402447362241896:10487]
2025-10-15T11:03:19.155772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:19.156301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:19.156326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:19.156337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:19.156361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:19.156848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:19.156891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:19.156989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:19.157022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:19.157042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:19.157053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:19.157090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:19.157135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:19.157182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:19.155360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1141
2025-10-15T11:03:19.155459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1141
2025-10-15T11:03:19.155523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1141, pipe: [1:7561402444562553356:4077]
2025-10-15T11:03:19.160087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:19.160123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:19.160205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:19.161448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1142 partition: 0 MaxSeqNo: 46 sessionId: src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0
2025-10-15T11:03:19.166216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57ff0e9-6139ef87-f863c6fc-dabf1491_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:19.253976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0] Write session: try to update token
2025-10-15T11:03:19.254043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:19.329979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:19.330019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:19.330032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:19.330155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:19.330171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:19.330188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:19.330198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:19.330233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402447362241896:10487]
2025-10-15T11:03:19.330260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402447362241896:10487]
2025-10-15T11:03:19.330284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402447362241896:10487]
2025-10-15T11:03:19.330431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:19.330480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:19.330511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:19.366583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:19.366635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:19.371880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:19.448381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId: src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:19.477576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:19.570645Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:19.581849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:19.581888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:19.581935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402447362241896:10487]
2025-10-15T11:03:19.582102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:19.582129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:19.582482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:19.584468Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:19.584894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:19.584922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:19.591581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:19.591890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402444562553356:4077]
2025-10-15T11:03:19.683616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1142 reason: error at write: Disconnected sessionId: src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0
2025-10-15T11:03:19.683915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1142 sessionId: src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0 is DEAD
2025-10-15T11:03:19.688128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:19.688231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0] Write session will restart in 0.007723s
2025-10-15T11:03:19.688449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0] Write session: Do CDS request
2025-10-15T11:03:19.688530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:19.691903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402448857520718:4077]
2025-10-15T11:03:19.702584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:19.702620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1143
2025-10-15T11:03:19.708260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:19.709462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:19.709626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:19.709643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:19.709656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:19.712189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1143 sessionId:  describe result for acl check
2025-10-15T11:03:19.712305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:19.712315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:19.712323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:19.712339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402448857520746:3274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:19.714614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402448857520746:3274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:19.760122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402448857520746:3274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:19.772042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402448857520746:3274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:19.772091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402448857520746:3274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:19.772108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402448857520746:3274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:19.772140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:19.799703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:19.808921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:19.809757Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:19.809792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:19.809836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:19.810092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:19.810293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402451657209469:10499]
2025-10-15T11:03:19.812465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:19.813551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:19.813764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:19.814911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:19.815215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:19.815223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:19.815230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:19.815237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:19.815243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:19.815251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:19.815257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:19.815263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:19.815270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:19.815278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:19.815285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:19.815291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:19.815298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:19.815305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:19.815373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:19.815474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:19.815521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:19.815566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:19.815609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:19.815654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:19.815713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:19.815758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:19.815801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:19.815846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:19.815888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:19.815929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:19.815969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:19.816010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:19.816053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:19.816117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:19.816172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:19.816224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:19.816271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:19.816320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:19.816365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:19.816417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:19.816461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:19.816510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:19.816554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:19.816604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:19.816648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:19.816698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:19.816742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:19.816790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:19.816838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:19.816888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:19.816930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:19.816981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:19.817027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:19.818311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:19.818412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:19.818495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:19.818557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:19.818622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:19.818672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:19.818735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:19.819248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:19.844600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:19.894761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:19.894938Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:19.894958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:19.894975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:19.894998Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1142 [2:7561402451657209469:10499]
2025-10-15T11:03:19.895049Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:19.895100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:19.895113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:19.895124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:19.895134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:19.895175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:19.895196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:19.895217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:19.896394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:19.896409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:19.896421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:19.896432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:19.896684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:19.896700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:19.896828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:19.896999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:19.897211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:19.897271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402451657209464:10499]
2025-10-15T11:03:19.897284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402451657209464:10499]
2025-10-15T11:03:19.897296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402451657209464:10499]
2025-10-15T11:03:19.897334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:19.897397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:19.897559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:19.897575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:19.897681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402451657209464:10499]
2025-10-15T11:03:19.897698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:19.898810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:19.898833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:19.898845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:19.898867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:19.902548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402448857520718:4077], now have 1 active actors on pipe
2025-10-15T11:03:19.902586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402448857520691:2467], now have 1 active actors on pipe
2025-10-15T11:03:19.902608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402448857520888:3274], now have 1 active actors on pipe
2025-10-15T11:03:19.903518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1142, pipe: [1:7561402448857520718:4077]
2025-10-15T11:03:19.903632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1142
2025-10-15T11:03:19.903672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1142
2025-10-15T11:03:19.907473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:19.907514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:19.907596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df2d7a31-656b1506-43510e7c-6e99d540_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:19.907628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:19.907644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:19.907655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:19.907703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:19.907743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:19.907791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:19.912774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:19.912812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:19.912887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:19.913216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1143 partition: 0 MaxSeqNo: 46 sessionId: src_id|df2d7a31-656b1506-43510e7c-6e99d540_0
2025-10-15T11:03:19.915642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9641cad9-c21625b8-f3cdc0bb-b9adbcf3_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|df2d7a31-656b1506-43510e7c-6e99d540_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:19.966212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df2d7a31-656b1506-43510e7c-6e99d540_0] Write session: try to update token
2025-10-15T11:03:19.966279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df2d7a31-656b1506-43510e7c-6e99d540_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:20.093782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:20.093821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:20.093834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:20.093891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:20.093908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:20.093922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:20.093934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:20.093970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402451657209464:10499]
2025-10-15T11:03:20.094000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402451657209464:10499]
2025-10-15T11:03:20.094028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402451657209464:10499]
2025-10-15T11:03:20.094229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:20.094251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:20.094642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:20.094673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:20.094701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:20.096690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:20.155767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId: src_id|df2d7a31-656b1506-43510e7c-6e99d540_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:20.187988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:20.266338Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:20.310328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:20.310376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:20.310449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:20.310463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:20.310505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402451657209464:10499]
2025-10-15T11:03:20.310681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:20.311054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:20.312317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:20.364673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1143 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df2d7a31-656b1506-43510e7c-6e99d540_0
2025-10-15T11:03:20.364978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1143 sessionId: src_id|df2d7a31-656b1506-43510e7c-6e99d540_0 is DEAD
2025-10-15T11:03:20.371580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2d7a31-656b1506-43510e7c-6e99d540_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:20.371625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2d7a31-656b1506-43510e7c-6e99d540_0] Write session will restart in 0.008643s
2025-10-15T11:03:20.371748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2d7a31-656b1506-43510e7c-6e99d540_0] Write session: Do CDS request
2025-10-15T11:03:20.371777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2d7a31-656b1506-43510e7c-6e99d540_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:20.388715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df2d7a31-656b1506-43510e7c-6e99d540_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:20.412897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402448857520718:4077]
2025-10-15T11:03:20.413034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:20.413162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:20.413176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1144
2025-10-15T11:03:20.414494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:20.414611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:20.414624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:20.414634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:20.429953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1144 sessionId:  describe result for acl check
2025-10-15T11:03:20.430071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:20.430082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:20.430091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:20.430107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402453152488287:3242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:20.432494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402453152488287:3242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:20.463620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402453152488287:3242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:20.485863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402453152488287:3242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:20.485909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402453152488287:3242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:20.485924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402453152488287:3242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:20.485951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:20.515455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402453152488485:4077]
2025-10-15T11:03:20.554188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:20.560803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:20.561610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:20.561630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:20.561667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:20.561903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:20.562076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402455952177011:10507]
2025-10-15T11:03:20.564278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:20.565774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:20.565977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:20.567173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:20.567493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:20.567501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:20.567508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:20.567515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:20.567522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:20.567528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:20.567534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:20.567541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:20.567547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:20.567553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:20.567561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:20.567567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:20.567574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:20.567579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:20.567620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:20.567742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:20.567788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:20.567833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:20.567877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:20.567923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:20.567966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:20.568011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:20.568053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:20.568098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:20.568140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:20.568181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:20.568244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:20.568289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:20.568328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:20.568387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:20.568440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:20.568492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:20.568540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:20.568588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:20.568630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:20.568683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:20.568727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:20.568774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:20.568816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:20.568867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:20.568913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:20.568965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:20.569008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:20.571316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:20.571423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:20.571979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:20.572043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:20.572100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:20.572150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:20.572201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:20.572249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:20.572300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:20.572344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:20.572406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:20.572451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:20.572506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:20.573003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:20.606649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:20.619580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:20.619621Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:20.619652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:20.619670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:20.619696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1143 [2:7561402455952177011:10507]
2025-10-15T11:03:20.619746Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:20.619799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:20.619812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:20.619827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:20.619838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:20.619884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:20.619904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:20.619923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:20.621008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:20.621024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:20.621039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:20.621050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:20.621309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:20.621325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:20.621464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:20.621649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:20.621887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:20.621949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402455952177006:10507]
2025-10-15T11:03:20.621963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402455952177006:10507]
2025-10-15T11:03:20.621976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402455952177006:10507]
2025-10-15T11:03:20.622015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:20.622081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:20.622251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:20.622267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:20.622370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402455952177006:10507]
2025-10-15T11:03:20.622388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:20.623248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:20.623271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:20.623282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:20.623304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:20.624824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402453152488485:4077], now have 1 active actors on pipe
2025-10-15T11:03:20.624860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402453152488450:3242], now have 1 active actors on pipe
2025-10-15T11:03:20.624881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402453152488263:2467], now have 1 active actors on pipe
2025-10-15T11:03:20.628610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1143, pipe: [1:7561402453152488485:4077]
2025-10-15T11:03:20.628712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1143
2025-10-15T11:03:20.628777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1143
2025-10-15T11:03:20.630728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:20.630775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:20.630886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:20.630919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:20.630936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:20.630946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:20.630983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:20.631024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:20.631074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:20.636605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:20.636645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:20.636723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:20.637034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1144 partition: 0 MaxSeqNo: 46 sessionId: src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0
2025-10-15T11:03:20.643624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2d7a31-656b1506-43510e7c-6e99d540_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:20.681986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0] Write session: try to update token
2025-10-15T11:03:20.682053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:20.826943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:20.826977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:20.826988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:20.826998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:20.827026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402455952177006:10507]
2025-10-15T11:03:20.827054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402455952177006:10507]
2025-10-15T11:03:20.827078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402455952177006:10507]
2025-10-15T11:03:20.827227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:20.827241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:20.827250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:20.827711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:20.827748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:20.827773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:20.831390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:20.831467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:20.832554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:20.874461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId: src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:20.911783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:21.028918Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:21.058262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402453152488485:4077]
2025-10-15T11:03:21.058360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:21.058372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:21.056334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:21.056385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:21.056445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:21.056460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:21.056514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402455952177006:10507]
2025-10-15T11:03:21.056915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:21.058985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:21.064064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:21.100678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1144 reason: error at write: Disconnected sessionId: src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0
2025-10-15T11:03:21.100951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1144 sessionId: src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0 is DEAD
2025-10-15T11:03:21.107633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:21.107687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0] Write session will restart in 0.006116s
2025-10-15T11:03:21.107800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0] Write session: Do CDS request
2025-10-15T11:03:21.107832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:21.127919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:21.135477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:21.135509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1145
2025-10-15T11:03:21.139672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:21.139853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:21.139871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:21.139883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:21.144715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1145 sessionId:  describe result for acl check
2025-10-15T11:03:21.144841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:21.144851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:21.144859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:21.144876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402457447455832:3245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:21.147174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402457447455832:3245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:21.159015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402457447455848:4077]
2025-10-15T11:03:21.169516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402457447455832:3245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:21.191162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402457447455832:3245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:21.191195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402457447455832:3245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:21.191206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402457447455832:3245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:21.191227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:21.277315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:21.279936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:21.280736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:21.280764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:21.280804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:21.281021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:21.281204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402460247144568:10518]
2025-10-15T11:03:21.283242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:21.285694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:21.285914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:21.287275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:21.287975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:21.287991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:21.287997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:21.288003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:21.288010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:21.288016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:21.288022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:21.288029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:21.288034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:21.288041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:21.288048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:21.288054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.288059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.288065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.288109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:21.288212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:21.288258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:21.288303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:21.288348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:21.288394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:21.288436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:21.288480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:21.288521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:21.288565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:21.288606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:21.288649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.288689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.288734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.288775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:21.288834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:21.288888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:21.288939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:21.288985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:21.289033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:21.289075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:21.289124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:21.289169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:21.289222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:21.289264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:21.289314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:21.289361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:21.289412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:21.289455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:21.289504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:21.289548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:21.289597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:21.289640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:21.289691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:21.289736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:21.289784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:21.289826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.289876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.289922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.289971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.290012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.290065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.290547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:21.340345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:21.356046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:21.356107Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:21.356128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:21.356149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:21.356178Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1144 [2:7561402460247144568:10518]
2025-10-15T11:03:21.356239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:21.356308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:21.356325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:21.356339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:21.356352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:21.356407Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:21.356433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:21.356458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:21.379128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.379154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.379164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.379172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:21.379421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:21.379435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.379547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.379701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.379853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:21.379915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402457447455848:4077], now have 1 active actors on pipe
2025-10-15T11:03:21.379932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402457447455942:3245], now have 1 active actors on pipe
2025-10-15T11:03:21.379945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402457447455815:2467], now have 1 active actors on pipe
2025-10-15T11:03:21.379965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402460247144562:10518]
2025-10-15T11:03:21.379975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402460247144562:10518]
2025-10-15T11:03:21.379984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402460247144562:10518]
2025-10-15T11:03:21.380015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:21.380068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:21.380139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:21.380156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:21.380168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:21.380214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:21.380226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:21.380316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402460247144562:10518]
2025-10-15T11:03:21.380336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:21.380355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:21.384270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1144, pipe: [1:7561402457447455848:4077]
2025-10-15T11:03:21.384372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1144
2025-10-15T11:03:21.384436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1144
2025-10-15T11:03:21.385927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:21.385980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:21.386102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fc1442d-83e1a984-f64be276-4e81f405_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:21.386142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:21.386163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:21.386177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:21.386221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:21.386272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:21.386325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:21.387186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:21.387225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:21.387307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:21.391707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1145 partition: 0 MaxSeqNo: 46 sessionId: src_id|5fc1442d-83e1a984-f64be276-4e81f405_0
2025-10-15T11:03:21.393677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0d0e9-e387d20a-ddafbfbf-62251a4c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|5fc1442d-83e1a984-f64be276-4e81f405_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:21.444536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:21.444570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:21.444607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402460247144562:10518]
2025-10-15T11:03:21.444713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:21.448586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:21.456186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:21.467223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:21.469335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1442d-83e1a984-f64be276-4e81f405_0] Write session: try to update token
2025-10-15T11:03:21.469383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1442d-83e1a984-f64be276-4e81f405_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:21.470257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:21.471511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:21.473223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:21.473657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:21.473670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:21.473682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:21.473733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:21.589216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:21.589244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:21.589255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:21.589303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:21.589315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:21.589326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:21.589336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:21.589371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402460247144562:10518]
2025-10-15T11:03:21.589397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402460247144562:10518]
2025-10-15T11:03:21.589418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402460247144562:10518]
2025-10-15T11:03:21.589546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:21.589564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:21.591239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:21.591269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:21.591294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:21.594271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:21.603084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId: src_id|5fc1442d-83e1a984-f64be276-4e81f405_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:21.632581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:21.758369Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:21.760699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:21.760738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:21.762283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402457447455848:4077]
2025-10-15T11:03:21.762367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:21.762377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:21.761550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:21.796978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1145 reason: error at write: Disconnected sessionId: src_id|5fc1442d-83e1a984-f64be276-4e81f405_0
2025-10-15T11:03:21.797287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1145 sessionId: src_id|5fc1442d-83e1a984-f64be276-4e81f405_0 is DEAD
2025-10-15T11:03:21.803868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1442d-83e1a984-f64be276-4e81f405_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:21.803908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1442d-83e1a984-f64be276-4e81f405_0] Write session will restart in 0.007799s
2025-10-15T11:03:21.804009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1442d-83e1a984-f64be276-4e81f405_0] Write session: Do CDS request
2025-10-15T11:03:21.804033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1442d-83e1a984-f64be276-4e81f405_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:21.806317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:21.815155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1442d-83e1a984-f64be276-4e81f405_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:21.822264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:21.822298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1146
2025-10-15T11:03:21.822533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:21.822633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:21.822653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:21.822663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:21.823620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1146 sessionId:  describe result for acl check
2025-10-15T11:03:21.823690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:21.823696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:21.823702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:21.823711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402457447456110:3217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:21.825362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402457447456110:3217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:21.845270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402457447456110:3217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:21.867664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402457447456208:4077]
2025-10-15T11:03:21.873203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402457447456110:3217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:21.873248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402457447456110:3217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:21.873263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402457447456110:3217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:21.873292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:21.932224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:21.942289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:21.943038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:21.943054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:21.943092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:21.943311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:21.943501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402460247144812:10527]
2025-10-15T11:03:21.945477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:21.946551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:21.946750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:21.947886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:21.948176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:21.948183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:21.948189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:21.948194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:21.948200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:21.948206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:21.948212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:21.948219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:21.948224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:21.948229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:21.948235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:21.948241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.948247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.948252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.948290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:21.948379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:21.948419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:21.948460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:21.948498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:21.948537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:21.948575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:21.948616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:21.948653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:21.948694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:21.948733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:21.948772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.948810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.948850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.948885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:21.948942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:21.948988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:21.949033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:21.949075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:21.949118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:21.949157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:21.949201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:21.949243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:21.949289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:21.949327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:21.949371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:21.949409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:21.949453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:21.949491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:21.949540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:21.949580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:21.949626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:21.949668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:21.949715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:21.949753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:21.949801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:21.949839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.949884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:21.949924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.949967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:21.950006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.950049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:21.952530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:21.978113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:21.995875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:21.995915Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:21.995930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:21.995949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:21.995972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1145 [2:7561402460247144812:10527]
2025-10-15T11:03:21.996019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:21.996071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:21.996084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:21.996095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:21.996105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:21.996148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:21.996168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:21.996187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:22.056930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:22.056968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:22.056983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:22.056994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:22.057294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:22.057310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:22.057454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:22.057641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:22.060230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1145
2025-10-15T11:03:22.057866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:22.057936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402460247144806:10527]
2025-10-15T11:03:22.060314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1145, pipe: [1:7561402457447456208:4077]
2025-10-15T11:03:22.057953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402460247144806:10527]
2025-10-15T11:03:22.060389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1145
2025-10-15T11:03:22.057968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402460247144806:10527]
2025-10-15T11:03:22.058017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:22.058093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:22.058267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:22.058283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:22.058418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402460247144806:10527]
2025-10-15T11:03:22.058438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:22.058770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:22.058783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:22.058794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:22.058816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:22.059787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402457447456230:3217], now have 1 active actors on pipe
2025-10-15T11:03:22.059814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402457447456208:4077], now have 1 active actors on pipe
2025-10-15T11:03:22.059838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402457447456103:2467], now have 1 active actors on pipe
2025-10-15T11:03:22.063197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:22.063228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:22.063322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:22.063377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:22.063395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:22.063407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:22.063444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:22.063488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:22.063539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:22.072010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:22.072051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:22.072129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:22.073232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1146 partition: 0 MaxSeqNo: 46 sessionId: src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0
2025-10-15T11:03:22.078884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fc1442d-83e1a984-f64be276-4e81f405_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:22.096027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:22.096056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:22.096068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:22.134379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0] Write session: try to update token
2025-10-15T11:03:22.134436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:22.281778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:22.281815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:22.281828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:22.281839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:22.281873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402460247144806:10527]
2025-10-15T11:03:22.281900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402460247144806:10527]
2025-10-15T11:03:22.281925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402460247144806:10527]
2025-10-15T11:03:22.282076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:22.282088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:22.282099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:22.282197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:22.282218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:22.283455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:22.283667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:22.283712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:22.283739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:22.360518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId: src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:22.393529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:22.517129Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:22.531583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:22.531637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:22.531702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:22.531715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:22.531751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402460247144806:10527]
2025-10-15T11:03:22.532418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:22.532867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:22.537703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:22.539729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402457447456208:4077]
2025-10-15T11:03:22.539852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:22.635827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402461742423678:4077]
2025-10-15T11:03:22.637943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1146 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0
2025-10-15T11:03:22.638238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1146 sessionId: src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0 is DEAD
2025-10-15T11:03:22.643778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:22.643825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0] Write session will restart in 0.005980s
2025-10-15T11:03:22.643926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0] Write session: Do CDS request
2025-10-15T11:03:22.643959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:22.658737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:22.663820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:22.663862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1147
2025-10-15T11:03:22.668142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:22.668331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:22.668376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:22.668402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:22.672539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1147 sessionId:  describe result for acl check
2025-10-15T11:03:22.672670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:22.672680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:22.672689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:22.672704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402461742423718:3191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:22.675867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402461742423718:3191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:22.707337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402461742423718:3191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:22.729331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402461742423718:3191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:22.729377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402461742423718:3191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:22.729392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402461742423718:3191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:22.729420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:22.778000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:22.790637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:22.791459Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:22.791479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:22.791537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:22.791779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:22.791951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402464542112372:10538]
2025-10-15T11:03:22.794030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:22.804037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:22.804291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:22.805501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:22.805834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:22.805843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:22.805849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:22.805856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:22.805863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:22.805871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:22.805878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:22.805884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:22.805891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:22.805899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:22.805906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:22.805913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:22.805919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:22.805925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:22.805968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:22.806065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:22.806109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:22.806154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:22.806196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:22.806241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:22.806283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:22.806324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:22.806365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:22.806407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:22.806448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:22.806488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:22.806530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:22.806571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:22.806611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:22.806669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:22.806723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:22.806775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:22.806820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:22.806868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:22.806911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:22.806958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:22.807005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:22.807052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:22.807093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:22.807139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:22.807179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:22.807230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:22.807270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:22.807316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:22.807437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:22.807487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:22.807543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:22.807592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:22.807633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:22.807679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:22.807719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:22.807764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:22.807806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:22.807854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:22.807894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:22.807942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:22.808382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:22.828784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:22.840758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:22.841140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:22.841164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:22.841182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:22.841204Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1146 [2:7561402464542112372:10538]
2025-10-15T11:03:22.841261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:22.841308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:22.841320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:22.841330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:22.841340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:22.841379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:22.841400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:22.841418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:22.843085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:22.843098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:22.843110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:22.843120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:22.843393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:22.843408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:22.843533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:22.843693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:22.843891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:22.843953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402464542112366:10538]
2025-10-15T11:03:22.843966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402464542112366:10538]
2025-10-15T11:03:22.843978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402464542112366:10538]
2025-10-15T11:03:22.844215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:22.844227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:22.844238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:22.845086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:22.845166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:22.845335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:22.845350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:22.845391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402461742423837:3191], now have 1 active actors on pipe
2025-10-15T11:03:22.845411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402461742423678:4077], now have 1 active actors on pipe
2025-10-15T11:03:22.845431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402461742423661:2467], now have 1 active actors on pipe
2025-10-15T11:03:22.845525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402464542112366:10538]
2025-10-15T11:03:22.845551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:22.845976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1146
2025-10-15T11:03:22.846060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1146, pipe: [1:7561402461742423678:4077]
2025-10-15T11:03:22.846126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1146
2025-10-15T11:03:22.846219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:22.848194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:22.848225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:22.848308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:22.848337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:22.848353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:22.848362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:22.848391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:22.848439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:22.848483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:22.849173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:22.849195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:22.849250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:22.849640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1147 partition: 0 MaxSeqNo: 46 sessionId: src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0
2025-10-15T11:03:22.850996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dabe86e-35e4c99c-271c2151-a57ccb9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:22.929886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0] Write session: try to update token
2025-10-15T11:03:22.929942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:22.942406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:22.942452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:22.942465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:23.115560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:23.115597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:23.115608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:23.115669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:23.115685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:23.115699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:23.115710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:23.115745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402464542112366:10538]
2025-10-15T11:03:23.115774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402464542112366:10538]
2025-10-15T11:03:23.115799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402464542112366:10538]
2025-10-15T11:03:23.115952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:23.115975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:23.117612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:23.117660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:23.117689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:23.120461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:23.145348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId: src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:23.194315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:23.304897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:23.320018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:23.320069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:23.325652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:23.325680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:23.332084Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:23.415675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402461742423678:4077]
2025-10-15T11:03:23.415775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1147 reason: error at write: Disconnected sessionId: src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0
2025-10-15T11:03:23.416127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1147 sessionId: src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0 is DEAD
2025-10-15T11:03:23.419790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:23.419823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0] Write session will restart in 0.005053s
2025-10-15T11:03:23.419912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0] Write session: Do CDS request
2025-10-15T11:03:23.419938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:23.438981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:23.470067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:23.470991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:23.471016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1148
2025-10-15T11:03:23.471576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:23.471712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:23.471729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:23.471741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:23.473335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1148 sessionId:  describe result for acl check
2025-10-15T11:03:23.476316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:23.476337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:23.476347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:23.476368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402466037391388:3182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:23.479160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402466037391388:3182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:23.502103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402466037391388:3182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:23.509891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402466037391460:4077]
2025-10-15T11:03:23.517017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402466037391388:3182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:23.517057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402466037391388:3182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:23.517074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402466037391388:3182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:23.517103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:23.522336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:23.532050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:23.532802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:23.532817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:23.532850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:23.533063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:23.533227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402468837079929:10547]
2025-10-15T11:03:23.541035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:23.542656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:23.542880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:23.544134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:23.544458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:23.544466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:23.544473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:23.544480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:23.544487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:23.544493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:23.544500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:23.544507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:23.544514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:23.544520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:23.544527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:23.544534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:23.544541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:23.544548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:23.544593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:23.544697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:23.544745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:23.544792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:23.544837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:23.544885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:23.544930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:23.544978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:23.545022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:23.545067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:23.545110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:23.545157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:23.545201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:23.545247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:23.545287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:23.545349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:23.545407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:23.545461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:23.551458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:23.551572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:23.551633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:23.551689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:23.551746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:23.551802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:23.551848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:23.551904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:23.551953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:23.552009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:23.552059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:23.552112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:23.552159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:23.552218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:23.552261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:23.552317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:23.552366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:23.552421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:23.552467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:23.552523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:23.552572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:23.552626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:23.552673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:23.552728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:23.553241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:23.582858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:23.593742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:23.593798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:23.593815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:23.593838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:23.593868Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1147 [2:7561402468837079929:10547]
2025-10-15T11:03:23.593926Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:23.593991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:23.594008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:23.594022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:23.594034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:23.594086Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:23.594111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:23.594135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:23.596942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:23.596978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:23.596992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:23.597003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:23.597277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:23.597293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:23.597437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:23.597628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:23.597851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:23.597919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402468837079923:10547]
2025-10-15T11:03:23.597933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402468837079923:10547]
2025-10-15T11:03:23.597944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402468837079923:10547]
2025-10-15T11:03:23.597987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:23.598061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:23.598232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:23.598249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:23.598394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402468837079923:10547]
2025-10-15T11:03:23.598416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:23.600286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1147
2025-10-15T11:03:23.600385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1147, pipe: [1:7561402466037391460:4077]
2025-10-15T11:03:23.600516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1147
2025-10-15T11:03:23.599033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:23.599054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:23.599064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:23.599087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:23.606227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402466037391468:3182], now have 1 active actors on pipe
2025-10-15T11:03:23.606287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402466037391460:4077], now have 1 active actors on pipe
2025-10-15T11:03:23.606313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402466037391373:2467], now have 1 active actors on pipe
2025-10-15T11:03:23.606375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:23.606402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:23.606521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:23.606558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:23.606579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:23.606590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:23.606639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:23.606691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:23.606759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:23.611184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:23.611223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:23.611299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:23.611780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1148 partition: 0 MaxSeqNo: 46 sessionId: src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0
2025-10-15T11:03:23.612549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556edcb4-b0379b81-a9ce7eb7-28dd4dba_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:23.648943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0] Write session: try to update token
2025-10-15T11:03:23.649001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:23.695599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:23.695629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:23.695640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:23.893603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:23.893630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:23.893639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:23.893689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:23.893701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:23.893712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:23.893719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:23.893747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402468837079923:10547]
2025-10-15T11:03:23.893769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402468837079923:10547]
2025-10-15T11:03:23.893790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402468837079923:10547]
2025-10-15T11:03:23.893907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:23.893924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:23.894924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:23.895596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:23.895628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:23.895655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:23.907530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId: src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:23.961236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:24.103687Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:24.113286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:24.113324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:24.118445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:24.118473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:24.119129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402466037391460:4077]
2025-10-15T11:03:24.119231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:24.134683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1148 reason: error at write: Disconnected sessionId: src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0
2025-10-15T11:03:24.134980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1148 sessionId: src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0 is DEAD
2025-10-15T11:03:24.135802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:24.135836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0] Write session will restart in 0.006329s
2025-10-15T11:03:24.135923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0] Write session: Do CDS request
2025-10-15T11:03:24.135948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:24.165380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:24.165412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1149
2025-10-15T11:03:24.165928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:24.166497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:24.166632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:24.166649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:24.166660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:24.168216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1149 sessionId:  describe result for acl check
2025-10-15T11:03:24.168343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:24.168351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:24.168358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:24.168371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402470332358821:3170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:24.170894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402470332358821:3170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:24.189086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402470332358821:3170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:24.196039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:24.216689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402470332358821:3170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:24.216738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402470332358821:3170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:24.216754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402470332358821:3170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:24.216783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:24.221185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402470332358853:4077]
2025-10-15T11:03:24.378716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:24.391039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:24.391900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:24.391917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:24.391957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:24.392197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:24.392361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402473132047493:10558]
2025-10-15T11:03:24.394444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:24.396827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:24.397057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:24.398266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:24.398599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:24.398608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:24.398614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:24.398621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:24.398627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:24.398635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:24.398641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:24.398648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:24.398655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:24.398661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:24.398668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:24.398674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:24.398681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:24.398688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:24.398732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:24.398836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:24.398885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:24.398931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:24.398977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:24.399024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:24.399071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:24.399114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:24.399158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:24.399202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:24.399263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:24.399306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:24.399365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:24.399410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:24.399469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:24.399534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:24.399591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:24.399647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:24.399695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:24.399746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:24.399793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:24.399843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:24.399888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:24.399941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:24.399985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:24.400033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:24.400080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:24.400131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:24.400178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:24.400229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:24.400276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:24.400331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:24.400375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:24.400426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:24.400471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:24.400521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:24.400563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:24.400614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:24.400662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:24.400715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:24.400759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:24.400805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:24.401284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:24.433615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:24.444930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:24.444976Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:24.444992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:24.445010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:24.445033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1148 [2:7561402473132047493:10558]
2025-10-15T11:03:24.445080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:24.445131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:24.445144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:24.445155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:24.445166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:24.445208Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:24.445228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:24.445247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:24.446944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:24.446958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:24.446970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:24.446981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:24.447243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:24.447259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:24.448237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:24.448421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:24.448631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:24.448708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402470332358812:2467], now have 1 active actors on pipe
2025-10-15T11:03:24.448729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402470332358853:4077], now have 1 active actors on pipe
2025-10-15T11:03:24.448751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402470332358851:3170], now have 1 active actors on pipe
2025-10-15T11:03:24.448775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402473132047487:10558]
2025-10-15T11:03:24.448789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402473132047487:10558]
2025-10-15T11:03:24.448803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402473132047487:10558]
2025-10-15T11:03:24.448839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:24.448908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:24.449064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:24.449079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:24.449183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402473132047487:10558]
2025-10-15T11:03:24.449199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:24.449678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:24.449696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:24.449706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:24.449728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:24.454676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1148
2025-10-15T11:03:24.454785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1148, pipe: [1:7561402470332358853:4077]
2025-10-15T11:03:24.454862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1148
2025-10-15T11:03:24.459567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:24.459608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:24.459683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|118133ed-e634dc21-1eb2d510-f107b86c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:24.459715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:24.459733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:24.459744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:24.459778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:24.459817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:24.459858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:24.466389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:24.466433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:24.466515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:24.471607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1149 partition: 0 MaxSeqNo: 46 sessionId: src_id|118133ed-e634dc21-1eb2d510-f107b86c_0
2025-10-15T11:03:24.475638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdc654ea-4fee3797-4f780c7b-913c99fc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|118133ed-e634dc21-1eb2d510-f107b86c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:24.573386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118133ed-e634dc21-1eb2d510-f107b86c_0] Write session: try to update token
2025-10-15T11:03:24.573470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118133ed-e634dc21-1eb2d510-f107b86c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:24.656026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:24.656087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:24.656172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402473132047487:10558]
2025-10-15T11:03:24.656387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:24.656417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:24.656444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:24.656687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:24.657291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:24.667827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:24.669036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:24.670633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:24.671874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:24.673474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:24.702893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:24.703181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:24.703222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:24.703265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:24.703298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:24.703777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402473132047487:10558]
2025-10-15T11:03:24.703858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402473132047487:10558]
2025-10-15T11:03:24.703922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402473132047487:10558]
2025-10-15T11:03:24.704168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:24.704205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:24.704297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:24.704342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:24.704374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:24.721226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:24.776481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId: src_id|118133ed-e634dc21-1eb2d510-f107b86c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:24.817399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:24.968577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:24.970591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:24.970631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:24.972719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:24.975561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:25.033545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1149 reason: status is not ok: tablet will be restarted right now sessionId: src_id|118133ed-e634dc21-1eb2d510-f107b86c_0
2025-10-15T11:03:25.033906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1149 sessionId: src_id|118133ed-e634dc21-1eb2d510-f107b86c_0 is DEAD
2025-10-15T11:03:25.034985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118133ed-e634dc21-1eb2d510-f107b86c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:25.035010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118133ed-e634dc21-1eb2d510-f107b86c_0] Write session will restart in 0.008339s
2025-10-15T11:03:25.035082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118133ed-e634dc21-1eb2d510-f107b86c_0] Write session: Do CDS request
2025-10-15T11:03:25.035104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118133ed-e634dc21-1eb2d510-f107b86c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:25.052495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118133ed-e634dc21-1eb2d510-f107b86c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:25.060629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:25.060784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402470332358853:4077]
2025-10-15T11:03:25.060812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:25.060826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1150
2025-10-15T11:03:25.061796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:25.061924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:25.061940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:25.061950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:25.063514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1150 sessionId:  describe result for acl check
2025-10-15T11:03:25.063638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:25.063649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:25.063659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:25.063680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402474627326416:3144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:25.066540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402474627326416:3144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:25.104954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402474627326416:3144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:25.126340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402474627326416:3144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:25.126386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402474627326416:3144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:25.126403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402474627326416:3144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:25.126436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:25.158874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402474627326589:4077]
2025-10-15T11:03:25.184672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:25.193236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:25.194230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:25.194250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:25.194294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:25.194578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:25.194767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402477427015043:10567]
2025-10-15T11:03:25.201448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:25.212375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:25.212702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:25.214086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:25.214441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:25.214449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:25.214457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:25.214465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:25.214472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:25.214479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:25.214487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:25.214493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:25.214500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:25.214508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:25.214515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:25.214522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:25.214529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:25.214536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:25.214590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:25.214710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:25.214759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:25.214808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:25.214856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:25.214902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:25.214950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:25.214997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:25.215042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:25.215092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:25.215137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:25.215181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:25.215226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:25.215321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:25.215383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:25.215471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:25.215538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:25.215595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:25.215646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:25.215708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:25.215754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:25.215815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:25.215864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:25.215924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:25.215985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:25.216046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:25.216097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:25.216152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:25.216198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:25.216254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:25.216302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:25.216358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:25.216405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:25.216464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:25.216510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:25.216565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:25.216611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:25.216669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:25.216718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:25.216773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:25.216818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:25.216875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:25.217432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:25.281021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:25.290849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:25.291221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:25.291249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:25.291273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:25.291301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1149 [2:7561402477427015043:10567]
2025-10-15T11:03:25.291376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:25.291470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:25.291487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:25.291502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:25.291516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:25.291570Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:25.291594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:25.291617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:25.341885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:25.341920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:25.341933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:25.341945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:25.342232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:25.342252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:25.342402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:25.342597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:25.342831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:25.342910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402477427015038:10567]
2025-10-15T11:03:25.342926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402477427015038:10567]
2025-10-15T11:03:25.342941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402477427015038:10567]
2025-10-15T11:03:25.342984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:25.343061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:25.343259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:25.343278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:25.343693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402477427015038:10567]
2025-10-15T11:03:25.343717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:25.344083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:25.344104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:25.344116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:25.344141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:25.346353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402474627326412:2467], now have 1 active actors on pipe
2025-10-15T11:03:25.346392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402474627326529:3144], now have 1 active actors on pipe
2025-10-15T11:03:25.346416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402474627326589:4077], now have 1 active actors on pipe
2025-10-15T11:03:25.347559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1149
2025-10-15T11:03:25.347571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1149
2025-10-15T11:03:25.347666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1149, pipe: [1:7561402474627326589:4077]
2025-10-15T11:03:25.351535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:25.351585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:25.351685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:25.351725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:25.351747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:25.351760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:25.351805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:25.351856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:25.351908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:25.355489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:25.355545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:25.355639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:25.356250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1150 partition: 0 MaxSeqNo: 46 sessionId: src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0
2025-10-15T11:03:25.359474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118133ed-e634dc21-1eb2d510-f107b86c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:25.395496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:25.395536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:25.395553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:25.423090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0] Write session: try to update token
2025-10-15T11:03:25.423143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:25.467211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:25.467249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:25.467265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:25.467277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:25.467319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402477427015038:10567]
2025-10-15T11:03:25.467364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402477427015038:10567]
2025-10-15T11:03:25.467407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402477427015038:10567]
2025-10-15T11:03:25.467571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:25.467596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:25.467593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:25.467629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:25.467664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:25.478705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:25.590479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId: src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:25.634166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:25.698489Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:25.704712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:25.704757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:25.711563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402474627326589:4077]
2025-10-15T11:03:25.711655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:25.711770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:25.711793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:25.714140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:25.775175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:25.775225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0] Write session will restart in 0.006962s
2025-10-15T11:03:25.775328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0] Write session: Do CDS request
2025-10-15T11:03:25.775383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:25.774542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1150 reason: error at write: Disconnected sessionId: src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0
2025-10-15T11:03:25.775312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1150 sessionId: src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0 is DEAD
2025-10-15T11:03:25.790117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:25.795557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:25.795596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1151
2025-10-15T11:03:25.795920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:25.796031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:25.796046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:25.796056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:25.804438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1151 sessionId:  describe result for acl check
2025-10-15T11:03:25.804560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:25.804570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:25.804579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:25.804596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402474627326665:3132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:25.807071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402474627326665:3132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:25.814563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402474627326677:4077]
2025-10-15T11:03:25.831848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402474627326665:3132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:25.860409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402474627326665:3132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:25.860451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402474627326665:3132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:25.860469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402474627326665:3132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:25.860498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:25.983485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:25.995733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:25.996614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:25.996634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:25.996678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:25.996940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:25.997138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402477427015311:10579]
2025-10-15T11:03:25.999266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:26.000458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:26.000671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:26.001932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:26.002254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:26.002262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:26.002269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:26.002276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:26.002283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:26.002290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:26.002297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:26.002303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:26.002310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:26.002316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:26.002323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:26.002329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.002336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.002342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.002387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:26.002497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:26.002549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:26.002596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:26.002644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:26.002692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:26.002737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:26.002785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:26.002831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:26.002880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:26.002926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:26.002970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.003016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.003062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.003104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:26.003169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:26.003227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:26.003284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:26.003334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:26.004152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:26.004214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:26.004271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:26.004321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:26.004374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:26.004422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:26.004476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:26.004524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:26.004577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:26.004623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:26.004674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:26.004720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:26.004771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:26.004816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:26.004872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:26.004920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:26.004971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:26.005015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.005070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.005118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.005171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.005216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.005268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.005804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:26.036971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:26.047924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:26.047970Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:26.047987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:26.048005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:26.048028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1150 [2:7561402477427015311:10579]
2025-10-15T11:03:26.048077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:26.048129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:26.048143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:26.048154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:26.048164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:26.048208Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:26.048229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:26.048247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:26.078501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.078526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.078534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.078543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:26.078777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:26.078790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.078901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.079037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.079216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:26.079291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402477427015306:10579]
2025-10-15T11:03:26.079304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402477427015306:10579]
2025-10-15T11:03:26.079315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402477427015306:10579]
2025-10-15T11:03:26.079373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:26.079442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:26.079601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:26.079616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:26.079723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402477427015306:10579]
2025-10-15T11:03:26.079738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:26.083959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:26.083983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:26.083996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:26.084023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:26.086621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1150
2025-10-15T11:03:26.086724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1150
2025-10-15T11:03:26.086780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1150, pipe: [1:7561402474627326677:4077]
2025-10-15T11:03:26.087219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402474627326649:2467], now have 1 active actors on pipe
2025-10-15T11:03:26.087254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402474627326755:3132], now have 1 active actors on pipe
2025-10-15T11:03:26.087276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402474627326677:4077], now have 1 active actors on pipe
2025-10-15T11:03:26.087332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:26.087382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:26.087459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f502789-e0922dca-f2e0d954-b937bb01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:26.087491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:26.087509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:26.087521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:26.087558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:26.087599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:26.087652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:26.094326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1151 partition: 0 MaxSeqNo: 46 sessionId: src_id|f502789-e0922dca-f2e0d954-b937bb01_0
2025-10-15T11:03:26.093865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:26.093904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:26.093979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:26.097873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81baa4ad-5fa2dd07-34b86005-b0887993_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f502789-e0922dca-f2e0d954-b937bb01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:26.148459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:26.148497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:26.148510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:26.159523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f502789-e0922dca-f2e0d954-b937bb01_0] Write session: try to update token
2025-10-15T11:03:26.159579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f502789-e0922dca-f2e0d954-b937bb01_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:26.228550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:26.229035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:26.229058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:26.229070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:26.229121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402477427015306:10579]
2025-10-15T11:03:26.229150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402477427015306:10579]
2025-10-15T11:03:26.229176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402477427015306:10579]
2025-10-15T11:03:26.229357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:26.229385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:26.230522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:26.231794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:26.231841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:26.231874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:26.402206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId: src_id|f502789-e0922dca-f2e0d954-b937bb01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:26.404543Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:26.444942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:26.445114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402474627326677:4077]
2025-10-15T11:03:26.445224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:26.445236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:26.450451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1151 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|f502789-e0922dca-f2e0d954-b937bb01_0
2025-10-15T11:03:26.450794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1151 sessionId: src_id|f502789-e0922dca-f2e0d954-b937bb01_0 is DEAD
2025-10-15T11:03:26.454069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f502789-e0922dca-f2e0d954-b937bb01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T11:03:26.454107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f502789-e0922dca-f2e0d954-b937bb01_0] Write session will restart in 0.008433s
2025-10-15T11:03:26.454214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f502789-e0922dca-f2e0d954-b937bb01_0] Write session: Do CDS request
2025-10-15T11:03:26.454244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f502789-e0922dca-f2e0d954-b937bb01_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:26.468714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f502789-e0922dca-f2e0d954-b937bb01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:26.469235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:26.469271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1152
2025-10-15T11:03:26.469494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:26.469594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:26.469607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:26.469616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:26.473096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1152 sessionId:  describe result for acl check
2025-10-15T11:03:26.473225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:26.473237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:26.473247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:26.473265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402478922294229:3101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:26.477358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402478922294229:3101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:26.498323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402478922294229:3101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:26.520715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402478922294229:3101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:26.520766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402478922294229:3101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:26.520789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402478922294229:3101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:26.520823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:26.547587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402478922294274:4077]
2025-10-15T11:03:26.688444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:26.696395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:26.697291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:26.697312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:26.697356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:26.697618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:26.697811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402481721982874:10587]
2025-10-15T11:03:26.700466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:26.701681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:26.701971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:26.703289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:26.703665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:26.703690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:26.703698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:26.703705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:26.703714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:26.703721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:26.703729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:26.703736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:26.703742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:26.703750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:26.703757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:26.703765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.703773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.703780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.703831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:26.703951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:26.704006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:26.704059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:26.704118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:26.704169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:26.704220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:26.704267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:26.704319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:26.704373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:26.704425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:26.704475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.704530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.704577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.704624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:26.704701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:26.704766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:26.704835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:26.704888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:26.704949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:26.705002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:26.705063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:26.705116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:26.705179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:26.705229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:26.705285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:26.705338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:26.705404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:26.705453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:26.705513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:26.705566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:26.705624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:26.705673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:26.705729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:26.705779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:26.705837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:26.705886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.705946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.705996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.706051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.706097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.706153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.706813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:26.733875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:26.745222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:26.745280Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:26.745300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:26.745322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:26.745350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1151 [2:7561402481721982874:10587]
2025-10-15T11:03:26.745409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:26.745471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:26.745487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:26.745502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:26.745515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:26.745567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:26.745591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:26.745614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:26.747295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.747313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.747340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.747789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:26.748124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:26.748143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:26.748290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:26.748486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:26.748732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:26.748809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402481721982868:10587]
2025-10-15T11:03:26.748825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402481721982868:10587]
2025-10-15T11:03:26.748840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402481721982868:10587]
2025-10-15T11:03:26.748887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:26.748971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:26.749168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:26.749187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:26.749317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402481721982868:10587]
2025-10-15T11:03:26.749336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:26.749945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:26.749966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:26.749978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:26.750004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:26.751089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1151, pipe: [1:7561402478922294274:4077]
2025-10-15T11:03:26.751197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1151
2025-10-15T11:03:26.751279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1151
2025-10-15T11:03:26.751487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402478922294274:4077], now have 1 active actors on pipe
2025-10-15T11:03:26.751526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402478922294220:2467], now have 1 active actors on pipe
2025-10-15T11:03:26.751550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402478922294263:3101], now have 1 active actors on pipe
2025-10-15T11:03:26.756403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:26.756447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:26.756550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33c081ba-609ab995-607ec1ec-285c7200_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:26.756585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:26.756609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:26.756622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:26.756665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:26.756713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:26.756779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:26.757778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:26.757806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:26.757874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:26.758963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1152 partition: 0 MaxSeqNo: 46 sessionId: src_id|33c081ba-609ab995-607ec1ec-285c7200_0
2025-10-15T11:03:26.759939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f502789-e0922dca-f2e0d954-b937bb01_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|33c081ba-609ab995-607ec1ec-285c7200_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:26.799370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c081ba-609ab995-607ec1ec-285c7200_0] Write session: try to update token
2025-10-15T11:03:26.799426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c081ba-609ab995-607ec1ec-285c7200_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:26.937481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:26.937513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:26.937542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402481721982868:10587]
2025-10-15T11:03:26.937651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:26.937662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:26.937671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:26.937775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:26.938523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:26.940744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:26.996000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:26.997251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:26.998568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:27.016343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:27.023437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId: src_id|33c081ba-609ab995-607ec1ec-285c7200_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:27.105605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:27.105778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:27.105791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:27.105803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:27.105855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:27.105870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:27.105884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:27.105897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:27.105937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402481721982868:10587]
2025-10-15T11:03:27.105966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402481721982868:10587]
2025-10-15T11:03:27.105989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402481721982868:10587]
2025-10-15T11:03:27.106124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:27.106146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:27.107196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:27.111622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:27.111701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:27.111735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:27.118292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:27.381054Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:27.382565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:27.382599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:27.383638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:27.383677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402478922294274:4077]
2025-10-15T11:03:27.383773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:27.383786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:27.388095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:27.401160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1152 reason: error at write: Disconnected sessionId: src_id|33c081ba-609ab995-607ec1ec-285c7200_0
2025-10-15T11:03:27.401530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1152 sessionId: src_id|33c081ba-609ab995-607ec1ec-285c7200_0 is DEAD
2025-10-15T11:03:27.409628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c081ba-609ab995-607ec1ec-285c7200_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:27.409678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c081ba-609ab995-607ec1ec-285c7200_0] Write session will restart in 0.007814s
2025-10-15T11:03:27.409806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c081ba-609ab995-607ec1ec-285c7200_0] Write session: Do CDS request
2025-10-15T11:03:27.409843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c081ba-609ab995-607ec1ec-285c7200_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:27.426983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:27.427020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1153
2025-10-15T11:03:27.428366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33c081ba-609ab995-607ec1ec-285c7200_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:27.430657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:27.430819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:27.430838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:27.430850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:27.433127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1153 sessionId:  describe result for acl check
2025-10-15T11:03:27.433284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:27.433298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:27.433308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:27.433327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402483217261799:3094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:27.436394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402483217261799:3094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:27.456159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402483217261799:3094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:27.470236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402483217261799:3094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:27.470293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402483217261799:3094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:27.470311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402483217261799:3094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:27.470344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:27.486643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402483217261856:4077]
2025-10-15T11:03:27.602287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:27.616866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:27.617889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:27.617909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:27.617954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:27.618228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:27.618432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402486016950438:10599]
2025-10-15T11:03:27.620808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:27.626374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:27.626567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:27.627872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:27.628237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:27.628245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:27.628253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:27.628261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:27.628268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:27.628276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:27.628283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:27.628290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:27.628296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:27.628304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:27.628312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:27.628319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:27.628327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:27.628333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:27.628381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:27.628491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:27.628541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:27.628985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:27.629043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:27.629093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:27.629142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:27.629190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:27.629239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:27.629288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:27.629336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:27.629386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:27.629429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:27.629477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:27.629522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:27.629595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:27.629656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:27.629712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:27.629764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:27.629822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:27.629869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:27.629929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:27.629980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:27.630037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:27.630083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:27.630141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:27.630193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:27.630250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:27.630295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:27.630349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:27.630400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:27.630455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:27.630502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:27.630560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:27.630610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:27.630666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:27.630713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:27.630770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:27.630820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:27.630876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:27.630921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:27.630978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:27.631553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:27.658527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:27.696038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:27.696093Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:27.696111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:27.696132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:27.696159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1152 [2:7561402486016950438:10599]
2025-10-15T11:03:27.696217Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:27.696281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:27.696297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:27.696311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:27.696322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:27.696378Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:27.696402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:27.696428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:27.698191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:27.698209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:27.698223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:27.698236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:27.707317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1152, pipe: [1:7561402483217261856:4077]
2025-10-15T11:03:27.707483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1152
2025-10-15T11:03:27.707563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1152
2025-10-15T11:03:27.708232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:27.711442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:27.711619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:27.711816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:27.712055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:27.712107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402483217261856:4077], now have 1 active actors on pipe
2025-10-15T11:03:27.712135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402483217261836:3094], now have 1 active actors on pipe
2025-10-15T11:03:27.712160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402483217261788:2467], now have 1 active actors on pipe
2025-10-15T11:03:27.712264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:27.712289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:27.712349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402486016950432:10599]
2025-10-15T11:03:27.712367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402486016950432:10599]
2025-10-15T11:03:27.712382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402486016950432:10599]
2025-10-15T11:03:27.712426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:27.712505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:27.712700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:27.712718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:27.712784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|539fe029-c590fcbe-3bee7753-d9001db9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:27.712815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:27.712834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:27.712845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:27.712882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:27.712925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:27.713056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402486016950432:10599]
2025-10-15T11:03:27.713075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:27.713120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:27.713807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:27.713832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:27.713844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:27.713868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:27.727397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:27.727446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:27.727546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:27.728350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1153 partition: 0 MaxSeqNo: 46 sessionId: src_id|539fe029-c590fcbe-3bee7753-d9001db9_0
2025-10-15T11:03:27.735618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33c081ba-609ab995-607ec1ec-285c7200_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|539fe029-c590fcbe-3bee7753-d9001db9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:27.800916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:27.800955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:27.800967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:27.809737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|539fe029-c590fcbe-3bee7753-d9001db9_0] Write session: try to update token
2025-10-15T11:03:27.809800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|539fe029-c590fcbe-3bee7753-d9001db9_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:27.958922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:27.958959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:27.958971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:27.959026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:27.959040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:27.959054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:27.959065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:27.959098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402486016950432:10599]
2025-10-15T11:03:27.959124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402486016950432:10599]
2025-10-15T11:03:27.959150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402486016950432:10599]
2025-10-15T11:03:27.959286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:27.959306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:27.959337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:27.959431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:27.959471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:27.961144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:27.989316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId: src_id|539fe029-c590fcbe-3bee7753-d9001db9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:28.010633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:28.125723Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:28.128034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:28.128071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:28.132863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:28.133004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402483217261856:4077]
2025-10-15T11:03:28.133075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:28.133085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:28.141459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1153 reason: error at write: Disconnected sessionId: src_id|539fe029-c590fcbe-3bee7753-d9001db9_0
2025-10-15T11:03:28.141741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1153 sessionId: src_id|539fe029-c590fcbe-3bee7753-d9001db9_0 is DEAD
2025-10-15T11:03:28.144639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|539fe029-c590fcbe-3bee7753-d9001db9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:28.144684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|539fe029-c590fcbe-3bee7753-d9001db9_0] Write session will restart in 0.009563s
2025-10-15T11:03:28.144809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|539fe029-c590fcbe-3bee7753-d9001db9_0] Write session: Do CDS request
2025-10-15T11:03:28.144845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|539fe029-c590fcbe-3bee7753-d9001db9_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:28.155201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:28.160818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|539fe029-c590fcbe-3bee7753-d9001db9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:28.186918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:28.186965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1154
2025-10-15T11:03:28.187675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:28.187782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:28.187796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:28.187804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:28.189310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1154 sessionId:  describe result for acl check
2025-10-15T11:03:28.189423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:28.189434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:28.189442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:28.189458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402487512229366:3068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:28.196953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402487512229366:3068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:28.205320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402487512229366:3068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:28.224462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402487512229366:3068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:28.224502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402487512229366:3068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:28.224517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402487512229366:3068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:28.224548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:28.230494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402487512229428:4077]
2025-10-15T11:03:28.366656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:28.368499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:28.369350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:28.369370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:28.369415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:28.369683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:28.369882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402490311917997:10607]
2025-10-15T11:03:28.372181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:28.373831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:28.374067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:28.375505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:28.375919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:28.375928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:28.375936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:28.375944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:28.375951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:28.375957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:28.375964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:28.375971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:28.375978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:28.375985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:28.375994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:28.376001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:28.376009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:28.376020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:28.376076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:28.376193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:28.376249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:28.376297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:28.376344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:28.376394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:28.376453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:28.376500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:28.376546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:28.376595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:28.376646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:28.376693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:28.376739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:28.376788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:28.376837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:28.376908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:28.376971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:28.377031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:28.377082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:28.377139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:28.377184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:28.377238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:28.377287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:28.377344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:28.377392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:28.377445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:28.377494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:28.377548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:28.377592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:28.377646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:28.377696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:28.377752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:28.377800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:28.377857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:28.377904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:28.377955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:28.378004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:28.378062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:28.378110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:28.378166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:28.378213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:28.378268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:28.378790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:28.412183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:28.433855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:28.433913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:28.433934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:28.433956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:28.433984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1153 [2:7561402490311917997:10607]
2025-10-15T11:03:28.434038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:28.434118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:28.434136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:28.434158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:28.434176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:28.434231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:28.434256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:28.434281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:28.445036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:28.445079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:28.445093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:28.445108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:28.445404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:28.445440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:28.445592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:28.445803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:28.446046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:28.446130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402490311917990:10607]
2025-10-15T11:03:28.446148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402490311917990:10607]
2025-10-15T11:03:28.446162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402490311917990:10607]
2025-10-15T11:03:28.446209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:28.446290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:28.446475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:28.446494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:28.446635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402490311917990:10607]
2025-10-15T11:03:28.446659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:28.446935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:28.446947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:28.446959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:28.446981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:28.447468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402487512229428:4077], now have 1 active actors on pipe
2025-10-15T11:03:28.447502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402487512229417:3068], now have 1 active actors on pipe
2025-10-15T11:03:28.447526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402487512229353:2467], now have 1 active actors on pipe
2025-10-15T11:03:28.451556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1153, pipe: [1:7561402487512229428:4077]
2025-10-15T11:03:28.451691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1153
2025-10-15T11:03:28.451766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1153
2025-10-15T11:03:28.453417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:28.453461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:28.453566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6e0c694-976b3cac-47b781ea-737553dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:28.453603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:28.453623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:28.453635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:28.453677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:28.453729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:28.453785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:28.456297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:28.456337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:28.456418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:28.457245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1154 partition: 0 MaxSeqNo: 46 sessionId: src_id|e6e0c694-976b3cac-47b781ea-737553dc_0
2025-10-15T11:03:28.459941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|539fe029-c590fcbe-3bee7753-d9001db9_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e6e0c694-976b3cac-47b781ea-737553dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:28.503147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e0c694-976b3cac-47b781ea-737553dc_0] Write session: try to update token
2025-10-15T11:03:28.503205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e0c694-976b3cac-47b781ea-737553dc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:28.656937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:28.656969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:28.656980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:28.657029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:28.657041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:28.657053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:28.657062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:28.657092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402490311917990:10607]
2025-10-15T11:03:28.657116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402490311917990:10607]
2025-10-15T11:03:28.657140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402490311917990:10607]
2025-10-15T11:03:28.657324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:28.657343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:28.658811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:28.659523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:28.659565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:28.659596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:28.663481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId: src_id|e6e0c694-976b3cac-47b781ea-737553dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:28.706396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1015 11:03:28.772900385  821865 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:03:28.851894Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:28.876764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:28.876814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:28.876876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:28.876889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:28.876930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402490311917990:10607]
2025-10-15T11:03:28.877544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:28.878422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:28.880001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:28.880064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:28.883866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:28.884159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402487512229428:4077]
2025-10-15T11:03:28.911287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1154 reason: error at write: Disconnected sessionId: src_id|e6e0c694-976b3cac-47b781ea-737553dc_0
2025-10-15T11:03:28.919686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1154 sessionId: src_id|e6e0c694-976b3cac-47b781ea-737553dc_0 is DEAD
2025-10-15T11:03:28.923943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e0c694-976b3cac-47b781ea-737553dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:28.923993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e0c694-976b3cac-47b781ea-737553dc_0] Write session will restart in 0.006251s
2025-10-15T11:03:28.924114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e0c694-976b3cac-47b781ea-737553dc_0] Write session: Do CDS request
2025-10-15T11:03:28.924155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e0c694-976b3cac-47b781ea-737553dc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:28.935389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e0c694-976b3cac-47b781ea-737553dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:28.942638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:28.942674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1155
2025-10-15T11:03:28.943047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:28.943165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:28.943184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:28.943193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:28.945072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1155 sessionId:  describe result for acl check
2025-10-15T11:03:28.945245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:28.945266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:28.945287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:28.945317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402487512229644:3060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:28.949304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402487512229644:3060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:28.959492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402487512229644:3060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:28.987254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402487512229680:4077]
2025-10-15T11:03:28.994395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402487512229644:3060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:28.994437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402487512229644:3060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:28.994454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402487512229644:3060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:28.994485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:29.141404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:29.151632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:29.152462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:29.152481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:29.152519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:29.152762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:29.152930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402494606885561:10613]
2025-10-15T11:03:29.155078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:29.163917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:29.164155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:29.165359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:29.165679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:29.165687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:29.165694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:29.165701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:29.165707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:29.165713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:29.165720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:29.165727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:29.165734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:29.165740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:29.165746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:29.165753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.165759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.165765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.165811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:29.165916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:29.165963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:29.166009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:29.166053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:29.166097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:29.166138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:29.166179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:29.166221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:29.166264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:29.166306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:29.166348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.166390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.166429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.166465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:29.166523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:29.166578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:29.166628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:29.166671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:29.166722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:29.166764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:29.166814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:29.166864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:29.166911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:29.166957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:29.167003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:29.167052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:29.167100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:29.167143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:29.167197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:29.167258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:29.167307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:29.168345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:29.168422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:29.168475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:29.168527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:29.168570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.168620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.168664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.168714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.168756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.168805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.169281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:29.187717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:29.197941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:29.197981Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:29.197998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:29.198014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:29.198037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1154 [2:7561402494606885561:10613]
2025-10-15T11:03:29.198083Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:29.198136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:29.198148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:29.198159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:29.198169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:29.198214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:29.198235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:29.198255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:29.199444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.199459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.199473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.199484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:29.199764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:29.199781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.199913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.200086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.200305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:29.200372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402494606885556:10613]
2025-10-15T11:03:29.200386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402494606885556:10613]
2025-10-15T11:03:29.200397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402494606885556:10613]
2025-10-15T11:03:29.200440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:29.200505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:29.200668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:29.200683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:29.200785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402494606885556:10613]
2025-10-15T11:03:29.200802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:29.202837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1154
2025-10-15T11:03:29.202928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1154, pipe: [1:7561402487512229680:4077]
2025-10-15T11:03:29.202996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1154
2025-10-15T11:03:29.201698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:29.201721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:29.201731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:29.201752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:29.203498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402487512229630:2467], now have 1 active actors on pipe
2025-10-15T11:03:29.203539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402487512229680:4077], now have 1 active actors on pipe
2025-10-15T11:03:29.203559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402487512229693:3060], now have 1 active actors on pipe
2025-10-15T11:03:29.203615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:29.203632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:29.203699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:29.203726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:29.203742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:29.203751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:29.203784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:29.203822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:29.203877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:29.206466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:29.206500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:29.206565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:29.207702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e0c694-976b3cac-47b781ea-737553dc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:29.206948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1155 partition: 0 MaxSeqNo: 46 sessionId: src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0
2025-10-15T11:03:29.278079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0] Write session: try to update token
2025-10-15T11:03:29.278141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:29.322996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:29.323035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:29.323045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:29.323105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:29.323119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:29.323158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402494606885556:10613]
2025-10-15T11:03:29.323287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:29.323969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:29.326987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:29.335548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:29.359896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:29.368375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:29.370020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:29.370451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:29.500095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:29.500137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:29.500149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:29.500207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:29.500222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:29.500235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:29.500247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:29.500287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402494606885556:10613]
2025-10-15T11:03:29.500314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402494606885556:10613]
2025-10-15T11:03:29.500337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402494606885556:10613]
2025-10-15T11:03:29.500479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:29.500503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:29.500939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:29.500978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:29.501005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:29.505764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:29.516036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId: src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:29.581026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:29.681787Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:29.692434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:29.692484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:29.694483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:29.694600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402487512229680:4077]
2025-10-15T11:03:29.694676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:29.694688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:29.701621Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:29.705069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:29.705137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0] Write session will restart in 0.005287s
2025-10-15T11:03:29.705304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0] Write session: Do CDS request
2025-10-15T11:03:29.705346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:29.704210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1155 reason: error at write: Disconnected sessionId: src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0
2025-10-15T11:03:29.704619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1155 sessionId: src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0 is DEAD
2025-10-15T11:03:29.723415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:29.727584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:29.727624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1156
2025-10-15T11:03:29.731587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:29.731760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:29.731777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:29.731787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:29.733381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1156 sessionId:  describe result for acl check
2025-10-15T11:03:29.733498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:29.733508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:29.733518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:29.733536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402491807197211:3049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:29.736836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402491807197211:3049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:29.757720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402491807197211:3049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:29.796285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402491807197253:4077]
2025-10-15T11:03:29.808532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402491807197211:3049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:29.808581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402491807197211:3049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:29.808597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402491807197211:3049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:29.808625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:29.917297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:29.919857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:29.920616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:29.920631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:29.920669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:29.920901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:29.921068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402494606885832:10623]
2025-10-15T11:03:29.923072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:29.924261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:29.924457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:29.925658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:29.925961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:29.925969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:29.925974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:29.925981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:29.925988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:29.925995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:29.926001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:29.926007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:29.926013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:29.926018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:29.926024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:29.926030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.926037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.926043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.926086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:29.926184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:29.926228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:29.926270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:29.926310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:29.926353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:29.926394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:29.926434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:29.926474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:29.926516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:29.926556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:29.926597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.926636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.926675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.926714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:29.926773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:29.926822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:29.926873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:29.926916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:29.926962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:29.927006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:29.927054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:29.927095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:29.927142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:29.927198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:29.927248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:29.927293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:29.927342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:29.928598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:29.928671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:29.928717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:29.928770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:29.928811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:29.928862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:29.928903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:29.928967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:29.929011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.929060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:29.929104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.929156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:29.929199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.929246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:29.929708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:29.986745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:30.004746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:30.004797Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:30.004815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:30.004836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:30.004864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1155 [2:7561402494606885832:10623]
2025-10-15T11:03:30.004919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:30.004983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:30.005000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:30.005013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:30.005025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:30.005073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:30.005097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:30.005120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:30.006852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:30.006880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:30.006894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:30.006906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:30.007192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:30.007219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:30.008642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1155, pipe: [1:7561402491807197253:4077]
2025-10-15T11:03:30.008751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1155
2025-10-15T11:03:30.008825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1155
2025-10-15T11:03:30.008163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:30.008378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:30.008624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:30.008716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402491807197253:4077], now have 1 active actors on pipe
2025-10-15T11:03:30.008742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402491807197199:2467], now have 1 active actors on pipe
2025-10-15T11:03:30.008764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402491807197267:3049], now have 1 active actors on pipe
2025-10-15T11:03:30.008792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402494606885827:10623]
2025-10-15T11:03:30.008808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402494606885827:10623]
2025-10-15T11:03:30.008822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402494606885827:10623]
2025-10-15T11:03:30.008874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:30.008890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:30.008906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:30.008918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:30.008953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:30.009135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:30.009155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:30.009327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:30.009348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:30.009379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402494606885827:10623]
2025-10-15T11:03:30.009407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:30.009521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d906990-d6f82308-dd948fa6-2708ac76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:30.009553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:30.009571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:30.009582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:30.009619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:30.009665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:30.009750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:30.017683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1156 partition: 0 MaxSeqNo: 46 sessionId: src_id|1d906990-d6f82308-dd948fa6-2708ac76_0
2025-10-15T11:03:30.018673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cd8a22c-7b486abe-f95a3ff7-125ac753_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|1d906990-d6f82308-dd948fa6-2708ac76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:30.015468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:30.017212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:30.017242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:30.017322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:30.051994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d906990-d6f82308-dd948fa6-2708ac76_0] Write session: try to update token
2025-10-15T11:03:30.052059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d906990-d6f82308-dd948fa6-2708ac76_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:30.134584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:30.134640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:30.134660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:30.134777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:30.134801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:30.134829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:30.134848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:30.134903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402494606885827:10623]
2025-10-15T11:03:30.134952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402494606885827:10623]
2025-10-15T11:03:30.135002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402494606885827:10623]
2025-10-15T11:03:30.135183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:30.135259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:30.135320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:30.172786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:30.172843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:30.173921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:30.222667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId: src_id|1d906990-d6f82308-dd948fa6-2708ac76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:30.270736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:30.349941Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:30.351618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:30.351647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:30.351698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402494606885827:10623]
2025-10-15T11:03:30.351868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:30.351897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:30.352200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:30.353949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402491807197253:4077]
2025-10-15T11:03:30.354039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:30.354168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:30.354188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:30.355685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:30.365807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1156 reason: error at write: Disconnected sessionId: src_id|1d906990-d6f82308-dd948fa6-2708ac76_0
2025-10-15T11:03:30.366167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1156 sessionId: src_id|1d906990-d6f82308-dd948fa6-2708ac76_0 is DEAD
2025-10-15T11:03:30.367934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d906990-d6f82308-dd948fa6-2708ac76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:30.367966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d906990-d6f82308-dd948fa6-2708ac76_0] Write session will restart in 0.005997s
2025-10-15T11:03:30.368064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d906990-d6f82308-dd948fa6-2708ac76_0] Write session: Do CDS request
2025-10-15T11:03:30.368095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d906990-d6f82308-dd948fa6-2708ac76_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:30.392630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d906990-d6f82308-dd948fa6-2708ac76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:30.396656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:30.396691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1157
2025-10-15T11:03:30.397196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:30.397315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:30.397331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:30.397341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:30.399264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1157 sessionId:  describe result for acl check
2025-10-15T11:03:30.399394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:30.399406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:30.399417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:30.399434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402496102164797:3030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:30.402077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402496102164797:3030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:30.435974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402496102164797:3030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:30.455800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402496102164895:4077]
2025-10-15T11:03:30.462936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402496102164797:3030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:30.462984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402496102164797:3030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:30.463000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402496102164797:3030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:30.463033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:30.508662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:30.515739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:30.516659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:30.516693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:30.516737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:30.517005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:30.517219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402498901853387:10632]
2025-10-15T11:03:30.527416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:30.529227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:30.529444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:30.530382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:30.530620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:30.530625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:30.530630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:30.530635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:30.530640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:30.530646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:30.530651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:30.530656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:30.530660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:30.530665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:30.530671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:30.530676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:30.530681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:30.530687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:30.530720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:30.530807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:30.530844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:30.530878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:30.530909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:30.530944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:30.530980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:30.531014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:30.531048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:30.531083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:30.531118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:30.531163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:30.531197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:30.531231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:30.531260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:30.531310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:30.531378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:30.531436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:30.531492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:30.531549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:30.531599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:30.531689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:30.531746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:30.531806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:30.531842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:30.531880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:30.531913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:30.531952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:30.531985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:30.532023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:30.532057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:30.532095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:30.532127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:30.532168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:30.532199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:30.532238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:30.532270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:30.532309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:30.532341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:30.532381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:30.532412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:30.532449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:30.532805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:30.579865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:30.589617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:30.589681Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:30.589701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:30.589724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:30.589753Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1156 [2:7561402498901853387:10632]
2025-10-15T11:03:30.589813Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:30.589905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:30.589923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:30.589936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:30.589948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:30.590006Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:30.590033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:30.590059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:30.592263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:30.592295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:30.592311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:30.592324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:30.592648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:30.592668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:30.592828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:30.593035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:30.593286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:30.593364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402498901853382:10632]
2025-10-15T11:03:30.593381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402498901853382:10632]
2025-10-15T11:03:30.593394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402498901853382:10632]
2025-10-15T11:03:30.593430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:30.593500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:30.593516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:30.593521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:30.593528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:30.593720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:30.593739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:30.593792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402496102164783:2467], now have 1 active actors on pipe
2025-10-15T11:03:30.593820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402496102164927:3030], now have 1 active actors on pipe
2025-10-15T11:03:30.593843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402496102164895:4077], now have 1 active actors on pipe
2025-10-15T11:03:30.593968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402498901853382:10632]
2025-10-15T11:03:30.593991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:30.593645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1156
2025-10-15T11:03:30.593769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1156
2025-10-15T11:03:30.593829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1156, pipe: [1:7561402496102164895:4077]
2025-10-15T11:03:30.595474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:30.595919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:30.595954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:30.596028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b57baeb4-79d458-8bbb95a4-badd358c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:30.596059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:30.596078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:30.596089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:30.596122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:30.596158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:30.596204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:30.604157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:30.604198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:30.604276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:30.607873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d906990-d6f82308-dd948fa6-2708ac76_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|b57baeb4-79d458-8bbb95a4-badd358c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:30.605443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1157 partition: 0 MaxSeqNo: 46 sessionId: src_id|b57baeb4-79d458-8bbb95a4-badd358c_0
2025-10-15T11:03:30.657723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b57baeb4-79d458-8bbb95a4-badd358c_0] Write session: try to update token
2025-10-15T11:03:30.657810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b57baeb4-79d458-8bbb95a4-badd358c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:30.660325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:30.660360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:30.660397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402498901853382:10632]
2025-10-15T11:03:30.660517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:30.662974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:30.663786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:30.664490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:30.665611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:30.667236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:30.670415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:30.671040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:30.769201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:30.769233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:30.769243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:30.795175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:30.795212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:30.795225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:30.795235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:30.795274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402498901853382:10632]
2025-10-15T11:03:30.795298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402498901853382:10632]
2025-10-15T11:03:30.795321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402498901853382:10632]
2025-10-15T11:03:30.795474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:30.795496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:30.796680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:30.799275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:30.799314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:30.799341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:30.855516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId: src_id|b57baeb4-79d458-8bbb95a4-badd358c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:30.898288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:30.956079Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:30.958179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:30.958199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:30.959048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:30.959168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:30.959180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:30.959173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:30.959718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402496102164895:4077]
2025-10-15T11:03:30.980977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1157 reason: error at write: Disconnected sessionId: src_id|b57baeb4-79d458-8bbb95a4-badd358c_0
2025-10-15T11:03:30.981437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1157 sessionId: src_id|b57baeb4-79d458-8bbb95a4-badd358c_0 is DEAD
2025-10-15T11:03:30.984015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57baeb4-79d458-8bbb95a4-badd358c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:30.984048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57baeb4-79d458-8bbb95a4-badd358c_0] Write session will restart in 0.006222s
2025-10-15T11:03:30.984148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57baeb4-79d458-8bbb95a4-badd358c_0] Write session: Do CDS request
2025-10-15T11:03:30.984188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57baeb4-79d458-8bbb95a4-badd358c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:31.000541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b57baeb4-79d458-8bbb95a4-badd358c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:31.003460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:31.003492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1158
2025-10-15T11:03:31.003907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:31.004013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:31.004026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:31.004035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:31.008492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1158 sessionId:  describe result for acl check
2025-10-15T11:03:31.008604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:31.008615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:31.008625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:31.008641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402500397132350:3021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:31.011604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402500397132350:3021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:31.033826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402500397132350:3021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:31.048600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402500397132350:3021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:31.048652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402500397132350:3021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:31.048668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402500397132350:3021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:31.048699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:31.059553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402500397132481:4077]
2025-10-15T11:03:31.134910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:31.137123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:31.137925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:31.137953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:31.137995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:31.138237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:31.138436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402503196820939:10642]
2025-10-15T11:03:31.140477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:31.141685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:31.150547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:31.151829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:31.157517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:31.157545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:31.157550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:31.157557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:31.157563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:31.157569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:31.157575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:31.157582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:31.157589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:31.157596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:31.157602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:31.157608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.157615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.157621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.157670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:31.157772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:31.157818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:31.157864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:31.157914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:31.157961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:31.158004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:31.158045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:31.158088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:31.158135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:31.158180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:31.158223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.158268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.158311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.158354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:31.158418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:31.158475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:31.158528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:31.158575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:31.158631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:31.158676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:31.158727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:31.158770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:31.158823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:31.158867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:31.158918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:31.158961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:31.159013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:31.159058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:31.159125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:31.159171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:31.159222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:31.159265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:31.159319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:31.167434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:31.167551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:31.167606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.167661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.167706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.167764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.167808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.167860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.168328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:31.189833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:31.200800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:31.200843Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:31.200859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:31.200875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:31.200899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1157 [2:7561402503196820939:10642]
2025-10-15T11:03:31.200944Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:31.200994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:31.201007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:31.201019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:31.201030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:31.201075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:31.201094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:31.201114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:31.203128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.203154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.203176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.203186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:31.203430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:31.203446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.203569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.203729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.204576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1157, pipe: [1:7561402500397132481:4077]
2025-10-15T11:03:31.203936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:31.204007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402500397132481:4077], now have 1 active actors on pipe
2025-10-15T11:03:31.204027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402496102165041:2467], now have 1 active actors on pipe
2025-10-15T11:03:31.204045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402500397132440:3021], now have 1 active actors on pipe
2025-10-15T11:03:31.204064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402503196820934:10642]
2025-10-15T11:03:31.204078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402503196820934:10642]
2025-10-15T11:03:31.204090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402503196820934:10642]
2025-10-15T11:03:31.204128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:31.204188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:31.204343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:31.204689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1157
2025-10-15T11:03:31.204359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:31.204762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1157
2025-10-15T11:03:31.204526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402503196820934:10642]
2025-10-15T11:03:31.204543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:31.204703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:31.204716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:31.204727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:31.204749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:31.205088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:31.205118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:31.205188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|364f8438-23e30bc-3d07d210-db7aa64c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:31.205215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:31.205230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:31.205240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:31.205267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:31.205297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:31.205324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:31.207552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:31.207582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:31.207643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:31.208081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1158 partition: 0 MaxSeqNo: 46 sessionId: src_id|364f8438-23e30bc-3d07d210-db7aa64c_0
2025-10-15T11:03:31.208793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57baeb4-79d458-8bbb95a4-badd358c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|364f8438-23e30bc-3d07d210-db7aa64c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:31.239946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|364f8438-23e30bc-3d07d210-db7aa64c_0] Write session: try to update token
2025-10-15T11:03:31.239998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|364f8438-23e30bc-3d07d210-db7aa64c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:31.303824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:31.303857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:31.303868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:31.434068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:31.434112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:31.434125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:31.434184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:31.434203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:31.434217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:31.434229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:31.434265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402503196820934:10642]
2025-10-15T11:03:31.434290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402503196820934:10642]
2025-10-15T11:03:31.434316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402503196820934:10642]
2025-10-15T11:03:31.434590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:31.434636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:31.434677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:31.448311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:31.448365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:31.449457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:31.484581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId: src_id|364f8438-23e30bc-3d07d210-db7aa64c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:31.517807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:31.624379Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:31.626478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:31.626510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:31.626561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402503196820934:10642]
2025-10-15T11:03:31.626721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:31.626750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:31.626938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:31.628075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:31.631685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402500397132481:4077]
2025-10-15T11:03:31.631863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:31.632135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:31.652210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364f8438-23e30bc-3d07d210-db7aa64c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:31.652278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364f8438-23e30bc-3d07d210-db7aa64c_0] Write session will restart in 0.006075s
2025-10-15T11:03:31.652449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364f8438-23e30bc-3d07d210-db7aa64c_0] Write session: Do CDS request
2025-10-15T11:03:31.652493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364f8438-23e30bc-3d07d210-db7aa64c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:31.649758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1158 reason: status is not ok: tablet will be restarted right now sessionId: src_id|364f8438-23e30bc-3d07d210-db7aa64c_0
2025-10-15T11:03:31.650171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1158 sessionId: src_id|364f8438-23e30bc-3d07d210-db7aa64c_0 is DEAD
2025-10-15T11:03:31.680674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|364f8438-23e30bc-3d07d210-db7aa64c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:31.686205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:31.686254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1159
2025-10-15T11:03:31.691507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:31.691672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:31.691689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:31.691699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:31.696604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1159 sessionId:  describe result for acl check
2025-10-15T11:03:31.696740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:31.696753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:31.696764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:31.696789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402500397132633:3008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:31.703771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402500397132633:3008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:31.730988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402500397132633:3008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:31.743845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402500397132666:4077]
2025-10-15T11:03:31.783592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402500397132633:3008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:31.783641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402500397132633:3008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:31.783659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402500397132633:3008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:31.783693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:31.917534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:31.932302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:31.933314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:31.933345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:31.933389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:31.933659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:31.933854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402503196821215:10650]
2025-10-15T11:03:31.936369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:31.944188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:31.944471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:31.946082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:31.946442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:31.946452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:31.946461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:31.946468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:31.946476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:31.946483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:31.946491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:31.946498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:31.946505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:31.946521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:31.946529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:31.946536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.946545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.946553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.946606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:31.946744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:31.946798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:31.946853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:31.946900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:31.946951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:31.947002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:31.947050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:31.947108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:31.947157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:31.947207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:31.947255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.947304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.959526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.959633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:31.959728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:31.959801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:31.959890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:31.959958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:31.960020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:31.960069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:31.960128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:31.960181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:31.960234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:31.960283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:31.960364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:31.960423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:31.960484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:31.960534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:31.960590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:31.960643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:31.960701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:31.960751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:31.960812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:31.960864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:31.960922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:31.960969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.961032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:31.961081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.961143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:31.961193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.961250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:31.961844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:32.011661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:32.028079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:32.028131Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:32.028151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:32.028171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:32.028199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1158 [2:7561402503196821215:10650]
2025-10-15T11:03:32.028259Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:32.028328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:32.028343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:32.028357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:32.028369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:32.028423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:32.031173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1158, pipe: [1:7561402500397132666:4077]
2025-10-15T11:03:32.031286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1158
2025-10-15T11:03:32.031373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1158
2025-10-15T11:03:32.028447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:32.028481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:32.029909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:32.029929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:32.029943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:32.029958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:32.030255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:32.030275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:32.030433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:32.030645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:32.030892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:32.030976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402500397132666:4077], now have 1 active actors on pipe
2025-10-15T11:03:32.031003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402500397132730:3008], now have 1 active actors on pipe
2025-10-15T11:03:32.031029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402500397132618:2467], now have 1 active actors on pipe
2025-10-15T11:03:32.031068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402503196821210:10650]
2025-10-15T11:03:32.031086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402503196821210:10650]
2025-10-15T11:03:32.031101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402503196821210:10650]
2025-10-15T11:03:32.031171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:32.031185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:32.031197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:32.032237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:32.032353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:32.032570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:32.032588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:32.032671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:32.032697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:32.032841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402503196821210:10650]
2025-10-15T11:03:32.032876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:32.032910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:32.032959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a4e4df0-54ef9b52-db12798a-63477180_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:32.032998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:32.033018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:32.033029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:32.033075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:32.033122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:32.033269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:32.039637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:32.039686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:32.039783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:32.042521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1159 partition: 0 MaxSeqNo: 46 sessionId: src_id|8a4e4df0-54ef9b52-db12798a-63477180_0
2025-10-15T11:03:32.044461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364f8438-23e30bc-3d07d210-db7aa64c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8a4e4df0-54ef9b52-db12798a-63477180_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:32.103511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4e4df0-54ef9b52-db12798a-63477180_0] Write session: try to update token
2025-10-15T11:03:32.103568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4e4df0-54ef9b52-db12798a-63477180_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:32.232871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:32.232906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:32.232939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402503196821210:10650]
2025-10-15T11:03:32.233057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:32.233068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:32.233079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:32.233191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:32.234790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:32.235627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:32.244079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:32.245133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:32.257464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:32.267676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:32.306597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:32.306750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:32.306767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:32.306779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:32.306791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:32.306827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402503196821210:10650]
2025-10-15T11:03:32.306854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402503196821210:10650]
2025-10-15T11:03:32.306880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402503196821210:10650]
2025-10-15T11:03:32.307006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:32.307027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:32.308139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:32.311529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:32.311572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:32.311600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:32.321763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId: src_id|8a4e4df0-54ef9b52-db12798a-63477180_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:32.353899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:32.477488Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:32.483518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:32.483563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:32.486718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:32.487524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402500397132666:4077]
2025-10-15T11:03:32.487618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:32.487627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:32.489055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:32.531709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1159 reason: error at write: Disconnected sessionId: src_id|8a4e4df0-54ef9b52-db12798a-63477180_0
2025-10-15T11:03:32.531986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1159 sessionId: src_id|8a4e4df0-54ef9b52-db12798a-63477180_0 is DEAD
2025-10-15T11:03:32.535787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4e4df0-54ef9b52-db12798a-63477180_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:32.535816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4e4df0-54ef9b52-db12798a-63477180_0] Write session will restart in 0.005010s
2025-10-15T11:03:32.535909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4e4df0-54ef9b52-db12798a-63477180_0] Write session: Do CDS request
2025-10-15T11:03:32.535938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4e4df0-54ef9b52-db12798a-63477180_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:32.548453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4e4df0-54ef9b52-db12798a-63477180_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:32.549011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:32.549046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1160
2025-10-15T11:03:32.549407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:32.549510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:32.549524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:32.549533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:32.551075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1160 sessionId:  describe result for acl check
2025-10-15T11:03:32.551180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:32.551190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:32.551199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:32.551215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402504692100214:2982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:32.553708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402504692100214:2982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:32.560999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402504692100214:2982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:32.585523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402504692100259:4077]
2025-10-15T11:03:32.588622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402504692100214:2982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:32.588665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402504692100214:2982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:32.588682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402504692100214:2982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:32.588713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:32.695745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:32.706824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:32.707972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:32.707994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:32.708046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:32.708313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:32.708494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402507491788786:10662]
2025-10-15T11:03:32.711035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:32.712548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:32.712826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:32.714274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:32.714662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:32.714672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:32.714678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:32.714686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:32.714693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:32.714701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:32.714709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:32.714717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:32.714725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:32.714733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:32.714740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:32.714749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:32.714757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:32.714765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:32.714829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:32.714949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:32.715002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:32.715068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:32.715119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:32.715170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:32.715220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:32.715266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:32.715316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:32.715517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:32.715569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:32.715619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:32.715669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:32.715718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:32.715773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:32.715849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:32.715917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:32.715981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:32.716033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:32.716108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:32.716160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:32.716217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:32.716292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:32.716352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:32.716403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:32.716464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:32.716517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:32.716588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:32.716644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:32.716701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:32.716752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:32.716807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:32.716854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:32.716909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:32.716959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:32.717017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:32.717066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:32.717122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:32.717171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:32.717228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:32.717277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:32.717336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:32.717886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:32.745402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:32.754886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:32.755064Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:32.755104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:32.755125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:32.755154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1159 [2:7561402507491788786:10662]
2025-10-15T11:03:32.755211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:32.755280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:32.755297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:32.755310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:32.755322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:32.755395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:32.755420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:32.755445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:32.756933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:32.756960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:32.756974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:32.756987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:32.757256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:32.757282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:32.757434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:32.757648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:32.757886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:32.757972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402504692100265:2982], now have 1 active actors on pipe
2025-10-15T11:03:32.757995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402504692100259:4077], now have 1 active actors on pipe
2025-10-15T11:03:32.758018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402504692100197:2467], now have 1 active actors on pipe
2025-10-15T11:03:32.758045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402507491788781:10662]
2025-10-15T11:03:32.758060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402507491788781:10662]
2025-10-15T11:03:32.758075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402507491788781:10662]
2025-10-15T11:03:32.758114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:32.758190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:32.758304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:32.758317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:32.758329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:32.758381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:32.758401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:32.759375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:32.759415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:32.759462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402507491788781:10662]
2025-10-15T11:03:32.759493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:32.759643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:32.759651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:32.759679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:32.759698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:32.759709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:32.759749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:32.759800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:32.759915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:32.757804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1159
2025-10-15T11:03:32.757910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1159, pipe: [1:7561402504692100259:4077]
2025-10-15T11:03:32.757982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1159
2025-10-15T11:03:32.761261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:32.761294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:32.761368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:32.761762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1160 partition: 0 MaxSeqNo: 46 sessionId: src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0
2025-10-15T11:03:32.762740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4e4df0-54ef9b52-db12798a-63477180_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:32.788953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0] Write session: try to update token
2025-10-15T11:03:32.789005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:32.856105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:32.856142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:32.856154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:32.956554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:32.956588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:32.956601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:32.988153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId: src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:33.047199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:33.061124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:33.061157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:33.061170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:33.061181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:33.061214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402507491788781:10662]
2025-10-15T11:03:33.061241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402507491788781:10662]
2025-10-15T11:03:33.061267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402507491788781:10662]
2025-10-15T11:03:33.061440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:33.061464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:33.061512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:33.061525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:33.061537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:33.064063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:33.064106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:33.064134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:33.070895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:33.070943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:33.072001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:33.230862Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:33.233009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:33.233028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:33.233085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402507491788781:10662]
2025-10-15T11:03:33.233317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:33.233941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:33.234557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:33.234585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:33.245159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402504692100259:4077]
2025-10-15T11:03:33.245234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:33.251302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:33.248176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1160 reason: error at write: Disconnected sessionId: src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0
2025-10-15T11:03:33.251388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0] Write session will restart in 0.007533s
2025-10-15T11:03:33.248501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1160 sessionId: src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0 is DEAD
2025-10-15T11:03:33.251559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0] Write session: Do CDS request
2025-10-15T11:03:33.251591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:33.273018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:33.273660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:33.273702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1161
2025-10-15T11:03:33.276308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:33.276436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:33.276450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:33.276459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:33.278366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1161 sessionId:  describe result for acl check
2025-10-15T11:03:33.278482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:33.278494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:33.278503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:33.278519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402508987067780:2957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:33.281418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402508987067780:2957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:33.317037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402508987067780:2957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:33.336669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402508987067780:2957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:33.336718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402508987067780:2957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:33.336735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402508987067780:2957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:33.336765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:33.348020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402508987067870:4077]
2025-10-15T11:03:33.445893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:33.454434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:33.455451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:33.455474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:33.455522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:33.455813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:33.456009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402511786756346:10670]
2025-10-15T11:03:33.458250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:33.460390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:33.460653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:33.462272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:33.462717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:33.463402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:33.463504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:33.463556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:33.463602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:33.463658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:33.463704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:33.463752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:33.463799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:33.463844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:33.463892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:33.463938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:33.463983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:33.464025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:33.464118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:33.464327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:33.464539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:33.464681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:33.464819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:33.464954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:33.465089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:33.465225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:33.465361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:33.465502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:33.465643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:33.465778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:33.465913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:33.466050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:33.466193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:33.466368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:33.466545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:33.466709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:33.466864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:33.467043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:33.467217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:33.467386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:33.467561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:33.467802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:33.467954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:33.468107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:33.468259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:33.468411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:33.468556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:33.468701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:33.468851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:33.469005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:33.469159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:33.469305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:33.469446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:33.469590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:33.469739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:33.469882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:33.470033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:33.470178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:33.470321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:33.470467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:33.471248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:33.503313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:33.523720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:33.525099Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:33.525246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:33.525329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:33.525422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1160 [2:7561402511786756346:10670]
2025-10-15T11:03:33.525541Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:33.525700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:33.525817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:33.525905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:33.525974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:33.526073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:33.526189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:33.526275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:33.643727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:33.643767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:33.643783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:33.643795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:33.643956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:33.643970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:33.643981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:33.644181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:33.644201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:33.644350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:33.644544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:33.644771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:33.644846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402511786756341:10670]
2025-10-15T11:03:33.644860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402511786756341:10670]
2025-10-15T11:03:33.644874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402511786756341:10670]
2025-10-15T11:03:33.644924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:33.645002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:33.645187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:33.645204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:33.645326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402511786756341:10670]
2025-10-15T11:03:33.645344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:33.646045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:33.646088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:33.646098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:33.646124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:33.647003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402508987067769:2467], now have 1 active actors on pipe
2025-10-15T11:03:33.647031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402508987067850:2957], now have 1 active actors on pipe
2025-10-15T11:03:33.647052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402508987067870:4077], now have 1 active actors on pipe
2025-10-15T11:03:33.647960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1160, pipe: [1:7561402508987067870:4077]
2025-10-15T11:03:33.648093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1160
2025-10-15T11:03:33.648122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1160
2025-10-15T11:03:33.650307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:33.650540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:33.650728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:33.650918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:33.651012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:33.651078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:33.651164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:33.651286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:33.651437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:33.656275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:33.656319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:33.656409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:33.659282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1161 partition: 0 MaxSeqNo: 46 sessionId: src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0
2025-10-15T11:03:33.664091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028e77d-850fc950-2e5a4ec7-ae04e18b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:33.725811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0] Write session: try to update token
2025-10-15T11:03:33.725873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:33.745285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:33.745315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:33.745352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402511786756341:10670]
2025-10-15T11:03:33.745459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:33.745473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:33.745484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:33.745544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:33.745872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:33.751470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:33.752717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:33.754184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:33.759185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:33.762867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:33.763452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:33.896952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:33.896996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:33.897010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:33.897022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:33.897066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402511786756341:10670]
2025-10-15T11:03:33.897095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402511786756341:10670]
2025-10-15T11:03:33.897118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402511786756341:10670]
2025-10-15T11:03:33.897281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:33.897294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:33.897306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:33.897354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:33.897377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:33.898382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:33.903680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:33.903756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:33.903800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:33.923643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId: src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:33.946487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:34.059776Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:34.061894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:34.061946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:34.063005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:34.063036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:34.063489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:34.063729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402508987067870:4077]
2025-10-15T11:03:34.063117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:34.126366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:34.126479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0] Write session will restart in 0.006292s
2025-10-15T11:03:34.126676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0] Write session: Do CDS request
2025-10-15T11:03:34.126729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:34.124342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1161 reason: error at write: Disconnected sessionId: src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0
2025-10-15T11:03:34.124677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1161 sessionId: src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0 is DEAD
2025-10-15T11:03:34.139409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:34.139449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1162
2025-10-15T11:03:34.140926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:34.144537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:34.144694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:34.144710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:34.144722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:34.148869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1162 sessionId:  describe result for acl check
2025-10-15T11:03:34.149003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:34.149015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:34.149024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:34.149041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402513282035385:2952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:34.152970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402513282035385:2952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:34.164515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402513282035405:4077]
2025-10-15T11:03:34.179213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402513282035385:2952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:34.207478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402513282035385:2952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:34.207525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402513282035385:2952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:34.207544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402513282035385:2952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:34.207579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:34.255017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:34.261852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:34.262805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:34.262825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:34.262871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:34.263170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:34.263380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402516081723921:10682]
2025-10-15T11:03:34.265664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:34.267103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:34.267330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:34.268714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:34.269049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:34.269057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:34.269065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:34.269072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:34.269079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:34.269086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:34.269094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:34.269101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:34.269108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:34.269116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:34.269123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:34.269130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:34.269137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:34.269144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:34.269193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:34.269311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:34.269362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:34.269413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:34.269463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:34.269515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:34.269562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:34.269611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:34.269660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:34.269708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:34.269754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:34.269802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:34.269850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:34.269897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:34.269945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:34.270015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:34.270081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:34.270140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:34.270192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:34.270249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:34.270297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:34.270353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:34.270404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:34.270465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:34.270518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:34.270577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:34.270625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:34.270682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:34.270729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:34.270785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:34.270837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:34.270893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:34.270939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:34.271016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:34.271068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:34.271127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:34.271173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:34.271231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:34.271281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:34.271336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:34.273242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:34.273339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:34.273890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:34.300782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:34.380922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:34.381290Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:34.381313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:34.381333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:34.381358Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1161 [2:7561402516081723921:10682]
2025-10-15T11:03:34.381412Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:34.381472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:34.381487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:34.381499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:34.381510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:34.381560Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:34.381582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:34.381604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:34.383974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:34.383993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:34.384008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:34.384020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:34.385356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1161
2025-10-15T11:03:34.385455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1161
2025-10-15T11:03:34.385529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1161, pipe: [1:7561402513282035405:4077]
2025-10-15T11:03:34.387836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:34.387877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:34.388022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:34.388228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:34.388456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:34.388499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402513282035405:4077], now have 1 active actors on pipe
2025-10-15T11:03:34.388525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402513282035350:2467], now have 1 active actors on pipe
2025-10-15T11:03:34.388548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402513282035517:2952], now have 1 active actors on pipe
2025-10-15T11:03:34.388617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:34.388641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:34.388722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402516081723916:10682]
2025-10-15T11:03:34.388736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402516081723916:10682]
2025-10-15T11:03:34.388751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402516081723916:10682]
2025-10-15T11:03:34.388790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:34.388891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:34.388924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:34.388942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:34.388953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:34.388990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:34.389033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:34.389084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:34.389263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:34.389280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:34.389408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:34.389460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402516081723916:10682]
2025-10-15T11:03:34.389479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:34.389777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:34.389789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:34.389801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:34.389824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:34.402750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:34.402801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:34.402893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:34.403440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1162 partition: 0 MaxSeqNo: 46 sessionId: src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0
2025-10-15T11:03:34.404265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c0f1ab3-1079d695-d831019-6c0668ae_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:34.442667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0] Write session: try to update token
2025-10-15T11:03:34.442728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:34.528394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:34.528430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:34.528442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:34.528504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:34.528519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:34.528535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:34.528546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:34.528579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402516081723916:10682]
2025-10-15T11:03:34.528606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402516081723916:10682]
2025-10-15T11:03:34.528634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402516081723916:10682]
2025-10-15T11:03:34.528772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:34.528794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:34.528842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:34.528877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:34.528910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:34.529754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:34.672534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId: src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:34.721841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:34.741634Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:34.743778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:34.743817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:34.749652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402513282035405:4077]
2025-10-15T11:03:34.749749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:34.749883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:34.749895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:34.754278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1162 reason: error at write: Disconnected sessionId: src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0
2025-10-15T11:03:34.754643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1162 sessionId: src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0 is DEAD
2025-10-15T11:03:34.760512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:34.760556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0] Write session will restart in 0.007146s
2025-10-15T11:03:34.760661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0] Write session: Do CDS request
2025-10-15T11:03:34.760697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:34.761175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:34.778028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:34.804149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:34.804188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1163
2025-10-15T11:03:34.804648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:34.804780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:34.804795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:34.804806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:34.806287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1163 sessionId:  describe result for acl check
2025-10-15T11:03:34.806407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:34.806419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:34.806429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:34.806446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402513282035650:2933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:34.809370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402513282035650:2933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:34.819649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402513282035650:2933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:34.837427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402513282035650:2933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:34.837479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402513282035650:2933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:34.837499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402513282035650:2933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:34.837534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:34.847332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402513282035686:4077]
2025-10-15T11:03:34.988860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:35.000273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:35.001252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:35.001273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:35.001319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:35.001609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:35.001800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402516081724199:10690]
2025-10-15T11:03:35.009739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:35.011187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:35.011458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:35.012811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:35.013154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:35.013164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:35.013172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:35.013180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:35.013186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:35.013194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:35.013201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:35.013208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:35.013215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:35.013223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:35.013230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:35.013237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.013245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.013252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.013305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:35.013437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:35.013498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:35.013548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:35.013605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:35.013664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:35.013713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:35.013764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:35.013813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:35.013863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:35.013912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:35.013962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.014008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.014054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.014100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:35.014170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:35.014231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:35.014292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:35.015566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:35.015648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:35.015701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:35.015762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:35.015815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:35.015872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:35.015921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:35.015980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:35.016030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:35.016088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:35.016134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:35.016192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:35.016243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:35.016310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:35.016372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:35.016429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:35.016482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:35.016539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:35.016587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.016645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.016695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.016753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.016801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.016866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.017424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:35.067819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:35.079497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:35.079551Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:35.079569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:35.079591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:35.079618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1162 [2:7561402516081724199:10690]
2025-10-15T11:03:35.079675Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:35.079736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:35.079752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:35.079767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:35.079779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:35.079832Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:35.079864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:35.079888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:35.081029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.081057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.081072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.081085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:35.082456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1162
2025-10-15T11:03:35.082552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1162
2025-10-15T11:03:35.082618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1162, pipe: [1:7561402513282035686:4077]
2025-10-15T11:03:35.081363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:35.081388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.081541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.081741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.082013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:35.082094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402513282035684:2933], now have 1 active actors on pipe
2025-10-15T11:03:35.082120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402513282035640:2467], now have 1 active actors on pipe
2025-10-15T11:03:35.082143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402513282035686:4077], now have 1 active actors on pipe
2025-10-15T11:03:35.082170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402516081724193:10690]
2025-10-15T11:03:35.082186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402516081724193:10690]
2025-10-15T11:03:35.082199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402516081724193:10690]
2025-10-15T11:03:35.082236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:35.082311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:35.082489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:35.082507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:35.082629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402516081724193:10690]
2025-10-15T11:03:35.082648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:35.082783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:35.082797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:35.082807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:35.082832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:35.085277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:35.085315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:35.085414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:35.085450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:35.085481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:35.085493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:35.085533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:35.085588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:35.085635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:35.091013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:35.091060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:35.091146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:35.092457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1163 partition: 0 MaxSeqNo: 46 sessionId: src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0
2025-10-15T11:03:35.099620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350a670f-e54dae6a-b7e20c54-999da6ee_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:35.163074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0] Write session: try to update token
2025-10-15T11:03:35.163139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:35.359099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:35.359144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:35.359158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:35.359292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:35.359309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:35.359326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:35.359338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:35.363677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402516081724193:10690]
2025-10-15T11:03:35.363729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402516081724193:10690]
2025-10-15T11:03:35.363758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402516081724193:10690]
2025-10-15T11:03:35.365834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:35.365888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:35.365918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:35.386158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:35.386217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:35.394091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:35.405843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId: src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:35.429092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:35.547220Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:35.548868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:35.548898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:35.548949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402516081724193:10690]
2025-10-15T11:03:35.549081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:35.549106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:35.549134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:35.549965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:35.555522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:35.558973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1163 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0
2025-10-15T11:03:35.559316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1163 sessionId: src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0 is DEAD
2025-10-15T11:03:35.559465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:35.559631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402513282035686:4077]
2025-10-15T11:03:35.561396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:35.561432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0] Write session will restart in 0.007961s
2025-10-15T11:03:35.561535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0] Write session: Do CDS request
2025-10-15T11:03:35.561565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:35.594982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:35.598589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:35.598627Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1164
2025-10-15T11:03:35.603704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:35.603870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:35.603888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:35.603899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:35.605257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1164 sessionId:  describe result for acl check
2025-10-15T11:03:35.605376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:35.605389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:35.605398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:35.605417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402517577003243:2920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:35.608165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402517577003243:2920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:35.621111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402517577003243:2920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:35.648749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402517577003243:2920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:35.648800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402517577003243:2920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:35.648820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402517577003243:2920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:35.648851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:35.663479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402517577003348:4077]
2025-10-15T11:03:35.743570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:35.745022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:35.745855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:35.745876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:35.745925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:35.746176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:35.746376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402520376691774:10695]
2025-10-15T11:03:35.748549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:35.756357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:35.756656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:35.758711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:35.759084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:35.759092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:35.759100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:35.759108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:35.759116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:35.759122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:35.759129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:35.759135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:35.759142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:35.759149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:35.759155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:35.759161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.759169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.759176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.759222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:35.759335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:35.759400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:35.759447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:35.759491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:35.759536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:35.759584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:35.759629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:35.759674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:35.759724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:35.759768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:35.759812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.759856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.759901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.759946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:35.760007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:35.760062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:35.760113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:35.760158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:35.760210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:35.760255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:35.760310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:35.760356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:35.760410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:35.760453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:35.760507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:35.760553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:35.760607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:35.760650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:35.760703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:35.760750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:35.760800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:35.760844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:35.760897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:35.760943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:35.760997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:35.761041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.761096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.761141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.761195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.761241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.761292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.762946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:35.790312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:35.808964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:35.809013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:35.809029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:35.809048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:35.809074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1163 [2:7561402520376691774:10695]
2025-10-15T11:03:35.809123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:35.809186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:35.809200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:35.809213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:35.809224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:35.809275Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:35.809297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:35.809318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:35.815431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.815487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.815503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.815514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:35.815836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:35.815853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:35.815990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:35.816172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:35.816400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:35.816492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402520376691769:10695]
2025-10-15T11:03:35.816509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402520376691769:10695]
2025-10-15T11:03:35.816524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402520376691769:10695]
2025-10-15T11:03:35.816563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:35.816641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:35.816817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:35.816836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:35.816966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402520376691769:10695]
2025-10-15T11:03:35.816985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:35.817957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:35.817981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:35.817993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:35.818020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:35.820180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1163, pipe: [1:7561402517577003348:4077]
2025-10-15T11:03:35.820293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1163
2025-10-15T11:03:35.820293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1163
2025-10-15T11:03:35.820569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402517577003348:4077], now have 1 active actors on pipe
2025-10-15T11:03:35.820611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402517577003309:2920], now have 1 active actors on pipe
2025-10-15T11:03:35.820641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402517577003228:2467], now have 1 active actors on pipe
2025-10-15T11:03:35.820831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:35.820861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:35.820952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:35.820989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:35.821014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:35.821033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:35.821076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:35.821122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:35.821171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:35.828566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:35.828607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:35.828694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:35.834004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1164 partition: 0 MaxSeqNo: 46 sessionId: src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0
2025-10-15T11:03:35.835005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3e2c4f1-d9e5a428-b56ece78-da1bd1cc_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:35.902500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0] Write session: try to update token
2025-10-15T11:03:35.902565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:35.908235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:35.908270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:35.908284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:35.974212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:35.974257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:35.974273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:35.974284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:35.974322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402520376691769:10695]
2025-10-15T11:03:35.974350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402520376691769:10695]
2025-10-15T11:03:35.974377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402520376691769:10695]
2025-10-15T11:03:35.974546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:35.974570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:35.974977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:35.975016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:35.975044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:35.987849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:36.095578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId: src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:36.148480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:36.160311Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:36.170009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:36.170065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:36.173863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402517577003348:4077]
2025-10-15T11:03:36.173998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:36.174013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:36.174696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:36.182832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1164 reason: error at write: Disconnected sessionId: src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0
2025-10-15T11:03:36.183229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1164 sessionId: src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0 is DEAD
2025-10-15T11:03:36.183688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:36.183733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0] Write session will restart in 0.006045s
2025-10-15T11:03:36.183834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0] Write session: Do CDS request
2025-10-15T11:03:36.183984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:36.194544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:36.194586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1165
2025-10-15T11:03:36.200186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:36.201027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:36.201199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:36.201217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:36.201228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:36.203228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1165 sessionId:  describe result for acl check
2025-10-15T11:03:36.203646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:36.203680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:36.203704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:36.203753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402521871970793:2915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:36.207620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402521871970793:2915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:36.208256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:36.220474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402521871970793:2915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:36.247271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402521871970793:2915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:36.247324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402521871970793:2915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:36.247342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402521871970793:2915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:36.247389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:36.274482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402521871970839:4077]
2025-10-15T11:03:36.410240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:36.417001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:36.417954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:36.417974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:36.418021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:36.418278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:36.418467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402524671659338:10705]
2025-10-15T11:03:36.421177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:36.423951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:36.424187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:36.425748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:36.426109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:36.426118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:36.426125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:36.426133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:36.426141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:36.426149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:36.426157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:36.426164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:36.426171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:36.426178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:36.426185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:36.426193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:36.426200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:36.426207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:36.426257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:36.426382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:36.426433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:36.426481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:36.426531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:36.426581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:36.426626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:36.426679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:36.426727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:36.426779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:36.426830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:36.426913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:36.426962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:36.427008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:36.427053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:36.427127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:36.427191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:36.427248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:36.427302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:36.427379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:36.427428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:36.438431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:36.438558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:36.438642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:36.438697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:36.438759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:36.438813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:36.438904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:36.438957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:36.439015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:36.439084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:36.439143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:36.439193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:36.439253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:36.439306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:36.439378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:36.439429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:36.439487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:36.439537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:36.439593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:36.439641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:36.439703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:36.440272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:36.482960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:36.499987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:36.500041Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:36.500059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:36.500079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:36.500105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1164 [2:7561402524671659338:10705]
2025-10-15T11:03:36.500161Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:36.500222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:36.500239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:36.500252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:36.500264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:36.500320Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:36.500343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:36.500368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:36.501992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:36.502008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:36.502024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:36.502036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:36.502326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:36.502346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:36.502494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:36.502688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:36.502933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:36.503004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402524671659333:10705]
2025-10-15T11:03:36.503020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402524671659333:10705]
2025-10-15T11:03:36.503034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402524671659333:10705]
2025-10-15T11:03:36.503223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:36.503234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:36.503245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:36.504339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1164, pipe: [1:7561402521871970839:4077]
2025-10-15T11:03:36.504454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1164
2025-10-15T11:03:36.504530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1164
2025-10-15T11:03:36.504687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:36.504790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:36.504984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:36.505002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:36.505207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402521871970839:4077], now have 1 active actors on pipe
2025-10-15T11:03:36.505241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402521871970828:2915], now have 1 active actors on pipe
2025-10-15T11:03:36.505266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402521871970784:2467], now have 1 active actors on pipe
2025-10-15T11:03:36.505396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402524671659333:10705]
2025-10-15T11:03:36.505428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:36.505765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:36.507786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:36.507823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:36.507923Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:36.507959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:36.507980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:36.507992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:36.508033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:36.508091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:36.508149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:36.512573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:36.512617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:36.512703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:36.513182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1165 partition: 0 MaxSeqNo: 46 sessionId: src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0
2025-10-15T11:03:36.514411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|725867f6-18ba14ce-d899e1c3-fb474b95_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:36.589885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0] Write session: try to update token
2025-10-15T11:03:36.589942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:36.602125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:36.602156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:36.602170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:36.675168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T11:03:36.675229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-15T11:03:36.847866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId: src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:36.865358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:36.865394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:36.865409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:36.865421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:36.865456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402524671659333:10705]
2025-10-15T11:03:36.865482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402524671659333:10705]
2025-10-15T11:03:36.865507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402524671659333:10705]
2025-10-15T11:03:36.865644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:36.865684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:36.865714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:36.865781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:36.865794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:36.865805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:36.865848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:36.865868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:36.867011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:36.892672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:37.037106Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:37.048752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:37.048796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:37.048854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:37.048866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:37.048903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402524671659333:10705]
2025-10-15T11:03:37.051607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:37.052446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:37.056669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402521871970839:4077]
2025-10-15T11:03:37.056764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:37.059492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:37.059552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-15T11:03:37.102702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1165 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0
2025-10-15T11:03:37.103019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1165 sessionId: src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0 is DEAD
2025-10-15T11:03:37.113114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:37.113163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0] Write session will restart in 0.008794s
2025-10-15T11:03:37.113271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0] Write session: Do CDS request
2025-10-15T11:03:37.113308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:37.140190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:37.156178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:37.156223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1166
2025-10-15T11:03:37.163405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:37.163599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:37.163618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:37.163630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:37.163707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402526166938400:4077]
2025-10-15T11:03:37.169789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1166 sessionId:  describe result for acl check
2025-10-15T11:03:37.169924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:37.169937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:37.169947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:37.169964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402526166938404:2885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:37.173314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402526166938404:2885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:37.198470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402526166938404:2885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:37.231692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402526166938404:2885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:37.231745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402526166938404:2885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:37.231766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402526166938404:2885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:37.231801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:37.383734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:37.388754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:37.389645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:37.389665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:37.389710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:37.389977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:37.390169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402528966626920:10717]
2025-10-15T11:03:37.392407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:37.393838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:37.394052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:37.395455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:37.395817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:37.395844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:37.395850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:37.395857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:37.395865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:37.395871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:37.395878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:37.395885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:37.395892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:37.395898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:37.395906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:37.395914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:37.395920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:37.395926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:37.395975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:37.396085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:37.396136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:37.396184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:37.396231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:37.396280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:37.396324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:37.396370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:37.396413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:37.396463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:37.396515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:37.396561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:37.396607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:37.396655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:37.396703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:37.396786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:37.396847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:37.396909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:37.396960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:37.397018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:37.397066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:37.397125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:37.397175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:37.397234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:37.397282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:37.397340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:37.397388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:37.397445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:37.397494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:37.397548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:37.397596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:37.397655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:37.397702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:37.397761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:37.397812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:37.397869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:37.397919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:37.397973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:37.398023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:37.398076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:37.398125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:37.398181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:37.398706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:37.427307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:37.437937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:37.437989Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:37.438006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:37.438025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:37.438052Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1165 [2:7561402528966626920:10717]
2025-10-15T11:03:37.438105Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:37.438162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:37.438176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:37.438188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:37.438199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:37.438255Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:37.438279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:37.438300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:37.459587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:37.459621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:37.459630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:37.459640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:37.459929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:37.459946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:37.460073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:37.460237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:37.460445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:37.460518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402528966626915:10717]
2025-10-15T11:03:37.460531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402528966626915:10717]
2025-10-15T11:03:37.460543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402528966626915:10717]
2025-10-15T11:03:37.460584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:37.460658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:37.460842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:37.460858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:37.460986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402528966626915:10717]
2025-10-15T11:03:37.461006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:37.462405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:37.462429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:37.462442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:37.462465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:37.463523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402526166938469:2885], now have 1 active actors on pipe
2025-10-15T11:03:37.463560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402526166938400:4077], now have 1 active actors on pipe
2025-10-15T11:03:37.463582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402526166938387:2467], now have 1 active actors on pipe
2025-10-15T11:03:37.467093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1165
2025-10-15T11:03:37.467180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1165, pipe: [1:7561402526166938400:4077]
2025-10-15T11:03:37.467272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1165
2025-10-15T11:03:37.469056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:37.469100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:37.469228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68999507-3e06d9e9-e1572300-827e06f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:37.469267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:37.469286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:37.469298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:37.469338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:37.469389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:37.469548Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 93815374 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T11:03:37.469641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:37.470637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 23 DataSize: 93815374 UsedReserveSize: 0
2025-10-15T11:03:37.470781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T11:03:37.472111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:37.472145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:37.472218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:37.475808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1166 partition: 0 MaxSeqNo: 46 sessionId: src_id|68999507-3e06d9e9-e1572300-827e06f7_0
2025-10-15T11:03:37.480173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2718371-d9f78af7-4a3d52f3-7ff7c60b_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|68999507-3e06d9e9-e1572300-827e06f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:37.539553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:37.539589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:37.539600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:37.567300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68999507-3e06d9e9-e1572300-827e06f7_0] Write session: try to update token
2025-10-15T11:03:37.567374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68999507-3e06d9e9-e1572300-827e06f7_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:37.594801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:37.594843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:37.594857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:37.594869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:37.594901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402528966626915:10717]
2025-10-15T11:03:37.594926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402528966626915:10717]
2025-10-15T11:03:37.594951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402528966626915:10717]
2025-10-15T11:03:37.595061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:37.595090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:37.595096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:37.595117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:37.595118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:37.616641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:37.735883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId: src_id|68999507-3e06d9e9-e1572300-827e06f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:37.757430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:37.792099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:37.804922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:37.804967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:37.807546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:37.807587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:37.807846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402526166938400:4077]
2025-10-15T11:03:37.807956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:37.809613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:37.881299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1166 reason: error at write: Disconnected sessionId: src_id|68999507-3e06d9e9-e1572300-827e06f7_0
2025-10-15T11:03:37.881644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1166 sessionId: src_id|68999507-3e06d9e9-e1572300-827e06f7_0 is DEAD
2025-10-15T11:03:37.887206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68999507-3e06d9e9-e1572300-827e06f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:37.887249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68999507-3e06d9e9-e1572300-827e06f7_0] Write session will restart in 0.008222s
2025-10-15T11:03:37.887371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68999507-3e06d9e9-e1572300-827e06f7_0] Write session: Do CDS request
2025-10-15T11:03:37.887404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68999507-3e06d9e9-e1572300-827e06f7_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:37.905322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402526166938697:4077]
2025-10-15T11:03:37.906710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:37.906741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1167
2025-10-15T11:03:37.907686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68999507-3e06d9e9-e1572300-827e06f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:37.911506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:37.911669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:37.911685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:37.911696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:37.913094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1167 sessionId:  describe result for acl check
2025-10-15T11:03:37.913206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:37.913216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:37.913225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:37.913240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402526166938709:2876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:37.917096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402526166938709:2876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:37.934702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402526166938709:2876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:37.955766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402526166938709:2876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:37.955814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402526166938709:2876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:37.955832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402526166938709:2876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:37.955867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:37.995771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:38.013179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:38.014133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:38.014170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:38.014216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:38.014501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:38.014696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402533261594500:10728]
2025-10-15T11:03:38.017898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:38.023022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:38.023340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:38.024723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:38.025113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:38.025135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:38.025142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:38.025151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:38.025158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:38.025166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:38.025174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:38.025181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:38.025189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:38.025196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:38.025205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:38.025213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.025221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.025229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.025280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:38.025403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:38.025454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:38.025516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:38.025570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:38.025627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:38.025681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:38.025738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:38.025795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:38.025849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:38.025904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:38.025959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.026014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.026070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.026125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:38.026205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:38.026276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:38.026340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:38.026398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:38.026461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:38.026519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:38.026582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:38.026640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:38.026702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:38.026800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:38.027136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:38.027206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:38.027273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:38.027329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:38.027408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:38.027481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:38.027543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:38.027597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:38.027659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:38.027712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:38.027776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:38.027831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.027892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.027942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.028005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.028055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.028118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.028663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:38.053019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:38.066889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:38.067173Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:38.067202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:38.067224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:38.067253Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1166 [2:7561402533261594500:10728]
2025-10-15T11:03:38.067315Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:38.067407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:38.067422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:38.067436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:38.067449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:38.067505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:38.067531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:38.067555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:38.068625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.068644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.068659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.068671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:38.068944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:38.068963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.069119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.069322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.069567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:38.069640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402528966627198:10728]
2025-10-15T11:03:38.069657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402528966627198:10728]
2025-10-15T11:03:38.069671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402528966627198:10728]
2025-10-15T11:03:38.069713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:38.069795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:38.069997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:38.070017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:38.070144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402528966627198:10728]
2025-10-15T11:03:38.070165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:38.071432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:38.071457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:38.071470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:38.071495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:38.073708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402526166938850:2876], now have 1 active actors on pipe
2025-10-15T11:03:38.073750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402526166938670:2467], now have 1 active actors on pipe
2025-10-15T11:03:38.073773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402526166938697:4077], now have 1 active actors on pipe
2025-10-15T11:03:38.074331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1166
2025-10-15T11:03:38.074440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1166
2025-10-15T11:03:38.074512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1166, pipe: [1:7561402526166938697:4077]
2025-10-15T11:03:38.082327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:38.082379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:38.082488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:38.082527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:38.082547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:38.082559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:38.082600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:38.082651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:38.082710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:38.087924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:38.087972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:38.088060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:38.088395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1167 partition: 0 MaxSeqNo: 46 sessionId: src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0
2025-10-15T11:03:38.090217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68999507-3e06d9e9-e1572300-827e06f7_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:38.158555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0] Write session: try to update token
2025-10-15T11:03:38.158616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:38.169528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:38.169563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:38.169576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:38.300805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:38.300846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:38.300863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:38.300875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:38.300914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402528966627198:10728]
2025-10-15T11:03:38.300943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402528966627198:10728]
2025-10-15T11:03:38.300969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402528966627198:10728]
2025-10-15T11:03:38.301141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:38.301154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:38.301167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:38.301279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:38.301300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:38.302411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:38.304856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:38.304939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:38.304993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:38.387642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId: src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:38.411041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:38.562182Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:38.583691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:38.583754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:38.583828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:38.583843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:38.583889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402528966627198:10728]
2025-10-15T11:03:38.587704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:38.587869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402526166938697:4077]
2025-10-15T11:03:38.587947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:38.587958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:38.586062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:38.587280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:38.670926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1167 reason: error at write: Disconnected sessionId: src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0
2025-10-15T11:03:38.672656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:38.672695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0] Write session will restart in 0.005079s
2025-10-15T11:03:38.672802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0] Write session: Do CDS request
2025-10-15T11:03:38.672832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:38.677069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1167 sessionId: src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0 is DEAD
2025-10-15T11:03:38.692165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:38.690931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402530461906287:4077]
2025-10-15T11:03:38.691030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:38.691045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1168
2025-10-15T11:03:38.692783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:38.692916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:38.692932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:38.692944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:38.694380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1168 sessionId:  describe result for acl check
2025-10-15T11:03:38.694488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:38.694500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:38.694509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:38.694527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402530461906290:2863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:38.697442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402530461906290:2863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:38.721384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402530461906290:2863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:38.770448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402530461906290:2863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:38.770496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402530461906290:2863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:38.770517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402530461906290:2863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:38.770550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1168 sessionId:  partition: 0 expectedGeneration: (NULL)
E1015 11:03:38.793425997  821271 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-15T11:03:38.824058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:38.834444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:38.835430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:38.835451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:38.835501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:38.835781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:38.835978Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402533261594764:10735]
2025-10-15T11:03:38.838475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:38.840362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:38.840587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:38.841545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:38.841784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:38.841789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:38.841794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:38.841799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:38.841804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:38.841809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:38.841813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:38.841821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:38.841828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:38.841836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:38.841842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:38.841851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.841859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.841864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.841902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:38.841997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:38.842034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:38.842072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:38.842104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:38.842140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:38.842173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:38.842207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:38.842243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:38.842283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:38.842322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:38.842364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.842399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.842435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.842464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:38.842530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:38.842584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:38.842625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:38.842659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:38.842700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:38.842746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:38.842785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:38.842819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:38.842865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:38.842906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:38.842946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:38.842980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:38.843026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:38.843072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:38.843127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:38.843177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:38.843230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:38.843274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:38.843329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:38.843510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:38.843575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:38.843625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.843680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.843727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.843787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.843848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.843939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.844462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:38.869747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:38.879036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:38.879095Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:38.879115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:38.879137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:38.879166Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1167 [2:7561402533261594764:10735]
2025-10-15T11:03:38.879227Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:38.879299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:38.879317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:38.879332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:38.879726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:38.879799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:38.879826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:38.879852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:38.903022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.904315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1167
2025-10-15T11:03:38.904404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1167, pipe: [1:7561402530461906287:4077]
2025-10-15T11:03:38.904478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1167
2025-10-15T11:03:38.903327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.903377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.903388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:38.903653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:38.903670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:38.903800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:38.903971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:38.904183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:38.904265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402530461906422:2863], now have 1 active actors on pipe
2025-10-15T11:03:38.904288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402530461906287:4077], now have 1 active actors on pipe
2025-10-15T11:03:38.904311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402530461906255:2467], now have 1 active actors on pipe
2025-10-15T11:03:38.904335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402533261594754:10735]
2025-10-15T11:03:38.904350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402533261594754:10735]
2025-10-15T11:03:38.904363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402533261594754:10735]
2025-10-15T11:03:38.904407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:38.904478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:38.904652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:38.904656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:38.904665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:38.904676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:38.904677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:38.904805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402533261594754:10735]
2025-10-15T11:03:38.904834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:38.904891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:38.904912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:38.905064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:38.905096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:38.905113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:38.905123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:38.905140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:38.905160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:38.905208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:38.905282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:38.914182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:38.914236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:38.914331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:38.917504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f37a861d-4c54fc9d-21bef30c-d99551ef_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:38.916254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1168 partition: 0 MaxSeqNo: 46 sessionId: src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0
2025-10-15T11:03:38.970144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0] Write session: try to update token
2025-10-15T11:03:38.970205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:38.983655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:38.983692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:38.983704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:39.047995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:39.048036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:39.048052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:39.048063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:39.048102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402533261594754:10735]
2025-10-15T11:03:39.048133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402533261594754:10735]
2025-10-15T11:03:39.048159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402533261594754:10735]
2025-10-15T11:03:39.048283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:39.048306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:39.048325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:39.048329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:39.048354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:39.080343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:39.157347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId: src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:39.198586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:39.317130Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:39.328186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:39.328239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:39.330975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:39.333273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:39.331024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:39.332553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402530461906287:4077]
2025-10-15T11:03:39.332685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:39.409420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1168 reason: error at write: Disconnected sessionId: src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0
2025-10-15T11:03:39.409779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1168 sessionId: src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0 is DEAD
2025-10-15T11:03:39.415634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:39.415702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0] Write session will restart in 0.008430s
2025-10-15T11:03:39.415872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0] Write session: Do CDS request
2025-10-15T11:03:39.415926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:39.436188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:39.436313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402534756873912:4077]
2025-10-15T11:03:39.436414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:39.436431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1169
2025-10-15T11:03:39.439831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:39.439982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:39.439998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:39.440010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:39.443136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1169 sessionId:  describe result for acl check
2025-10-15T11:03:39.443271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:39.443282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:39.443291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:39.443306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402534756873924:2850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:39.445930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402534756873924:2850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:39.456046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402534756873924:2850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:39.472176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402534756873924:2850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:39.472229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402534756873924:2850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:39.472246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402534756873924:2850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:39.472281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:39.525237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:39.540285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:39.541148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:39.541167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:39.541208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:39.541456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:39.541634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402537556562333:10747]
2025-10-15T11:03:39.544321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:39.545485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:39.545706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:39.546922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:39.547232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:39.547238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:39.547245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:39.547252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:39.547260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:39.547267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:39.547274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:39.547283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:39.547290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:39.547297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:39.547304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:39.547310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:39.547316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:39.547322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:39.547385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:39.547492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:39.547541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:39.547584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:39.547625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:39.547669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:39.547717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:39.547762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:39.547807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:39.547853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:39.547900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:39.547943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:39.548003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:39.548048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:39.548090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:39.548152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:39.548211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:39.548264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:39.548314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:39.548367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:39.548410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:39.548462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:39.548509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:39.548560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:39.548605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:39.548657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:39.548702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:39.548750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:39.548794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:39.548850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:39.548896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:39.548948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:39.548992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:39.549746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:39.549821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:39.549881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:39.549926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:39.549981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:39.550027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:39.550089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:39.550135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:39.550188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:39.550715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:39.572271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:39.585025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:39.585078Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:39.585096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:39.585116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:39.585141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1168 [2:7561402537556562333:10747]
2025-10-15T11:03:39.585192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:39.585251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:39.585266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:39.585280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:39.585290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:39.585344Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:39.585367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:39.585392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:39.586521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:39.586535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:39.586563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:39.586580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:39.586846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:39.586871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:39.586998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:39.587142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:39.587336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:39.587421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402537556562328:10747]
2025-10-15T11:03:39.587439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402537556562328:10747]
2025-10-15T11:03:39.587455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402537556562328:10747]
2025-10-15T11:03:39.587498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:39.587593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:39.587797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:39.587813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:39.587944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402537556562328:10747]
2025-10-15T11:03:39.587977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:39.589473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1168
2025-10-15T11:03:39.589603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1168
2025-10-15T11:03:39.589666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1168, pipe: [1:7561402534756873912:4077]
2025-10-15T11:03:39.588395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:39.588416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:39.588429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:39.588454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:39.589514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402534756873826:2467], now have 1 active actors on pipe
2025-10-15T11:03:39.589543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402534756873991:2850], now have 1 active actors on pipe
2025-10-15T11:03:39.589574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402534756873912:4077], now have 1 active actors on pipe
2025-10-15T11:03:39.590067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:39.590096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:39.590193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f262968-a2783668-e759b063-8b833728_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:39.590227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:39.590247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:39.590260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:39.590308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:39.590391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:39.590450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:39.591484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:39.591510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:39.591587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:39.592140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1169 partition: 0 MaxSeqNo: 46 sessionId: src_id|f262968-a2783668-e759b063-8b833728_0
2025-10-15T11:03:39.595590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e34d452c-6c7ef58d-7bf2ace4-67008066_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|f262968-a2783668-e759b063-8b833728_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:39.631928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f262968-a2783668-e759b063-8b833728_0] Write session: try to update token
2025-10-15T11:03:39.631994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f262968-a2783668-e759b063-8b833728_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:39.765257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:39.765295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:39.765309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:39.765368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:39.765384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:39.765400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:39.765412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:39.765451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402537556562328:10747]
2025-10-15T11:03:39.765480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402537556562328:10747]
2025-10-15T11:03:39.765508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402537556562328:10747]
2025-10-15T11:03:39.765718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:39.765741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:39.766483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:39.766521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:39.766561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:39.766834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:39.815490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId: src_id|f262968-a2783668-e759b063-8b833728_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:39.857019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:39.965781Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:39.978339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:39.978390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:39.978460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:39.978476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:39.978520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402537556562328:10747]
2025-10-15T11:03:39.979628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:39.980292Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:39.981180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:39.981338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:39.981359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:40.038090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402534756873912:4077]
2025-10-15T11:03:40.038233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1169 reason: error at write: Disconnected sessionId: src_id|f262968-a2783668-e759b063-8b833728_0
2025-10-15T11:03:40.039626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f262968-a2783668-e759b063-8b833728_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:40.039669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f262968-a2783668-e759b063-8b833728_0] Write session will restart in 0.006572s
2025-10-15T11:03:40.039775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f262968-a2783668-e759b063-8b833728_0] Write session: Do CDS request
2025-10-15T11:03:40.039808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f262968-a2783668-e759b063-8b833728_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:40.044627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1169 sessionId: src_id|f262968-a2783668-e759b063-8b833728_0 is DEAD
2025-10-15T11:03:40.057371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f262968-a2783668-e759b063-8b833728_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:40.076015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:40.076053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1170
2025-10-15T11:03:40.080354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:40.080530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:40.080556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:40.080568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:40.082013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1170 sessionId:  describe result for acl check
2025-10-15T11:03:40.082125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:40.082141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:40.082150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:40.082168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402539051841475:2822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:40.084966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402539051841475:2822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:40.125921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402539051841475:2822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:40.139230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402539051841596:4077]
2025-10-15T11:03:40.146308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402539051841475:2822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:40.146360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402539051841475:2822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:40.146379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402539051841475:2822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:40.146413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:40.187758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:40.212250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:40.213070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:40.213088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:40.213128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:40.213371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:40.213579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402541851529914:10756]
2025-10-15T11:03:40.215790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:40.216936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:40.217149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:40.218340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:40.218669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:40.218677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:40.218685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:40.218691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:40.218698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:40.218705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:40.218712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:40.218720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:40.218727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:40.218734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:40.218741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:40.218749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.218756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.218764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.218808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:40.218914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:40.218961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:40.219009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:40.219051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:40.219094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:40.219138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:40.219181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:40.219227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:40.219274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:40.219318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:40.219389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.219437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.219484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.219530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:40.219596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:40.219652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:40.219707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:40.219755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:40.219809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:40.219853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:40.219905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:40.219952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:40.220004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:40.220048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:40.220101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:40.220147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:40.220200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:40.220244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:40.220297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:40.220344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:40.220396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:40.220441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:40.220492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:40.220539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:40.220591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:40.220637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.220691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.220740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.220793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.220837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.220889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.221389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:40.261812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:40.273011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:40.273058Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:40.273076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:40.273094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:40.273118Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1169 [2:7561402541851529914:10756]
2025-10-15T11:03:40.273169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:40.273227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:40.273241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:40.273254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:40.273265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:40.273312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:40.273333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:40.273356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:40.276497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.276528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.276542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.276554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:40.276829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:40.276846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.276983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.277319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.277579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:40.277646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402541851529908:10756]
2025-10-15T11:03:40.277661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402541851529908:10756]
2025-10-15T11:03:40.277674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402541851529908:10756]
2025-10-15T11:03:40.277718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:40.277785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:40.277958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:40.277976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:40.278076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:40.278108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:40.278136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:40.278163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402539051841619:2822], now have 1 active actors on pipe
2025-10-15T11:03:40.278212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402541851529908:10756]
2025-10-15T11:03:40.278254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:40.278323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402534756874127:2467], now have 1 active actors on pipe
2025-10-15T11:03:40.278365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402539051841596:4077], now have 1 active actors on pipe
2025-10-15T11:03:40.278395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:40.279808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:40.279846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:40.279918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:40.279948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:40.279966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:40.279976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:40.280010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:40.280047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:40.280108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:40.279252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1169
2025-10-15T11:03:40.279409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1169
2025-10-15T11:03:40.279490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1169, pipe: [1:7561402539051841596:4077]
2025-10-15T11:03:40.281720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:40.281750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:40.281813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:40.282127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1170 partition: 0 MaxSeqNo: 46 sessionId: src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0
2025-10-15T11:03:40.283432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f262968-a2783668-e759b063-8b833728_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:40.340393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0] Write session: try to update token
2025-10-15T11:03:40.340451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:40.376751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:40.376790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:40.376802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:40.460330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:40.460363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:40.460374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:40.460382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:40.460407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402541851529908:10756]
2025-10-15T11:03:40.460426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402541851529908:10756]
2025-10-15T11:03:40.460444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402541851529908:10756]
2025-10-15T11:03:40.460555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:40.460571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:40.461393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:40.462724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:40.462755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:40.462772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:40.551170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId: src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:40.575502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:40.693993Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:40.696046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:40.696083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:40.699801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:40.706095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:40.709405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:40.709572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402539051841596:4077]
2025-10-15T11:03:40.714375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0
2025-10-15T11:03:40.715868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:40.715917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0] Write session will restart in 0.009288s
2025-10-15T11:03:40.716023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0] Write session: Do CDS request
2025-10-15T11:03:40.716054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:40.721061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1170 sessionId: src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0 is DEAD
2025-10-15T11:03:40.743738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:40.743771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1171
2025-10-15T11:03:40.744177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:40.745021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:40.745264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:40.745301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:40.745324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:40.747540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1171 sessionId:  describe result for acl check
2025-10-15T11:03:40.747653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:40.747663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:40.747673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:40.747690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402539051841729:2807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:40.750048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402539051841729:2807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:40.774422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402539051841729:2807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:40.796670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402539051841729:2807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:40.796724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402539051841729:2807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:40.796743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402539051841729:2807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:40.796775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:40.805138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402539051841766:4077]
2025-10-15T11:03:40.926957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:40.937462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:40.938257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:40.938275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:40.938314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:40.938549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:40.938737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402541851530202:10766]
2025-10-15T11:03:40.940801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:40.941760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:40.942004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:40.943138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:40.943478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:40.943485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:40.943491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:40.943497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:40.943505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:40.943512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:40.943518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:40.943525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:40.943532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:40.943539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:40.943545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:40.943551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.943556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.943562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.943604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:40.943704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:40.943747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:40.943791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:40.943834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:40.943878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:40.943919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:40.943959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:40.943999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:40.944042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:40.944084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:40.944126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.944170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.944210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.944248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:40.944309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:40.944363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:40.944413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:40.944457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:40.944506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:40.944547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:40.944592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:40.944636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:40.945574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:40.945633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:40.945683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:40.945729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:40.945778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:40.945825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:40.945875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:40.945922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:40.945975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:40.946019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:40.946069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:40.946114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:40.946163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:40.946204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.946258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:40.946303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.946355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:40.946394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.946447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:40.946941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:40.976801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:41.042553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:41.042733Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:41.042751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:41.042767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:41.042791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1170 [2:7561402541851530202:10766]
2025-10-15T11:03:41.042837Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:41.042885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:41.042897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:41.042908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:41.042920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:41.042963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:41.042982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:41.043002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:41.045011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:41.045037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:41.045051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:41.045062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:41.045320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:41.045334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:41.045460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:41.045632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:41.045849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:41.045908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402541851530196:10766]
2025-10-15T11:03:41.045923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402541851530196:10766]
2025-10-15T11:03:41.045938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402541851530196:10766]
2025-10-15T11:03:41.045967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:41.046033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:41.046201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:41.046218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:41.046331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402541851530196:10766]
2025-10-15T11:03:41.046348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:41.048803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1170
2025-10-15T11:03:41.048875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1170, pipe: [1:7561402539051841766:4077]
2025-10-15T11:03:41.048941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1170
2025-10-15T11:03:41.046958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:41.046978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:41.046988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:41.047011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:41.049940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402539051841764:2807], now have 1 active actors on pipe
2025-10-15T11:03:41.049995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402539051841766:4077], now have 1 active actors on pipe
2025-10-15T11:03:41.050020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402539051841715:2467], now have 1 active actors on pipe
2025-10-15T11:03:41.050065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:41.050085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:41.050165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:41.050194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:41.050209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:41.050220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:41.050253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:41.050290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:41.050332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:41.051043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:41.051067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:41.051125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:41.051463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1171 partition: 0 MaxSeqNo: 46 sessionId: src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0
2025-10-15T11:03:41.055666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|379b6101-f76aba6b-24a3141f-7c9106a6_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:41.129534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0] Write session: try to update token
2025-10-15T11:03:41.129605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:41.141896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:41.141940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:41.141954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:41.346139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:41.346175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:41.346187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:41.346196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:41.346227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402541851530196:10766]
2025-10-15T11:03:41.346252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402541851530196:10766]
2025-10-15T11:03:41.346275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402541851530196:10766]
2025-10-15T11:03:41.346467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:41.346478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:41.346487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:41.346528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:41.346545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:41.348462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:41.348508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:41.348535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:41.368111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId: src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:41.367922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:41.394446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:41.507819Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:41.522003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:41.522048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:41.522108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:41.522121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:41.522156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402541851530196:10766]
2025-10-15T11:03:41.522827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:41.523515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:41.524209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:41.524239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:41.565831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1171 reason: error at write: Disconnected sessionId: src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0
2025-10-15T11:03:41.566249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1171 sessionId: src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0 is DEAD
2025-10-15T11:03:41.569538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:41.569568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0] Write session will restart in 0.009448s
2025-10-15T11:03:41.569670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0] Write session: Do CDS request
2025-10-15T11:03:41.569696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:41.591037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:41.589868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402539051841766:4077]
2025-10-15T11:03:41.589955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:41.590956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:41.590974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1172
2025-10-15T11:03:41.592322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:41.592486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:41.592504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:41.592516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:41.598937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1172 sessionId:  describe result for acl check
2025-10-15T11:03:41.599076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:41.599088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:41.599099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:41.599117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402543346809332:2779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:41.602051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402543346809332:2779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:41.626441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402543346809332:2779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:41.652806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402543346809332:2779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:41.652857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402543346809332:2779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:41.652875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402543346809332:2779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:41.652912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:41.688168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402543346809534:4077]
2025-10-15T11:03:41.727618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:41.729271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:41.730026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:41.730043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:41.730084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:41.730316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:41.730491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402546146497772:10775]
2025-10-15T11:03:41.732593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:41.739952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:41.740209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:41.741513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:41.741854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:41.741862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:41.741869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:41.741876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:41.741883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:41.741889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:41.741897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:41.741903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:41.741909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:41.741915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:41.741922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:41.741928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:41.741935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:41.741943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:41.741985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:41.742083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:41.742128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:41.742171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:41.742219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:41.742262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:41.742306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:41.742349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:41.742392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:41.742436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:41.742478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:41.742522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:41.742563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:41.742621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:41.742664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:41.742725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:41.742779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:41.742831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:41.742878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:41.742932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:41.742976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:41.743028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:41.743073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:41.743122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:41.743165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:41.743215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:41.743261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:41.743311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:41.747459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:41.747549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:41.747715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:41.747774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:41.747817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:41.747869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:41.747913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:41.747963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:41.748011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:41.748058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:41.748106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:41.748158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:41.748202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:41.748252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:41.748753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:41.796399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:41.892358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:41.892426Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:41.892443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:41.892464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:41.892490Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1171 [2:7561402546146497772:10775]
2025-10-15T11:03:41.892544Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:41.892602Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:41.892619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:41.892632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:41.892645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:41.892696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:41.892719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:41.892742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:41.894306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:41.894322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:41.894337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:41.894350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:41.894638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:41.894658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:41.894806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:41.895004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:41.895243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:41.895320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402546146497767:10775]
2025-10-15T11:03:41.895336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402546146497767:10775]
2025-10-15T11:03:41.896033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402546146497767:10775]
2025-10-15T11:03:41.896104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:41.896197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:41.896390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:41.896409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:41.896479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402543346809460:2779], now have 1 active actors on pipe
2025-10-15T11:03:41.896505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402543346809534:4077], now have 1 active actors on pipe
2025-10-15T11:03:41.896527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402543346809313:2467], now have 1 active actors on pipe
2025-10-15T11:03:41.896648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402546146497767:10775]
2025-10-15T11:03:41.896669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:41.896962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:41.896981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:41.896993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:41.897019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:41.898900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1171
2025-10-15T11:03:41.898990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1171
2025-10-15T11:03:41.899033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1171, pipe: [1:7561402543346809534:4077]
2025-10-15T11:03:41.899399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:41.899440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:41.899538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:41.899574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:41.899593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:41.899605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:41.899646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:41.899696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:41.899753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:41.901214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1172 partition: 0 MaxSeqNo: 46 sessionId: src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0
2025-10-15T11:03:41.902177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e72e536-dd12b8c8-6cb9fce-f00edb6c_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:41.900787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:41.900821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:41.900901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:41.945194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0] Write session: try to update token
2025-10-15T11:03:41.945260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:41.960729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:41.960769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:41.960812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402546146497767:10775]
2025-10-15T11:03:41.960944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:41.962692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:41.967629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:41.972973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:41.974172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:41.980490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:41.993993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:41.994374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:41.994391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:41.994403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:41.994468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:42.100601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:42.100646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:42.100663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:42.100676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:42.100724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402546146497767:10775]
2025-10-15T11:03:42.100757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402546146497767:10775]
2025-10-15T11:03:42.100788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402546146497767:10775]
2025-10-15T11:03:42.100954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:42.100967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:42.100982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:42.101033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:42.101055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:42.102106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:42.107844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:42.107891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:42.107920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:42.147897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId: src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:42.172209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:42.304377Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:42.306968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:42.307014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:42.308639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:42.311508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:42.311557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:42.311784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402543346809534:4077]
2025-10-15T11:03:42.311904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:42.328480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1172 reason: error at write: Disconnected sessionId: src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0
2025-10-15T11:03:42.328831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1172 sessionId: src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0 is DEAD
2025-10-15T11:03:42.333894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:42.333936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0] Write session will restart in 0.007298s
2025-10-15T11:03:42.334031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0] Write session: Do CDS request
2025-10-15T11:03:42.334062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:42.349758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:42.349797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1173
2025-10-15T11:03:42.352107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:42.355732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:42.355903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:42.355921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:42.355935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:42.357492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1173 sessionId:  describe result for acl check
2025-10-15T11:03:42.357618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:42.357629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:42.357638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:42.357658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402547641776905:2774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:42.360527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402547641776905:2774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:42.391762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402547641776905:2774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:42.415611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402547641776934:4077]
2025-10-15T11:03:42.429035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402547641776905:2774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:42.429082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402547641776905:2774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:42.429101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402547641776905:2774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:42.429135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:42.526924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:42.532279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:42.533251Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:42.533291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:42.533338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:42.533626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:42.533829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402550441465358:10787]
2025-10-15T11:03:42.536456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:42.544418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:42.544735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:42.546209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:42.546607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:42.546617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:42.546624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:42.546631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:42.546638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:42.546646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:42.546654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:42.546663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:42.546670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:42.546679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:42.546686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:42.546693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:42.546701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:42.546708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:42.546759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:42.546886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:42.546942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:42.546996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:42.547046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:42.547096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:42.547148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:42.547216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:42.547268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:42.547318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:42.548090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:42.548161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:42.548227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:42.548276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:42.548333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:42.548410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:42.548480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:42.548540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:42.548599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:42.548658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:42.548707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:42.548768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:42.548819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:42.548876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:42.548927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:42.548985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:42.549037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:42.549096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:42.549150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:42.549209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:42.549270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:42.549331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:42.549384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:42.549443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:42.549493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:42.549554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:42.549603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:42.549664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:42.549719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:42.549778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:42.549830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:42.549888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:42.550447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:42.632392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:42.643047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:42.643105Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:42.643124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:42.643144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:42.643170Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1172 [2:7561402550441465358:10787]
2025-10-15T11:03:42.643225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:42.643289Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:42.643305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:42.643318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:42.643330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:42.643681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:42.643713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:42.643740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:42.645392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:42.645411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:42.645427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:42.645441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:42.645733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:42.645753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:42.645901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:42.646104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:42.646339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:42.646414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402550441465353:10787]
2025-10-15T11:03:42.646432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402550441465353:10787]
2025-10-15T11:03:42.646446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402550441465353:10787]
2025-10-15T11:03:42.646492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:42.646586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:42.646781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:42.646808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:42.646942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402550441465353:10787]
2025-10-15T11:03:42.646964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:42.647780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:42.647805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:42.647820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:42.647846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:42.650848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402547641776891:2467], now have 1 active actors on pipe
2025-10-15T11:03:42.650887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402547641776949:2774], now have 1 active actors on pipe
2025-10-15T11:03:42.650911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402547641776934:4077], now have 1 active actors on pipe
2025-10-15T11:03:42.650958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:42.650983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:42.651076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:42.651110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:42.651127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:42.651135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:42.651165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:42.651199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:42.651238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:42.652344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:42.652374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:42.652441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:42.653723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf12bb11-6230e7c6-b53a3b54-495baf51_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:42.650220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1172
2025-10-15T11:03:42.650333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1172
2025-10-15T11:03:42.650394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1172, pipe: [1:7561402547641776934:4077]
2025-10-15T11:03:42.652829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1173 partition: 0 MaxSeqNo: 46 sessionId: src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0
2025-10-15T11:03:42.691729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0] Write session: try to update token
2025-10-15T11:03:42.691784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:42.807971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:42.808004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:42.808023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:42.808089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:42.808104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:42.808121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:42.808133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:42.808176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402550441465353:10787]
2025-10-15T11:03:42.808206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402550441465353:10787]
2025-10-15T11:03:42.808233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402550441465353:10787]
2025-10-15T11:03:42.808448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:42.808471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:42.809526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:42.809624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:42.809670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:42.809702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:42.850631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId: src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:42.891112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:43.030304Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:43.049474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:43.049529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:43.049604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:43.049619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:43.049662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402550441465353:10787]
2025-10-15T11:03:43.050192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:43.051025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:43.051503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:43.051671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402547641776934:4077]
2025-10-15T11:03:43.051753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:43.051765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:43.076320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:43.076361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0] Write session will restart in 0.006108s
2025-10-15T11:03:43.076460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0] Write session: Do CDS request
2025-10-15T11:03:43.076487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:43.069943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1173 reason: error at write: Disconnected sessionId: src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0
2025-10-15T11:03:43.070298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1173 sessionId: src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0 is DEAD
2025-10-15T11:03:43.092492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:43.117602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:43.117638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1174
2025-10-15T11:03:43.123702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:43.123872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:43.123890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:43.123900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:43.128502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1174 sessionId:  describe result for acl check
2025-10-15T11:03:43.128636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:43.128647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:43.128657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:43.128675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402551936744523:2748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:43.131565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402551936744523:2748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:43.151780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402551936744555:4077]
2025-10-15T11:03:43.164375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402551936744523:2748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:43.190530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402551936744523:2748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:43.190584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402551936744523:2748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:43.190602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402551936744523:2748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:43.190640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:43.236957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:43.242373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:43.243312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:43.243331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:43.243399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:43.243682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:43.243865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402554736432943:10796]
2025-10-15T11:03:43.246005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:43.247887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:43.248140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:43.249431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:43.249776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:43.249784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:43.249792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:43.249800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:43.249808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:43.249816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:43.249824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:43.249832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:43.249839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:43.249846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:43.249853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:43.249860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:43.249867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:43.249874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:43.249922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:43.250039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:43.250091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:43.250140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:43.250186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:43.250234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:43.250279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:43.250324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:43.250371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:43.250417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:43.250467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:43.250535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:43.250579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:43.250622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:43.250704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:43.250776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:43.250840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:43.250898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:43.250949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:43.251003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:43.251050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:43.251110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:43.251166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:43.251223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:43.251270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:43.251326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:43.259648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:43.259772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:43.259837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:43.259901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:43.259961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:43.260022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:43.260076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:43.260135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:43.260189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:43.260245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:43.260302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:43.260363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:43.260416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:43.260474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:43.260523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:43.260583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:43.261161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:43.305248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:43.397405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:43.398067Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:43.398093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:43.398111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:43.398135Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1173 [2:7561402554736432943:10796]
2025-10-15T11:03:43.398186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:43.398241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:43.398256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:43.398267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:43.398278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:43.398326Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:43.398348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:43.398368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:43.400083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:43.400099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:43.400113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:43.400124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:43.400377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:43.400393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:43.400539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:43.400727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:43.402047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:43.402142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402551936744686:2748], now have 1 active actors on pipe
2025-10-15T11:03:43.402167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402551936744555:4077], now have 1 active actors on pipe
2025-10-15T11:03:43.402189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402551936744491:2467], now have 1 active actors on pipe
2025-10-15T11:03:43.402217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402554736432938:10796]
2025-10-15T11:03:43.402231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402554736432938:10796]
2025-10-15T11:03:43.402246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402554736432938:10796]
2025-10-15T11:03:43.402283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:43.402358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:43.402563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:43.402581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:43.402702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402554736432938:10796]
2025-10-15T11:03:43.402722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:43.403169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:43.403190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:43.403202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:43.403226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:43.404716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1173
2025-10-15T11:03:43.404799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1173, pipe: [1:7561402551936744555:4077]
2025-10-15T11:03:43.404868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1173
2025-10-15T11:03:43.407560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:43.407601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:43.407707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:43.407743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:43.407763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:43.407774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:43.407815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:43.407863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:43.407917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:43.415529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:43.415580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:43.415674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:43.419816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1174 partition: 0 MaxSeqNo: 46 sessionId: src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0
2025-10-15T11:03:43.427333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be90e73b-5b5600fb-22a79a-29eb64a5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:43.473976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0] Write session: try to update token
2025-10-15T11:03:43.474030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:43.512836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:43.512871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:43.512883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:43.512943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:43.512959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:43.512998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402554736432938:10796]
2025-10-15T11:03:43.513123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:43.513125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:43.514936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:43.528502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:43.532220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:43.622127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:43.623589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:43.624705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:43.624720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:43.624733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:43.624791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:43.673242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId: src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:43.705315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:43.705352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:43.705367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:43.705378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:43.705415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402554736432938:10796]
2025-10-15T11:03:43.705443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402554736432938:10796]
2025-10-15T11:03:43.705468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402554736432938:10796]
2025-10-15T11:03:43.705615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:43.705635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:43.706830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:43.707558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:43.707604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:43.707635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:43.712480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:43.905792Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:43.918201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:43.918249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:43.920164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:43.920298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:43.920308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:43.923561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402551936744555:4077]
2025-10-15T11:03:43.925588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:43.975833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1174 reason: error at write: Disconnected sessionId: src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0
2025-10-15T11:03:43.976132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1174 sessionId: src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0 is DEAD
2025-10-15T11:03:43.983582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:43.983621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0] Write session will restart in 0.007221s
2025-10-15T11:03:43.983726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0] Write session: Do CDS request
2025-10-15T11:03:43.983767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:43.996963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:43.999649Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:43.999684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1175
2025-10-15T11:03:44.001009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:44.001131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:44.001144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:44.001153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:44.004473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1175 sessionId:  describe result for acl check
2025-10-15T11:03:44.004584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:44.004593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:44.004601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:44.004616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402556231712115:2743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:44.006894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402556231712115:2743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:44.026289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402556231712150:4077]
2025-10-15T11:03:44.033836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402556231712115:2743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:44.049745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402556231712115:2743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:44.049793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402556231712115:2743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:44.049810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402556231712115:2743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:44.049841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:44.113174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:44.120640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:44.121481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:44.121513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:44.121555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:44.121780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:44.121947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402559031400534:10808]
2025-10-15T11:03:44.124024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:44.125318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:44.125518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:44.126660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:44.126943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:44.126949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:44.126956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:44.126962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:44.126969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:44.126975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:44.126981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:44.126987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:44.126993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:44.127000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:44.127006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:44.127012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.127018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.127024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.127064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:44.127157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:44.127200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:44.127243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:44.127281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:44.127320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:44.127386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:44.127428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:44.127470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:44.127511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:44.127552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:44.127595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.127635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.127675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.127711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:44.127770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:44.127825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:44.127872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:44.127912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:44.127960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:44.128000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:44.128047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:44.128090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:44.128135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:44.128175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:44.128222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:44.128262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:44.128308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:44.128348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:44.128396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:44.128438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:44.128482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:44.128522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:44.128568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:44.128609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:44.128655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:44.128694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.128742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.128783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.128828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.128868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.128913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.130493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:44.177645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:44.249481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:44.249536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:44.249555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:44.249575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:44.249605Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1174 [2:7561402559031400534:10808]
2025-10-15T11:03:44.249661Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:44.249728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:44.249744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:44.249757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:44.249769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:44.249819Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:44.249843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:44.249866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:44.252467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.252501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.252517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.252529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:44.252827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:44.252848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.253007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.253213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.253463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:44.253541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402559031400529:10808]
2025-10-15T11:03:44.253557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402559031400529:10808]
2025-10-15T11:03:44.253571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402559031400529:10808]
2025-10-15T11:03:44.253617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:44.253701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:44.253897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:44.253915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:44.254048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402559031400529:10808]
2025-10-15T11:03:44.254068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:44.256183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1174
2025-10-15T11:03:44.256278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1174, pipe: [1:7561402556231712150:4077]
2025-10-15T11:03:44.256353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1174
2025-10-15T11:03:44.255326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:44.255370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:44.255383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:44.255410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:44.256506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402556231712231:2743], now have 1 active actors on pipe
2025-10-15T11:03:44.256538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402556231712150:4077], now have 1 active actors on pipe
2025-10-15T11:03:44.256558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402551936744789:2467], now have 1 active actors on pipe
2025-10-15T11:03:44.258227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:44.258267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:44.258367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff1b822f-781cf032-dca91b38-c8801023_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:44.258401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:44.258421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:44.258433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:44.258487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:44.258536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:44.258592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:44.263422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:44.263462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:44.263545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:44.265326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1175 partition: 0 MaxSeqNo: 46 sessionId: src_id|ff1b822f-781cf032-dca91b38-c8801023_0
2025-10-15T11:03:44.267553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84eb5668-2aee3e56-e47f3c2e-6a52b4e1_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|ff1b822f-781cf032-dca91b38-c8801023_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:44.322467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1b822f-781cf032-dca91b38-c8801023_0] Write session: try to update token
2025-10-15T11:03:44.323752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1b822f-781cf032-dca91b38-c8801023_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:44.350399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:44.350459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:44.350471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
E1015 11:03:44.385569223  821865 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6562: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T11:03:44.394941Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6562 } ]
2025-10-15T11:03:44.402968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:44.403001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:44.403010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:44.403019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:44.403043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402559031400529:10808]
2025-10-15T11:03:44.403063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402559031400529:10808]
2025-10-15T11:03:44.403081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402559031400529:10808]
2025-10-15T11:03:44.403180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:44.403195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:44.403483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:44.403542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:44.403574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:44.404498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:44.493261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId: src_id|ff1b822f-781cf032-dca91b38-c8801023_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:44.517916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:44.639060Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:44.641183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:44.641226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:44.645801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:44.647861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402556231712150:4077]
2025-10-15T11:03:44.648036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:44.648339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:44.648366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:44.729495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1175 reason: error at write: Disconnected sessionId: src_id|ff1b822f-781cf032-dca91b38-c8801023_0
2025-10-15T11:03:44.729853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1175 sessionId: src_id|ff1b822f-781cf032-dca91b38-c8801023_0 is DEAD
2025-10-15T11:03:44.735633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1b822f-781cf032-dca91b38-c8801023_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:44.735673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1b822f-781cf032-dca91b38-c8801023_0] Write session will restart in 0.008967s
2025-10-15T11:03:44.735765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1b822f-781cf032-dca91b38-c8801023_0] Write session: Do CDS request
2025-10-15T11:03:44.735790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1b822f-781cf032-dca91b38-c8801023_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:44.749618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402556231712413:4077]
2025-10-15T11:03:44.756492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1b822f-781cf032-dca91b38-c8801023_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:44.759676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:44.759715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1176
2025-10-15T11:03:44.761212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:44.761349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:44.761367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:44.761378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:44.763488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1176 sessionId:  describe result for acl check
2025-10-15T11:03:44.763625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:44.763637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:44.763648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:44.763666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402556231712426:2719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:44.766545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402556231712426:2719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:44.778524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402556231712426:2719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:44.808547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402556231712426:2719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:44.808597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402556231712426:2719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:44.808615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402556231712426:2719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:44.808650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:44.901207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:44.903806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:44.904623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:44.904642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:44.904684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:44.904933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:44.905106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402559031400811:10815]
2025-10-15T11:03:44.907230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:44.912510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:44.912781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:44.914012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:44.914325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:44.914333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:44.914341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:44.914348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:44.914356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:44.914363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:44.914370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:44.914376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:44.914383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:44.914390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:44.914396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:44.914402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.914408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.914431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.914480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:44.914585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:44.914634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:44.914679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:44.914724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:44.914770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:44.914813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:44.914857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:44.914903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:44.914949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:44.914992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:44.915037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.915082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.915126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.915168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:44.915240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:44.915293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:44.915344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:44.915548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:44.915604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:44.915646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:44.915699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:44.915744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:44.915808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:44.915850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:44.915902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:44.915948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:44.916001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:44.916045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:44.916097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:44.916143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:44.916192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:44.916243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:44.916297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:44.916344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:44.916414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:44.916457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.916520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.916572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.916624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.916669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.916722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.917205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:44.937176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:44.948173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:44.948227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:44.948244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:44.948265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:44.948291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1175 [2:7561402559031400811:10815]
2025-10-15T11:03:44.948345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:44.948419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:44.948436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:44.948449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:44.948463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:44.948512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:44.948537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:44.948561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:44.950311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.950344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.950358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.950371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:44.950681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:44.950702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:44.950854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:44.951054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:44.951302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:44.951803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402559031400806:10815]
2025-10-15T11:03:44.951831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402559031400806:10815]
2025-10-15T11:03:44.951846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402559031400806:10815]
2025-10-15T11:03:44.951881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:44.951983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402556231712413:4077], now have 1 active actors on pipe
2025-10-15T11:03:44.952014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402556231712365:2467], now have 1 active actors on pipe
2025-10-15T11:03:44.952036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402556231712517:2719], now have 1 active actors on pipe
2025-10-15T11:03:44.952073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:44.952263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:44.952279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:44.952404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402559031400806:10815]
2025-10-15T11:03:44.952425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:44.952775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1175, pipe: [1:7561402556231712413:4077]
2025-10-15T11:03:44.952914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1175
2025-10-15T11:03:44.952991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1175
2025-10-15T11:03:44.952603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:44.952617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:44.952628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:44.952650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:44.953934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:44.953963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:44.954052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:44.954099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:44.954119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:44.954130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:44.954170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:44.954214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:44.954258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:44.956657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:44.956681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:44.956770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:44.958158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1176 partition: 0 MaxSeqNo: 46 sessionId: src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0
2025-10-15T11:03:44.962089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1b822f-781cf032-dca91b38-c8801023_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:45.036632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:45.036668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:45.036704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402559031400806:10815]
2025-10-15T11:03:45.036818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:45.038792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:45.039268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:45.054427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0] Write session: try to update token
2025-10-15T11:03:45.054482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:45.063152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:45.064518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:45.065776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:45.072220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:45.072542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:45.072555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:45.072565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:45.072615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:45.144210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:45.144244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:45.144259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:45.144270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:45.144306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402559031400806:10815]
2025-10-15T11:03:45.144331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402559031400806:10815]
2025-10-15T11:03:45.144353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402559031400806:10815]
2025-10-15T11:03:45.144453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:45.144481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:45.144508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:45.151572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:45.151618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:45.152731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:45.257502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId: src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:45.288063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:45.293853Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:45.301007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402556231712413:4077]
2025-10-15T11:03:45.301112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:45.301269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:45.301294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:45.330929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1176 reason: error at write: Disconnected sessionId: src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0
2025-10-15T11:03:45.332269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:45.332304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0] Write session will restart in 0.008201s
2025-10-15T11:03:45.332400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0] Write session: Do CDS request
2025-10-15T11:03:45.332428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:45.332546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1176 sessionId: src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0 is DEAD
2025-10-15T11:03:45.345167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:45.349691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:45.349748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1177
2025-10-15T11:03:45.353960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:45.354206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:45.354232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:45.354246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:45.356846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1177 sessionId:  describe result for acl check
2025-10-15T11:03:45.356990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:45.357002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:45.357011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:45.357029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402560526679983:2704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:45.362157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402560526679983:2704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:45.370411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402560526679983:2704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:45.389860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402560526679983:2704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:45.389906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402560526679983:2704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:45.389922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402560526679983:2704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:45.389948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:45.403701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402560526680083:4077]
2025-10-15T11:03:45.462256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:45.468878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:45.469549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:45.469560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:45.469590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:45.469758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:45.469903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402563326368402:10823]
2025-10-15T11:03:45.471305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:45.472212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:45.472426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:45.473304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:45.473542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:45.473547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:45.473551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:45.473556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:45.473560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:45.473564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:45.473568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:45.473572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:45.473576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:45.473580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:45.473585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:45.473589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:45.473594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:45.473599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:45.473632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:45.473716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:45.473758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:45.473798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:45.473838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:45.473874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:45.473908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:45.473940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:45.473973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:45.474006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:45.474039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:45.474071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:45.474105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:45.474140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:45.474167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:45.474221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:45.474276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:45.474323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:45.474369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:45.474427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:45.474469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:45.474509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:45.474542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:45.474583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:45.474618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:45.474655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:45.474689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:45.474727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:45.474758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:45.474805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:45.474839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:45.474887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:45.474921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:45.474959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:45.474989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:45.475027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:45.475058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:45.475097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:45.475131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:45.475169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:45.475200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:45.475237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:45.475707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:45.506143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:45.567308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:45.567396Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:45.567415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:45.567435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:45.567461Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1176 [2:7561402563326368402:10823]
2025-10-15T11:03:45.567513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:45.567577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:45.567602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:45.567616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:45.567629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:45.567680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:45.567702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:45.567730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:45.569473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:45.569503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:45.569517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:45.569529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:45.569789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:45.569807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:45.569956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:45.570139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:45.570303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:45.570403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402563326368397:10823]
2025-10-15T11:03:45.570425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402563326368397:10823]
2025-10-15T11:03:45.570440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402563326368397:10823]
2025-10-15T11:03:45.570475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:45.570543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:45.570711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:45.570734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:45.570847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402563326368397:10823]
2025-10-15T11:03:45.570872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:45.571109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:45.571129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:45.571140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:45.571164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:45.571949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1176
2025-10-15T11:03:45.572046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1176
2025-10-15T11:03:45.572075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1176, pipe: [1:7561402560526680083:4077]
2025-10-15T11:03:45.572545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402560526680049:2704], now have 1 active actors on pipe
2025-10-15T11:03:45.572583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402560526680083:4077], now have 1 active actors on pipe
2025-10-15T11:03:45.572605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402560526679969:2467], now have 1 active actors on pipe
2025-10-15T11:03:45.572649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:45.572678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:45.572771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:45.572807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:45.572832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:45.572844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:45.572882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:45.572929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:45.572986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:45.574235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:45.574273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:45.574343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:45.574964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1177 partition: 0 MaxSeqNo: 46 sessionId: src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0
2025-10-15T11:03:45.575834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a051e20-9db04a74-3d0af0fe-e1ed3a8e_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:45.622967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0] Write session: try to update token
2025-10-15T11:03:45.623066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:45.623627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:45.623669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:45.623709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402563326368397:10823]
2025-10-15T11:03:45.623836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T11:03:45.625000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:45.626171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T11:03:45.627951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:45.629848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:45.644449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T11:03:45.646192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T11:03:45.646693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525649106 queuesize 0 startOffset 0
2025-10-15T11:03:45.681646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:45.681683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:45.681695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:45.716075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:45.716118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:45.716133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:45.716148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:45.716196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402563326368397:10823]
2025-10-15T11:03:45.716226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402563326368397:10823]
2025-10-15T11:03:45.716253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402563326368397:10823]
2025-10-15T11:03:45.716422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:45.716449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:45.717587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:45.719803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:45.719857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:45.719892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:45.814307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId: src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:45.850821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:45.877860Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:45.879537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:45.879582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:45.881254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:45.880277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:45.883600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402560526680083:4077]
2025-10-15T11:03:45.883768Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:45.889797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1177 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0
2025-10-15T11:03:45.890159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1177 sessionId: src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0 is DEAD
2025-10-15T11:03:45.893803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:45.893870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0] Write session will restart in 0.006340s
2025-10-15T11:03:45.894026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0] Write session: Do CDS request
2025-10-15T11:03:45.894072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:45.906322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:45.906365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1178
2025-10-15T11:03:45.909018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:45.911853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:45.911981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:45.911993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:45.912002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:45.913153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1178 sessionId:  describe result for acl check
2025-10-15T11:03:45.913257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:45.913271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:45.913277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:45.913290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402560526680267:2699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:45.918021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402560526680267:2699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:45.924099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402560526680267:2699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:45.932902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402560526680267:2699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:45.932956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402560526680267:2699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:45.932975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402560526680267:2699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:45.933009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:45.980877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402560526680416:4077]
2025-10-15T11:03:46.036601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:46.038934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:46.039811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:46.039850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:46.039901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:46.040193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:46.040459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402567621335989:10834]
2025-10-15T11:03:46.042778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:46.043957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:46.044215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:46.045717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:46.046079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:46.046101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:46.046109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:46.046116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:46.046124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:46.046131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:46.046139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:46.046149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:46.046160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:46.046169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:46.046178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:46.046186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.046193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.046200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.046251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:46.046391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:46.046442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:46.046492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:46.046546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:46.046596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:46.046644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:46.046698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:46.046748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:46.046801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:46.046853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:46.046904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.046955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.047007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.047057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:46.047135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:46.047202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:46.047263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:46.047315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:46.047394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:46.047447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:46.047520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:46.047572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:46.047630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:46.047681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:46.047740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:46.047792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:46.047849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:46.047898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:46.047971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:46.048023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:46.048080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:46.048127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:46.048187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:46.048236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:46.048296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:46.048350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.048423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.048478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.048541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.048597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.048665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.049151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:46.084714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:46.097647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:46.097711Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:46.097732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:46.097754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:46.097784Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1177 [2:7561402567621335989:10834]
2025-10-15T11:03:46.097845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:46.097919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:46.097937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:46.097951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:46.097964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:46.098023Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:46.098050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:46.098077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:46.099219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.099239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.099254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.099267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:46.100089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:46.100126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.100289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.100499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.100759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:46.100843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402567621335984:10834]
2025-10-15T11:03:46.100861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402567621335984:10834]
2025-10-15T11:03:46.100876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402567621335984:10834]
2025-10-15T11:03:46.100926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:46.101013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:46.101221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:46.101242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:46.101380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402567621335984:10834]
2025-10-15T11:03:46.101404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:46.102104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:46.102128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:46.102141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:46.102167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:46.104257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402560526680416:4077], now have 1 active actors on pipe
2025-10-15T11:03:46.104300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402560526680257:2467], now have 1 active actors on pipe
2025-10-15T11:03:46.104324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402560526680299:2699], now have 1 active actors on pipe
2025-10-15T11:03:46.104392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:46.104417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:46.104499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|417f515f-cc674d95-a65e22cc-291db007_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:46.104532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:46.104552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:46.104563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:46.104605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:46.104654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:46.104705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:46.105547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:46.105580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:46.105651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:46.107032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fc23651-6738c3b7-8187bd84-61db93c5_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|417f515f-cc674d95-a65e22cc-291db007_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:46.103926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1177, pipe: [1:7561402560526680416:4077]
2025-10-15T11:03:46.104054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1177
2025-10-15T11:03:46.104141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1177
2025-10-15T11:03:46.106064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1178 partition: 0 MaxSeqNo: 46 sessionId: src_id|417f515f-cc674d95-a65e22cc-291db007_0
2025-10-15T11:03:46.174164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|417f515f-cc674d95-a65e22cc-291db007_0] Write session: try to update token
2025-10-15T11:03:46.174232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|417f515f-cc674d95-a65e22cc-291db007_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:46.232315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:46.232355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:46.232370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:46.232505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:46.232522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:46.232553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:46.232567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:46.232607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402567621335984:10834]
2025-10-15T11:03:46.232639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402567621335984:10834]
2025-10-15T11:03:46.232668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402567621335984:10834]
2025-10-15T11:03:46.235525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:46.235583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:46.235618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:46.256946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:46.256996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:46.258462Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:46.427514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId: src_id|417f515f-cc674d95-a65e22cc-291db007_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:46.434680Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:46.436828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:46.436867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:46.436920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402567621335984:10834]
2025-10-15T11:03:46.437156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:46.486185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:46.486375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402560526680416:4077]
2025-10-15T11:03:46.486479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:46.486500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:46.497595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417f515f-cc674d95-a65e22cc-291db007_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-15T11:03:46.497668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417f515f-cc674d95-a65e22cc-291db007_0] Write session will restart in 0.008419s
2025-10-15T11:03:46.497852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417f515f-cc674d95-a65e22cc-291db007_0] Write session: Do CDS request
2025-10-15T11:03:46.497902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417f515f-cc674d95-a65e22cc-291db007_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:46.496696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1178 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|417f515f-cc674d95-a65e22cc-291db007_0
2025-10-15T11:03:46.497084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1178 sessionId: src_id|417f515f-cc674d95-a65e22cc-291db007_0 is DEAD
2025-10-15T11:03:46.517340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|417f515f-cc674d95-a65e22cc-291db007_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:46.520034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:46.520072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1179
2025-10-15T11:03:46.520500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:46.520627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:46.520645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:46.520657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:46.522165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1179 sessionId:  describe result for acl check
2025-10-15T11:03:46.522287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:46.522299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:46.522309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:46.522329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402564821647858:2660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:46.525308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402564821647858:2660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:46.543036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402564821647858:2660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:46.565758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402564821647858:2660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:46.565812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402564821647858:2660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:46.565831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402564821647858:2660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:46.565868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:46.587689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402564821648043:4077]
2025-10-15T11:03:46.622174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:46.625923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:46.626888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:46.626909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:46.626953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:46.627224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:46.627452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402567621336251:10838]
2025-10-15T11:03:46.629596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:46.633486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:46.633748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:46.635054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:46.635421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:46.635444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:46.635452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:46.635459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:46.635467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:46.635474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:46.635482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:46.635489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:46.635495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:46.635502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:46.635509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:46.635518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.635524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.635531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.635577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:46.635682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:46.635730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:46.635774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:46.635820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:46.635864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:46.635907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:46.635954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:46.635995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:46.636041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:46.636088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:46.636129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.636171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.636228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.636273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:46.636345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:46.636408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:46.636471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:46.636526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:46.636585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:46.636630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:46.636689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:46.636745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:46.636803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:46.636854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:46.636910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:46.636962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:46.637020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:46.637070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:46.637121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:46.637173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:46.637235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:46.637282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:46.637332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:46.637377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:46.637429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:46.637472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.637524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.637566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.637614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.637657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.637703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.638177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:46.679561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:46.690720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:46.690775Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:46.690793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:46.690812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:46.690838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1178 [2:7561402567621336251:10838]
2025-10-15T11:03:46.690892Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:46.690949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:46.690963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:46.690973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:46.690984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:46.691029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:46.691050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:46.691070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:46.692935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.692965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.692978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.692990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:46.693267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:46.693286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:46.693426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:46.693613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:46.693842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:46.693911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402567621336246:10838]
2025-10-15T11:03:46.693928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402567621336246:10838]
2025-10-15T11:03:46.693942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402567621336246:10838]
2025-10-15T11:03:46.693988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:46.694063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:46.694239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:46.694255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:46.694392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402567621336246:10838]
2025-10-15T11:03:46.694411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:46.695059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:46.695081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:46.695092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:46.695114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:46.697740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1178
2025-10-15T11:03:46.697841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1178, pipe: [1:7561402564821648043:4077]
2025-10-15T11:03:46.697924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1178
2025-10-15T11:03:46.703637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402564821647840:2467], now have 1 active actors on pipe
2025-10-15T11:03:46.703687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402564821648043:4077], now have 1 active actors on pipe
2025-10-15T11:03:46.703718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402564821647976:2660], now have 1 active actors on pipe
2025-10-15T11:03:46.703801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:46.703825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:46.703901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|791606da-4d942174-c5c42a5d-65d26bee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:46.703935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:46.703952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:46.703964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:46.704001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:46.704064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:46.704112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:46.705363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:46.705396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:46.705467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:46.705834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1179 partition: 0 MaxSeqNo: 46 sessionId: src_id|791606da-4d942174-c5c42a5d-65d26bee_0
2025-10-15T11:03:46.711627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417f515f-cc674d95-a65e22cc-291db007_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|791606da-4d942174-c5c42a5d-65d26bee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:46.767913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|791606da-4d942174-c5c42a5d-65d26bee_0] Write session: try to update token
2025-10-15T11:03:46.767973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|791606da-4d942174-c5c42a5d-65d26bee_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:46.939736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:46.939775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:46.939786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:46.939843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:46.939858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:46.939873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:46.939885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:46.939921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402567621336246:10838]
2025-10-15T11:03:46.939949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402567621336246:10838]
2025-10-15T11:03:46.939978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402567621336246:10838]
2025-10-15T11:03:46.940187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:46.940208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:46.943477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:46.943530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:46.943561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:46.949250Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:46.963553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId: src_id|791606da-4d942174-c5c42a5d-65d26bee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:47.005633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:47.122554Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:47.155726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:47.155780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:47.155855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T11:03:47.155870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:47.155913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561402567621336246:10838]
2025-10-15T11:03:47.156030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T11:03:47.156520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:47.159492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:47.159521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402564821648043:4077]
2025-10-15T11:03:47.159615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T11:03:47.168088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1179 reason: status is not ok: tablet will be restarted right now sessionId: src_id|791606da-4d942174-c5c42a5d-65d26bee_0
2025-10-15T11:03:47.168452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1179 sessionId: src_id|791606da-4d942174-c5c42a5d-65d26bee_0 is DEAD
2025-10-15T11:03:47.173884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791606da-4d942174-c5c42a5d-65d26bee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T11:03:47.173963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791606da-4d942174-c5c42a5d-65d26bee_0] Write session will restart in 0.006613s
2025-10-15T11:03:47.174150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791606da-4d942174-c5c42a5d-65d26bee_0] Write session: Do CDS request
2025-10-15T11:03:47.174206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791606da-4d942174-c5c42a5d-65d26bee_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:47.202927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:47.202961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1180
2025-10-15T11:03:47.206006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|791606da-4d942174-c5c42a5d-65d26bee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:47.207839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:47.207999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:47.208016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:47.208027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:47.209435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1180 sessionId:  describe result for acl check
2025-10-15T11:03:47.209567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:47.209578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:47.209588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:47.209606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402569116615448:2640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:47.212730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402569116615448:2640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:47.237311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402569116615448:2640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:47.262085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402569116615593:4077]
2025-10-15T11:03:47.263322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402569116615448:2640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:47.263373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402569116615448:2640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:47.263392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402569116615448:2640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:47.263425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:47.306086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:47.309931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:47.310765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:47.310784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:47.310823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:47.311066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:47.311262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402571916303844:10850]
2025-10-15T11:03:47.313430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:47.320702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:47.320977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:47.322291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:47.322666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:47.322674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:47.322681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:47.322688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:47.322695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:47.322701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:47.322708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:47.322715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:47.322721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:47.322729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:47.322736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:47.322743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.322749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.322756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.322802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:47.322911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:47.322966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:47.323015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:47.323059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:47.323108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:47.323157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:47.323202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:47.323250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:47.323298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:47.323344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:47.324018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.324077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.324123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.324170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:47.324239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:47.324296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:47.324351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:47.324400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:47.324455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:47.324508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:47.324570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:47.324618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:47.324669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:47.324714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:47.324768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:47.324815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:47.324868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:47.324912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:47.324967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:47.325018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:47.325074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:47.325121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:47.325173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:47.325250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:47.325316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:47.325366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.325419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.325468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.325522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.325570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.325626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.326139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:47.355646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418
2025-10-15T11:03:47.366918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T11:03:47.366967Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T11:03:47.366983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T11:03:47.367001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T11:03:47.367025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1179 [2:7561402571916303844:10850]
2025-10-15T11:03:47.367077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 46 Head Offset 46 PartNo 0 PackedSize 0 count 0 nextOffset 46 batches 0
SYNC INIT sourceId  src_id seqNo 46 offset 45
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000002_00008? size 4506418
2025-10-15T11:03:47.367136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T11:03:47.367149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:47.367161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:47.367172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:47.367218Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 46 offset: 45 MaxOffset: 46
2025-10-15T11:03:47.367239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T11:03:47.367259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T11:03:47.408365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.408398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.408411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.408421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:210: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-15T11:03:47.408694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:221: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T11:03:47.408709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.408838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.409013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:234: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.409236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:258: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T11:03:47.409305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 3 count 3 parts_count 9 actorID [2:7561402571916303838:10850]
2025-10-15T11:03:47.409318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 12 actorID [2:7561402571916303838:10850]
2025-10-15T11:03:47.409332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 0 count 2 parts_count 8 actorID [2:7561402571916303838:10850]
2025-10-15T11:03:47.409370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T11:03:47.409438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 46 max time lag 0ms effective offset 0
2025-10-15T11:03:47.409605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 46
2025-10-15T11:03:47.409621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T11:03:47.409725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561402571916303838:10850]
2025-10-15T11:03:47.409743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T11:03:47.410639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 3 count 3 parts_count 9
2025-10-15T11:03:47.410660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 12
2025-10-15T11:03:47.410672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 0 count 2 parts_count 8
2025-10-15T11:03:47.410691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T11:03:47.411308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402569116615593:4077], now have 1 active actors on pipe
2025-10-15T11:03:47.411340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402569116615433:2467], now have 1 active actors on pipe
2025-10-15T11:03:47.411381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561402569116615603:2640], now have 1 active actors on pipe
2025-10-15T11:03:47.411536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1179, pipe: [1:7561402569116615593:4077]
2025-10-15T11:03:47.411669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1179
2025-10-15T11:03:47.411758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1179
2025-10-15T11:03:47.411962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:47.412001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:47.412070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|678481c3-8caae790-3bafb5f6-6ffce634_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T11:03:47.412098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:47.412114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:47.412131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T11:03:47.412172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:47.412210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T11:03:47.412258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:47.417039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:47.417070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:47.417130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T11:03:47.431612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1180 partition: 0 MaxSeqNo: 46 sessionId: src_id|678481c3-8caae790-3bafb5f6-6ffce634_0
2025-10-15T11:03:47.435138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791606da-4d942174-c5c42a5d-65d26bee_0] Write session established. Init response: last_sequence_number: 46 session_id: "src_id|678481c3-8caae790-3bafb5f6-6ffce634_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T11:03:47.472171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T11:03:47.472209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T11:03:47.472221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T11:03:47.493241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|678481c3-8caae790-3bafb5f6-6ffce634_0] Write session: try to update token
2025-10-15T11:03:47.493308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|678481c3-8caae790-3bafb5f6-6ffce634_0] Send 10 message(s) (0 left), first sequence number is 47
2025-10-15T11:03:47.537388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T11:03:47.537425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T11:03:47.537437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T11:03:47.537447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T11:03:47.537477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 3 size 5223531 actorID [2:7561402571916303838:10850]
2025-10-15T11:03:47.537497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 6759616 actorID [2:7561402571916303838:10850]
2025-10-15T11:03:47.537515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 4506418 actorID [2:7561402571916303838:10850]
2025-10-15T11:03:47.537629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:375: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T11:03:47.537651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:436: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T11:03:47.538912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-15T11:03:47.539493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 38 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-15T11:03:47.539532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T11:03:47.539565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T11:03:47.659467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId: src_id|678481c3-8caae790-3bafb5f6-6ffce634_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T11:03:47.694669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T11:03:47.762311Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=38;Head.PackedSize=4506418;NewHead.Offset=38;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8D09DD)
__cxa_throw+221 (0x1A8D07FD)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC2A72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA8E91A)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA78330)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD47FDE)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+13407 (0x3DD4CCEF)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9D0A37)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D9778A5)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB4A65C)
2025-10-15T11:03:47.764200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T11:03:47.764235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T11:03:47.769057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T11:03:47.769617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561402569116615593:4077]
2025-10-15T11:03:47.769697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T11:03:47.769804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T11:03:47.769817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T11:03:47.830796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|678481c3-8caae790-3bafb5f6-6ffce634_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T11:03:47.830839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|678481c3-8caae790-3bafb5f6-6ffce634_0] Write session will restart in 0.009214s
2025-10-15T11:03:47.830935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|678481c3-8caae790-3bafb5f6-6ffce634_0] Write session: Do CDS request
2025-10-15T11:03:47.830963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|678481c3-8caae790-3bafb5f6-6ffce634_0] Start write session. Will connect to endpoint: localhost:13695
2025-10-15T11:03:47.830136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1180 reason: error at write: Disconnected sessionId: src_id|678481c3-8caae790-3bafb5f6-6ffce634_0
2025-10-15T11:03:47.830461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1180 sessionId: src_id|678481c3-8caae790-3bafb5f6-6ffce634_0 is DEAD
2025-10-15T11:03:47.851993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|678481c3-8caae790-3bafb5f6-6ffce634_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:47.852132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T11:03:47.852169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1181
2025-10-15T11:03:47.852887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T11:03:47.853025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53654
2025-10-15T11:03:47.853043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53654 proto=v1  topic=test-topic durationSec=0
2025-10-15T11:03:47.853053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T11:03:47.856602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1181 sessionId:  describe result for acl check
2025-10-15T11:03:47.856718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T11:03:47.856729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T11:03:47.856739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T11:03:47.856755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561402569116615750:2637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T11:03:47.859308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561402569116615750:2637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T11:03:47.869517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_8704868778275197978_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 46 InitDone 1 WaitForData 0, pipe: [1:7561402569116615781:4077]
2025-10-15T11:03:47.876786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561402569116615750:2637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T11:03:47.893651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561402569116615750:2637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T11:03:47.893699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561402569116615750:2637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T11:03:47.893715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561402569116615750:2637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T11:03:47.893743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T11:03:47.964522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T11:03:47.977711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T11:03:47.978569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T11:03:47.978587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T11:03:47.978629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T11:03:47.978814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T11:03:47.978949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561402571916304126:10857]
2025-10-15T11:03:47.980429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T11:03:47.984439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T11:03:47.984643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T11:03:47.985500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T11:03:47.985759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:47.985765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:47.985768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:47.985773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:47.985777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:47.985782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:47.985787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:47.985791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:47.985796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:47.985800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:47.985805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:47.985808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.985813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.985817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.985854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:47.985951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:47.985993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:47.986026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:47.986059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:47.986090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:47.986121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:47.986152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:47.986183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:47.986215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:47.986246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:47.986290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.986322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.986363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.986406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:47.986467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T11:03:47.986525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:47.986574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T11:03:47.986609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:47.986644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T11:03:47.986676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:47.986711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T11:03:47.986743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:47.986786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T11:03:47.986831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:47.986869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T11:03:47.986899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:47.986935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T11:03:47.986966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:47.987002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T11:03:47.987032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:47.987068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988760 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T11:03:47.987100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:47.987139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T11:03:47.987172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:47.987210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008|
2025-10-15T11:03:47.987239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.987274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 5223531 so 0 eo 41 d0000000000_00000000000000000038_00003_0000000003_00009?
2025-10-15T11:03:47.987304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.987338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 6759616 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00012?
2025-10-15T11:03:47.987545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.987582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 4506418 so 0 eo 46 d0000000000_00000000000000000044_00000_0000000002_00008?
2025-10-15T11:03:47.987990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T11:03:48.087060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 46 key 36,2 valuesize 4506418 expected 4506418

Traceback (most recent call last):
  File "library/python/testing/yatest_common/yatest/common/process.py", line 384, in wait
    wait_for(
  File "library/python/testing/yatest_common/yatest/common/process.py", line 765, in wait_for
    raise TimeoutError(truncate(message, MAX_MESSAGE_LEN))
yatest.common.process.TimeoutError: 600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9750504073/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/s8a1/00106d/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "devtools/ya/test/programs/test_tool/run_test/run_test.py", line 1770, in main
    res.wait(check_exit_code=False, timeout=current_run_test_timeout, on_timeout=timeout_callback)
  File "library/python/testing/yatest_common/yatest/common/process.py", line 398, in wait
    raise ExecutionTimeoutError(self, str(e))
yatest.common.process.ExecutionTimeoutError: (("600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9750504073/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/s8a1/00106d/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout",), {})
2025-10-15T10:53:39.356737Z :RetryDiscoveryWithCancel INFO: Random seed for debugging is 1760525619356654
2025-10-15T10:53:39.909104Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561399958007909480:2077];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:39.909148Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:40.187872Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:40.208130Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7561399963872753827:2077];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:40.208175Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:40.315531Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/001070/r3tmp/tmpE16m3M/pdisk_1.dat
2025-10-15T10:53:40.747572Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:40.779144Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:40.918667Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:40.979231Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:41.018873Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:41.041853Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:41.081407Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:41.081509Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:41.082969Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:41.087766Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:41.087852Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:41.090885Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:41.124299Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T10:53:41.125311Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:41.259444Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TServer::EnableGrpc on GrpcPort 27273, node 1
2025-10-15T10:53:41.557548Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:41.576054Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/001070/r3tmp/yandexNfrkJ6.tmp
2025-10-15T10:53:41.576073Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/001070/r3tmp/yandexNfrkJ6.tmp
2025-10-15T10:53:41.576229Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/001070/r3tmp/yandexNfrkJ6.tmp
2025-10-15T10:53:41.576341Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:41.628801Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:41.693967Z INFO: TTestServer started on Port 7925 GrpcPort 27273
TClient is connected to server localhost:7925
PQClient connected to localhost:27273
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:42.455279Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:44.928208Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561399958007909480:2077];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:44.928350Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:45.208344Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7561399963872753827:2077];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:45.208437Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:48.174150Z node 1 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k7kr27e6dq9af925yhdxcpp0", Request deadline has expired for 0.450772s seconds
2025-10-15T10:53:48.614744Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7561399996662616200:2332], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:48.621235Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7561399993937525199:2297], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:48.623654Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=Njg0NzcwZDktODA0OTdhMDItNDFmZDBkMmItNDM5MjcwNWQ=, ActorId: [2:7561399993937525197:2296], ActorState: ExecuteState, TraceId: 01k7kr2c87dznz0j6qm2bd9a1k, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:48.625778Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:48.625891Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=MmQ4MTdlNjUtYjllYWY4NWUtYmEwMTBhNmMtMWQyOWU2YWU=, ActorId: [1:7561399996662616197:2330], ActorState: ExecuteState, TraceId: 01k7kr2crwd3c36yptm0snjxqe, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:48.626236Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:48.729648Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:49.004255Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:49.262984Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:27273", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:49.801603Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k7kr2e0c11nd9hyr2kfq606k, Database: , SessionId: ydb://session/3?node_id=1&id=YWRkMTJmZDMtZTk5NjliZC03NTNjNWMzMy1lMDZiY2I5MQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561400000957583904:2944] 
=== CheckClustersList. Ok
2025-10-15T10:53:54.970043Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:27273
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:55.171216Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:27273
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:55.308957Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561400026727388145:3218] connected; active server actors: 1
2025-10-15T10:53:55.309158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:55.316141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:55.337177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:55.452442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:55.468662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:55.468926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:55.468975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:55.469024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:55.470458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400026727388144:3217], now have 1 active actors on pipe
2025-10-15T10:53:55.470490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400026727388165:2442], now have 1 active actors on pipe
2025-10-15T10:53:55.470937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:55.471746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T10:53:55.495636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:55.523728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400026727388207:3268], now have 1 active actors on pipe
2025-10-15T10:53:55.524074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:55.533902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:55.535004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:55.535100Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:55.535365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:55.535752Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561400028297264084:2379]
2025-10-15T10:53:55.538547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:55.538578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:55.538613Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561400028297264084:2379]
2025-10-15T10:53:55.538645Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:55.549140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:55.549209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.549334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.549350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:55.549366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:55.549379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.549391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.549402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:55.549455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:55.550044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:55.550179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:55.573687Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715677. Ctx: { TraceId: 01k7kr2kr45atyd3vmmmfg00f7, Database: , SessionId: ydb://session/3?node_id=1&id=ZGUxZTQxZTctODg0YmU2ODctYjRmZTNjMS1hODViZGFmOA==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-15T10:53:55.575719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:55.575864Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525635554, TxId 281474976715676
2025-10-15T10:53:55.575884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.575897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.576025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.576294Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:55.587038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:55.587385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:55.587421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.587432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.587446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.587474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:55.588034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:55.588140Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:55.588424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:55.607804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:55.607924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:55.616599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525635554
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525635554
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:27273
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:55.644766Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:55.651482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.651510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.651521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.751872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.751901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.751912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.851781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.851811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.851821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.911682Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:55.911710Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:55.956444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.956467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.956478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.059991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.060015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.060024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:27273
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:56.162155Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:56.167493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.167515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.167524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.189631Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:56.190185Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:56.190237Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:27273
2025-10-15T10:53:56.223845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:56.223878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:56.234133Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:56.234898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:56.235056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:56316
2025-10-15T10:53:56.235089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56316 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:56.235102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:56.236872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:56.237007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:56.237023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:56.237035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:56.237052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561400031022355649:2474] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:56.239328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561400031022355649:2474] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:56.268253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.268274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.268284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.368003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.368029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.368038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.469534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.469559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.469568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.570116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.570139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.570149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.671560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.671586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.671595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.738160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561400031022355649:2474] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:56.752843Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400031022355694:2474] connected; active server actors: 1
2025-10-15T10:53:56.753017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561400031022355649:2474] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:56.753047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561400031022355649:2474] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:56.775710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.775734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.775744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.830144Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400031022355694:2474] disconnected; active server actors: 1
2025-10-15T10:53:56.830181Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561400031022355694:2474] disconnected no session
2025-10-15T10:53:56.876028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.876053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.876062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.979263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.979301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.979309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.015963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561400035317323034:2474], now have 1 active actors on pipe
2025-10-15T10:53:57.016301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:57.016338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:57.016419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|6a548204-71cfe228-a717e5d6-c4e62c29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:57.016481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.016499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.016510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:57.016583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.016634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:57.016712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:57.017821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:57.017839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:57.017914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:57.019665Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525637019 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:57.019803Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|6a548204-71cfe228-a717e5d6-c4e62c29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:57.020010Z :INFO: [] MessageGroupId [src] SessionId [src|6a548204-71cfe228-a717e5d6-c4e62c29_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:57.020051Z :INFO: [] MessageGroupId [src] SessionId [src|6a548204-71cfe228-a717e5d6-c4e62c29_0] Write session will now close
2025-10-15T10:53:57.020084Z :DEBUG: [] MessageGroupId [src] SessionId [src|6a548204-71cfe228-a717e5d6-c4e62c29_0] Write session: aborting
2025-10-15T10:53:57.013413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561400031022355649:2474] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:57.013465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561400031022355649:2474] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:57.013483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561400031022355649:2474] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:57.013513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:57.016031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:57.018357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|6a548204-71cfe228-a717e5d6-c4e62c29_0
2025-10-15T10:53:57.020482Z :INFO: [] MessageGroupId [src] SessionId [src|6a548204-71cfe228-a717e5d6-c4e62c29_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:57.020525Z :DEBUG: [] MessageGroupId [src] SessionId [src|6a548204-71cfe228-a717e5d6-c4e62c29_0] Write session: destroy
2025-10-15T10:53:57.026336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|6a548204-71cfe228-a717e5d6-c4e62c29_0 grpc read done: success: 0 data: 
2025-10-15T10:53:57.026364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|6a548204-71cfe228-a717e5d6-c4e62c29_0 grpc read failed
2025-10-15T10:53:57.027195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|6a548204-71cfe228-a717e5d6-c4e62c29_0
2025-10-15T10:53:57.027220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|6a548204-71cfe228-a717e5d6-c4e62c29_0 is DEAD
2025-10-15T10:53:57.035882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:57.051874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561400035317323034:2474] destroyed
2025-10-15T10:53:57.051924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:57.051963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.051976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.051988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.082359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.082388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.082401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.187907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.187938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.187951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-15T10:53:57.203655Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:1369 } ]
2025-10-15T10:53:57.291451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.291483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.291493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.395458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.395490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.395499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.499456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.499486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.499495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.599469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.599503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.599512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.703456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.703485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.703495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.803579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.803614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.803623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.903979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.904003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.904012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.007565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.007591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.007602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.104693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.104718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.104727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.206626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.206649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.206658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.307103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.307130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.307142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.407639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.407662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.407672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.507505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.507535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.507546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.615471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.615501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.615511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.719445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.719477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.719489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.825618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.825643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.825653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.926089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.926114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.926124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.029383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.029410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.029421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.131473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.131504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.131515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.234800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.234825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.234837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.337139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.337163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.337187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.439503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.439531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.439539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.539564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.539588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.539598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.639605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.639628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.639638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.742813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.742847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.742856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.847088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.847118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.847129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.951574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.951599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.951609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.051532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.051562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.051574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.151741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.151764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.151775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.251962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.251993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.252007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.355224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.355254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.355266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.459470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.459501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.459513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.551795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:00.563490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.563519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.563529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.664195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.664224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.664235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.764645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.764671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.764681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.868408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.868437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.868448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.968738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.968763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.968773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.069078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.069102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.069113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.171463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.171493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.171503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.272384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.272407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.272418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.375032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.375060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.375072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.476262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.476290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.476300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.577270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.577295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.577306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.678804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.678832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.678844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.781638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.781673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.781684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.886052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.886078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.886098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.986790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.986816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.986829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.086891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.086925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.086936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.191509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.191537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.191550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.296176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.296198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.296207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.395716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.395743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.395755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.499450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.499476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.499487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.599448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.599477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.599487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.700765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.700786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.700797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.803455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.803483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.803496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.903776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.903799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.903810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.003953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.003976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.003986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.106090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.106116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.106128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.206660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.206685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.206695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.307024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.307054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.307066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.411790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.411815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.411827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.511777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.511807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.511820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.612096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.612123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.612134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.712518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.712550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.712560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.818597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.818628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.818640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.923530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.923556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.923567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.025274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.025299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.025309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.133661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.133691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.133702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.231972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.232007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.232043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.332255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.332282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.332293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.438831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.438857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.438867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.541093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.541121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.541135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.643454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.643483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.643497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.746705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.746733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.746745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.847505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.847532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.847544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.947761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.947789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.947800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.051695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.051725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.051737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:54:05.151558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.151586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.151597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.252223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.252246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.252256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.355686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.355712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.355726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.455879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.455897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.455908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.555647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:05.559637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.559661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.559671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.660715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.660736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.660748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.763571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.763598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.763611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.866728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.866757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.866769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.971464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.971496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.971508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.075477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.075504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.075516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.183466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.183497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.183507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.284020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.284046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.284057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.384138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.384162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.384172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.485192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.485229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.485241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.587953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.587977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.587987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.689807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.689835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.689848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.791477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.791515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.791530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.895594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.895626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.895638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.999518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.999544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.999554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.100584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.100604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.100613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.203578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.203603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.203615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.303770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.303794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.303806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.407930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.407956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.407970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.511585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.511612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.511623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.615661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.615683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.615694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.719662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.719689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.719700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.823593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.823620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.823633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.923660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.923687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.923698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.027073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.027095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.027106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.131456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.131485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.131495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.235514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.235542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.235569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.336027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.336054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.336065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.440531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.440557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.440569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.543466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.543498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.543510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.647094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.647119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.647130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.748339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.748364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.748375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.852478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.852510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.852521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.956901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.956927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.956940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.062452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.062484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.062495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.163471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.163503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.163516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.265951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.265979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.265990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.368110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.368136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.368147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.472140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.472168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.472180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.573814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.573835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.573845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.675485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.675507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.675516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.777036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.777064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.777075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.877468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.877493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.877509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.979522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.979544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.979555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.079868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.079912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.079925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.180083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.180108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.180120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.287455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.287483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.287496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.385121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.385147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.385159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.491543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.491571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.491582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.555792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:10.591129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.591160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.591172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.695663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.695688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.695700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.798443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.798484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.798496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.898447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.898476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.898490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.999817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.999843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.999855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.099609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.099635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.099647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.201937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.201963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.201976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.307929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.307952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.307962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.434436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.434465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.434477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.539488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.539519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.539529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.639055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.639088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.639101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.739157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.739186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.739198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.839581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.839606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.839619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.942294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.942323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.942334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.044449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.044478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.044490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.144833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.144862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.144878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.251542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.251575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.251586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.351619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.351648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.351659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.452303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.452335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.452345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.555774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.555802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.555812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.659768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.659793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.659804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.766766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.766794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.766805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.867456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.867489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.867501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.965855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.965877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.965884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.074367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.074396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.074407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.176320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.176344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.176353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.279756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.279783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.279792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.382164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.382190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.382201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.483728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.483759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.483769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.587837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.587864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.587875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.691090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.691129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.691141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.792374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.792403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.792415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.895529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.895557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.895570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.999724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.999754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.999765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.103246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.103278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.103289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.213408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.213439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.213449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.315576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.315605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.315617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.416998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.417030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.417042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.518950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.518980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.518992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.623445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.623475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.623485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.725987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.726013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.726022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.827997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.828028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.828040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.927894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.927924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.927949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.031977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.032007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.032019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.131768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.131797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.131810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.235627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.235656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.235667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.334407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.334447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.334461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.434902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.434940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.434952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.539463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.539492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.539503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.559808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:15.643477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.643510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.643522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.743568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.743596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.743608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.847222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.847253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.847266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.947790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.947811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.947823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.051701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.051724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.051735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.155768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.155792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.155803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.259703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.259730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.259745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.363844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.363871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.363883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.467493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.467519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.467533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.571479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.571509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.571520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.671902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.671929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.671939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.772255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.772278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.772288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.875619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.875642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.875652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.975886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.975908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.975919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.076273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.076302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.076314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.180330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.180354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.180364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.280610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.280637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.280648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.380861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.380889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.380900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.485196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.485224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.485247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.587561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.587599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.587612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.691473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.691506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.691519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.791647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.791680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.791692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.899470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.899504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.899517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.003677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.003703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.003715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.106055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.106078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.106089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.207468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.207502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.207514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.307732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.307760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.307771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.408137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.408196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.408210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.511712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.511742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.511762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.611899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.611927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.611939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.715483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.715516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.715530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.815602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.815631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.815643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.913013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.913042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.913053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.019453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.019488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.019500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.117204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.117232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.117243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.218022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.218053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.218065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.319322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.319376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.319389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.420049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.420083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.420094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.521442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.521470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.521482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.621434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.621464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.621476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.723646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.723675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.723687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.822717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.822751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.822763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.930233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.930265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.930275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.031676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.031707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.031717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.131753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.131779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.131790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.231969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.231995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.232005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.332598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.332624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.332635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.433670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.433698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.433709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.533768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.533795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.533805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.563724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:20.639103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.639132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.639143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.737823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.737848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.737860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.839467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.839501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.839513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.943461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.943491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.943503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.042659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.042684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.042694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.146311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.146342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.146354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.247498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.247530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.247540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.351512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.351543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.351555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.449865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.449893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.449908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.551068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.551094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.551107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.651675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.651709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.651721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.751748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.751776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.751788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.855492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.855531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.855543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.956882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.956910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.956920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.059489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.059521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.059532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.162064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.162090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.162102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.263222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.263263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.263274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.363665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.363693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.363706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.464055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.464082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.464094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.564368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.564396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.564407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.667671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.667699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.667712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.771035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.771066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.771079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.871522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.871551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.871563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.970867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.970897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.970907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.071906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.071927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.071938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.174752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.174775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.174783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.275494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.275521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.275533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.376163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.376193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.376206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.476825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.476851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.476865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.577400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.577429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.577442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.677487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.677510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.677521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.777770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.777789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.777795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.878715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.878747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.878759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.983914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.983947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.983960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.085974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.086000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.086013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.187114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.187139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.187150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.287167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.287189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.287201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.395610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.395649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.395660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.497585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.497615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.497627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.599596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.599628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.599641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.701069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.701096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.701118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.803652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.803676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.803696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.910788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.910818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.910831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.007893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.007919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.007930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.112022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.112049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.112061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.214855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.214880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.214893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.315520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.315547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.315559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.339613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:54:25.339699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-15T10:54:25.341108Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:54:25.344487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-15T10:54:25.345066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:54:25.359677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-15T10:54:25.419607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.419637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.419648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.519565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.519591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.519604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.564198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:25.622702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.622725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.622737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.728512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.728538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.728549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.835474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.835502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.835513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.939458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.939485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.939498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.039503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.039524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.039536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.139884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.139906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.139916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.240426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.240454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.240466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.341128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.341157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.341170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.444287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.444314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.444327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.547873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.547902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.547915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.651529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.651560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.651571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.753361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.753388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.753399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.855084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.855112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.855124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.955494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.955520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.955532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.055751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.055778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.055789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.160004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.160037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.160049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.263466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.263498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.263510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.371811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.371837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.371850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.471901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.471930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.471943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.573235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.573258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.573269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.675140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.675166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.675176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.775062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.775085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.775096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.879471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.879504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.879517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.976906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.976931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.976943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.079518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.079547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.079560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.179973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.180010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.180023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.283180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.283206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.283218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.384954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.384982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.384993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.487035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.487064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.487074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.586577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.586609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.586621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.689668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.689692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.689703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.791622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.791648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.791673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.899139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.899168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.899179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.003467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.003499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.003510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.103539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.103566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.103576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.207531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.207568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.207579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.308035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.308063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.308074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.407896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.407925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.407936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.510999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.511021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.511030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.611639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.611667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.611678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.715474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.715507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.715519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.816117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.816147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.816158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.919816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.919846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.919857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.020078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.020115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.020125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.123508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.123543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.123555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.232611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.232640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.232661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.335659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.335689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.335701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.439482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.439524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.439535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.539818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.539859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.539870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.564591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:30.640327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.640361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.640376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.743471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.743507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.743520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.844206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.844236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.844248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.947543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.947573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.947584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.050981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.051014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.051025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.151731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.151760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.151772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.256545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.256574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.256586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.356330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.356356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.356367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.457713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.457742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.457754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.559480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.559511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.559523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.661588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.661618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.661629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.761426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.761470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.761482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.863657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.863682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.863692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.963660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.963691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.963706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.065157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.065188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.065209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.171264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.171298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.171310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.271406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.271440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.271450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.374262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.374300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.374311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.479252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.479282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.479295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.579607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.579644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.579657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.677994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.678020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.678031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.780509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.780535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.780548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.883489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.883518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.883531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.987811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.987841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.987854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.088024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.088054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.088065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.191523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.191554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.191566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.291923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.291949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.291959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.392593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.392619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.392629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.492738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.492764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.492774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.599504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.599539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.599551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.703583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.703615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.703628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.807520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.807548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.807560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.911567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.911593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.911604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.019522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.019556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.019567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.119801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.119835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.119848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.220246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.220273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.220285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.323518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.323565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.323578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.427689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.427721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.427734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.531602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.531630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.531643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.635471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.635499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.635511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.735749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.735770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.735781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.838725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.838751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.838763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.939796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.939821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.939832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.043466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.043495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.043518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-15T10:54:35.132087Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:1369 } ]
2025-10-15T10:54:35.143710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.143747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.143758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.247898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.247925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.247937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.351735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.351764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.351778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.451924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.451949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.451961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.555619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.555647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.555660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.567814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:35.659481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.659512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.659525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.761360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.761387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.761401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.861541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.861571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.861584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.963788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.963815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.963826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.063381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.063410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.063429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.163679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.163710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.163722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.264478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.264505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.264518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.364299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.364325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.364338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.471465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.471495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.471505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.575505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.575536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.575548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.677223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.677267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.677278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.779521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.779553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.779565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.881512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.881534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.881542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.984340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.984381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.984391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.087643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.087672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.087684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.188162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.188192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.188204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.288965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.288997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.289009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.390291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.390320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.390332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.499548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.499584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.499596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.598292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.598322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.598332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.699564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.699587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.699598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.803507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.803532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.803546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.907695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.907726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.907739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.005780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.005804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.005816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.106210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.106232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.106243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.206690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.206715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.206727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.306887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.306910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.306921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.407489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.407512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.407523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.508164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.508189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.508203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.609641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.609668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.609682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.715571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.715602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.715615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.817953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.817980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.817992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.919779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.919804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.919817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.023732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.023763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.023778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.126931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.126965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.126979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.227552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.227577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.227587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.331476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.331507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.331520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.428245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.428287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.428298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.531480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.531511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.531522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.635776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.635806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.635815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.736364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.736399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.736410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.836895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.836929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.836941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.937017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.937042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.937053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.043505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.043537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.043549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.143695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.143725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.143739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.246526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.246554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.246568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.347610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.347637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.347649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.453776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.453820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.453833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.554130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.554159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.554171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.568297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:40.656464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.656486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.656499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.756738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.756763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.756776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.857696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.857718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.857727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.961494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.961519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.961531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.063308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.063363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.063376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.163952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.163986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.163996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.264785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.264812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.264823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.365083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.365109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.365120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.472438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.472470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.472484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.575677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.575706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.575727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.683478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.683516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.683527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.787527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.787553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.787566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.888491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.888531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.888543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.988187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.988214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.988226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.093743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.093772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.093784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.195560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.195587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.195599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.295576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.295602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.295615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.395625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.395651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.395665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:54:42.500707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.500729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.500742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.604397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.604420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.604432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.707503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.707534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.707544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.811622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.811649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.811659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.915599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.915630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.915643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.015997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.016024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.016036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.117786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.117804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.117812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.219495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.219523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.219536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.320611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.320650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.320661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.424425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.424452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.424464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.526152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.526177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.526192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.631540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.631568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.631581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.735637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.735665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.735678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.839480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.839512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.839527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.940906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.940934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.940948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.041933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.041988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.042001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.143524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.143553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.143566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.246359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.246386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.246397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.351521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.351550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.351562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.452031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.452061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.452072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.555491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.555523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.555535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.663508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.663536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.663547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.767688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.767715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.767725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.871468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.871501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.871512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.975581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.975614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.975627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.078674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.078748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.078763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.182511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.182549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.182564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.286996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.287027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.287039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.391492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.391533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.391545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.491733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.491765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.491777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.568698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:45.596291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.596319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.596332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.699466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.699498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.699511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.799437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.799465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.799477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.901125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.901153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.901164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.011706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.011738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.011749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.115553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.115579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.115591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.215807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.215837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.215849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.319320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.319364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.319377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.419484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.419515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.419531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.524375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.524400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.524413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.624313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.624343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.624356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.725891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.725920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.725933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.826038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.826065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.826076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.931538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.931575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.931589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.032311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.032345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.032358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.135474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.135510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.135525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.239941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.239971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.239982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.341185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.341220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.341243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.445631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.445662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.445674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.545897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.545923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.545935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.651017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.651050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.651062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.751163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.751195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.751208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.851564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.851597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.851610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.952952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.952981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.952993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.053254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.053280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.053299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.154858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.154888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.154899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.259466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.259505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.259519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.359968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.360004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.360016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.462703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.462738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.462752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.561900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.561933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.561944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.670905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.670929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.670938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.771582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.771612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.771623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.872042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.872074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.872083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.975437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.975465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.975474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.079447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.079480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.079492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.179749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.179787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.179799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.281960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.282001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.282012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.382507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.382538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.382551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.482784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.482817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.482830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.583117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.583147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.583169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.683794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.683822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.683842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.787476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.787512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.787524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.891540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.891566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.891580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.998650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.998671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.998684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.099478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.099510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.099523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.203469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.203504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.203519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.307492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.307520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.307532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.411457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.411487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.411497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.515506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.515535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.515548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.571743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:50.619465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.619495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.619506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.724408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.724438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.724451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.824282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.824309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.824321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.924561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.924588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.924600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.024910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.024938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.024950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.131469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.131502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.131516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.235481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.235513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.235525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.335469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.335502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.335514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.435532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.435560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.435581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.539635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.539665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.539678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.640509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.640551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.640564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.740498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.740522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.740534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.843470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.843501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.843515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.944276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.944304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.944316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.046915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.046948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.046963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.151445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.151474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.151485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.255462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.255492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.255504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.357100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.357130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.357142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.459138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.459177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.459191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.563454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.563483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.563498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.662582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.662607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.662618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.762171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.762198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.762211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.862503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.862533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.862546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.962823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.962856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.962869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.063197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.063227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.063240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.163532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.163561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.163573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.267327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.267379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.267391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.367316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.367360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.367373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.467812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.467836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.467848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.567980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.568002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.568013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.670049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.670076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.670098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.770543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.770580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.770591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.896668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.896697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.896707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.999450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.999477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.999487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.102821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.102852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.102862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.203021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.203064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.203077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.307527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.307554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.307566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.411559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.411596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.411609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.512236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.512268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.512281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.615484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.615518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.615530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.715456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.715487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.715500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.815789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.815819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.815829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.916110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.916141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.916153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.016945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.016976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.016989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.118617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.118649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.118662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.227481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.227519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.227530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.327857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.327883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.327891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.343439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:54:55.343491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-15T10:54:55.344745Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:54:55.345512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-15T10:54:55.345657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:54:55.428571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.428603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.428613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.529615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.529647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.529662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.575634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:55.629856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.629885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.629899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.731666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.731698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.731710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.833377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.833412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.833422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.935823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.935856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.935868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.036037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.036067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.036079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.136196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.136228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.136240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.236696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.236725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.236737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.339763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.339798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.339812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.439815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.439845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.439865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.540253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.540284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.540296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.640503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.640545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.640556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.740891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.740919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.740930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.844216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.844244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.844257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.949729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.949761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.949776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.047008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.047040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.047053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.151489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.151524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.151539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.255467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.255496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.255509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.355805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.355834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.355848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.456146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.456185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.456200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.556556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.556595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.556609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.659633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.659662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.659675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.760797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.760829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.760842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.863522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.863556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.863568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.970247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.970280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.970292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.071457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.071490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.071501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.173199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.173228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.173240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.275900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.275928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.275939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.378514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.378544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.378555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.479472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.479506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.479518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.583084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.583113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.583126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.684705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.684737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.684750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.785139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.785167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.785179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.885651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.885678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.885700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.985941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.985979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.985992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.086536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.086578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.086592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.187539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.187570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.187583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.287553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.287594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.287606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.387978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.388004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.388015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.492102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.492133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.492145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.592178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.592214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.592226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.692518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.692546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.692557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.793433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.793459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.793469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.893420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.893461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.893473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.995247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.995280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.995294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.095557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.095590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.095603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.198649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.198682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.198694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.299483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.299518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.299548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.399560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.399588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.399600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.499967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.500002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.500015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.575937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:00.600339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.600376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.600390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.700674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.700702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.700714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.801078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.801102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.801114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.903472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.903503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.903515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.003815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.003855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.003867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.104135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.104163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.104176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.208224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.208289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.208304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.311207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.311236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.311246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.411430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.411459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.411473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.511908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.511940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.511959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.612189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.612220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.612231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.712400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.712440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.712452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.812667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.812696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.812708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.913101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.913129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.913142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.013469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.013499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.013513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.113789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.113818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.113829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.214154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.214181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.214195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.315451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.315482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.315496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.416868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.416898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.416911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.523513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.523546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.523560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.623462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.623494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.623508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.725269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.725305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.725317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.826341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.826374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.826386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.926828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.926856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.926870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.027222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.027252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.027265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.127973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.128002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.128016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.230592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.230624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.230637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.329262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.329302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.329316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.431417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.431450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.431463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.531529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.531565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.531578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.635596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.635624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.635637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.736967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.736999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.737013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.836988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.837022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.837035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.939744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.939776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.939786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.040100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.040133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.040144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.144345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.144377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.144390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.247445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.247476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.247486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.352529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.352561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.352571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.453077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.453118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.453131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.553700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.553729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.553742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.653851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.653894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.653909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.758693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.758723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.758734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.859302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.859330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.859341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.959551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.959582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.959604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.063465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.063492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.063504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.163761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.163790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.163802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.267473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.267505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.267517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.369537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.369560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.369573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.475147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.475170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.475180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.575501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.575529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.575541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.576314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:05.678819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.678850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.678860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.779207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.779240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.779252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.879595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.879634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.879649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.983470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.983505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.983520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.087522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.087555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.087567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.192801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.192843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.192856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.295647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.295677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.295689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.395796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.395829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.395841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.499482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.499519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.499531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.607548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.607579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.607593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.707979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.708010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.708024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.808346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.808393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.808406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.908728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.908761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.908772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.009033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.009061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.009073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.109708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.109740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.109752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.209753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.209790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.209802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.310081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.310105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.310113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.411239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.411271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.411285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.514517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.514546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.514557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.613193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.613224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.613236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.716159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.716192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.716205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.819527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.819561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.819573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.920107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.920135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.920146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.020414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.020442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.020455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.122704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.122732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.122743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.220927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.220958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.220970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.323797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.323830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.323843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.427454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.427484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.427495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.527479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.527511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.527524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.627589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.627619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.627632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.731772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.731796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.731806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.836266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.836298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.836309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.936216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.936248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.936261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.036558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.036586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.036599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.142562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.142594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.142607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.247481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.247516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.247529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.346344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.346379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.346391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.446741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.446773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.446787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.547171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.547197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.547221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.648857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.648891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.648903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.751480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.751519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.751530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.852651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.852685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.852698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.959441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.959469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.959479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.059465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.059491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.059502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.161061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.161096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.161108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.263454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.263488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.263500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.364617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.364643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.364654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.467671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.467702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.467715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.567984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.568021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.568033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.576805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:10.672999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.673027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.673040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.773283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.773312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.773328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.876302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.876334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.876348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.979821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.979855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.979869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.082549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.082580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.082593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.182863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.182896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.182908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.283204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.283240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.283252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.385797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.385825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.385835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.491642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.491672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.491683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.657012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.657040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.657049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.757306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.757343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.757355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.859796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.859831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.859842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.962379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.962412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.962426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.062438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.062459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.062468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.163557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.163586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.163606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.263965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.263994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.264005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.375991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.376023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.376036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.476796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.476831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.476843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-15T10:55:12.483218Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:1369 } ]
2025-10-15T10:55:12.583265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.583296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.583309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.683565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.683595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.683608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.783895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.783930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.783943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.884247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.884276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.884289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.984556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.984596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.984609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.086785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.086812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.086824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.186905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.186934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.186954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.291305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.291336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.291364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.399654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.399690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.399702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.503602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.503641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.503654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.603852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.603891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.603905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.708299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.708339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.708352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.811692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.811720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.811746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.911778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.911806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.911827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.012728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.012759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.012772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.114023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.114062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.114076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.215588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.215633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.215648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.315807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.315855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.315868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.417181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.417210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.417222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.517570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.517598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.517618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.617889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.617920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.617932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.719735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.719762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.719781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.821468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.821500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.821512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.921987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.922011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.922024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.022331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.022366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.022378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.122755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.122788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.122810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.223003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.223031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.223043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.325819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.325858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.325870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.425833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.425866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.425881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.526155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.526188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.526203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.579618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:15.627472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.627507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.627521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.729499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.729531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.729543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.829806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.829836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.829849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.930181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.930216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.930228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.031474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.031509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.031522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.135480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.135514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.135526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.239479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.239513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.239525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.343637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.343686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.343700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.447179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.447210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.447222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.555479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.555509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.555524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.656742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.656775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.656800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.759909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.759942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.759950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.863604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.863638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.863652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.970005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.970052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.970065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.069851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.069879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.069892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.170843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.170873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.170898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.271636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.271668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.271681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.371903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.371934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.371946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.475520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.475552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.475565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.573071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.573096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.573106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.673477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.673502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.673514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.773904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.773936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.773948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.874207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.874244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.874256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.975479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.975509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.975520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.075887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.075925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.075938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:55:18.176710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.176742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.176754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.277469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.277498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.277511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.379480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.379510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.379523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.062207Z :RecreateObserver INFO: Random seed for debugging is 1760525720062176
2025-10-15T10:55:20.632963Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7561400395067507739:2079];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:55:20.633120Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:55:20.646714Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7561400392881599919:2082];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:55:20.646786Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/001070/r3tmp/tmpx1CnIj/pdisk_1.dat
2025-10-15T10:55:20.670061Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:55:20.681532Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:55:20.689901Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:55:20.699856Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:55:20.820035Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:55:20.863768Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:55:20.863855Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:55:20.865974Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:55:20.866060Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:55:20.877111Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-15T10:55:20.877277Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:55:20.877652Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:55:20.877841Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 18885, node 3
2025-10-15T10:55:20.938375Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/001070/r3tmp/yandexHPFJ9W.tmp
2025-10-15T10:55:20.938399Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/001070/r3tmp/yandexHPFJ9W.tmp
2025-10-15T10:55:20.938544Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/001070/r3tmp/yandexHPFJ9W.tmp
2025-10-15T10:55:20.938696Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:55:20.966218Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:55:20.979860Z INFO: TTestServer started on Port 31440 GrpcPort 18885
TClient is connected to server localhost:31440
PQClient connected to localhost:18885
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:55:21.234097Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:55:21.642779Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:55:21.667586Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:55:24.525317Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:55:24.610737Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7561400412247377893:2321], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:55:24.611931Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=MTMzYzM3MGYtYWM1ZWYwZTgtY2UzOTZhMWMtNTY5YWZkNzQ=, ActorId: [3:7561400412247377890:2319], ActorState: ExecuteState, TraceId: 01k7kr5as52fahwg6nnrh5t4yw, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:55:24.612335Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:55:24.690004Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:55:24.855882Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:55:24.903215Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7561400410061469459:2297], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:55:24.903491Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=ZmI5YzM5MWMtYTAyMTE4OTgtMWQ1MjFkOGItYWZmNWMzZGI=, ActorId: [4:7561400410061469457:2296], ActorState: ExecuteState, TraceId: 01k7kr5b5z8yxdfq1aam8kfhxa, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:55:24.903902Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:18885", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:55:25.310721Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k7kr5b9v5kewacsy73qzg4sa, Database: , SessionId: ydb://session/3?node_id=3&id=MTM5MjZjNjAtY2Y1NDg0ZDQtOTJjMGM3MzUtZDc1OGZlNWU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7561400416542345581:2904] 
2025-10-15T10:55:25.633706Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7561400395067507739:2079];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:55:25.633777Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:55:25.646859Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7561400392881599919:2082];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:55:25.646988Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-15T10:55:31.706802Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:18885
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:55:31.781501Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:18885
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:55:31.814451Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7561400442312149944:3247] connected; active server actors: 1
2025-10-15T10:55:31.814813Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:55:31.815471Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:55:31.818937Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:55:31.823273Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:55:31.826813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:55:31.827153Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:55:31.827213Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:31.827259Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:55:31.827749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400442312149973:2452], now have 1 active actors on pipe
2025-10-15T10:55:31.827792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400442312149943:3246], now have 1 active actors on pipe
2025-10-15T10:55:31.827903Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-15T10:55:31.829281Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:55:31.836033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:55:31.843104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400442312150004:3296], now have 1 active actors on pipe
2025-10-15T10:55:31.843759Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:55:31.848691Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:55:31.849624Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:55:31.849706Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:55:31.849984Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:55:31.850178Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7561400440126241044:2386]
2025-10-15T10:55:31.853207Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:55:31.853239Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:55:31.853259Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7561400440126241044:2386]
2025-10-15T10:55:31.853283Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:55:31.854461Z node 4 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:55:31.854496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.854563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.854574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:31.854590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:55:31.854599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.854607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.854618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:55:31.854660Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:55:31.854937Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:55:31.855061Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:31.864812Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:55:31.864956Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525731888, TxId 281474976715679
2025-10-15T10:55:31.864978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.864988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.865104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.865302Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:55:31.867610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:55:31.867921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:55:31.867954Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.867965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.867973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.868036Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:31.868438Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:55:31.868553Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:55:31.868850Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:55:31.873254Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:55:31.873372Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:55:31.875251Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:55:31.953010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.953043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.953056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.970818Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k7kr5hzffasy1ejjvmgwraqq, Database: , SessionId: ydb://session/3?node_id=3&id=NjVjZmZhMmEtNWVjYjc3MmItNjNmNzA0YTAtM2NhMGY4OGI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760525731888
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760525731888
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:18885
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:55:31.993086Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:55:32.052992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.053022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.053035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.153315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.153352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.153363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.253720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.253751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.253775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.359046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.359074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.359086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.459534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.459568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.459581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:18885
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:55:32.497889Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:55:32.506443Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:55:32.507403Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:55:32.507455Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:18885
2025-10-15T10:55:32.515372Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:55:32.516013Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:32.516045Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:55:32.516343Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:55:32.516465Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:37108
2025-10-15T10:55:32.516485Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37108 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:55:32.516494Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:32.518104Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:55:32.518218Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:32.518235Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:32.518245Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:32.518264Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561400446607117430:2475] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:32.521022Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561400446607117430:2475] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:32.559873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.559911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.559925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.660237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.660280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.660292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.721642Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7561400446607117430:2475] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:55:32.722214Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400446607117478:2475] connected; active server actors: 1
2025-10-15T10:55:32.722263Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7561400446607117430:2475] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:55:32.722281Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400446607117430:2475] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:32.722610Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400446607117478:2475] disconnected; active server actors: 1
2025-10-15T10:55:32.722642Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400446607117478:2475] disconnected no session
2025-10-15T10:55:32.760564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.760612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.760638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.861387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.861415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.861440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.901036Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400446607117430:2475] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:32.901081Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561400446607117430:2475] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:55:32.901099Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400446607117430:2475] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:32.901130Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:32.902906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400446607117513:2475], now have 1 active actors on pipe
2025-10-15T10:55:32.903107Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:55:32.903377Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.903411Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.903493Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|952800cd-41b8abe6-430df570-462ec089_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:55:32.903537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.903556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.903567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:32.903605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.903645Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:32.903689Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:32.904274Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:32.904300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:32.904360Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:32.905244Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|952800cd-41b8abe6-430df570-462ec089_0
2025-10-15T10:55:32.906128Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525732906 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:55:32.906277Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|952800cd-41b8abe6-430df570-462ec089_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:55:32.906493Z :INFO: [] MessageGroupId [src] SessionId [src|952800cd-41b8abe6-430df570-462ec089_0] Write session: close. Timeout = 0 ms
2025-10-15T10:55:32.906544Z :INFO: [] MessageGroupId [src] SessionId [src|952800cd-41b8abe6-430df570-462ec089_0] Write session will now close
2025-10-15T10:55:32.906595Z :DEBUG: [] MessageGroupId [src] SessionId [src|952800cd-41b8abe6-430df570-462ec089_0] Write session: aborting
2025-10-15T10:55:32.907051Z :INFO: [] MessageGroupId [src] SessionId [src|952800cd-41b8abe6-430df570-462ec089_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:55:32.907089Z :DEBUG: [] MessageGroupId [src] SessionId [src|952800cd-41b8abe6-430df570-462ec089_0] Write session: destroy
2025-10-15T10:55:32.912722Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|952800cd-41b8abe6-430df570-462ec089_0 grpc read done: success: 0 data: 
2025-10-15T10:55:32.912739Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|952800cd-41b8abe6-430df570-462ec089_0 grpc read failed
2025-10-15T10:55:32.912762Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|952800cd-41b8abe6-430df570-462ec089_0 grpc closed
2025-10-15T10:55:32.912776Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|952800cd-41b8abe6-430df570-462ec089_0 is DEAD
2025-10-15T10:55:32.914170Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:55:32.914600Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561400446607117513:2475] destroyed
2025-10-15T10:55:32.914643Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:55:32.914678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.914691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.914702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-15T10:55:32.963501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.963530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.963541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.063770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.063798Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.063810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.163995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.164022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.164034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.264388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.264416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.264428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.364761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.364793Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.364807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.465098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.465131Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.465143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.565481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.565510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.565522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.665784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.665808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.665820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.766156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.766198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.766211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.866485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.866522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.866549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-15T10:55:33.922541Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:15636 } ]
2025-10-15T10:55:33.922812Z :ERROR: [/Root] [] [ed846599-cd672143-6d2b813-a9947985] Federated state update failed. FederationState: { Status: TRANSPORT_UNAVAILABLE SelfLocation: "" Issues: { [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:15636 } ] } }
>>> Got event: SessionClosed { Status: TRANSPORT_UNAVAILABLE Issues: "<main>: Error: GRpc error: (14): mock 'unavailable' <main>: Error: Grpc error response on endpoint localhost:15636 " }
Session2 was created
2025-10-15T10:55:33.966848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.966880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.966894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.067832Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.067863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.067876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.171485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.171514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.171524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.271562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.271594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.271607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.371883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.371918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.371931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.472238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.472270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.472282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.572563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.572612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.572625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.672886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.672916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.672929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.773246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.773277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.773300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.873571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.873592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.873600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:55:34.925163Z :INFO: [/Root] [] [2d88ed46-b6fdb37-d2314bde-1c8ad1cd] Open read subsessions to databases: { name: dc1, endpoint: localhost:18885, path: /Root }, { name: dc2, endpoint: localhost:18885, path: /Root }, { name: dc3, endpoint: localhost:18885, path: /Root }
2025-10-15T10:55:34.933441Z :INFO: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] Starting read session
2025-10-15T10:55:34.933492Z :DEBUG: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] Starting single session
2025-10-15T10:55:34.934302Z :DEBUG: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:34.934357Z :DEBUG: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:34.934414Z :DEBUG: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:55:34.937987Z :INFO: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] Starting read session
2025-10-15T10:55:34.938024Z :DEBUG: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] Starting single session
2025-10-15T10:55:34.938151Z :DEBUG: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:34.938177Z :DEBUG: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:34.938204Z :DEBUG: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:55:34.938880Z :DEBUG: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] [] Successfully connected. Initializing session
2025-10-15T10:55:34.939798Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:55:34.939830Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-15T10:55:34.940385Z :INFO: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] Starting read session
2025-10-15T10:55:34.940424Z :DEBUG: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] Starting single session
2025-10-15T10:55:34.940556Z :DEBUG: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:34.940588Z :DEBUG: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:34.940632Z :DEBUG: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:55:34.940907Z :DEBUG: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] [] Successfully connected. Initializing session
2025-10-15T10:55:34.941039Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:55:34.941054Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-15T10:55:34.942713Z :DEBUG: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] [] Successfully connected. Initializing session
2025-10-15T10:55:34.969948Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:55:34.969949Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:55:34.970248Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 read init: from# ipv6:[::1]:37136, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:55:34.970248Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 read init: from# ipv6:[::1]:37136, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:55:34.971129Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 auth for : user
2025-10-15T10:55:34.971171Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 auth for : user
2025-10-15T10:55:34.971190Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:55:34.971197Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-15T10:55:34.971631Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:55:34.971770Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 Handle describe topics response
2025-10-15T10:55:34.971776Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 read init: from# ipv6:[::1]:37136, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:55:34.971907Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 auth is DEAD
2025-10-15T10:55:34.971977Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 auth for : user
2025-10-15T10:55:34.972021Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:55:34.972064Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 Handle describe topics response
2025-10-15T10:55:34.972123Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 auth is DEAD
2025-10-15T10:55:34.972182Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:55:34.973275Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:55:34.973279Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:55:34.973551Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400455197052241:2516] connected; active server actors: 1
2025-10-15T10:55:34.973603Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400455197052240:2517] connected; active server actors: 1
2025-10-15T10:55:34.973670Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7561400455197052241:2516] session shared/user_3_1_2613369873048936796_v1
2025-10-15T10:55:34.973705Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 Handle describe topics response
2025-10-15T10:55:34.973769Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:55:34.973795Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 auth is DEAD
2025-10-15T10:55:34.973846Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:55:34.973847Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:55:34.973892Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_2613369873048936796_v1" (Sender=[3:7561400455197052232:2516], Pipe=[3:7561400455197052241:2516], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:55:34.973928Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:55:34.973962Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7561400455197052240:2517] session shared/user_3_2_10071255884527415362_v1
2025-10-15T10:55:34.973924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.973986Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_10071255884527415362_v1" (Sender=[3:7561400455197052233:2517], Pipe=[3:7561400455197052240:2517], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:55:34.974034Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:55:34.974074Z :INFO: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] [] Got InitResponse. ReadSessionId: shared/user_3_2_10071255884527415362_v1
2025-10-15T10:55:34.974080Z :INFO: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] [] Got InitResponse. ReadSessionId: shared/user_3_1_2613369873048936796_v1
2025-10-15T10:55:34.973949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.974174Z :DEBUG: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:34.974202Z :DEBUG: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:34.973962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.974127Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_2_10071255884527415362_v1" (Sender=[3:7561400455197052233:2517], Pipe=[3:7561400455197052240:2517], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:55:34.974250Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_2_10071255884527415362_v1" sender [3:7561400455197052233:2517] lock partition 0 for ReadingSession "shared/user_3_2_10071255884527415362_v1" (Sender=[3:7561400455197052233:2517], Pipe=[3:7561400455197052240:2517], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-15T10:55:34.974308Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-15T10:55:34.974441Z :DEBUG: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:55:34.974435Z :DEBUG: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:55:34.974349Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000288s
2025-10-15T10:55:34.974639Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:55:34.974928Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:55:34.975001Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 got read request: guid# 4fc7c417-f9ebc23-81946975-28693aa7
2025-10-15T10:55:34.975066Z :INFO: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] [] Got InitResponse. ReadSessionId: shared/user_3_3_3404498052345499861_v1
2025-10-15T10:55:34.975104Z :DEBUG: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:55:34.975159Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400455197052245:2520] connected; active server actors: 1
2025-10-15T10:55:34.975189Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7561400455197052245:2520] session shared/user_3_3_3404498052345499861_v1
2025-10-15T10:55:34.975220Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_3404498052345499861_v1" (Sender=[3:7561400455197052236:2520], Pipe=[3:7561400455197052245:2520], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:55:34.975244Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:55:34.975274Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-15T10:55:34.975294Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-15T10:55:34.975340Z :DEBUG: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:55:34.975372Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_2_10071255884527415362_v1" sender [3:7561400455197052233:2517]  release partitions [0]. Target status Free
2025-10-15T10:55:34.975407Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000116s
2025-10-15T10:55:34.975429Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_2_10071255884527415362_v1" ClientId: "user" PipeClient { RawX1: 7561400455197052240 RawX2: 4503612512274901 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:55:34.975484Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:55:34.975519Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:55:34.975528Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 gone release: partition# 0
2025-10-15T10:55:34.975564Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:55:34.975589Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:55:34.975610Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:55:34.975628Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:55:34.975714Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 got read request: guid# 252ea0d7-c514ecbe-8120d4f1-b34d0328
2025-10-15T10:55:34.975720Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 got read request: guid# 502a104d-c425c6f1-ad084a0a-2d7955f4
2025-10-15T10:55:34.975839Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [3:7561400455197052240:2517] session shared/user_3_2_10071255884527415362_v1 partition 0
2025-10-15T10:55:34.975894Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:55:34.975938Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:55:34.975984Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_3_3404498052345499861_v1" (Sender=[3:7561400455197052236:2520], Pipe=[3:7561400455197052245:2520], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:55:34.976033Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_3_3404498052345499861_v1" sender [3:7561400455197052236:2520] lock partition 0 for ReadingSession "shared/user_3_3_3404498052345499861_v1" (Sender=[3:7561400455197052236:2520], Pipe=[3:7561400455197052245:2520], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-15T10:55:34.976074Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-15T10:55:34.976097Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000138s
2025-10-15T10:55:34.976510Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_3_3_3404498052345499861_v1" ClientId: "user" PipeClient { RawX1: 7561400455197052245 RawX2: 4503612512274904 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:55:34.976572Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:55:34.977072Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400455197052250:2526], now have 1 active actors on pipe
2025-10-15T10:55:34.977275Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7561400455197052250:2526]
2025-10-15T10:55:34.977462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:34.977494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:34.977559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_3_3404498052345499861_v1 on pipe: [3:7561400455197052250:2526]
2025-10-15T10:55:34.977633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.977652Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_3_3404498052345499861_v1:1 with generation 1
2025-10-15T10:55:34.977677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.977693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:34.977783Z node 4 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_3_3404498052345499861_v1
2025-10-15T10:55:34.977817Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.978008Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:55:34.980813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:55:34.980883Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:55:34.980909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.980921Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.980930Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.980954Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:34.980988Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:55:34.981327Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760525734973 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:55:34.981389Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T10:55:34.981465Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 sending to client partition status
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 CommittedOffset: 0 EndOffset: 0 }
2025-10-15T10:55:34.982351Z :INFO: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] Closing read session. Close timeout: 0.000000s
2025-10-15T10:55:34.982400Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:55:34.982446Z :INFO: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] Counters: { Errors: 0 CurrentSessionLifetimeMs: 49 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:55:34.982538Z :NOTICE: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-15T10:55:34.982580Z :DEBUG: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] [] Abort session to cluster
2025-10-15T10:55:34.983363Z :INFO: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] Closing read session. Close timeout: 0.000000s
2025-10-15T10:55:34.983403Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:55:34.983433Z :INFO: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 45 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:55:34.983479Z :NOTICE: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-15T10:55:34.983516Z :DEBUG: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] [] Abort session to cluster
2025-10-15T10:55:34.983541Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 grpc read done: success# 0, data# {  }
2025-10-15T10:55:34.983567Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 grpc read failed
2025-10-15T10:55:34.983604Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 grpc closed
2025-10-15T10:55:34.983634Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_2613369873048936796_v1 is DEAD
2025-10-15T10:55:34.984000Z :INFO: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] Closing read session. Close timeout: 0.000000s
2025-10-15T10:55:34.984036Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-15T10:55:34.984075Z :INFO: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] Counters: { Errors: 0 CurrentSessionLifetimeMs: 43 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:55:34.984127Z :NOTICE: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-15T10:55:34.984147Z :DEBUG: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] [] Abort session to cluster
2025-10-15T10:55:34.984192Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 grpc read done: success# 0, data# {  }
2025-10-15T10:55:34.984211Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 grpc read failed
2025-10-15T10:55:34.984230Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 grpc closed
2025-10-15T10:55:34.984254Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_10071255884527415362_v1 is DEAD
2025-10-15T10:55:34.984363Z :INFO: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] Closing read session. Close timeout: 0.000000s
2025-10-15T10:55:34.984404Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-15T10:55:34.984443Z :INFO: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] Counters: { Errors: 0 CurrentSessionLifetimeMs: 44 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:55:34.984515Z :NOTICE: [/Root] [/Root] [8259fd15-5c764741-bfa0cf33-135a08c5] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:55:34.984643Z :INFO: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] Closing read session. Close timeout: 0.000000s
2025-10-15T10:55:34.984665Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:55:34.984688Z :INFO: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 46 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:55:34.984725Z :NOTICE: [/Root] [/Root] [68ae88ce-acd4bd50-4fe65694-606d9ec7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:55:34.984683Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400455197052241:2516] disconnected; active server actors: 1
2025-10-15T10:55:34.984719Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400455197052241:2516] client user disconnected session shared/user_3_1_2613369873048936796_v1
2025-10-15T10:55:34.984775Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:55:34.984826Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-15T10:55:34.984853Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-15T10:55:34.984877Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-10-15T10:55:34.985157Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400455197052240:2517] disconnected; active server actors: 1
2025-10-15T10:55:34.985187Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400455197052240:2517] client user disconnected session shared/user_3_2_10071255884527415362_v1
2025-10-15T10:55:34.985213Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:55:34.985252Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-15T10:55:34.985275Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:55:34.985295Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000026s
2025-10-15T10:55:34.985414Z :INFO: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] Closing read session. Close timeout: 0.000000s
2025-10-15T10:55:34.985445Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:55:34.985470Z :INFO: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] Counters: { Errors: 0 CurrentSessionLifetimeMs: 52 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:55:34.985510Z :NOTICE: [/Root] [/Root] [2512e1d2-1dbf3d07-62211e00-198a7f64] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:55:34.985845Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 grpc read done: success# 0, data# {  }
2025-10-15T10:55:34.986393Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_3_3404498052345499861_v1
2025-10-15T10:55:34.985864Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 grpc read failed
2025-10-15T10:55:34.985885Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 grpc closed
2025-10-15T10:55:34.986453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561400455197052250:2526] destroyed
2025-10-15T10:55:34.985916Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_3404498052345499861_v1 is DEAD
2025-10-15T10:55:34.986499Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_3_3404498052345499861_v1
2025-10-15T10:55:34.986824Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400455197052245:2520] disconnected; active server actors: 1
2025-10-15T10:55:34.986845Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400455197052245:2520] client user disconnected session shared/user_3_3_3404498052345499861_v1
2025-10-15T10:55:35.074330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.074368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.074381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.174713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.174746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.174760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.397781Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7561400459492019557:2527]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-15T10:55:35.433277Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7561400459492019557:2527]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:55:35.547413Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7561400459492019557:2527]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:55:35.747906Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7561400459492019557:2527]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:55:35.810152Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:55:35.810182Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:55:35.973079Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7561400459492019557:2527]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:12.895794Z :WaitEventBlocksBeforeDiscovery INFO: Random seed for debugging is 1760525592895728
2025-10-15T10:53:13.472381Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561399848746851363:2075];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:13.472441Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:13.612932Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:13.692288Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7561399846081395594:2218];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:13.692367Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:13.753617Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/001076/r3tmp/tmpujF8M6/pdisk_1.dat
2025-10-15T10:53:14.002354Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:14.030839Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:14.246060Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:14.293537Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:14.420632Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:14.519608Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:14.519913Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:14.524538Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:14.524626Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:14.530307Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:14.530370Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:14.548166Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:14.561181Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T10:53:14.562008Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:14.669867Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 1562, node 1
2025-10-15T10:53:14.723537Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:14.849032Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:14.971461Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/001076/r3tmp/yandexH8ajjP.tmp
2025-10-15T10:53:14.971483Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/001076/r3tmp/yandexH8ajjP.tmp
2025-10-15T10:53:14.971615Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/001076/r3tmp/yandexH8ajjP.tmp
2025-10-15T10:53:14.971721Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:15.038936Z INFO: TTestServer started on Port 5793 GrpcPort 1562
TClient is connected to server localhost:5793
PQClient connected to localhost:1562
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:15.890262Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:18.474741Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561399848746851363:2075];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:18.474804Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:18.692709Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7561399846081395594:2218];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:18.693033Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:21.292940Z node 1 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k7kr1dj9b4wj872b7hqvzy11", Request deadline has expired for 0.069564s seconds
2025-10-15T10:53:21.970282Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7561399880441134114:2298], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:21.972407Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=MTljNmUwMWQtODQ4NzUyNzctNWU3NDg2NGYtODgxYmEyNmY=, ActorId: [2:7561399880441134112:2297], ActorState: ExecuteState, TraceId: 01k7kr1je2c7gn3qthygnx5vfm, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:21.971732Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:21.974491Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7561399883106590773:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:21.975524Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=MTkyOGRlLTcxZWEwYjczLWZmYzI5ZWVmLWZlMmVhMDI4, ActorId: [1:7561399883106590770:2328], ActorState: ExecuteState, TraceId: 01k7kr1jh5erxafe190nkx0je2, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:21.979049Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:21.979672Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:22.131607Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:22.427825Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:1562", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:22.946439Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k7kr1ksg60k764vpqyjpmc8y, Database: , SessionId: ydb://session/3?node_id=1&id=N2ZjNTE2YWItZDk3NDIyMDUtZWM0YmJkM2MtZmVhNGQ1MjE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561399887401558530:2985] 
=== CheckClustersList. Ok
2025-10-15T10:53:28.656211Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:1562
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:28.903366Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:1562
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:29.028239Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:29.037389Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561399913171362823:3284] connected; active server actors: 1
2025-10-15T10:53:29.042542Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:29.047651Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:29.049418Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:29.042838Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:29.042916Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:29.042955Z node 1 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:29.045774Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399913171362822:3283], now have 1 active actors on pipe
2025-10-15T10:53:29.046289Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:29.062650Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:29.062749Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1
2025-10-15T10:53:29.063415Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7561399914800872903:2381], now have 1 active actors on pipe
2025-10-15T10:53:29.068191Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:29.091174Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399917466330201:3346], now have 1 active actors on pipe
2025-10-15T10:53:29.091461Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:29.122551Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:29.123877Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:29.123992Z node 1 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:29.124331Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:29.124655Z node 1 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7561399917466330211:2452]
2025-10-15T10:53:29.142315Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:29.142380Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:29.142433Z node 1 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [1:7561399917466330211:2452]
2025-10-15T10:53:29.142487Z node 1 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:29.144147Z node 1 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:29.144210Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.144345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.144355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:29.144379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:29.144393Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.144403Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.144412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:29.144476Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:29.144946Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:29.145103Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:29.162940Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:29.163101Z node 1 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525609129, TxId 281474976715676
2025-10-15T10:53:29.163124Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.163146Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.163281Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.163542Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:29.173489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:29.173807Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:29.173842Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.173853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.173871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.173902Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:29.174259Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:29.174360Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:29.174660Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:29.189748Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:29.189780Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:29.193019Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:29.193146Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:29.201074Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:29.247586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.247625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.247635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.355744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.356154Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.356164Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.467477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.467572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.467583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.560839Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715679. Ctx: { TraceId: 01k7kr1t0p6h9vg623hdww3a9q, Database: , SessionId: ydb://session/3?node_id=1&id=OTVlMTdmOTEtOTAzMTc0NmYtYzZkNTY5OGItOGI5Njhi, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-15T10:53:29.561248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.561258Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.561267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525609129
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525609129
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:1562
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:29.631624Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:29.663655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.663691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.663701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.767669Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.767699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.767709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.868296Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.868332Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.868341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:29.971716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:29.971742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:29.971752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.073479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.073523Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.073534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:1562
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:30.143603Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:30.176044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.176076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.176086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.280126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.280160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.280172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.383678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.383712Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.383723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.488108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.488138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.488147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.586358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.586390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.586399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:1562
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:30.654945Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:30.671167Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:30.671618Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:30.671652Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:1562
2025-10-15T10:53:30.687844Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.687872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.687892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.708337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:30.708377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:30.735229Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:30.736189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:30.736358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:47804
2025-10-15T10:53:30.736387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:47804 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:30.736397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:30.738589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:30.738743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:30.738757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:30.738766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:30.738782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399921761297743:2488] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:30.757541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399921761297743:2488] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:30.791603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.791636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.791646Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.892680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.892703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.892723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:30.995531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:30.995555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:30.995566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.095753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.095783Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.095793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.196151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.196177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.196187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.296651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.296689Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.296700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.301909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399921761297743:2488] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:31.303269Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399926056265092:2488] connected; active server actors: 1
2025-10-15T10:53:31.303988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399921761297743:2488] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:31.304019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399921761297743:2488] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:31.307822Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399926056265092:2488] disconnected; active server actors: 1
2025-10-15T10:53:31.307857Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399926056265092:2488] disconnected no session
2025-10-15T10:53:31.399619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.399650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.399661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.562010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.562035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.562044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.616157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399921761297743:2488] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:31.616206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399921761297743:2488] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:31.616232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399921761297743:2488] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:31.616261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:31.627491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-10-15T10:53:31.627557Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399926056265136:2488], now have 1 active actors on pipe
2025-10-15T10:53:31.631462Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:31.631517Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:31.631635Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|44ba47c6-701b1c69-738c6a64-9cee1633_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:31.631682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.631705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.631715Z node 1 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:31.631761Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.631803Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:31.631876Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:31.632407Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:31.632429Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:31.632522Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:31.632651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|44ba47c6-701b1c69-738c6a64-9cee1633_0
2025-10-15T10:53:31.636054Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525611636 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:31.636216Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|44ba47c6-701b1c69-738c6a64-9cee1633_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:31.636606Z :INFO: [] MessageGroupId [src] SessionId [src|44ba47c6-701b1c69-738c6a64-9cee1633_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:31.636646Z :INFO: [] MessageGroupId [src] SessionId [src|44ba47c6-701b1c69-738c6a64-9cee1633_0] Write session will now close
2025-10-15T10:53:31.636720Z :DEBUG: [] MessageGroupId [src] SessionId [src|44ba47c6-701b1c69-738c6a64-9cee1633_0] Write session: aborting
2025-10-15T10:53:31.637160Z :INFO: [] MessageGroupId [src] SessionId [src|44ba47c6-701b1c69-738c6a64-9cee1633_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:31.637201Z :DEBUG: [] MessageGroupId [src] SessionId [src|44ba47c6-701b1c69-738c6a64-9cee1633_0] Write session: destroy
2025-10-15T10:53:31.638392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|44ba47c6-701b1c69-738c6a64-9cee1633_0 grpc read done: success: 0 data: 
2025-10-15T10:53:31.638425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|44ba47c6-701b1c69-738c6a64-9cee1633_0 grpc read failed
2025-10-15T10:53:31.638458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|44ba47c6-701b1c69-738c6a64-9cee1633_0 grpc closed
2025-10-15T10:53:31.638472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|44ba47c6-701b1c69-738c6a64-9cee1633_0 is DEAD
2025-10-15T10:53:31.639659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:31.640344Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399926056265136:2488] destroyed
2025-10-15T10:53:31.640470Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:31.640522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.640543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.640565Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.663559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.663588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.663622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Before ReadSession was created
Session was created
Returned from WaitEvent
2025-10-15T10:53:31.763962Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.764005Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.764016Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.864686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.864714Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.864722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:31.964773Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:31.964805Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:31.964815Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:32.064982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.065012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.065022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:32.165202Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.165229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.165239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:32.267499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.267527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.267537Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:32.372008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.372042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.372063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:32.474055Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.474091Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.474101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:32.574379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.574409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.574421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:32.675665Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.675707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.675719Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session blocked successfully
Session closed gracefully
2025-10-15T10:53:32.779853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.779883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.779895Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:32.882763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.882798Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.882811Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:32.983568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:32.983593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:32.983602Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:33.091580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:33.091607Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:33.091618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:33.189703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:33.189727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:33.189737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:33.290224Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:33.290247Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:33.290256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:33.390760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:33.390786Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:33.390795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:33.497672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:33.497698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:33.497707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:33.598550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:33.598576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:33.598585Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:33.702794Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:33.702820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:33.702830Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:33.803031Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:33.803053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:33.803062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:33.904012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:33.904036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:33.904046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.007466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.007492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.007503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.108070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.108101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.108114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.145555Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:34.212113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.212144Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.212155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.315940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.315971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.315985Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.419896Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.419928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.419948Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.523616Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.523649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.523661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.627012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.627038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.627048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.727834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.727860Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.727872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.828110Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.828140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.828151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:34.928485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:34.928515Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:34.928526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.028852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.028878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.028887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.129191Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.129226Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.129238Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.229556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.229590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.229601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.329898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.329927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.329938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.430248Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.430275Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.430286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.530578Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.530605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.530617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.632092Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.632121Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.632132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.735792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.735822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.735836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.840313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.840345Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.840356Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:35.940190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:35.940222Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:35.940246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.041530Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.041561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.041571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.146677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.146706Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.146717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.247882Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.247915Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.247926Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.348028Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.348060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.348071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.452151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.452189Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.452200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.555982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.556022Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.556032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.656078Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.656107Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.656119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.756321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.756348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.756358Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.858549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.858577Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.858587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:36.959112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:36.959140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:36.959153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.059514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.059545Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.059557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.163978Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.164008Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.164019Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.267606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.267638Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.267651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.367686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.367716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.367727Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.471617Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.471647Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.471659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.575789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.575817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.575829Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.677410Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.677436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.677446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.779630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.779661Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.779672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.887912Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.887938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.887949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:37.990983Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:37.991011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:37.991020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.095641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.095672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.095684Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.199784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.199812Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.199824Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.300266Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.300306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.300316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.404034Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.404074Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.404087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.507384Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.507418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.507429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.607922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.607946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.607954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.711528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.711558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.711570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.811747Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.811782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.811793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:38.915637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:38.915666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:38.915676Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.016048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.016076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.016087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.117259Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.117286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.117295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.147185Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:39.218079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.218108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.218118Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.321479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.321507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.321518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.426274Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.426301Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.426313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.527170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.527199Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.527209Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.628544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.628574Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.628583Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.735483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.735511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.735526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.836570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.836599Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.836608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.943561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.943600Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.943612Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.043642Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.043675Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.043687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.144782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.144810Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.144820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.249849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.249878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.249889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.351739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.351767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.351778Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.459469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.459503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.459514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.560084Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.560114Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.560126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.663698Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.663723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.663737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.768037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.768063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.768076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.871553Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.871587Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.871601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.974201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.974233Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.974246Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.079480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.079510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.079524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.183453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.183482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.183492Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.284336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.284361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.284371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.387660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.387691Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.387701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.491461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.491486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.491497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.590508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.590529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.590540Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.692708Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.692742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.692753Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.795721Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.795752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.795764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.899808Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.899838Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.899852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.003702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.003732Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.003744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.107156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.107186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.107197Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.208376Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.208407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.208417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.310966Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.311000Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.311012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.415462Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.415494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.415507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.517699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.517738Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.517750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.619672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.619705Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.619716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.723764Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.723792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.723802Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.831481Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.831514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.831527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.928415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.928442Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.928454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.029172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.029201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.029213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.131854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.131880Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.131890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.235843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.235869Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.235878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.340112Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.340127Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.340136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.447666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.447694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.447704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.551454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.551485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.551495Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.652142Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.652173Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.652185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.752618Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.752645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.752654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.855267Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.855292Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.855302Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.962343Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.962371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.962383Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.063816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.063843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.063854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.147967Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:44.166054Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.166086Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.166099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.267002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.267035Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.267049Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.367629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.367660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.367672Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.470755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.470785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.470797Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.571017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.571063Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.571075Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.671457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.671489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.671502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.772412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.772440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.772452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.875667Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.875703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.875716Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.980390Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.980419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.980429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.083542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.083572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.083584Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.185155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.185188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.185198Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.289780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.289809Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.289820Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.392108Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.392140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.392151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.499659Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.499690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.499701Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.603529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.603564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.603576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.702816Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.702845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.702857Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.804723Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.804755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.804767Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.904252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.904287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.904311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.007650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.007682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.007694Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.111872Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.111908Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.111920Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.215475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.215514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.215527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.315630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.315666Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.315678Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.415801Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.415832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.415845Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.515973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.515997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.516007Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.619294Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.619323Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.619335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.720071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.720099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.720111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.820295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.820324Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.820336Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.920652Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.920677Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.920688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.023601Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.023635Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.023645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.127868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.127909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.127921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.229215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.229251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.229263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.331477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.331513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.331524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.431528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.431561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.431575Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.536648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.536687Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.536702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.635890Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.635922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.635934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.736382Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.736415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.736427Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.838511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.838550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.838562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.941593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.941625Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.941637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.041997Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.042025Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.042038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.144085Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.144122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.144134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.244101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.244129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.244140Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.347861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.347899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.347909Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.451468Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.451499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.451510Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.555756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.555784Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.555795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.658717Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.658744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.658755Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.759139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.759172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.759184Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.862606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.862640Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.862651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.967885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.967919Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.967930Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.071498Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.071528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.071539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.151720Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:49.171011Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.171040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.171051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.271756Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.271789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.271799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.371928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.371960Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.371970Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.475469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.475497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.475508Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.580529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.580557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.580568Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.687469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.687500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.687511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.791460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.791489Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.791501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.896486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.896516Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.896529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.996455Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.996483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.996493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.096426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.096453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.096464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.199469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.199507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.199519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.302136Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.302167Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.302187Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.407739Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.407775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.407787Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.504269Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.504305Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.504316Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.617366Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.617392Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.617402Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.717758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.717789Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.717799Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.819593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.819615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.819623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.923444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.923474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.923485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.027500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.027528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.027539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.131469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.131501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.131511Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.231557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.231582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.231593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.330148Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.330178Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.330190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.435480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.435513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.435524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.535702Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.535731Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.535742Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.637800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.637828Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.637839Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.739696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.739722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.739733Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.847526Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.847559Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.847571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.946299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.946330Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.946340Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.047680Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.047709Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.047720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.149724Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.149766Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.149779Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.250119Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.250147Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.250160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.350821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.350854Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.350868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.451071Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.451101Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.451113Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.551046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.551079Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.551099Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.653922Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.653957Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.653971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.753772Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.753804Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.753817Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.857138Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.857172Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.857185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.956322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.956350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.956361Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.055300Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.055333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.055364Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.155892Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.155917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.155928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.259608Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.259641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.259653Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.362939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.362974Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.362986Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.463451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.463485Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.463497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.563889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.563921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.563932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.668190Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.668223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.668240Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.768546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.768582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.768594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.872017Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.872047Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.872059Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.976606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.976634Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.976644Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.079475Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.079507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.079519Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.154312Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:54.180006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.180036Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.180048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.281348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.281377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.281387Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.387517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.387544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.387555Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.491486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.491513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.491524Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.591029Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.591062Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.591073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.694436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.694470Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.694483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.795606Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.795637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.795645Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.902720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.902750Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.902760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.003596Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.003624Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.003636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.104434Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.104463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.104474Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.207528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.207563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.207576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.307849Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.307878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.307891Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.411466Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.411500Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.411512Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.511421Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.511451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.511464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.611775Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.611806Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.611818Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.712939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.712976Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.712989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.815887Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.815923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.815936Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.915898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.915928Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.915939Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.019562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.019598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.019609Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.119649Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.119682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.119695Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.223534Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.223560Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.223570Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.324965Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.325001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.325012Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.430276Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.430311Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.430322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.530938Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.530969Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.530980Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.630655Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.630685Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.630697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.735641Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.735674Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.735686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.835494Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.835532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.835544Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.934273Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.934309Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.934321Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.036889Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.036921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.036932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.141414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.141440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.141451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.242856Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.242883Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.242894Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.342973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.343004Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.343013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.444088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.444126Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.444134Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.545876Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.545901Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.545910Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.647726Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.647752Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.647763Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.747793Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.747821Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.747831Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.855446Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.855480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.855491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.956760Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.956785Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.956795Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.059497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.059527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.059538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.163408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.163438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.163449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.268060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.268088Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.268098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.371934Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.371961Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.371973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.475836Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.475861Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.475871Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.579843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.579870Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.579881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.681186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.681213Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.681223Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.781905Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.781932Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.781942Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.884160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.884186Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.884196Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.987513Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.987546Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.987556Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.059505Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:53:59.059594Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-15T10:53:59.060354Z node 1 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:53:59.061188Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-15T10:53:59.061679Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:53:59.064806Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-15T10:53:59.087502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.087528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.087538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.156811Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:59.187156Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.187188Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.187201Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.287483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.287531Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.287543Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.390557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.390598Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.390614Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.490937Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.490973Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.490992Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.591357Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.591396Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.591411Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.691819Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.691853Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.691866Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.792250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.792284Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.792299Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.895571Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.895603Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.895615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.002541Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.002581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.002593Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.103605Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.103637Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.103658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.204002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.204039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.204052Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.307588Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.307620Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.307633Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.413407Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.413450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.413463Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.515507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.515539Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.515550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.619379Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.619415Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.619429Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.722215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.722252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.722264Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.825359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.825386Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.825399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.924886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.924917Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.924929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.027792Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.027822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.027835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.128040Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.128080Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.128093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.229391Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.229419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.229428Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.329823Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.329855Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.329868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.432304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.432338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.432350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.532538Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.532566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.532579Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.633104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.633139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.633153Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.733291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.733322Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.733333Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.836203Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.836239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.836251Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.940419Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.940450Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.940461Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.040822Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.040851Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.040864Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.143253Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.143283Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.143295Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.247257Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.247291Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.247304Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.352377Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.352414Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.352426Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.451650Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.451688Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.451700Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.551925Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.551955Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.551979Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.652418Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.652441Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.652449Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.759520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.759562Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.759572Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.855964Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.855993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.856002Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.959743Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.959771Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.959782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.057660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.057686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.057699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.158982Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.159010Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.159020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.259480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.259506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.259518Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.365757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.365782Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.365800Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.471408Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.471443Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.471454Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.571916Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.571941Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.571950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.672231Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.672256Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.672268Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.775452Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.775482Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.775493Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.879476Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.879504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.879514Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.987590Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.987619Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.987630Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.091520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.091549Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.091558Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.159687Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:04.191460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.191491Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.191502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.292149Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.292176Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.292185Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.395690Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.395720Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.395744Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.499457Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.499488Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.499499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.599629Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.599660Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.599673Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.700502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.700532Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.700542Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.803664Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.803696Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.803707Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.907375Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.907409Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.907420Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.011843Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.011877Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.011886Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.115651Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.115686Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.115697Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.219440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.219469Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.219479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.319834Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.319868Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.319878Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.423480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.423517Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.423529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.527648Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.527682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.527693Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.628098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.628132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.628145Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.731528Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.731563Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.731576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.831451Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.831483Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.831497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.933399Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.933444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.933460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.039473Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.039507Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.039520Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.139001Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.139037Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.139050Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.239453Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.239484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.239497Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.342902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.342940Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.342954Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.443132Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.443166Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.443179Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.543991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.544020Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.544032Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.647412Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.647444Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.647456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.748109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.748139Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.748151Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.848791Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.848835Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.848846Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.949066Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.949093Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.949103Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.055885Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.055923Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.055935Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.157122Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.157159Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.157169Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.257200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.257239Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.257252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.363053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.363087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.363098Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.468070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.468104Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.468115Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.575487Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.575522Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.575535Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.675576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.675611Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.675623Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.779550Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.779581Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.779594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.880286Z node 1 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.880315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.880326Z node 1 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.027416Z :SimpleHandlers INFO: Random seed for debugging is 1760525649027397
2025-10-15T10:54:09.722700Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7561400089783097844:2077];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:54:09.722755Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:54:09.867425Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/001076/r3tmp/tmpUVqL3o/pdisk_1.dat
2025-10-15T10:54:09.911569Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:54:09.960944Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:54:09.961039Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:54:09.967733Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:54:10.249859Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:54:10.268471Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:54:10.415606Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:54:10.415765Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:54:10.415905Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:54:10.452867Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:54:10.452948Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:54:10.468945Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:54:10.470068Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-15T10:54:10.476118Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 2628, node 3
2025-10-15T10:54:10.579426Z node 4 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.015175s
2025-10-15T10:54:10.798299Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:54:10.820286Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:54:10.828435Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:54:10.865972Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/001076/r3tmp/yandexySOY8y.tmp
2025-10-15T10:54:10.865999Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/001076/r3tmp/yandexySOY8y.tmp
2025-10-15T10:54:10.866175Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/001076/r3tmp/yandexySOY8y.tmp
2025-10-15T10:54:10.866318Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:54:10.913392Z INFO: TTestServer started on Port 23541 GrpcPort 2628
2025-10-15T10:54:10.950463Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:23541
PQClient connected to localhost:2628
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:54:11.324063Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:54:14.723217Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7561400089783097844:2077];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:54:14.723319Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:54:15.968868Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7561400115552902631:2325], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:54:15.972109Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=OWE2ZDAwYzMtNmU5MjQ0NWYtMmFhODc4NDEtNjYxOWRkNDQ=, ActorId: [3:7561400115552902627:2323], ActorState: ExecuteState, TraceId: 01k7kr37s75ky12fwccbxr9wmc, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:54:15.972559Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:54:15.976911Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:54:16.114484Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:54:16.345772Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:54:16.477097Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7561400120408391268:2300], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:54:16.479194Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=ODkzZGFiMTEtNWNhNDMxYjktNzVkZjZmMjQtYmRlMzkyNjI=, ActorId: [4:7561400120408391266:2299], ActorState: ExecuteState, TraceId: 01k7kr38asbf80cq0mcrawp1pf, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:54:16.479669Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:2628", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:54:16.861327Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k7kr38fxeqssz7g3pj6rk2n3, Database: , SessionId: ydb://session/3?node_id=3&id=ZTZlZDQ4Mi1jODIzY2ZjLTM2ZGM3ZmY5LWNlZjVkOWUx, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7561400119847870322:2925] 
=== CheckClustersList. Ok
2025-10-15T10:54:23.194780Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710677:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:2628
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:54:23.333541Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:2628
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710678
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:54:23.503693Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7561400149912641942:3245] connected; active server actors: 1
2025-10-15T10:54:23.503903Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:54:23.509863Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:54:23.513706Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:54:23.517833Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:23.522835Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:23.523131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:54:23.523163Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:23.523216Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:54:23.524364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400149912641941:3244], now have 1 active actors on pipe
2025-10-15T10:54:23.524400Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400149912641972:2446], now have 1 active actors on pipe
2025-10-15T10:54:23.525435Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-15T10:54:23.525977Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:23.534042Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:23.547089Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400149912642003:3294], now have 1 active actors on pipe
2025-10-15T10:54:23.547932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:23.556624Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:23.557688Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:23.557737Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:54:23.557992Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:23.558193Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7561400150473162784:2377]
2025-10-15T10:54:23.561625Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:23.561664Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:23.561682Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7561400150473162784:2377]
2025-10-15T10:54:23.561704Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:54:23.563218Z node 4 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:54:23.563261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.563329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.563361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:23.563378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:54:23.563389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.563398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.563407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:54:23.563437Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:23.563900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:23.564032Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:23.568269Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:23.568394Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525663589, TxId 281474976710678
2025-10-15T10:54:23.568412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.568423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.568535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.568722Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:23.571941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:23.572161Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:23.572183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.572206Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.572223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.572252Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:23.572524Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:54:23.572593Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:23.572779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:23.581500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:23.581588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:23.583609Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:23.667587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.667614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.667625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.758822Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710679. Ctx: { TraceId: 01k7kr3f511v850ck8kcewz47e, Database: , SessionId: ydb://session/3?node_id=3&id=NTRjNzk3N2ItMmI0NmJhMTMtNGYyMjc5MGYtYTg1NDUyMWQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-15T10:54:23.769207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.769233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.769247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710678
    CreateStep: 1760525663589
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710678
    CreateStep: 1760525663589
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:2628
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:54:23.824022Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-15T10:54:23.871490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.871528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.871541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.974738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.974767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.974778Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.075889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.075920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.075933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.179307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.179336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.179363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.282299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.282336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.282348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:2628
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:54:24.337565Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:54:24.363995Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:54:24.364451Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:54:24.364485Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:2628
2025-10-15T10:54:24.382539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.382569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.382579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.394238Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:54:24.395281Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:24.395313Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:54:24.395738Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:54:24.395835Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:42430
2025-10-15T10:54:24.395848Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42430 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:24.395856Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:24.397616Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:54:24.397770Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:24.397781Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:24.397790Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:24.397805Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561400154207609451:2478] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:24.400295Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561400154207609451:2478] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:24.490719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.490747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.490757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.591803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.591829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.591840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.695855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.695882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.695893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.798770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.798814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.798826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.899138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.899171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.899181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.999895Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7561400154207609451:2478] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:54:25.003463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.003498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.003508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.010321Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400154207609511:2478] connected; active server actors: 1
2025-10-15T10:54:25.010446Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7561400154207609451:2478] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:54:25.010458Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400154207609451:2478] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:25.012048Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400154207609511:2478] disconnected; active server actors: 1
2025-10-15T10:54:25.012065Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400154207609511:2478] disconnected no session
2025-10-15T10:54:25.107685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.107716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.107726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.174991Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400154207609451:2478] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:25.175026Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561400154207609451:2478] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:54:25.175042Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400154207609451:2478] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:25.175068Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:25.179503Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400158502576847:2478], now have 1 active actors on pipe
2025-10-15T10:54:25.179792Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:54:25.180111Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.180148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.180214Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|102103b7-84ec43e2-b7a20896-51b70057_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:54:25.180251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.180267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.180275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:25.180327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.180362Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:25.180403Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:25.181495Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.181518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.181575Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:25.182781Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525665182 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:25.182870Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|102103b7-84ec43e2-b7a20896-51b70057_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:25.183081Z :INFO: [] MessageGroupId [src] SessionId [src|102103b7-84ec43e2-b7a20896-51b70057_0] Write session: close. Timeout = 0 ms
2025-10-15T10:54:25.183140Z :INFO: [] MessageGroupId [src] SessionId [src|102103b7-84ec43e2-b7a20896-51b70057_0] Write session will now close
2025-10-15T10:54:25.183191Z :DEBUG: [] MessageGroupId [src] SessionId [src|102103b7-84ec43e2-b7a20896-51b70057_0] Write session: aborting
2025-10-15T10:54:25.182040Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|102103b7-84ec43e2-b7a20896-51b70057_0
2025-10-15T10:54:25.183714Z :INFO: [] MessageGroupId [src] SessionId [src|102103b7-84ec43e2-b7a20896-51b70057_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:54:25.183767Z :DEBUG: [] MessageGroupId [src] SessionId [src|102103b7-84ec43e2-b7a20896-51b70057_0] Write session: destroy
2025-10-15T10:54:25.184747Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|102103b7-84ec43e2-b7a20896-51b70057_0 grpc read done: success: 0 data: 
2025-10-15T10:54:25.184765Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|102103b7-84ec43e2-b7a20896-51b70057_0 grpc read failed
2025-10-15T10:54:25.184790Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|102103b7-84ec43e2-b7a20896-51b70057_0 grpc closed
2025-10-15T10:54:25.184807Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|102103b7-84ec43e2-b7a20896-51b70057_0 is DEAD
2025-10-15T10:54:25.185480Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:54:25.188364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561400158502576847:2478] destroyed
2025-10-15T10:54:25.188406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:54:25.188430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.188441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.188450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.208487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.219412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.219437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.235239Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:54:25.235263Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:54:25.312137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.312167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.312177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Session was created
>>> Ready to answer: ok
2025-10-15T10:54:25.374433Z :INFO: [/Root] [] [7c8afb2d-a837bbb3-48f159f4-df148ab6] Open read subsessions to databases: { name: dc1, endpoint: localhost:2628, path: /Root }, { name: dc2, endpoint: localhost:2628, path: /Root }, { name: dc3, endpoint: localhost:2628, path: /Root }
2025-10-15T10:54:25.415564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.415597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.415613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.415943Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Starting read session
2025-10-15T10:54:25.416003Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Starting single session
2025-10-15T10:54:25.421027Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:25.421094Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:25.421142Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:54:25.424289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-15T10:54:25.441737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-15T10:54:25.442418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:2628
2025-10-15T10:54:25.451658Z :INFO: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Starting read session
2025-10-15T10:54:25.465064Z :DEBUG: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Starting single session
2025-10-15T10:54:25.465268Z :DEBUG: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:25.465312Z :DEBUG: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:25.465357Z :DEBUG: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:54:25.465596Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Successfully connected. Initializing session
2025-10-15T10:54:25.467559Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:54:25.467597Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-15T10:54:25.474723Z :INFO: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Starting read session
2025-10-15T10:54:25.474768Z :DEBUG: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Starting single session
2025-10-15T10:54:25.474899Z :DEBUG: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:25.474924Z :DEBUG: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:25.474954Z :DEBUG: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T10:54:25.475824Z :DEBUG: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] [] Successfully connected. Initializing session
2025-10-15T10:54:25.476874Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:54:25.476899Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-15T10:54:25.478004Z :DEBUG: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] [] Successfully connected. Initializing session
2025-10-15T10:54:25.503877Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:54:25.503879Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:54:25.504313Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read init: from# ipv6:[::1]:42440, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:54:25.504422Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T10:54:25.504438Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-15T10:54:25.504821Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 read init: from# ipv6:[::1]:42440, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:54:25.504931Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 auth for : user
2025-10-15T10:54:25.505088Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 auth for : user
2025-10-15T10:54:25.507609Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:54:25.507814Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 read init: from# ipv6:[::1]:42440, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T10:54:25.508200Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 auth for : user
2025-10-15T10:54:25.508696Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Handle describe topics response
2025-10-15T10:54:25.508864Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 auth is DEAD
2025-10-15T10:54:25.508962Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:54:25.510302Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:54:25.511544Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 Handle describe topics response
2025-10-15T10:54:25.511655Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 auth is DEAD
2025-10-15T10:54:25.511725Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:54:25.512620Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:54:25.513412Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576874:2500] connected; active server actors: 1
2025-10-15T10:54:25.513554Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 Handle describe topics response
2025-10-15T10:54:25.513632Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 auth is DEAD
2025-10-15T10:54:25.513698Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 auth ok: topics# 1, initDone# 0
2025-10-15T10:54:25.514519Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T10:54:25.515816Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got InitResponse. ReadSessionId: shared/user_3_1_2543886588194940179_v1
2025-10-15T10:54:25.515891Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:25.515700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.515735Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.515747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.516102Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:25.516251Z :INFO: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] [] Got InitResponse. ReadSessionId: shared/user_3_2_5033013796418176116_v1
2025-10-15T10:54:25.516278Z :DEBUG: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:25.516424Z :DEBUG: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:25.516533Z :INFO: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] [] Got InitResponse. ReadSessionId: shared/user_3_3_16701149177465999335_v1
2025-10-15T10:54:25.516573Z :DEBUG: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T10:54:25.516780Z :DEBUG: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:25.515300Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7561400158502576874:2500] session shared/user_3_1_2543886588194940179_v1
2025-10-15T10:54:25.515404Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T10:54:25.515479Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T10:54:25.515528Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_2543886588194940179_v1" (Sender=[3:7561400158502576861:2500], Pipe=[3:7561400158502576874:2500], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:54:25.515565Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:54:25.515619Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576876:2502] connected; active server actors: 1
2025-10-15T10:54:25.515636Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576879:2504] connected; active server actors: 1
2025-10-15T10:54:25.515681Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T10:54:25.515764Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_2543886588194940179_v1" (Sender=[3:7561400158502576861:2500], Pipe=[3:7561400158502576874:2500], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:54:25.515846Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_2543886588194940179_v1" sender [3:7561400158502576861:2500] lock partition 0 for ReadingSession "shared/user_3_1_2543886588194940179_v1" (Sender=[3:7561400158502576861:2500], Pipe=[3:7561400158502576874:2500], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-15T10:54:25.515916Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T10:54:25.515949Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000242s
2025-10-15T10:54:25.517484Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_1_2543886588194940179_v1" ClientId: "user" PipeClient { RawX1: 7561400158502576874 RawX2: 4503612512274884 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T10:54:25.517632Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T10:54:25.519829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:25.519068Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7561400158502576876:2502] session shared/user_3_2_5033013796418176116_v1
2025-10-15T10:54:25.519145Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_5033013796418176116_v1" (Sender=[3:7561400158502576863:2502], Pipe=[3:7561400158502576876:2502], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:54:25.519175Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:54:25.519209Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7561400158502576879:2504] session shared/user_3_3_16701149177465999335_v1
2025-10-15T10:54:25.519244Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_16701149177465999335_v1" (Sender=[3:7561400158502576868:2504], Pipe=[3:7561400158502576879:2504], Partitions=[], ActiveFamilyCount=0)
2025-10-15T10:54:25.519296Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-15T10:54:25.519356Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-15T10:54:25.519384Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000066s
2025-10-15T10:54:25.519489Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:54:25.519561Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 50e241c4-2bf8037e-5613f6df-2e817f4f
2025-10-15T10:54:25.519635Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:25.519649Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-15T10:54:25.519779Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:54:25.519822Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 got read request: guid# 6dd99bf2-549155e0-d31d7c32-97df7c96
2025-10-15T10:54:25.519857Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T10:54:25.519887Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 got read request: guid# 4accd30d-2ab1adb4-102980d2-bff80a8e
2025-10-15T10:54:25.524664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400158502576883:2511], now have 1 active actors on pipe
2025-10-15T10:54:25.523016Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:25.523173Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:42440
2025-10-15T10:54:25.523189Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42440 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:25.523202Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:25.525278Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7561400158502576883:2511]
2025-10-15T10:54:25.526370Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-15T10:54:25.526476Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:25.526486Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:25.526494Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:25.526510Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:25.529334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.529395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.529470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_1_2543886588194940179_v1 on pipe: [3:7561400158502576883:2511]
2025-10-15T10:54:25.529552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.529576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.529594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:25.529667Z node 4 :PERSQUEUE DEBUG: partition.cpp:3754: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_1_2543886588194940179_v1
2025-10-15T10:54:25.529699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.529871Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:25.530467Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_1_2543886588194940179_v1:1 with generation 1
2025-10-15T10:54:25.534681Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:25.537641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:25.537754Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:25.537781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.537794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.537805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.537840Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:25.537883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T10:54:25.538690Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760525665515 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T10:54:25.538766Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T10:54:25.538854Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 sending to client partition status
2025-10-15T10:54:25.543063Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-15T10:54:25.543917Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-15T10:54:25.544079Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-15T10:54:25.545094Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-15T10:54:25.545142Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-15T10:54:25.548466Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:54:25.549128Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576907:2512] connected; active server actors: 1
2025-10-15T10:54:25.549199Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-15T10:54:25.549218Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:25.550994Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576907:2512] disconnected; active server actors: 1
2025-10-15T10:54:25.551018Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576907:2512] disconnected no session
2025-10-15T10:54:25.577246Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:25.577288Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:54:25.577307Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:25.577339Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:25.580203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400158502576918:2512], now have 1 active actors on pipe
2025-10-15T10:54:25.580866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.580897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.580968Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:25.581000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.581014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.581023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:25.581057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.581096Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:25.581144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:25.580534Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:54:25.582063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.582086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.582147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:25.582557Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0
2025-10-15T10:54:25.583208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525665583 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:25.583451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:25.583873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 1 to 1
2025-10-15T10:54:25.584005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.584052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-15T10:54:25.584303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 2 to 2
2025-10-15T10:54:25.584347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.584371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-15T10:54:25.584415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 3 to 3
2025-10-15T10:54:25.584445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.584465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-15T10:54:25.584499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 4 to 4
2025-10-15T10:54:25.584533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.584550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-15T10:54:25.584580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 5 to 5
2025-10-15T10:54:25.584610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.584628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-15T10:54:25.584659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 6 to 6
2025-10-15T10:54:25.584723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.584746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-15T10:54:25.584816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 7 to 7
2025-10-15T10:54:25.584852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.584870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-15T10:54:25.584458Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.584692Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.584926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 8 to 8
2025-10-15T10:54:25.584960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.584976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-15T10:54:25.585006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 9 to 9
2025-10-15T10:54:25.585029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-15T10:54:25.585077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 10 to 10
2025-10-15T10:54:25.585115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-15T10:54:25.585178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 11 to 11
2025-10-15T10:54:25.585213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-15T10:54:25.585264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 12 to 12
2025-10-15T10:54:25.585298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-15T10:54:25.585348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 13 to 13
2025-10-15T10:54:25.585373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-15T10:54:25.585427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 14 to 14
2025-10-15T10:54:25.585455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-15T10:54:25.585506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 15 to 15
2025-10-15T10:54:25.585535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-15T10:54:25.585592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 16 to 16
2025-10-15T10:54:25.585643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-15T10:54:25.585715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 17 to 17
2025-10-15T10:54:25.585748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-15T10:54:25.585800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 18 to 18
2025-10-15T10:54:25.585827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-15T10:54:25.585883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 19 to 19
2025-10-15T10:54:25.585911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.585933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-15T10:54:25.585995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 20 to 20
2025-10-15T10:54:25.586033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-15T10:54:25.586083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 21 to 21
2025-10-15T10:54:25.586116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-15T10:54:25.586167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 22 to 22
2025-10-15T10:54:25.586193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-15T10:54:25.586257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 23 to 23
2025-10-15T10:54:25.586289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-15T10:54:25.586348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 24 to 24
2025-10-15T10:54:25.586381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-15T10:54:25.586446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 25 to 25
2025-10-15T10:54:25.586482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-15T10:54:25.586546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 26 to 26
2025-10-15T10:54:25.586587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-15T10:54:25.586646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 27 to 27
2025-10-15T10:54:25.586675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-15T10:54:25.586741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 28 to 28
2025-10-15T10:54:25.586782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-15T10:54:25.586851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 29 to 29
2025-10-15T10:54:25.586887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-15T10:54:25.586939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 30 to 30
2025-10-15T10:54:25.586964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.586982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-15T10:54:25.587017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 31 to 31
2025-10-15T10:54:25.587045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.587061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-15T10:54:25.587107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 32 to 32
2025-10-15T10:54:25.587146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.587167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-15T10:54:25.587208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 33 to 33
2025-10-15T10:54:25.587236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.587256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-15T10:54:25.587303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 34 to 34
2025-10-15T10:54:25.587338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.591536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-15T10:54:25.592112Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.592377Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.592752Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.592906Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.593168Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.593334Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.593573Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.593714Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.593932Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.594146Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.594340Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.594547Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.594919Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.595103Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.595327Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.595659Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.595870Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.596329Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.596675Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.596953Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.597173Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.597392Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.597644Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.597881Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.598113Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.598322Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.598629Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.598944Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.600010Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.600050Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.600104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.600114Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.600157Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.600170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.600231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.600246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.600275Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.600287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.600395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:54:25.600436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-10-15T10:54:25.600452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 3
2025-10-15T10:54:25.600471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 4
2025-10-15T10:54:25.600487Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 5
2025-10-15T10:54:25.603197Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.603281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.603306Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.603372Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.603396Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.603681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.603766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.603793Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.604229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 35 to 35
2025-10-15T10:54:25.603824Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.603853Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.604323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.604364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-15T10:54:25.604412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 36 to 36
2025-10-15T10:54:25.604473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.604497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-15T10:54:25.604553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 37 to 37
2025-10-15T10:54:25.604607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.604629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-15T10:54:25.604667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 38 to 38
2025-10-15T10:54:25.604749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.604771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-15T10:54:25.604830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 39 to 39
2025-10-15T10:54:25.604547Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.604883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.604910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-15T10:54:25.604971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 40 to 40
2025-10-15T10:54:25.605040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.605067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-15T10:54:25.605131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 41 to 41
2025-10-15T10:54:25.604903Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.605189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.605212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-15T10:54:25.605267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 42 to 42
2025-10-15T10:54:25.605322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.605349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-15T10:54:25.605183Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.605414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 43 to 43
2025-10-15T10:54:25.605587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.605609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-15T10:54:25.605664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 44 to 44
2025-10-15T10:54:25.605733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.605754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-15T10:54:25.605812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 45 to 45
2025-10-15T10:54:25.605457Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.605880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.605903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-15T10:54:25.605957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 46 to 46
2025-10-15T10:54:25.606033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.606057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-15T10:54:25.605900Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.606114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 47 to 47
2025-10-15T10:54:25.606153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.606172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-15T10:54:25.606222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 48 to 48
2025-10-15T10:54:25.606262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.606288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-15T10:54:25.606345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 49 to 49
2025-10-15T10:54:25.606187Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.606381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.606420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-15T10:54:25.606474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 50 to 50
2025-10-15T10:54:25.606530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.606553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-15T10:54:25.606612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 51 to 51
2025-10-15T10:54:25.606660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.606475Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.606684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-15T10:54:25.606742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 52 to 52
2025-10-15T10:54:25.606778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.606796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-15T10:54:25.606848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 53 to 53
2025-10-15T10:54:25.606903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.606923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-15T10:54:25.606767Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.606984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 54 to 54
2025-10-15T10:54:25.607031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.607053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 54
2025-10-15T10:54:25.607106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 55 to 55
2025-10-15T10:54:25.607167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.607191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 55
2025-10-15T10:54:25.607250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 56 to 56
2025-10-15T10:54:25.607033Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.607295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.607316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 56
2025-10-15T10:54:25.609989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 57 to 57
2025-10-15T10:54:25.608204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.608241Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.608622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 5 size 82 offset: -1
2025-10-15T10:54:25.608690Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.608704Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.608727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 6 size 192 offset: -1
2025-10-15T10:54:25.608776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.608790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.608812Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 7 size 303 offset: -1
2025-10-15T10:54:25.608844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.608859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.608890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 8 size 413 offset: -1
2025-10-15T10:54:25.608957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.608969Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.608991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size 523 offset: -1
2025-10-15T10:54:25.609029Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.609042Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.609075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.609083Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.609107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.609120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.609153Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.609169Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.609191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.609316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.609344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.609392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.609418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.609435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:25.609657Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T10:54:25.613110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.613148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 57
2025-10-15T10:54:25.613353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 58 to 58
2025-10-15T10:54:25.613434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.613456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 58
2025-10-15T10:54:25.613500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 59 to 59
2025-10-15T10:54:25.613545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.613565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 59
2025-10-15T10:54:25.613609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 60 to 60
2025-10-15T10:54:25.613647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.613664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 60
2025-10-15T10:54:25.613721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 61 to 61
2025-10-15T10:54:25.613762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.613778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 61
2025-10-15T10:54:25.613823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 62 to 62
2025-10-15T10:54:25.613870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.613891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 62
2025-10-15T10:54:25.613933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 63 to 63
2025-10-15T10:54:25.613978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.613995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 63
2025-10-15T10:54:25.614041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 64 to 64
2025-10-15T10:54:25.614077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 64
2025-10-15T10:54:25.614136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 65 to 65
2025-10-15T10:54:25.614178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 65
2025-10-15T10:54:25.614237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 66 to 66
2025-10-15T10:54:25.614266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 66
2025-10-15T10:54:25.614325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 67 to 67
2025-10-15T10:54:25.614358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 67
2025-10-15T10:54:25.614418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 68 to 68
2025-10-15T10:54:25.614448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 68
2025-10-15T10:54:25.614526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 69 to 69
2025-10-15T10:54:25.614558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 69
2025-10-15T10:54:25.614623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 70 to 70
2025-10-15T10:54:25.614654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 70
2025-10-15T10:54:25.614721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 71 to 71
2025-10-15T10:54:25.614755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 71
2025-10-15T10:54:25.614816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 72 to 72
2025-10-15T10:54:25.614848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 72
2025-10-15T10:54:25.614910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 73 to 73
2025-10-15T10:54:25.614938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.614956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 73
2025-10-15T10:54:25.614998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 74 to 74
2025-10-15T10:54:25.615041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.615060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 74
2025-10-15T10:54:25.615112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 75 to 75
2025-10-15T10:54:25.615164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.615183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 75
2025-10-15T10:54:25.615242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 76 to 76
2025-10-15T10:54:25.615305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.615323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 76
2025-10-15T10:54:25.615389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 77 to 77
2025-10-15T10:54:25.615447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.615466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 77
2025-10-15T10:54:25.615516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 78 to 78
2025-10-15T10:54:25.615571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.615590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 78
2025-10-15T10:54:25.615656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 79 to 79
2025-10-15T10:54:25.615705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.615722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 79
2025-10-15T10:54:25.615774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 80 to 80
2025-10-15T10:54:25.615830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.615849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 80
2025-10-15T10:54:25.615903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 81 to 81
2025-10-15T10:54:25.615960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.615997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 81
2025-10-15T10:54:25.616053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 82 to 82
2025-10-15T10:54:25.615883Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.616252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.616270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 82
2025-10-15T10:54:25.616339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 83 to 83
2025-10-15T10:54:25.616383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.616406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 83
2025-10-15T10:54:25.616252Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.616464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 84 to 84
2025-10-15T10:54:25.616545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.616578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 84
2025-10-15T10:54:25.616633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 85 to 85
2025-10-15T10:54:25.616707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.616726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 85
2025-10-15T10:54:25.616574Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.616811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 86 to 86
2025-10-15T10:54:25.616880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.616900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 86
2025-10-15T10:54:25.616955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 87 to 87
2025-10-15T10:54:25.617005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.617023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 87
2025-10-15T10:54:25.616889Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.617081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 88 to 88
2025-10-15T10:54:25.617131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.617148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 88
2025-10-15T10:54:25.617199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 89 to 89
2025-10-15T10:54:25.617254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.617273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 89
2025-10-15T10:54:25.617335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 90 to 90
2025-10-15T10:54:25.617157Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.617425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.617452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 90
2025-10-15T10:54:25.617522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 91 to 91
2025-10-15T10:54:25.617578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.617607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 91
2025-10-15T10:54:25.617670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 92 to 92
2025-10-15T10:54:25.617463Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.617743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.617770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 92
2025-10-15T10:54:25.617851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 93 to 93
2025-10-15T10:54:25.617961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.617987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 93
2025-10-15T10:54:25.617783Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.618054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 94 to 94
2025-10-15T10:54:25.618125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.618149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 94
2025-10-15T10:54:25.618215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 95 to 95
2025-10-15T10:54:25.618064Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.618432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.618464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 95
2025-10-15T10:54:25.618531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 96 to 96
2025-10-15T10:54:25.618342Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.618816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.618836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 96
2025-10-15T10:54:25.618654Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.618902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 97 to 97
2025-10-15T10:54:25.618968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.618987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 97
2025-10-15T10:54:25.619049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 98 to 98
2025-10-15T10:54:25.618952Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.619220Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.619628Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.620128Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.620587Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.620990Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.621403Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.621916Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.622514Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.622911Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.619110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.623414Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.623609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 98
2025-10-15T10:54:25.623729Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.624009Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.624304Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.624583Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.624916Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.625163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 99 to 99
2025-10-15T10:54:25.625245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.625285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 99
2025-10-15T10:54:25.625363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 100 to 100
2025-10-15T10:54:25.625180Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.625443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.625464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 100
2025-10-15T10:54:25.625529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 101 to 101
2025-10-15T10:54:25.625584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.625613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 101
2025-10-15T10:54:25.625668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 102 to 102
2025-10-15T10:54:25.625503Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.625747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.625767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 102
2025-10-15T10:54:25.625892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 103 to 103
2025-10-15T10:54:25.625959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.625996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 103
2025-10-15T10:54:25.625787Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.626070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 104 to 104
2025-10-15T10:54:25.626130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.626152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 104
2025-10-15T10:54:25.626066Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.624343Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 156 count 1 nextOffset 1 batches 1
2025-10-15T10:54:25.624409Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.625106Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 142 WTime 1760525665620
2025-10-15T10:54:25.625341Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.625382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.625405Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.625423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.625444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.626310Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.625468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.625479Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.625492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.625587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.625610Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:25.625773Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 142
2025-10-15T10:54:25.625823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-15T10:54:25.626550Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.626780Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.627055Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.627280Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.627550Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.627786Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.626212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 105 to 105
2025-10-15T10:54:25.628242Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 7
2025-10-15T10:54:25.628270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 8
2025-10-15T10:54:25.628285Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 9
2025-10-15T10:54:25.628299Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 10
2025-10-15T10:54:25.631381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.631445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 105
2025-10-15T10:54:25.631533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 106 to 106
2025-10-15T10:54:25.631618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.631649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 106
2025-10-15T10:54:25.631712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 107 to 107
2025-10-15T10:54:25.631776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.631795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 107
2025-10-15T10:54:25.631859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 108 to 108
2025-10-15T10:54:25.631918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.631937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 108
2025-10-15T10:54:25.632001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 109 to 109
2025-10-15T10:54:25.632094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.632114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 109
2025-10-15T10:54:25.628001Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.631013Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.631051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.631103Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.631154Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.631179Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.631200Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.631726Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.631785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.631842Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.631877Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.631914Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.632582Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.632935Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.633254Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.632173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 110 to 110
2025-10-15T10:54:25.633601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.633629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 110
2025-10-15T10:54:25.633746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 111 to 111
2025-10-15T10:54:25.633817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.633844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 111
2025-10-15T10:54:25.633912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 112 to 112
2025-10-15T10:54:25.633976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.634007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 112
2025-10-15T10:54:25.634117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 113 to 113
2025-10-15T10:54:25.634181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.634209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 113
2025-10-15T10:54:25.634261Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.634664Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.635034Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.635305Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.635622Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.636096Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.636401Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.636721Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.637005Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.637376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 114 to 114
2025-10-15T10:54:25.637461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.637494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 114
2025-10-15T10:54:25.637562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 115 to 115
2025-10-15T10:54:25.637629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.637654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 115
2025-10-15T10:54:25.637468Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.637734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 116 to 116
2025-10-15T10:54:25.637797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.637818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 116
2025-10-15T10:54:25.637901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 117 to 117
2025-10-15T10:54:25.637955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.637975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 117
2025-10-15T10:54:25.638041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 118 to 118
2025-10-15T10:54:25.638101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.638119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 118
2025-10-15T10:54:25.638184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 119 to 119
2025-10-15T10:54:25.638238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.638266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 119
2025-10-15T10:54:25.638088Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.638500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 120 to 120
2025-10-15T10:54:25.638546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.638561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 120
2025-10-15T10:54:25.652923Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.658291Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.658390Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.658466Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.652975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.658498Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.658495Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-15T10:54:25.653041Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 15 size 633 offset: -1
2025-10-15T10:54:25.658537Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-15T10:54:25.662718Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.653154Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.671536Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.653165Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.671680Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 142
2025-10-15T10:54:25.671709Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:25.672209Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.653210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 16 size 743 offset: -1
2025-10-15T10:54:25.676034Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.676099Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.653261Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.676149Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.676184Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.653273Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.676228Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.719703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 121 to 121
2025-10-15T10:54:25.719826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.719859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 121
2025-10-15T10:54:25.677495Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 39d3a5e8-1e18d360-d724d4c5-a2c3c002, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 170, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:25.679706Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 170 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 39d3a5e8-1e18d360-d724d4c5-a2c3c002
2025-10-15T10:54:25.681049Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.733120Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 171, now ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-10-15T10:54:25.733239Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-10-15T10:54:25.737936Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-15T10:54:25.738016Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 171 to budget
2025-10-15T10:54:25.738090Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 171, ReadSizeServerDelta = 524117
2025-10-15T10:54:25.738432Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:25.738528Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-15T10:54:25.691799Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.653293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 17 size 853 offset: -1
2025-10-15T10:54:25.700724Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.705079Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.710437Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.710538Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.710899Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.711605Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.711642Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.717722Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.719167Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.724980Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.729628Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.729702Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.730208Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.731574Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.731751Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.732147Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 82 bytes ..." SourceId: "\000src_id" SeqNo: 1 WriteTimestampMS: 1760525665607 CreateTimestampMS: 1760525665583 UncompressedSize: 11 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-15T10:54:25.732318Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-15T10:54:25.732375Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 39d3a5e8-1e18d360-d724d4c5-a2c3c002 has messages 1
2025-10-15T10:54:25.732501Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 39d3a5e8-1e18d360-d724d4c5-a2c3c002, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 171
2025-10-15T10:54:25.732538Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 39d3a5e8-1e18d360-d724d4c5-a2c3c002
2025-10-15T10:54:25.732833Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:25.736291Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.739786Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 171 } }
2025-10-15T10:54:25.739918Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 97c3535a-f274f674-16f6948c-ce9e0c19
2025-10-15T10:54:25.653344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.748307Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-10-15T10:54:25.653355Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.653379Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 18 size 963 offset: -1
2025-10-15T10:54:25.653415Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.653424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.653442Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size 1073 offset: -1
2025-10-15T10:54:25.653471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.653482Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.653512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.653521Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.653547Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.653557Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.653592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.653609Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.653645Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.653657Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.653834Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.653875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.653898Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.653918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.653928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.653943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.653952Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.653962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.653973Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.653985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.654088Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 142 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:25.654149Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-15T10:54:25.654186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 12
2025-10-15T10:54:25.654199Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 13
2025-10-15T10:54:25.654212Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 14
2025-10-15T10:54:25.654223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 15
2025-10-15T10:54:25.654239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:25.654284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 89 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:25.654321Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.654373Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-15T10:54:25.654606Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:25.654632Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:54:25.654647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.654691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.654700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (9)
2025-10-15T10:54:25.654798Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T10:54:25.660197Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 266 count 1 nextOffset 2 batches 1
2025-10-15T10:54:25.660260Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-15T10:54:25.660297Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 611 count 2 nextOffset 3 batches 1
2025-10-15T10:54:25.660316Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-15T10:54:25.660336Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1066 count 3 nextOffset 4 batches 1
2025-10-15T10:54:25.660359Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-15T10:54:25.660374Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1631 count 4 nextOffset 5 batches 1
2025-10-15T10:54:25.660391Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-15T10:54:25.660411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2306 count 5 nextOffset 6 batches 1
2025-10-15T10:54:25.660454Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-15T10:54:25.660483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3091 count 6 nextOffset 7 batches 1
2025-10-15T10:54:25.660502Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-15T10:54:25.660519Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3986 count 7 nextOffset 8 batches 1
2025-10-15T10:54:25.660539Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-15T10:54:25.660557Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 4991 count 8 nextOffset 9 batches 1
2025-10-15T10:54:25.660576Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-15T10:54:25.660598Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 6106 count 9 nextOffset 10 batches 1
2025-10-15T10:54:25.660612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.661404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,9 HeadOffset 1 endOffset 1 curOffset 10 d0000000000_00000000000000000001_00000_0000000009_00000? size 5877 WTime 1760525665657
2025-10-15T10:54:25.661552Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:25.661606Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 1
2025-10-15T10:54:25.661675Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:25.661774Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 9 size 5877
2025-10-15T10:54:25.748778Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.750120Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.760967Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.761073Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.761121Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.761145Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.761179Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.761234Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.764720Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-15T10:54:25.764756Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 10
2025-10-15T10:54:25.764799Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 10, WTime# 1760525665607, sizeLag# 5877
2025-10-15T10:54:25.764813Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:25.764858Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 48eb3016-cf6cadf0-c8cdcb45-465252dd, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 7052, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:25.764903Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 7052 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid 48eb3016-cf6cadf0-c8cdcb45-465252dd
2025-10-15T10:54:25.661960Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T10:54:25.662182Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-15T10:54:25.766699Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.766774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.766812Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.766862Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.766902Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.766938Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.662197Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:54:25.662269Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 0 times before, last time 2025-10-15T10:54:25.000000Z
2025-10-15T10:54:25.662295Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-15T10:54:25.662336Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:25.662825Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-15T10:54:25.662859Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 142
2025-10-15T10:54:25.662947Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-15T10:54:25.667658Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525665607 queuesize 0 startOffset 0
2025-10-15T10:54:25.679409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.679465Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.679517Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 25 size 1183 offset: -1
2025-10-15T10:54:25.683872Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.683905Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.683956Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 26 size 1293 offset: -1
2025-10-15T10:54:25.684014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.684025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.684043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 27 size 1403 offset: -1
2025-10-15T10:54:25.684076Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.684084Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.684102Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 28 size 1513 offset: -1
2025-10-15T10:54:25.684124Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.684162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.684176Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.684188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.684198Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.684209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.684218Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.690782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.693012Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.693043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.693091Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size 1623 offset: -1
2025-10-15T10:54:25.693133Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.693142Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.693168Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.693205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.693258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-15T10:54:25.703482Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.703519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.703567Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.703577Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.703601Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.703610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.703673Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 17
2025-10-15T10:54:25.703702Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 18
2025-10-15T10:54:25.704737Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 19
2025-10-15T10:54:25.713279Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.713314Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.716693Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.716732Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.716866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 20
2025-10-15T10:54:25.716953Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 170 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T10:54:25.717149Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-15T10:54:25.718406Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T10:54:25.718473Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 1 times before, last time 2025-10-15T10:54:25.000000Z
2025-10-15T10:54:25.718519Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-15T10:54:25.718586Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:25.718714Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-15T10:54:25.724015Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-15T10:54:25.724315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:25.724445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.731841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.731877Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.731929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 35 size 1733 offset: -1
2025-10-15T10:54:25.731975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.731988Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.732026Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.732037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.732060Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 37 size 1843 offset: -1
2025-10-15T10:54:25.732088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.732105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.732141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.732154Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.732173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 39 size 1953 offset: -1
2025-10-15T10:54:25.732199Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.732242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.732273Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.732284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.732324Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.732339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.732359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 21
2025-10-15T10:54:25.732406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 22
2025-10-15T10:54:25.747707Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.747747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.751536Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.751586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.751640Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 41 size 2063 offset: -1
2025-10-15T10:54:25.751733Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.751744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.751823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.751840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.751886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 43 size 2173 offset: -1
2025-10-15T10:54:25.751933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.751944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.752001Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.752045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.752068Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 23
2025-10-15T10:54:25.752120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.752146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.752191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 24
2025-10-15T10:54:25.752205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 25
2025-10-15T10:54:25.760882Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 9 size 5877 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:25.760929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:25.760976Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 5759 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:25.761022Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.761071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-15T10:54:25.761093Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.761113Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-15T10:54:25.761123Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.761142Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-15T10:54:25.761153Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.761170Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-15T10:54:25.761205Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.761228Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-15T10:54:25.761241Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.761258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-15T10:54:25.761267Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.761283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-15T10:54:25.761292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.761311Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-15T10:54:25.761330Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.761347Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-15T10:54:25.761537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.761585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.761594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:25.761669Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-15T10:54:25.764294Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 9 parts 0 suffix '63' size 5877
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..11 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-15T10:54:25.583000Z WriteTime: 2025-10-15T10:54:25.607000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:25.775572Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 1, size 11 bytes
2025-10-15T10:54:25.775707Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:25.776123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 122 to 122
2025-10-15T10:54:25.776207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.776253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 122
2025-10-15T10:54:25.776318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 123 to 123
2025-10-15T10:54:25.776372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.776393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 123
2025-10-15T10:54:25.776450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 124 to 124
2025-10-15T10:54:25.776534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.776555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 124
2025-10-15T10:54:25.776615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 125 to 125
2025-10-15T10:54:25.776672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.776694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 125
2025-10-15T10:54:25.776749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 126 to 126
2025-10-15T10:54:25.776808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.776831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 126
2025-10-15T10:54:25.776886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 127 to 127
2025-10-15T10:54:25.776936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.776967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 127
2025-10-15T10:54:25.777025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 128 to 128
2025-10-15T10:54:25.777079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.777113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 128
2025-10-15T10:54:25.777172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 129 to 129
2025-10-15T10:54:25.777228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.777251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 129
2025-10-15T10:54:25.777304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 130 to 130
2025-10-15T10:54:25.777413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.777436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 130
2025-10-15T10:54:25.777494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 131 to 131
2025-10-15T10:54:25.777558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.777582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 131
2025-10-15T10:54:25.777639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 132 to 132
2025-10-15T10:54:25.777710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.777735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 132
2025-10-15T10:54:25.777795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 133 to 133
2025-10-15T10:54:25.777850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.777870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 133
2025-10-15T10:54:25.777923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 134 to 134
2025-10-15T10:54:25.777982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.778004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 134
2025-10-15T10:54:25.778061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 135 to 135
2025-10-15T10:54:25.778119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.778140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 135
2025-10-15T10:54:25.778194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 136 to 136
2025-10-15T10:54:25.778263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.778286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 136
2025-10-15T10:54:25.778338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 137 to 137
2025-10-15T10:54:25.778397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.778420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 137
2025-10-15T10:54:25.778479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 138 to 138
2025-10-15T10:54:25.778540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.778568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 138
2025-10-15T10:54:25.778634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 139 to 139
2025-10-15T10:54:25.778704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.778724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 139
2025-10-15T10:54:25.778780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 140 to 140
2025-10-15T10:54:25.778837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.778861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 140
2025-10-15T10:54:25.778914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 141 to 141
2025-10-15T10:54:25.778979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.779001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 141
2025-10-15T10:54:25.779057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 142 to 142
2025-10-15T10:54:25.779114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.779137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 142
2025-10-15T10:54:25.779190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 143 to 143
2025-10-15T10:54:25.779249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.779274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 143
2025-10-15T10:54:25.779334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 144 to 144
2025-10-15T10:54:25.773005Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1257 count 1 nextOffset 11 batches 1
2025-10-15T10:54:25.773110Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-15T10:54:25.773158Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 2592 count 2 nextOffset 12 batches 1
2025-10-15T10:54:25.773179Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-15T10:54:25.773204Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 4037 count 3 nextOffset 13 batches 1
2025-10-15T10:54:25.773226Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-15T10:54:25.773246Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 5592 count 4 nextOffset 14 batches 1
2025-10-15T10:54:25.773270Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-15T10:54:25.773310Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 7257 count 5 nextOffset 15 batches 1
2025-10-15T10:54:25.773334Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-15T10:54:25.773358Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 9032 count 6 nextOffset 16 batches 1
2025-10-15T10:54:25.773384Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-15T10:54:25.773405Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 10917 count 7 nextOffset 17 batches 1
2025-10-15T10:54:25.773425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-15T10:54:25.773444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 12912 count 8 nextOffset 18 batches 1
2025-10-15T10:54:25.773466Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-15T10:54:25.773489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 15017 count 9 nextOffset 19 batches 1
2025-10-15T10:54:25.773509Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-15T10:54:25.773529Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 17232 count 10 nextOffset 20 batches 1
2025-10-15T10:54:25.773569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.774368Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,10 HeadOffset 10 endOffset 10 curOffset 20 d0000000000_00000000000000000010_00000_0000000010_00000? size 16974 WTime 1760525665773
2025-10-15T10:54:25.774544Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:25.774654Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 2
2025-10-15T10:54:25.774716Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 3
2025-10-15T10:54:25.774742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 4
2025-10-15T10:54:25.774767Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-15T10:54:25.774803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 6
2025-10-15T10:54:25.774834Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 7
2025-10-15T10:54:25.774860Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 8
2025-10-15T10:54:25.774885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 9
2025-10-15T10:54:25.774914Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-15T10:54:25.774997Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.775026Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.775081Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 45 size 2283 offset: -1
2025-10-15T10:54:25.775160Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.775178Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.775204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 46 size 2393 offset: -1
2025-10-15T10:54:25.775300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.775318Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.781284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.781317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 144
2025-10-15T10:54:25.781404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 145 to 145
2025-10-15T10:54:25.781466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.781490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 145
2025-10-15T10:54:25.781551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 146 to 146
2025-10-15T10:54:25.781612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.781636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 146
2025-10-15T10:54:25.781714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 147 to 147
2025-10-15T10:54:25.781785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.781808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 147
2025-10-15T10:54:25.781880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 148 to 148
2025-10-15T10:54:25.781954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.781983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 148
2025-10-15T10:54:25.782052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 149 to 149
2025-10-15T10:54:25.782136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.782160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 149
2025-10-15T10:54:25.782231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 150 to 150
2025-10-15T10:54:25.782302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.782326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 150
2025-10-15T10:54:25.782866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 151 to 151
2025-10-15T10:54:25.782968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.782994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 151
2025-10-15T10:54:25.781653Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.781794Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.781897Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.783095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 152 to 152
2025-10-15T10:54:25.781934Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.783180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.781976Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.783215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 152
2025-10-15T10:54:25.782003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.782039Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.782097Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.782131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.783292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 153 to 153
2025-10-15T10:54:25.782161Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.782581Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.783378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.783404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 153
2025-10-15T10:54:25.783481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 154 to 154
2025-10-15T10:54:25.783568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.783593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 154
2025-10-15T10:54:25.783660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 155 to 155
2025-10-15T10:54:25.783727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.783751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 155
2025-10-15T10:54:25.783839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 156 to 156
2025-10-15T10:54:25.783905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.783934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 156
2025-10-15T10:54:25.784003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 157 to 157
2025-10-15T10:54:25.784073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.784097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 157
2025-10-15T10:54:25.784159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 158 to 158
2025-10-15T10:54:25.784222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.784245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 158
2025-10-15T10:54:25.784309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 159 to 159
2025-10-15T10:54:25.784377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.784399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 159
2025-10-15T10:54:25.784460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 160 to 160
2025-10-15T10:54:25.784538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.784560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 160
2025-10-15T10:54:25.784627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 161 to 161
2025-10-15T10:54:25.784694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.784719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 161
2025-10-15T10:54:25.784787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 162 to 162
2025-10-15T10:54:25.784894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.784917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 162
2025-10-15T10:54:25.784978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 163 to 163
2025-10-15T10:54:25.785043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.785065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 163
2025-10-15T10:54:25.785125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 164 to 164
2025-10-15T10:54:25.785189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.785213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 164
2025-10-15T10:54:25.785281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 165 to 165
2025-10-15T10:54:25.785347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.785369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 165
2025-10-15T10:54:25.785429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 166 to 166
2025-10-15T10:54:25.785512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.785537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 166
2025-10-15T10:54:25.785618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 167 to 167
2025-10-15T10:54:25.785698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.785720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 167
2025-10-15T10:54:25.785785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 168 to 168
2025-10-15T10:54:25.785888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.785910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 168
2025-10-15T10:54:25.785970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 169 to 169
2025-10-15T10:54:25.786037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.786058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 169
2025-10-15T10:54:25.788096Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.788797Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.789243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 170 to 170
2025-10-15T10:54:25.789348Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.789720Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.790430Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.787929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.787991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.788047Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 47 size 2503 offset: -1
2025-10-15T10:54:25.788151Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.788167Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.790790Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.788190Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 48 size 2613 offset: -1
2025-10-15T10:54:25.788247Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.788260Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.788278Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size 2723 offset: -1
2025-10-15T10:54:25.788308Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.788321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.788360Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.788370Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.788393Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.788402Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.788427Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.788436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.788470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.788482Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.788509Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:25.788626Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 10 size 16974
2025-10-15T10:54:25.791115Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.788666Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.788721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.788734Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.788749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.788777Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.788790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.788799Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.788814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.788823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.788835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.789123Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-15T10:54:25.789182Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 27
2025-10-15T10:54:25.789199Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 28
2025-10-15T10:54:25.789215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 29
2025-10-15T10:54:25.789229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 30
2025-10-15T10:54:25.791434Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.789305Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 10 size 7052 endOffset 10 max time lag 0ms effective offset 1
2025-10-15T10:54:25.789470Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 5877 count 9 last offset 1, current partition end offset: 10
2025-10-15T10:54:25.789485Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-15T10:54:25.789530Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 9 parts_count 0 source 1 size 5877 accessed 0 times before, last time 2025-10-15T10:54:25.000000Z
2025-10-15T10:54:25.789551Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-15T10:54:25.789612Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:25.790239Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 9 count 9 size 5857 from pos 0 cbcount 9
2025-10-15T10:54:25.790386Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:54:25.792105Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.793054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.793096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 170
2025-10-15T10:54:25.793240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 171 to 171
2025-10-15T10:54:25.793343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.793370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 171
2025-10-15T10:54:25.793460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 172 to 172
2025-10-15T10:54:25.793572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.793605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 172
2025-10-15T10:54:25.793713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 173 to 173
2025-10-15T10:54:25.793829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.793855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 173
2025-10-15T10:54:25.793934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 174 to 174
2025-10-15T10:54:25.794013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.794040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 174
2025-10-15T10:54:25.794127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 175 to 175
2025-10-15T10:54:25.794194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.794236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 175
2025-10-15T10:54:25.794308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 176 to 176
2025-10-15T10:54:25.794379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.794401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 176
2025-10-15T10:54:25.794489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 177 to 177
2025-10-15T10:54:25.793137Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.793251Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.791988Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 9 parts 0 suffix '63'
2025-10-15T10:54:25.793281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.793304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.793353Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.793392Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.794197Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.794260Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.794306Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.794341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.794396Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.795815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.795844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 177
2025-10-15T10:54:25.795932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 178 to 178
2025-10-15T10:54:25.796017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.796042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 178
2025-10-15T10:54:25.796124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 179 to 179
2025-10-15T10:54:25.796186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.796208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 179
2025-10-15T10:54:25.796295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 180 to 180
2025-10-15T10:54:25.796365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.796386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 180
2025-10-15T10:54:25.796450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 181 to 181
2025-10-15T10:54:25.796523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.796546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 181
2025-10-15T10:54:25.796610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 182 to 182
2025-10-15T10:54:25.796671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.796693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 182
2025-10-15T10:54:25.796762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 183 to 183
2025-10-15T10:54:25.796847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.796865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 183
2025-10-15T10:54:25.796932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 184 to 184
2025-10-15T10:54:25.797007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.797026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 184
2025-10-15T10:54:25.797088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 185 to 185
2025-10-15T10:54:25.797195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.797218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 185
2025-10-15T10:54:25.797287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 186 to 186
2025-10-15T10:54:25.797349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.797369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 186
2025-10-15T10:54:25.797467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 187 to 187
2025-10-15T10:54:25.797546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.797575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 187
2025-10-15T10:54:25.797635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 188 to 188
2025-10-15T10:54:25.797724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.797744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 188
2025-10-15T10:54:25.797806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 189 to 189
2025-10-15T10:54:25.797879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.797901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 189
2025-10-15T10:54:25.797964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 190 to 190
2025-10-15T10:54:25.798024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.798045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 190
2025-10-15T10:54:25.798107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 191 to 191
2025-10-15T10:54:25.798164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.798183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 191
2025-10-15T10:54:25.798251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 192 to 192
2025-10-15T10:54:25.798315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.798342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 192
2025-10-15T10:54:25.798408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 193 to 193
2025-10-15T10:54:25.798474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.798494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 193
2025-10-15T10:54:25.798589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 194 to 194
2025-10-15T10:54:25.798667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.798690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 194
2025-10-15T10:54:25.798756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 195 to 195
2025-10-15T10:54:25.798823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.798846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 195
2025-10-15T10:54:25.798913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 196 to 196
2025-10-15T10:54:25.798984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.799004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 196
2025-10-15T10:54:25.799076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 197 to 197
2025-10-15T10:54:25.799172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.799194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 197
2025-10-15T10:54:25.799262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 198 to 198
2025-10-15T10:54:25.799322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.799342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 198
2025-10-15T10:54:25.803402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 199 to 199
2025-10-15T10:54:25.800142Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.800198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.800255Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 55 size 2833 offset: -1
2025-10-15T10:54:25.803533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.803566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 199
2025-10-15T10:54:25.803709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 200 to 200
2025-10-15T10:54:25.803794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.803818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 200
2025-10-15T10:54:25.803886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 201 to 201
2025-10-15T10:54:25.803962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.803988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 201
2025-10-15T10:54:25.804052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 202 to 202
2025-10-15T10:54:25.804115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.804138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 202
2025-10-15T10:54:25.804209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 203 to 203
2025-10-15T10:54:25.804287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.804308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 203
2025-10-15T10:54:25.804382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 204 to 204
2025-10-15T10:54:25.804446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.804473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 204
2025-10-15T10:54:25.804539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 205 to 205
2025-10-15T10:54:25.804616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.804636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 205
2025-10-15T10:54:25.805974Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.807920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 206 to 206
2025-10-15T10:54:25.808030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.808059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 206
2025-10-15T10:54:25.808144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 207 to 207
2025-10-15T10:54:25.808257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.808281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 207
2025-10-15T10:54:25.808349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 208 to 208
2025-10-15T10:54:25.808410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.808429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 208
2025-10-15T10:54:25.808493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 209 to 209
2025-10-15T10:54:25.808552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.808577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 209
2025-10-15T10:54:25.808657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 210 to 210
2025-10-15T10:54:25.808718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.808739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 210
2025-10-15T10:54:25.808800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 211 to 211
2025-10-15T10:54:25.808863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.808883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 211
2025-10-15T10:54:25.808951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 212 to 212
2025-10-15T10:54:25.809016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.809036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 212
2025-10-15T10:54:25.809128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 213 to 213
2025-10-15T10:54:25.809194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.809213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 213
2025-10-15T10:54:25.809276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 214 to 214
2025-10-15T10:54:25.809339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.809363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 214
2025-10-15T10:54:25.809424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 215 to 215
2025-10-15T10:54:25.809501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.809524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 215
2025-10-15T10:54:25.809594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 216 to 216
2025-10-15T10:54:25.809677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.809719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 216
2025-10-15T10:54:25.809801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 217 to 217
2025-10-15T10:54:25.809896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.809917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 217
2025-10-15T10:54:25.809983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 218 to 218
2025-10-15T10:54:25.810045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.810065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 218
2025-10-15T10:54:25.810162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 219 to 219
2025-10-15T10:54:25.810226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.810248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 219
2025-10-15T10:54:25.810313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 220 to 220
2025-10-15T10:54:25.810385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.810404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 220
2025-10-15T10:54:25.810494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 221 to 221
2025-10-15T10:54:25.810567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.810587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 221
2025-10-15T10:54:25.810658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 222 to 222
2025-10-15T10:54:25.810732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.810757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 222
2025-10-15T10:54:25.810833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 223 to 223
2025-10-15T10:54:25.810901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.810925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 223
2025-10-15T10:54:25.810997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 224 to 224
2025-10-15T10:54:25.811068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.811090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 224
2025-10-15T10:54:25.811158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 225 to 225
2025-10-15T10:54:25.811264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.811286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 225
2025-10-15T10:54:25.813322Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 1 Data: "... 192 bytes ..." SourceId: "\000src_id" SeqNo: 2 WriteTimestampMS: 1760525665653 CreateTimestampMS: 1760525665584 UncompressedSize: 121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 303 bytes ..." SourceId: "\000src_id" SeqNo: 3 WriteTimestampMS: 1760525665657 CreateTimestampMS: 1760525665584 UncompressedSize: 231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 413 bytes ..." SourceId: "\000src_id" SeqNo: 4 WriteTimestampMS: 1760525665657 CreateTimestampMS: 1760525665584 UncompressedSize: 341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 523 bytes ..." SourceId: "\000src_id" SeqNo: 5 WriteTimestampMS: 1760525665657 CreateTimestampMS: 1760525665584 UncompressedSize: 451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 633 bytes ..." SourceId: "\000src_id" SeqNo: 6 WriteTimestampMS: 1760525665657 CreateTimestampMS: 1760525665584 UncompressedSize: 561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 743 bytes ..." SourceId: "\000src_id" SeqNo: 7 WriteTimestampMS: 1760525665657 CreateTimestampMS: 1760525665584 UncompressedSize: 671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 853 bytes ..." SourceId: "\000src_id" SeqNo: 8 WriteTimestampMS: 1760525665657 CreateTimestampMS: 1760525665584 UncompressedSize: 781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 963 bytes ..." SourceId: "\000src_id" SeqNo: 9 WriteTimestampMS: 1760525665657 CreateTimestampMS: 1760525665584 UncompressedSize: 891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 1073 bytes ..." SourceId: "\000src_id" SeqNo: 10 WriteTimestampMS: 1760525665657 CreateTimestampMS: 1760525665585 UncompressedSize: 1001 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551419 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 1 }
2025-10-15T10:54:25.819473Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.813644Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 10
2025-10-15T10:54:25.813718Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid 48eb3016-cf6cadf0-c8cdcb45-465252dd has messages 1
2025-10-15T10:54:25.819579Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 56 size 2943 offset: -1
2025-10-15T10:54:25.813899Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 48eb3016-cf6cadf0-c8cdcb45-465252dd, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 5610
2025-10-15T10:54:25.814017Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 48eb3016-cf6cadf0-c8cdcb45-465252dd
2025-10-15T10:54:25.823455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 226 to 226
2025-10-15T10:54:25.814350Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:25.821465Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.819704Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.819728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.819750Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 57 size 3053 offset: -1
2025-10-15T10:54:25.820080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.820093Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.820120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 58 size 3163 offset: -1
2025-10-15T10:54:25.820162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.820173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.820192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size 3273 offset: -1
2025-10-15T10:54:25.820260Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.820315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.820347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.820360Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.820379Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.820393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.820402Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.820416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.820426Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.820438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.820449Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.820463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.821008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-15T10:54:25.821416Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.821437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.821483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.821496Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.821524Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.821536Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.821590Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 32
2025-10-15T10:54:25.821611Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 33
2025-10-15T10:54:25.821635Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 34
2025-10-15T10:54:25.826722Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.829444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.829585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.829618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.829743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 35
2025-10-15T10:54:25.830203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.830246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.830323Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 65 size 3383 offset: -1
2025-10-15T10:54:25.830425Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.830455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.830496Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.830588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.830643Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 36
2025-10-15T10:54:25.829558Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.829714Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:25.829752Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.829803Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.829835Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.830516Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.830610Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.830667Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.831945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.832008Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.830982Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 5610, now ReadSizeBudget = 0, ReadSizeServerDelta = 518678
2025-10-15T10:54:25.832548Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 518678
2025-10-15T10:54:25.832144Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.832256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.832858Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-9)
2025-10-15T10:54:25.832904Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 5610 to budget
2025-10-15T10:54:25.832955Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 5610, ReadSizeServerDelta = 518678
2025-10-15T10:54:25.833217Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.833307Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:25.833319Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.833448Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-15T10:54:25.833404Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 67 size 3493 offset: -1
2025-10-15T10:54:25.833536Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (2-2)
2025-10-15T10:54:25.833595Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (3-3)
2025-10-15T10:54:25.833627Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (4-4)
2025-10-15T10:54:25.833678Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (5-5)
2025-10-15T10:54:25.833788Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (6-6)
2025-10-15T10:54:25.833835Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (7-7)
2025-10-15T10:54:25.833869Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (8-8)
2025-10-15T10:54:25.833944Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (9-9)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..121 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-15T10:54:25.584000Z WriteTime: 2025-10-15T10:54:25.653000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..231 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-15T10:54:25.584000Z WriteTime: 2025-10-15T10:54:25.657000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..341 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-15T10:54:25.584000Z WriteTime: 2025-10-15T10:54:25.657000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..451 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-15T10:54:25.584000Z WriteTime: 2025-10-15T10:54:25.657000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..561 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-15T10:54:25.584000Z WriteTime: 2025-10-15T10:54:25.657000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..671 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-15T10:54:25.584000Z WriteTime: 2025-10-15T10:54:25.657000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..781 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-15T10:54:25.584000Z WriteTime: 2025-10-15T10:54:25.657000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..891 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-15T10:54:25.584000Z WriteTime: 2025-10-15T10:54:25.657000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1001 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.657000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:25.835045Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 9, size 5049 bytes
2025-10-15T10:54:25.835080Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:25.835372Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.833549Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.833574Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.833601Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 68 size 3603 offset: -1
2025-10-15T10:54:25.833668Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.833697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.833724Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 69 size 3713 offset: -1
2025-10-15T10:54:25.833770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.833807Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.833841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.833854Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.833883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.833893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.833947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.833960Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.833983Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 73 size 3823 offset: -1
2025-10-15T10:54:25.834048Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.834064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.834086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 74 size 3933 offset: -1
2025-10-15T10:54:25.836752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.836799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 226
2025-10-15T10:54:25.835443Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.835519Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.834114Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.834152Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.834188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.834205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.834233Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.834286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.834461Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.834478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.834490Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.834507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.834561Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.834588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.834610Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.835552Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.835575Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.834627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.834739Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 10 size 16974 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:25.834810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 37
2025-10-15T10:54:25.834838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 38
2025-10-15T10:54:25.834854Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 39
2025-10-15T10:54:25.834868Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 40
2025-10-15T10:54:25.834883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 41
2025-10-15T10:54:25.834887Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 10 parts 0 suffix '63' size 16974
2025-10-15T10:54:25.834900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:25.834966Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 16850 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:25.835000Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835031Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-15T10:54:25.835051Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835101Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-15T10:54:25.835120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835140Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-15T10:54:25.835836Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.835882Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.835915Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.837404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.837457Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.839673Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 5610 } }
2025-10-15T10:54:25.839873Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 931fc552-4817a25-6f73d8e2-2b4e6453
2025-10-15T10:54:25.839952Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 10 EndOffset 10 newEndOffset 20 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-15T10:54:25.839972Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 20
2025-10-15T10:54:25.840044Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 20, WTime# 1760525665657, sizeLag# 16974
2025-10-15T10:54:25.840058Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:25.840112Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 27968e03-77ed666f-3283b5b0-e3a8666d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 20368, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:25.840165Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 20368 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 20 ClientCommitOffset 0 committedOffset 0 Guid 27968e03-77ed666f-3283b5b0-e3a8666d
2025-10-15T10:54:25.835153Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835179Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-15T10:54:25.835195Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835220Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-15T10:54:25.835235Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-15T10:54:25.835265Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-15T10:54:25.835294Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835331Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-15T10:54:25.835367Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835405Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-15T10:54:25.835418Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:25.835433Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-15T10:54:25.835640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.835707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.835716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (16)
2025-10-15T10:54:25.835804Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-15T10:54:25.860898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 227 to 227
2025-10-15T10:54:25.878185Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2357 count 1 nextOffset 21 batches 1
2025-10-15T10:54:25.878283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-15T10:54:25.878330Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 4792 count 2 nextOffset 22 batches 1
2025-10-15T10:54:25.878363Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-15T10:54:25.883545Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.878391Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 7337 count 3 nextOffset 23 batches 1
2025-10-15T10:54:25.878422Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-15T10:54:25.878443Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 9992 count 4 nextOffset 24 batches 1
2025-10-15T10:54:25.878466Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-15T10:54:25.878489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 12757 count 5 nextOffset 25 batches 1
2025-10-15T10:54:25.878509Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-15T10:54:25.878529Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 15632 count 6 nextOffset 26 batches 1
2025-10-15T10:54:25.878549Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-15T10:54:25.878568Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 18617 count 7 nextOffset 27 batches 1
2025-10-15T10:54:25.878589Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-15T10:54:25.878610Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 21712 count 8 nextOffset 28 batches 1
2025-10-15T10:54:25.878632Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-15T10:54:25.878654Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 24917 count 9 nextOffset 29 batches 1
2025-10-15T10:54:25.878675Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-15T10:54:25.878696Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 28232 count 10 nextOffset 30 batches 1
2025-10-15T10:54:25.878719Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-15T10:54:25.878748Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 31657 count 11 nextOffset 31 batches 1
2025-10-15T10:54:25.878771Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-15T10:54:25.878790Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 35192 count 12 nextOffset 32 batches 1
2025-10-15T10:54:25.878844Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-15T10:54:25.883658Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.878870Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 38837 count 13 nextOffset 33 batches 1
2025-10-15T10:54:25.878891Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-15T10:54:25.883689Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.878913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 42592 count 14 nextOffset 34 batches 1
2025-10-15T10:54:25.878935Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-15T10:54:25.878954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 46457 count 15 nextOffset 35 batches 1
2025-10-15T10:54:25.887891Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.887949Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.900955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.901011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 227
2025-10-15T10:54:25.878974Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-15T10:54:25.878993Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 50432 count 16 nextOffset 36 batches 1
2025-10-15T10:54:25.879014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.879834Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 20,16 HeadOffset 20 endOffset 20 curOffset 36 d0000000000_00000000000000000020_00000_0000000016_00000? size 49982 WTime 1760525665878
2025-10-15T10:54:25.879992Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:25.880092Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 11
2025-10-15T10:54:25.880171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 12
2025-10-15T10:54:25.880214Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 13
2025-10-15T10:54:25.880257Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 14
2025-10-15T10:54:25.880295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-15T10:54:25.880339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 16
2025-10-15T10:54:25.880381Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 17
2025-10-15T10:54:25.880423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 18
2025-10-15T10:54:25.880459Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 19
2025-10-15T10:54:25.880501Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 20
2025-10-15T10:54:25.880626Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.880653Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.880710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 77 size 4043 offset: -1
2025-10-15T10:54:25.880766Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.880780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.880802Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 78 size 4153 offset: -1
2025-10-15T10:54:25.880838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.880848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.880870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 79 size 4263 offset: -1
2025-10-15T10:54:25.880906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.880916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.880936Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 80 size 4373 offset: -1
2025-10-15T10:54:25.884289Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.884332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.884392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size 4483 offset: -1
2025-10-15T10:54:25.895380Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.895428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.895539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.895562Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.895599Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.895613Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.895642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.895655Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.895684Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.895700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.895788Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.895801Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.895847Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:25.895974Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 16 size 49982
2025-10-15T10:54:25.896020Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.896071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.896092Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.896118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.896140Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.896160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.896171Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.896190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.896201Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.896215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.896454Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-15T10:54:25.896499Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 43
2025-10-15T10:54:25.896518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 44
2025-10-15T10:54:25.896534Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 45
2025-10-15T10:54:25.896551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 46
2025-10-15T10:54:25.896636Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 12 size 20368 endOffset 20 max time lag 0ms effective offset 10
2025-10-15T10:54:25.896820Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 16974 count 10 last offset 10, current partition end offset: 20
2025-10-15T10:54:25.896836Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-15T10:54:25.896883Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 10 parts_count 0 source 1 size 16974 accessed 0 times before, last time 2025-10-15T10:54:25.000000Z
2025-10-15T10:54:25.896906Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-15T10:54:25.896953Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:25.897280Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 10 count 10 size 16952 from pos 0 cbcount 10
2025-10-15T10:54:25.897455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-15T10:54:25.899678Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.899756Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.899895Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.899981Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.915923Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:25.900045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.907588Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.930618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.930683Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.930748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 87 size 4593 offset: -1
2025-10-15T10:54:25.907659Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.907684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.907707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.907731Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.908106Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.908178Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.908219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.908257Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.908295Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.919508Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 20 Result { Offset: 10 Data: "... 1183 bytes ..." SourceId: "\000src_id" SeqNo: 11 WriteTimestampMS: 1760525665761 CreateTimestampMS: 1760525665585 UncompressedSize: 1111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 1293 bytes ..." SourceId: "\000src_id" SeqNo: 12 WriteTimestampMS: 1760525665773 CreateTimestampMS: 1760525665585 UncompressedSize: 1221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 1403 bytes ..." SourceId: "\000src_id" SeqNo: 13 WriteTimestampMS: 1760525665773 CreateTimestampMS: 1760525665585 UncompressedSize: 1331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 1513 bytes ..." SourceId: "\000src_id" SeqNo: 14 WriteTimestampMS: 1760525665773 CreateTimestampMS: 1760525665585 UncompressedSize: 1441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 1623 bytes ..." SourceId: "\000src_id" SeqNo: 15 WriteTimestampMS: 1760525665773 CreateTimestampMS: 1760525665585 UncompressedSize: 1551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 1733 bytes ..." SourceId: "\000src_id" SeqNo: 16 WriteTimestampMS: 1760525665773 CreateTimestampMS: 1760525665585 UncompressedSize: 1661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 1843 bytes ..." SourceId: "\000src_id" SeqNo: 17 WriteTimestampMS: 1760525665773 CreateTimestampMS: 1760525665585 UncompressedSize: 1771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 1953 bytes ..." SourceId: "\000src_id" SeqNo: 18 WriteTimestampMS: 1760525665773 CreateTimestampMS: 1760525665585 UncompressedSize: 1881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 2063 bytes ..." SourceId: "\000src_id" SeqNo: 19 WriteTimestampMS: 1760525665773 CreateTimestampMS: 1760525665585 UncompressedSize: 1991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 2173 bytes ..." SourceId: "\000src_id" SeqNo: 20 WriteTimestampMS: 1760525665773 CreateTimestampMS: 1760525665585 UncompressedSize: 2101 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551390 RealReadOffset: 19 WaitQuotaTimeMs: 0 EndOffset: 20 StartOffset: 0 } Cookie: 10 }
2025-10-15T10:54:25.927665Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 20
2025-10-15T10:54:25.927734Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 20 ReadOffset 20 ReadGuid 27968e03-77ed666f-3283b5b0-e3a8666d has messages 1
2025-10-15T10:54:25.935465Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 27968e03-77ed666f-3283b5b0-e3a8666d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 16660
2025-10-15T10:54:25.935599Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 27968e03-77ed666f-3283b5b0-e3a8666d
2025-10-15T10:54:25.935919Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:25.936360Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 16660, now ReadSizeBudget = 0, ReadSizeServerDelta = 507628
2025-10-15T10:54:25.936452Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 507628
2025-10-15T10:54:25.939434Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-19)
2025-10-15T10:54:25.939807Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 16660 to budget
2025-10-15T10:54:25.939843Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 16660, ReadSizeServerDelta = 507628
2025-10-15T10:54:25.940080Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:25.940180Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-10-15T10:54:25.940278Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (11-11)
2025-10-15T10:54:25.940357Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (12-12)
2025-10-15T10:54:25.940460Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (13-13)
2025-10-15T10:54:25.940507Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (14-14)
2025-10-15T10:54:25.940531Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (15-15)
2025-10-15T10:54:25.940589Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (16-16)
2025-10-15T10:54:25.940668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 228 to 228
2025-10-15T10:54:25.943376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.943441Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.943511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 88 size 4703 offset: -1
2025-10-15T10:54:25.943648Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.943671Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.943698Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 89 size 4813 offset: -1
2025-10-15T10:54:25.943778Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.943562Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 16660 } }
2025-10-15T10:54:25.943800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.943828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 90 size 4923 offset: -1
2025-10-15T10:54:25.943732Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# d8acd871-ddea9784-9224b550-60417eb4
2025-10-15T10:54:25.945852Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.945892Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.945940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size 5033 offset: -1
2025-10-15T10:54:25.951418Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.951457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.951543Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.951559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.951589Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.951603Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.952920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.952981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 228
2025-10-15T10:54:25.956873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 229 to 229
2025-10-15T10:54:25.957002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.957036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 229
2025-10-15T10:54:25.957154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 230 to 230
2025-10-15T10:54:25.957222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.957271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 230
2025-10-15T10:54:25.957405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 231 to 231
2025-10-15T10:54:25.957493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.957517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 231
2025-10-15T10:54:25.957582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 232 to 232
2025-10-15T10:54:25.963504Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.963562Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.963658Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:25.963681Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:25.963731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.963751Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.963807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.963846Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.963863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.963874Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.963893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.963906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.963922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.963947Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:25.963969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:25.947619Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (17-17)
2025-10-15T10:54:25.964559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-15T10:54:25.964605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 48
2025-10-15T10:54:25.964621Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 49
2025-10-15T10:54:25.964639Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 50
2025-10-15T10:54:25.964657Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 51
2025-10-15T10:54:25.967469Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.967569Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.967600Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.967658Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.967706Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:25.968075Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.975558Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.975606Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.975644Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.975680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:25.979636Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (18-18)
2025-10-15T10:54:25.991672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.991712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 232
2025-10-15T10:54:25.991888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 233 to 233
2025-10-15T10:54:25.992021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.992047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 233
2025-10-15T10:54:25.992124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 234 to 234
2025-10-15T10:54:25.992194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.992219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 234
2025-10-15T10:54:25.992295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 235 to 235
2025-10-15T10:54:25.992364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.992388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 235
2025-10-15T10:54:25.992474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 236 to 236
2025-10-15T10:54:25.992546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.992572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 236
2025-10-15T10:54:25.992652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 237 to 237
2025-10-15T10:54:25.992732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.992756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 237
2025-10-15T10:54:25.992836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 238 to 238
2025-10-15T10:54:25.992897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.992918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 238
2025-10-15T10:54:25.992986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 239 to 239
2025-10-15T10:54:25.993052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.993073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 239
2025-10-15T10:54:25.993184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 240 to 240
2025-10-15T10:54:25.993260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.993282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 240
2025-10-15T10:54:25.993342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 241 to 241
2025-10-15T10:54:25.993450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.993471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 241
2025-10-15T10:54:25.993533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 242 to 242
2025-10-15T10:54:25.993599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.993623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 242
2025-10-15T10:54:25.993699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 243 to 243
2025-10-15T10:54:25.993759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.993781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 243
2025-10-15T10:54:25.993844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 244 to 244
2025-10-15T10:54:25.993907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.993927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 244
2025-10-15T10:54:25.993992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 245 to 245
2025-10-15T10:54:25.994059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.994082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 245
2025-10-15T10:54:25.994184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 246 to 246
2025-10-15T10:54:25.994252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.994275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 246
2025-10-15T10:54:25.994343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 247 to 247
2025-10-15T10:54:25.994420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.994441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 247
2025-10-15T10:54:25.994509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 248 to 248
2025-10-15T10:54:25.994592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.994616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 248
2025-10-15T10:54:25.994680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 249 to 249
2025-10-15T10:54:25.994744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.994766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 249
2025-10-15T10:54:25.994831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 250 to 250
2025-10-15T10:54:25.994898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.994924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 250
2025-10-15T10:54:25.994999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 251 to 251
2025-10-15T10:54:25.995117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.995139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 251
2025-10-15T10:54:25.995211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 252 to 252
2025-10-15T10:54:25.995279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:25.995302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 252
2025-10-15T10:54:26.001973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.002025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.002083Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 97 size 5143 offset: -1
2025-10-15T10:54:26.002206Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (19-19)
2025-10-15T10:54:26.014908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 253 to 253
2025-10-15T10:54:26.015047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.015080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 253
2025-10-15T10:54:26.015184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 254 to 254
2025-10-15T10:54:26.015269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.015292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 254
2025-10-15T10:54:26.015395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 255 to 255
2025-10-15T10:54:26.015473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.015502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 255
2025-10-15T10:54:26.015582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 256 to 256
2025-10-15T10:54:26.015658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.015686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 256
2025-10-15T10:54:26.015760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 257 to 257
2025-10-15T10:54:26.015836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.015860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 257
2025-10-15T10:54:26.015943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 258 to 258
2025-10-15T10:54:26.016015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.016038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 258
2025-10-15T10:54:26.016146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 259 to 259
2025-10-15T10:54:26.016211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.016236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 259
2025-10-15T10:54:26.016306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 260 to 260
2025-10-15T10:54:26.016401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.016425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 260
2025-10-15T10:54:26.016489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 261 to 261
2025-10-15T10:54:26.016555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.016576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 261
2025-10-15T10:54:26.016640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 262 to 262
2025-10-15T10:54:26.016706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.016729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 262
2025-10-15T10:54:26.016794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 263 to 263
2025-10-15T10:54:26.016859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.016882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 263
2025-10-15T10:54:26.016948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 264 to 264
2025-10-15T10:54:26.017017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.017039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 264
2025-10-15T10:54:26.017139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 265 to 265
2025-10-15T10:54:26.017203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.017228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 265
2025-10-15T10:54:26.017295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 266 to 266
2025-10-15T10:54:26.017355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.017378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 266
2025-10-15T10:54:26.017446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 267 to 267
2025-10-15T10:54:26.017508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.017532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 267
2025-10-15T10:54:26.017597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 268 to 268
2025-10-15T10:54:26.017707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.017729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 268
2025-10-15T10:54:26.017796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 269 to 269
2025-10-15T10:54:26.017875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.017898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 269
2025-10-15T10:54:26.017963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 270 to 270
2025-10-15T10:54:26.018026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.018050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 270
2025-10-15T10:54:26.018116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 271 to 271
2025-10-15T10:54:26.018183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.018206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 271
2025-10-15T10:54:26.018308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 272 to 272
2025-10-15T10:54:26.018380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.018403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 272
2025-10-15T10:54:26.018473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 273 to 273
2025-10-15T10:54:26.018542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.018568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 273
2025-10-15T10:54:26.018643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 274 to 274
2025-10-15T10:54:26.018710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.018732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 274
2025-10-15T10:54:26.018800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 275 to 275
2025-10-15T10:54:26.018864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.018888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 275
2025-10-15T10:54:26.018961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 276 to 276
2025-10-15T10:54:26.019070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.019090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 276
2025-10-15T10:54:26.019157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 277 to 277
2025-10-15T10:54:26.019223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.019245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 277
2025-10-15T10:54:26.014463Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.014517Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.014583Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 98 size 5253 offset: -1
2025-10-15T10:54:26.014700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.014717Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.014744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 99 size 5363 offset: -1
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..1111 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.761000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1221 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.773000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1331 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.773000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1441 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.773000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1551 bytes.. Information: { Offset: 14 ProducerId: "src_id" SeqNo: 15 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.773000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1661 bytes.. Information: { Offset: 15 ProducerId: "src_id" SeqNo: 16 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.773000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1771 bytes.. Information: { Offset: 16 ProducerId: "src_id" SeqNo: 17 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.773000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1881 bytes.. Information: { Offset: 17 ProducerId: "src_id" SeqNo: 18 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.773000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..1991 bytes.. Information: { Offset: 18 ProducerId: "src_id" SeqNo: 19 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.773000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2101 bytes.. Information: { Offset: 19 ProducerId: "src_id" SeqNo: 20 CreateTime: 2025-10-15T10:54:25.585000Z WriteTime: 2025-10-15T10:54:25.773000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:26.025630Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 10, size 16060 bytes
2025-10-15T10:54:26.025698Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.024147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.024198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.024258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 100 size 5473 offset: -1
2025-10-15T10:54:26.024342Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.024357Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.024379Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 101 size 5583 offset: -1
2025-10-15T10:54:26.024419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.024435Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.024468Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.024480Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.024506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.024519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.024548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.024560Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.024588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.024600Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.024626Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.024673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.024706Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.024726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.024738Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.024753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.024763Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.024778Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.024790Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.024802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.024890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 52
2025-10-15T10:54:26.024927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103  requestId: <none> cookie: 53
2025-10-15T10:54:26.024945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 54
2025-10-15T10:54:26.024962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105  requestId: <none> cookie: 55
2025-10-15T10:54:26.024982Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 56
2025-10-15T10:54:26.031760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 278 to 278
2025-10-15T10:54:26.031913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.031947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 278
2025-10-15T10:54:26.032061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 279 to 279
2025-10-15T10:54:26.032141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.032166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 279
2025-10-15T10:54:26.032236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 280 to 280
2025-10-15T10:54:26.032318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.032343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 280
2025-10-15T10:54:26.032454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 281 to 281
2025-10-15T10:54:26.032524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.032546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 281
2025-10-15T10:54:26.032620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 282 to 282
2025-10-15T10:54:26.032686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.032708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 282
2025-10-15T10:54:26.032780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 283 to 283
2025-10-15T10:54:26.032849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.032872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 283
2025-10-15T10:54:26.032947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 284 to 284
2025-10-15T10:54:26.033043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.033064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 284
2025-10-15T10:54:26.033135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 285 to 285
2025-10-15T10:54:26.033201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.033222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 285
2025-10-15T10:54:26.033291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 286 to 286
2025-10-15T10:54:26.033357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.033377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 286
2025-10-15T10:54:26.033475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 287 to 287
2025-10-15T10:54:26.033542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.033563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 287
2025-10-15T10:54:26.033633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 288 to 288
2025-10-15T10:54:26.033717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.033739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 288
2025-10-15T10:54:26.033811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 289 to 289
2025-10-15T10:54:26.033879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.033902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 289
2025-10-15T10:54:26.033976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 290 to 290
2025-10-15T10:54:26.034052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.034071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 290
2025-10-15T10:54:26.034146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 291 to 291
2025-10-15T10:54:26.034222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.034244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 291
2025-10-15T10:54:26.034317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 292 to 292
2025-10-15T10:54:26.034424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.034445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 292
2025-10-15T10:54:26.034550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 293 to 293
2025-10-15T10:54:26.034616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.034637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 293
2025-10-15T10:54:26.034720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 294 to 294
2025-10-15T10:54:26.034793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.034815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 294
2025-10-15T10:54:26.034889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 295 to 295
2025-10-15T10:54:26.034962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.034981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 295
2025-10-15T10:54:26.035054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 296 to 296
2025-10-15T10:54:26.035139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.035162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 296
2025-10-15T10:54:26.035237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 297 to 297
2025-10-15T10:54:26.035373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.035400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 297
2025-10-15T10:54:26.035488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 298 to 298
2025-10-15T10:54:26.035573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.035599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 298
2025-10-15T10:54:26.035666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 299 to 299
2025-10-15T10:54:26.035745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.035772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 299
2025-10-15T10:54:26.035833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write 1 messages with Id from 300 to 300
2025-10-15T10:54:26.035929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: try to update token
2025-10-15T10:54:26.035950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Send 1 message(s) (0 left), first sequence number is 300
2025-10-15T10:54:26.035514Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.035644Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.035674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.035719Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.035749Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.036035Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.036100Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.036142Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.036180Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.036212Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.035663Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 16 size 49982 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.035741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.035794Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 49840 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.035828Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.035858Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-15T10:54:26.035886Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.035909Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-15T10:54:26.035921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.035946Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-15T10:54:26.035958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.035975Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-15T10:54:26.035987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036005Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-15T10:54:26.036015Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036033Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-15T10:54:26.036044Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-15T10:54:26.036076Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-15T10:54:26.036135Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036156Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-15T10:54:26.036168Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036186Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-15T10:54:26.036196Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036213Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-15T10:54:26.036223Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036248Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-15T10:54:26.036258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036277Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-15T10:54:26.036287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036314Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-15T10:54:26.036326Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036341Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-15T10:54:26.036352Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.036369Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-15T10:54:26.036554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.036621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.036632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:26.036720Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-15T10:54:26.037612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4117 count 1 nextOffset 37 batches 1
2025-10-15T10:54:26.037663Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-15T10:54:26.037705Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 8312 count 2 nextOffset 38 batches 1
2025-10-15T10:54:26.037729Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-15T10:54:26.037752Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 12617 count 3 nextOffset 39 batches 1
2025-10-15T10:54:26.037774Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-15T10:54:26.037794Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 17032 count 4 nextOffset 40 batches 1
2025-10-15T10:54:26.037816Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-15T10:54:26.037839Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 21557 count 5 nextOffset 41 batches 1
2025-10-15T10:54:26.037860Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-15T10:54:26.037880Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 26192 count 6 nextOffset 42 batches 1
2025-10-15T10:54:26.037899Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-15T10:54:26.037919Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 30937 count 7 nextOffset 43 batches 1
2025-10-15T10:54:26.037938Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-15T10:54:26.037958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 35792 count 8 nextOffset 44 batches 1
2025-10-15T10:54:26.037978Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-15T10:54:26.038000Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 40757 count 9 nextOffset 45 batches 1
2025-10-15T10:54:26.038023Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-15T10:54:26.038044Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 45832 count 10 nextOffset 46 batches 1
2025-10-15T10:54:26.038064Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-15T10:54:26.038083Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 51017 count 11 nextOffset 47 batches 1
2025-10-15T10:54:26.038102Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-15T10:54:26.038120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 56312 count 12 nextOffset 48 batches 1
2025-10-15T10:54:26.038146Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-15T10:54:26.038165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 61717 count 13 nextOffset 49 batches 1
2025-10-15T10:54:26.038183Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-15T10:54:26.038202Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 67232 count 14 nextOffset 50 batches 1
2025-10-15T10:54:26.038225Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-15T10:54:26.038244Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 72857 count 15 nextOffset 51 batches 1
2025-10-15T10:54:26.038259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.039083Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,15 HeadOffset 36 endOffset 36 curOffset 51 d0000000000_00000000000000000036_00000_0000000015_00000? size 72439 WTime 1760525666037
2025-10-15T10:54:26.039272Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.039341Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 21
2025-10-15T10:54:26.039676Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 16 parts 0 suffix '63' size 49982
2025-10-15T10:54:26.043497Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 20 EndOffset 20 newEndOffset 36 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-15T10:54:26.043551Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 20 endOffset 36
2025-10-15T10:54:26.043621Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 20, endOffset# 36, WTime# 1760525665773, sizeLag# 49982
2025-10-15T10:54:26.043639Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:26.043690Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 5a8341a-1779aa47-89511ca0-cda9e510, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 59978, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:26.043752Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 59978 maxTimeLagMs 0 readTimestampMs 0 readOffset 20 EndOffset 36 ClientCommitOffset 0 committedOffset 0 Guid 5a8341a-1779aa47-89511ca0-cda9e510
2025-10-15T10:54:26.047434Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.048220Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.048525Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.048973Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.049185Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.049367Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.049661Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.050039Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.050259Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.050414Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.050772Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.051510Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 22
2025-10-15T10:54:26.051556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 23
2025-10-15T10:54:26.051583Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 24
2025-10-15T10:54:26.051606Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-15T10:54:26.051632Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 26
2025-10-15T10:54:26.051657Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 27
2025-10-15T10:54:26.051682Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 28
2025-10-15T10:54:26.051707Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 29
2025-10-15T10:54:26.051730Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-15T10:54:26.051753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 31
2025-10-15T10:54:26.051775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 32
2025-10-15T10:54:26.051799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 33
2025-10-15T10:54:26.054718Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.051821Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 34
2025-10-15T10:54:26.051844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 35
2025-10-15T10:54:26.051866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 36
2025-10-15T10:54:26.051912Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.052036Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 15 size 72439
2025-10-15T10:54:26.052160Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052187Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052236Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 107 size 5693 offset: -1
2025-10-15T10:54:26.052293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052305Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 108 size 5803 offset: -1
2025-10-15T10:54:26.052392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052404Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052432Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 109 size 5913 offset: -1
2025-10-15T10:54:26.052492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052504Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 110 size 6023 offset: -1
2025-10-15T10:54:26.052594Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052606Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052630Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 111 size 6133 offset: -1
2025-10-15T10:54:26.055040Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.052659Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052668Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052696Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052706Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052730Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052761Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052797Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.052865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.052876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.053027Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.053070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.053083Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.055385Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.053096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.053105Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.053118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.053128Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.053139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.053154Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.053166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.053283Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 112  requestId: <none> cookie: 57
2025-10-15T10:54:26.053306Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 113  requestId: <none> cookie: 58
2025-10-15T10:54:26.053322Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 114  requestId: <none> cookie: 59
2025-10-15T10:54:26.053336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 115  requestId: <none> cookie: 60
2025-10-15T10:54:26.053356Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 116  requestId: <none> cookie: 61
2025-10-15T10:54:26.053405Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 20 count 19 size 59978 endOffset 36 max time lag 0ms effective offset 20
2025-10-15T10:54:26.053576Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 49982 count 16 last offset 20, current partition end offset: 36
2025-10-15T10:54:26.055761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 32 queued_in_partition_duration_ms: 12 }
2025-10-15T10:54:26.053590Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-15T10:54:26.053630Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 16 parts_count 0 source 1 size 49982 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:26.053652Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-15T10:54:26.053716Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:26.054119Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 20 totakecount 16 count 16 size 49960 from pos 0 cbcount 16
2025-10-15T10:54:26.055834Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.054326Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 20
2025-10-15T10:54:26.055842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 1
2025-10-15T10:54:26.056127Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.055962Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 16 parts 0 suffix '63'
2025-10-15T10:54:26.056348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056425Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056547Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056572Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056616Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056647Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056689Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056714Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056742Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056784Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056808Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056833Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056859Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056888Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056919Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.056972Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.057006Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.057033Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.057056Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.057079Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.058189Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.058261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.058303Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.058334Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.058367Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.059267Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 36 Result { Offset: 20 Data: "... 2283 bytes ..." SourceId: "\000src_id" SeqNo: 21 WriteTimestampMS: 1760525665834 CreateTimestampMS: 1760525665586 UncompressedSize: 2211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 2393 bytes ..." SourceId: "\000src_id" SeqNo: 22 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665586 UncompressedSize: 2321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 2503 bytes ..." SourceId: "\000src_id" SeqNo: 23 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665586 UncompressedSize: 2431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 2613 bytes ..." SourceId: "\000src_id" SeqNo: 24 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665586 UncompressedSize: 2541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 2723 bytes ..." SourceId: "\000src_id" SeqNo: 25 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665586 UncompressedSize: 2651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 25 Data: "... 2833 bytes ..." SourceId: "\000src_id" SeqNo: 26 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665586 UncompressedSize: 2761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 2943 bytes ..." SourceId: "\000src_id" SeqNo: 27 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665586 UncompressedSize: 2871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 3053 bytes ..." SourceId: "\000src_id" SeqNo: 28 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665586 UncompressedSize: 2981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 28 Data: "... 3163 bytes ..." SourceId: "\000src_id" SeqNo: 29 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665586 UncompressedSize: 3091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 29 Data: "... 3273 bytes ..." SourceId: "\000src_id" SeqNo: 30 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665586 UncompressedSize: 3201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 30 Data: "... 3383 bytes ..." SourceId: "\000src_id" SeqNo: 31 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665587 UncompressedSize: 3311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 31 Data: "... 3493 bytes ..." SourceId: "\000src_id" SeqNo: 32 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665587 UncompressedSize: 3421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 32 Data: "... 3603 bytes ..." SourceId: "\000src_id" SeqNo: 33 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665587 UncompressedSize: 3531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 33 Data: "... 3713 bytes ..." SourceId: "\000src_id" SeqNo: 34 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665587 UncompressedSize: 3641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 34 Data: "... 3823 bytes ..." SourceId: "\000src_id" SeqNo: 35 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665604 UncompressedSize: 3751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 35 Data: "... 3933 bytes ..." SourceId: "\000src_id" SeqNo: 36 WriteTimestampMS: 1760525665878 CreateTimestampMS: 1760525665604 UncompressedSize: 3861 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551198 RealReadOffset: 35 WaitQuotaTimeMs: 0 EndOffset: 36 StartOffset: 0 } Cookie: 20 }
2025-10-15T10:54:26.063752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 102 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:26.063812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 2
2025-10-15T10:54:26.063982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 102 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:26.064019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 3
2025-10-15T10:54:26.064172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 102 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:26.064198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 4
2025-10-15T10:54:26.063553Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.064325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 102 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:26.063605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.065320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 5
2025-10-15T10:54:26.065530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 102 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.065560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 6
2025-10-15T10:54:26.063660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 117 size 6243 offset: -1
2025-10-15T10:54:26.063735Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.063745Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.063766Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 118 size 6353 offset: -1
2025-10-15T10:54:26.063838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.063851Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.063873Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 119 size 6463 offset: -1
2025-10-15T10:54:26.063951Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.065740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 102 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.063964Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.065764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 7
2025-10-15T10:54:26.063993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 120 size 6573 offset: -1
2025-10-15T10:54:26.064086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.064101Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.064126Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 121 size 6683 offset: -1
2025-10-15T10:54:26.064161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.064172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.064205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.064215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.064240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.065925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 102 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.064252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.064276Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.065962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 8
2025-10-15T10:54:26.064285Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.064315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.064326Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.064484Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.064532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.064546Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.064562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.064571Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.066100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 102 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.066134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 9
2025-10-15T10:54:26.066296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 102 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.066322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 10
2025-10-15T10:54:26.066459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 89 }
2025-10-15T10:54:26.066487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 11
2025-10-15T10:54:26.066610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 89 }
2025-10-15T10:54:26.066631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 12
2025-10-15T10:54:26.066788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 89 }
2025-10-15T10:54:26.066816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 13
2025-10-15T10:54:26.066936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 89 }
2025-10-15T10:54:26.066954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 14
2025-10-15T10:54:26.067062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 80 }
2025-10-15T10:54:26.067081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 15
2025-10-15T10:54:26.067245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:26.067273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 16
2025-10-15T10:54:26.067883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:26.067928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 17
2025-10-15T10:54:26.068115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:26.068146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 18
2025-10-15T10:54:26.068279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 22 }
2025-10-15T10:54:26.068303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 19
2025-10-15T10:54:26.068437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 61 queued_in_partition_duration_ms: 22 }
2025-10-15T10:54:26.068457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 20
2025-10-15T10:54:26.068556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 91 }
2025-10-15T10:54:26.068574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 21
2025-10-15T10:54:26.068691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 91 }
2025-10-15T10:54:26.068718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 22
2025-10-15T10:54:26.068847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 91 }
2025-10-15T10:54:26.068867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 23
2025-10-15T10:54:26.068969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 91 }
2025-10-15T10:54:26.068988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 24
2025-10-15T10:54:26.069084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 91 }
2025-10-15T10:54:26.069129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 25
2025-10-15T10:54:26.069247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 58 }
2025-10-15T10:54:26.069268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 26
2025-10-15T10:54:26.069377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 58 }
2025-10-15T10:54:26.069423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 27
2025-10-15T10:54:26.069540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 58 }
2025-10-15T10:54:26.069566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 28
2025-10-15T10:54:26.069680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 58 }
2025-10-15T10:54:26.069715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 29
2025-10-15T10:54:26.069838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 58 }
2025-10-15T10:54:26.069858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 30
2025-10-15T10:54:26.069972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 48 }
2025-10-15T10:54:26.069995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 31
2025-10-15T10:54:26.070106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 44 }
2025-10-15T10:54:26.070125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 32
2025-10-15T10:54:26.070242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 44 }
2025-10-15T10:54:26.070268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 33
2025-10-15T10:54:26.070386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 43 }
2025-10-15T10:54:26.070412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 34
2025-10-15T10:54:26.070527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 43 }
2025-10-15T10:54:26.068470Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 36
2025-10-15T10:54:26.070550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 35
2025-10-15T10:54:26.068537Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 ReadOffset 36 ReadGuid 5a8341a-1779aa47-89511ca0-cda9e510 has messages 1
2025-10-15T10:54:26.068716Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 5a8341a-1779aa47-89511ca0-cda9e510, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 49387
2025-10-15T10:54:26.068748Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 5a8341a-1779aa47-89511ca0-cda9e510
2025-10-15T10:54:26.069092Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:26.069294Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.070647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 156 queued_in_partition_duration_ms: 43 }
2025-10-15T10:54:26.069389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.069455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.070666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 36
2025-10-15T10:54:26.069488Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.069546Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.069586Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.070140Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.070206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.070245Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.070298Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.070338Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.064582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.064592Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.064605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.064617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.064628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.065099Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 122  requestId: <none> cookie: 62
2025-10-15T10:54:26.065131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 123  requestId: <none> cookie: 63
2025-10-15T10:54:26.065147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 124  requestId: <none> cookie: 64
2025-10-15T10:54:26.065162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 125  requestId: <none> cookie: 65
2025-10-15T10:54:26.065176Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 126  requestId: <none> cookie: 66
2025-10-15T10:54:26.071544Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.072161Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.072393Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 49387, now ReadSizeBudget = 0, ReadSizeServerDelta = 474901
2025-10-15T10:54:26.072534Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 474901
2025-10-15T10:54:26.072614Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.072935Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.073236Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.073597Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.073992Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.074317Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.074627Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.071784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.072094Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072123Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 127 size 6793 offset: -1
2025-10-15T10:54:26.072276Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 128 size 6903 offset: -1
2025-10-15T10:54:26.072395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072430Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 129 size 7013 offset: -1
2025-10-15T10:54:26.072472Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 130 size 7123 offset: -1
2025-10-15T10:54:26.072578Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072591Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072612Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 131 size 7233 offset: -1
2025-10-15T10:54:26.072642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072653Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072690Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072699Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072731Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072769Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.072814Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.072902Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 15 size 72439 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.072952Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.072995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.073007Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.073020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.073030Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.075574Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (20-35)
2025-10-15T10:54:26.075637Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 49387 to budget
2025-10-15T10:54:26.075680Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 49387, ReadSizeServerDelta = 474901
2025-10-15T10:54:26.075883Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:26.075995Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (20-20)
2025-10-15T10:54:26.076067Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (21-21)
2025-10-15T10:54:26.076177Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (22-22)
2025-10-15T10:54:26.076224Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (23-23)
2025-10-15T10:54:26.076301Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (24-24)
2025-10-15T10:54:26.076330Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (25-25)
2025-10-15T10:54:26.076360Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (26-26)
2025-10-15T10:54:26.076404Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (27-27)
2025-10-15T10:54:26.076479Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (28-28)
2025-10-15T10:54:26.076508Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (29-29)
2025-10-15T10:54:26.076533Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (30-30)
2025-10-15T10:54:26.076568Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (31-31)
2025-10-15T10:54:26.076642Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (32-32)
2025-10-15T10:54:26.076684Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (33-33)
2025-10-15T10:54:26.073054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.073066Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.073079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.073088Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.073105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.073174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.073220Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 72300 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.073252Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073303Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-15T10:54:26.073328Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073354Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-15T10:54:26.073369Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073387Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-15T10:54:26.073403Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073417Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-15T10:54:26.073427Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073446Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-15T10:54:26.073455Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073469Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-15T10:54:26.073479Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073508Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-15T10:54:26.073520Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073533Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-15T10:54:26.073542Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073560Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-15T10:54:26.073568Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073585Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-15T10:54:26.073593Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-15T10:54:26.073618Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073633Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-15T10:54:26.073645Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073662Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-15T10:54:26.073672Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073713Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-15T10:54:26.073733Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.073752Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-15T10:54:26.073943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.074014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.074026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:26.074128Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-15T10:54:26.075742Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 5767 count 1 nextOffset 52 batches 1
2025-10-15T10:54:26.075806Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-15T10:54:26.075838Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 11612 count 2 nextOffset 53 batches 1
2025-10-15T10:54:26.075862Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-15T10:54:26.075884Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 17567 count 3 nextOffset 54 batches 1
2025-10-15T10:54:26.075908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-15T10:54:26.075929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 23632 count 4 nextOffset 55 batches 1
2025-10-15T10:54:26.075947Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-15T10:54:26.075981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 29807 count 5 nextOffset 56 batches 1
2025-10-15T10:54:26.076008Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-15T10:54:26.076035Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 36092 count 6 nextOffset 57 batches 1
2025-10-15T10:54:26.076062Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-15T10:54:26.076089Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 42487 count 7 nextOffset 58 batches 1
2025-10-15T10:54:26.076122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-15T10:54:26.076162Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 48992 count 8 nextOffset 59 batches 1
2025-10-15T10:54:26.076187Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-15T10:54:26.076210Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 55607 count 9 nextOffset 60 batches 1
2025-10-15T10:54:26.076235Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-15T10:54:26.076261Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 62332 count 10 nextOffset 61 batches 1
2025-10-15T10:54:26.076292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-10-15T10:54:26.076314Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 69167 count 11 nextOffset 62 batches 1
2025-10-15T10:54:26.076335Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-15T10:54:26.076355Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 76112 count 12 nextOffset 63 batches 1
2025-10-15T10:54:26.076375Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-15T10:54:26.076395Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 83167 count 13 nextOffset 64 batches 1
2025-10-15T10:54:26.076413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-15T10:54:26.076432Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 90332 count 14 nextOffset 65 batches 1
2025-10-15T10:54:26.076459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-15T10:54:26.076737Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (34-34)
2025-10-15T10:54:26.080160Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 14} (35-35)
>>> event from dataHandler: 2025-10-15T10:54:26.076482Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 97607 count 15 nextOffset 66 batches 1
2025-10-15T10:54:26.076501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.076840Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 15 parts 0 suffix '63' size 72439
2025-10-15T10:54:26.077396Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 51,15 HeadOffset 51 endOffset 51 curOffset 66 d0000000000_00000000000000000051_00000_0000000015_00000? size 97189 WTime 1760525666074
2025-10-15T10:54:26.077660Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.077727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 132  requestId: <none> cookie: 67
2025-10-15T10:54:26.077775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 133  requestId: <none> cookie: 68
2025-10-15T10:54:26.077798Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 134  requestId: <none> cookie: 69
2025-10-15T10:54:26.077816Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 135  requestId: <none> cookie: 70
2025-10-15T10:54:26.077848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 136  requestId: <none> cookie: 71
2025-10-15T10:54:26.077881Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 37
2025-10-15T10:54:26.077914Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 38
2025-10-15T10:54:26.077936Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 39
2025-10-15T10:54:26.077959Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 40
2025-10-15T10:54:26.077980Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-15T10:54:26.078003Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 42
2025-10-15T10:54:26.083850Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.078033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 43
2025-10-15T10:54:26.083927Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 44
2025-10-15T10:54:26.083990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078083Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 45
2025-10-15T10:54:26.084028Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 46
2025-10-15T10:54:26.084055Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.084082Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078126Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 47
2025-10-15T10:54:26.084109Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078149Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 48
2025-10-15T10:54:26.084154Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078176Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99  requestId: <none> cookie: 49
2025-10-15T10:54:26.084182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 50
2025-10-15T10:54:26.084214Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101  requestId: <none> cookie: 51
2025-10-15T10:54:26.084242Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078258Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.084268Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.078391Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 51 partNo 0 count 15 size 97189
2025-10-15T10:54:26.084300Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.084326Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.084356Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.084403Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.084440Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.084466Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.084491Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.084517Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.084542Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.085091Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2211 bytes.. Information: { Offset: 20 ProducerId: "src_id" SeqNo: 21 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.834000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2321 bytes.. Information: { Offset: 21 ProducerId: "src_id" SeqNo: 22 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2431 bytes.. Information: { Offset: 22 ProducerId: "src_id" SeqNo: 23 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2541 bytes.. Information: { Offset: 23 ProducerId: "src_id" SeqNo: 24 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2651 bytes.. Information: { Offset: 24 ProducerId: "src_id" SeqNo: 25 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2761 bytes.. Information: { Offset: 25 ProducerId: "src_id" SeqNo: 26 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2871 bytes.. Information: { Offset: 26 ProducerId: "src_id" SeqNo: 27 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..2981 bytes.. Information: { Offset: 27 ProducerId: "src_id" SeqNo: 28 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3091 bytes.. Information: { Offset: 28 ProducerId: "src_id" SeqNo: 29 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3201 bytes.. Information: { Offset: 29 ProducerId: "src_id" SeqNo: 30 CreateTime: 2025-10-15T10:54:25.586000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3311 bytes.. Information: { Offset: 30 ProducerId: "src_id" SeqNo: 31 CreateTime: 2025-10-15T10:54:25.587000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3421 bytes.. Information: { Offset: 31 ProducerId: "src_id" SeqNo: 32 CreateTime: 2025-10-15T10:54:25.587000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3531 bytes.. Information: { Offset: 32 ProducerId: "src_id" SeqNo: 33 CreateTime: 2025-10-15T10:54:25.587000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3641 bytes.. Information: { Offset: 33 ProducerId: "src_id" SeqNo: 34 CreateTime: 2025-10-15T10:54:25.587000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3751 bytes.. Information: { Offset: 34 ProducerId: "src_id" SeqNo: 35 CreateTime: 2025-10-15T10:54:25.604000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..3861 bytes.. Information: { Offset: 35 ProducerId: "src_id" SeqNo: 36 CreateTime: 2025-10-15T10:54:25.604000Z WriteTime: 2025-10-15T10:54:25.878000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }2025-10-15T10:54:26.085148Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.085184Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.085216Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.085249Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.085862Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 36 EndOffset 36 newEndOffset 51 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-15T10:54:26.085884Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 36 endOffset 51
2025-10-15T10:54:26.085922Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 36, endOffset# 51, WTime# 1760525665878, sizeLag# 72439
2025-10-15T10:54:26.085943Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:26.085994Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# d4aaa84d-6e946a63-e50e515-7242c3a9, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 86926, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:26.086052Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 86926 maxTimeLagMs 0 readTimestampMs 0 readOffset 36 EndOffset 51 ClientCommitOffset 0 committedOffset 0 Guid d4aaa84d-6e946a63-e50e515-7242c3a9
2025-10-15T10:54:26.088639Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.088685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.088745Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 137 size 7343 offset: -1
2025-10-15T10:54:26.088799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.088809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.088834Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 138 size 7453 offset: -1
2025-10-15T10:54:26.088881Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.088894Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.088913Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 139 size 7563 offset: -1
2025-10-15T10:54:26.088957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.088968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.088990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 140 size 7673 offset: -1
2025-10-15T10:54:26.089030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.089041Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.089062Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 141 size 7783 offset: -1
2025-10-15T10:54:26.089095Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.089108Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.089164Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.089177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.089204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.089217Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.089281Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.089296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.089321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.089332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.089412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.092110Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.092291Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.107760Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 49387 } }
2025-10-15T10:54:26.107858Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 94263904-715a5028-b8cb8336-d4ee179a
2025-10-15T10:54:26.089423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.089511Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.089558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.089572Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.089592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.089603Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.089621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.089632Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.089661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.089681Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.089737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.090253Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 16, size 48576 bytes
2025-10-15T10:54:26.111799Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.090297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 142  requestId: <none> cookie: 72
2025-10-15T10:54:26.090736Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 143  requestId: <none> cookie: 73
2025-10-15T10:54:26.090762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 144  requestId: <none> cookie: 74
2025-10-15T10:54:26.090781Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 145  requestId: <none> cookie: 75
2025-10-15T10:54:26.090800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 146  requestId: <none> cookie: 76
2025-10-15T10:54:26.090860Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 36 count 18 size 86926 endOffset 51 max time lag 0ms effective offset 36
2025-10-15T10:54:26.091048Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 72439 count 15 last offset 36, current partition end offset: 51
2025-10-15T10:54:26.122645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 139 }
2025-10-15T10:54:26.122734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 37
2025-10-15T10:54:26.123120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 143 }
2025-10-15T10:54:26.123152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 38
2025-10-15T10:54:26.091063Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-15T10:54:26.091110Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 36 partno 0 count 15 parts_count 0 source 1 size 72439 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:26.091134Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-15T10:54:26.091183Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:26.112458Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 36 totakecount 15 count 15 size 72417 from pos 0 cbcount 15
2025-10-15T10:54:26.112747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 36
2025-10-15T10:54:26.121888Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.123819Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 15 parts 0 suffix '63'
2025-10-15T10:54:26.124211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.124307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.124348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.124389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.124651Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.124722Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.124763Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.124797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.124859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.124895Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.124946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 147 size 7893 offset: -1
2025-10-15T10:54:26.124988Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.124999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.125025Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.125079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.125141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 148  requestId: <none> cookie: 77
2025-10-15T10:54:26.126000Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.126022Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.126055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 149 size 8003 offset: -1
2025-10-15T10:54:26.126100Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.126111Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.126142Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 150 size 8113 offset: -1
2025-10-15T10:54:26.126192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.126203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.126233Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 151 size 8223 offset: -1
2025-10-15T10:54:26.126282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.126295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.126317Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 152 size 8333 offset: -1
2025-10-15T10:54:26.126351Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.126362Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.126387Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.126395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.126417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.126425Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.126447Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.126454Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.126472Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.126499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.126509Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.126523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.126532Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.126542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.126551Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.126563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.126652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 153  requestId: <none> cookie: 78
2025-10-15T10:54:26.126684Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 154  requestId: <none> cookie: 79
2025-10-15T10:54:26.126704Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 155  requestId: <none> cookie: 80
2025-10-15T10:54:26.126719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 156  requestId: <none> cookie: 81
2025-10-15T10:54:26.125871Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 51 Result { Offset: 36 Data: "... 4043 bytes ..." SourceId: "\000src_id" SeqNo: 37 WriteTimestampMS: 1760525666034 CreateTimestampMS: 1760525665604 UncompressedSize: 3971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 37 Data: "... 4153 bytes ..." SourceId: "\000src_id" SeqNo: 38 WriteTimestampMS: 1760525666034 CreateTimestampMS: 1760525665604 UncompressedSize: 4081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 38 Data: "... 4263 bytes ..." SourceId: "\000src_id" SeqNo: 39 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665604 UncompressedSize: 4191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 39 Data: "... 4373 bytes ..." SourceId: "\000src_id" SeqNo: 40 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665604 UncompressedSize: 4301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 40 Data: "... 4483 bytes ..." SourceId: "\000src_id" SeqNo: 41 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665605 UncompressedSize: 4411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 41 Data: "... 4593 bytes ..." SourceId: "\000src_id" SeqNo: 42 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665605 UncompressedSize: 4521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 42 Data: "... 4703 bytes ..." SourceId: "\000src_id" SeqNo: 43 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665605 UncompressedSize: 4631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 43 Data: "... 4813 bytes ..." SourceId: "\000src_id" SeqNo: 44 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665605 UncompressedSize: 4741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 44 Data: "... 4923 bytes ..." SourceId: "\000src_id" SeqNo: 45 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665605 UncompressedSize: 4851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 45 Data: "... 5033 bytes ..." SourceId: "\000src_id" SeqNo: 46 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665605 UncompressedSize: 4961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 46 Data: "... 5143 bytes ..." SourceId: "\000src_id" SeqNo: 47 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665606 UncompressedSize: 5071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 47 Data: "... 5253 bytes ..." SourceId: "\000src_id" SeqNo: 48 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665606 UncompressedSize: 5181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 48 Data: "... 5363 bytes ..." SourceId: "\000src_id" SeqNo: 49 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665606 UncompressedSize: 5291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 49 Data: "... 5473 bytes ..." SourceId: "\000src_id" SeqNo: 50 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665606 UncompressedSize: 5401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 50 Data: "... 5583 bytes ..." SourceId: "\000src_id" SeqNo: 51 WriteTimestampMS: 1760525666037 CreateTimestampMS: 1760525665606 UncompressedSize: 5511 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551230 RealReadOffset: 50 WaitQuotaTimeMs: 0 EndOffset: 51 StartOffset: 0 } Cookie: 36 }
2025-10-15T10:54:26.126388Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 51
2025-10-15T10:54:26.126428Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 51 ReadOffset 51 ReadGuid d4aaa84d-6e946a63-e50e515-7242c3a9 has messages 1
2025-10-15T10:54:26.126580Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.126774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.126909Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# d4aaa84d-6e946a63-e50e515-7242c3a9, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 71889
2025-10-15T10:54:26.126938Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# d4aaa84d-6e946a63-e50e515-7242c3a9
2025-10-15T10:54:26.127173Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:26.127539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.127561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.127594Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 157 size 8443 offset: -1
2025-10-15T10:54:26.127637Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.127658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.127793Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.127840Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.127870Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.127897Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.128255Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.128305Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.128340Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.128372Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.128546Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.129511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.129543Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.129588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.129599Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.129629Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 159 size 8553 offset: -1
2025-10-15T10:54:26.129670Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.129680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.129737Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 160 size 8663 offset: -1
2025-10-15T10:54:26.129785Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.129796Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.129816Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 161 size 8773 offset: -1
2025-10-15T10:54:26.129855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.129866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.129896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 162 size 8883 offset: -1
2025-10-15T10:54:26.129951Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.129967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.129998Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.130009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.130033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.130044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.130065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.130074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.130114Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.130139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.130158Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.130172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.130183Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.130196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.130207Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.130220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.130270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 158  requestId: <none> cookie: 82
2025-10-15T10:54:26.130312Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 163  requestId: <none> cookie: 83
2025-10-15T10:54:26.130335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 164  requestId: <none> cookie: 84
2025-10-15T10:54:26.130353Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 165  requestId: <none> cookie: 85
2025-10-15T10:54:26.130369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 166  requestId: <none> cookie: 86
2025-10-15T10:54:26.130703Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.130765Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.131014Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.131049Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.131079Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.131108Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.131565Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.131613Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.131652Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.131687Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.131723Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.132080Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.132493Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 71889, now ReadSizeBudget = 0, ReadSizeServerDelta = 452399
2025-10-15T10:54:26.132641Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 452399
2025-10-15T10:54:26.137065Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.135555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.135596Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.135650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 167 size 8993 offset: -1
2025-10-15T10:54:26.135710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.135721Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.135742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 168 size 9103 offset: -1
2025-10-15T10:54:26.135792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.135805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.135827Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 169 size 9213 offset: -1
2025-10-15T10:54:26.135884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.135900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.135926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 170 size 9323 offset: -1
2025-10-15T10:54:26.135970Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.135987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.136012Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 171 size 9433 offset: -1
2025-10-15T10:54:26.136045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.136056Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.136087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.136107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.136139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.136150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.136183Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.136194Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.136232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.136246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.136454Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.136506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.136523Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.136537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.136547Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.136563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.136575Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.136587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.136596Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.136610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.136726Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 51 count 15 size 97189 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.136815Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 51 partno 0 count 15 parts 0 suffix '63' size 97189
2025-10-15T10:54:26.138416Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.139421Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (36-50)
2025-10-15T10:54:26.139475Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 71889 to budget
2025-10-15T10:54:26.139523Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 71889, ReadSizeServerDelta = 452399
2025-10-15T10:54:26.139722Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:26.139810Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (36-36)
2025-10-15T10:54:26.139858Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (37-37)
2025-10-15T10:54:26.139922Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (38-38)
2025-10-15T10:54:26.139954Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (39-39)
2025-10-15T10:54:26.140023Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (40-40)
2025-10-15T10:54:26.140085Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (41-41)
2025-10-15T10:54:26.140117Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (42-42)
2025-10-15T10:54:26.140148Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (43-43)
2025-10-15T10:54:26.140248Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (44-44)
2025-10-15T10:54:26.140335Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (45-45)
2025-10-15T10:54:26.140362Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (46-46)
2025-10-15T10:54:26.140412Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (47-47)
2025-10-15T10:54:26.140441Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (48-48)
2025-10-15T10:54:26.140489Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (49-49)
2025-10-15T10:54:26.140528Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (50-50)
>>> event from dataHandler: 2025-10-15T10:54:26.143182Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..3971 bytes.. Information: { Offset: 36 ProducerId: "src_id" SeqNo: 37 CreateTime: 2025-10-15T10:54:25.604000Z WriteTime: 2025-10-15T10:54:26.034000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4081 bytes.. Information: { Offset: 37 ProducerId: "src_id" SeqNo: 38 CreateTime: 2025-10-15T10:54:25.604000Z WriteTime: 2025-10-15T10:54:26.034000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4191 bytes.. Information: { Offset: 38 ProducerId: "src_id" SeqNo: 39 CreateTime: 2025-10-15T10:54:25.604000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4301 bytes.. Information: { Offset: 39 ProducerId: "src_id" SeqNo: 40 CreateTime: 2025-10-15T10:54:25.604000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4411 bytes.. Information: { Offset: 40 ProducerId: "src_id" SeqNo: 41 CreateTime: 2025-10-15T10:54:25.605000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4521 bytes.. Information: { Offset: 41 ProducerId: "src_id" SeqNo: 42 CreateTime: 2025-10-15T10:54:25.605000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4631 bytes.. Information: { Offset: 42 ProducerId: "src_id" SeqNo: 43 CreateTime: 2025-10-15T10:54:25.605000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4741 bytes.. Information: { Offset: 43 ProducerId: "src_id" SeqNo: 44 CreateTime: 2025-10-15T10:54:25.605000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4851 bytes.. Information: { Offset: 44 ProducerId: "src_id" SeqNo: 45 CreateTime: 2025-10-15T10:54:25.605000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..4961 bytes.. Information: { Offset: 45 ProducerId: "src_id" SeqNo: 46 CreateTime: 2025-10-15T10:54:25.605000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5071 bytes.. Information: { Offset: 46 ProducerId: "src_id" SeqNo: 47 CreateTime: 2025-10-15T10:54:25.606000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5181 bytes.. Information: { Offset: 47 ProducerId: "src_id" SeqNo: 48 CreateTime: 2025-10-15T10:54:25.606000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5291 bytes.. Information: { Offset: 48 ProducerId: "src_id" SeqNo: 49 CreateTime: 2025-10-15T10:54:25.606000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5401 bytes.. Information: { Offset: 49 ProducerId: "src_id" SeqNo: 50 CreateTime: 2025-10-15T10:54:25.606000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5511 bytes.. Information: { Offset: 50 ProducerId: "src_id" SeqNo: 51 CreateTime: 2025-10-15T10:54:25.606000Z WriteTime: 2025-10-15T10:54:26.037000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:26.143926Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 15, size 71115 bytes
2025-10-15T10:54:26.143986Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.143731Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.143984Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 71889 } }
2025-10-15T10:54:26.144102Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 8f28b5f6-d4bb7742-66fa50d7-d3f28491
2025-10-15T10:54:26.144346Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.144726Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.145023Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.145290Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.145608Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.145891Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.146173Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.146431Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.146700Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.147068Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 172  requestId: <none> cookie: 87
2025-10-15T10:54:26.147146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 173  requestId: <none> cookie: 88
2025-10-15T10:54:26.147166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 174  requestId: <none> cookie: 89
2025-10-15T10:54:26.147186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 175  requestId: <none> cookie: 90
2025-10-15T10:54:26.147206Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 176  requestId: <none> cookie: 91
2025-10-15T10:54:26.147234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.147294Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 97050 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.147332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147394Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-15T10:54:26.147415Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147432Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-15T10:54:26.147445Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147463Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-15T10:54:26.147477Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147494Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-15T10:54:26.147506Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-15T10:54:26.147537Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147581Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-15T10:54:26.147597Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-15T10:54:26.147629Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-15T10:54:26.147657Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-15T10:54:26.147686Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147709Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-15T10:54:26.147719Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147737Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-15T10:54:26.147749Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147777Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-15T10:54:26.147797Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147831Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-15T10:54:26.147851Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147882Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-15T10:54:26.147903Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.147940Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-15T10:54:26.148187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.148265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.148275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-15T10:54:26.148359Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-15T10:54:26.149168Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 7417 count 1 nextOffset 67 batches 1
2025-10-15T10:54:26.149218Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-15T10:54:26.149247Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 14912 count 2 nextOffset 68 batches 1
2025-10-15T10:54:26.149266Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-15T10:54:26.149287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 22517 count 3 nextOffset 69 batches 1
2025-10-15T10:54:26.149308Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-15T10:54:26.149325Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 30232 count 4 nextOffset 70 batches 1
2025-10-15T10:54:26.149375Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-15T10:54:26.149399Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 38057 count 5 nextOffset 71 batches 1
2025-10-15T10:54:26.149416Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-15T10:54:26.149435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 45992 count 6 nextOffset 72 batches 1
2025-10-15T10:54:26.149453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-10-15T10:54:26.149472Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 54037 count 7 nextOffset 73 batches 1
2025-10-15T10:54:26.149489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-15T10:54:26.149507Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 62192 count 8 nextOffset 74 batches 1
2025-10-15T10:54:26.149525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-15T10:54:26.149547Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 70457 count 9 nextOffset 75 batches 1
2025-10-15T10:54:26.149566Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-15T10:54:26.149582Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 78832 count 10 nextOffset 76 batches 1
2025-10-15T10:54:26.149601Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-15T10:54:26.149619Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 87317 count 11 nextOffset 77 batches 1
2025-10-15T10:54:26.149640Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-15T10:54:26.149657Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 95912 count 12 nextOffset 78 batches 1
2025-10-15T10:54:26.149674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-15T10:54:26.149746Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 104617 count 13 nextOffset 79 batches 1
2025-10-15T10:54:26.149766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-15T10:54:26.149785Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 113432 count 14 nextOffset 80 batches 1
2025-10-15T10:54:26.149804Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-15T10:54:26.149822Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 122357 count 15 nextOffset 81 batches 1
2025-10-15T10:54:26.149841Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-15T10:54:26.149860Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 131392 count 16 nextOffset 82 batches 1
2025-10-15T10:54:26.149881Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-15T10:54:26.149904Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 140537 count 17 nextOffset 83 batches 1
2025-10-15T10:54:26.149923Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-15T10:54:26.149941Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 149792 count 18 nextOffset 84 batches 1
2025-10-15T10:54:26.149963Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-15T10:54:26.149980Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 159157 count 19 nextOffset 85 batches 1
2025-10-15T10:54:26.149998Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-15T10:54:26.150016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 66 PartNo 0 PackedSize 168632 count 20 nextOffset 86 batches 1
2025-10-15T10:54:26.150061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.152266Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.152341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.152447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.152471Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.152503Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.152526Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.152979Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.153207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.153246Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.153276Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.153340Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.153503Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 51 EndOffset 51 newEndOffset 66 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-10-15T10:54:26.153523Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 51 endOffset 66
2025-10-15T10:54:26.153561Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 51, endOffset# 66, WTime# 1760525666037, sizeLag# 97189
2025-10-15T10:54:26.153575Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:26.153641Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# a5d3262d-61de6e8d-df43c319-2fcf930d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 116626, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:26.153733Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 116626 maxTimeLagMs 0 readTimestampMs 0 readOffset 51 EndOffset 66 ClientCommitOffset 0 committedOffset 0 Guid a5d3262d-61de6e8d-df43c319-2fcf930d
2025-10-15T10:54:26.154979Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.155430Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.155779Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.163480Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 66,20 HeadOffset 66 endOffset 66 curOffset 86 d0000000000_00000000000000000066_00000_0000000020_00000? size 168054 WTime 1760525666162
2025-10-15T10:54:26.163832Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.163943Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 107  requestId: <none> cookie: 52
2025-10-15T10:54:26.164006Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 108  requestId: <none> cookie: 53
2025-10-15T10:54:26.164031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 109  requestId: <none> cookie: 54
2025-10-15T10:54:26.164054Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 110  requestId: <none> cookie: 55
2025-10-15T10:54:26.164080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 111  requestId: <none> cookie: 56
2025-10-15T10:54:26.164103Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 117  requestId: <none> cookie: 57
2025-10-15T10:54:26.164129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 118  requestId: <none> cookie: 58
2025-10-15T10:54:26.164155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 119  requestId: <none> cookie: 59
2025-10-15T10:54:26.164181Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 120  requestId: <none> cookie: 60
2025-10-15T10:54:26.164207Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 121  requestId: <none> cookie: 61
2025-10-15T10:54:26.164232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 127  requestId: <none> cookie: 62
2025-10-15T10:54:26.164270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 128  requestId: <none> cookie: 63
2025-10-15T10:54:26.164311Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 129  requestId: <none> cookie: 64
2025-10-15T10:54:26.164338Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 130  requestId: <none> cookie: 65
2025-10-15T10:54:26.164362Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 131  requestId: <none> cookie: 66
2025-10-15T10:54:26.164456Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.164481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.164528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 177 size 9543 offset: -1
2025-10-15T10:54:26.164584Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.164596Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.164618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 178 size 9653 offset: -1
2025-10-15T10:54:26.164660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.164673Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.164694Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 179 size 9763 offset: -1
2025-10-15T10:54:26.164751Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.164762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.164784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 180 size 9873 offset: -1
2025-10-15T10:54:26.164831Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.164844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.164865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 181 size 9983 offset: -1
2025-10-15T10:54:26.164897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.164908Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.164943Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.164955Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.164981Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.164991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.165022Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.165034Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.165061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.165080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.165170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.165186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.165226Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.165325Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 66 partNo 0 count 20 size 168054
2025-10-15T10:54:26.165364Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.165412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.165425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.165441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.165451Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.165463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.165475Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.165489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.165499Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.165513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.165829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 182  requestId: <none> cookie: 92
2025-10-15T10:54:26.165860Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 183  requestId: <none> cookie: 93
2025-10-15T10:54:26.165877Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 184  requestId: <none> cookie: 94
2025-10-15T10:54:26.165894Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 185  requestId: <none> cookie: 95
2025-10-15T10:54:26.165914Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 186  requestId: <none> cookie: 96
2025-10-15T10:54:26.166022Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 51 count 18 size 116626 endOffset 66 max time lag 0ms effective offset 51
2025-10-15T10:54:26.166185Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 97189 count 15 last offset 51, current partition end offset: 66
2025-10-15T10:54:26.166197Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-15T10:54:26.166248Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 51 partno 0 count 15 parts_count 0 source 1 size 97189 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:26.166270Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-15T10:54:26.166320Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:26.166488Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 51 partno 0 count 15 parts 0 suffix '63'
2025-10-15T10:54:26.166915Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 51 totakecount 15 count 15 size 97167 from pos 0 cbcount 15
2025-10-15T10:54:26.167105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 51
2025-10-15T10:54:26.169051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169147Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169173Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169200Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169233Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169267Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169298Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169326Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169371Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169428Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169512Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169544Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169568Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169604Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169627Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169653Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.169678Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.170668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.170768Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.170877Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.170914Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.170950Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.172158Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 66 Result { Offset: 51 Data: "... 5693 bytes ..." SourceId: "\000src_id" SeqNo: 52 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665606 UncompressedSize: 5621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 52 Data: "... 5803 bytes ..." SourceId: "\000src_id" SeqNo: 53 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665606 UncompressedSize: 5731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 53 Data: "... 5913 bytes ..." SourceId: "\000src_id" SeqNo: 54 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665606 UncompressedSize: 5841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 54 Data: "... 6023 bytes ..." SourceId: "\000src_id" SeqNo: 55 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665607 UncompressedSize: 5951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 55 Data: "... 6133 bytes ..." SourceId: "\000src_id" SeqNo: 56 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665607 UncompressedSize: 6061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 56 Data: "... 6243 bytes ..." SourceId: "\000src_id" SeqNo: 57 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665607 UncompressedSize: 6171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 57 Data: "... 6353 bytes ..." SourceId: "\000src_id" SeqNo: 58 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665613 UncompressedSize: 6281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 58 Data: "... 6463 bytes ..." SourceId: "\000src_id" SeqNo: 59 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665613 UncompressedSize: 6391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 59 Data: "... 6573 bytes ..." SourceId: "\000src_id" SeqNo: 60 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665613 UncompressedSize: 6501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 60 Data: "... 6683 bytes ..." SourceId: "\000src_id" SeqNo: 61 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665613 UncompressedSize: 6611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 61 Data: "... 6793 bytes ..." SourceId: "\000src_id" SeqNo: 62 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665613 UncompressedSize: 6721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 62 Data: "... 6903 bytes ..." SourceId: "\000src_id" SeqNo: 63 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665613 UncompressedSize: 6831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 63 Data: "... 7013 bytes ..." SourceId: "\000src_id" SeqNo: 64 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665614 UncompressedSize: 6941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 64 Data: "... 7123 bytes ..." SourceId: "\000src_id" SeqNo: 65 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665614 UncompressedSize: 7051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 65 Data: "... 7233 bytes ..." SourceId: "\000src_id" SeqNo: 66 WriteTimestampMS: 1760525666074 CreateTimestampMS: 1760525665614 UncompressedSize: 7161 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551230 RealReadOffset: 65 WaitQuotaTimeMs: 0 EndOffset: 66 StartOffset: 0 } Cookie: 51 }
2025-10-15T10:54:26.172708Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 66
2025-10-15T10:54:26.172750Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 66 ReadOffset 66 ReadGuid a5d3262d-61de6e8d-df43c319-2fcf930d has messages 1
2025-10-15T10:54:26.173022Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# a5d3262d-61de6e8d-df43c319-2fcf930d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 96522
2025-10-15T10:54:26.173068Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# a5d3262d-61de6e8d-df43c319-2fcf930d
2025-10-15T10:54:26.173394Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:26.176003Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 96522, now ReadSizeBudget = 0, ReadSizeServerDelta = 427766
2025-10-15T10:54:26.176096Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 427766
2025-10-15T10:54:26.176213Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (51-65)
2025-10-15T10:54:26.176253Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 96522 to budget
2025-10-15T10:54:26.176288Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 96522, ReadSizeServerDelta = 427766
2025-10-15T10:54:26.175415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.175532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.175569Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.175636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 187 size 10093 offset: -1
2025-10-15T10:54:26.175703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.175720Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.175752Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 188 size 10203 offset: -1
2025-10-15T10:54:26.175834Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.175886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.175911Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.175927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.176499Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:26.176760Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (51-51)
2025-10-15T10:54:26.176845Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (52-52)
2025-10-15T10:54:26.176917Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (53-53)
2025-10-15T10:54:26.177166Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (54-54)
2025-10-15T10:54:26.177295Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (55-55)
2025-10-15T10:54:26.177350Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (56-56)
2025-10-15T10:54:26.177379Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (57-57)
2025-10-15T10:54:26.177402Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (58-58)
2025-10-15T10:54:26.178782Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (59-59)
2025-10-15T10:54:26.178835Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (60-60)
2025-10-15T10:54:26.178884Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (61-61)
2025-10-15T10:54:26.178933Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (62-62)
2025-10-15T10:54:26.178961Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (63-63)
2025-10-15T10:54:26.179006Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (64-64)
2025-10-15T10:54:26.179039Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (65-65)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..5621 bytes.. Information: { Offset: 51 ProducerId: "src_id" SeqNo: 52 CreateTime: 2025-10-15T10:54:25.606000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5731 bytes.. Information: { Offset: 52 ProducerId: "src_id" SeqNo: 53 CreateTime: 2025-10-15T10:54:25.606000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5841 bytes.. Information: { Offset: 53 ProducerId: "src_id" SeqNo: 54 CreateTime: 2025-10-15T10:54:25.606000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..5951 bytes.. Information: { Offset: 54 ProducerId: "src_id" SeqNo: 55 CreateTime: 2025-10-15T10:54:25.607000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6061 bytes.. Information: { Offset: 55 ProducerId: "src_id" SeqNo: 56 CreateTime: 2025-10-15T10:54:25.607000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6171 bytes.. Information: { Offset: 56 ProducerId: "src_id" SeqNo: 57 CreateTime: 2025-10-15T10:54:25.607000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6281 bytes.. Information: { Offset: 57 ProducerId: "src_id" SeqNo: 58 CreateTime: 2025-10-15T10:54:25.613000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6391 bytes.. Information: { Offset: 58 ProducerId: "src_id" SeqNo: 59 CreateTime: 2025-10-15T10:54:25.613000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6501 bytes.. Information: { Offset: 59 ProducerId: "src_id" SeqNo: 60 CreateTime: 2025-10-15T10:54:25.613000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6611 bytes.. Information: { Offset: 60 ProducerId: "src_id" SeqNo: 61 CreateTime: 2025-10-15T10:54:25.613000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6721 bytes.. Information: { Offset: 61 ProducerId: "src_id" SeqNo: 62 CreateTime: 2025-10-15T10:54:25.613000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6831 bytes.. Information: { Offset: 62 ProducerId: "src_id" SeqNo: 63 CreateTime: 2025-10-15T10:54:25.613000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..6941 bytes.. Information: { Offset: 63 ProducerId: "src_id" SeqNo: 64 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7051 bytes.. Information: { Offset: 64 ProducerId: "src_id" SeqNo: 65 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7161 bytes.. Information: { Offset: 65 ProducerId: "src_id" SeqNo: 66 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.074000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:26.180584Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 15, size 95865 bytes
2025-10-15T10:54:26.180627Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.182643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 143 }
2025-10-15T10:54:26.182692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 39
2025-10-15T10:54:26.183204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 143 }
2025-10-15T10:54:26.183233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 40
2025-10-15T10:54:26.183489Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.183550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.183607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 189 size 10313 offset: -1
2025-10-15T10:54:26.183688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.183705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.183729Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 190 size 10423 offset: -1
2025-10-15T10:54:26.183786Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.183800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.183825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 191 size 10533 offset: -1
2025-10-15T10:54:26.183861Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.183880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.183936Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.183947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.183972Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.183987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.184020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.184031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.184054Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.184063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.184265Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.184322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.184338Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.184351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.184362Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.184377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.184531Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 66 count 20 size 168054 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.184592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 192  requestId: <none> cookie: 97
2025-10-15T10:54:26.184623Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 193  requestId: <none> cookie: 98
2025-10-15T10:54:26.184637Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 66 partno 0 count 20 parts 0 suffix '63' size 168054
2025-10-15T10:54:26.184641Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 194  requestId: <none> cookie: 99
2025-10-15T10:54:26.184667Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 195  requestId: <none> cookie: 100
2025-10-15T10:54:26.184689Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 196  requestId: <none> cookie: 101
2025-10-15T10:54:26.184708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.184762Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 167900 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.184796Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.184822Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-15T10:54:26.184852Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.184873Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-15T10:54:26.184887Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.184906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-15T10:54:26.184917Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.184935Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-15T10:54:26.184947Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.184972Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-15T10:54:26.184990Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185009Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-15T10:54:26.185019Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185037Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-15T10:54:26.185049Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185066Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-15T10:54:26.185082Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185104Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-15T10:54:26.185117Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185136Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-15T10:54:26.185148Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185167Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-15T10:54:26.185179Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185197Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-15T10:54:26.185229Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185252Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-15T10:54:26.185266Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185286Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-15T10:54:26.185297Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185315Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-15T10:54:26.185327Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185353Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-15T10:54:26.185375Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185392Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-15T10:54:26.185403Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185419Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-15T10:54:26.185429Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185447Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-15T10:54:26.185459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.185483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-15T10:54:26.185714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.185796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.185808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:26.185921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-15T10:54:26.190470Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 66 EndOffset 66 newEndOffset 86 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-10-15T10:54:26.190510Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 66 endOffset 86
2025-10-15T10:54:26.190556Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.190642Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.190699Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.190726Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.190756Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.190785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.191475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.191539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.191573Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.191603Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.191641Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.191885Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 96522 } }
2025-10-15T10:54:26.191928Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 66, endOffset# 86, WTime# 1760525666074, sizeLag# 168054
2025-10-15T10:54:26.191942Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:26.191987Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 73f0c745-45c664fb-e99c8d32-fe6f4ee5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 24, size# 201664, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:26.192061Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# fbe013eb-844f6f9d-af6726bd-69d0acd4
2025-10-15T10:54:26.193024Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 24 maxSize 201664 maxTimeLagMs 0 readTimestampMs 0 readOffset 66 EndOffset 86 ClientCommitOffset 0 committedOffset 0 Guid 73f0c745-45c664fb-e99c8d32-fe6f4ee5
2025-10-15T10:54:26.194150Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.199591Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.200053Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.200314Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.200547Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.200969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 143 }
2025-10-15T10:54:26.201015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 41
2025-10-15T10:54:26.201199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 74 }
2025-10-15T10:54:26.201229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 42
2025-10-15T10:54:26.201348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 74 }
2025-10-15T10:54:26.201365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 43
2025-10-15T10:54:26.201483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 74 }
2025-10-15T10:54:26.201507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 44
2025-10-15T10:54:26.201618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 74 }
2025-10-15T10:54:26.201639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 45
2025-10-15T10:54:26.201769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 74 }
2025-10-15T10:54:26.201794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 46
2025-10-15T10:54:26.201905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 13 }
2025-10-15T10:54:26.201932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 47
2025-10-15T10:54:26.202049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 48 offsets: 47 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 13 }
2025-10-15T10:54:26.202075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 48
2025-10-15T10:54:26.202199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 49 offsets: 48 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 13 }
2025-10-15T10:54:26.202222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 49
2025-10-15T10:54:26.202321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 50 offsets: 49 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 13 }
2025-10-15T10:54:26.202341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 50
2025-10-15T10:54:26.202433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 51 offsets: 50 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 13 }
2025-10-15T10:54:26.202456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 51
2025-10-15T10:54:26.202566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 52 offsets: 51 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:26.202586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 52
2025-10-15T10:54:26.202668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 53 offsets: 52 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:26.202689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 53
2025-10-15T10:54:26.207694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 54 offsets: 53 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:26.207741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 54
2025-10-15T10:54:26.207960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 55 offsets: 54 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:26.207985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 55
2025-10-15T10:54:26.208112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 56 offsets: 55 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:26.208133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 56
2025-10-15T10:54:26.208235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 57 offsets: 56 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:26.208254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 57
2025-10-15T10:54:26.208354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 58 offsets: 57 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:26.208371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 58
2025-10-15T10:54:26.208483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 59 offsets: 58 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:26.208503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 59
2025-10-15T10:54:26.208617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 60 offsets: 59 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:26.208644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 60
2025-10-15T10:54:26.208751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 61 offsets: 60 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:26.208770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 61
2025-10-15T10:54:26.208896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 62 offsets: 61 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 1 }
2025-10-15T10:54:26.208920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 62
2025-10-15T10:54:26.209016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 63 offsets: 62 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 1 }
2025-10-15T10:54:26.209050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 63
2025-10-15T10:54:26.209146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 64 offsets: 63 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 1 }
2025-10-15T10:54:26.209163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 64
2025-10-15T10:54:26.209273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 65 offsets: 64 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 1 }
2025-10-15T10:54:26.209291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 65
2025-10-15T10:54:26.209385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 66 offsets: 65 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 1 }
2025-10-15T10:54:26.209403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 66
2025-10-15T10:54:26.217543Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 9617 count 1 nextOffset 87 batches 1
2025-10-15T10:54:26.217634Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-15T10:54:26.217674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 19312 count 2 nextOffset 88 batches 1
2025-10-15T10:54:26.217737Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-15T10:54:26.217760Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 29117 count 3 nextOffset 89 batches 1
2025-10-15T10:54:26.217782Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-15T10:54:26.217801Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 39032 count 4 nextOffset 90 batches 1
2025-10-15T10:54:26.217823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-15T10:54:26.217845Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 49057 count 5 nextOffset 91 batches 1
2025-10-15T10:54:26.217864Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-15T10:54:26.217882Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 59192 count 6 nextOffset 92 batches 1
2025-10-15T10:54:26.217900Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-15T10:54:26.217920Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 69437 count 7 nextOffset 93 batches 1
2025-10-15T10:54:26.217939Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-15T10:54:26.217959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 79792 count 8 nextOffset 94 batches 1
2025-10-15T10:54:26.217980Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-15T10:54:26.218002Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 90257 count 9 nextOffset 95 batches 1
2025-10-15T10:54:26.218019Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-15T10:54:26.218037Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 86 PartNo 0 PackedSize 100832 count 10 nextOffset 96 batches 1
2025-10-15T10:54:26.218053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.218820Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 86,10 HeadOffset 86 endOffset 86 curOffset 96 d0000000000_00000000000000000086_00000_0000000010_00000? size 100574 WTime 1760525666218
2025-10-15T10:54:26.218995Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.223889Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 137  requestId: <none> cookie: 67
2025-10-15T10:54:26.223954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 138  requestId: <none> cookie: 68
2025-10-15T10:54:26.223980Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 139  requestId: <none> cookie: 69
2025-10-15T10:54:26.224004Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 140  requestId: <none> cookie: 70
2025-10-15T10:54:26.224028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 141  requestId: <none> cookie: 71
2025-10-15T10:54:26.224051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 147  requestId: <none> cookie: 72
2025-10-15T10:54:26.224076Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 149  requestId: <none> cookie: 73
2025-10-15T10:54:26.224097Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 150  requestId: <none> cookie: 74
2025-10-15T10:54:26.224121Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 151  requestId: <none> cookie: 75
2025-10-15T10:54:26.224144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 152  requestId: <none> cookie: 76
2025-10-15T10:54:26.224169Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 157  requestId: <none> cookie: 77
2025-10-15T10:54:26.224190Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 159  requestId: <none> cookie: 78
2025-10-15T10:54:26.224211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 160  requestId: <none> cookie: 79
2025-10-15T10:54:26.224234Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 161  requestId: <none> cookie: 80
2025-10-15T10:54:26.224258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 162  requestId: <none> cookie: 81
2025-10-15T10:54:26.224283Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 167  requestId: <none> cookie: 82
2025-10-15T10:54:26.224307Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 168  requestId: <none> cookie: 83
2025-10-15T10:54:26.224330Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 169  requestId: <none> cookie: 84
2025-10-15T10:54:26.224355Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 170  requestId: <none> cookie: 85
2025-10-15T10:54:26.224377Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 171  requestId: <none> cookie: 86
2025-10-15T10:54:26.224474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.224500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.224552Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 197 size 10643 offset: -1
2025-10-15T10:54:26.224608Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.224618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.224637Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 198 size 10753 offset: -1
2025-10-15T10:54:26.224689Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.224700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.224721Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 199 size 10863 offset: -1
2025-10-15T10:54:26.224806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.224818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.224840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 200 size 10973 offset: -1
2025-10-15T10:54:26.224910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.224923Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.224947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 101 partNo : 0 messageNo: 201 size 11083 offset: -1
2025-10-15T10:54:26.224979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.224989Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.225022Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.225033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.225061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.225070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.225095Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.225106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.225175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.225186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.225227Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.225240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.225262Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.225375Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 86 partNo 0 count 10 size 100574
2025-10-15T10:54:26.225413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.225457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.225470Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.225489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.225501Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.225514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.225525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.225549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.225565Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.225579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.225819Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 202  requestId: <none> cookie: 102
2025-10-15T10:54:26.225848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 203  requestId: <none> cookie: 103
2025-10-15T10:54:26.225867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 204  requestId: <none> cookie: 104
2025-10-15T10:54:26.225884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 205  requestId: <none> cookie: 105
2025-10-15T10:54:26.225924Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 206  requestId: <none> cookie: 106
2025-10-15T10:54:26.226000Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 66 count 24 size 201664 endOffset 86 max time lag 0ms effective offset 66
2025-10-15T10:54:26.226168Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 168054 count 20 last offset 66, current partition end offset: 86
2025-10-15T10:54:26.226181Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-15T10:54:26.226231Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 66 partno 0 count 20 parts_count 0 source 1 size 168054 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:26.226254Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-15T10:54:26.226299Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:26.226993Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 66 totakecount 20 count 20 size 168032 from pos 0 cbcount 20
2025-10-15T10:54:26.227218Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 66
2025-10-15T10:54:26.227559Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 66 partno 0 count 20 parts 0 suffix '63'
2025-10-15T10:54:26.230914Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233537Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233605Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233635Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233664Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233744Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233778Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233804Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233832Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233862Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233890Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233916Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233942Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233967Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.233991Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234068Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234090Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234143Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234181Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234237Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.234263Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.235394Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.235457Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.235574Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.235609Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.235644Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.238656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 67 offsets: 66 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 59 }
2025-10-15T10:54:26.238700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 67
2025-10-15T10:54:26.238904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 68 offsets: 67 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 59 }
2025-10-15T10:54:26.238922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 68
2025-10-15T10:54:26.239014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 69 offsets: 68 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 59 }
2025-10-15T10:54:26.239035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 69
2025-10-15T10:54:26.239130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 70 offsets: 69 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 59 }
2025-10-15T10:54:26.239148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 70
2025-10-15T10:54:26.239241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 71 offsets: 70 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 59 }
2025-10-15T10:54:26.239261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 71
2025-10-15T10:54:26.239363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 72 offsets: 71 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 24 }
2025-10-15T10:54:26.239386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 72
2025-10-15T10:54:26.239488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 73 offsets: 72 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 22 }
2025-10-15T10:54:26.239509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 73
2025-10-15T10:54:26.239607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 74 offsets: 73 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 22 }
2025-10-15T10:54:26.239626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 74
2025-10-15T10:54:26.239719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 75 offsets: 74 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 22 }
2025-10-15T10:54:26.239740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 75
2025-10-15T10:54:26.239846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 76 offsets: 75 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 22 }
2025-10-15T10:54:26.239867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 76
2025-10-15T10:54:26.239971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 77 offsets: 76 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 21 }
2025-10-15T10:54:26.239990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 77
2025-10-15T10:54:26.240082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 78 offsets: 77 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:26.240104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 78
2025-10-15T10:54:26.240207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 79 offsets: 78 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:26.240227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 79
2025-10-15T10:54:26.240325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 80 offsets: 79 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:26.240345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 80
2025-10-15T10:54:26.240455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 81 offsets: 80 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:26.240475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 81
2025-10-15T10:54:26.240570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 82 offsets: 81 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 12 }
2025-10-15T10:54:26.240589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 82
2025-10-15T10:54:26.240682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 83 offsets: 82 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 12 }
2025-10-15T10:54:26.240700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 83
2025-10-15T10:54:26.240796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 84 offsets: 83 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 12 }
2025-10-15T10:54:26.240816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 84
2025-10-15T10:54:26.240919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 85 offsets: 84 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 12 }
2025-10-15T10:54:26.240939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 85
2025-10-15T10:54:26.241035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 86 offsets: 85 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 12 }
2025-10-15T10:54:26.241054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 86
2025-10-15T10:54:26.243620Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.243672Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.243730Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 102 partNo : 0 messageNo: 207 size 11193 offset: -1
2025-10-15T10:54:26.243844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.243859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.243887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 103 partNo : 0 messageNo: 208 size 11303 offset: -1
2025-10-15T10:54:26.243940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.243950Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.243971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 104 partNo : 0 messageNo: 209 size 11413 offset: -1
2025-10-15T10:54:26.244016Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.244026Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.244047Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 105 partNo : 0 messageNo: 210 size 11523 offset: -1
2025-10-15T10:54:26.244095Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.244105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.244128Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 106 partNo : 0 messageNo: 211 size 11633 offset: -1
2025-10-15T10:54:26.244161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.244174Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.244208Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.244220Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.244253Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.244266Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.244296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.244308Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.244336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.244348Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.244535Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.244587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.244602Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.244617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.244628Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.244643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.244655Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.244669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.244679Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.244694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.244804Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 86 count 10 size 100574 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.244859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 212  requestId: <none> cookie: 107
2025-10-15T10:54:26.244887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 213  requestId: <none> cookie: 108
2025-10-15T10:54:26.244906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 214  requestId: <none> cookie: 109
2025-10-15T10:54:26.244916Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 86 partno 0 count 10 parts 0 suffix '63' size 100574
2025-10-15T10:54:26.244927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 215  requestId: <none> cookie: 110
2025-10-15T10:54:26.244947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 216  requestId: <none> cookie: 111
2025-10-15T10:54:26.244967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.245017Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 100450 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.245051Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245082Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-15T10:54:26.245100Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245124Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-15T10:54:26.245135Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245155Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-15T10:54:26.245167Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245185Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-15T10:54:26.245196Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245214Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-10-15T10:54:26.245224Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245242Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-15T10:54:26.245252Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245269Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-15T10:54:26.245279Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245297Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-15T10:54:26.245308Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245326Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-15T10:54:26.245337Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.245356Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-15T10:54:26.245545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.245602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.245613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:26.245730Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-15T10:54:26.246689Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 10717 count 1 nextOffset 97 batches 1
2025-10-15T10:54:26.246744Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-15T10:54:26.246776Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 21512 count 2 nextOffset 98 batches 1
2025-10-15T10:54:26.246800Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-15T10:54:26.246824Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 32417 count 3 nextOffset 99 batches 1
2025-10-15T10:54:26.246843Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-15T10:54:26.246864Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 43432 count 4 nextOffset 100 batches 1
2025-10-15T10:54:26.246886Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 101 partNo 0
2025-10-15T10:54:26.246909Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 101 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 54557 count 5 nextOffset 101 batches 1
2025-10-15T10:54:26.246928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 102 partNo 0
2025-10-15T10:54:26.246947Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 102 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 65792 count 6 nextOffset 102 batches 1
2025-10-15T10:54:26.246969Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 103 partNo 0
2025-10-15T10:54:26.246990Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 103 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 77137 count 7 nextOffset 103 batches 1
2025-10-15T10:54:26.247010Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 104 partNo 0
2025-10-15T10:54:26.247029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 104 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 88592 count 8 nextOffset 104 batches 1
2025-10-15T10:54:26.247050Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 105 partNo 0
2025-10-15T10:54:26.247074Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 105 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 100157 count 9 nextOffset 105 batches 1
2025-10-15T10:54:26.247093Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 106 partNo 0
2025-10-15T10:54:26.247112Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 106 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 111832 count 10 nextOffset 106 batches 1
2025-10-15T10:54:26.247130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.248978Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 96,10 HeadOffset 96 endOffset 96 curOffset 106 d0000000000_00000000000000000096_00000_0000000010_00000? size 111574 WTime 1760525666248
2025-10-15T10:54:26.247512Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.247631Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.247696Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.247727Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.247757Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.247782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.248389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.248450Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.248489Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.248527Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.248564Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.250011Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 86 Result { Offset: 66 Data: "... 7343 bytes ..." SourceId: "\000src_id" SeqNo: 67 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665614 UncompressedSize: 7271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 67 Data: "... 7453 bytes ..." SourceId: "\000src_id" SeqNo: 68 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665614 UncompressedSize: 7381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 68 Data: "... 7563 bytes ..." SourceId: "\000src_id" SeqNo: 69 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665614 UncompressedSize: 7491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 69 Data: "... 7673 bytes ..." SourceId: "\000src_id" SeqNo: 70 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665614 UncompressedSize: 7601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 70 Data: "... 7783 bytes ..." SourceId: "\000src_id" SeqNo: 71 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665614 UncompressedSize: 7711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 71 Data: "... 7893 bytes ..." SourceId: "\000src_id" SeqNo: 72 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665614 UncompressedSize: 7821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 72 Data: "... 8003 bytes ..." SourceId: "\000src_id" SeqNo: 73 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665614 UncompressedSize: 7931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 73 Data: "... 8113 bytes ..." SourceId: "\000src_id" SeqNo: 74 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665614 UncompressedSize: 8041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 74 Data: "... 8223 bytes ..." SourceId: "\000src_id" SeqNo: 75 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665615 UncompressedSize: 8151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 75 Data: "... 8333 bytes ..." SourceId: "\000src_id" SeqNo: 76 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665615 UncompressedSize: 8261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 76 Data: "... 8443 bytes ..." SourceId: "\000src_id" SeqNo: 77 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665615 UncompressedSize: 8371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 77 Data: "... 8553 bytes ..." SourceId: "\000src_id" SeqNo: 78 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665615 UncompressedSize: 8481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 78 Data: "... 8663 bytes ..." SourceId: "\000src_id" SeqNo: 79 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665615 UncompressedSize: 8591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 79 Data: "... 8773 bytes ..." SourceId: "\000src_id" SeqNo: 80 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665615 UncompressedSize: 8701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 80 Data: "... 8883 bytes ..." SourceId: "\000src_id" SeqNo: 81 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665615 UncompressedSize: 8811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 81 Data: "... 8993 bytes ..." SourceId: "\000src_id" SeqNo: 82 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665616 UncompressedSize: 8921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 82 Data: "... 9103 bytes ..." SourceId: "\000src_id" SeqNo: 83 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665616 UncompressedSize: 9031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 83 Data: "... 9213 bytes ..." SourceId: "\000src_id" SeqNo: 84 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665616 UncompressedSize: 9141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 84 Data: "... 9323 bytes ..." SourceId: "\000src_id" SeqNo: 85 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665616 UncompressedSize: 9251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 85 Data: "... 9433 bytes ..." SourceId: "\000src_id" SeqNo: 86 WriteTimestampMS: 1760525666148 CreateTimestampMS: 1760525665616 UncompressedSize: 9361 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551070 RealReadOffset: 85 WaitQuotaTimeMs: 0 EndOffset: 86 StartOffset: 0 } Cookie: 66 }
2025-10-15T10:54:26.252644Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.252739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 177  requestId: <none> cookie: 87
2025-10-15T10:54:26.252806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 178  requestId: <none> cookie: 88
2025-10-15T10:54:26.252833Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 179  requestId: <none> cookie: 89
2025-10-15T10:54:26.252861Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 180  requestId: <none> cookie: 90
2025-10-15T10:54:26.252889Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 181  requestId: <none> cookie: 91
2025-10-15T10:54:26.252914Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 187  requestId: <none> cookie: 92
2025-10-15T10:54:26.252938Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 188  requestId: <none> cookie: 93
2025-10-15T10:54:26.252961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 189  requestId: <none> cookie: 94
2025-10-15T10:54:26.252986Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 190  requestId: <none> cookie: 95
2025-10-15T10:54:26.253013Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 191  requestId: <none> cookie: 96
2025-10-15T10:54:26.253111Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253138Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 107 partNo : 0 messageNo: 217 size 11743 offset: -1
2025-10-15T10:54:26.253245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253280Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 108 partNo : 0 messageNo: 218 size 11853 offset: -1
2025-10-15T10:54:26.253325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253355Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 109 partNo : 0 messageNo: 219 size 11963 offset: -1
2025-10-15T10:54:26.253395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253426Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 110 partNo : 0 messageNo: 220 size 12073 offset: -1
2025-10-15T10:54:26.253478Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253490Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 111 partNo : 0 messageNo: 221 size 12183 offset: -1
2025-10-15T10:54:26.253563Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253574Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253606Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253617Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253653Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253708Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253736Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.253747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.253770Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.253878Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 96 partNo 0 count 10 size 111574
2025-10-15T10:54:26.253916Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.253969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.253993Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.254007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.254018Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.254032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.254042Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.254056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.254068Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.254079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.254292Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 222  requestId: <none> cookie: 112
2025-10-15T10:54:26.254329Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 223  requestId: <none> cookie: 113
2025-10-15T10:54:26.254348Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 224  requestId: <none> cookie: 114
2025-10-15T10:54:26.254364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 225  requestId: <none> cookie: 115
2025-10-15T10:54:26.254381Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 226  requestId: <none> cookie: 116
2025-10-15T10:54:26.255628Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 86
2025-10-15T10:54:26.255686Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 86 ReadOffset 86 ReadGuid 73f0c745-45c664fb-e99c8d32-fe6f4ee5 has messages 1
2025-10-15T10:54:26.255925Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.255975Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256033Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256065Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256093Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256121Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256149Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256175Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256201Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256225Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256253Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256278Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256312Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256340Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256368Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.256394Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.257481Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.257536Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.257574Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.257609Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.257645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.257868Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 73f0c745-45c664fb-e99c8d32-fe6f4ee5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 167152
2025-10-15T10:54:26.257900Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 73f0c745-45c664fb-e99c8d32-fe6f4ee5
2025-10-15T10:54:26.258414Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:26.261430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 87 offsets: 86 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 55 }
2025-10-15T10:54:26.261477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 87
2025-10-15T10:54:26.261658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 88 offsets: 87 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 55 }
2025-10-15T10:54:26.261679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 88
2025-10-15T10:54:26.261839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 89 offsets: 88 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 55 }
2025-10-15T10:54:26.261862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 89
2025-10-15T10:54:26.261971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 90 offsets: 89 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 55 }
2025-10-15T10:54:26.261991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 90
2025-10-15T10:54:26.262088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 91 offsets: 90 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 55 }
2025-10-15T10:54:26.262109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 91
2025-10-15T10:54:26.262193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 92 offsets: 91 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 41 }
2025-10-15T10:54:26.262211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 92
2025-10-15T10:54:26.262309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 93 offsets: 92 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 41 }
2025-10-15T10:54:26.262331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 93
2025-10-15T10:54:26.262422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 94 offsets: 93 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 34 }
2025-10-15T10:54:26.262441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 94
2025-10-15T10:54:26.262525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 95 offsets: 94 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 34 }
2025-10-15T10:54:26.262545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 95
2025-10-15T10:54:26.262636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 96 offsets: 95 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 34 }
2025-10-15T10:54:26.262654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 96
2025-10-15T10:54:26.262798Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.263127Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 86 EndOffset 86 newEndOffset 96 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-10-15T10:54:26.263151Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 86 endOffset 96
2025-10-15T10:54:26.263189Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 86, endOffset# 96, WTime# 1760525666148, sizeLag# 100574
2025-10-15T10:54:26.263204Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:26.263243Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 13e4c524-37ab40f7-bde0ceaf-e5690ff2, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 120688, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:26.263294Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 120688 maxTimeLagMs 0 readTimestampMs 0 readOffset 86 EndOffset 96 ClientCommitOffset 0 committedOffset 0 Guid 13e4c524-37ab40f7-bde0ceaf-e5690ff2
2025-10-15T10:54:26.263789Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.264351Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 167152, now ReadSizeBudget = 0, ReadSizeServerDelta = 357136
2025-10-15T10:54:26.264478Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 357136
2025-10-15T10:54:26.265151Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (66-85)
2025-10-15T10:54:26.265203Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 167152 to budget
2025-10-15T10:54:26.265240Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 167152, ReadSizeServerDelta = 357136
2025-10-15T10:54:26.265459Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:26.265535Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (66-66)
2025-10-15T10:54:26.265601Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (67-67)
2025-10-15T10:54:26.265648Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (68-68)
2025-10-15T10:54:26.265680Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (69-69)
2025-10-15T10:54:26.265757Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (70-70)
2025-10-15T10:54:26.265801Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (71-71)
2025-10-15T10:54:26.265835Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (72-72)
2025-10-15T10:54:26.265873Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (73-73)
2025-10-15T10:54:26.265925Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (74-74)
2025-10-15T10:54:26.265951Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (75-75)
2025-10-15T10:54:26.265985Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (76-76)
2025-10-15T10:54:26.266007Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (77-77)
2025-10-15T10:54:26.266035Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (78-78)
2025-10-15T10:54:26.266061Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (79-79)
2025-10-15T10:54:26.266092Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (80-80)
2025-10-15T10:54:26.266123Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (81-81)
2025-10-15T10:54:26.266241Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (82-82)
2025-10-15T10:54:26.266276Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (83-83)
2025-10-15T10:54:26.266305Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (84-84)
2025-10-15T10:54:26.266331Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (85-85)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..7271 bytes.. Information: { Offset: 66 ProducerId: "src_id" SeqNo: 67 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7381 bytes.. Information: { Offset: 67 ProducerId: "src_id" SeqNo: 68 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7491 bytes.. Information: { Offset: 68 ProducerId: "src_id" SeqNo: 69 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7601 bytes.. Information: { Offset: 69 ProducerId: "src_id" SeqNo: 70 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7711 bytes.. Information: { Offset: 70 ProducerId: "src_id" SeqNo: 71 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7821 bytes.. Information: { Offset: 71 ProducerId: "src_id" SeqNo: 72 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..7931 bytes.. Information: { Offset: 72 ProducerId: "src_id" SeqNo: 73 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8041 bytes.. Information: { Offset: 73 ProducerId: "src_id" SeqNo: 74 CreateTime: 2025-10-15T10:54:25.614000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8151 bytes.. Information: { Offset: 74 ProducerId: "src_id" SeqNo: 75 CreateTime: 2025-10-15T10:54:25.615000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8261 bytes.. Information: { Offset: 75 ProducerId: "src_id" SeqNo: 76 CreateTime: 2025-10-15T10:54:25.615000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8371 bytes.. Information: { Offset: 76 ProducerId: "src_id" SeqNo: 77 CreateTime: 2025-10-15T10:54:25.615000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8481 bytes.. Information: { Offset: 77 ProducerId: "src_id" SeqNo: 78 CreateTime: 2025-10-15T10:54:25.615000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8591 bytes.. Information: { Offset: 78 ProducerId: "src_id" SeqNo: 79 CreateTime: 2025-10-15T10:54:25.615000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8701 bytes.. Information: { Offset: 79 ProducerId: "src_id" SeqNo: 80 CreateTime: 2025-10-15T10:54:25.615000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8811 bytes.. Information: { Offset: 80 ProducerId: "src_id" SeqNo: 81 CreateTime: 2025-10-15T10:54:25.615000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..8921 bytes.. Information: { Offset: 81 ProducerId: "src_id" SeqNo: 82 CreateTime: 2025-10-15T10:54:25.616000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9031 bytes.. Information: { Offset: 82 ProducerId: "src_id" SeqNo: 83 CreateTime: 2025-10-15T10:54:25.616000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9141 bytes.. Information: { Offset: 83 ProducerId: "src_id" SeqNo: 84 CreateTime: 2025-10-15T10:54:25.616000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9251 bytes.. Information: { Offset: 84 ProducerId: "src_id" SeqNo: 85 CreateTime: 2025-10-15T10:54:25.616000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9361 bytes.. Information: { Offset: 85 ProducerId: "src_id" SeqNo: 86 CreateTime: 2025-10-15T10:54:25.616000Z WriteTime: 2025-10-15T10:54:26.148000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:26.267599Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 20, size 166320 bytes
2025-10-15T10:54:26.267641Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.267751Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.268028Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 167152 } }
2025-10-15T10:54:26.268133Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# e68e8d1e-29d3453c-1ce0258f-384aae9e
2025-10-15T10:54:26.268470Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.268734Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.268951Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.268588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.268633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.268685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 112 partNo : 0 messageNo: 227 size 12293 offset: -1
2025-10-15T10:54:26.268753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.269231Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.268766Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.268789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 113 partNo : 0 messageNo: 228 size 12403 offset: -1
2025-10-15T10:54:26.268835Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.268845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.268865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 114 partNo : 0 messageNo: 229 size 12513 offset: -1
2025-10-15T10:54:26.268910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.268920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.268939Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 115 partNo : 0 messageNo: 230 size 12623 offset: -1
2025-10-15T10:54:26.268982Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.268993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.269012Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 116 partNo : 0 messageNo: 231 size 12733 offset: -1
2025-10-15T10:54:26.269041Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.269051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.269081Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.269090Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.269114Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.269123Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.269146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.269156Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.269282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.269300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.269376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.269393Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.269479Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.269527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.269541Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.269556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.269569Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.269587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.269596Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.269610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.269619Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.269634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.270141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 232  requestId: <none> cookie: 117
2025-10-15T10:54:26.270186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 233  requestId: <none> cookie: 118
2025-10-15T10:54:26.270206Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 234  requestId: <none> cookie: 119
2025-10-15T10:54:26.270223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 235  requestId: <none> cookie: 120
2025-10-15T10:54:26.270240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 236  requestId: <none> cookie: 121
2025-10-15T10:54:26.270299Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 86 count 12 size 120688 endOffset 96 max time lag 0ms effective offset 86
2025-10-15T10:54:26.270478Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 100574 count 10 last offset 86, current partition end offset: 96
2025-10-15T10:54:26.270492Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-15T10:54:26.270543Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 86 partno 0 count 10 parts_count 0 source 1 size 100574 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:26.270567Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-15T10:54:26.270622Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:26.271215Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 86 totakecount 10 count 10 size 100552 from pos 0 cbcount 10
2025-10-15T10:54:26.271385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 86
2025-10-15T10:54:26.271596Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 86 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:26.275417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.276209Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.276286Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.276316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.276344Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.276371Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.276688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.276908Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.276945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.276980Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.277015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.277873Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 96 Result { Offset: 86 Data: "... 9543 bytes ..." SourceId: "\000src_id" SeqNo: 87 WriteTimestampMS: 1760525666185 CreateTimestampMS: 1760525665616 UncompressedSize: 9471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 87 Data: "... 9653 bytes ..." SourceId: "\000src_id" SeqNo: 88 WriteTimestampMS: 1760525666217 CreateTimestampMS: 1760525665617 UncompressedSize: 9581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 88 Data: "... 9763 bytes ..." SourceId: "\000src_id" SeqNo: 89 WriteTimestampMS: 1760525666217 CreateTimestampMS: 1760525665617 UncompressedSize: 9691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 89 Data: "... 9873 bytes ..." SourceId: "\000src_id" SeqNo: 90 WriteTimestampMS: 1760525666217 CreateTimestampMS: 1760525665617 UncompressedSize: 9801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 90 Data: "... 9983 bytes ..." SourceId: "\000src_id" SeqNo: 91 WriteTimestampMS: 1760525666217 CreateTimestampMS: 1760525665617 UncompressedSize: 9911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 91 Data: "... 10093 bytes ..." SourceId: "\000src_id" SeqNo: 92 WriteTimestampMS: 1760525666217 CreateTimestampMS: 1760525665617 UncompressedSize: 10021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 92 Data: "... 10203 bytes ..." SourceId: "\000src_id" SeqNo: 93 WriteTimestampMS: 1760525666217 CreateTimestampMS: 1760525665617 UncompressedSize: 10131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 93 Data: "... 10313 bytes ..." SourceId: "\000src_id" SeqNo: 94 WriteTimestampMS: 1760525666217 CreateTimestampMS: 1760525665618 UncompressedSize: 10241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 94 Data: "... 10423 bytes ..." SourceId: "\000src_id" SeqNo: 95 WriteTimestampMS: 1760525666217 CreateTimestampMS: 1760525665618 UncompressedSize: 10351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 95 Data: "... 10533 bytes ..." SourceId: "\000src_id" SeqNo: 96 WriteTimestampMS: 1760525666217 CreateTimestampMS: 1760525665618 UncompressedSize: 10461 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551390 RealReadOffset: 95 WaitQuotaTimeMs: 0 EndOffset: 96 StartOffset: 0 } Cookie: 86 }
2025-10-15T10:54:26.278270Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 96
2025-10-15T10:54:26.278306Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 96 ReadOffset 96 ReadGuid 13e4c524-37ab40f7-bde0ceaf-e5690ff2 has messages 1
2025-10-15T10:54:26.284376Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 100259, now ReadSizeBudget = 0, ReadSizeServerDelta = 424029
2025-10-15T10:54:26.284498Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 424029
2025-10-15T10:54:26.284780Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (86-95)
2025-10-15T10:54:26.284815Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 100259 to budget
2025-10-15T10:54:26.284845Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 100259, ReadSizeServerDelta = 424029
2025-10-15T10:54:26.285054Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:26.285123Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (86-86)
2025-10-15T10:54:26.285166Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (87-87)
2025-10-15T10:54:26.285197Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (88-88)
2025-10-15T10:54:26.285254Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (89-89)
2025-10-15T10:54:26.285408Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (90-90)
2025-10-15T10:54:26.285438Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (91-91)
2025-10-15T10:54:26.285465Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (92-92)
2025-10-15T10:54:26.285490Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (93-93)
2025-10-15T10:54:26.285672Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (94-94)
2025-10-15T10:54:26.285765Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (95-95)
2025-10-15T10:54:26.284471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.284514Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.284576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 117 partNo : 0 messageNo: 237 size 12843 offset: -1
2025-10-15T10:54:26.284715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.284731Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.284756Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 118 partNo : 0 messageNo: 238 size 12953 offset: -1
2025-10-15T10:54:26.284818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.284829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.284853Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 119 partNo : 0 messageNo: 239 size 13063 offset: -1
2025-10-15T10:54:26.284940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.284954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.284977Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 120 partNo : 0 messageNo: 240 size 13173 offset: -1
2025-10-15T10:54:26.285031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
>>> event from dataHandler: 2025-10-15T10:54:26.285044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.285066Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 121 partNo : 0 messageNo: 241 size 13283 offset: -1
2025-10-15T10:54:26.285097Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.285107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.285138Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.285147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.285175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.285187Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.285214Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.285224Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.285266Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.285278Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.285350Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.285413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.285429Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.285448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.285459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.285474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.285483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.285503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..9471 bytes.. Information: { Offset: 86 ProducerId: "src_id" SeqNo: 87 CreateTime: 2025-10-15T10:54:25.616000Z WriteTime: 2025-10-15T10:54:26.185000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9581 bytes.. Information: { Offset: 87 ProducerId: "src_id" SeqNo: 88 CreateTime: 2025-10-15T10:54:25.617000Z WriteTime: 2025-10-15T10:54:26.217000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9691 bytes.. Information: { Offset: 88 ProducerId: "src_id" SeqNo: 89 CreateTime: 2025-10-15T10:54:25.617000Z WriteTime: 2025-10-15T10:54:26.217000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9801 bytes.. Information: { Offset: 89 ProducerId: "src_id" SeqNo: 90 CreateTime: 2025-10-15T10:54:25.617000Z WriteTime: 2025-10-15T10:54:26.217000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..9911 bytes.. Information: { Offset: 90 ProducerId: "src_id" SeqNo: 91 CreateTime: 2025-10-15T10:54:25.617000Z WriteTime: 2025-10-15T10:54:26.217000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10021 bytes.. Information: { Offset: 91 ProducerId: "src_id" SeqNo: 92 CreateTime: 2025-10-15T10:54:25.617000Z WriteTime: 2025-10-15T10:54:26.217000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10131 bytes.. Information: { Offset: 92 ProducerId: "src_id" SeqNo: 93 CreateTime: 2025-10-15T10:54:25.617000Z WriteTime: 2025-10-15T10:54:26.217000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10241 bytes.. Information: { Offset: 93 ProducerId: "src_id" SeqNo: 94 CreateTime: 2025-10-15T10:54:25.618000Z WriteTime: 2025-10-15T10:54:26.217000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10351 bytes.. Information: { Offset: 94 ProducerId: "src_id" SeqNo: 95 CreateTime: 2025-10-15T10:54:25.618000Z WriteTime: 2025-10-15T10:54:26.217000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10461 bytes.. Information: { Offset: 95 ProducerId: "src_id" SeqNo: 96 CreateTime: 2025-10-15T10:54:25.618000Z WriteTime: 2025-10-15T10:54:26.217000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:26.286858Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 10, size 99660 bytes
2025-10-15T10:54:26.286895Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.285521Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.285561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.285705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 242  requestId: <none> cookie: 122
2025-10-15T10:54:26.285761Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 243  requestId: <none> cookie: 123
2025-10-15T10:54:26.285779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 244  requestId: <none> cookie: 124
2025-10-15T10:54:26.285793Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 245  requestId: <none> cookie: 125
2025-10-15T10:54:26.285811Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 246  requestId: <none> cookie: 126
2025-10-15T10:54:26.290726Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.290767Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.290818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 122 partNo : 0 messageNo: 247 size 13393 offset: -1
2025-10-15T10:54:26.290881Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.290893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.290915Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 123 partNo : 0 messageNo: 248 size 13503 offset: -1
2025-10-15T10:54:26.290992Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.291007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.291031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 124 partNo : 0 messageNo: 249 size 13613 offset: -1
2025-10-15T10:54:26.291087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.291098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.291118Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 125 partNo : 0 messageNo: 250 size 13723 offset: -1
2025-10-15T10:54:26.291204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.291216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.291241Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 126 partNo : 0 messageNo: 251 size 13833 offset: -1
2025-10-15T10:54:26.291278Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.291288Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.291319Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.291328Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.291366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.291376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.291401Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.291409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.291433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.291443Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.291496Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 96 count 10 size 111574 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.291546Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.291599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.291612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.291626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.291635Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.291650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.291661Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.291673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.291696Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.291726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.291798Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.291847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 111450 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.291887Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.291916Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-15T10:54:26.291933Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.291949Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-15T10:54:26.291967Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.291987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-15T10:54:26.292000Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.292019Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-15T10:54:26.292030Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.292049Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 101, partNo: 0, Offset: 100 is stored on disk
2025-10-15T10:54:26.292059Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.292075Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 102, partNo: 0, Offset: 101 is stored on disk
2025-10-15T10:54:26.292089Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.292105Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 103, partNo: 0, Offset: 102 is stored on disk
2025-10-15T10:54:26.292116Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.292144Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 104, partNo: 0, Offset: 103 is stored on disk
2025-10-15T10:54:26.292159Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.292176Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 105, partNo: 0, Offset: 104 is stored on disk
2025-10-15T10:54:26.292188Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.292205Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 106, partNo: 0, Offset: 105 is stored on disk
2025-10-15T10:54:26.292413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.292499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.292510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-15T10:54:26.292600Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 107 partNo 0
2025-10-15T10:54:26.292884Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 96 partno 0 count 10 parts 0 suffix '63' size 111574
2025-10-15T10:54:26.308433Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 107 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 11817 count 1 nextOffset 107 batches 1
2025-10-15T10:54:26.308526Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 108 partNo 0
2025-10-15T10:54:26.308568Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 108 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 23712 count 2 nextOffset 108 batches 1
2025-10-15T10:54:26.308607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 109 partNo 0
2025-10-15T10:54:26.308631Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 109 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 35717 count 3 nextOffset 109 batches 1
2025-10-15T10:54:26.308652Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 110 partNo 0
2025-10-15T10:54:26.308673Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 110 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 47832 count 4 nextOffset 110 batches 1
2025-10-15T10:54:26.308692Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 111 partNo 0
2025-10-15T10:54:26.308713Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 111 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 60057 count 5 nextOffset 111 batches 1
2025-10-15T10:54:26.308734Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 112 partNo 0
2025-10-15T10:54:26.308755Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 112 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 72392 count 6 nextOffset 112 batches 1
2025-10-15T10:54:26.308774Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 113 partNo 0
2025-10-15T10:54:26.308794Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 113 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 84837 count 7 nextOffset 113 batches 1
2025-10-15T10:54:26.308816Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 114 partNo 0
2025-10-15T10:54:26.308837Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 114 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 97392 count 8 nextOffset 114 batches 1
2025-10-15T10:54:26.308859Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 115 partNo 0
2025-10-15T10:54:26.308883Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 115 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 110057 count 9 nextOffset 115 batches 1
2025-10-15T10:54:26.308900Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 116 partNo 0
2025-10-15T10:54:26.308918Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 116 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 122832 count 10 nextOffset 116 batches 1
2025-10-15T10:54:26.308938Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 117 partNo 0
2025-10-15T10:54:26.308961Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 117 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 135717 count 11 nextOffset 117 batches 1
2025-10-15T10:54:26.308980Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 118 partNo 0
2025-10-15T10:54:26.309000Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 118 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 148712 count 12 nextOffset 118 batches 1
2025-10-15T10:54:26.309023Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 119 partNo 0
2025-10-15T10:54:26.309044Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 119 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 161817 count 13 nextOffset 119 batches 1
2025-10-15T10:54:26.309064Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 120 partNo 0
2025-10-15T10:54:26.309085Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 120 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 175032 count 14 nextOffset 120 batches 1
2025-10-15T10:54:26.309104Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 121 partNo 0
2025-10-15T10:54:26.309124Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 121 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 188357 count 15 nextOffset 121 batches 1
2025-10-15T10:54:26.309142Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 122 partNo 0
2025-10-15T10:54:26.309161Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 122 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 201792 count 16 nextOffset 122 batches 1
2025-10-15T10:54:26.309180Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 123 partNo 0
2025-10-15T10:54:26.309203Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 123 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 215337 count 17 nextOffset 123 batches 1
2025-10-15T10:54:26.309222Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 124 partNo 0
2025-10-15T10:54:26.309239Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 124 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 228992 count 18 nextOffset 124 batches 1
2025-10-15T10:54:26.309258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 125 partNo 0
2025-10-15T10:54:26.309279Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 125 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 242757 count 19 nextOffset 125 batches 1
2025-10-15T10:54:26.309298Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 126 partNo 0
2025-10-15T10:54:26.309316Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 126 partNo 0 FormedBlobsCount 0 NewHead: Offset 106 PartNo 0 PackedSize 256632 count 20 nextOffset 126 batches 1
2025-10-15T10:54:26.309334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.312818Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 106,20 HeadOffset 106 endOffset 106 curOffset 126 d0000000000_00000000000000000106_00000_0000000020_00000? size 256054 WTime 1760525666310
2025-10-15T10:54:26.313232Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.313310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 252  requestId: <none> cookie: 127
2025-10-15T10:54:26.313372Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 253  requestId: <none> cookie: 128
2025-10-15T10:54:26.313394Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 254  requestId: <none> cookie: 129
2025-10-15T10:54:26.313421Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 255  requestId: <none> cookie: 130
2025-10-15T10:54:26.313441Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 256  requestId: <none> cookie: 131
2025-10-15T10:54:26.313471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 197  requestId: <none> cookie: 97
2025-10-15T10:54:26.313517Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 198  requestId: <none> cookie: 98
2025-10-15T10:54:26.313544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 199  requestId: <none> cookie: 99
2025-10-15T10:54:26.313569Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 200  requestId: <none> cookie: 100
2025-10-15T10:54:26.313598Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 201  requestId: <none> cookie: 101
2025-10-15T10:54:26.313622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 207  requestId: <none> cookie: 102
2025-10-15T10:54:26.313644Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 208  requestId: <none> cookie: 103
2025-10-15T10:54:26.313668Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 209  requestId: <none> cookie: 104
2025-10-15T10:54:26.313747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 210  requestId: <none> cookie: 105
2025-10-15T10:54:26.313786Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 211  requestId: <none> cookie: 106
2025-10-15T10:54:26.313904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.313931Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.313978Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.314086Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 106 partNo 0 count 20 size 256054
2025-10-15T10:54:26.314333Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 96 count 12 size 133888 endOffset 106 max time lag 0ms effective offset 96
2025-10-15T10:54:26.314505Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 111574 count 10 last offset 96, current partition end offset: 106
2025-10-15T10:54:26.314520Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-15T10:54:26.314570Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 96 partno 0 count 10 parts_count 0 source 1 size 111574 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:26.314594Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-15T10:54:26.314643Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:26.315201Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 96 totakecount 10 count 10 size 111552 from pos 0 cbcount 10
2025-10-15T10:54:26.315665Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 96 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:26.319528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 97 offsets: 96 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 21 }
2025-10-15T10:54:26.319588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 97
2025-10-15T10:54:26.321400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 98 offsets: 97 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 21 }
2025-10-15T10:54:26.321442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 98
2025-10-15T10:54:26.321648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 99 offsets: 98 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 21 }
2025-10-15T10:54:26.321676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 99
2025-10-15T10:54:26.321865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 100 offsets: 99 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 21 }
2025-10-15T10:54:26.321890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 100
2025-10-15T10:54:26.322011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 101 offsets: 100 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 21 }
2025-10-15T10:54:26.322033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 101
2025-10-15T10:54:26.322128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 102 offsets: 101 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 2 }
2025-10-15T10:54:26.322149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 102
2025-10-15T10:54:26.322247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 103 offsets: 102 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 2 }
2025-10-15T10:54:26.322266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 103
2025-10-15T10:54:26.322365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 104 offsets: 103 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 2 }
2025-10-15T10:54:26.322386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 104
2025-10-15T10:54:26.322481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 105 offsets: 104 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 2 }
2025-10-15T10:54:26.322498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 105
2025-10-15T10:54:26.322589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 106 offsets: 105 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 2 }
2025-10-15T10:54:26.322608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 106
2025-10-15T10:54:26.327458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 96
2025-10-15T10:54:26.327699Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.327727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.327784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 127 partNo : 0 messageNo: 257 size 13943 offset: -1
2025-10-15T10:54:26.327888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.327904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.327929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 128 partNo : 0 messageNo: 258 size 14054 offset: -1
2025-10-15T10:54:26.327985Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.327996Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.328018Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 129 partNo : 0 messageNo: 259 size 14164 offset: -1
2025-10-15T10:54:26.328075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.328085Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.328105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 130 partNo : 0 messageNo: 260 size 14274 offset: -1
2025-10-15T10:54:26.328181Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.328193Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.328216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 131 partNo : 0 messageNo: 261 size 14384 offset: -1
2025-10-15T10:54:26.328248Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.328258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.328291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.328300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.328325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.328337Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.328364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.328375Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.328402Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.328413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.328637Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.328685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.328700Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.328716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.328727Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.328743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.328753Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.328766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.328778Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.328790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.329266Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 262  requestId: <none> cookie: 132
2025-10-15T10:54:26.329296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 263  requestId: <none> cookie: 133
2025-10-15T10:54:26.329318Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 264  requestId: <none> cookie: 134
2025-10-15T10:54:26.329337Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 265  requestId: <none> cookie: 135
2025-10-15T10:54:26.329356Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 266  requestId: <none> cookie: 136
2025-10-15T10:54:26.338183Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 111259, now ReadSizeBudget = 0, ReadSizeServerDelta = 413029
2025-10-15T10:54:26.338313Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 413029
2025-10-15T10:54:26.339591Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (96-105)
2025-10-15T10:54:26.339638Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 111259 to budget
2025-10-15T10:54:26.339666Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 111259, ReadSizeServerDelta = 413029
2025-10-15T10:54:26.339910Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:26.340049Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (96-96)
2025-10-15T10:54:26.340137Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (97-97)
2025-10-15T10:54:26.340243Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (98-98)
2025-10-15T10:54:26.340292Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (99-99)
2025-10-15T10:54:26.340438Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (100-100)
2025-10-15T10:54:26.340499Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (101-101)
2025-10-15T10:54:26.340556Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (102-102)
2025-10-15T10:54:26.340614Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (103-103)
2025-10-15T10:54:26.340867Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (104-104)
2025-10-15T10:54:26.340920Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (105-105)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..10571 bytes.. Information: { Offset: 96 ProducerId: "src_id" SeqNo: 97 CreateTime: 2025-10-15T10:54:25.618000Z WriteTime: 2025-10-15T10:54:26.245000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10681 bytes.. Information: { Offset: 97 ProducerId: "src_id" SeqNo: 98 CreateTime: 2025-10-15T10:54:25.619000Z WriteTime: 2025-10-15T10:54:26.246000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10791 bytes.. Information: { Offset: 98 ProducerId: "src_id" SeqNo: 99 CreateTime: 2025-10-15T10:54:25.625000Z WriteTime: 2025-10-15T10:54:26.246000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..10901 bytes.. Information: { Offset: 99 ProducerId: "src_id" SeqNo: 100 CreateTime: 2025-10-15T10:54:25.625000Z WriteTime: 2025-10-15T10:54:26.246000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11011 bytes.. Information: { Offset: 100 ProducerId: "src_id" SeqNo: 101 CreateTime: 2025-10-15T10:54:25.625000Z WriteTime: 2025-10-15T10:54:26.246000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11121 bytes.. Information: { Offset: 101 ProducerId: "src_id" SeqNo: 102 CreateTime: 2025-10-15T10:54:25.625000Z WriteTime: 2025-10-15T10:54:26.246000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11231 bytes.. Information: { Offset: 102 ProducerId: "src_id" SeqNo: 103 CreateTime: 2025-10-15T10:54:25.625000Z WriteTime: 2025-10-15T10:54:26.246000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11341 bytes.. Information: { Offset: 103 ProducerId: "src_id" SeqNo: 104 CreateTime: 2025-10-15T10:54:25.626000Z WriteTime: 2025-10-15T10:54:26.246000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11451 bytes.. Information: { Offset: 104 ProducerId: "src_id" SeqNo: 105 CreateTime: 2025-10-15T10:54:25.626000Z WriteTime: 2025-10-15T10:54:26.246000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11561 bytes.. Information: { Offset: 105 ProducerId: "src_id" SeqNo: 106 CreateTime: 2025-10-15T10:54:25.631000Z WriteTime: 2025-10-15T10:54:26.246000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:26.345455Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 10, size 110660 bytes
2025-10-15T10:54:26.345501Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.347442Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.347491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.347559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 132 partNo : 0 messageNo: 267 size 14494 offset: -1
2025-10-15T10:54:26.347666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.347687Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.347715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 133 partNo : 0 messageNo: 268 size 14604 offset: -1
2025-10-15T10:54:26.347847Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.347862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.347888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 134 partNo : 0 messageNo: 269 size 14714 offset: -1
2025-10-15T10:54:26.347975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.347997Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.348025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 135 partNo : 0 messageNo: 270 size 14824 offset: -1
2025-10-15T10:54:26.348106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.348122Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.348146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 136 partNo : 0 messageNo: 271 size 14934 offset: -1
2025-10-15T10:54:26.348192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.348211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.348252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.348265Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.348297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.348309Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.348346Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.348361Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.348396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.348408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.348652Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.348701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.348714Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.348730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.348740Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.348775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.348789Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.348805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.348816Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.348832Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.348944Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 106 count 20 size 256054 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.349003Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 272  requestId: <none> cookie: 137
2025-10-15T10:54:26.349040Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 273  requestId: <none> cookie: 138
2025-10-15T10:54:26.349061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 274  requestId: <none> cookie: 139
2025-10-15T10:54:26.349079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 275  requestId: <none> cookie: 140
2025-10-15T10:54:26.349100Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 276  requestId: <none> cookie: 141
2025-10-15T10:54:26.349119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.349178Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 255900 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.349214Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349245Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 107, partNo: 0, Offset: 106 is stored on disk
2025-10-15T10:54:26.349263Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 108, partNo: 0, Offset: 107 is stored on disk
2025-10-15T10:54:26.349300Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349330Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 109, partNo: 0, Offset: 108 is stored on disk
2025-10-15T10:54:26.349346Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349365Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 110, partNo: 0, Offset: 109 is stored on disk
2025-10-15T10:54:26.349379Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349399Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 111, partNo: 0, Offset: 110 is stored on disk
2025-10-15T10:54:26.349410Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349433Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 112, partNo: 0, Offset: 111 is stored on disk
2025-10-15T10:54:26.349444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349463Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 113, partNo: 0, Offset: 112 is stored on disk
2025-10-15T10:54:26.349474Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349493Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 114, partNo: 0, Offset: 113 is stored on disk
2025-10-15T10:54:26.349503Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 115, partNo: 0, Offset: 114 is stored on disk
2025-10-15T10:54:26.349537Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349559Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 116, partNo: 0, Offset: 115 is stored on disk
2025-10-15T10:54:26.349571Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349591Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 117, partNo: 0, Offset: 116 is stored on disk
2025-10-15T10:54:26.349600Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349622Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 118, partNo: 0, Offset: 117 is stored on disk
2025-10-15T10:54:26.349634Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349653Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 119, partNo: 0, Offset: 118 is stored on disk
2025-10-15T10:54:26.349664Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349683Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 120, partNo: 0, Offset: 119 is stored on disk
2025-10-15T10:54:26.349751Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349772Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 121, partNo: 0, Offset: 120 is stored on disk
2025-10-15T10:54:26.349784Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349802Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 122, partNo: 0, Offset: 121 is stored on disk
2025-10-15T10:54:26.349813Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349832Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 123, partNo: 0, Offset: 122 is stored on disk
2025-10-15T10:54:26.349843Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349862Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 124, partNo: 0, Offset: 123 is stored on disk
2025-10-15T10:54:26.349873Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349891Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 125, partNo: 0, Offset: 124 is stored on disk
2025-10-15T10:54:26.349901Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.349924Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 126, partNo: 0, Offset: 125 is stored on disk
2025-10-15T10:54:26.350127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.350181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.350193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:26.350287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 127 partNo 0
2025-10-15T10:54:26.350548Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 106 partno 0 count 20 parts 0 suffix '63' size 256054
2025-10-15T10:54:26.364795Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 127 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 14017 count 1 nextOffset 127 batches 1
2025-10-15T10:54:26.364894Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 128 partNo 0
2025-10-15T10:54:26.364937Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 128 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 28113 count 2 nextOffset 128 batches 1
2025-10-15T10:54:26.364959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 129 partNo 0
2025-10-15T10:54:26.364979Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 129 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 42319 count 3 nextOffset 129 batches 1
2025-10-15T10:54:26.365001Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 130 partNo 0
2025-10-15T10:54:26.365020Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 130 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 56635 count 4 nextOffset 130 batches 1
2025-10-15T10:54:26.365038Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 131 partNo 0
2025-10-15T10:54:26.365061Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 131 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 71061 count 5 nextOffset 131 batches 1
2025-10-15T10:54:26.365080Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 132 partNo 0
2025-10-15T10:54:26.365098Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 132 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 85597 count 6 nextOffset 132 batches 1
2025-10-15T10:54:26.365118Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 133 partNo 0
2025-10-15T10:54:26.365136Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 133 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 100243 count 7 nextOffset 133 batches 1
2025-10-15T10:54:26.365155Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 134 partNo 0
2025-10-15T10:54:26.365173Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 134 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 114999 count 8 nextOffset 134 batches 1
2025-10-15T10:54:26.365195Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 135 partNo 0
2025-10-15T10:54:26.365217Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 135 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 129865 count 9 nextOffset 135 batches 1
2025-10-15T10:54:26.365237Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 136 partNo 0
2025-10-15T10:54:26.365256Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 136 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 144841 count 10 nextOffset 136 batches 1
2025-10-15T10:54:26.365274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.366326Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 126,10 HeadOffset 126 endOffset 126 curOffset 136 d0000000000_00000000000000000126_00000_0000000010_00000? size 144583 WTime 1760525666364
2025-10-15T10:54:26.366616Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.366726Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 217  requestId: <none> cookie: 107
2025-10-15T10:54:26.366794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 218  requestId: <none> cookie: 108
2025-10-15T10:54:26.366816Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 219  requestId: <none> cookie: 109
2025-10-15T10:54:26.366841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 220  requestId: <none> cookie: 110
2025-10-15T10:54:26.366865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 221  requestId: <none> cookie: 111
2025-10-15T10:54:26.366890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 227  requestId: <none> cookie: 112
2025-10-15T10:54:26.366915Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 228  requestId: <none> cookie: 113
2025-10-15T10:54:26.366940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 229  requestId: <none> cookie: 114
2025-10-15T10:54:26.366964Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 230  requestId: <none> cookie: 115
2025-10-15T10:54:26.366987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 231  requestId: <none> cookie: 116
2025-10-15T10:54:26.367009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 237  requestId: <none> cookie: 117
2025-10-15T10:54:26.367030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 238  requestId: <none> cookie: 118
2025-10-15T10:54:26.367052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 239  requestId: <none> cookie: 119
2025-10-15T10:54:26.367075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 240  requestId: <none> cookie: 120
2025-10-15T10:54:26.367098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 241  requestId: <none> cookie: 121
2025-10-15T10:54:26.367122Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 247  requestId: <none> cookie: 122
2025-10-15T10:54:26.367142Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 248  requestId: <none> cookie: 123
2025-10-15T10:54:26.367165Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 249  requestId: <none> cookie: 124
2025-10-15T10:54:26.367187Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 250  requestId: <none> cookie: 125
2025-10-15T10:54:26.367211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 251  requestId: <none> cookie: 126
2025-10-15T10:54:26.367340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.372882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 107 offsets: 106 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 54 }
2025-10-15T10:54:26.372933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 107
2025-10-15T10:54:26.375757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 108 offsets: 107 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 54 }
2025-10-15T10:54:26.375793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 108
2025-10-15T10:54:26.375943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 109 offsets: 108 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 54 }
2025-10-15T10:54:26.375965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 109
2025-10-15T10:54:26.376042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 110 offsets: 109 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 54 }
2025-10-15T10:54:26.376054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 110
2025-10-15T10:54:26.376112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 111 offsets: 110 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 54 }
2025-10-15T10:54:26.376127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 111
2025-10-15T10:54:26.376183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 112 offsets: 111 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 39 }
2025-10-15T10:54:26.376195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 112
2025-10-15T10:54:26.376318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 113 offsets: 112 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 38 }
2025-10-15T10:54:26.376344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 113
2025-10-15T10:54:26.376451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 114 offsets: 113 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 38 }
2025-10-15T10:54:26.376468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 114
2025-10-15T10:54:26.376543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 115 offsets: 114 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 38 }
2025-10-15T10:54:26.376555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 115
2025-10-15T10:54:26.376613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 116 offsets: 115 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 38 }
2025-10-15T10:54:26.376627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 116
2025-10-15T10:54:26.376682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 117 offsets: 116 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:26.376696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 117
2025-10-15T10:54:26.376756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 118 offsets: 117 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:26.376769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 118
2025-10-15T10:54:26.376821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 119 offsets: 118 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:26.376832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 119
2025-10-15T10:54:26.376895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 120 offsets: 119 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 24 }
2025-10-15T10:54:26.376910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 120
2025-10-15T10:54:26.377000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 121 offsets: 120 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:26.377014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 121
2025-10-15T10:54:26.377072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 122 offsets: 121 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 17 }
2025-10-15T10:54:26.377088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 122
2025-10-15T10:54:26.377145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 123 offsets: 122 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 17 }
2025-10-15T10:54:26.377157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 123
2025-10-15T10:54:26.377263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 124 offsets: 123 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 17 }
2025-10-15T10:54:26.377278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 124
2025-10-15T10:54:26.377346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 125 offsets: 124 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 17 }
2025-10-15T10:54:26.377360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 125
2025-10-15T10:54:26.377420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 126 offsets: 125 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 17 }
2025-10-15T10:54:26.377439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 126
2025-10-15T10:54:26.379513Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.379602Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 137 partNo : 0 messageNo: 277 size 15044 offset: -1
2025-10-15T10:54:26.379748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.379762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.379787Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 138 partNo : 0 messageNo: 278 size 15154 offset: -1
2025-10-15T10:54:26.379840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.379852Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.379874Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 139 partNo : 0 messageNo: 279 size 15264 offset: -1
2025-10-15T10:54:26.379935Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.379945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.379968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 140 partNo : 0 messageNo: 280 size 15374 offset: -1
2025-10-15T10:54:26.380028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.380040Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.380060Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 141 partNo : 0 messageNo: 281 size 15484 offset: -1
2025-10-15T10:54:26.380095Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.380108Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.380141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.380152Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.380180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.380192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.380219Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.380229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.380255Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.380265Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.380337Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.380348Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.380392Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.380512Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 126 partNo 0 count 10 size 144583
2025-10-15T10:54:26.380570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.380585Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.380628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.380641Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.380657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.380667Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.380681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.380691Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.380710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.380719Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.380734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.380946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 282  requestId: <none> cookie: 142
2025-10-15T10:54:26.381002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 283  requestId: <none> cookie: 143
2025-10-15T10:54:26.381020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 284  requestId: <none> cookie: 144
2025-10-15T10:54:26.381036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 285  requestId: <none> cookie: 145
2025-10-15T10:54:26.381053Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 286  requestId: <none> cookie: 146
2025-10-15T10:54:26.381155Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 106 count 24 size 307264 endOffset 126 max time lag 0ms effective offset 106
2025-10-15T10:54:26.381333Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 256054 count 20 last offset 106, current partition end offset: 126
2025-10-15T10:54:26.381349Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-15T10:54:26.381401Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 106 partno 0 count 20 parts_count 0 source 1 size 256054 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:26.381423Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-15T10:54:26.381472Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:26.382569Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 106 totakecount 20 count 20 size 256032 from pos 0 cbcount 20
2025-10-15T10:54:26.382809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 106
2025-10-15T10:54:26.383993Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 106 partno 0 count 20 parts 0 suffix '63'
2025-10-15T10:54:26.278444Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 13e4c524-37ab40f7-bde0ceaf-e5690ff2, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 100259
2025-10-15T10:54:26.278472Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 13e4c524-37ab40f7-bde0ceaf-e5690ff2
2025-10-15T10:54:26.278936Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:26.287378Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.287438Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.287494Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.287518Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.287544Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.287573Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.288101Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.288152Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.288185Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.288218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.288249Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.288475Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 100259 } }
2025-10-15T10:54:26.288584Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 91be5b12-873990d7-c5df4089-1cec882c
2025-10-15T10:54:26.291390Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.291760Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.292036Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.292298Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.292542Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.293576Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 96 EndOffset 96 newEndOffset 106 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-10-15T10:54:26.293597Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 96 endOffset 106
2025-10-15T10:54:26.293637Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 96, endOffset# 106, WTime# 1760525666217, sizeLag# 111574
2025-10-15T10:54:26.293652Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:26.293732Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# f3739029-954f404b-6043ce04-ccca505a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 133888, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:26.293795Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 133888 maxTimeLagMs 0 readTimestampMs 0 readOffset 96 EndOffset 106 ClientCommitOffset 0 committedOffset 0 Guid f3739029-954f404b-6043ce04-ccca505a
2025-10-15T10:54:26.311460Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.316986Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317055Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317086Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317115Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317142Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317170Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317208Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317236Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317263Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317288Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317344Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317370Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317399Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317426Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.317906Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.318151Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.318197Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.318245Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.318291Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.320913Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.321397Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.321742Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.334095Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 106 Result { Offset: 96 Data: "... 10643 bytes ..." SourceId: "\000src_id" SeqNo: 97 WriteTimestampMS: 1760525666245 CreateTimestampMS: 1760525665618 UncompressedSize: 10571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 97 Data: "... 10753 bytes ..." SourceId: "\000src_id" SeqNo: 98 WriteTimestampMS: 1760525666246 CreateTimestampMS: 1760525665619 UncompressedSize: 10681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 98 Data: "... 10863 bytes ..." SourceId: "\000src_id" SeqNo: 99 WriteTimestampMS: 1760525666246 CreateTimestampMS: 1760525665625 UncompressedSize: 10791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 99 Data: "... 10973 bytes ..." SourceId: "\000src_id" SeqNo: 100 WriteTimestampMS: 1760525666246 CreateTimestampMS: 1760525665625 UncompressedSize: 10901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 100 Data: "... 11083 bytes ..." SourceId: "\000src_id" SeqNo: 101 WriteTimestampMS: 1760525666246 CreateTimestampMS: 1760525665625 UncompressedSize: 11011 PartitionKey: "" ExplicitHash: "" } Result { Offset: 101 Data: "... 11193 bytes ..." SourceId: "\000src_id" SeqNo: 102 WriteTimestampMS: 1760525666246 CreateTimestampMS: 1760525665625 UncompressedSize: 11121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 102 Data: "... 11303 bytes ..." SourceId: "\000src_id" SeqNo: 103 WriteTimestampMS: 1760525666246 CreateTimestampMS: 1760525665625 UncompressedSize: 11231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 103 Data: "... 11413 bytes ..." SourceId: "\000src_id" SeqNo: 104 WriteTimestampMS: 1760525666246 CreateTimestampMS: 1760525665626 UncompressedSize: 11341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 104 Data: "... 11523 bytes ..." SourceId: "\000src_id" SeqNo: 105 WriteTimestampMS: 1760525666246 CreateTimestampMS: 1760525665626 UncompressedSize: 11451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 105 Data: "... 11633 bytes ..." SourceId: "\000src_id" SeqNo: 106 WriteTimestampMS: 1760525666246 CreateTimestampMS: 1760525665631 UncompressedSize: 11561 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551390 RealReadOffset: 105 WaitQuotaTimeMs: 0 EndOffset: 106 StartOffset: 0 } Cookie: 96 }
2025-10-15T10:54:26.334708Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 106
2025-10-15T10:54:26.334751Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 106 ReadOffset 106 ReadGuid f3739029-954f404b-6043ce04-ccca505a has messages 1
2025-10-15T10:54:26.334920Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.334973Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.335005Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.335032Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.335061Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.335407Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.335652Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.335694Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.335731Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.335766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.335932Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# f3739029-954f404b-6043ce04-ccca505a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 111259
2025-10-15T10:54:26.335963Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# f3739029-954f404b-6043ce04-ccca505a
2025-10-15T10:54:26.336362Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:26.346449Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.346918Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 111259 } }
2025-10-15T10:54:26.347058Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# b7c66dc0-3ced9976-bbc9524c-826b5ba4
2025-10-15T10:54:26.347968Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.348972Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.352253Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.352307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.352369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.352399Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.352425Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.352455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.352961Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.353064Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.353097Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.353131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.353166Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.353345Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 106 EndOffset 106 newEndOffset 126 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-10-15T10:54:26.353368Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 106 endOffset 126
2025-10-15T10:54:26.353407Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 106, endOffset# 126, WTime# 1760525666246, sizeLag# 256054
2025-10-15T10:54:26.353421Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:26.353471Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 858a437d-6d7b334e-a5a6757d-a1e5b2d5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 24, size# 307264, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:26.353522Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 24 maxSize 307264 maxTimeLagMs 0 readTimestampMs 0 readOffset 106 EndOffset 126 ClientCommitOffset 0 committedOffset 0 Guid 858a437d-6d7b334e-a5a6757d-a1e5b2d5
2025-10-15T10:54:26.367783Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.368313Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.368665Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.371000Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371077Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371106Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371132Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371160Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371183Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371238Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371260Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371286Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371309Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371339Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371378Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371403Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371429Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371454Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371478Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371504Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371528Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.371551Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.386843Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.386909Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.386937Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.391622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.391663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.391716Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 142 partNo : 0 messageNo: 287 size 15594 offset: -1
2025-10-15T10:54:26.391805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.391820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.391843Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 143 partNo : 0 messageNo: 288 size 15704 offset: -1
2025-10-15T10:54:26.391916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.391929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.391949Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 144 partNo : 0 messageNo: 289 size 15814 offset: -1
2025-10-15T10:54:26.392016Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.392028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.392048Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 145 partNo : 0 messageNo: 290 size 15924 offset: -1
2025-10-15T10:54:26.392125Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.392137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.392157Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 146 partNo : 0 messageNo: 291 size 16034 offset: -1
2025-10-15T10:54:26.392184Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.392235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.392248Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.392259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.392269Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.392283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.392292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.392304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.392313Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.392325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.396287Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 255390, now ReadSizeBudget = 0, ReadSizeServerDelta = 268898
2025-10-15T10:54:26.396437Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 268898
2025-10-15T10:54:26.396683Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (106-125)
2025-10-15T10:54:26.396722Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 255390 to budget
2025-10-15T10:54:26.396752Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 255390, ReadSizeServerDelta = 268898
2025-10-15T10:54:26.396980Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:26.397042Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (106-106)
2025-10-15T10:54:26.397151Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (107-107)
2025-10-15T10:54:26.397260Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (108-108)
2025-10-15T10:54:26.397325Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (109-109)
2025-10-15T10:54:26.397507Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (110-110)
2025-10-15T10:54:26.397569Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (111-111)
2025-10-15T10:54:26.397633Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (112-112)
2025-10-15T10:54:26.397674Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (113-113)
2025-10-15T10:54:26.397954Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (114-114)
2025-10-15T10:54:26.397998Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (115-115)
2025-10-15T10:54:26.398074Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (116-116)
2025-10-15T10:54:26.398110Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (117-117)
2025-10-15T10:54:26.398189Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (118-118)
2025-10-15T10:54:26.398226Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (119-119)
2025-10-15T10:54:26.398283Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (120-120)
2025-10-15T10:54:26.398318Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (121-121)
2025-10-15T10:54:26.398690Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (122-122)
2025-10-15T10:54:26.398739Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 3} (123-123)
2025-10-15T10:54:26.397470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.397515Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.398803Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 4} (124-124)
2025-10-15T10:54:26.397569Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.397579Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.397616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.398859Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 5} (125-125)
2025-10-15T10:54:26.397628Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.397656Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.397666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.397755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.397772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.398495Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 292  requestId: <none> cookie: 147
2025-10-15T10:54:26.398555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 293  requestId: <none> cookie: 148
2025-10-15T10:54:26.398589Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 294  requestId: <none> cookie: 149
2025-10-15T10:54:26.398618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 295  requestId: <none> cookie: 150
2025-10-15T10:54:26.398650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 296  requestId: <none> cookie: 151
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..11671 bytes.. Information: { Offset: 106 ProducerId: "src_id" SeqNo: 107 CreateTime: 2025-10-15T10:54:25.631000Z WriteTime: 2025-10-15T10:54:26.292000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11781 bytes.. Information: { Offset: 107 ProducerId: "src_id" SeqNo: 108 CreateTime: 2025-10-15T10:54:25.631000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..11891 bytes.. Information: { Offset: 108 ProducerId: "src_id" SeqNo: 109 CreateTime: 2025-10-15T10:54:25.631000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12001 bytes.. Information: { Offset: 109 ProducerId: "src_id" SeqNo: 110 CreateTime: 2025-10-15T10:54:25.632000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12111 bytes.. Information: { Offset: 110 ProducerId: "src_id" SeqNo: 111 CreateTime: 2025-10-15T10:54:25.633000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12221 bytes.. Information: { Offset: 111 ProducerId: "src_id" SeqNo: 112 CreateTime: 2025-10-15T10:54:25.633000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12331 bytes.. Information: { Offset: 112 ProducerId: "src_id" SeqNo: 113 CreateTime: 2025-10-15T10:54:25.634000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12441 bytes.. Information: { Offset: 113 ProducerId: "src_id" SeqNo: 114 CreateTime: 2025-10-15T10:54:25.637000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12551 bytes.. Information: { Offset: 114 ProducerId: "src_id" SeqNo: 115 CreateTime: 2025-10-15T10:54:25.637000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12661 bytes.. Information: { Offset: 115 ProducerId: "src_id" SeqNo: 116 CreateTime: 2025-10-15T10:54:25.637000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12771 bytes.. Information: { Offset: 116 ProducerId: "src_id" SeqNo: 117 CreateTime: 2025-10-15T10:54:25.637000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12881 bytes.. Information: { Offset: 117 ProducerId: "src_id" SeqNo: 118 CreateTime: 2025-10-15T10:54:25.637000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..12991 bytes.. Information: { Offset: 118 ProducerId: "src_id" SeqNo: 119 CreateTime: 2025-10-15T10:54:25.638000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13101 bytes.. Information: { Offset: 119 ProducerId: "src_id" SeqNo: 120 CreateTime: 2025-10-15T10:54:25.638000Z WriteTime: 2025-10-15T10:54:26.308000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13211 bytes.. Information: { Offset: 120 ProducerId: "src_id" SeqNo: 121 CreateTime: 2025-10-15T10:54:25.711000Z WriteTime: 2025-10-15T10:54:26.309000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13321 bytes.. Information: { Offset: 121 ProducerId: "src_id" SeqNo: 122 CreateTime: 2025-10-15T10:54:25.776000Z WriteTime: 2025-10-15T10:54:26.309000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13431 bytes.. Information: { Offset: 122 ProducerId: "src_id" SeqNo: 123 CreateTime: 2025-10-15T10:54:25.776000Z WriteTime: 2025-10-15T10:54:26.309000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13541 bytes.. Information: { Offset: 123 ProducerId: "src_id" SeqNo: 124 CreateTime: 2025-10-15T10:54:25.776000Z WriteTime: 2025-10-15T10:54:26.309000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13651 bytes.. Information: { Offset: 124 ProducerId: "src_id" SeqNo: 125 CreateTime: 2025-10-15T10:54:25.776000Z WriteTime: 2025-10-15T10:54:26.309000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13761 bytes.. Information: { Offset: 125 ProducerId: "src_id" SeqNo: 126 CreateTime: 2025-10-15T10:54:25.776000Z WriteTime: 2025-10-15T10:54:26.309000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:26.403083Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 20, size 254320 bytes
2025-10-15T10:54:26.403136Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.386965Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.386989Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.387361Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.387588Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.387630Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.387670Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.387730Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.387876Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.389606Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 126 Result { Offset: 106 Data: "... 11743 bytes ..." SourceId: "\000src_id" SeqNo: 107 WriteTimestampMS: 1760525666292 CreateTimestampMS: 1760525665631 UncompressedSize: 11671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 107 Data: "... 11853 bytes ..." SourceId: "\000src_id" SeqNo: 108 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665631 UncompressedSize: 11781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 108 Data: "... 11963 bytes ..." SourceId: "\000src_id" SeqNo: 109 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665631 UncompressedSize: 11891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 109 Data: "... 12073 bytes ..." SourceId: "\000src_id" SeqNo: 110 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665632 UncompressedSize: 12001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 110 Data: "... 12183 bytes ..." SourceId: "\000src_id" SeqNo: 111 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665633 UncompressedSize: 12111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 111 Data: "... 12293 bytes ..." SourceId: "\000src_id" SeqNo: 112 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665633 UncompressedSize: 12221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 112 Data: "... 12403 bytes ..." SourceId: "\000src_id" SeqNo: 113 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665634 UncompressedSize: 12331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 113 Data: "... 12513 bytes ..." SourceId: "\000src_id" SeqNo: 114 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665637 UncompressedSize: 12441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 114 Data: "... 12623 bytes ..." SourceId: "\000src_id" SeqNo: 115 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665637 UncompressedSize: 12551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 115 Data: "... 12733 bytes ..." SourceId: "\000src_id" SeqNo: 116 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665637 UncompressedSize: 12661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 116 Data: "... 12843 bytes ..." SourceId: "\000src_id" SeqNo: 117 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665637 UncompressedSize: 12771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 117 Data: "... 12953 bytes ..." SourceId: "\000src_id" SeqNo: 118 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665637 UncompressedSize: 12881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 118 Data: "... 13063 bytes ..." SourceId: "\000src_id" SeqNo: 119 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665638 UncompressedSize: 12991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 119 Data: "... 13173 bytes ..." SourceId: "\000src_id" SeqNo: 120 WriteTimestampMS: 1760525666308 CreateTimestampMS: 1760525665638 UncompressedSize: 13101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 120 Data: "... 13283 bytes ..." SourceId: "\000src_id" SeqNo: 121 WriteTimestampMS: 1760525666309 CreateTimestampMS: 1760525665711 UncompressedSize: 13211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 121 Data: "... 13393 bytes ..." SourceId: "\000src_id" SeqNo: 122 WriteTimestampMS: 1760525666309 CreateTimestampMS: 1760525665776 UncompressedSize: 13321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 122 Data: "... 13503 bytes ..." SourceId: "\000src_id" SeqNo: 123 WriteTimestampMS: 1760525666309 CreateTimestampMS: 1760525665776 UncompressedSize: 13431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 123 Data: "... 13613 bytes ..." SourceId: "\000src_id" SeqNo: 124 WriteTimestampMS: 1760525666309 CreateTimestampMS: 1760525665776 UncompressedSize: 13541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 124 Data: "... 13723 bytes ..." SourceId: "\000src_id" SeqNo: 125 WriteTimestampMS: 1760525666309 CreateTimestampMS: 1760525665776 UncompressedSize: 13651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 125 Data: "... 13833 bytes ..." SourceId: "\000src_id" SeqNo: 126 WriteTimestampMS: 1760525666309 CreateTimestampMS: 1760525665776 UncompressedSize: 13761 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551070 RealReadOffset: 125 WaitQuotaTimeMs: 0 EndOffset: 126 StartOffset: 0 } Cookie: 106 }
2025-10-15T10:54:26.390456Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 126
2025-10-15T10:54:26.390495Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 126 ReadOffset 126 ReadGuid 858a437d-6d7b334e-a5a6757d-a1e5b2d5 has messages 1
2025-10-15T10:54:26.390664Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 858a437d-6d7b334e-a5a6757d-a1e5b2d5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 255390
2025-10-15T10:54:26.390693Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 858a437d-6d7b334e-a5a6757d-a1e5b2d5
2025-10-15T10:54:26.394237Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:26.394398Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.405982Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 255390 } }
2025-10-15T10:54:26.406144Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 20007148-2c7a37eb-a2925bb5-7c51acfe
2025-10-15T10:54:26.406206Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.406261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.406331Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.406356Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.406384Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.406410Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.407034Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.407095Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.407132Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.407168Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.407203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.408605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.408648Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.408701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 147 partNo : 0 messageNo: 297 size 16144 offset: -1
2025-10-15T10:54:26.408776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.408787Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.408808Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 148 partNo : 0 messageNo: 298 size 16254 offset: -1
2025-10-15T10:54:26.408865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.408878Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.408899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 149 partNo : 0 messageNo: 299 size 16364 offset: -1
2025-10-15T10:54:26.408950Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.408962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.408983Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 150 partNo : 0 messageNo: 300 size 16475 offset: -1
2025-10-15T10:54:26.409033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.409045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.409065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 151 partNo : 0 messageNo: 301 size 16585 offset: -1
2025-10-15T10:54:26.409096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.409106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.409141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.409151Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.409196Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.409205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.409232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.409241Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.409266Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.409275Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.409300Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.409348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.409362Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.409378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.409387Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.409401Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.409411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.409425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.409434Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.409447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.409529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 302  requestId: <none> cookie: 152
2025-10-15T10:54:26.409572Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 303  requestId: <none> cookie: 153
2025-10-15T10:54:26.409587Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 304  requestId: <none> cookie: 154
2025-10-15T10:54:26.409605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 305  requestId: <none> cookie: 155
2025-10-15T10:54:26.409619Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 306  requestId: <none> cookie: 156
2025-10-15T10:54:26.412605Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.412682Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.412739Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.412776Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.412801Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.412833Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.413479Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.413532Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.413569Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.413603Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.413637Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.414345Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.415294Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.415750Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.416227Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.416559Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.416960Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:125:0
2025-10-15T10:54:26.417032Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 867636 MessagesRead: 126 BytesReadCompressed: 867636 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:26.411559Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 126 count 10 size 144583 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.411612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.411661Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 144459 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.411694Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411726Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 127, partNo: 0, Offset: 126 is stored on disk
2025-10-15T10:54:26.411744Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411764Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 128, partNo: 0, Offset: 127 is stored on disk
2025-10-15T10:54:26.411774Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411793Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 129, partNo: 0, Offset: 128 is stored on disk
2025-10-15T10:54:26.411803Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411819Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 130, partNo: 0, Offset: 129 is stored on disk
2025-10-15T10:54:26.411829Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411844Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 131, partNo: 0, Offset: 130 is stored on disk
2025-10-15T10:54:26.411854Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411872Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 132, partNo: 0, Offset: 131 is stored on disk
2025-10-15T10:54:26.411882Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411898Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 133, partNo: 0, Offset: 132 is stored on disk
2025-10-15T10:54:26.411907Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411926Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 134, partNo: 0, Offset: 133 is stored on disk
2025-10-15T10:54:26.411937Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411953Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 135, partNo: 0, Offset: 134 is stored on disk
2025-10-15T10:54:26.411950Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 126 partno 0 count 10 parts 0 suffix '63' size 144583
2025-10-15T10:54:26.411965Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.411983Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 136, partNo: 0, Offset: 135 is stored on disk
2025-10-15T10:54:26.412170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.412232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.412242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:26.412344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 137 partNo 0
2025-10-15T10:54:26.413257Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 137 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 15118 count 1 nextOffset 137 batches 1
2025-10-15T10:54:26.413303Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 138 partNo 0
2025-10-15T10:54:26.413332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 138 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 30314 count 2 nextOffset 138 batches 1
2025-10-15T10:54:26.413352Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 139 partNo 0
2025-10-15T10:54:26.413371Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 139 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 45620 count 3 nextOffset 139 batches 1
2025-10-15T10:54:26.413390Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 140 partNo 0
2025-10-15T10:54:26.413408Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 140 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 61036 count 4 nextOffset 140 batches 1
2025-10-15T10:54:26.413427Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 141 partNo 0
2025-10-15T10:54:26.413449Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 141 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 76562 count 5 nextOffset 141 batches 1
2025-10-15T10:54:26.413467Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 142 partNo 0
2025-10-15T10:54:26.413487Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 142 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 92198 count 6 nextOffset 142 batches 1
2025-10-15T10:54:26.413505Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 143 partNo 0
2025-10-15T10:54:26.413521Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 143 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 107944 count 7 nextOffset 143 batches 1
2025-10-15T10:54:26.413536Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 144 partNo 0
2025-10-15T10:54:26.413554Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 144 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 123800 count 8 nextOffset 144 batches 1
2025-10-15T10:54:26.413573Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 145 partNo 0
2025-10-15T10:54:26.413594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 145 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 139766 count 9 nextOffset 145 batches 1
2025-10-15T10:54:26.413610Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 146 partNo 0
2025-10-15T10:54:26.413629Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 146 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 155842 count 10 nextOffset 146 batches 1
2025-10-15T10:54:26.413647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 147 partNo 0
2025-10-15T10:54:26.413664Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 147 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 172028 count 11 nextOffset 147 batches 1
2025-10-15T10:54:26.413682Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 148 partNo 0
2025-10-15T10:54:26.413743Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 148 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 188324 count 12 nextOffset 148 batches 1
2025-10-15T10:54:26.413765Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 149 partNo 0
2025-10-15T10:54:26.413784Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 149 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 204730 count 13 nextOffset 149 batches 1
2025-10-15T10:54:26.413801Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 150 partNo 0
2025-10-15T10:54:26.413819Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 150 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 221247 count 14 nextOffset 150 batches 1
2025-10-15T10:54:26.413839Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 151 partNo 0
2025-10-15T10:54:26.413857Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 151 partNo 0 FormedBlobsCount 0 NewHead: Offset 136 PartNo 0 PackedSize 237874 count 15 nextOffset 151 batches 1
2025-10-15T10:54:26.413872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.415004Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 136,15 HeadOffset 136 endOffset 136 curOffset 151 d0000000000_00000000000000000136_00000_0000000015_00000? size 237460 WTime 1760525666414
2025-10-15T10:54:26.415342Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.415428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 257  requestId: <none> cookie: 127
2025-10-15T10:54:26.415492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 258  requestId: <none> cookie: 128
2025-10-15T10:54:26.415519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 259  requestId: <none> cookie: 129
2025-10-15T10:54:26.415542Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 260  requestId: <none> cookie: 130
2025-10-15T10:54:26.415562Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 261  requestId: <none> cookie: 131
2025-10-15T10:54:26.415583Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 267  requestId: <none> cookie: 132
2025-10-15T10:54:26.415607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 268  requestId: <none> cookie: 133
2025-10-15T10:54:26.415640Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 269  requestId: <none> cookie: 134
2025-10-15T10:54:26.415668Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 270  requestId: <none> cookie: 135
2025-10-15T10:54:26.415692Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 271  requestId: <none> cookie: 136
2025-10-15T10:54:26.415719Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.415809Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 136 partNo 0 count 15 size 237460
2025-10-15T10:54:26.421299Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 126 EndOffset 126 newEndOffset 136 commitOffset 0 clientCommitOffset 0 cookie 11 readingFinished 0 firstRead 0
2025-10-15T10:54:26.421339Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 126 endOffset 136
2025-10-15T10:54:26.421401Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.421468Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.421490Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.421521Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.421552Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.421581Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.421610Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.421638Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.421664Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.421708Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.421736Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.422596Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 126, endOffset# 136, WTime# 1760525666309, sizeLag# 144583
2025-10-15T10:54:26.422617Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:26.422665Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# e77ff554-2142006f-1263ab5b-4cd7bf17, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 173499, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:26.422729Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 173499 maxTimeLagMs 0 readTimestampMs 0 readOffset 126 EndOffset 136 ClientCommitOffset 0 committedOffset 0 Guid e77ff554-2142006f-1263ab5b-4cd7bf17
2025-10-15T10:54:26.424043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 127 offsets: 126 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 36 }
2025-10-15T10:54:26.424086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 127
2025-10-15T10:54:26.424300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 128 offsets: 127 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 36 }
2025-10-15T10:54:26.424327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 128
2025-10-15T10:54:26.424451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 129 offsets: 128 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 36 }
2025-10-15T10:54:26.424472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 129
2025-10-15T10:54:26.424579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 130 offsets: 129 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 36 }
2025-10-15T10:54:26.424600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 130
2025-10-15T10:54:26.424712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 131 offsets: 130 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 36 }
2025-10-15T10:54:26.424734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 131
2025-10-15T10:54:26.424578Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.425105Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.425614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 132 offsets: 131 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:26.425648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 132
2025-10-15T10:54:26.425789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 133 offsets: 132 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:26.425810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 133
2025-10-15T10:54:26.425908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 134 offsets: 133 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:26.425927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 134
2025-10-15T10:54:26.426064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 135 offsets: 134 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:26.426089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 135
2025-10-15T10:54:26.426190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 136 offsets: 135 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:26.426216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 136
2025-10-15T10:54:26.428369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.428414Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.428467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 152 partNo : 0 messageNo: 307 size 16695 offset: -1
2025-10-15T10:54:26.428585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.428599Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.428622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 153 partNo : 0 messageNo: 308 size 16805 offset: -1
2025-10-15T10:54:26.428701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.428714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.428735Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 154 partNo : 0 messageNo: 309 size 16915 offset: -1
2025-10-15T10:54:26.428825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.428836Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.428856Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 155 partNo : 0 messageNo: 310 size 17025 offset: -1
2025-10-15T10:54:26.428933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.428944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.428963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 156 partNo : 0 messageNo: 311 size 17135 offset: -1
2025-10-15T10:54:26.428993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.429002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.429029Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.429038Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.429064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.429072Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.429098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.429107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.429130Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.429139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.429245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.429256Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.429311Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.429358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.429370Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.429384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.429392Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.429408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.429417Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.433515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.433590Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.433618Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.433644Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.433671Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.434347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.434408Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.434605Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.434643Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.434678Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.429428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.429436Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.429449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.429926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 312  requestId: <none> cookie: 157
2025-10-15T10:54:26.429964Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 313  requestId: <none> cookie: 158
2025-10-15T10:54:26.429983Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 314  requestId: <none> cookie: 159
2025-10-15T10:54:26.429999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 315  requestId: <none> cookie: 160
2025-10-15T10:54:26.430014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 316  requestId: <none> cookie: 161
2025-10-15T10:54:26.430071Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 126 count 12 size 173499 endOffset 136 max time lag 0ms effective offset 126
2025-10-15T10:54:26.430239Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 1 blobs, size 144583 count 10 last offset 126, current partition end offset: 136
2025-10-15T10:54:26.430253Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-15T10:54:26.430305Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 126 partno 0 count 10 parts_count 0 source 1 size 144583 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:26.430328Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 14. All 1 blobs are from cache.
2025-10-15T10:54:26.430376Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:26.431215Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 126 totakecount 10 count 10 size 144561 from pos 0 cbcount 10
2025-10-15T10:54:26.432197Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 126 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:26.437451Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.438040Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.438408Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.439440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 126
2025-10-15T10:54:26.439799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.439830Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.439883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 157 partNo : 0 messageNo: 317 size 17245 offset: -1
2025-10-15T10:54:26.439975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.439987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.440007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 158 partNo : 0 messageNo: 318 size 17355 offset: -1
2025-10-15T10:54:26.440088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.440100Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.440120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 159 partNo : 0 messageNo: 319 size 17465 offset: -1
2025-10-15T10:54:26.440201Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.440211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.440232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 160 partNo : 0 messageNo: 320 size 17575 offset: -1
2025-10-15T10:54:26.440332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.440344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.440366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 161 partNo : 0 messageNo: 321 size 17685 offset: -1
2025-10-15T10:54:26.440398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.440408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.440437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.440446Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.440470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.440479Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.440501Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.440510Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.440541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.440550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.440894Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.440943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.440956Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.440972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.440981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.440993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.441002Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.441016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.441027Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.441038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.441145Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 136 count 15 size 237460 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.441191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 322  requestId: <none> cookie: 162
2025-10-15T10:54:26.441213Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 323  requestId: <none> cookie: 163
2025-10-15T10:54:26.441229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 324  requestId: <none> cookie: 164
2025-10-15T10:54:26.441247Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 325  requestId: <none> cookie: 165
2025-10-15T10:54:26.441264Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 326  requestId: <none> cookie: 166
2025-10-15T10:54:26.441283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.441330Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 237317 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.441362Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441388Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 137, partNo: 0, Offset: 136 is stored on disk
2025-10-15T10:54:26.441404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441426Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 138, partNo: 0, Offset: 137 is stored on disk
2025-10-15T10:54:26.441436Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441452Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 139, partNo: 0, Offset: 138 is stored on disk
2025-10-15T10:54:26.441463Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441478Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 140, partNo: 0, Offset: 139 is stored on disk
2025-10-15T10:54:26.441489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441503Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 141, partNo: 0, Offset: 140 is stored on disk
2025-10-15T10:54:26.441513Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441532Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 142, partNo: 0, Offset: 141 is stored on disk
2025-10-15T10:54:26.441544Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441559Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 143, partNo: 0, Offset: 142 is stored on disk
2025-10-15T10:54:26.441568Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441582Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 144, partNo: 0, Offset: 143 is stored on disk
2025-10-15T10:54:26.441593Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441608Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 145, partNo: 0, Offset: 144 is stored on disk
2025-10-15T10:54:26.441618Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441634Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 146, partNo: 0, Offset: 145 is stored on disk
2025-10-15T10:54:26.441644Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441662Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 147, partNo: 0, Offset: 146 is stored on disk
2025-10-15T10:54:26.441672Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441687Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 148, partNo: 0, Offset: 147 is stored on disk
2025-10-15T10:54:26.441713Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441729Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 149, partNo: 0, Offset: 148 is stored on disk
2025-10-15T10:54:26.441739Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441753Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 150, partNo: 0, Offset: 149 is stored on disk
2025-10-15T10:54:26.441764Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.441779Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 151, partNo: 0, Offset: 150 is stored on disk
2025-10-15T10:54:26.441950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.442000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.442010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:26.442096Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 152 partNo 0
2025-10-15T10:54:26.443552Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 136 partno 0 count 15 parts 0 suffix '63' size 237460
2025-10-15T10:54:26.446595Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 136 Result { Offset: 126 Data: "... 13943 bytes ..." SourceId: "\000src_id" SeqNo: 127 WriteTimestampMS: 1760525666350 CreateTimestampMS: 1760525665776 UncompressedSize: 13871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 127 Data: "... 14054 bytes ..." SourceId: "\000src_id" SeqNo: 128 WriteTimestampMS: 1760525666364 CreateTimestampMS: 1760525665776 UncompressedSize: 13981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 128 Data: "... 14164 bytes ..." SourceId: "\000src_id" SeqNo: 129 WriteTimestampMS: 1760525666364 CreateTimestampMS: 1760525665777 UncompressedSize: 14091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 129 Data: "... 14274 bytes ..." SourceId: "\000src_id" SeqNo: 130 WriteTimestampMS: 1760525666364 CreateTimestampMS: 1760525665777 UncompressedSize: 14201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 130 Data: "... 14384 bytes ..." SourceId: "\000src_id" SeqNo: 131 WriteTimestampMS: 1760525666364 CreateTimestampMS: 1760525665777 UncompressedSize: 14311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 131 Data: "... 14494 bytes ..." SourceId: "\000src_id" SeqNo: 132 WriteTimestampMS: 1760525666364 CreateTimestampMS: 1760525665777 UncompressedSize: 14421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 132 Data: "... 14604 bytes ..." SourceId: "\000src_id" SeqNo: 133 WriteTimestampMS: 1760525666364 CreateTimestampMS: 1760525665777 UncompressedSize: 14531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 133 Data: "... 14714 bytes ..." SourceId: "\000src_id" SeqNo: 134 WriteTimestampMS: 1760525666364 CreateTimestampMS: 1760525665777 UncompressedSize: 14641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 134 Data: "... 14824 bytes ..." SourceId: "\000src_id" SeqNo: 135 WriteTimestampMS: 1760525666364 CreateTimestampMS: 1760525665778 UncompressedSize: 14751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 135 Data: "... 14934 bytes ..." SourceId: "\000src_id" SeqNo: 136 WriteTimestampMS: 1760525666364 CreateTimestampMS: 1760525665778 UncompressedSize: 14861 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551390 RealReadOffset: 135 WaitQuotaTimeMs: 0 EndOffset: 136 StartOffset: 0 } Cookie: 126 }
2025-10-15T10:54:26.447140Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 12 from offset 136
2025-10-15T10:54:26.447182Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 136 ReadOffset 136 ReadGuid e77ff554-2142006f-1263ab5b-4cd7bf17 has messages 1
2025-10-15T10:54:26.447369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.447425Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.447451Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.447478Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.447506Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.448030Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.448266Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.448307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.448345Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.451269Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 144278, now ReadSizeBudget = 0, ReadSizeServerDelta = 380010
2025-10-15T10:54:26.448381Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.448599Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# e77ff554-2142006f-1263ab5b-4cd7bf17, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 144278
2025-10-15T10:54:26.448631Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# e77ff554-2142006f-1263ab5b-4cd7bf17
2025-10-15T10:54:26.449123Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:26.451421Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 380010
2025-10-15T10:54:26.451813Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (126-135)
2025-10-15T10:54:26.451854Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 144278 to budget
2025-10-15T10:54:26.451883Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 144278, ReadSizeServerDelta = 380010
2025-10-15T10:54:26.452079Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:26.452178Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (126-126)
2025-10-15T10:54:26.452251Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (127-127)
2025-10-15T10:54:26.452375Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (128-128)
2025-10-15T10:54:26.452424Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (129-129)
2025-10-15T10:54:26.452566Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (130-130)
2025-10-15T10:54:26.452620Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (131-131)
2025-10-15T10:54:26.452672Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (132-132)
2025-10-15T10:54:26.452722Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (133-133)
2025-10-15T10:54:26.452994Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (134-134)
2025-10-15T10:54:26.453051Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (135-135)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..13871 bytes.. Information: { Offset: 126 ProducerId: "src_id" SeqNo: 127 CreateTime: 2025-10-15T10:54:25.776000Z WriteTime: 2025-10-15T10:54:26.350000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..13981 bytes.. Information: { Offset: 127 ProducerId: "src_id" SeqNo: 128 CreateTime: 2025-10-15T10:54:25.776000Z WriteTime: 2025-10-15T10:54:26.364000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14091 bytes.. Information: { Offset: 128 ProducerId: "src_id" SeqNo: 129 CreateTime: 2025-10-15T10:54:25.777000Z WriteTime: 2025-10-15T10:54:26.364000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14201 bytes.. Information: { Offset: 129 ProducerId: "src_id" SeqNo: 130 CreateTime: 2025-10-15T10:54:25.777000Z WriteTime: 2025-10-15T10:54:26.364000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14311 bytes.. Information: { Offset: 130 ProducerId: "src_id" SeqNo: 131 CreateTime: 2025-10-15T10:54:25.777000Z WriteTime: 2025-10-15T10:54:26.364000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14421 bytes.. Information: { Offset: 131 ProducerId: "src_id" SeqNo: 132 CreateTime: 2025-10-15T10:54:25.777000Z WriteTime: 2025-10-15T10:54:26.364000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14531 bytes.. Information: { Offset: 132 ProducerId: "src_id" SeqNo: 133 CreateTime: 2025-10-15T10:54:25.777000Z WriteTime: 2025-10-15T10:54:26.364000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14641 bytes.. Information: { Offset: 133 ProducerId: "src_id" SeqNo: 134 CreateTime: 2025-10-15T10:54:25.777000Z WriteTime: 2025-10-15T10:54:26.364000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14751 bytes.. Information: { Offset: 134 ProducerId: "src_id" SeqNo: 135 CreateTime: 2025-10-15T10:54:25.778000Z WriteTime: 2025-10-15T10:54:26.364000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..14861 bytes.. Information: { Offset: 135 ProducerId: "src_id" SeqNo: 136 CreateTime: 2025-10-15T10:54:25.778000Z WriteTime: 2025-10-15T10:54:26.364000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:26.454687Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 10, size 143660 bytes
2025-10-15T10:54:26.454735Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.459464Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.459957Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 144278 } }
2025-10-15T10:54:26.460090Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 13e2eb40-4abe8a56-2030b98a-1f6785d0
2025-10-15T10:54:26.460853Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.461173Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.461415Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.467796Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:54:26.467873Z :INFO: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1016 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:26.475547Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:54:26.475623Z :INFO: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:26.567625Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 152 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 16769 count 1 nextOffset 152 batches 1
2025-10-15T10:54:26.567721Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 153 partNo 0
2025-10-15T10:54:26.567765Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 153 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 33616 count 2 nextOffset 153 batches 1
2025-10-15T10:54:26.567788Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 154 partNo 0
2025-10-15T10:54:26.567808Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 154 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 50573 count 3 nextOffset 154 batches 1
2025-10-15T10:54:26.567830Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 155 partNo 0
2025-10-15T10:54:26.567849Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 155 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 67640 count 4 nextOffset 155 batches 1
2025-10-15T10:54:26.567868Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 156 partNo 0
2025-10-15T10:54:26.567893Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 156 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 84817 count 5 nextOffset 156 batches 1
2025-10-15T10:54:26.567913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 157 partNo 0
2025-10-15T10:54:26.567932Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 157 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 102104 count 6 nextOffset 157 batches 1
2025-10-15T10:54:26.567949Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 158 partNo 0
2025-10-15T10:54:26.567966Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 158 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 119501 count 7 nextOffset 158 batches 1
2025-10-15T10:54:26.567985Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 159 partNo 0
2025-10-15T10:54:26.568002Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 159 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 137008 count 8 nextOffset 159 batches 1
2025-10-15T10:54:26.568019Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 160 partNo 0
2025-10-15T10:54:26.568041Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 160 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 154625 count 9 nextOffset 160 batches 1
2025-10-15T10:54:26.568061Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 161 partNo 0
2025-10-15T10:54:26.568079Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 161 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 172352 count 10 nextOffset 161 batches 1
2025-10-15T10:54:26.568096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.569163Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 151,10 HeadOffset 151 endOffset 151 curOffset 161 d0000000000_00000000000000000151_00000_0000000010_00000? size 172106 WTime 1760525666568
2025-10-15T10:54:26.569477Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.569791Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 277  requestId: <none> cookie: 137
2025-10-15T10:54:26.569861Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 278  requestId: <none> cookie: 138
2025-10-15T10:54:26.569884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 279  requestId: <none> cookie: 139
2025-10-15T10:54:26.569908Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 280  requestId: <none> cookie: 140
2025-10-15T10:54:26.569931Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 281  requestId: <none> cookie: 141
2025-10-15T10:54:26.569954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 287  requestId: <none> cookie: 142
2025-10-15T10:54:26.569978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 288  requestId: <none> cookie: 143
2025-10-15T10:54:26.569999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 289  requestId: <none> cookie: 144
2025-10-15T10:54:26.570020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 290  requestId: <none> cookie: 145
2025-10-15T10:54:26.570043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 291  requestId: <none> cookie: 146
2025-10-15T10:54:26.570066Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 297  requestId: <none> cookie: 147
2025-10-15T10:54:26.570087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 298  requestId: <none> cookie: 148
2025-10-15T10:54:26.570107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 299  requestId: <none> cookie: 149
2025-10-15T10:54:26.570130Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 300  requestId: <none> cookie: 150
2025-10-15T10:54:26.570154Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 301  requestId: <none> cookie: 151
2025-10-15T10:54:26.570278Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570357Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 162 partNo : 0 messageNo: 327 size 17795 offset: -1
2025-10-15T10:54:26.570420Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 163 partNo : 0 messageNo: 328 size 17905 offset: -1
2025-10-15T10:54:26.570509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570522Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570545Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 164 partNo : 0 messageNo: 329 size 18015 offset: -1
2025-10-15T10:54:26.570598Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570612Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570634Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 165 partNo : 0 messageNo: 330 size 18125 offset: -1
2025-10-15T10:54:26.570680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570691Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 166 partNo : 0 messageNo: 331 size 18235 offset: -1
2025-10-15T10:54:26.570739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570777Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570787Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570811Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570819Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.570891Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.570922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.570941Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.571039Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 151 partNo 0 count 10 size 172106
2025-10-15T10:54:26.571101Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.571141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.571153Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.571169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.571181Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.571200Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.571212Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.571226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.571236Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.571251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.573254Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573339Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573422Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573449Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573501Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573523Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573548Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573572Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573598Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573623Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573653Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573679Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.573734Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.574558Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 136 EndOffset 136 newEndOffset 151 commitOffset 0 clientCommitOffset 0 cookie 12 readingFinished 0 firstRead 0
2025-10-15T10:54:26.574582Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 136 endOffset 151
2025-10-15T10:54:26.574624Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 136, endOffset# 151, WTime# 1760525666364, sizeLag# 237460
2025-10-15T10:54:26.574639Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:26.574688Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# dbf1ccb5-6931857d-35e7acb9-225a0a84, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 284952, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:26.574738Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 284952 maxTimeLagMs 0 readTimestampMs 0 readOffset 136 EndOffset 151 ClientCommitOffset 0 committedOffset 0 Guid dbf1ccb5-6931857d-35e7acb9-225a0a84
2025-10-15T10:54:26.575894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 137 offsets: 136 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:26.575950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 137
2025-10-15T10:54:26.576137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 138 offsets: 137 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:26.576162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 138
2025-10-15T10:54:26.576284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 139 offsets: 138 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:26.576309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 139
2025-10-15T10:54:26.576416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 140 offsets: 139 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:26.576452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 140
2025-10-15T10:54:26.576769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 141 offsets: 140 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:26.576797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 141
2025-10-15T10:54:26.576908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 142 offsets: 141 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:26.576931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 142
2025-10-15T10:54:26.577026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 143 offsets: 142 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:26.577047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 143
2025-10-15T10:54:26.577156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 144 offsets: 143 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:26.577173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 144
2025-10-15T10:54:26.577256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 145 offsets: 144 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:26.577277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 145
2025-10-15T10:54:26.577359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 146 offsets: 145 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:26.577376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 146
2025-10-15T10:54:26.577465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 147 offsets: 146 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.577484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 147
2025-10-15T10:54:26.577597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 148 offsets: 147 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.577613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 148
2025-10-15T10:54:26.577711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 149 offsets: 148 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.577731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 149
2025-10-15T10:54:26.577822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 150 offsets: 149 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.577840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 150
2025-10-15T10:54:26.577930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 151 offsets: 150 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:26.577948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 151
2025-10-15T10:54:26.583486Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:26.591625Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 332  requestId: <none> cookie: 167
2025-10-15T10:54:26.591697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 333  requestId: <none> cookie: 168
2025-10-15T10:54:26.591720Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 334  requestId: <none> cookie: 169
2025-10-15T10:54:26.591745Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 335  requestId: <none> cookie: 170
2025-10-15T10:54:26.591765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 336  requestId: <none> cookie: 171
2025-10-15T10:54:26.591892Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.591921Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.592059Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 136 count 18 size 284952 endOffset 151 max time lag 0ms effective offset 136
2025-10-15T10:54:26.592243Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 1 blobs, size 237460 count 15 last offset 136, current partition end offset: 151
2025-10-15T10:54:26.592258Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-10-15T10:54:26.592309Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 136 partno 0 count 15 parts_count 0 source 1 size 237460 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:26.592330Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 15. All 1 blobs are from cache.
2025-10-15T10:54:26.592380Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:26.593262Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 136 totakecount 15 count 15 size 237437 from pos 0 cbcount 15
2025-10-15T10:54:26.593483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 136
2025-10-15T10:54:26.594273Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 136 partno 0 count 15 parts 0 suffix '63'
2025-10-15T10:54:26.608598Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 151 count 10 size 172106 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.608659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.608713Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 171970 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.608745Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.608781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 152, partNo: 0, Offset: 151 is stored on disk
2025-10-15T10:54:26.608800Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.608820Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 153, partNo: 0, Offset: 152 is stored on disk
2025-10-15T10:54:26.608832Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.608853Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 154, partNo: 0, Offset: 153 is stored on disk
2025-10-15T10:54:26.608868Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.608890Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 155, partNo: 0, Offset: 154 is stored on disk
2025-10-15T10:54:26.608900Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.608918Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 156, partNo: 0, Offset: 155 is stored on disk
2025-10-15T10:54:26.608929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.608948Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 157, partNo: 0, Offset: 156 is stored on disk
2025-10-15T10:54:26.608959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.608978Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 158, partNo: 0, Offset: 157 is stored on disk
2025-10-15T10:54:26.608989Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.609010Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 159, partNo: 0, Offset: 158 is stored on disk
2025-10-15T10:54:26.609021Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.609041Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 160, partNo: 0, Offset: 159 is stored on disk
2025-10-15T10:54:26.609054Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.609072Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 161, partNo: 0, Offset: 160 is stored on disk
2025-10-15T10:54:26.609237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.609279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.609289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T10:54:26.609381Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 162 partNo 0
2025-10-15T10:54:26.610283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 162 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 17869 count 1 nextOffset 162 batches 1
2025-10-15T10:54:26.610334Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 163 partNo 0
2025-10-15T10:54:26.610366Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 163 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 35816 count 2 nextOffset 163 batches 1
2025-10-15T10:54:26.610388Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 164 partNo 0
2025-10-15T10:54:26.610409Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 164 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 53873 count 3 nextOffset 164 batches 1
2025-10-15T10:54:26.610432Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 165 partNo 0
2025-10-15T10:54:26.610450Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 165 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 72040 count 4 nextOffset 165 batches 1
2025-10-15T10:54:26.610470Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 166 partNo 0
2025-10-15T10:54:26.610493Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 166 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 90317 count 5 nextOffset 166 batches 1
2025-10-15T10:54:26.610509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.611262Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 161,5 HeadOffset 161 endOffset 161 curOffset 166 d0000000000_00000000000000000161_00000_0000000005_00000? size 90226 WTime 1760525666611
2025-10-15T10:54:26.612709Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 151 partno 0 count 10 parts 0 suffix '63' size 172106
2025-10-15T10:54:26.619549Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.619653Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 307  requestId: <none> cookie: 152
2025-10-15T10:54:26.619720Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 308  requestId: <none> cookie: 153
2025-10-15T10:54:26.619746Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 309  requestId: <none> cookie: 154
2025-10-15T10:54:26.619769Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 310  requestId: <none> cookie: 155
2025-10-15T10:54:26.619794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 311  requestId: <none> cookie: 156
2025-10-15T10:54:26.619820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 317  requestId: <none> cookie: 157
2025-10-15T10:54:26.619845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 318  requestId: <none> cookie: 158
2025-10-15T10:54:26.619871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 319  requestId: <none> cookie: 159
2025-10-15T10:54:26.619894Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 320  requestId: <none> cookie: 160
2025-10-15T10:54:26.619919Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 321  requestId: <none> cookie: 161
2025-10-15T10:54:26.619947Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.620055Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 161 partNo 0 count 5 size 90226
2025-10-15T10:54:26.640774Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 161 count 5 size 90226 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:26.640836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:26.640889Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 90110 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:26.640923Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.640955Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 162, partNo: 0, Offset: 161 is stored on disk
2025-10-15T10:54:26.640975Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.640996Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 163, partNo: 0, Offset: 162 is stored on disk
2025-10-15T10:54:26.641008Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.641030Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 164, partNo: 0, Offset: 163 is stored on disk
2025-10-15T10:54:26.641043Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.641062Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 165, partNo: 0, Offset: 164 is stored on disk
2025-10-15T10:54:26.641075Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:26.641095Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 166, partNo: 0, Offset: 165 is stored on disk
2025-10-15T10:54:26.641274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.641288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.641300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.641335Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:26.641383Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 327  requestId: <none> cookie: 162
2025-10-15T10:54:26.641438Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 328  requestId: <none> cookie: 163
2025-10-15T10:54:26.641461Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 329  requestId: <none> cookie: 164
2025-10-15T10:54:26.641483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 330  requestId: <none> cookie: 165
2025-10-15T10:54:26.641506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 331  requestId: <none> cookie: 166
2025-10-15T10:54:26.642066Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 161 partno 0 count 5 parts 0 suffix '63' size 90226
2025-10-15T10:54:26.679470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.679505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.679518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.706277Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706390Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706427Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706504Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706536Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706612Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706638Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706671Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706697Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706745Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706822Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706852Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706884Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706921Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706947Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.706978Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.707005Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:26.708810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.708850Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.708903Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 167 partNo : 0 messageNo: 337 size 18345 offset: -1
2025-10-15T10:54:26.709009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.709026Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.709052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 168 partNo : 0 messageNo: 338 size 18455 offset: -1
2025-10-15T10:54:26.709141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.709156Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.709180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 169 partNo : 0 messageNo: 339 size 18565 offset: -1
2025-10-15T10:54:26.709207Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.709252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.709274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.709285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:26.709418Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 167 partNo 0
2025-10-15T10:54:26.715759Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.716024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.716067Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.716105Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.716143Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:26.717954Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 151 Result { Offset: 136 Data: "... 15044 bytes ..." SourceId: "\000src_id" SeqNo: 137 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665778 UncompressedSize: 14971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 137 Data: "... 15154 bytes ..." SourceId: "\000src_id" SeqNo: 138 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665778 UncompressedSize: 15081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 138 Data: "... 15264 bytes ..." SourceId: "\000src_id" SeqNo: 139 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665778 UncompressedSize: 15191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 139 Data: "... 15374 bytes ..." SourceId: "\000src_id" SeqNo: 140 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665778 UncompressedSize: 15301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 140 Data: "... 15484 bytes ..." SourceId: "\000src_id" SeqNo: 141 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665778 UncompressedSize: 15411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 141 Data: "... 15594 bytes ..." SourceId: "\000src_id" SeqNo: 142 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665779 UncompressedSize: 15521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 142 Data: "... 15704 bytes ..." SourceId: "\000src_id" SeqNo: 143 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665779 UncompressedSize: 15631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 143 Data: "... 15814 bytes ..." SourceId: "\000src_id" SeqNo: 144 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665779 UncompressedSize: 15741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 144 Data: "... 15924 bytes ..." SourceId: "\000src_id" SeqNo: 145 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665781 UncompressedSize: 15851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 145 Data: "... 16034 bytes ..." SourceId: "\000src_id" SeqNo: 146 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665781 UncompressedSize: 15961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 146 Data: "... 16144 bytes ..." SourceId: "\000src_id" SeqNo: 147 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665781 UncompressedSize: 16071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 147 Data: "... 16254 bytes ..." SourceId: "\000src_id" SeqNo: 148 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665781 UncompressedSize: 16181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 148 Data: "... 16364 bytes ..." SourceId: "\000src_id" SeqNo: 149 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665782 UncompressedSize: 16291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 149 Data: "... 16475 bytes ..." SourceId: "\000src_id" SeqNo: 150 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665782 UncompressedSize: 16401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 150 Data: "... 16585 bytes ..." SourceId: "\000src_id" SeqNo: 151 WriteTimestampMS: 1760525666412 CreateTimestampMS: 1760525665782 UncompressedSize: 16511 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551234 RealReadOffset: 150 WaitQuotaTimeMs: 0 EndOffset: 151 StartOffset: 0 } Cookie: 136 }
2025-10-15T10:54:26.718684Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 13 from offset 151
2025-10-15T10:54:26.718731Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 151 ReadOffset 151 ReadGuid dbf1ccb5-6931857d-35e7acb9-225a0a84 has messages 1
2025-10-15T10:54:26.719727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 152 offsets: 151 already_written: false write_statistics { persist_duration_ms: 45 queued_in_partition_duration_ms: 139 }
2025-10-15T10:54:26.719772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 152
2025-10-15T10:54:26.736277Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.736608Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# dbf1ccb5-6931857d-35e7acb9-225a0a84, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 236809
2025-10-15T10:54:26.736643Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# dbf1ccb5-6931857d-35e7acb9-225a0a84
2025-10-15T10:54:26.737091Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:26.740607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 153 offsets: 152 already_written: false write_statistics { persist_duration_ms: 45 queued_in_partition_duration_ms: 139 }
2025-10-15T10:54:26.740652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 153
2025-10-15T10:54:26.740816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 154 offsets: 153 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 144 }
2025-10-15T10:54:26.740839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 154
2025-10-15T10:54:26.740945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 155 offsets: 154 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 144 }
2025-10-15T10:54:26.740965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 155
2025-10-15T10:54:26.741057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 156 offsets: 155 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 144 }
2025-10-15T10:54:26.741077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 156
2025-10-15T10:54:26.741166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 157 offsets: 156 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 128 }
2025-10-15T10:54:26.741185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 157
2025-10-15T10:54:26.741279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 158 offsets: 157 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 128 }
2025-10-15T10:54:26.741298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 158
2025-10-15T10:54:26.741392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 159 offsets: 158 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 128 }
2025-10-15T10:54:26.741409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 159
2025-10-15T10:54:26.741495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 160 offsets: 159 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 128 }
2025-10-15T10:54:26.741514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 160
2025-10-15T10:54:26.741605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 161 offsets: 160 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 128 }
2025-10-15T10:54:26.741624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 161
2025-10-15T10:54:26.741736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 162 offsets: 161 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:26.741755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 162
2025-10-15T10:54:26.741841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 163 offsets: 162 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:26.741859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 163
2025-10-15T10:54:26.741950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 164 offsets: 163 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:26.741971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 164
2025-10-15T10:54:26.742062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 165 offsets: 164 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:26.742080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 165
2025-10-15T10:54:26.742165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 166 offsets: 165 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:26.742188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 166
2025-10-15T10:54:26.742957Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 236809, now ReadSizeBudget = 0, ReadSizeServerDelta = 287479
2025-10-15T10:54:26.743085Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 287479
2025-10-15T10:54:26.743226Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (136-150)
2025-10-15T10:54:26.743260Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 236809 to budget
2025-10-15T10:54:26.743295Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 236809, ReadSizeServerDelta = 287479
2025-10-15T10:54:26.743526Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:26.743630Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (136-136)
2025-10-15T10:54:26.743721Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (137-137)
2025-10-15T10:54:26.743846Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (138-138)
2025-10-15T10:54:26.743900Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (139-139)
2025-10-15T10:54:26.744095Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (140-140)
2025-10-15T10:54:26.744156Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (141-141)
2025-10-15T10:54:26.744222Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (142-142)
2025-10-15T10:54:26.744284Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (143-143)
2025-10-15T10:54:26.744567Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (144-144)
2025-10-15T10:54:26.744655Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (145-145)
2025-10-15T10:54:26.744719Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (146-146)
2025-10-15T10:54:26.744790Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (147-147)
2025-10-15T10:54:26.744856Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (148-148)
2025-10-15T10:54:26.744926Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (149-149)
2025-10-15T10:54:26.744990Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (150-150)
2025-10-15T10:54:26.749583Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:26.750413Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..14971 bytes.. Information: { Offset: 136 ProducerId: "src_id" SeqNo: 137 CreateTime: 2025-10-15T10:54:25.778000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15081 bytes.. Information: { Offset: 137 ProducerId: "src_id" SeqNo: 138 CreateTime: 2025-10-15T10:54:25.778000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15191 bytes.. Information: { Offset: 138 ProducerId: "src_id" SeqNo: 139 CreateTime: 2025-10-15T10:54:25.778000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15301 bytes.. Information: { Offset: 139 ProducerId: "src_id" SeqNo: 140 CreateTime: 2025-10-15T10:54:25.778000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15411 bytes.. Information: { Offset: 140 ProducerId: "src_id" SeqNo: 141 CreateTime: 2025-10-15T10:54:25.778000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15521 bytes.. Information: { Offset: 141 ProducerId: "src_id" SeqNo: 142 CreateTime: 2025-10-15T10:54:25.779000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15631 bytes.. Information: { Offset: 142 ProducerId: "src_id" SeqNo: 143 CreateTime: 2025-10-15T10:54:25.779000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15741 bytes.. Information: { Offset: 143 ProducerId: "src_id" SeqNo: 144 CreateTime: 2025-10-15T10:54:25.779000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15851 bytes.. Information: { Offset: 144 ProducerId: "src_id" SeqNo: 145 CreateTime: 2025-10-15T10:54:25.781000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..15961 bytes.. Information: { Offset: 145 ProducerId: "src_id" SeqNo: 146 CreateTime: 2025-10-15T10:54:25.781000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16071 bytes.. Information: { Offset: 146 ProducerId: "src_id" SeqNo: 147 CreateTime: 2025-10-15T10:54:25.781000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16181 bytes.. Information: { Offset: 147 ProducerId: "src_id" SeqNo: 148 CreateTime: 2025-10-15T10:54:25.781000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16291 bytes.. Information: { Offset: 148 ProducerId: "src_id" SeqNo: 149 CreateTime: 2025-10-15T10:54:25.782000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16401 bytes.. Information: { Offset: 149 ProducerId: "src_id" SeqNo: 150 CreateTime: 2025-10-15T10:54:25.782000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16511 bytes.. Information: { Offset: 150 ProducerId: "src_id" SeqNo: 151 CreateTime: 2025-10-15T10:54:25.782000Z WriteTime: 2025-10-15T10:54:26.412000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:26.764371Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 15, size 236115 bytes
2025-10-15T10:54:26.764426Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:26.945838Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 167 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 18419 count 1 nextOffset 167 batches 1
2025-10-15T10:54:26.959661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.960258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 166,1 HeadOffset 166 endOffset 166 curOffset 167 d0000000000_00000000000000000166_00000_0000000001_00000? size 18410 WTime 1760525666958
2025-10-15T10:54:26.960466Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.960510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.960527Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.960544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.960636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.960660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.960719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 170 partNo : 0 messageNo: 340 size 18675 offset: -1
2025-10-15T10:54:26.960790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.960802Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.960821Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 171 partNo : 0 messageNo: 341 size 18785 offset: -1
2025-10-15T10:54:26.960873Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.960884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.960920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.960930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.960958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.960970Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.961002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.961013Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.961039Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:26.961052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:26.961081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.961102Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:26.961207Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 166 partNo 0 count 1 size 18410
2025-10-15T10:54:26.961241Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.961265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.961278Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:26.961291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:26.961511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 342  requestId: <none> cookie: 172
2025-10-15T10:54:26.961548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 343  requestId: <none> cookie: 173
2025-10-15T10:54:26.961567Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 344  requestId: <none> cookie: 174
2025-10-15T10:54:26.961586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 345  requestId: <none> cookie: 175
2025-10-15T10:54:26.961605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 346  requestId: <none> cookie: 176
2025-10-15T10:54:27.002493Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 166 count 1 size 18410 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.002562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.002617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 18352 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.002653Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.002700Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 167, partNo: 0, Offset: 166 is stored on disk
2025-10-15T10:54:27.002876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.002914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.002924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-15T10:54:27.003013Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 168 partNo 0
2025-10-15T10:54:27.003476Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 166 partno 0 count 1 parts 0 suffix '63' size 18410
2025-10-15T10:54:27.003915Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 168 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 18529 count 1 nextOffset 168 batches 1
2025-10-15T10:54:27.003966Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 169 partNo 0
2025-10-15T10:54:27.003997Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 169 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 37136 count 2 nextOffset 169 batches 1
2025-10-15T10:54:27.004018Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 170 partNo 0
2025-10-15T10:54:27.004040Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 170 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 55853 count 3 nextOffset 170 batches 1
2025-10-15T10:54:27.004065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 171 partNo 0
2025-10-15T10:54:27.004085Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 171 partNo 0 FormedBlobsCount 0 NewHead: Offset 167 PartNo 0 PackedSize 74680 count 4 nextOffset 171 batches 1
2025-10-15T10:54:27.004099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.004804Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 167,4 HeadOffset 167 endOffset 167 curOffset 171 d0000000000_00000000000000000167_00000_0000000004_00000? size 74620 WTime 1760525666998
2025-10-15T10:54:27.004966Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.005033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 337  requestId: <none> cookie: 167
2025-10-15T10:54:27.005100Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.005200Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 167 partNo 0 count 4 size 74620
2025-10-15T10:54:27.028317Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 167 count 4 size 74620 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.028385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.028444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 74508 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.028483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.028519Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 168, partNo: 0, Offset: 167 is stored on disk
2025-10-15T10:54:27.028540Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.028564Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 169, partNo: 0, Offset: 168 is stored on disk
2025-10-15T10:54:27.028577Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.028597Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 170, partNo: 0, Offset: 169 is stored on disk
2025-10-15T10:54:27.028612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.028635Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 171, partNo: 0, Offset: 170 is stored on disk
2025-10-15T10:54:27.028820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.028835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.028846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.028883Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.028935Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 338  requestId: <none> cookie: 168
2025-10-15T10:54:27.028995Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 339  requestId: <none> cookie: 169
2025-10-15T10:54:27.029018Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 340  requestId: <none> cookie: 170
2025-10-15T10:54:27.029043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 341  requestId: <none> cookie: 171
2025-10-15T10:54:27.029578Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 167 partno 0 count 4 parts 0 suffix '63' size 74620
2025-10-15T10:54:27.061522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.061555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.061566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.171454Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.171485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.171496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.275455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.275492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.275505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.361148Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 151 EndOffset 151 newEndOffset 166 commitOffset 0 clientCommitOffset 0 cookie 13 readingFinished 0 firstRead 0
2025-10-15T10:54:27.361195Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 151 endOffset 166
2025-10-15T10:54:27.372016Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.372097Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372189Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372229Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372254Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372279Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372302Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372407Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372431Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.372973Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.373196Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.373233Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.373267Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.373304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.373840Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 236809 } }
2025-10-15T10:54:27.373896Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 151, endOffset# 166, WTime# 1760525666412, sizeLag# 344212
2025-10-15T10:54:27.373908Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:27.373951Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 853258af-5487454d-700c7951-e4f5655c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 287479, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:27.374015Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 63efbafb-6a21d8a7-92d0f28-cac3a0f9
2025-10-15T10:54:27.376015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 167 offsets: 166 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 252 }
2025-10-15T10:54:27.376066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 167
2025-10-15T10:54:27.376283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 168 offsets: 167 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:27.376309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 168
2025-10-15T10:54:27.375726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.375756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.376430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 169 offsets: 168 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 40 }
2025-10-15T10:54:27.375770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.376453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 169
2025-10-15T10:54:27.376956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 170 offsets: 169 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:27.376990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 170
2025-10-15T10:54:27.377137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 171 offsets: 170 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:27.377160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 171
2025-10-15T10:54:27.376673Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.376709Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.376762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 172 partNo : 0 messageNo: 347 size 18895 offset: -1
2025-10-15T10:54:27.376835Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.376848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.376870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 173 partNo : 0 messageNo: 348 size 19005 offset: -1
2025-10-15T10:54:27.376973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.376987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.377011Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 174 partNo : 0 messageNo: 349 size 19115 offset: -1
2025-10-15T10:54:27.377066Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.377078Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.377099Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 175 partNo : 0 messageNo: 350 size 19225 offset: -1
2025-10-15T10:54:27.377161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.377171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.377191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 176 partNo : 0 messageNo: 351 size 19335 offset: -1
2025-10-15T10:54:27.377221Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.377232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.377261Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.377272Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.377300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.377308Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.377332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.377342Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.377367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.377376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.377399Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.377444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.377466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.377476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:27.377583Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 172 partNo 0
2025-10-15T10:54:27.378474Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 172 partNo 0 FormedBlobsCount 0 NewHead: Offset 171 PartNo 0 PackedSize 18969 count 1 nextOffset 172 batches 1
2025-10-15T10:54:27.378509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.379023Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 171,1 HeadOffset 171 endOffset 171 curOffset 172 d0000000000_00000000000000000171_00000_0000000001_00000? size 18960 WTime 1760525667378
2025-10-15T10:54:27.379161Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.379192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.379203Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.379219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.379231Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.379245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.379256Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.379272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.379374Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.379470Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 171 partNo 0 count 1 size 18960
2025-10-15T10:54:27.379516Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 352  requestId: <none> cookie: 177
2025-10-15T10:54:27.379574Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 353  requestId: <none> cookie: 178
2025-10-15T10:54:27.379596Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 354  requestId: <none> cookie: 179
2025-10-15T10:54:27.379616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 355  requestId: <none> cookie: 180
2025-10-15T10:54:27.379635Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 356  requestId: <none> cookie: 181
2025-10-15T10:54:27.398960Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 287479 maxTimeLagMs 0 readTimestampMs 0 readOffset 151 EndOffset 166 ClientCommitOffset 0 committedOffset 0 Guid 853258af-5487454d-700c7951-e4f5655c
2025-10-15T10:54:27.400396Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 171 count 1 size 18960 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.400461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.400516Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 18902 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.400553Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.400586Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 172, partNo: 0, Offset: 171 is stored on disk
2025-10-15T10:54:27.400758Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.400796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.400806Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-10-15T10:54:27.400896Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 173 partNo 0
2025-10-15T10:54:27.401791Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 173 partNo 0 FormedBlobsCount 0 NewHead: Offset 172 PartNo 0 PackedSize 19079 count 1 nextOffset 173 batches 1
2025-10-15T10:54:27.401842Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 174 partNo 0
2025-10-15T10:54:27.401873Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 174 partNo 0 FormedBlobsCount 0 NewHead: Offset 172 PartNo 0 PackedSize 38236 count 2 nextOffset 174 batches 1
2025-10-15T10:54:27.401898Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 175 partNo 0
2025-10-15T10:54:27.401922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 175 partNo 0 FormedBlobsCount 0 NewHead: Offset 172 PartNo 0 PackedSize 57503 count 3 nextOffset 175 batches 1
2025-10-15T10:54:27.401940Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 176 partNo 0
2025-10-15T10:54:27.401959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 176 partNo 0 FormedBlobsCount 0 NewHead: Offset 172 PartNo 0 PackedSize 76880 count 4 nextOffset 176 batches 1
2025-10-15T10:54:27.401977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.402743Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 172,4 HeadOffset 172 endOffset 172 curOffset 176 d0000000000_00000000000000000172_00000_0000000004_00000? size 76820 WTime 1760525667398
2025-10-15T10:54:27.402926Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.402991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 347  requestId: <none> cookie: 172
2025-10-15T10:54:27.403056Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.403149Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 172 partNo 0 count 4 size 76820
2025-10-15T10:54:27.403961Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 171 partno 0 count 1 parts 0 suffix '63' size 18960
2025-10-15T10:54:27.407701Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.407793Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.407853Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.407882Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.407912Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.407972Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.407998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.408664Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.408716Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.408753Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.408789Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.408822Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.411834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 172 offsets: 171 already_written: false write_statistics { persist_duration_ms: 23 }
2025-10-15T10:54:27.411900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 172
2025-10-15T10:54:27.411125Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.411161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.411289Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.411302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.411369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 177 partNo : 0 messageNo: 357 size 19445 offset: -1
2025-10-15T10:54:27.411485Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.411498Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.411522Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 178 partNo : 0 messageNo: 358 size 19555 offset: -1
2025-10-15T10:54:27.411611Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.411625Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.411646Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 179 partNo : 0 messageNo: 359 size 19665 offset: -1
2025-10-15T10:54:27.411762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.411773Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.411796Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 180 partNo : 0 messageNo: 360 size 19775 offset: -1
2025-10-15T10:54:27.411892Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.411906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.411929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 181 partNo : 0 messageNo: 361 size 19885 offset: -1
2025-10-15T10:54:27.411963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.411973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.412006Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.412016Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.412045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.412055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.412084Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.412096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.412123Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.412134Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.412217Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.412262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.412274Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.412289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.412301Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.412314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.412325Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.412343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.412352Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.412367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.412861Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 362  requestId: <none> cookie: 182
2025-10-15T10:54:27.412896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 363  requestId: <none> cookie: 183
2025-10-15T10:54:27.412915Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 364  requestId: <none> cookie: 184
2025-10-15T10:54:27.412932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 365  requestId: <none> cookie: 185
2025-10-15T10:54:27.412948Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 366  requestId: <none> cookie: 186
2025-10-15T10:54:27.412983Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 16 Topic 'rt3.dc1--test-topic' partition 0 user user offset 151 count 18 size 287479 endOffset 172 max time lag 0ms effective offset 151
2025-10-15T10:54:27.413808Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 16 added 4 blobs, size 355362 count 20 last offset 167, current partition end offset: 172
2025-10-15T10:54:27.413826Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 16. Send blob request.
2025-10-15T10:54:27.413881Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 151 partno 0 count 10 parts_count 0 source 1 size 172106 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:27.413900Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 161 partno 0 count 5 parts_count 0 source 1 size 90226 accessed 0 times before, last time 2025-10-15T10:54:26.000000Z
2025-10-15T10:54:27.413921Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 166 partno 0 count 1 parts_count 0 source 1 size 18410 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.413939Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 167 partno 0 count 4 parts_count 0 source 1 size 74620 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.413967Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 16. All 4 blobs are from cache.
2025-10-15T10:54:27.414027Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 4 blobs
2025-10-15T10:54:27.415287Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 151 totakecount 10 count 10 size 172083 from pos 0 cbcount 10
2025-10-15T10:54:27.416497Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 151 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:27.416525Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 161 partno 0 count 5 parts 0 suffix '63'
2025-10-15T10:54:27.416546Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 166 partno 0 count 1 parts 0 suffix '63'
2025-10-15T10:54:27.416567Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 167 partno 0 count 4 parts 0 suffix '63'
2025-10-15T10:54:27.418555Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 161 totakecount 5 count 5 size 90203 from pos 0 cbcount 5
2025-10-15T10:54:27.418717Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 166 totakecount 1 count 1 size 18387 from pos 0 cbcount 1
2025-10-15T10:54:27.419161Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 167 totakecount 4 count 4 size 74597 from pos 0 cbcount 4
2025-10-15T10:54:27.419366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 151
2025-10-15T10:54:27.420465Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.420538Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.420593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.420620Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.420682Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.420709Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.421343Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.421398Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.421435Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.421473Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.421510Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.423328Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 172 Result { Offset: 151 Data: "... 16695 bytes ..." SourceId: "\000src_id" SeqNo: 152 WriteTimestampMS: 1760525666439 CreateTimestampMS: 1760525665783 UncompressedSize: 16621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 152 Data: "... 16805 bytes ..." SourceId: "\000src_id" SeqNo: 153 WriteTimestampMS: 1760525666562 CreateTimestampMS: 1760525665783 UncompressedSize: 16731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 153 Data: "... 16915 bytes ..." SourceId: "\000src_id" SeqNo: 154 WriteTimestampMS: 1760525666562 CreateTimestampMS: 1760525665783 UncompressedSize: 16841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 154 Data: "... 17025 bytes ..." SourceId: "\000src_id" SeqNo: 155 WriteTimestampMS: 1760525666567 CreateTimestampMS: 1760525665783 UncompressedSize: 16951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 155 Data: "... 17135 bytes ..." SourceId: "\000src_id" SeqNo: 156 WriteTimestampMS: 1760525666567 CreateTimestampMS: 1760525665783 UncompressedSize: 17061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 156 Data: "... 17245 bytes ..." SourceId: "\000src_id" SeqNo: 157 WriteTimestampMS: 1760525666567 CreateTimestampMS: 1760525665783 UncompressedSize: 17171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 157 Data: "... 17355 bytes ..." SourceId: "\000src_id" SeqNo: 158 WriteTimestampMS: 1760525666567 CreateTimestampMS: 1760525665784 UncompressedSize: 17281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 158 Data: "... 17465 bytes ..." SourceId: "\000src_id" SeqNo: 159 WriteTimestampMS: 1760525666567 CreateTimestampMS: 1760525665784 UncompressedSize: 17391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 159 Data: "... 17575 bytes ..." SourceId: "\000src_id" SeqNo: 160 WriteTimestampMS: 1760525666567 CreateTimestampMS: 1760525665784 UncompressedSize: 17501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 160 Data: "... 17685 bytes ..." SourceId: "\000src_id" SeqNo: 161 WriteTimestampMS: 1760525666567 CreateTimestampMS: 1760525665784 UncompressedSize: 17611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 161 Data: "... 17795 bytes ..." SourceId: "\000src_id" SeqNo: 162 WriteTimestampMS: 1760525666609 CreateTimestampMS: 1760525665784 UncompressedSize: 17721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 162 Data: "... 17905 bytes ..." SourceId: "\000src_id" SeqNo: 163 WriteTimestampMS: 1760525666610 CreateTimestampMS: 1760525665784 UncompressedSize: 17831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 163 Data: "... 18015 bytes ..." SourceId: "\000src_id" SeqNo: 164 WriteTimestampMS: 1760525666610 CreateTimestampMS: 1760525665785 UncompressedSize: 17941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 164 Data: "... 18125 bytes ..." SourceId: "\000src_id" SeqNo: 165 WriteTimestampMS: 1760525666610 CreateTimestampMS: 1760525665785 UncompressedSize: 18051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 165 Data: "... 18235 bytes ..." SourceId: "\000src_id" SeqNo: 166 WriteTimestampMS: 1760525666610 CreateTimestampMS: 1760525665785 UncompressedSize: 18161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 166 Data: "... 18345 bytes ..." SourceId: "\000src_id" SeqNo: 167 WriteTimestampMS: 1760525666705 CreateTimestampMS: 1760525665785 UncompressedSize: 18271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 167 Data: "... 18455 bytes ..." SourceId: "\000src_id" SeqNo: 168 WriteTimestampMS: 1760525666998 CreateTimestampMS: 1760525665785 UncompressedSize: 18381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 168 Data: "... 18565 bytes ..." SourceId: "\000src_id" SeqNo: 169 WriteTimestampMS: 1760525666998 CreateTimestampMS: 1760525665785 UncompressedSize: 18491 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 4 SizeLag: 209372 RealReadOffset: 168 WaitQuotaTimeMs: 0 EndOffset: 172 StartOffset: 0 } Cookie: 151 }
2025-10-15T10:54:27.428976Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.429075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 182 partNo : 0 messageNo: 367 size 19995 offset: -1
2025-10-15T10:54:27.429161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.436046Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 169 endOffset 172
2025-10-15T10:54:27.436113Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 172 ReadOffset 169 ReadGuid 853258af-5487454d-700c7951-e4f5655c has messages 1
2025-10-15T10:54:27.436332Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.436385Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.436438Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.436472Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.436498Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.436519Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.437178Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.437227Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.437256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.437287Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.437316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.437788Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 169, endOffset# 172, WTime# 1760525666998, sizeLag# 209372
2025-10-15T10:54:27.437804Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:27.429196Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 183 partNo : 0 messageNo: 368 size 20105 offset: -1
2025-10-15T10:54:27.429296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.429334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 184 partNo : 0 messageNo: 369 size 20215 offset: -1
2025-10-15T10:54:27.429415Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.429453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 185 partNo : 0 messageNo: 370 size 20325 offset: -1
2025-10-15T10:54:27.429504Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429516Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.429541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 186 partNo : 0 messageNo: 371 size 20435 offset: -1
2025-10-15T10:54:27.429572Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429583Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.429618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429629Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.429661Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429672Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.429700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429721Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.429744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.429754Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.429958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.430009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.430023Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.430039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.430048Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.430062Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.430071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.430083Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.430091Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.430105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.430213Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 172 count 4 size 76820 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.430269Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 372  requestId: <none> cookie: 187
2025-10-15T10:54:27.430303Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 373  requestId: <none> cookie: 188
2025-10-15T10:54:27.430320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 374  requestId: <none> cookie: 189
2025-10-15T10:54:27.430337Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 375  requestId: <none> cookie: 190
2025-10-15T10:54:27.430352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 376  requestId: <none> cookie: 191
2025-10-15T10:54:27.430370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.430417Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 76708 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.430449Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.430506Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 173, partNo: 0, Offset: 172 is stored on disk
2025-10-15T10:54:27.430526Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.430543Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 174, partNo: 0, Offset: 173 is stored on disk
2025-10-15T10:54:27.430553Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.430571Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 175, partNo: 0, Offset: 174 is stored on disk
2025-10-15T10:54:27.430583Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.430599Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 176, partNo: 0, Offset: 175 is stored on disk
2025-10-15T10:54:27.430769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.430816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.430826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:27.430911Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 177 partNo 0
2025-10-15T10:54:27.432258Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 172 partno 0 count 4 parts 0 suffix '63' size 76820
2025-10-15T10:54:27.437886Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 853258af-5487454d-700c7951-e4f5655c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 317575
2025-10-15T10:54:27.437916Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 853258af-5487454d-700c7951-e4f5655c
2025-10-15T10:54:27.438830Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 1
2025-10-15T10:54:27.438915Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 5405f508-c438205f-e7591b5-e19a05a8, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 206713, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:27.439123Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 206713 maxTimeLagMs 0 readTimestampMs 0 readOffset 169 EndOffset 172 ClientCommitOffset 0 committedOffset 0 Guid 5405f508-c438205f-e7591b5-e19a05a8
2025-10-15T10:54:27.443455Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.447744Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.449588Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.451105Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 317575, now ReadSizeBudget = 0, ReadSizeServerDelta = 206713
2025-10-15T10:54:27.451281Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 206713
2025-10-15T10:54:27.455405Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (151-168)
2025-10-15T10:54:27.455479Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 317575 to budget
2025-10-15T10:54:27.455727Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.455645Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 317575, ReadSizeServerDelta = 206713
2025-10-15T10:54:27.457272Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:27.457392Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (151-151)
2025-10-15T10:54:27.457493Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (152-152)
2025-10-15T10:54:27.457668Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (153-153)
2025-10-15T10:54:27.457742Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (154-154)
2025-10-15T10:54:27.457920Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (155-155)
2025-10-15T10:54:27.457984Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (156-156)
2025-10-15T10:54:27.458050Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 3} (157-157)
2025-10-15T10:54:27.458107Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 4} (158-158)
2025-10-15T10:54:27.458442Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 5} (159-159)
2025-10-15T10:54:27.458522Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 6} (160-160)
2025-10-15T10:54:27.458593Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (161-161)
2025-10-15T10:54:27.458654Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (162-162)
2025-10-15T10:54:27.458711Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 1} (163-163)
2025-10-15T10:54:27.458778Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 2} (164-164)
2025-10-15T10:54:27.458846Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 3} (165-165)
2025-10-15T10:54:27.458940Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 0} (166-166)
2025-10-15T10:54:27.460392Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 0} (167-167)
2025-10-15T10:54:27.460469Z :DEBUG: [/Root] Take Data. Partition 0. Read: {6, 1} (168-168)
2025-10-15T10:54:27.467603Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 317575 } }
2025-10-15T10:54:27.467829Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 1f1de6e6-f793ad6b-fc8f04dc-b7148679
2025-10-15T10:54:27.467887Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..16621 bytes.. Information: { Offset: 151 ProducerId: "src_id" SeqNo: 152 CreateTime: 2025-10-15T10:54:25.783000Z WriteTime: 2025-10-15T10:54:26.439000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16731 bytes.. Information: { Offset: 152 ProducerId: "src_id" SeqNo: 153 CreateTime: 2025-10-15T10:54:25.783000Z WriteTime: 2025-10-15T10:54:26.562000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16841 bytes.. Information: { Offset: 153 ProducerId: "src_id" SeqNo: 154 CreateTime: 2025-10-15T10:54:25.783000Z WriteTime: 2025-10-15T10:54:26.562000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..16951 bytes.. Information: { Offset: 154 ProducerId: "src_id" SeqNo: 155 CreateTime: 2025-10-15T10:54:25.783000Z WriteTime: 2025-10-15T10:54:26.567000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17061 bytes.. Information: { Offset: 155 ProducerId: "src_id" SeqNo: 156 CreateTime: 2025-10-15T10:54:25.783000Z WriteTime: 2025-10-15T10:54:26.567000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17171 bytes.. Information: { Offset: 156 ProducerId: "src_id" SeqNo: 157 CreateTime: 2025-10-15T10:54:25.783000Z WriteTime: 2025-10-15T10:54:26.567000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17281 bytes.. Information: { Offset: 157 ProducerId: "src_id" SeqNo: 158 CreateTime: 2025-10-15T10:54:25.784000Z WriteTime: 2025-10-15T10:54:26.567000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17391 bytes.. Information: { Offset: 158 ProducerId: "src_id" SeqNo: 159 CreateTime: 2025-10-15T10:54:25.784000Z WriteTime: 2025-10-15T10:54:26.567000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17501 bytes.. Information: { Offset: 159 ProducerId: "src_id" SeqNo: 160 CreateTime: 2025-10-15T10:54:25.784000Z WriteTime: 2025-10-15T10:54:26.567000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17611 bytes.. Information: { Offset: 160 ProducerId: "src_id" SeqNo: 161 CreateTime: 2025-10-15T10:54:25.784000Z WriteTime: 2025-10-15T10:54:26.567000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17721 bytes.. Information: { Offset: 161 ProducerId: "src_id" SeqNo: 162 CreateTime: 2025-10-15T10:54:25.784000Z WriteTime: 2025-10-15T10:54:26.609000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17831 bytes.. Information: { Offset: 162 ProducerId: "src_id" SeqNo: 163 CreateTime: 2025-10-15T10:54:25.784000Z WriteTime: 2025-10-15T10:54:26.610000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..17941 bytes.. Information: { Offset: 163 ProducerId: "src_id" SeqNo: 164 CreateTime: 2025-10-15T10:54:25.785000Z WriteTime: 2025-10-15T10:54:26.610000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18051 bytes.. Information: { Offset: 164 ProducerId: "src_id" SeqNo: 165 CreateTime: 2025-10-15T10:54:25.785000Z WriteTime: 2025-10-15T10:54:26.610000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18161 bytes.. Information: { Offset: 165 ProducerId: "src_id" SeqNo: 166 CreateTime: 2025-10-15T10:54:25.785000Z WriteTime: 2025-10-15T10:54:26.610000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18271 bytes.. Information: { Offset: 166 ProducerId: "src_id" SeqNo: 167 CreateTime: 2025-10-15T10:54:25.785000Z WriteTime: 2025-10-15T10:54:26.705000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18381 bytes.. Information: { Offset: 167 ProducerId: "src_id" SeqNo: 168 CreateTime: 2025-10-15T10:54:25.785000Z WriteTime: 2025-10-15T10:54:26.998000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18491 bytes.. Information: { Offset: 168 ProducerId: "src_id" SeqNo: 169 CreateTime: 2025-10-15T10:54:25.785000Z WriteTime: 2025-10-15T10:54:26.998000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:27.475058Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 18, size 316008 bytes
2025-10-15T10:54:27.475116Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:27.482856Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.483468Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.483856Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.484226Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.484546Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.491446Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.492126Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.492450Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.500813Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 177 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 19519 count 1 nextOffset 177 batches 1
2025-10-15T10:54:27.500904Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 178 partNo 0
2025-10-15T10:54:27.500943Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 178 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 39116 count 2 nextOffset 178 batches 1
2025-10-15T10:54:27.500963Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 179 partNo 0
2025-10-15T10:54:27.500981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 179 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 58823 count 3 nextOffset 179 batches 1
2025-10-15T10:54:27.500998Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 180 partNo 0
2025-10-15T10:54:27.501014Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 180 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 78640 count 4 nextOffset 180 batches 1
2025-10-15T10:54:27.501033Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 181 partNo 0
2025-10-15T10:54:27.501053Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 181 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 98567 count 5 nextOffset 181 batches 1
2025-10-15T10:54:27.501071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 182 partNo 0
2025-10-15T10:54:27.501090Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 182 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 118604 count 6 nextOffset 182 batches 1
2025-10-15T10:54:27.501110Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 183 partNo 0
2025-10-15T10:54:27.501128Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 183 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 138751 count 7 nextOffset 183 batches 1
2025-10-15T10:54:27.501148Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 184 partNo 0
2025-10-15T10:54:27.501166Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 184 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 159008 count 8 nextOffset 184 batches 1
2025-10-15T10:54:27.501187Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 185 partNo 0
2025-10-15T10:54:27.501208Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 185 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 179375 count 9 nextOffset 185 batches 1
2025-10-15T10:54:27.501229Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 186 partNo 0
2025-10-15T10:54:27.501249Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 186 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 199852 count 10 nextOffset 186 batches 1
2025-10-15T10:54:27.501267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.502411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 176,10 HeadOffset 176 endOffset 176 curOffset 186 d0000000000_00000000000000000176_00000_0000000010_00000? size 199606 WTime 1760525667499
2025-10-15T10:54:27.502772Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.512291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 348  requestId: <none> cookie: 173
2025-10-15T10:54:27.512362Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 349  requestId: <none> cookie: 174
2025-10-15T10:54:27.512392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 350  requestId: <none> cookie: 175
2025-10-15T10:54:27.512418Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 351  requestId: <none> cookie: 176
2025-10-15T10:54:27.512525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.512555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.512609Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 187 partNo : 0 messageNo: 377 size 20545 offset: -1
2025-10-15T10:54:27.512678Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.512690Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.512710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 188 partNo : 0 messageNo: 378 size 20655 offset: -1
2025-10-15T10:54:27.512807Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.512822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.512846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 189 partNo : 0 messageNo: 379 size 20765 offset: -1
2025-10-15T10:54:27.512933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.512947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.512971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 190 partNo : 0 messageNo: 380 size 20875 offset: -1
2025-10-15T10:54:27.513096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.513111Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.513137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 191 partNo : 0 messageNo: 381 size 20985 offset: -1
2025-10-15T10:54:27.513171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.513184Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.513223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.513236Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.513264Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.513275Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.513304Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.513315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.513343Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.513354Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.513423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.513435Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.513487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.513506Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.513630Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 176 partNo 0 count 10 size 199606
2025-10-15T10:54:27.513666Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.513725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.513740Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.513756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.513766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.513782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.513792Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.513806Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.513816Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.513829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.514051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 382  requestId: <none> cookie: 192
2025-10-15T10:54:27.514077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 383  requestId: <none> cookie: 193
2025-10-15T10:54:27.514105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 384  requestId: <none> cookie: 194
2025-10-15T10:54:27.514122Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 385  requestId: <none> cookie: 195
2025-10-15T10:54:27.514137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 386  requestId: <none> cookie: 196
2025-10-15T10:54:27.514236Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 17 Topic 'rt3.dc1--test-topic' partition 0 user user offset 169 count 3 size 206713 endOffset 176 max time lag 0ms effective offset 169
2025-10-15T10:54:27.514596Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 17 added 2 blobs, size 18960 count 3 last offset 171, current partition end offset: 176
2025-10-15T10:54:27.514611Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 17. Send blob request.
2025-10-15T10:54:27.514664Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 167 partno 0 count 4 parts_count 0 source 1 size 74620 accessed 1 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.514685Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 171 partno 0 count 1 parts_count 0 source 1 size 18960 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.514709Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 17. All 2 blobs are from cache.
2025-10-15T10:54:27.514759Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-10-15T10:54:27.515201Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 167 totakecount 4 count 4 size 74597 from pos 2 cbcount 4
2025-10-15T10:54:27.515337Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 171 totakecount 1 count 1 size 18937 from pos 0 cbcount 1
2025-10-15T10:54:27.515656Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 167 partno 0 count 4 parts 0 suffix '63'
2025-10-15T10:54:27.515680Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 171 partno 0 count 1 parts 0 suffix '63'
2025-10-15T10:54:27.518124Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.518209Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.518238Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.518265Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.518297Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.518339Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.518369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.518395Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.518424Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.519298Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.519470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.519518Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.519561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.519605Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.523913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 173 offsets: 172 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:27.523956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 173
2025-10-15T10:54:27.524147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 174 offsets: 173 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:27.524170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 174
2025-10-15T10:54:27.524284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 175 offsets: 174 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:27.524310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 175
2025-10-15T10:54:27.524410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 176 offsets: 175 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 20 }
2025-10-15T10:54:27.524434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 176
2025-10-15T10:54:27.524687Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.527600Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.528115Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.528528Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.526512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.526555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.526607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 192 partNo : 0 messageNo: 387 size 21095 offset: -1
2025-10-15T10:54:27.526703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.526716Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.526741Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 193 partNo : 0 messageNo: 388 size 21205 offset: -1
2025-10-15T10:54:27.526827Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.526840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.526866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 194 partNo : 0 messageNo: 389 size 21315 offset: -1
2025-10-15T10:54:27.526948Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.526962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.526986Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 195 partNo : 0 messageNo: 390 size 21425 offset: -1
2025-10-15T10:54:27.527069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.527083Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.527109Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 196 partNo : 0 messageNo: 391 size 21535 offset: -1
2025-10-15T10:54:27.527146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.527158Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.527191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.527202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.527233Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.527245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.527276Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.527288Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.527316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.527327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.527400Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 169
2025-10-15T10:54:27.527894Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.527944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.527960Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.527975Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.527986Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.528010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.528029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.528045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.528058Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.528075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.528247Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 392  requestId: <none> cookie: 197
2025-10-15T10:54:27.528279Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 393  requestId: <none> cookie: 198
2025-10-15T10:54:27.528297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 394  requestId: <none> cookie: 199
2025-10-15T10:54:27.528315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 395  requestId: <none> cookie: 200
2025-10-15T10:54:27.528336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 396  requestId: <none> cookie: 201
2025-10-15T10:54:27.530846Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.530913Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.530945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.530976Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.531005Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.531429Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.531607Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.531649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.531687Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.531728Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.532546Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 176 Result { Offset: 169 Data: "... 18675 bytes ..." SourceId: "\000src_id" SeqNo: 170 WriteTimestampMS: 1760525666998 CreateTimestampMS: 1760525665786 UncompressedSize: 18601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 170 Data: "... 18785 bytes ..." SourceId: "\000src_id" SeqNo: 171 WriteTimestampMS: 1760525666998 CreateTimestampMS: 1760525665793 UncompressedSize: 18711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 171 Data: "... 18895 bytes ..." SourceId: "\000src_id" SeqNo: 172 WriteTimestampMS: 1760525667375 CreateTimestampMS: 1760525665793 UncompressedSize: 18821 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 111719 RealReadOffset: 171 WaitQuotaTimeMs: 0 EndOffset: 176 StartOffset: 0 } Cookie: 169 }
2025-10-15T10:54:27.532756Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 172 endOffset 176
2025-10-15T10:54:27.532794Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 176 ReadOffset 172 ReadGuid 5405f508-c438205f-e7591b5-e19a05a8 has messages 1
2025-10-15T10:54:27.532873Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 172, endOffset# 176, WTime# 1760525667375, sizeLag# 111719
2025-10-15T10:54:27.532890Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:27.532942Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 5405f508-c438205f-e7591b5-e19a05a8, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 56505
2025-10-15T10:54:27.532968Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 5405f508-c438205f-e7591b5-e19a05a8
2025-10-15T10:54:27.533271Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 1
2025-10-15T10:54:27.533317Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# dad26748-120c004c-dfacbbda-4963250f, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 134062, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:27.533420Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 134062 maxTimeLagMs 0 readTimestampMs 0 readOffset 172 EndOffset 176 ClientCommitOffset 0 committedOffset 0 Guid dad26748-120c004c-dfacbbda-4963250f
2025-10-15T10:54:27.535634Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 56505, now ReadSizeBudget = 0, ReadSizeServerDelta = 467783
2025-10-15T10:54:27.535768Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 467783
2025-10-15T10:54:27.536011Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (169-171)
2025-10-15T10:54:27.536069Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 56505 to budget
2025-10-15T10:54:27.536098Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 56505, ReadSizeServerDelta = 467783
2025-10-15T10:54:27.536296Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:27.536398Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (169-169)
2025-10-15T10:54:27.536502Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (170-170)
2025-10-15T10:54:27.536640Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (171-171)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..18601 bytes.. Information: { Offset: 169 ProducerId: "src_id" SeqNo: 170 CreateTime: 2025-10-15T10:54:25.786000Z WriteTime: 2025-10-15T10:54:26.998000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18711 bytes.. Information: { Offset: 170 ProducerId: "src_id" SeqNo: 171 CreateTime: 2025-10-15T10:54:25.793000Z WriteTime: 2025-10-15T10:54:26.998000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..18821 bytes.. Information: { Offset: 171 ProducerId: "src_id" SeqNo: 172 CreateTime: 2025-10-15T10:54:25.793000Z WriteTime: 2025-10-15T10:54:27.375000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:27.540085Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 3, size 56133 bytes
2025-10-15T10:54:27.540134Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:27.539936Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.540343Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 56505 } }
2025-10-15T10:54:27.540451Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 7f39c92b-6289f7da-1f9ba72-c9bc2a22
2025-10-15T10:54:27.540882Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.541230Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.541540Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.542577Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.542618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.542675Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 197 partNo : 0 messageNo: 397 size 21645 offset: -1
2025-10-15T10:54:27.542785Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.542803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.542829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 198 partNo : 0 messageNo: 398 size 21755 offset: -1
2025-10-15T10:54:27.542953Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.542969Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.542996Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 199 partNo : 0 messageNo: 399 size 21865 offset: -1
2025-10-15T10:54:27.543089Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.543104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.543129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 200 partNo : 0 messageNo: 400 size 21975 offset: -1
2025-10-15T10:54:27.543213Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.543228Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.543254Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 201 partNo : 0 messageNo: 401 size 22085 offset: -1
2025-10-15T10:54:27.543290Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.543304Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.543340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.543369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.543400Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.543414Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.543444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.543455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.543483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.543497Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.543571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.543585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.543815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.543862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.543876Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.543894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.543905Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.543919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.543929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.543944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.543954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.543967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.544097Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 176 count 10 size 199606 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.544141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 402  requestId: <none> cookie: 202
2025-10-15T10:54:27.544172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 403  requestId: <none> cookie: 203
2025-10-15T10:54:27.544192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 404  requestId: <none> cookie: 204
2025-10-15T10:54:27.544209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 405  requestId: <none> cookie: 205
2025-10-15T10:54:27.544228Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 406  requestId: <none> cookie: 206
2025-10-15T10:54:27.544271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.544321Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 199470 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.544355Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544381Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 177, partNo: 0, Offset: 176 is stored on disk
2025-10-15T10:54:27.544398Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544414Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 178, partNo: 0, Offset: 177 is stored on disk
2025-10-15T10:54:27.544425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544442Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 179, partNo: 0, Offset: 178 is stored on disk
2025-10-15T10:54:27.544453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544471Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 180, partNo: 0, Offset: 179 is stored on disk
2025-10-15T10:54:27.544484Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544499Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 181, partNo: 0, Offset: 180 is stored on disk
2025-10-15T10:54:27.544510Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544526Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 182, partNo: 0, Offset: 181 is stored on disk
2025-10-15T10:54:27.544537Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544555Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 183, partNo: 0, Offset: 182 is stored on disk
2025-10-15T10:54:27.544566Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544583Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 184, partNo: 0, Offset: 183 is stored on disk
2025-10-15T10:54:27.544595Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544613Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 185, partNo: 0, Offset: 184 is stored on disk
2025-10-15T10:54:27.544623Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.544641Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 186, partNo: 0, Offset: 185 is stored on disk
2025-10-15T10:54:27.544800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.544861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.544872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:27.544957Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 187 partNo 0
2025-10-15T10:54:27.545771Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 187 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 20619 count 1 nextOffset 187 batches 1
2025-10-15T10:54:27.545824Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 188 partNo 0
2025-10-15T10:54:27.545854Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 188 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 41316 count 2 nextOffset 188 batches 1
2025-10-15T10:54:27.545875Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 189 partNo 0
2025-10-15T10:54:27.545895Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 189 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 62123 count 3 nextOffset 189 batches 1
2025-10-15T10:54:27.545914Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 190 partNo 0
2025-10-15T10:54:27.545934Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 190 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 83040 count 4 nextOffset 190 batches 1
2025-10-15T10:54:27.545955Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 191 partNo 0
2025-10-15T10:54:27.545975Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 191 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 104067 count 5 nextOffset 191 batches 1
2025-10-15T10:54:27.545994Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 192 partNo 0
2025-10-15T10:54:27.546011Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 192 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 125204 count 6 nextOffset 192 batches 1
2025-10-15T10:54:27.546034Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 193 partNo 0
2025-10-15T10:54:27.546050Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 193 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 146451 count 7 nextOffset 193 batches 1
2025-10-15T10:54:27.546070Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 194 partNo 0
2025-10-15T10:54:27.546087Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 194 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 167808 count 8 nextOffset 194 batches 1
2025-10-15T10:54:27.546104Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 195 partNo 0
2025-10-15T10:54:27.546127Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 195 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 189275 count 9 nextOffset 195 batches 1
2025-10-15T10:54:27.546147Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 196 partNo 0
2025-10-15T10:54:27.546166Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 196 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 210852 count 10 nextOffset 196 batches 1
2025-10-15T10:54:27.546189Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 197 partNo 0
2025-10-15T10:54:27.546208Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 197 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 232539 count 11 nextOffset 197 batches 1
2025-10-15T10:54:27.546227Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 198 partNo 0
2025-10-15T10:54:27.546246Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 198 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 254336 count 12 nextOffset 198 batches 1
2025-10-15T10:54:27.546265Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 199 partNo 0
2025-10-15T10:54:27.546283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 199 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 276243 count 13 nextOffset 199 batches 1
2025-10-15T10:54:27.546302Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 200 partNo 0
2025-10-15T10:54:27.546323Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 200 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 298260 count 14 nextOffset 200 batches 1
2025-10-15T10:54:27.546344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 201 partNo 0
2025-10-15T10:54:27.546363Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 201 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 320387 count 15 nextOffset 201 batches 1
2025-10-15T10:54:27.546379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.547686Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 176 partno 0 count 10 parts 0 suffix '63' size 199606
2025-10-15T10:54:27.550634Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.550706Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.550737Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.550767Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.550799Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.551196Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.551436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.551483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.551521Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.551559Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.553111Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.553696Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.554035Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.554337Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.559441Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.560612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 186,15 HeadOffset 186 endOffset 186 curOffset 201 d0000000000_00000000000000000186_00000_0000000015_00000? size 319986 WTime 1760525667559
2025-10-15T10:54:27.561284Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.561837Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 18 Topic 'rt3.dc1--test-topic' partition 0 user user offset 172 count 4 size 134062 endOffset 186 max time lag 0ms effective offset 172
2025-10-15T10:54:27.562019Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 18 added 1 blobs, size 76820 count 4 last offset 172, current partition end offset: 186
2025-10-15T10:54:27.562035Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 18. Send blob request.
2025-10-15T10:54:27.562090Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 357  requestId: <none> cookie: 177
2025-10-15T10:54:27.562144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 358  requestId: <none> cookie: 178
2025-10-15T10:54:27.562169Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 359  requestId: <none> cookie: 179
2025-10-15T10:54:27.562196Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 360  requestId: <none> cookie: 180
2025-10-15T10:54:27.562224Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 361  requestId: <none> cookie: 181
2025-10-15T10:54:27.562250Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 367  requestId: <none> cookie: 182
2025-10-15T10:54:27.562277Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 368  requestId: <none> cookie: 183
2025-10-15T10:54:27.562302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 369  requestId: <none> cookie: 184
2025-10-15T10:54:27.562329Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 370  requestId: <none> cookie: 185
2025-10-15T10:54:27.562354Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 371  requestId: <none> cookie: 186
2025-10-15T10:54:27.562505Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.562533Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.562585Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 202 partNo : 0 messageNo: 407 size 22195 offset: -1
2025-10-15T10:54:27.562698Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.562712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.562735Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 203 partNo : 0 messageNo: 408 size 22305 offset: -1
2025-10-15T10:54:27.562828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.562840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.562866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 204 partNo : 0 messageNo: 409 size 22415 offset: -1
2025-10-15T10:54:27.562955Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.562968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.562991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 205 partNo : 0 messageNo: 410 size 22525 offset: -1
2025-10-15T10:54:27.563093Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.563107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.563131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 206 partNo : 0 messageNo: 411 size 22635 offset: -1
2025-10-15T10:54:27.563167Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.563178Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.563211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.563221Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.563249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.563259Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.563287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.563298Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.563324Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.563333Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.564865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.564944Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.564976Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.565008Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.565036Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.565062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.565091Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.565117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.565143Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.565173Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.567621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 177 offsets: 176 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 87 }
2025-10-15T10:54:27.567672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 177
2025-10-15T10:54:27.567963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 178 offsets: 177 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 87 }
2025-10-15T10:54:27.567992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 178
2025-10-15T10:54:27.568132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 179 offsets: 178 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 87 }
2025-10-15T10:54:27.568155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 179
2025-10-15T10:54:27.568258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 180 offsets: 179 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 87 }
2025-10-15T10:54:27.568277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 180
2025-10-15T10:54:27.568388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 181 offsets: 180 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 87 }
2025-10-15T10:54:27.568407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 181
2025-10-15T10:54:27.568504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 182 offsets: 181 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 71 }
2025-10-15T10:54:27.568522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 182
2025-10-15T10:54:27.568639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 183 offsets: 182 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 71 }
2025-10-15T10:54:27.568659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 183
2025-10-15T10:54:27.568758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 184 offsets: 183 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 71 }
2025-10-15T10:54:27.568779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 184
2025-10-15T10:54:27.568873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 185 offsets: 184 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 71 }
2025-10-15T10:54:27.568891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 185
2025-10-15T10:54:27.568993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 186 offsets: 185 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 71 }
2025-10-15T10:54:27.569019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 186
2025-10-15T10:54:27.571423Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.571586Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 186 partNo 0 count 15 size 319986
2025-10-15T10:54:27.571672Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 172 partno 0 count 4 parts_count 0 source 1 size 76820 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.571706Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 18. All 1 blobs are from cache.
2025-10-15T10:54:27.571754Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.571807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.571835Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.571851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.571864Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.571880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.571891Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.571906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.571917Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.571933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.572171Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:27.572661Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 172 totakecount 4 count 4 size 76797 from pos 0 cbcount 4
2025-10-15T10:54:27.572790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 412  requestId: <none> cookie: 207
2025-10-15T10:54:27.572829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 413  requestId: <none> cookie: 208
2025-10-15T10:54:27.572849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 414  requestId: <none> cookie: 209
2025-10-15T10:54:27.572868Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 415  requestId: <none> cookie: 210
2025-10-15T10:54:27.572887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 416  requestId: <none> cookie: 211
2025-10-15T10:54:27.572965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 172
2025-10-15T10:54:27.574237Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 172 partno 0 count 4 parts 0 suffix '63'
2025-10-15T10:54:27.576867Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.576946Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.576976Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.577004Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.577034Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.577448Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.577515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.577754Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.577800Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.577837Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.578411Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 186 Result { Offset: 172 Data: "... 19005 bytes ..." SourceId: "\000src_id" SeqNo: 173 WriteTimestampMS: 1760525667398 CreateTimestampMS: 1760525665793 UncompressedSize: 18931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 173 Data: "... 19115 bytes ..." SourceId: "\000src_id" SeqNo: 174 WriteTimestampMS: 1760525667398 CreateTimestampMS: 1760525665793 UncompressedSize: 19041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 174 Data: "... 19225 bytes ..." SourceId: "\000src_id" SeqNo: 175 WriteTimestampMS: 1760525667398 CreateTimestampMS: 1760525665794 UncompressedSize: 19151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 175 Data: "... 19335 bytes ..." SourceId: "\000src_id" SeqNo: 176 WriteTimestampMS: 1760525667398 CreateTimestampMS: 1760525665794 UncompressedSize: 19261 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 76792 RealReadOffset: 175 WaitQuotaTimeMs: 0 EndOffset: 186 StartOffset: 0 } Cookie: 172 }
2025-10-15T10:54:27.578605Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 176 endOffset 186
2025-10-15T10:54:27.578642Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 186 ReadOffset 176 ReadGuid dad26748-120c004c-dfacbbda-4963250f has messages 1
2025-10-15T10:54:27.578717Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 176, endOffset# 186, WTime# 1760525667398, sizeLag# 76792
2025-10-15T10:54:27.578732Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:27.578788Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# dad26748-120c004c-dfacbbda-4963250f, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 76677
2025-10-15T10:54:27.578812Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# dad26748-120c004c-dfacbbda-4963250f
2025-10-15T10:54:27.579141Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 1
2025-10-15T10:54:27.579184Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 39ab465c-8f2454cf-c0bba92e-cbbb0710, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 92150, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:27.579285Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 92150 maxTimeLagMs 0 readTimestampMs 0 readOffset 176 EndOffset 186 ClientCommitOffset 0 committedOffset 0 Guid 39ab465c-8f2454cf-c0bba92e-cbbb0710
2025-10-15T10:54:27.583597Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 76677, now ReadSizeBudget = 0, ReadSizeServerDelta = 447611
2025-10-15T10:54:27.583722Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 447611
2025-10-15T10:54:27.583976Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (172-175)
2025-10-15T10:54:27.584031Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 76677 to budget
2025-10-15T10:54:27.584058Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 76677, ReadSizeServerDelta = 447611
2025-10-15T10:54:27.584335Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:27.584473Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (172-172)
2025-10-15T10:54:27.584553Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (173-173)
2025-10-15T10:54:27.584604Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (174-174)
2025-10-15T10:54:27.584641Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (175-175)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..18931 bytes.. Information: { Offset: 172 ProducerId: "src_id" SeqNo: 173 CreateTime: 2025-10-15T10:54:25.793000Z WriteTime: 2025-10-15T10:54:27.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19041 bytes.. Information: { Offset: 173 ProducerId: "src_id" SeqNo: 174 CreateTime: 2025-10-15T10:54:25.793000Z WriteTime: 2025-10-15T10:54:27.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19151 bytes.. Information: { Offset: 174 ProducerId: "src_id" SeqNo: 175 CreateTime: 2025-10-15T10:54:25.794000Z WriteTime: 2025-10-15T10:54:27.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19261 bytes.. Information: { Offset: 175 ProducerId: "src_id" SeqNo: 176 CreateTime: 2025-10-15T10:54:25.794000Z WriteTime: 2025-10-15T10:54:27.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:27.587855Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 4, size 76384 bytes
2025-10-15T10:54:27.587902Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:27.588408Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 76677 } }
2025-10-15T10:54:27.588580Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 6e46e81c-f57beb3c-5050093e-cab83c8c
2025-10-15T10:54:27.588634Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.589807Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.589852Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.589906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 207 partNo : 0 messageNo: 417 size 22745 offset: -1
2025-10-15T10:54:27.590020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590060Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 208 partNo : 0 messageNo: 418 size 22855 offset: -1
2025-10-15T10:54:27.590188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590218Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590242Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 209 partNo : 0 messageNo: 419 size 22965 offset: -1
2025-10-15T10:54:27.590346Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590388Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 210 partNo : 0 messageNo: 420 size 23075 offset: -1
2025-10-15T10:54:27.590475Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590517Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 211 partNo : 0 messageNo: 421 size 23185 offset: -1
2025-10-15T10:54:27.590551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590563Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590593Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590603Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590644Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590667Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590676Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590707Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590791Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.590804Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.590894Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.590942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.590954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.590972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.590983Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.590996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.591006Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.591021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.591035Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.591049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.591612Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 422  requestId: <none> cookie: 212
2025-10-15T10:54:27.591649Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 423  requestId: <none> cookie: 213
2025-10-15T10:54:27.591667Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 424  requestId: <none> cookie: 214
2025-10-15T10:54:27.591686Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 425  requestId: <none> cookie: 215
2025-10-15T10:54:27.591703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 426  requestId: <none> cookie: 216
2025-10-15T10:54:27.591770Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 19 Topic 'rt3.dc1--test-topic' partition 0 user user offset 176 count 12 size 92150 endOffset 186 max time lag 0ms effective offset 176
2025-10-15T10:54:27.591966Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 19 added 1 blobs, size 199606 count 10 last offset 176, current partition end offset: 186
2025-10-15T10:54:27.591982Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 19. Send blob request.
2025-10-15T10:54:27.592053Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 176 partno 0 count 10 parts_count 0 source 1 size 199606 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.592079Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 19. All 1 blobs are from cache.
2025-10-15T10:54:27.592138Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:27.592889Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 176 totakecount 10 count 10 size 199583 from pos 0 cbcount 10
2025-10-15T10:54:27.593064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 176
2025-10-15T10:54:27.593396Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 176 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:27.602902Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 186 count 15 size 319986 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.602971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.603027Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 319830 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.603065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603097Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 187, partNo: 0, Offset: 186 is stored on disk
2025-10-15T10:54:27.603119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603141Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 188, partNo: 0, Offset: 187 is stored on disk
2025-10-15T10:54:27.603154Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603174Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 189, partNo: 0, Offset: 188 is stored on disk
2025-10-15T10:54:27.603187Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603207Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 190, partNo: 0, Offset: 189 is stored on disk
2025-10-15T10:54:27.603221Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603242Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 191, partNo: 0, Offset: 190 is stored on disk
2025-10-15T10:54:27.603253Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603271Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 192, partNo: 0, Offset: 191 is stored on disk
2025-10-15T10:54:27.603283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603303Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 193, partNo: 0, Offset: 192 is stored on disk
2025-10-15T10:54:27.603314Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603334Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 194, partNo: 0, Offset: 193 is stored on disk
2025-10-15T10:54:27.603364Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603387Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 195, partNo: 0, Offset: 194 is stored on disk
2025-10-15T10:54:27.603400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603421Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 196, partNo: 0, Offset: 195 is stored on disk
2025-10-15T10:54:27.603433Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 197, partNo: 0, Offset: 196 is stored on disk
2025-10-15T10:54:27.603467Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603490Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 198, partNo: 0, Offset: 197 is stored on disk
2025-10-15T10:54:27.603503Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603524Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 199, partNo: 0, Offset: 198 is stored on disk
2025-10-15T10:54:27.603535Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603554Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 200, partNo: 0, Offset: 199 is stored on disk
2025-10-15T10:54:27.603567Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.603589Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 201, partNo: 0, Offset: 200 is stored on disk
2025-10-15T10:54:27.603923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.603982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.603993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:27.604091Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 202 partNo 0
2025-10-15T10:54:27.605037Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 202 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 22269 count 1 nextOffset 202 batches 1
2025-10-15T10:54:27.605097Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 203 partNo 0
2025-10-15T10:54:27.605133Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 203 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 44616 count 2 nextOffset 203 batches 1
2025-10-15T10:54:27.605154Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 204 partNo 0
2025-10-15T10:54:27.605176Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 204 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 67073 count 3 nextOffset 204 batches 1
2025-10-15T10:54:27.605196Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 205 partNo 0
2025-10-15T10:54:27.605218Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 205 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 89640 count 4 nextOffset 205 batches 1
2025-10-15T10:54:27.605236Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 206 partNo 0
2025-10-15T10:54:27.605259Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 206 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 112317 count 5 nextOffset 206 batches 1
2025-10-15T10:54:27.605279Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 207 partNo 0
2025-10-15T10:54:27.605296Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 207 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 135104 count 6 nextOffset 207 batches 1
2025-10-15T10:54:27.605316Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 208 partNo 0
2025-10-15T10:54:27.605336Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 208 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 158001 count 7 nextOffset 208 batches 1
2025-10-15T10:54:27.605356Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 209 partNo 0
2025-10-15T10:54:27.605373Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 209 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 181008 count 8 nextOffset 209 batches 1
2025-10-15T10:54:27.605391Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 210 partNo 0
2025-10-15T10:54:27.605411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 210 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 204125 count 9 nextOffset 210 batches 1
2025-10-15T10:54:27.605432Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 211 partNo 0
2025-10-15T10:54:27.605450Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 211 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 227352 count 10 nextOffset 211 batches 1
2025-10-15T10:54:27.605464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.606569Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 201,10 HeadOffset 201 endOffset 201 curOffset 211 d0000000000_00000000000000000201_00000_0000000010_00000? size 227106 WTime 1760525667603
2025-10-15T10:54:27.606949Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.607030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 377  requestId: <none> cookie: 187
2025-10-15T10:54:27.607162Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 186 partno 0 count 15 parts 0 suffix '63' size 319986
2025-10-15T10:54:27.611265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 187 offsets: 186 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:27.611316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 187
2025-10-15T10:54:27.607447Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 186 Result { Offset: 176 Data: "... 19445 bytes ..." SourceId: "\000src_id" SeqNo: 177 WriteTimestampMS: 1760525667427 CreateTimestampMS: 1760525665794 UncompressedSize: 19371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 177 Data: "... 19555 bytes ..." SourceId: "\000src_id" SeqNo: 178 WriteTimestampMS: 1760525667499 CreateTimestampMS: 1760525665795 UncompressedSize: 19481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 178 Data: "... 19665 bytes ..." SourceId: "\000src_id" SeqNo: 179 WriteTimestampMS: 1760525667499 CreateTimestampMS: 1760525665796 UncompressedSize: 19591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 179 Data: "... 19775 bytes ..." SourceId: "\000src_id" SeqNo: 180 WriteTimestampMS: 1760525667499 CreateTimestampMS: 1760525665796 UncompressedSize: 19701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 180 Data: "... 19885 bytes ..." SourceId: "\000src_id" SeqNo: 181 WriteTimestampMS: 1760525667499 CreateTimestampMS: 1760525665796 UncompressedSize: 19811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 181 Data: "... 19995 bytes ..." SourceId: "\000src_id" SeqNo: 182 WriteTimestampMS: 1760525667499 CreateTimestampMS: 1760525665796 UncompressedSize: 19921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 182 Data: "... 20105 bytes ..." SourceId: "\000src_id" SeqNo: 183 WriteTimestampMS: 1760525667499 CreateTimestampMS: 1760525665796 UncompressedSize: 20031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 183 Data: "... 20215 bytes ..." SourceId: "\000src_id" SeqNo: 184 WriteTimestampMS: 1760525667499 CreateTimestampMS: 1760525665796 UncompressedSize: 20141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 184 Data: "... 20325 bytes ..." SourceId: "\000src_id" SeqNo: 185 WriteTimestampMS: 1760525667499 CreateTimestampMS: 1760525665797 UncompressedSize: 20251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 185 Data: "... 20435 bytes ..." SourceId: "\000src_id" SeqNo: 186 WriteTimestampMS: 1760525667499 CreateTimestampMS: 1760525665797 UncompressedSize: 20361 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551402 RealReadOffset: 185 WaitQuotaTimeMs: 0 EndOffset: 186 StartOffset: 0 } Cookie: 176 }
2025-10-15T10:54:27.607878Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 14 from offset 186
2025-10-15T10:54:27.607926Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 186 ReadOffset 186 ReadGuid 39ab465c-8f2454cf-c0bba92e-cbbb0710 has messages 1
2025-10-15T10:54:27.608542Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 39ab465c-8f2454cf-c0bba92e-cbbb0710, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 199312
2025-10-15T10:54:27.608573Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 39ab465c-8f2454cf-c0bba92e-cbbb0710
2025-10-15T10:54:27.609167Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:27.609447Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.609496Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.609555Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.609583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.609611Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.609640Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.609672Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.610351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.611674Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 199312, now ReadSizeBudget = 0, ReadSizeServerDelta = 324976
2025-10-15T10:54:27.610409Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.610445Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.610483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.610518Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.611794Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 324976
2025-10-15T10:54:27.611980Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (176-185)
2025-10-15T10:54:27.612013Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 199312 to budget
2025-10-15T10:54:27.612046Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 199312, ReadSizeServerDelta = 324976
2025-10-15T10:54:27.612220Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:27.612338Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (176-176)
2025-10-15T10:54:27.612413Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (177-177)
2025-10-15T10:54:27.612457Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (178-178)
2025-10-15T10:54:27.612489Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (179-179)
2025-10-15T10:54:27.612549Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (180-180)
2025-10-15T10:54:27.612577Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (181-181)
2025-10-15T10:54:27.612607Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (182-182)
2025-10-15T10:54:27.612633Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (183-183)
2025-10-15T10:54:27.612890Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (184-184)
2025-10-15T10:54:27.612928Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (185-185)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..19371 bytes.. Information: { Offset: 176 ProducerId: "src_id" SeqNo: 177 CreateTime: 2025-10-15T10:54:25.794000Z WriteTime: 2025-10-15T10:54:27.427000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19481 bytes.. Information: { Offset: 177 ProducerId: "src_id" SeqNo: 178 CreateTime: 2025-10-15T10:54:25.795000Z WriteTime: 2025-10-15T10:54:27.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19591 bytes.. Information: { Offset: 178 ProducerId: "src_id" SeqNo: 179 CreateTime: 2025-10-15T10:54:25.796000Z WriteTime: 2025-10-15T10:54:27.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19701 bytes.. Information: { Offset: 179 ProducerId: "src_id" SeqNo: 180 CreateTime: 2025-10-15T10:54:25.796000Z WriteTime: 2025-10-15T10:54:27.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19811 bytes.. Information: { Offset: 180 ProducerId: "src_id" SeqNo: 181 CreateTime: 2025-10-15T10:54:25.796000Z WriteTime: 2025-10-15T10:54:27.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..19921 bytes.. Information: { Offset: 181 ProducerId: "src_id" SeqNo: 182 CreateTime: 2025-10-15T10:54:25.796000Z WriteTime: 2025-10-15T10:54:27.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20031 bytes.. Information: { Offset: 182 ProducerId: "src_id" SeqNo: 183 CreateTime: 2025-10-15T10:54:25.796000Z WriteTime: 2025-10-15T10:54:27.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20141 bytes.. Information: { Offset: 183 ProducerId: "src_id" SeqNo: 184 CreateTime: 2025-10-15T10:54:25.796000Z WriteTime: 2025-10-15T10:54:27.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20251 bytes.. Information: { Offset: 184 ProducerId: "src_id" SeqNo: 185 CreateTime: 2025-10-15T10:54:25.797000Z WriteTime: 2025-10-15T10:54:27.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20361 bytes.. Information: { Offset: 185 ProducerId: "src_id" SeqNo: 186 CreateTime: 2025-10-15T10:54:25.797000Z WriteTime: 2025-10-15T10:54:27.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:27.615057Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 10, size 198660 bytes
2025-10-15T10:54:27.615104Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:27.617075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 378  requestId: <none> cookie: 188
2025-10-15T10:54:27.617150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 379  requestId: <none> cookie: 189
2025-10-15T10:54:27.617179Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 380  requestId: <none> cookie: 190
2025-10-15T10:54:27.617207Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 381  requestId: <none> cookie: 191
2025-10-15T10:54:27.617237Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 387  requestId: <none> cookie: 192
2025-10-15T10:54:27.617264Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 388  requestId: <none> cookie: 193
2025-10-15T10:54:27.617294Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 389  requestId: <none> cookie: 194
2025-10-15T10:54:27.617320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 390  requestId: <none> cookie: 195
2025-10-15T10:54:27.617346Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 391  requestId: <none> cookie: 196
2025-10-15T10:54:27.617376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 397  requestId: <none> cookie: 197
2025-10-15T10:54:27.617404Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 398  requestId: <none> cookie: 198
2025-10-15T10:54:27.617431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 399  requestId: <none> cookie: 199
2025-10-15T10:54:27.617460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 400  requestId: <none> cookie: 200
2025-10-15T10:54:27.617490Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 401  requestId: <none> cookie: 201
2025-10-15T10:54:27.617530Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.617662Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 201 partNo 0 count 10 size 227106
2025-10-15T10:54:27.617768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.617854Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.617878Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.617933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 212 partNo : 0 messageNo: 427 size 23295 offset: -1
2025-10-15T10:54:27.618002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.618015Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.618040Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 213 partNo : 0 messageNo: 428 size 23405 offset: -1
2025-10-15T10:54:27.618093Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.618104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.618128Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 214 partNo : 0 messageNo: 429 size 23515 offset: -1
2025-10-15T10:54:27.618185Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.618198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.618220Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 215 partNo : 0 messageNo: 430 size 23625 offset: -1
2025-10-15T10:54:27.618271Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.618285Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.618306Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 216 partNo : 0 messageNo: 431 size 23735 offset: -1
2025-10-15T10:54:27.618339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.618350Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.618383Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.618392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.618425Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.618437Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.618464Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.618475Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.618506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.618518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.618698Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.618744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.618758Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.618773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.618786Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.618802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.618813Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.618827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.618838Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.618854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.618967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 432  requestId: <none> cookie: 217
2025-10-15T10:54:27.618996Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 433  requestId: <none> cookie: 218
2025-10-15T10:54:27.619013Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 434  requestId: <none> cookie: 219
2025-10-15T10:54:27.619031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 435  requestId: <none> cookie: 220
2025-10-15T10:54:27.619048Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 436  requestId: <none> cookie: 221
2025-10-15T10:54:27.631716Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 186 EndOffset 186 newEndOffset 201 commitOffset 0 clientCommitOffset 0 cookie 14 readingFinished 0 firstRead 0
2025-10-15T10:54:27.631759Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 186 endOffset 201
2025-10-15T10:54:27.633125Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 201 count 10 size 227106 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.633191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.633239Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 226970 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.633272Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633302Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 202, partNo: 0, Offset: 201 is stored on disk
2025-10-15T10:54:27.633320Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633339Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 203, partNo: 0, Offset: 202 is stored on disk
2025-10-15T10:54:27.633350Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633369Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 204, partNo: 0, Offset: 203 is stored on disk
2025-10-15T10:54:27.633381Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 205, partNo: 0, Offset: 204 is stored on disk
2025-10-15T10:54:27.633411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633431Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 206, partNo: 0, Offset: 205 is stored on disk
2025-10-15T10:54:27.633443Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633460Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 207, partNo: 0, Offset: 206 is stored on disk
2025-10-15T10:54:27.633470Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 208, partNo: 0, Offset: 207 is stored on disk
2025-10-15T10:54:27.633501Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633520Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 209, partNo: 0, Offset: 208 is stored on disk
2025-10-15T10:54:27.633530Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633547Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 210, partNo: 0, Offset: 209 is stored on disk
2025-10-15T10:54:27.633557Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.633574Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 211, partNo: 0, Offset: 210 is stored on disk
2025-10-15T10:54:27.633777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.633825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.633835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T10:54:27.633927Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 212 partNo 0
2025-10-15T10:54:27.634155Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 201 partno 0 count 10 parts 0 suffix '63' size 227106
2025-10-15T10:54:27.634750Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 212 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 23369 count 1 nextOffset 212 batches 1
2025-10-15T10:54:27.636044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 188 offsets: 187 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:27.636085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 188
2025-10-15T10:54:27.636263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 189 offsets: 188 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:27.636287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 189
2025-10-15T10:54:27.636397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 190 offsets: 189 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:27.636418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 190
2025-10-15T10:54:27.633728Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.633805Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.633855Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.633880Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.633906Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.633931Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.633957Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.633994Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634031Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634092Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634119Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634147Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634173Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634200Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634225Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634264Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634290Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634318Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634345Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.634798Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 213 partNo 0
2025-10-15T10:54:27.634840Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 213 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 46816 count 2 nextOffset 213 batches 1
2025-10-15T10:54:27.634863Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 214 partNo 0
2025-10-15T10:54:27.634885Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 214 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 70373 count 3 nextOffset 214 batches 1
2025-10-15T10:54:27.634908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 215 partNo 0
2025-10-15T10:54:27.634928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 215 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 94040 count 4 nextOffset 215 batches 1
2025-10-15T10:54:27.634948Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 216 partNo 0
2025-10-15T10:54:27.634971Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 216 partNo 0 FormedBlobsCount 0 NewHead: Offset 211 PartNo 0 PackedSize 117817 count 5 nextOffset 216 batches 1
2025-10-15T10:54:27.634988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.635758Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 211,5 HeadOffset 211 endOffset 211 curOffset 216 d0000000000_00000000000000000211_00000_0000000005_00000? size 117726 WTime 1760525667635
2025-10-15T10:54:27.635918Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.635983Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 407  requestId: <none> cookie: 202
2025-10-15T10:54:27.636044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 408  requestId: <none> cookie: 203
2025-10-15T10:54:27.636070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 409  requestId: <none> cookie: 204
2025-10-15T10:54:27.636094Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 410  requestId: <none> cookie: 205
2025-10-15T10:54:27.636118Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 411  requestId: <none> cookie: 206
2025-10-15T10:54:27.636141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 417  requestId: <none> cookie: 207
2025-10-15T10:54:27.636166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 418  requestId: <none> cookie: 208
2025-10-15T10:54:27.636190Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 419  requestId: <none> cookie: 209
2025-10-15T10:54:27.636215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 420  requestId: <none> cookie: 210
2025-10-15T10:54:27.636238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 421  requestId: <none> cookie: 211
2025-10-15T10:54:27.636269Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.636377Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 211 partNo 0 count 5 size 117726
2025-10-15T10:54:27.647592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.647639Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.647694Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 217 partNo : 0 messageNo: 437 size 23845 offset: -1
2025-10-15T10:54:27.647793Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.647805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.647826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 218 partNo : 0 messageNo: 438 size 23955 offset: -1
2025-10-15T10:54:27.647879Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.647890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.647912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 219 partNo : 0 messageNo: 439 size 24065 offset: -1
2025-10-15T10:54:27.647981Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.647991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.648013Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 220 partNo : 0 messageNo: 440 size 24175 offset: -1
2025-10-15T10:54:27.648063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.648074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.648094Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 221 partNo : 0 messageNo: 441 size 24285 offset: -1
2025-10-15T10:54:27.648163Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.648209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.648222Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.648236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.648246Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.648260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.648270Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.648287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.648297Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.648312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.652061Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.652159Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.652198Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.652239Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.652280Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.652330Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.652365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.652427Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.652459Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.652489Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.652522Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.652554Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.652584Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.652615Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.652645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.652674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.653444Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 199312 } }
2025-10-15T10:54:27.653511Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 186, endOffset# 201, WTime# 1760525667499, sizeLag# 319986
2025-10-15T10:54:27.653527Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:27.653570Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# f7b9f5e2-7dd30523-6c4ed0d1-ea766d5a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 324976, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:27.653638Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 31c52f89-890e9b38-89c33744-7c124994
2025-10-15T10:54:27.653866Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 324976 maxTimeLagMs 0 readTimestampMs 0 readOffset 186 EndOffset 201 ClientCommitOffset 0 committedOffset 0 Guid f7b9f5e2-7dd30523-6c4ed0d1-ea766d5a
2025-10-15T10:54:27.656603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 191 offsets: 190 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 32 }
2025-10-15T10:54:27.656643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 191
2025-10-15T10:54:27.656826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 192 offsets: 191 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:27.656851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 192
2025-10-15T10:54:27.656959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 193 offsets: 192 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:27.656983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 193
2025-10-15T10:54:27.657101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 194 offsets: 193 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:27.657120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 194
2025-10-15T10:54:27.657209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 195 offsets: 194 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:27.657229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 195
2025-10-15T10:54:27.657332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 196 offsets: 195 already_written: false write_statistics { persist_duration_ms: 56 queued_in_partition_duration_ms: 18 }
2025-10-15T10:54:27.657351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 196
2025-10-15T10:54:27.657437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 197 offsets: 196 already_written: false write_statistics { persist_duration_ms: 56 }
2025-10-15T10:54:27.657455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 197
2025-10-15T10:54:27.657542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 198 offsets: 197 already_written: false write_statistics { persist_duration_ms: 56 }
2025-10-15T10:54:27.657560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 198
2025-10-15T10:54:27.657645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 199 offsets: 198 already_written: false write_statistics { persist_duration_ms: 56 }
2025-10-15T10:54:27.657666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 199
2025-10-15T10:54:27.657767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 200 offsets: 199 already_written: false write_statistics { persist_duration_ms: 56 }
2025-10-15T10:54:27.657785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 200
2025-10-15T10:54:27.657879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 201 offsets: 200 already_written: false write_statistics { persist_duration_ms: 56 }
2025-10-15T10:54:27.657899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 201
2025-10-15T10:54:27.657994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 202 offsets: 201 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 31 }
2025-10-15T10:54:27.658014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 202
2025-10-15T10:54:27.658101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 203 offsets: 202 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 31 }
2025-10-15T10:54:27.658120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 203
2025-10-15T10:54:27.658212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 204 offsets: 203 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 31 }
2025-10-15T10:54:27.658233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 204
2025-10-15T10:54:27.658328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 205 offsets: 204 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 31 }
2025-10-15T10:54:27.658350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 205
2025-10-15T10:54:27.658439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 206 offsets: 205 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 31 }
2025-10-15T10:54:27.658460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 206
2025-10-15T10:54:27.658549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 207 offsets: 206 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 15 }
2025-10-15T10:54:27.658568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 207
2025-10-15T10:54:27.658665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 208 offsets: 207 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 15 }
2025-10-15T10:54:27.658687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 208
2025-10-15T10:54:27.658774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 209 offsets: 208 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 15 }
2025-10-15T10:54:27.658792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 209
2025-10-15T10:54:27.658942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 210 offsets: 209 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 15 }
2025-10-15T10:54:27.658966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 210
2025-10-15T10:54:27.659069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 211 offsets: 210 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 15 }
2025-10-15T10:54:27.659089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 211
2025-10-15T10:54:27.659570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.659624Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.659678Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.659689Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.659719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.659731Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.659760Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.659772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.659801Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.659813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.659886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.659905Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.660274Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 211 count 5 size 117726 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.660334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 442  requestId: <none> cookie: 222
2025-10-15T10:54:27.660371Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 443  requestId: <none> cookie: 223
2025-10-15T10:54:27.660391Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 444  requestId: <none> cookie: 224
2025-10-15T10:54:27.660409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 445  requestId: <none> cookie: 225
2025-10-15T10:54:27.660427Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 446  requestId: <none> cookie: 226
2025-10-15T10:54:27.660475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.660541Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 117610 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.660577Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.660607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 212, partNo: 0, Offset: 211 is stored on disk
2025-10-15T10:54:27.660626Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.660643Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 213, partNo: 0, Offset: 212 is stored on disk
2025-10-15T10:54:27.660653Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.660674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 214, partNo: 0, Offset: 213 is stored on disk
2025-10-15T10:54:27.660688Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.660710Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 215, partNo: 0, Offset: 214 is stored on disk
2025-10-15T10:54:27.660721Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.660740Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 216, partNo: 0, Offset: 215 is stored on disk
2025-10-15T10:54:27.660930Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.660970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.660980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T10:54:27.661076Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 217 partNo 0
2025-10-15T10:54:27.661950Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 211 partno 0 count 5 parts 0 suffix '63' size 117726
2025-10-15T10:54:27.663444Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.663564Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.663625Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.663652Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.663678Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.663707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.664378Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.664435Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.664467Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.664500Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.664534Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.671484Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.675437Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.675942Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.676213Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.676443Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.676662Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.676880Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.677103Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.677346Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.677594Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.677834Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.678070Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.726676Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 217 partNo 0 FormedBlobsCount 0 NewHead: Offset 216 PartNo 0 PackedSize 23919 count 1 nextOffset 217 batches 1
2025-10-15T10:54:27.726764Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 218 partNo 0
2025-10-15T10:54:27.726801Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 218 partNo 0 FormedBlobsCount 0 NewHead: Offset 216 PartNo 0 PackedSize 47916 count 2 nextOffset 218 batches 1
2025-10-15T10:54:27.726820Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 219 partNo 0
2025-10-15T10:54:27.726839Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 219 partNo 0 FormedBlobsCount 0 NewHead: Offset 216 PartNo 0 PackedSize 72023 count 3 nextOffset 219 batches 1
2025-10-15T10:54:27.726857Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 220 partNo 0
2025-10-15T10:54:27.726876Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 220 partNo 0 FormedBlobsCount 0 NewHead: Offset 216 PartNo 0 PackedSize 96240 count 4 nextOffset 220 batches 1
2025-10-15T10:54:27.726895Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 221 partNo 0
2025-10-15T10:54:27.726916Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 221 partNo 0 FormedBlobsCount 0 NewHead: Offset 216 PartNo 0 PackedSize 120567 count 5 nextOffset 221 batches 1
2025-10-15T10:54:27.726931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.727647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 216,5 HeadOffset 216 endOffset 216 curOffset 221 d0000000000_00000000000000000216_00000_0000000005_00000? size 120476 WTime 1760525667725
2025-10-15T10:54:27.727826Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.727923Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 20 Topic 'rt3.dc1--test-topic' partition 0 user user offset 186 count 18 size 324976 endOffset 216 max time lag 0ms effective offset 186
2025-10-15T10:54:27.728294Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 20 added 2 blobs, size 547092 count 25 last offset 201, current partition end offset: 216
2025-10-15T10:54:27.728311Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 20. Send blob request.
2025-10-15T10:54:27.728366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 427  requestId: <none> cookie: 212
2025-10-15T10:54:27.728444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 428  requestId: <none> cookie: 213
2025-10-15T10:54:27.728472Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 429  requestId: <none> cookie: 214
2025-10-15T10:54:27.728500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 430  requestId: <none> cookie: 215
2025-10-15T10:54:27.728527Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 431  requestId: <none> cookie: 216
2025-10-15T10:54:27.728631Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.728660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.728713Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 222 partNo : 0 messageNo: 447 size 24395 offset: -1
2025-10-15T10:54:27.728795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.728811Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.728839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 223 partNo : 0 messageNo: 448 size 24505 offset: -1
2025-10-15T10:54:27.728902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.728916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.728939Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 224 partNo : 0 messageNo: 449 size 24615 offset: -1
2025-10-15T10:54:27.729002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.729015Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.729039Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 225 partNo : 0 messageNo: 450 size 24725 offset: -1
2025-10-15T10:54:27.729096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.729108Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.729131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 226 partNo : 0 messageNo: 451 size 24835 offset: -1
2025-10-15T10:54:27.729163Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.729177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.729211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.729224Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.729256Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.729269Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.729302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.729315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.729347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.729360Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.729396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.729418Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.729529Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 216 partNo 0 count 5 size 120476
2025-10-15T10:54:27.729594Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 186 partno 0 count 15 parts_count 0 source 1 size 319986 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.729617Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 201 partno 0 count 10 parts_count 0 source 1 size 227106 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.729826Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 186 partno 0 count 15 parts 0 suffix '63'
2025-10-15T10:54:27.729844Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 201 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:27.730996Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 20. All 2 blobs are from cache.
2025-10-15T10:54:27.735472Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.735572Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.735606Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.735635Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.735661Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.737124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 212 offsets: 211 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.737169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 212
2025-10-15T10:54:27.737344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 213 offsets: 212 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.737364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 213
2025-10-15T10:54:27.737461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 214 offsets: 213 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.737484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 214
2025-10-15T10:54:27.737580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 215 offsets: 214 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.737600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 215
2025-10-15T10:54:27.737697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 216 offsets: 215 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.737734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 216
2025-10-15T10:54:27.742009Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.742079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.742098Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.742117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.742131Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.742152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.742165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.742182Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.742192Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.742209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.742489Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-10-15T10:54:27.743640Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 186 totakecount 15 count 15 size 319963 from pos 0 cbcount 15
2025-10-15T10:54:27.744476Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 201 totakecount 10 count 10 size 227083 from pos 0 cbcount 10
2025-10-15T10:54:27.744637Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 452  requestId: <none> cookie: 227
2025-10-15T10:54:27.744706Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 453  requestId: <none> cookie: 228
2025-10-15T10:54:27.744729Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 454  requestId: <none> cookie: 229
2025-10-15T10:54:27.744755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 455  requestId: <none> cookie: 230
2025-10-15T10:54:27.744781Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 456  requestId: <none> cookie: 231
2025-10-15T10:54:27.744932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 186
2025-10-15T10:54:27.749052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749102Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749169Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 227 partNo : 0 messageNo: 457 size 24945 offset: -1
2025-10-15T10:54:27.749262Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 228 partNo : 0 messageNo: 458 size 25055 offset: -1
2025-10-15T10:54:27.749384Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749396Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 229 partNo : 0 messageNo: 459 size 25165 offset: -1
2025-10-15T10:54:27.749476Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749487Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 230 partNo : 0 messageNo: 460 size 25275 offset: -1
2025-10-15T10:54:27.749565Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749609Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 231 partNo : 0 messageNo: 461 size 25385 offset: -1
2025-10-15T10:54:27.749641Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749689Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749754Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749782Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749791Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749817Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.749828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.749855Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.749914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.749933Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.749951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.749961Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.749977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.749989Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.750004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.750015Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.750028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.750163Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 462  requestId: <none> cookie: 232
2025-10-15T10:54:27.750217Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 463  requestId: <none> cookie: 233
2025-10-15T10:54:27.750239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 464  requestId: <none> cookie: 234
2025-10-15T10:54:27.750263Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 465  requestId: <none> cookie: 235
2025-10-15T10:54:27.750287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 466  requestId: <none> cookie: 236
2025-10-15T10:54:27.747443Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.747531Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.747559Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.747586Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.747611Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.748059Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.748122Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.748313Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.748349Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.748385Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.750031Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 216 Result { Offset: 186 Data: "... 20545 bytes ..." SourceId: "\000src_id" SeqNo: 187 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665797 UncompressedSize: 20471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 187 Data: "... 20655 bytes ..." SourceId: "\000src_id" SeqNo: 188 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665797 UncompressedSize: 20581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 188 Data: "... 20765 bytes ..." SourceId: "\000src_id" SeqNo: 189 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665797 UncompressedSize: 20691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 189 Data: "... 20875 bytes ..." SourceId: "\000src_id" SeqNo: 190 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665797 UncompressedSize: 20801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 190 Data: "... 20985 bytes ..." SourceId: "\000src_id" SeqNo: 191 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665798 UncompressedSize: 20911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 191 Data: "... 21095 bytes ..." SourceId: "\000src_id" SeqNo: 192 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665798 UncompressedSize: 21021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 192 Data: "... 21205 bytes ..." SourceId: "\000src_id" SeqNo: 193 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665798 UncompressedSize: 21131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 193 Data: "... 21315 bytes ..." SourceId: "\000src_id" SeqNo: 194 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665798 UncompressedSize: 21241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 194 Data: "... 21425 bytes ..." SourceId: "\000src_id" SeqNo: 195 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665798 UncompressedSize: 21351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 195 Data: "... 21535 bytes ..." SourceId: "\000src_id" SeqNo: 196 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665798 UncompressedSize: 21461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 196 Data: "... 21645 bytes ..." SourceId: "\000src_id" SeqNo: 197 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665799 UncompressedSize: 21571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 197 Data: "... 21755 bytes ..." SourceId: "\000src_id" SeqNo: 198 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665799 UncompressedSize: 21681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 198 Data: "... 21865 bytes ..." SourceId: "\000src_id" SeqNo: 199 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665800 UncompressedSize: 21791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 199 Data: "... 21975 bytes ..." SourceId: "\000src_id" SeqNo: 200 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665803 UncompressedSize: 21901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 200 Data: "... 22085 bytes ..." SourceId: "\000src_id" SeqNo: 201 WriteTimestampMS: 1760525667543 CreateTimestampMS: 1760525665803 UncompressedSize: 22011 PartitionKey: "" ExplicitHash: "" } Result { Offset: 201 Data: "... 22195 bytes ..." SourceId: "\000src_id" SeqNo: 202 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665804 UncompressedSize: 22121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 202 Data: "... 22305 bytes ..." SourceId: "\000src_id" SeqNo: 203 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665804 UncompressedSize: 22231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 203 Data: "... 22415 bytes ..." SourceId: "\000src_id" SeqNo: 204 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665804 UncompressedSize: 22341 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 479682 RealReadOffset: 203 WaitQuotaTimeMs: 0 EndOffset: 216 StartOffset: 0 } Cookie: 186 }
2025-10-15T10:54:27.751112Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 204 endOffset 216
2025-10-15T10:54:27.751146Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 216 ReadOffset 204 ReadGuid f7b9f5e2-7dd30523-6c4ed0d1-ea766d5a has messages 1
2025-10-15T10:54:27.751274Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 204, endOffset# 216, WTime# 1760525667603, sizeLag# 479682
2025-10-15T10:54:27.751299Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:27.759519Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# f7b9f5e2-7dd30523-6c4ed0d1-ea766d5a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 386280
2025-10-15T10:54:27.759597Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# f7b9f5e2-7dd30523-6c4ed0d1-ea766d5a
2025-10-15T10:54:27.760465Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 1
2025-10-15T10:54:27.760522Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 7a1b74a7-284814de-f9058abf-f2b1ee04, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 14, size# 138008, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:27.760711Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.760789Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.760820Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.760848Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.760875Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.760914Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.761601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.761664Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.761703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.761757Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.761792Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.761958Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 14 maxSize 138008 maxTimeLagMs 0 readTimestampMs 0 readOffset 204 EndOffset 216 ClientCommitOffset 0 committedOffset 0 Guid 7a1b74a7-284814de-f9058abf-f2b1ee04
2025-10-15T10:54:27.764869Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 386280, now ReadSizeBudget = 0, ReadSizeServerDelta = 138008
2025-10-15T10:54:27.765021Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 138008
2025-10-15T10:54:27.762149Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 216 count 5 size 120476 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.762215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.767599Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (186-203)
2025-10-15T10:54:27.767660Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 386280 to budget
2025-10-15T10:54:27.767695Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 386280, ReadSizeServerDelta = 138008
2025-10-15T10:54:27.767999Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:27.768127Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (186-186)
2025-10-15T10:54:27.768241Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (187-187)
2025-10-15T10:54:27.768393Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (188-188)
2025-10-15T10:54:27.768612Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (189-189)
2025-10-15T10:54:27.768837Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (190-190)
2025-10-15T10:54:27.768907Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (191-191)
2025-10-15T10:54:27.768975Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (192-192)
2025-10-15T10:54:27.762267Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 120360 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.762301Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.769041Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (193-193)
2025-10-15T10:54:27.762335Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 217, partNo: 0, Offset: 216 is stored on disk
2025-10-15T10:54:27.762371Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.762390Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 218, partNo: 0, Offset: 217 is stored on disk
2025-10-15T10:54:27.762404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.762423Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 219, partNo: 0, Offset: 218 is stored on disk
2025-10-15T10:54:27.762435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.762455Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 220, partNo: 0, Offset: 219 is stored on disk
2025-10-15T10:54:27.762467Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.762483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 221, partNo: 0, Offset: 220 is stored on disk
2025-10-15T10:54:27.762660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.762714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.762724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:27.762815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 222 partNo 0
2025-10-15T10:54:27.763020Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 216 partno 0 count 5 parts 0 suffix '63' size 120476
2025-10-15T10:54:27.769368Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 386280 } }
2025-10-15T10:54:27.769518Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 56362534-7c81ebef-1151a154-76fe1bd2
2025-10-15T10:54:27.769566Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.769588Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 222 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 24469 count 1 nextOffset 222 batches 1
2025-10-15T10:54:27.769673Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 223 partNo 0
2025-10-15T10:54:27.769809Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 223 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 49016 count 2 nextOffset 223 batches 1
2025-10-15T10:54:27.769836Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 224 partNo 0
2025-10-15T10:54:27.769860Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 224 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 73673 count 3 nextOffset 224 batches 1
2025-10-15T10:54:27.769885Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 225 partNo 0
2025-10-15T10:54:27.769908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 225 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 98440 count 4 nextOffset 225 batches 1
2025-10-15T10:54:27.769929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 226 partNo 0
2025-10-15T10:54:27.769952Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 226 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 123317 count 5 nextOffset 226 batches 1
2025-10-15T10:54:27.769974Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 227 partNo 0
2025-10-15T10:54:27.769994Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 227 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 148304 count 6 nextOffset 227 batches 1
2025-10-15T10:54:27.770016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 228 partNo 0
2025-10-15T10:54:27.770034Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 228 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 173401 count 7 nextOffset 228 batches 1
2025-10-15T10:54:27.770055Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 229 partNo 0
2025-10-15T10:54:27.770077Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 229 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 198608 count 8 nextOffset 229 batches 1
2025-10-15T10:54:27.770098Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 230 partNo 0
2025-10-15T10:54:27.770120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 230 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 223925 count 9 nextOffset 230 batches 1
2025-10-15T10:54:27.770139Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 231 partNo 0
2025-10-15T10:54:27.770162Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 231 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 249352 count 10 nextOffset 231 batches 1
2025-10-15T10:54:27.770178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.771382Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 221,10 HeadOffset 221 endOffset 221 curOffset 231 d0000000000_00000000000000000221_00000_0000000010_00000? size 249106 WTime 1760525667770
2025-10-15T10:54:27.771774Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.771857Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 437  requestId: <none> cookie: 217
2025-10-15T10:54:27.771944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 438  requestId: <none> cookie: 218
2025-10-15T10:54:27.771971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 439  requestId: <none> cookie: 219
2025-10-15T10:54:27.771999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 440  requestId: <none> cookie: 220
2025-10-15T10:54:27.772027Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 441  requestId: <none> cookie: 221
2025-10-15T10:54:27.772134Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.772161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.772216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 232 partNo : 0 messageNo: 467 size 25495 offset: -1
2025-10-15T10:54:27.772311Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.772325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.772415Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.772427Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.772453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 233 partNo : 0 messageNo: 468 size 25605 offset: -1
2025-10-15T10:54:27.772514Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.772529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.772550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 234 partNo : 0 messageNo: 469 size 25715 offset: -1
2025-10-15T10:54:27.772608Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.772620Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.772642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 235 partNo : 0 messageNo: 470 size 25825 offset: -1
2025-10-15T10:54:27.772704Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.772714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.772736Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 236 partNo : 0 messageNo: 471 size 25935 offset: -1
2025-10-15T10:54:27.772761Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.772873Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 221 partNo 0 count 10 size 249106
2025-10-15T10:54:27.777916Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.778004Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.778033Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.778060Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.778091Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.778134Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.779314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 217 offsets: 216 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 78 }
2025-10-15T10:54:27.779372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 217
2025-10-15T10:54:27.779940Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (194-194)
2025-10-15T10:54:27.780030Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (195-195)
2025-10-15T10:54:27.780094Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (196-196)
2025-10-15T10:54:27.780166Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (197-197)
2025-10-15T10:54:27.780239Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (198-198)
2025-10-15T10:54:27.772910Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.772960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.772990Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.773005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.773016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.773034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.773046Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.773059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.773071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.773089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.773440Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 21 Topic 'rt3.dc1--test-topic' partition 0 user user offset 204 count 14 size 138008 endOffset 221 max time lag 0ms effective offset 204
2025-10-15T10:54:27.781308Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 21 added 3 blobs, size 238202 count 17 last offset 216, current partition end offset: 221
2025-10-15T10:54:27.781338Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 21. Send blob request.
2025-10-15T10:54:27.781466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.781492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.781537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.781550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.781599Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 201 partno 0 count 10 parts_count 0 source 1 size 227106 accessed 1 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.781625Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 211 partno 0 count 5 parts_count 0 source 1 size 117726 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.781647Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 216 partno 0 count 5 parts_count 0 source 1 size 120476 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.781685Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 21. All 3 blobs are from cache.
2025-10-15T10:54:27.782272Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 3 blobs
2025-10-15T10:54:27.785394Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 201 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:27.785426Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 211 partno 0 count 5 parts 0 suffix '63'
2025-10-15T10:54:27.785445Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 216 partno 0 count 5 parts 0 suffix '63'
2025-10-15T10:54:27.786913Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.792133Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.795254Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (199-199)
2025-10-15T10:54:27.795360Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (200-200)
2025-10-15T10:54:27.795461Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (201-201)
2025-10-15T10:54:27.802508Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (202-202)
2025-10-15T10:54:27.803056Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (203-203)
>>> event from dataHandler: 2025-10-15T10:54:27.806839Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.807157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 218 offsets: 217 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 78 }
2025-10-15T10:54:27.807208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 218
2025-10-15T10:54:27.807413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 219 offsets: 218 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 78 }
2025-10-15T10:54:27.807435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 219
2025-10-15T10:54:27.807545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 220 offsets: 219 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 78 }
2025-10-15T10:54:27.807573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 220
2025-10-15T10:54:27.807262Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.807691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 221 offsets: 220 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 78 }
2025-10-15T10:54:27.807714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 221
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..20471 bytes.. Information: { Offset: 186 ProducerId: "src_id" SeqNo: 187 CreateTime: 2025-10-15T10:54:25.797000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20581 bytes.. Information: { Offset: 187 ProducerId: "src_id" SeqNo: 188 CreateTime: 2025-10-15T10:54:25.797000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20691 bytes.. Information: { Offset: 188 ProducerId: "src_id" SeqNo: 189 CreateTime: 2025-10-15T10:54:25.797000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20801 bytes.. Information: { Offset: 189 ProducerId: "src_id" SeqNo: 190 CreateTime: 2025-10-15T10:54:25.797000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..20911 bytes.. Information: { Offset: 190 ProducerId: "src_id" SeqNo: 191 CreateTime: 2025-10-15T10:54:25.798000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21021 bytes.. Information: { Offset: 191 ProducerId: "src_id" SeqNo: 192 CreateTime: 2025-10-15T10:54:25.798000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21131 bytes.. Information: { Offset: 192 ProducerId: "src_id" SeqNo: 193 CreateTime: 2025-10-15T10:54:25.798000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21241 bytes.. Information: { Offset: 193 ProducerId: "src_id" SeqNo: 194 CreateTime: 2025-10-15T10:54:25.798000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21351 bytes.. Information: { Offset: 194 ProducerId: "src_id" SeqNo: 195 CreateTime: 2025-10-15T10:54:25.798000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21461 bytes.. Information: { Offset: 195 ProducerId: "src_id" SeqNo: 196 CreateTime: 2025-10-15T10:54:25.798000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21571 bytes.. Information: { Offset: 196 ProducerId: "src_id" SeqNo: 197 CreateTime: 2025-10-15T10:54:25.799000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21681 bytes.. Information: { Offset: 197 ProducerId: "src_id" SeqNo: 198 CreateTime: 2025-10-15T10:54:25.799000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21791 bytes.. Information: { Offset: 198 ProducerId: "src_id" SeqNo: 199 CreateTime: 2025-10-15T10:54:25.800000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..21901 bytes.. Information: { Offset: 199 ProducerId: "src_id" SeqNo: 200 CreateTime: 2025-10-15T10:54:25.803000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22011 bytes.. Information: { Offset: 200 ProducerId: "src_id" SeqNo: 201 CreateTime: 2025-10-15T10:54:25.803000Z WriteTime: 2025-10-15T10:54:27.543000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22121 bytes.. Information: { Offset: 201 ProducerId: "src_id" SeqNo: 202 CreateTime: 2025-10-15T10:54:25.804000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22231 bytes.. Information: { Offset: 202 ProducerId: "src_id" SeqNo: 203 CreateTime: 2025-10-15T10:54:25.804000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22341 bytes.. Information: { Offset: 203 ProducerId: "src_id" SeqNo: 204 CreateTime: 2025-10-15T10:54:25.804000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:27.808577Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 18, size 385308 bytes
2025-10-15T10:54:27.808633Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:27.835701Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 201 totakecount 10 count 10 size 227083 from pos 3 cbcount 10
2025-10-15T10:54:27.836445Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 211 totakecount 5 count 5 size 117703 from pos 0 cbcount 5
2025-10-15T10:54:27.836994Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 216 totakecount 5 count 5 size 120453 from pos 0 cbcount 5
2025-10-15T10:54:27.837165Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 472  requestId: <none> cookie: 237
2025-10-15T10:54:27.837242Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 473  requestId: <none> cookie: 238
2025-10-15T10:54:27.837310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.837339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.837385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.837399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.837428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.837438Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.837671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.837768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 204
2025-10-15T10:54:27.837924Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 221 count 10 size 249106 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.838186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 474  requestId: <none> cookie: 239
2025-10-15T10:54:27.838209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 475  requestId: <none> cookie: 240
2025-10-15T10:54:27.838230Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 476  requestId: <none> cookie: 241
2025-10-15T10:54:27.838250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.838301Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 248970 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.838337Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838366Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 222, partNo: 0, Offset: 221 is stored on disk
2025-10-15T10:54:27.838386Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 223, partNo: 0, Offset: 222 is stored on disk
2025-10-15T10:54:27.838415Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838434Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 224, partNo: 0, Offset: 223 is stored on disk
2025-10-15T10:54:27.838447Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838465Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 225, partNo: 0, Offset: 224 is stored on disk
2025-10-15T10:54:27.838476Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838496Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 226, partNo: 0, Offset: 225 is stored on disk
2025-10-15T10:54:27.838509Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838527Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 227, partNo: 0, Offset: 226 is stored on disk
2025-10-15T10:54:27.838537Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838559Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 228, partNo: 0, Offset: 227 is stored on disk
2025-10-15T10:54:27.838570Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838589Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 229, partNo: 0, Offset: 228 is stored on disk
2025-10-15T10:54:27.838601Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838618Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 230, partNo: 0, Offset: 229 is stored on disk
2025-10-15T10:54:27.838628Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.838647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 231, partNo: 0, Offset: 230 is stored on disk
2025-10-15T10:54:27.838817Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.838858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.838869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T10:54:27.838958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 232 partNo 0
2025-10-15T10:54:27.848484Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 221 partno 0 count 10 parts 0 suffix '63' size 249106
2025-10-15T10:54:27.863752Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.863841Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.863924Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.863953Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.863983Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.864009Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.864606Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.864839Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.864882Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.864922Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.864961Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.866670Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 221 Result { Offset: 204 Data: "... 22525 bytes ..." SourceId: "\000src_id" SeqNo: 205 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665804 UncompressedSize: 22451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 205 Data: "... 22635 bytes ..." SourceId: "\000src_id" SeqNo: 206 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665804 UncompressedSize: 22561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 206 Data: "... 22745 bytes ..." SourceId: "\000src_id" SeqNo: 207 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665808 UncompressedSize: 22671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 207 Data: "... 22855 bytes ..." SourceId: "\000src_id" SeqNo: 208 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665808 UncompressedSize: 22781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 208 Data: "... 22965 bytes ..." SourceId: "\000src_id" SeqNo: 209 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665808 UncompressedSize: 22891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 209 Data: "... 23075 bytes ..." SourceId: "\000src_id" SeqNo: 210 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665808 UncompressedSize: 23001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 210 Data: "... 23185 bytes ..." SourceId: "\000src_id" SeqNo: 211 WriteTimestampMS: 1760525667603 CreateTimestampMS: 1760525665808 UncompressedSize: 23111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 211 Data: "... 23295 bytes ..." SourceId: "\000src_id" SeqNo: 212 WriteTimestampMS: 1760525667631 CreateTimestampMS: 1760525665808 UncompressedSize: 23221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 212 Data: "... 23405 bytes ..." SourceId: "\000src_id" SeqNo: 213 WriteTimestampMS: 1760525667631 CreateTimestampMS: 1760525665809 UncompressedSize: 23331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 213 Data: "... 23515 bytes ..." SourceId: "\000src_id" SeqNo: 214 WriteTimestampMS: 1760525667631 CreateTimestampMS: 1760525665809 UncompressedSize: 23441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 214 Data: "... 23625 bytes ..." SourceId: "\000src_id" SeqNo: 215 WriteTimestampMS: 1760525667631 CreateTimestampMS: 1760525665809 UncompressedSize: 23551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 215 Data: "... 23735 bytes ..." SourceId: "\000src_id" SeqNo: 216 WriteTimestampMS: 1760525667631 CreateTimestampMS: 1760525665809 UncompressedSize: 23661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 216 Data: "... 23845 bytes ..." SourceId: "\000src_id" SeqNo: 217 WriteTimestampMS: 1760525667660 CreateTimestampMS: 1760525665809 UncompressedSize: 23771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 217 Data: "... 23955 bytes ..." SourceId: "\000src_id" SeqNo: 218 WriteTimestampMS: 1760525667725 CreateTimestampMS: 1760525665809 UncompressedSize: 23881 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 3 SizeLag: 245990 RealReadOffset: 217 WaitQuotaTimeMs: 0 EndOffset: 221 StartOffset: 0 } Cookie: 204 }
2025-10-15T10:54:27.883883Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 218 endOffset 221
2025-10-15T10:54:27.883953Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 221 ReadOffset 218 ReadGuid 7a1b74a7-284814de-f9058abf-f2b1ee04 has messages 1
2025-10-15T10:54:27.884120Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.884461Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 218, endOffset# 221, WTime# 1760525667725, sizeLag# 245990
2025-10-15T10:54:27.884477Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:27.884557Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 7a1b74a7-284814de-f9058abf-f2b1ee04, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 325374
2025-10-15T10:54:27.884588Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 7a1b74a7-284814de-f9058abf-f2b1ee04
2025-10-15T10:54:27.885297Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 1
2025-10-15T10:54:27.885344Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# a988ccb7-7fa95f3a-d73d33db-aa140837, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 198914, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:27.905511Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 325374, now ReadSizeBudget = 0, ReadSizeServerDelta = 198914
2025-10-15T10:54:27.905668Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 198914
2025-10-15T10:54:27.905068Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 198914 maxTimeLagMs 0 readTimestampMs 0 readOffset 218 EndOffset 221 ClientCommitOffset 0 committedOffset 0 Guid a988ccb7-7fa95f3a-d73d33db-aa140837
2025-10-15T10:54:27.905656Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.906734Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (204-217)
2025-10-15T10:54:27.906787Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 325374 to budget
2025-10-15T10:54:27.906821Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 325374, ReadSizeServerDelta = 198914
2025-10-15T10:54:27.907076Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:27.907190Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (204-204)
2025-10-15T10:54:27.907296Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (205-205)
2025-10-15T10:54:27.907440Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (206-206)
2025-10-15T10:54:27.907671Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (207-207)
2025-10-15T10:54:27.907894Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (208-208)
2025-10-15T10:54:27.907970Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (209-209)
2025-10-15T10:54:27.908038Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (210-210)
2025-10-15T10:54:27.908101Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (211-211)
2025-10-15T10:54:27.910809Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.912049Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (212-212)
2025-10-15T10:54:27.912139Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (213-213)
2025-10-15T10:54:27.912204Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (214-214)
2025-10-15T10:54:27.912261Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (215-215)
2025-10-15T10:54:27.912322Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (216-216)
2025-10-15T10:54:27.912493Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 325374 } }
2025-10-15T10:54:27.912665Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 30c4e976-ab0c4943-2dcc2ffc-1c871e05
2025-10-15T10:54:27.912710Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.916096Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (217-217)
2025-10-15T10:54:27.916362Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.917120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 232 partNo 0 FormedBlobsCount 0 NewHead: Offset 231 PartNo 0 PackedSize 25569 count 1 nextOffset 232 batches 1
2025-10-15T10:54:27.917206Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 233 partNo 0
2025-10-15T10:54:27.917250Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 233 partNo 0 FormedBlobsCount 0 NewHead: Offset 231 PartNo 0 PackedSize 51216 count 2 nextOffset 233 batches 1
2025-10-15T10:54:27.917276Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 234 partNo 0
2025-10-15T10:54:27.917299Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 234 partNo 0 FormedBlobsCount 0 NewHead: Offset 231 PartNo 0 PackedSize 76973 count 3 nextOffset 234 batches 1
2025-10-15T10:54:27.917322Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 235 partNo 0
2025-10-15T10:54:27.917344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 235 partNo 0 FormedBlobsCount 0 NewHead: Offset 231 PartNo 0 PackedSize 102840 count 4 nextOffset 235 batches 1
2025-10-15T10:54:27.917364Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 236 partNo 0
2025-10-15T10:54:27.917387Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 236 partNo 0 FormedBlobsCount 0 NewHead: Offset 231 PartNo 0 PackedSize 128817 count 5 nextOffset 236 batches 1
2025-10-15T10:54:27.917407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.918233Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 231,5 HeadOffset 231 endOffset 231 curOffset 236 d0000000000_00000000000000000231_00000_0000000005_00000? size 128726 WTime 1760525667917
2025-10-15T10:54:27.918423Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.918522Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 447  requestId: <none> cookie: 222
2025-10-15T10:54:27.918588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 448  requestId: <none> cookie: 223
2025-10-15T10:54:27.918615Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 449  requestId: <none> cookie: 224
2025-10-15T10:54:27.918643Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 450  requestId: <none> cookie: 225
2025-10-15T10:54:27.918669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 451  requestId: <none> cookie: 226
2025-10-15T10:54:27.918701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 457  requestId: <none> cookie: 227
2025-10-15T10:54:27.918727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 458  requestId: <none> cookie: 228
2025-10-15T10:54:27.918753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 459  requestId: <none> cookie: 229
2025-10-15T10:54:27.918778Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 460  requestId: <none> cookie: 230
2025-10-15T10:54:27.918803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 461  requestId: <none> cookie: 231
2025-10-15T10:54:27.918906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.918930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.918982Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 237 partNo : 0 messageNo: 477 size 26045 offset: -1
2025-10-15T10:54:27.919075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.919089Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.919111Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 238 partNo : 0 messageNo: 478 size 26155 offset: -1
2025-10-15T10:54:27.919188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.919200Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.919220Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 239 partNo : 0 messageNo: 479 size 26265 offset: -1
2025-10-15T10:54:27.920859Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.920929Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.920959Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.920985Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.921011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.921040Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.921067Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.921094Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.921120Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.921148Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.922757Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.922808Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.922835Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.922862Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.922889Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.920051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.920079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.920125Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 240 partNo : 0 messageNo: 480 size 26375 offset: -1
2025-10-15T10:54:27.920221Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.920234Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.920257Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 241 partNo : 0 messageNo: 481 size 26485 offset: -1
2025-10-15T10:54:27.920291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.920302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.920336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.920346Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.920376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.920387Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.920416Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.920427Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.920466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.920476Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.920545Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.920559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.920599Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.920718Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 231 partNo 0 count 5 size 128726
2025-10-15T10:54:27.920756Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.920802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.920815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.920831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.920840Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.920854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.920865Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.923560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 222 offsets: 221 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 24 }
2025-10-15T10:54:27.923317Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.923406Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.923458Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.923493Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.923533Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.920880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.920889Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.920901Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.921106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 482  requestId: <none> cookie: 242
2025-10-15T10:54:27.921143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 483  requestId: <none> cookie: 243
2025-10-15T10:54:27.921162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 484  requestId: <none> cookie: 244
2025-10-15T10:54:27.921180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 485  requestId: <none> cookie: 245
2025-10-15T10:54:27.921196Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 486  requestId: <none> cookie: 246
2025-10-15T10:54:27.921284Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 22 Topic 'rt3.dc1--test-topic' partition 0 user user offset 218 count 3 size 198914 endOffset 231 max time lag 0ms effective offset 218
2025-10-15T10:54:27.921457Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 22 added 1 blobs, size 0 count 3 last offset 216, current partition end offset: 231
2025-10-15T10:54:27.921471Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 22. Send blob request.
2025-10-15T10:54:27.921525Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 216 partno 0 count 5 parts_count 0 source 1 size 120476 accessed 1 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.921548Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 22. All 1 blobs are from cache.
2025-10-15T10:54:27.921595Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:27.922709Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 216 partno 0 count 5 parts 0 suffix '63'
2025-10-15T10:54:27.935533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 222
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..22451 bytes.. Information: { Offset: 204 ProducerId: "src_id" SeqNo: 205 CreateTime: 2025-10-15T10:54:25.804000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22561 bytes.. Information: { Offset: 205 ProducerId: "src_id" SeqNo: 206 CreateTime: 2025-10-15T10:54:25.804000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22671 bytes.. Information: { Offset: 206 ProducerId: "src_id" SeqNo: 207 CreateTime: 2025-10-15T10:54:25.808000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22781 bytes.. Information: { Offset: 207 ProducerId: "src_id" SeqNo: 208 CreateTime: 2025-10-15T10:54:25.808000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..22891 bytes.. Information: { Offset: 208 ProducerId: "src_id" SeqNo: 209 CreateTime: 2025-10-15T10:54:25.808000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23001 bytes.. Information: { Offset: 209 ProducerId: "src_id" SeqNo: 210 CreateTime: 2025-10-15T10:54:25.808000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23111 bytes.. Information: { Offset: 210 ProducerId: "src_id" SeqNo: 211 CreateTime: 2025-10-15T10:54:25.808000Z WriteTime: 2025-10-15T10:54:27.603000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23221 bytes.. Information: { Offset: 211 ProducerId: "src_id" SeqNo: 212 CreateTime: 2025-10-15T10:54:25.808000Z WriteTime: 2025-10-15T10:54:27.631000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23331 bytes.. Information: { Offset: 212 ProducerId: "src_id" SeqNo: 213 CreateTime: 2025-10-15T10:54:25.809000Z WriteTime: 2025-10-15T10:54:27.631000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23441 bytes.. Information: { Offset: 213 ProducerId: "src_id" SeqNo: 214 CreateTime: 2025-10-15T10:54:25.809000Z WriteTime: 2025-10-15T10:54:27.631000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23551 bytes.. Information: { Offset: 214 ProducerId: "src_id" SeqNo: 215 CreateTime: 2025-10-15T10:54:25.809000Z WriteTime: 2025-10-15T10:54:27.631000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23661 bytes.. Information: { Offset: 215 ProducerId: "src_id" SeqNo: 216 CreateTime: 2025-10-15T10:54:25.809000Z WriteTime: 2025-10-15T10:54:27.631000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23771 bytes.. Information: { Offset: 216 ProducerId: "src_id" SeqNo: 217 CreateTime: 2025-10-15T10:54:25.809000Z WriteTime: 2025-10-15T10:54:27.660000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..23881 bytes.. Information: { Offset: 217 ProducerId: "src_id" SeqNo: 218 CreateTime: 2025-10-15T10:54:25.809000Z WriteTime: 2025-10-15T10:54:27.725000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:27.938022Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 14, size 324324 bytes
2025-10-15T10:54:27.938074Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:27.938364Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.939579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 223 offsets: 222 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 24 }
2025-10-15T10:54:27.939630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 223
2025-10-15T10:54:27.939852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 224 offsets: 223 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 24 }
2025-10-15T10:54:27.939874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 224
2025-10-15T10:54:27.947761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 225 offsets: 224 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 24 }
2025-10-15T10:54:27.947818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 225
2025-10-15T10:54:27.945166Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.948175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 226 offsets: 225 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 24 }
2025-10-15T10:54:27.948216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 226
2025-10-15T10:54:27.948355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 227 offsets: 226 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.948379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 227
2025-10-15T10:54:27.948493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 228 offsets: 227 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.948516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 228
2025-10-15T10:54:27.947942Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.948255Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.948866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 229 offsets: 228 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.948901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 229
2025-10-15T10:54:27.957435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 230 offsets: 229 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.957490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 230
2025-10-15T10:54:27.957946Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 216 totakecount 5 count 5 size 120453 from pos 2 cbcount 5
2025-10-15T10:54:27.958126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.958219Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958247Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958298Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 242 partNo : 0 messageNo: 487 size 26595 offset: -1
2025-10-15T10:54:27.958369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958381Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 243 partNo : 0 messageNo: 488 size 26705 offset: -1
2025-10-15T10:54:27.958469Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 244 partNo : 0 messageNo: 489 size 26815 offset: -1
2025-10-15T10:54:27.958588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958600Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958624Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 245 partNo : 0 messageNo: 490 size 26925 offset: -1
2025-10-15T10:54:27.958688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958721Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 246 partNo : 0 messageNo: 491 size 27035 offset: -1
2025-10-15T10:54:27.958757Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958815Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958857Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958924Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.958935Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.958989Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 218
2025-10-15T10:54:27.959058Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.959106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.959122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.959136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.959147Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.959163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.959176Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.959188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.959199Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.959213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.959406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 492  requestId: <none> cookie: 247
2025-10-15T10:54:27.959431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 493  requestId: <none> cookie: 248
2025-10-15T10:54:27.959451Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 494  requestId: <none> cookie: 249
2025-10-15T10:54:27.959471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 495  requestId: <none> cookie: 250
2025-10-15T10:54:27.959491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 496  requestId: <none> cookie: 251
2025-10-15T10:54:27.965042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 231 offsets: 230 already_written: false write_statistics { persist_duration_ms: 71 queued_in_partition_duration_ms: 16 }
2025-10-15T10:54:27.965098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 231
2025-10-15T10:54:27.971611Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 231 Result { Offset: 218 Data: "... 24065 bytes ..." SourceId: "\000src_id" SeqNo: 219 WriteTimestampMS: 1760525667725 CreateTimestampMS: 1760525665810 UncompressedSize: 23991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 219 Data: "... 24175 bytes ..." SourceId: "\000src_id" SeqNo: 220 WriteTimestampMS: 1760525667725 CreateTimestampMS: 1760525665810 UncompressedSize: 24101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 220 Data: "... 24285 bytes ..." SourceId: "\000src_id" SeqNo: 221 WriteTimestampMS: 1760525667725 CreateTimestampMS: 1760525665810 UncompressedSize: 24211 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 168301 RealReadOffset: 220 WaitQuotaTimeMs: 0 EndOffset: 231 StartOffset: 0 } Cookie: 218 }
2025-10-15T10:54:27.971835Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 221 endOffset 231
2025-10-15T10:54:27.971867Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 231 ReadOffset 221 ReadGuid a988ccb7-7fa95f3a-d73d33db-aa140837 has messages 1
2025-10-15T10:54:27.971944Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.971988Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.972015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.972040Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.972063Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.972541Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.972770Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.972812Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.972849Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.972886Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.973128Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 221, endOffset# 231, WTime# 1760525667725, sizeLag# 168301
2025-10-15T10:54:27.973165Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:27.973259Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# a988ccb7-7fa95f3a-d73d33db-aa140837, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 72556
2025-10-15T10:54:27.973297Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# a988ccb7-7fa95f3a-d73d33db-aa140837
2025-10-15T10:54:27.973592Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 1
2025-10-15T10:54:27.973637Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# c2149ddd-7ce1299d-13693b16-f3466c91, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 201961, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:27.973754Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 201961 maxTimeLagMs 0 readTimestampMs 0 readOffset 221 EndOffset 231 ClientCommitOffset 0 committedOffset 0 Guid c2149ddd-7ce1299d-13693b16-f3466c91
2025-10-15T10:54:27.975424Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 72556, now ReadSizeBudget = 0, ReadSizeServerDelta = 451732
2025-10-15T10:54:27.975540Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 451732
2025-10-15T10:54:27.975717Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (218-220)
2025-10-15T10:54:27.975756Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 72556 to budget
2025-10-15T10:54:27.975781Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 72556, ReadSizeServerDelta = 451732
2025-10-15T10:54:27.974683Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.975490Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.975996Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:27.976101Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (218-218)
2025-10-15T10:54:27.977348Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.977388Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.977441Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 247 partNo : 0 messageNo: 497 size 27145 offset: -1
2025-10-15T10:54:27.977476Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.977518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.976683Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.977479Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-15T10:54:27.977495Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400158502576887:2512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:27.979577Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.979866Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (219-219)
2025-10-15T10:54:27.979964Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (220-220)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..23991 bytes.. Information: { Offset: 218 ProducerId: "src_id" SeqNo: 219 CreateTime: 2025-10-15T10:54:25.810000Z WriteTime: 2025-10-15T10:54:27.725000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24101 bytes.. Information: { Offset: 219 ProducerId: "src_id" SeqNo: 220 CreateTime: 2025-10-15T10:54:25.810000Z WriteTime: 2025-10-15T10:54:27.725000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24211 bytes.. Information: { Offset: 220 ProducerId: "src_id" SeqNo: 221 CreateTime: 2025-10-15T10:54:25.810000Z WriteTime: 2025-10-15T10:54:27.725000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:27.980629Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 3, size 72303 bytes
2025-10-15T10:54:27.980664Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:27.980911Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 72556 } }
2025-10-15T10:54:27.981056Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# d9c70410-eba0d29d-32ed0c88-2a59b000
2025-10-15T10:54:27.982929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.982973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.983027Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 248 partNo : 0 messageNo: 498 size 27255 offset: -1
2025-10-15T10:54:27.983104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.983121Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.983146Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 249 partNo : 0 messageNo: 499 size 27365 offset: -1
2025-10-15T10:54:27.983209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.983221Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.983287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 250 partNo : 0 messageNo: 500 size 27475 offset: -1
2025-10-15T10:54:27.983432Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.983460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.983498Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 251 partNo : 0 messageNo: 501 size 27585 offset: -1
2025-10-15T10:54:27.983536Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.983548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.983579Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.983590Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.983617Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.983629Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.983658Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.983667Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.983695Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.983705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.983775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.983788Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.984005Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.984054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.984070Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.984083Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.984093Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.984110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.984121Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.984133Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.984267Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 231 count 5 size 128726 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:27.984323Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 502  requestId: <none> cookie: 252
2025-10-15T10:54:27.984359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 503  requestId: <none> cookie: 253
2025-10-15T10:54:27.984378Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 504  requestId: <none> cookie: 254
2025-10-15T10:54:27.984400Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 505  requestId: <none> cookie: 255
2025-10-15T10:54:27.984419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 506  requestId: <none> cookie: 256
2025-10-15T10:54:27.984465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:27.984516Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 128610 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:27.984549Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.984577Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 232, partNo: 0, Offset: 231 is stored on disk
2025-10-15T10:54:27.984594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.984615Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 233, partNo: 0, Offset: 232 is stored on disk
2025-10-15T10:54:27.984626Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.984646Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 234, partNo: 0, Offset: 233 is stored on disk
2025-10-15T10:54:27.984662Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.984683Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 235, partNo: 0, Offset: 234 is stored on disk
2025-10-15T10:54:27.984694Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:27.984714Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 236, partNo: 0, Offset: 235 is stored on disk
2025-10-15T10:54:27.984887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.984947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.984958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:27.985047Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 237 partNo 0
2025-10-15T10:54:27.985919Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 237 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 26119 count 1 nextOffset 237 batches 1
2025-10-15T10:54:27.985968Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 238 partNo 0
2025-10-15T10:54:27.985999Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 238 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 52316 count 2 nextOffset 238 batches 1
2025-10-15T10:54:27.986020Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 239 partNo 0
2025-10-15T10:54:27.986042Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 239 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 78623 count 3 nextOffset 239 batches 1
2025-10-15T10:54:27.986060Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 240 partNo 0
2025-10-15T10:54:27.986081Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 240 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 105040 count 4 nextOffset 240 batches 1
2025-10-15T10:54:27.986101Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 241 partNo 0
2025-10-15T10:54:27.986124Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 241 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 131567 count 5 nextOffset 241 batches 1
2025-10-15T10:54:27.986141Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 242 partNo 0
2025-10-15T10:54:27.986161Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 242 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 158204 count 6 nextOffset 242 batches 1
2025-10-15T10:54:27.986180Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 243 partNo 0
2025-10-15T10:54:27.986197Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 243 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 184951 count 7 nextOffset 243 batches 1
2025-10-15T10:54:27.986218Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 244 partNo 0
2025-10-15T10:54:27.986238Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 244 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 211808 count 8 nextOffset 244 batches 1
2025-10-15T10:54:27.986258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 245 partNo 0
2025-10-15T10:54:27.986283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 245 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 238775 count 9 nextOffset 245 batches 1
2025-10-15T10:54:27.986303Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 246 partNo 0
2025-10-15T10:54:27.986324Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 246 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 265852 count 10 nextOffset 246 batches 1
2025-10-15T10:54:27.986345Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 247 partNo 0
2025-10-15T10:54:27.986363Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 247 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 293039 count 11 nextOffset 247 batches 1
2025-10-15T10:54:27.986382Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 248 partNo 0
2025-10-15T10:54:27.986401Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 248 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 320336 count 12 nextOffset 248 batches 1
2025-10-15T10:54:27.986422Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 249 partNo 0
2025-10-15T10:54:27.986442Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 249 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 347743 count 13 nextOffset 249 batches 1
2025-10-15T10:54:27.986461Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 250 partNo 0
2025-10-15T10:54:27.986481Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 250 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 375260 count 14 nextOffset 250 batches 1
2025-10-15T10:54:27.986500Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 251 partNo 0
2025-10-15T10:54:27.986523Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 251 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 402887 count 15 nextOffset 251 batches 1
2025-10-15T10:54:27.986541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.988980Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 231 partno 0 count 5 parts 0 suffix '63' size 128726
2025-10-15T10:54:27.991453Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.991539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.991567Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.991593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.991615Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.992103Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.992335Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.992375Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.992413Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.992464Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:27.990055Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 236,15 HeadOffset 236 endOffset 236 curOffset 251 d0000000000_00000000000000000236_00000_0000000015_00000? size 402486 WTime 1760525667989
2025-10-15T10:54:27.990616Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:27.990683Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 23 Topic 'rt3.dc1--test-topic' partition 0 user user offset 221 count 12 size 201961 endOffset 236 max time lag 0ms effective offset 221
2025-10-15T10:54:27.990865Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 23 added 1 blobs, size 249106 count 10 last offset 221, current partition end offset: 236
2025-10-15T10:54:27.990881Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 23. Send blob request.
2025-10-15T10:54:27.990932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 467  requestId: <none> cookie: 232
2025-10-15T10:54:27.990997Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 468  requestId: <none> cookie: 233
2025-10-15T10:54:27.991025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 469  requestId: <none> cookie: 234
2025-10-15T10:54:27.991051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 470  requestId: <none> cookie: 235
2025-10-15T10:54:27.991078Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 471  requestId: <none> cookie: 236
2025-10-15T10:54:27.991105Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:27.991235Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 236 partNo 0 count 15 size 402486
2025-10-15T10:54:27.991297Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 221 partno 0 count 10 parts_count 0 source 1 size 249106 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:27.991326Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 23. All 1 blobs are from cache.
2025-10-15T10:54:27.991516Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:27.992518Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 221 totakecount 10 count 10 size 249083 from pos 0 cbcount 10
2025-10-15T10:54:27.992717Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 221
2025-10-15T10:54:27.993071Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.993388Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.993622Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.993900Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.994155Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:27.993651Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 221 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:27.996445Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.996478Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.996531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 252 partNo : 0 messageNo: 507 size 27695 offset: -1
2025-10-15T10:54:27.996618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.996631Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.996655Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 253 partNo : 0 messageNo: 508 size 27805 offset: -1
2025-10-15T10:54:27.996714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.996725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.996746Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 254 partNo : 0 messageNo: 509 size 27915 offset: -1
2025-10-15T10:54:27.996857Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.996871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.996895Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 255 partNo : 0 messageNo: 510 size 28025 offset: -1
2025-10-15T10:54:27.996988Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.997002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.997032Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 256 partNo : 0 messageNo: 511 size 28135 offset: -1
2025-10-15T10:54:27.997073Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.997086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.997133Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.997147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.997179Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.997191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.997231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.997245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.997286Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:27.997300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:27.997333Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.997387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.997404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.997419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.997431Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.997455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.997471Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.997485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.997504Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:27.997524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:27.997626Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 512  requestId: <none> cookie: 257
2025-10-15T10:54:27.997663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 513  requestId: <none> cookie: 258
2025-10-15T10:54:27.997682Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 514  requestId: <none> cookie: 259
2025-10-15T10:54:27.997701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 515  requestId: <none> cookie: 260
2025-10-15T10:54:27.997743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 516  requestId: <none> cookie: 261
2025-10-15T10:54:27.995427Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.995498Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.995527Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.995553Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.995578Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:27.996972Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 236 Result { Offset: 221 Data: "... 24395 bytes ..." SourceId: "\000src_id" SeqNo: 222 WriteTimestampMS: 1760525667759 CreateTimestampMS: 1760525665810 UncompressedSize: 24321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 222 Data: "... 24505 bytes ..." SourceId: "\000src_id" SeqNo: 223 WriteTimestampMS: 1760525667765 CreateTimestampMS: 1760525665810 UncompressedSize: 24431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 223 Data: "... 24615 bytes ..." SourceId: "\000src_id" SeqNo: 224 WriteTimestampMS: 1760525667765 CreateTimestampMS: 1760525665810 UncompressedSize: 24541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 224 Data: "... 24725 bytes ..." SourceId: "\000src_id" SeqNo: 225 WriteTimestampMS: 1760525667765 CreateTimestampMS: 1760525665811 UncompressedSize: 24651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 225 Data: "... 24835 bytes ..." SourceId: "\000src_id" SeqNo: 226 WriteTimestampMS: 1760525667765 CreateTimestampMS: 1760525665811 UncompressedSize: 24761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 226 Data: "... 24945 bytes ..." SourceId: "\000src_id" SeqNo: 227 WriteTimestampMS: 1760525667765 CreateTimestampMS: 1760525665836 UncompressedSize: 24871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 227 Data: "... 25055 bytes ..." SourceId: "\000src_id" SeqNo: 228 WriteTimestampMS: 1760525667765 CreateTimestampMS: 1760525665901 UncompressedSize: 24981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 228 Data: "... 25165 bytes ..." SourceId: "\000src_id" SeqNo: 229 WriteTimestampMS: 1760525667765 CreateTimestampMS: 1760525665953 UncompressedSize: 25091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 229 Data: "... 25275 bytes ..." SourceId: "\000src_id" SeqNo: 230 WriteTimestampMS: 1760525667765 CreateTimestampMS: 1760525665957 UncompressedSize: 25201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 230 Data: "... 25385 bytes ..." SourceId: "\000src_id" SeqNo: 231 WriteTimestampMS: 1760525667765 CreateTimestampMS: 1760525665957 UncompressedSize: 25311 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 248892 RealReadOffset: 230 WaitQuotaTimeMs: 0 EndOffset: 236 StartOffset: 0 } Cookie: 221 }
2025-10-15T10:54:27.997679Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 231 endOffset 236
2025-10-15T10:54:27.997730Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 236 ReadOffset 231 ReadGuid c2149ddd-7ce1299d-13693b16-f3466c91 has messages 1
2025-10-15T10:54:27.997828Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 231, endOffset# 236, WTime# 1760525667765, sizeLag# 248892
2025-10-15T10:54:27.997845Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 0
2025-10-15T10:54:27.997899Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# c2149ddd-7ce1299d-13693b16-f3466c91, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 248812
2025-10-15T10:54:27.997924Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# c2149ddd-7ce1299d-13693b16-f3466c91
2025-10-15T10:54:27.998464Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 1
2025-10-15T10:54:27.998509Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 253fe898-93806c89-8d1684b9-dc02e2e0, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 275476, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:27.998627Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 275476 maxTimeLagMs 0 readTimestampMs 0 readOffset 231 EndOffset 236 ClientCommitOffset 0 committedOffset 0 Guid 253fe898-93806c89-8d1684b9-dc02e2e0
2025-10-15T10:54:27.999908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 232 offsets: 231 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 146 }
2025-10-15T10:54:27.999953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 232
2025-10-15T10:54:28.000668Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 248812, now ReadSizeBudget = 0, ReadSizeServerDelta = 275476
2025-10-15T10:54:28.000783Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 275476
2025-10-15T10:54:28.000903Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (221-230)
2025-10-15T10:54:28.000931Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 248812 to budget
2025-10-15T10:54:28.000953Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 248812, ReadSizeServerDelta = 275476
2025-10-15T10:54:28.001121Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:28.001257Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (221-221)
2025-10-15T10:54:28.001366Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (222-222)
2025-10-15T10:54:28.001502Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (223-223)
2025-10-15T10:54:28.001571Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (224-224)
2025-10-15T10:54:28.001828Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (225-225)
2025-10-15T10:54:28.001908Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (226-226)
2025-10-15T10:54:28.001971Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (227-227)
2025-10-15T10:54:28.002038Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (228-228)
2025-10-15T10:54:28.002432Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (229-229)
2025-10-15T10:54:28.002507Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (230-230)
>>> event from dataHandler: 2025-10-15T10:54:28.001312Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.001398Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.001440Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.001481Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.001509Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.002092Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.002278Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.002338Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.002396Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.002441Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.002809Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.003309Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.003382Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.003518Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 24 Topic 'rt3.dc1--test-topic' partition 0 user user offset 231 count 6 size 275476 endOffset 236 max time lag 0ms effective offset 231
2025-10-15T10:54:28.003767Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 24 added 1 blobs, size 128726 count 5 last offset 231, current partition end offset: 236
2025-10-15T10:54:28.003791Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 24. Send blob request.
2025-10-15T10:54:28.003853Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 231 partno 0 count 5 parts_count 0 source 1 size 128726 accessed 0 times before, last time 2025-10-15T10:54:27.000000Z
2025-10-15T10:54:28.003889Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 24. All 1 blobs are from cache.
2025-10-15T10:54:28.003958Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:28.004955Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 231 partno 0 count 5 parts 0 suffix '63'
2025-10-15T10:54:28.005605Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.006053Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.006475Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..24321 bytes.. Information: { Offset: 221 ProducerId: "src_id" SeqNo: 222 CreateTime: 2025-10-15T10:54:25.810000Z WriteTime: 2025-10-15T10:54:27.759000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24431 bytes.. Information: { Offset: 222 ProducerId: "src_id" SeqNo: 223 CreateTime: 2025-10-15T10:54:25.810000Z WriteTime: 2025-10-15T10:54:27.765000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24541 bytes.. Information: { Offset: 223 ProducerId: "src_id" SeqNo: 224 CreateTime: 2025-10-15T10:54:25.810000Z WriteTime: 2025-10-15T10:54:27.765000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24651 bytes.. Information: { Offset: 224 ProducerId: "src_id" SeqNo: 225 CreateTime: 2025-10-15T10:54:25.811000Z WriteTime: 2025-10-15T10:54:27.765000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24761 bytes.. Information: { Offset: 225 ProducerId: "src_id" SeqNo: 226 CreateTime: 2025-10-15T10:54:25.811000Z WriteTime: 2025-10-15T10:54:27.765000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24871 bytes.. Information: { Offset: 226 ProducerId: "src_id" SeqNo: 227 CreateTime: 2025-10-15T10:54:25.836000Z WriteTime: 2025-10-15T10:54:27.765000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..24981 bytes.. Information: { Offset: 227 ProducerId: "src_id" SeqNo: 228 CreateTime: 2025-10-15T10:54:25.901000Z WriteTime: 2025-10-15T10:54:27.765000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25091 bytes.. Information: { Offset: 228 ProducerId: "src_id" SeqNo: 229 CreateTime: 2025-10-15T10:54:25.953000Z WriteTime: 2025-10-15T10:54:27.765000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25201 bytes.. Information: { Offset: 229 ProducerId: "src_id" SeqNo: 230 CreateTime: 2025-10-15T10:54:25.957000Z WriteTime: 2025-10-15T10:54:27.765000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25311 bytes.. Information: { Offset: 230 ProducerId: "src_id" SeqNo: 231 CreateTime: 2025-10-15T10:54:25.957000Z WriteTime: 2025-10-15T10:54:27.765000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:28.016859Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 231 totakecount 5 count 5 size 128703 from pos 0 cbcount 5
2025-10-15T10:54:28.017702Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.017765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.017821Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 257 partNo : 0 messageNo: 517 size 28245 offset: -1
2025-10-15T10:54:28.018009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.018025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.018049Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 258 partNo : 0 messageNo: 518 size 28355 offset: -1
2025-10-15T10:54:28.018150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.018163Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.018188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 259 partNo : 0 messageNo: 519 size 28465 offset: -1
2025-10-15T10:54:28.018292Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.018309Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.018331Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 260 partNo : 0 messageNo: 520 size 28575 offset: -1
2025-10-15T10:54:28.018436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.018453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.018477Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 261 partNo : 0 messageNo: 521 size 28685 offset: -1
2025-10-15T10:54:28.018512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.018527Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.018564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.018576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.018608Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.018621Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.018650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.018664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.018693Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.018705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.018766Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 231
2025-10-15T10:54:28.021799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 233 offsets: 232 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 146 }
2025-10-15T10:54:28.021847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 233
2025-10-15T10:54:28.022096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 234 offsets: 233 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 146 }
2025-10-15T10:54:28.022128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 234
2025-10-15T10:54:28.022267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 235 offsets: 234 already_written: false write_statistics { persist_duration_ms: 63 queued_in_partition_duration_ms: 146 }
2025-10-15T10:54:28.022286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 235
2025-10-15T10:54:28.022391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 236 offsets: 235 already_written: false write_statistics { persist_duration_ms: 63 queued_in_partition_duration_ms: 146 }
2025-10-15T10:54:28.022410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 236
2025-10-15T10:54:28.027728Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 248812 } }
2025-10-15T10:54:28.027905Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 3538ce68-12bb3d8a-19b7ece9-6ae1e4f6
2025-10-15T10:54:28.031175Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.031245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.031263Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.031286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.031300Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.031317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.031332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.031367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.031380Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.031397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.031812Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 522  requestId: <none> cookie: 262
2025-10-15T10:54:28.031844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 523  requestId: <none> cookie: 263
2025-10-15T10:54:28.031867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 524  requestId: <none> cookie: 264
2025-10-15T10:54:28.031889Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 525  requestId: <none> cookie: 265
2025-10-15T10:54:28.031906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 526  requestId: <none> cookie: 266
2025-10-15T10:54:28.031971Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 236 count 15 size 402486 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:28.032016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:28.032066Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 402330 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:28.032114Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032148Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 237, partNo: 0, Offset: 236 is stored on disk
2025-10-15T10:54:28.032165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032186Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 238, partNo: 0, Offset: 237 is stored on disk
2025-10-15T10:54:28.032198Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032216Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 239, partNo: 0, Offset: 238 is stored on disk
2025-10-15T10:54:28.032227Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032249Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 240, partNo: 0, Offset: 239 is stored on disk
2025-10-15T10:54:28.032260Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032279Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 241, partNo: 0, Offset: 240 is stored on disk
2025-10-15T10:54:28.032291Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032310Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 242, partNo: 0, Offset: 241 is stored on disk
2025-10-15T10:54:28.032323Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032341Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 243, partNo: 0, Offset: 242 is stored on disk
2025-10-15T10:54:28.032353Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032371Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 244, partNo: 0, Offset: 243 is stored on disk
2025-10-15T10:54:28.032385Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 245, partNo: 0, Offset: 244 is stored on disk
2025-10-15T10:54:28.032419Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032438Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 246, partNo: 0, Offset: 245 is stored on disk
2025-10-15T10:54:28.032452Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032471Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 247, partNo: 0, Offset: 246 is stored on disk
2025-10-15T10:54:28.032481Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032498Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 248, partNo: 0, Offset: 247 is stored on disk
2025-10-15T10:54:28.032508Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032527Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 249, partNo: 0, Offset: 248 is stored on disk
2025-10-15T10:54:28.032539Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032558Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 250, partNo: 0, Offset: 249 is stored on disk
2025-10-15T10:54:28.032570Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.032590Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 251, partNo: 0, Offset: 250 is stored on disk
2025-10-15T10:54:28.033125Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.033183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.033192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T10:54:28.033293Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 252 partNo 0
2025-10-15T10:54:28.034755Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 252 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 27769 count 1 nextOffset 252 batches 1
2025-10-15T10:54:28.034812Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 253 partNo 0
2025-10-15T10:54:28.034847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 253 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 55616 count 2 nextOffset 253 batches 1
2025-10-15T10:54:28.034867Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 254 partNo 0
2025-10-15T10:54:28.034891Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 254 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 83573 count 3 nextOffset 254 batches 1
2025-10-15T10:54:28.034914Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 255 partNo 0
2025-10-15T10:54:28.034932Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 255 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 111640 count 4 nextOffset 255 batches 1
2025-10-15T10:54:28.034953Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 256 partNo 0
2025-10-15T10:54:28.034976Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 256 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 139817 count 5 nextOffset 256 batches 1
2025-10-15T10:54:28.034996Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 257 partNo 0
2025-10-15T10:54:28.035016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 257 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 168104 count 6 nextOffset 257 batches 1
2025-10-15T10:54:28.035035Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 258 partNo 0
2025-10-15T10:54:28.035054Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 258 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 196501 count 7 nextOffset 258 batches 1
2025-10-15T10:54:28.035076Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 259 partNo 0
2025-10-15T10:54:28.035097Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 259 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 225008 count 8 nextOffset 259 batches 1
2025-10-15T10:54:28.035120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 260 partNo 0
2025-10-15T10:54:28.035144Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 260 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 253625 count 9 nextOffset 260 batches 1
2025-10-15T10:54:28.035169Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 261 partNo 0
2025-10-15T10:54:28.035191Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 261 partNo 0 FormedBlobsCount 0 NewHead: Offset 251 PartNo 0 PackedSize 282352 count 10 nextOffset 261 batches 1
2025-10-15T10:54:28.035204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.035515Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 236 partno 0 count 15 parts 0 suffix '63' size 402486
2025-10-15T10:54:28.042182Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 251,10 HeadOffset 251 endOffset 251 curOffset 261 d0000000000_00000000000000000251_00000_0000000010_00000? size 282106 WTime 1760525668041
2025-10-15T10:54:28.043195Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:28.037054Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 236 Result { Offset: 231 Data: "... 25495 bytes ..." SourceId: "\000src_id" SeqNo: 232 WriteTimestampMS: 1760525667838 CreateTimestampMS: 1760525665957 UncompressedSize: 25421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 232 Data: "... 25605 bytes ..." SourceId: "\000src_id" SeqNo: 233 WriteTimestampMS: 1760525667916 CreateTimestampMS: 1760525665991 UncompressedSize: 25531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 233 Data: "... 25715 bytes ..." SourceId: "\000src_id" SeqNo: 234 WriteTimestampMS: 1760525667916 CreateTimestampMS: 1760525665992 UncompressedSize: 25641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 234 Data: "... 25825 bytes ..." SourceId: "\000src_id" SeqNo: 235 WriteTimestampMS: 1760525667917 CreateTimestampMS: 1760525665992 UncompressedSize: 25751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 235 Data: "... 25935 bytes ..." SourceId: "\000src_id" SeqNo: 236 WriteTimestampMS: 1760525667917 CreateTimestampMS: 1760525665992 UncompressedSize: 25861 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 235 WaitQuotaTimeMs: 0 EndOffset: 236 StartOffset: 0 } Cookie: 231 }
2025-10-15T10:54:28.037292Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.037348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.037380Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.037409Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.037436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.037937Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.038178Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.038217Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.038252Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.038288Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.038768Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.043602Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 477  requestId: <none> cookie: 237
2025-10-15T10:54:28.043680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 478  requestId: <none> cookie: 238
2025-10-15T10:54:28.043705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 479  requestId: <none> cookie: 239
2025-10-15T10:54:28.043730Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 480  requestId: <none> cookie: 240
2025-10-15T10:54:28.043753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 481  requestId: <none> cookie: 241
2025-10-15T10:54:28.043778Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 487  requestId: <none> cookie: 242
2025-10-15T10:54:28.043802Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 488  requestId: <none> cookie: 243
2025-10-15T10:54:28.043827Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 489  requestId: <none> cookie: 244
2025-10-15T10:54:28.043851Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 490  requestId: <none> cookie: 245
2025-10-15T10:54:28.043876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 491  requestId: <none> cookie: 246
2025-10-15T10:54:28.043901Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 497  requestId: <none> cookie: 247
2025-10-15T10:54:28.043924Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 498  requestId: <none> cookie: 248
2025-10-15T10:54:28.043946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 499  requestId: <none> cookie: 249
2025-10-15T10:54:28.043973Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 500  requestId: <none> cookie: 250
2025-10-15T10:54:28.043999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 501  requestId: <none> cookie: 251
2025-10-15T10:54:28.044143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.044169Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.044220Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 262 partNo : 0 messageNo: 527 size 28795 offset: -1
2025-10-15T10:54:28.044543Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044611Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044640Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044696Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044737Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044787Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044811Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044833Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044857Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044879Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044902Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044927Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044952Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.044988Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.045845Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 15 from offset 236
2025-10-15T10:54:28.045902Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 236 ReadOffset 236 ReadGuid 253fe898-93806c89-8d1684b9-dc02e2e0 has messages 1
2025-10-15T10:54:28.046057Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 253fe898-93806c89-8d1684b9-dc02e2e0, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 128776
2025-10-15T10:54:28.046098Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 253fe898-93806c89-8d1684b9-dc02e2e0
2025-10-15T10:54:28.046382Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:28.047053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 237 offsets: 236 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 61 }
2025-10-15T10:54:28.047113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 237
2025-10-15T10:54:28.051969Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.052019Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.052080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 263 partNo : 0 messageNo: 528 size 28905 offset: -1
2025-10-15T10:54:28.052133Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:28.052263Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 251 partNo 0 count 10 size 282106
2025-10-15T10:54:28.052409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.052428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.052460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 264 partNo : 0 messageNo: 529 size 29015 offset: -1
2025-10-15T10:54:28.052561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.052576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.052601Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 265 partNo : 0 messageNo: 530 size 29125 offset: -1
2025-10-15T10:54:28.052741Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.052755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.052783Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 266 partNo : 0 messageNo: 531 size 29235 offset: -1
2025-10-15T10:54:28.052823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.052835Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.052869Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.052883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.052917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.052928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.052959Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.052971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.053007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.053020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.053046Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.053098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.053133Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.053149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.053317Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.053336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.053349Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.053376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.053389Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.053403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.053556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 532  requestId: <none> cookie: 267
2025-10-15T10:54:28.053594Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 533  requestId: <none> cookie: 268
2025-10-15T10:54:28.053612Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 534  requestId: <none> cookie: 269
2025-10-15T10:54:28.053631Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 535  requestId: <none> cookie: 270
2025-10-15T10:54:28.053653Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 536  requestId: <none> cookie: 271
2025-10-15T10:54:28.055429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.057507Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 128776, now ReadSizeBudget = 0, ReadSizeServerDelta = 395512
2025-10-15T10:54:28.057645Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 395512
2025-10-15T10:54:28.059419Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (231-235)
2025-10-15T10:54:28.059466Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 128776 to budget
2025-10-15T10:54:28.059495Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 128776, ReadSizeServerDelta = 395512
2025-10-15T10:54:28.059930Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:28.060019Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (231-231)
2025-10-15T10:54:28.058412Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.058488Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.058553Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.058585Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.058615Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.058645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.060163Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (232-232)
2025-10-15T10:54:28.059380Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.059443Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.059481Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.059522Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.059561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.059724Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 236 EndOffset 236 newEndOffset 251 commitOffset 0 clientCommitOffset 0 cookie 15 readingFinished 0 firstRead 0
2025-10-15T10:54:28.060312Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (233-233)
2025-10-15T10:54:28.059748Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 236 endOffset 251
2025-10-15T10:54:28.059788Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 236, endOffset# 251, WTime# 1760525667917, sizeLag# 402486
2025-10-15T10:54:28.059804Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:28.059855Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 25ff9e13-dde909e6-807affd-c06b239a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 395512, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:28.059905Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 395512 maxTimeLagMs 0 readTimestampMs 0 readOffset 236 EndOffset 251 ClientCommitOffset 0 committedOffset 0 Guid 25ff9e13-dde909e6-807affd-c06b239a
2025-10-15T10:54:28.060555Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (234-234)
2025-10-15T10:54:28.060923Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.060965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.061008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.061064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 267 partNo : 0 messageNo: 537 size 29345 offset: -1
2025-10-15T10:54:28.061193Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.061224Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.061351Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.061365Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.065387Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (235-235)
2025-10-15T10:54:28.061415Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 268 partNo : 0 messageNo: 538 size 29455 offset: -1
2025-10-15T10:54:28.061496Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.061520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.061571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 269 partNo : 0 messageNo: 539 size 29565 offset: -1
2025-10-15T10:54:28.061680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.061700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.061747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 270 partNo : 0 messageNo: 540 size 29675 offset: -1
2025-10-15T10:54:28.061781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.061836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.061950Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.061968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.061999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 271 partNo : 0 messageNo: 541 size 29785 offset: -1
2025-10-15T10:54:28.062044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.062058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.062094Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.062107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.062143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.062166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.062207Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.062225Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.062284Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.062298Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.062757Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.062791Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.062802Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.062817Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.062828Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.062845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.066469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 238 offsets: 237 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 61 }
2025-10-15T10:54:28.062855Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.062868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.062974Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 542  requestId: <none> cookie: 272
2025-10-15T10:54:28.066516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 238
2025-10-15T10:54:28.063015Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 543  requestId: <none> cookie: 273
2025-10-15T10:54:28.063033Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 544  requestId: <none> cookie: 274
2025-10-15T10:54:28.063050Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 545  requestId: <none> cookie: 275
2025-10-15T10:54:28.063084Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 25 Topic 'rt3.dc1--test-topic' partition 0 user user offset 236 count 18 size 395512 endOffset 251 max time lag 0ms effective offset 236
2025-10-15T10:54:28.063300Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 25 added 1 blobs, size 402486 count 15 last offset 236, current partition end offset: 251
2025-10-15T10:54:28.063315Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 25. Send blob request.
2025-10-15T10:54:28.063340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 546  requestId: <none> cookie: 276
2025-10-15T10:54:28.063441Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 236 partno 0 count 15 parts_count 0 source 1 size 402486 accessed 0 times before, last time 2025-10-15T10:54:28.000000Z
2025-10-15T10:54:28.063465Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 25. All 1 blobs are from cache.
2025-10-15T10:54:28.063518Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:28.065080Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 236 partno 0 count 15 parts 0 suffix '63'
2025-10-15T10:54:28.066700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 239 offsets: 238 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 61 }
2025-10-15T10:54:28.066725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 239
2025-10-15T10:54:28.066837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 240 offsets: 239 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 61 }
2025-10-15T10:54:28.066861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 240
2025-10-15T10:54:28.066963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 241 offsets: 240 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 61 }
2025-10-15T10:54:28.066983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 241
2025-10-15T10:54:28.067108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 242 offsets: 241 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 27 }
2025-10-15T10:54:28.067133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 242
2025-10-15T10:54:28.066129Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.066209Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.066241Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.066272Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.066304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.066350Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.066955Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.067013Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.067052Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.067091Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.067132Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.067276Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:28.067512Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 128776 } }
2025-10-15T10:54:28.067577Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 8ddbc45f-d1c0d0f6-506e7be8-554c7e8f
2025-10-15T10:54:28.071547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 243 offsets: 242 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 27 }
2025-10-15T10:54:28.071591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 243
2025-10-15T10:54:28.071820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 244 offsets: 243 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 27 }
2025-10-15T10:54:28.071850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 244
2025-10-15T10:54:28.072013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 245 offsets: 244 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 27 }
2025-10-15T10:54:28.072040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 245
2025-10-15T10:54:28.072152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 246 offsets: 245 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 27 }
2025-10-15T10:54:28.072174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 246
2025-10-15T10:54:28.072288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 247 offsets: 246 already_written: false write_statistics { persist_duration_ms: 51 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:28.072311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 247
2025-10-15T10:54:28.072416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 248 offsets: 247 already_written: false write_statistics { persist_duration_ms: 51 }
2025-10-15T10:54:28.072436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 248
2025-10-15T10:54:28.072572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 249 offsets: 248 already_written: false write_statistics { persist_duration_ms: 51 }
2025-10-15T10:54:28.072603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 249
2025-10-15T10:54:28.072725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 250 offsets: 249 already_written: false write_statistics { persist_duration_ms: 51 }
2025-10-15T10:54:28.072747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 250
2025-10-15T10:54:28.072836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 251 offsets: 250 already_written: false write_statistics { persist_duration_ms: 51 }
2025-10-15T10:54:28.072854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 251
2025-10-15T10:54:28.076118Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 236 totakecount 15 count 15 size 402463 from pos 0 cbcount 15
2025-10-15T10:54:28.076649Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.076680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.076734Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 272 partNo : 0 messageNo: 547 size 29895 offset: -1
2025-10-15T10:54:28.076869Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.076885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.076912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 273 partNo : 0 messageNo: 548 size 30005 offset: -1
2025-10-15T10:54:28.077015Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.077031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.077057Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 274 partNo : 0 messageNo: 549 size 30115 offset: -1
2025-10-15T10:54:28.077169Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.077183Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.077207Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 275 partNo : 0 messageNo: 550 size 30225 offset: -1
2025-10-15T10:54:28.077310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.077327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.077350Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 276 partNo : 0 messageNo: 551 size 30335 offset: -1
2025-10-15T10:54:28.077385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.077397Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.077431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.077444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.077475Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.077488Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.077517Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.077530Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.077559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.077571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.077873Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 236
2025-10-15T10:54:28.077950Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.077999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.078014Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.078029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.078040Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.078055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.078065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.078079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.078089Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.078148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.078267Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 251 count 10 size 282106 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:28.078525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 552  requestId: <none> cookie: 277
2025-10-15T10:54:28.078550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 553  requestId: <none> cookie: 278
2025-10-15T10:54:28.078571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 554  requestId: <none> cookie: 279
2025-10-15T10:54:28.078589Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 555  requestId: <none> cookie: 280
2025-10-15T10:54:28.078607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 556  requestId: <none> cookie: 281
2025-10-15T10:54:28.078625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:28.078671Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 281970 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:28.078704Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.078733Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 252, partNo: 0, Offset: 251 is stored on disk
2025-10-15T10:54:28.078752Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.078773Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 253, partNo: 0, Offset: 252 is stored on disk
2025-10-15T10:54:28.078785Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.078805Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 254, partNo: 0, Offset: 253 is stored on disk
2025-10-15T10:54:28.078817Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.078834Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 255, partNo: 0, Offset: 254 is stored on disk
2025-10-15T10:54:28.078847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.078864Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 256, partNo: 0, Offset: 255 is stored on disk
2025-10-15T10:54:28.078879Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.078897Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 257, partNo: 0, Offset: 256 is stored on disk
2025-10-15T10:54:28.078908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.078928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 258, partNo: 0, Offset: 257 is stored on disk
2025-10-15T10:54:28.078940Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.078958Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 259, partNo: 0, Offset: 258 is stored on disk
2025-10-15T10:54:28.078970Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.078988Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 260, partNo: 0, Offset: 259 is stored on disk
2025-10-15T10:54:28.079000Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.079018Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 261, partNo: 0, Offset: 260 is stored on disk
2025-10-15T10:54:28.079316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.079473Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 251 partno 0 count 10 parts 0 suffix '63' size 282106
2025-10-15T10:54:28.081418Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.081495Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.081521Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.081548Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.081574Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.082081Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.082144Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.082180Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.082211Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.082241Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.088340Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 251 Result { Offset: 236 Data: "... 26045 bytes ..." SourceId: "\000src_id" SeqNo: 237 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665992 UncompressedSize: 25971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 237 Data: "... 26155 bytes ..." SourceId: "\000src_id" SeqNo: 238 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665992 UncompressedSize: 26081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 238 Data: "... 26265 bytes ..." SourceId: "\000src_id" SeqNo: 239 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665992 UncompressedSize: 26191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 239 Data: "... 26375 bytes ..." SourceId: "\000src_id" SeqNo: 240 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665993 UncompressedSize: 26301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 240 Data: "... 26485 bytes ..." SourceId: "\000src_id" SeqNo: 241 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665993 UncompressedSize: 26411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 241 Data: "... 26595 bytes ..." SourceId: "\000src_id" SeqNo: 242 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665993 UncompressedSize: 26521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 242 Data: "... 26705 bytes ..." SourceId: "\000src_id" SeqNo: 243 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665993 UncompressedSize: 26631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 243 Data: "... 26815 bytes ..." SourceId: "\000src_id" SeqNo: 244 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665993 UncompressedSize: 26741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 244 Data: "... 26925 bytes ..." SourceId: "\000src_id" SeqNo: 245 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665993 UncompressedSize: 26851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 245 Data: "... 27035 bytes ..." SourceId: "\000src_id" SeqNo: 246 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665994 UncompressedSize: 26961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 246 Data: "... 27145 bytes ..." SourceId: "\000src_id" SeqNo: 247 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665994 UncompressedSize: 27071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 247 Data: "... 27255 bytes ..." SourceId: "\000src_id" SeqNo: 248 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665994 UncompressedSize: 27181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 248 Data: "... 27365 bytes ..." SourceId: "\000src_id" SeqNo: 249 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665994 UncompressedSize: 27291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 249 Data: "... 27475 bytes ..." SourceId: "\000src_id" SeqNo: 250 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665994 UncompressedSize: 27401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 250 Data: "... 27585 bytes ..." SourceId: "\000src_id" SeqNo: 251 WriteTimestampMS: 1760525667980 CreateTimestampMS: 1760525665994 UncompressedSize: 27511 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551247 RealReadOffset: 250 WaitQuotaTimeMs: 0 EndOffset: 251 StartOffset: 0 } Cookie: 236 }
2025-10-15T10:54:28.089371Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 16 from offset 251
2025-10-15T10:54:28.089415Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 251 ReadOffset 251 ReadGuid 25ff9e13-dde909e6-807affd-c06b239a has messages 1
2025-10-15T10:54:28.089636Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 25ff9e13-dde909e6-807affd-c06b239a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 401848
2025-10-15T10:54:28.089667Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 25ff9e13-dde909e6-807affd-c06b239a
2025-10-15T10:54:28.090525Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:28.091284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.091310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:28.091455Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 262 partNo 0
2025-10-15T10:54:28.096244Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 401848, now ReadSizeBudget = 0, ReadSizeServerDelta = 122440
2025-10-15T10:54:28.096583Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 10, size 248160 bytes
2025-10-15T10:54:28.096630Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 122440
2025-10-15T10:54:28.096674Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:28.096708Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 122440
2025-10-15T10:54:28.097163Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (236-250)
2025-10-15T10:54:28.097681Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 401848 to budget
2025-10-15T10:54:28.097710Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 401848, ReadSizeServerDelta = 122440
2025-10-15T10:54:28.097982Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:28.098107Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (236-236)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..25421 bytes.. Information: { Offset: 231 ProducerId: "src_id" SeqNo: 232 CreateTime: 2025-10-15T10:54:25.957000Z WriteTime: 2025-10-15T10:54:27.838000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25531 bytes.. Information: { Offset: 232 ProducerId: "src_id" SeqNo: 233 CreateTime: 2025-10-15T10:54:25.991000Z WriteTime: 2025-10-15T10:54:27.916000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25641 bytes.. Information: { Offset: 233 ProducerId: "src_id" SeqNo: 234 CreateTime: 2025-10-15T10:54:25.992000Z WriteTime: 2025-10-15T10:54:27.916000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25751 bytes.. Information: { Offset: 234 ProducerId: "src_id" SeqNo: 235 CreateTime: 2025-10-15T10:54:25.992000Z WriteTime: 2025-10-15T10:54:27.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..25861 bytes.. Information: { Offset: 235 ProducerId: "src_id" SeqNo: 236 CreateTime: 2025-10-15T10:54:25.992000Z WriteTime: 2025-10-15T10:54:27.917000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:28.098851Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 5, size 128205 bytes
2025-10-15T10:54:28.098885Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:28.099792Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 401848 } }
2025-10-15T10:54:28.099929Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 35723014-20e788aa-8aa3f3-4933d6cd
2025-10-15T10:54:28.111759Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (237-237)
2025-10-15T10:54:28.111953Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (238-238)
2025-10-15T10:54:28.112023Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (239-239)
2025-10-15T10:54:28.112266Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (240-240)
2025-10-15T10:54:28.112336Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (241-241)
2025-10-15T10:54:28.112412Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (242-242)
2025-10-15T10:54:28.112487Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (243-243)
2025-10-15T10:54:28.112864Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (244-244)
2025-10-15T10:54:28.112933Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (245-245)
2025-10-15T10:54:28.113001Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (246-246)
2025-10-15T10:54:28.113111Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (247-247)
2025-10-15T10:54:28.113211Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (248-248)
2025-10-15T10:54:28.113272Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (249-249)
2025-10-15T10:54:28.113340Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (250-250)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..25971 bytes.. Information: { Offset: 236 ProducerId: "src_id" SeqNo: 237 CreateTime: 2025-10-15T10:54:25.992000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26081 bytes.. Information: { Offset: 237 ProducerId: "src_id" SeqNo: 238 CreateTime: 2025-10-15T10:54:25.992000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26191 bytes.. Information: { Offset: 238 ProducerId: "src_id" SeqNo: 239 CreateTime: 2025-10-15T10:54:25.992000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26301 bytes.. Information: { Offset: 239 ProducerId: "src_id" SeqNo: 240 CreateTime: 2025-10-15T10:54:25.993000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26411 bytes.. Information: { Offset: 240 ProducerId: "src_id" SeqNo: 241 CreateTime: 2025-10-15T10:54:25.993000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26521 bytes.. Information: { Offset: 241 ProducerId: "src_id" SeqNo: 242 CreateTime: 2025-10-15T10:54:25.993000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26631 bytes.. Information: { Offset: 242 ProducerId: "src_id" SeqNo: 243 CreateTime: 2025-10-15T10:54:25.993000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26741 bytes.. Information: { Offset: 243 ProducerId: "src_id" SeqNo: 244 CreateTime: 2025-10-15T10:54:25.993000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26851 bytes.. Information: { Offset: 244 ProducerId: "src_id" SeqNo: 245 CreateTime: 2025-10-15T10:54:25.993000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..26961 bytes.. Information: { Offset: 245 ProducerId: "src_id" SeqNo: 246 CreateTime: 2025-10-15T10:54:25.994000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27071 bytes.. Information: { Offset: 246 ProducerId: "src_id" SeqNo: 247 CreateTime: 2025-10-15T10:54:25.994000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27181 bytes.. Information: { Offset: 247 ProducerId: "src_id" SeqNo: 248 CreateTime: 2025-10-15T10:54:25.994000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27291 bytes.. Information: { Offset: 248 ProducerId: "src_id" SeqNo: 249 CreateTime: 2025-10-15T10:54:25.994000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27401 bytes.. Information: { Offset: 249 ProducerId: "src_id" SeqNo: 250 CreateTime: 2025-10-15T10:54:25.994000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27511 bytes.. Information: { Offset: 250 ProducerId: "src_id" SeqNo: 251 CreateTime: 2025-10-15T10:54:25.994000Z WriteTime: 2025-10-15T10:54:27.980000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:28.117643Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 15, size 401115 bytes
2025-10-15T10:54:28.117691Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:28.183673Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 262 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 28869 count 1 nextOffset 262 batches 1
2025-10-15T10:54:28.183773Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 263 partNo 0
2025-10-15T10:54:28.183814Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 263 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 57816 count 2 nextOffset 263 batches 1
2025-10-15T10:54:28.183836Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 264 partNo 0
2025-10-15T10:54:28.183859Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 264 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 86873 count 3 nextOffset 264 batches 1
2025-10-15T10:54:28.183881Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 265 partNo 0
2025-10-15T10:54:28.183900Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 265 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 116040 count 4 nextOffset 265 batches 1
2025-10-15T10:54:28.183921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 266 partNo 0
2025-10-15T10:54:28.183941Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 266 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 145317 count 5 nextOffset 266 batches 1
2025-10-15T10:54:28.183961Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 267 partNo 0
2025-10-15T10:54:28.183982Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 267 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 174704 count 6 nextOffset 267 batches 1
2025-10-15T10:54:28.184003Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 268 partNo 0
2025-10-15T10:54:28.184022Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 268 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 204201 count 7 nextOffset 268 batches 1
2025-10-15T10:54:28.184042Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 269 partNo 0
2025-10-15T10:54:28.184061Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 269 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 233808 count 8 nextOffset 269 batches 1
2025-10-15T10:54:28.184081Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 270 partNo 0
2025-10-15T10:54:28.184104Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 270 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 263525 count 9 nextOffset 270 batches 1
2025-10-15T10:54:28.184125Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 271 partNo 0
2025-10-15T10:54:28.184146Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 271 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 293352 count 10 nextOffset 271 batches 1
2025-10-15T10:54:28.184166Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 272 partNo 0
2025-10-15T10:54:28.184184Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 272 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 323289 count 11 nextOffset 272 batches 1
2025-10-15T10:54:28.184203Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 273 partNo 0
2025-10-15T10:54:28.184224Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 273 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 353336 count 12 nextOffset 273 batches 1
2025-10-15T10:54:28.184246Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 274 partNo 0
2025-10-15T10:54:28.184267Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 274 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 383493 count 13 nextOffset 274 batches 1
2025-10-15T10:54:28.184288Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 275 partNo 0
2025-10-15T10:54:28.184308Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 275 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 413760 count 14 nextOffset 275 batches 1
2025-10-15T10:54:28.184329Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 276 partNo 0
2025-10-15T10:54:28.184349Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 276 partNo 0 FormedBlobsCount 0 NewHead: Offset 261 PartNo 0 PackedSize 444137 count 15 nextOffset 276 batches 1
2025-10-15T10:54:28.184367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.186031Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 261,15 HeadOffset 261 endOffset 261 curOffset 276 d0000000000_00000000000000000261_00000_0000000015_00000? size 443736 WTime 1760525668185
2025-10-15T10:54:28.186599Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:28.186741Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 507  requestId: <none> cookie: 252
2025-10-15T10:54:28.186818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 508  requestId: <none> cookie: 253
2025-10-15T10:54:28.186849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 509  requestId: <none> cookie: 254
2025-10-15T10:54:28.186875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 510  requestId: <none> cookie: 255
2025-10-15T10:54:28.186902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 511  requestId: <none> cookie: 256
2025-10-15T10:54:28.186933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 517  requestId: <none> cookie: 257
2025-10-15T10:54:28.186956Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 518  requestId: <none> cookie: 258
2025-10-15T10:54:28.186983Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 519  requestId: <none> cookie: 259
2025-10-15T10:54:28.187009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 520  requestId: <none> cookie: 260
2025-10-15T10:54:28.187036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 521  requestId: <none> cookie: 261
2025-10-15T10:54:28.187204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.187235Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.187292Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 277 partNo : 0 messageNo: 557 size 30445 offset: -1
2025-10-15T10:54:28.187492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.187511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.187544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 278 partNo : 0 messageNo: 558 size 30555 offset: -1
2025-10-15T10:54:28.187658Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.187674Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.187700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 279 partNo : 0 messageNo: 559 size 30665 offset: -1
2025-10-15T10:54:28.187805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.187820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.187846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 280 partNo : 0 messageNo: 560 size 30775 offset: -1
2025-10-15T10:54:28.187949Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.187962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.188003Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 281 partNo : 0 messageNo: 561 size 30885 offset: -1
2025-10-15T10:54:28.188037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.188049Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.188083Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.188094Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.188127Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.188138Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.188167Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.188177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.188205Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.188216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.188280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.188301Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:28.188418Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 261 partNo 0 count 15 size 443736
2025-10-15T10:54:28.188454Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.188498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.188510Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.188526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.188538Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.188553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.188564Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.188581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.188591Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.188607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.188850Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 562  requestId: <none> cookie: 282
2025-10-15T10:54:28.188880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 563  requestId: <none> cookie: 283
2025-10-15T10:54:28.188901Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 564  requestId: <none> cookie: 284
2025-10-15T10:54:28.188919Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 565  requestId: <none> cookie: 285
2025-10-15T10:54:28.188942Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 566  requestId: <none> cookie: 286
2025-10-15T10:54:28.192811Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.192906Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.192947Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.192976Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193008Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193067Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193099Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193136Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193166Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193197Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193225Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193265Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193330Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.193358Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.194453Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.194520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.194558Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.194597Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.194637Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.194829Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 251 EndOffset 251 newEndOffset 261 commitOffset 0 clientCommitOffset 0 cookie 16 readingFinished 0 firstRead 0
2025-10-15T10:54:28.194853Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 251 endOffset 261
2025-10-15T10:54:28.194900Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 251, endOffset# 261, WTime# 1760525667980, sizeLag# 282106
2025-10-15T10:54:28.194916Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:28.194969Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# f1009f3d-11048c2f-f69a9c9-3d2dfb3e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 338527, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:28.195029Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 338527 maxTimeLagMs 0 readTimestampMs 0 readOffset 251 EndOffset 261 ClientCommitOffset 0 committedOffset 0 Guid f1009f3d-11048c2f-f69a9c9-3d2dfb3e
2025-10-15T10:54:28.197086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 252 offsets: 251 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:28.197132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 252
2025-10-15T10:54:28.197339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 253 offsets: 252 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:28.197366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 253
2025-10-15T10:54:28.197489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 254 offsets: 253 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:28.197516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 254
2025-10-15T10:54:28.197631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 255 offsets: 254 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:28.197654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 255
2025-10-15T10:54:28.197782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 256 offsets: 255 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:28.197807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 256
2025-10-15T10:54:28.197924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 257 offsets: 256 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 3 }
2025-10-15T10:54:28.197946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 257
2025-10-15T10:54:28.198050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 258 offsets: 257 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:28.198077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 258
2025-10-15T10:54:28.198198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 259 offsets: 258 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:28.198224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 259
2025-10-15T10:54:28.198348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 260 offsets: 259 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:28.198373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 260
2025-10-15T10:54:28.198483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 261 offsets: 260 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:28.198507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 261
2025-10-15T10:54:28.208074Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.208159Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.208191Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.208224Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.208251Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.208715Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.208782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.208817Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.208855Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.208891Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.210375Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 261 Result { Offset: 251 Data: "... 27695 bytes ..." SourceId: "\000src_id" SeqNo: 252 WriteTimestampMS: 1760525668033 CreateTimestampMS: 1760525665995 UncompressedSize: 27621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 252 Data: "... 27805 bytes ..." SourceId: "\000src_id" SeqNo: 253 WriteTimestampMS: 1760525668034 CreateTimestampMS: 1760525665995 UncompressedSize: 27731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 253 Data: "... 27915 bytes ..." SourceId: "\000src_id" SeqNo: 254 WriteTimestampMS: 1760525668034 CreateTimestampMS: 1760525666015 UncompressedSize: 27841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 254 Data: "... 28025 bytes ..." SourceId: "\000src_id" SeqNo: 255 WriteTimestampMS: 1760525668034 CreateTimestampMS: 1760525666015 UncompressedSize: 27951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 255 Data: "... 28135 bytes ..." SourceId: "\000src_id" SeqNo: 256 WriteTimestampMS: 1760525668034 CreateTimestampMS: 1760525666015 UncompressedSize: 28061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 256 Data: "... 28245 bytes ..." SourceId: "\000src_id" SeqNo: 257 WriteTimestampMS: 1760525668034 CreateTimestampMS: 1760525666015 UncompressedSize: 28171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 257 Data: "... 28355 bytes ..." SourceId: "\000src_id" SeqNo: 258 WriteTimestampMS: 1760525668034 CreateTimestampMS: 1760525666015 UncompressedSize: 28281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 258 Data: "... 28465 bytes ..." SourceId: "\000src_id" SeqNo: 259 WriteTimestampMS: 1760525668035 CreateTimestampMS: 1760525666016 UncompressedSize: 28391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 259 Data: "... 28575 bytes ..." SourceId: "\000src_id" SeqNo: 260 WriteTimestampMS: 1760525668035 CreateTimestampMS: 1760525666016 UncompressedSize: 28501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 260 Data: "... 28685 bytes ..." SourceId: "\000src_id" SeqNo: 261 WriteTimestampMS: 1760525668035 CreateTimestampMS: 1760525666016 UncompressedSize: 28611 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551402 RealReadOffset: 260 WaitQuotaTimeMs: 0 EndOffset: 261 StartOffset: 0 } Cookie: 251 }
2025-10-15T10:54:28.211103Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 17 from offset 261
2025-10-15T10:54:28.211147Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 261 ReadOffset 261 ReadGuid f1009f3d-11048c2f-f69a9c9-3d2dfb3e has messages 1
2025-10-15T10:54:28.211306Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# f1009f3d-11048c2f-f69a9c9-3d2dfb3e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 281920
2025-10-15T10:54:28.211336Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# f1009f3d-11048c2f-f69a9c9-3d2dfb3e
2025-10-15T10:54:28.202035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.202083Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.202140Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 282 partNo : 0 messageNo: 567 size 30995 offset: -1
2025-10-15T10:54:28.202262Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.202277Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.202305Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 283 partNo : 0 messageNo: 568 size 31105 offset: -1
2025-10-15T10:54:28.202410Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.202429Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.202455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 284 partNo : 0 messageNo: 569 size 31215 offset: -1
2025-10-15T10:54:28.202560Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.202576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.202602Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 285 partNo : 0 messageNo: 570 size 31325 offset: -1
2025-10-15T10:54:28.202746Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.202762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.202788Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 286 partNo : 0 messageNo: 571 size 31435 offset: -1
2025-10-15T10:54:28.202826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.202841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.202880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.202893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.202928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.202939Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.202971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.202985Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.203017Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.203029Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.203106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.203120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.203214Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.203266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.203280Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.203296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.203308Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.203324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.203334Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.203368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.203379Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.203394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.203901Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 572  requestId: <none> cookie: 287
2025-10-15T10:54:28.203945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 573  requestId: <none> cookie: 288
2025-10-15T10:54:28.203963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 574  requestId: <none> cookie: 289
2025-10-15T10:54:28.203980Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 575  requestId: <none> cookie: 290
2025-10-15T10:54:28.203998Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 576  requestId: <none> cookie: 291
2025-10-15T10:54:28.204062Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 26 Topic 'rt3.dc1--test-topic' partition 0 user user offset 251 count 12 size 338527 endOffset 261 max time lag 0ms effective offset 251
2025-10-15T10:54:28.204258Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 26 added 1 blobs, size 282106 count 10 last offset 251, current partition end offset: 261
2025-10-15T10:54:28.204273Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 26. Send blob request.
2025-10-15T10:54:28.204327Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 251 partno 0 count 10 parts_count 0 source 1 size 282106 accessed 0 times before, last time 2025-10-15T10:54:28.000000Z
2025-10-15T10:54:28.204356Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 26. All 1 blobs are from cache.
2025-10-15T10:54:28.204402Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:28.204508Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 251 partno 0 count 10 parts 0 suffix '63'
2025-10-15T10:54:28.205670Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 251 totakecount 10 count 10 size 282083 from pos 0 cbcount 10
2025-10-15T10:54:28.206008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 251
2025-10-15T10:54:28.214097Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.214139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.214193Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 287 partNo : 0 messageNo: 577 size 31545 offset: -1
2025-10-15T10:54:28.214313Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.214330Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.214357Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 288 partNo : 0 messageNo: 578 size 31655 offset: -1
2025-10-15T10:54:28.214463Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.214479Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.214504Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 289 partNo : 0 messageNo: 579 size 31765 offset: -1
2025-10-15T10:54:28.214605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.214621Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.214647Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 290 partNo : 0 messageNo: 580 size 31875 offset: -1
2025-10-15T10:54:28.214758Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.214774Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.214799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 291 partNo : 0 messageNo: 581 size 31985 offset: -1
2025-10-15T10:54:28.214836Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.214849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.214884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.214900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.214932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.214945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.214975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.214987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.215016Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.215028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.215112Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 261 count 15 size 443736 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:28.215166Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.215212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.215227Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.215245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.215257Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.215271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.215281Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.215297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.215309Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.215322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.215432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:28.215483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 443580 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:28.215519Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215549Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 262, partNo: 0, Offset: 261 is stored on disk
2025-10-15T10:54:28.215567Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215588Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 263, partNo: 0, Offset: 262 is stored on disk
2025-10-15T10:54:28.215599Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215620Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 264, partNo: 0, Offset: 263 is stored on disk
2025-10-15T10:54:28.215634Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215655Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 265, partNo: 0, Offset: 264 is stored on disk
2025-10-15T10:54:28.215666Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215686Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 266, partNo: 0, Offset: 265 is stored on disk
2025-10-15T10:54:28.215699Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215719Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 267, partNo: 0, Offset: 266 is stored on disk
2025-10-15T10:54:28.215729Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215748Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 268, partNo: 0, Offset: 267 is stored on disk
2025-10-15T10:54:28.215761Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215782Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 269, partNo: 0, Offset: 268 is stored on disk
2025-10-15T10:54:28.215793Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215811Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 270, partNo: 0, Offset: 269 is stored on disk
2025-10-15T10:54:28.215823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215844Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 271, partNo: 0, Offset: 270 is stored on disk
2025-10-15T10:54:28.215854Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215877Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 272, partNo: 0, Offset: 271 is stored on disk
2025-10-15T10:54:28.215889Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215910Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 273, partNo: 0, Offset: 272 is stored on disk
2025-10-15T10:54:28.215922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215943Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 274, partNo: 0, Offset: 273 is stored on disk
2025-10-15T10:54:28.215954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.215973Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 275, partNo: 0, Offset: 274 is stored on disk
2025-10-15T10:54:28.215984Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.216002Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 276, partNo: 0, Offset: 275 is stored on disk
2025-10-15T10:54:28.216316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.216385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.216397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T10:54:28.216496Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 277 partNo 0
2025-10-15T10:54:28.219049Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 261 EndOffset 261 newEndOffset 276 commitOffset 0 clientCommitOffset 0 cookie 17 readingFinished 0 firstRead 0
2025-10-15T10:54:28.219091Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 261 endOffset 276
2025-10-15T10:54:28.220303Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:28.220470Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 261, endOffset# 276, WTime# 1760525668035, sizeLag# 443736
2025-10-15T10:54:28.220487Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:28.220536Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 6ece8aa3-8772f57a-9cdbc803-33758c46, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 242368, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:28.220607Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 242368 maxTimeLagMs 0 readTimestampMs 0 readOffset 261 EndOffset 276 ClientCommitOffset 0 committedOffset 0 Guid 6ece8aa3-8772f57a-9cdbc803-33758c46
2025-10-15T10:54:28.222552Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 281920, now ReadSizeBudget = 0, ReadSizeServerDelta = 242368
2025-10-15T10:54:28.222689Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 242368
2025-10-15T10:54:28.222872Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (251-260)
2025-10-15T10:54:28.222911Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 281920 to budget
2025-10-15T10:54:28.222940Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 281920, ReadSizeServerDelta = 242368
2025-10-15T10:54:28.223151Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:28.223262Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (251-251)
2025-10-15T10:54:28.223404Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (252-252)
2025-10-15T10:54:28.223614Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (253-253)
2025-10-15T10:54:28.223692Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (254-254)
2025-10-15T10:54:28.223901Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (255-255)
2025-10-15T10:54:28.223970Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (256-256)
2025-10-15T10:54:28.224042Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (257-257)
2025-10-15T10:54:28.224113Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (258-258)
2025-10-15T10:54:28.224541Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (259-259)
2025-10-15T10:54:28.224639Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (260-260)
2025-10-15T10:54:28.225618Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 281920 } }
2025-10-15T10:54:28.225764Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# dcdbf31f-844cb964-2feb9284-acb5b74e
2025-10-15T10:54:28.218744Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 261 partno 0 count 15 parts 0 suffix '63' size 443736
2025-10-15T10:54:28.226368Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 277 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 30519 count 1 nextOffset 277 batches 1
2025-10-15T10:54:28.226450Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 278 partNo 0
2025-10-15T10:54:28.226495Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 278 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 61116 count 2 nextOffset 278 batches 1
2025-10-15T10:54:28.226521Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 279 partNo 0
2025-10-15T10:54:28.226545Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 279 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 91823 count 3 nextOffset 279 batches 1
2025-10-15T10:54:28.226566Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 280 partNo 0
2025-10-15T10:54:28.226589Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 280 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 122640 count 4 nextOffset 280 batches 1
2025-10-15T10:54:28.226613Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 281 partNo 0
2025-10-15T10:54:28.226636Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 281 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 153567 count 5 nextOffset 281 batches 1
2025-10-15T10:54:28.226658Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 282 partNo 0
2025-10-15T10:54:28.226679Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 282 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 184604 count 6 nextOffset 282 batches 1
2025-10-15T10:54:28.226705Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 283 partNo 0
2025-10-15T10:54:28.226726Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 283 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 215751 count 7 nextOffset 283 batches 1
2025-10-15T10:54:28.226747Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 284 partNo 0
2025-10-15T10:54:28.226769Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 284 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 247008 count 8 nextOffset 284 batches 1
2025-10-15T10:54:28.226791Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 285 partNo 0
2025-10-15T10:54:28.226815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 285 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 278375 count 9 nextOffset 285 batches 1
2025-10-15T10:54:28.226838Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 286 partNo 0
2025-10-15T10:54:28.226859Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 286 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 309852 count 10 nextOffset 286 batches 1
2025-10-15T10:54:28.226880Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 287 partNo 0
2025-10-15T10:54:28.226900Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 287 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 341439 count 11 nextOffset 287 batches 1
2025-10-15T10:54:28.226921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 288 partNo 0
2025-10-15T10:54:28.226944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 288 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 373136 count 12 nextOffset 288 batches 1
2025-10-15T10:54:28.226964Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 289 partNo 0
2025-10-15T10:54:28.226985Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 289 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 404943 count 13 nextOffset 289 batches 1
2025-10-15T10:54:28.227007Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 290 partNo 0
2025-10-15T10:54:28.227028Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 290 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 436860 count 14 nextOffset 290 batches 1
2025-10-15T10:54:28.227050Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 291 partNo 0
2025-10-15T10:54:28.227070Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 291 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 468887 count 15 nextOffset 291 batches 1
2025-10-15T10:54:28.233579Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.233660Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..27621 bytes.. Information: { Offset: 251 ProducerId: "src_id" SeqNo: 252 CreateTime: 2025-10-15T10:54:25.995000Z WriteTime: 2025-10-15T10:54:28.033000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27731 bytes.. Information: { Offset: 252 ProducerId: "src_id" SeqNo: 253 CreateTime: 2025-10-15T10:54:25.995000Z WriteTime: 2025-10-15T10:54:28.034000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27841 bytes.. Information: { Offset: 253 ProducerId: "src_id" SeqNo: 254 CreateTime: 2025-10-15T10:54:26.015000Z WriteTime: 2025-10-15T10:54:28.034000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..27951 bytes.. Information: { Offset: 254 ProducerId: "src_id" SeqNo: 255 CreateTime: 2025-10-15T10:54:26.015000Z WriteTime: 2025-10-15T10:54:28.034000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28061 bytes.. Information: { Offset: 255 ProducerId: "src_id" SeqNo: 256 CreateTime: 2025-10-15T10:54:26.015000Z WriteTime: 2025-10-15T10:54:28.034000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28171 bytes.. Information: { Offset: 256 ProducerId: "src_id" SeqNo: 257 CreateTime: 2025-10-15T10:54:26.015000Z WriteTime: 2025-10-15T10:54:28.034000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28281 bytes.. Information: { Offset: 257 ProducerId: "src_id" SeqNo: 258 CreateTime: 2025-10-15T10:54:26.015000Z WriteTime: 2025-10-15T10:54:28.034000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "logtype": "unknown", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28391 bytes.. Information: { Offset: 258 ProducerId: "src_id" SeqNo: 259 CreateTime: 2025-10-15T10:54:26.016000Z WriteTime: 2025-10-15T10:54:28.035000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28501 bytes.. Information: { Offset: 259 ProducerId: "src_id" SeqNo: 260 CreateTime: 2025-10-15T10:54:26.016000Z WriteTime: 2025-10-15T10:54:28.035000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28611 bytes.. Information: { Offset: 260 ProducerId: "src_id" SeqNo: 261 CreateTime: 2025-10-15T10:54:26.016000Z WriteTime: 2025-10-15T10:54:28.035000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "logtype": "unknown", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:28.236216Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 10, size 281160 bytes
2025-10-15T10:54:28.236267Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:28.227104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.228803Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 276,15 HeadOffset 276 endOffset 276 curOffset 291 d0000000000_00000000000000000276_00000_0000000015_00000? size 468486 WTime 1760525668228
2025-10-15T10:54:28.229375Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:28.229483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 582  requestId: <none> cookie: 292
2025-10-15T10:54:28.229546Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 583  requestId: <none> cookie: 293
2025-10-15T10:54:28.229567Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 584  requestId: <none> cookie: 294
2025-10-15T10:54:28.229587Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 585  requestId: <none> cookie: 295
2025-10-15T10:54:28.229615Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 586  requestId: <none> cookie: 296
2025-10-15T10:54:28.229644Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 527  requestId: <none> cookie: 262
2025-10-15T10:54:28.229674Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 528  requestId: <none> cookie: 263
2025-10-15T10:54:28.229698Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 529  requestId: <none> cookie: 264
2025-10-15T10:54:28.229743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 530  requestId: <none> cookie: 265
2025-10-15T10:54:28.229770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 531  requestId: <none> cookie: 266
2025-10-15T10:54:28.229799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 537  requestId: <none> cookie: 267
2025-10-15T10:54:28.229825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 538  requestId: <none> cookie: 268
2025-10-15T10:54:28.229851Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 539  requestId: <none> cookie: 269
2025-10-15T10:54:28.229876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 540  requestId: <none> cookie: 270
2025-10-15T10:54:28.229902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 541  requestId: <none> cookie: 271
2025-10-15T10:54:28.229927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 547  requestId: <none> cookie: 272
2025-10-15T10:54:28.229954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 548  requestId: <none> cookie: 273
2025-10-15T10:54:28.229979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 549  requestId: <none> cookie: 274
2025-10-15T10:54:28.230002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 550  requestId: <none> cookie: 275
2025-10-15T10:54:28.230026Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 551  requestId: <none> cookie: 276
2025-10-15T10:54:28.230139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.230166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.230214Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:28.230329Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 276 partNo 0 count 15 size 468486
2025-10-15T10:54:28.230584Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 27 Topic 'rt3.dc1--test-topic' partition 0 user user offset 261 count 18 size 242368 endOffset 276 max time lag 0ms effective offset 261
2025-10-15T10:54:28.230757Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 27 added 1 blobs, size 443736 count 15 last offset 261, current partition end offset: 276
2025-10-15T10:54:28.230772Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 27. Send blob request.
2025-10-15T10:54:28.230828Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 261 partno 0 count 15 parts_count 0 source 1 size 443736 accessed 0 times before, last time 2025-10-15T10:54:28.000000Z
2025-10-15T10:54:28.230851Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 27. All 1 blobs are from cache.
2025-10-15T10:54:28.237232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.237291Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.237324Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.237354Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.230896Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:28.232588Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 261 partno 0 count 15 parts 0 suffix '63'
2025-10-15T10:54:28.244804Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.244860Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.244894Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.244927Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.244956Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245032Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245068Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245099Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245133Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245168Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245204Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245236Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245264Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.245919Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.245989Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.246028Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.246066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:28.253443Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 261 totakecount 15 count 15 size 443713 from pos 0 cbcount 15
2025-10-15T10:54:28.253998Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.254031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.254101Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 292 partNo : 0 messageNo: 587 size 32095 offset: -1
2025-10-15T10:54:28.254226Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.254241Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.254269Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 293 partNo : 0 messageNo: 588 size 32205 offset: -1
2025-10-15T10:54:28.254341Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.254353Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.254376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 294 partNo : 0 messageNo: 589 size 32315 offset: -1
2025-10-15T10:54:28.254442Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.254456Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.254478Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 295 partNo : 0 messageNo: 590 size 32425 offset: -1
2025-10-15T10:54:28.254542Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.254555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.254579Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 296 partNo : 0 messageNo: 591 size 32535 offset: -1
2025-10-15T10:54:28.254616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.254629Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.254665Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.254678Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.254708Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.254718Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.254749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.254761Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.254862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 261
2025-10-15T10:54:28.254952Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.255001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.255016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.255033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.255046Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.255064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.255074Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.255088Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.255098Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.255114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.255415Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 592  requestId: <none> cookie: 297
2025-10-15T10:54:28.255443Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 593  requestId: <none> cookie: 298
2025-10-15T10:54:28.255462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 594  requestId: <none> cookie: 299
2025-10-15T10:54:28.255479Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 595  requestId: <none> cookie: 300
2025-10-15T10:54:28.261507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 262 offsets: 261 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 130 }
2025-10-15T10:54:28.261562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 262
2025-10-15T10:54:28.261809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 263 offsets: 262 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 130 }
2025-10-15T10:54:28.261835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 263
2025-10-15T10:54:28.261948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 264 offsets: 263 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 130 }
2025-10-15T10:54:28.261970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 264
2025-10-15T10:54:28.262294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 265 offsets: 264 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 130 }
2025-10-15T10:54:28.262320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 265
2025-10-15T10:54:28.262429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 266 offsets: 265 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 130 }
2025-10-15T10:54:28.262450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 266
2025-10-15T10:54:28.262538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 267 offsets: 266 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 121 }
2025-10-15T10:54:28.262557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 267
2025-10-15T10:54:28.262651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 268 offsets: 267 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 120 }
2025-10-15T10:54:28.262668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 268
2025-10-15T10:54:28.262750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 269 offsets: 268 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 121 }
2025-10-15T10:54:28.262767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 269
2025-10-15T10:54:28.262857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 270 offsets: 269 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 121 }
2025-10-15T10:54:28.262876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 270
2025-10-15T10:54:28.262969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 271 offsets: 270 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 121 }
2025-10-15T10:54:28.262988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 271
2025-10-15T10:54:28.263071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 272 offsets: 271 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 106 }
2025-10-15T10:54:28.263090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 272
2025-10-15T10:54:28.263185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 273 offsets: 272 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 106 }
2025-10-15T10:54:28.263207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 273
2025-10-15T10:54:28.263310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 274 offsets: 273 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 106 }
2025-10-15T10:54:28.263329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 274
2025-10-15T10:54:28.263446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 275 offsets: 274 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 106 }
2025-10-15T10:54:28.263465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 275
2025-10-15T10:54:28.263566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 276 offsets: 275 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 106 }
2025-10-15T10:54:28.263585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 276
2025-10-15T10:54:28.291485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.395458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.414418Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 276 Result { Offset: 261 Data: "... 28795 bytes ..." SourceId: "\000src_id" SeqNo: 262 WriteTimestampMS: 1760525668091 CreateTimestampMS: 1760525666016 UncompressedSize: 28721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 262 Data: "... 28905 bytes ..." SourceId: "\000src_id" SeqNo: 263 WriteTimestampMS: 1760525668183 CreateTimestampMS: 1760525666016 UncompressedSize: 28831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 263 Data: "... 29015 bytes ..." SourceId: "\000src_id" SeqNo: 264 WriteTimestampMS: 1760525668183 CreateTimestampMS: 1760525666016 UncompressedSize: 28941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 264 Data: "... 29125 bytes ..." SourceId: "\000src_id" SeqNo: 265 WriteTimestampMS: 1760525668183 CreateTimestampMS: 1760525666017 UncompressedSize: 29051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 265 Data: "... 29235 bytes ..." SourceId: "\000src_id" SeqNo: 266 WriteTimestampMS: 1760525668183 CreateTimestampMS: 1760525666017 UncompressedSize: 29161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 266 Data: "... 29345 bytes ..." SourceId: "\000src_id" SeqNo: 267 WriteTimestampMS: 1760525668183 CreateTimestampMS: 1760525666017 UncompressedSize: 29271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 267 Data: "... 29455 bytes ..." SourceId: "\000src_id" SeqNo: 268 WriteTimestampMS: 1760525668183 CreateTimestampMS: 1760525666017 UncompressedSize: 29381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 268 Data: "... 29565 bytes ..." SourceId: "\000src_id" SeqNo: 269 WriteTimestampMS: 1760525668183 CreateTimestampMS: 1760525666017 UncompressedSize: 29491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 269 Data: "... 29675 bytes ..." SourceId: "\000src_id" SeqNo: 270 WriteTimestampMS: 1760525668184 CreateTimestampMS: 1760525666017 UncompressedSize: 29601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 270 Data: "... 29785 bytes ..." SourceId: "\000src_id" SeqNo: 271 WriteTimestampMS: 1760525668184 CreateTimestampMS: 1760525666018 UncompressedSize: 29711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 271 Data: "... 29895 bytes ..." SourceId: "\000src_id" SeqNo: 272 WriteTimestampMS: 1760525668184 CreateTimestampMS: 1760525666018 UncompressedSize: 29821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 272 Data: "... 30005 bytes ..." SourceId: "\000src_id" SeqNo: 273 WriteTimestampMS: 1760525668184 CreateTimestampMS: 1760525666018 UncompressedSize: 29931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 273 Data: "... 30115 bytes ..." SourceId: "\000src_id" SeqNo: 274 WriteTimestampMS: 1760525668184 CreateTimestampMS: 1760525666018 UncompressedSize: 30041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 274 Data: "... 30225 bytes ..." SourceId: "\000src_id" SeqNo: 275 WriteTimestampMS: 1760525668184 CreateTimestampMS: 1760525666018 UncompressedSize: 30151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 275 Data: "... 30335 bytes ..." SourceId: "\000src_id" SeqNo: 276 WriteTimestampMS: 1760525668184 CreateTimestampMS: 1760525666018 UncompressedSize: 30261 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551247 RealReadOffset: 275 WaitQuotaTimeMs: 0 EndOffset: 276 StartOffset: 0 } Cookie: 261 }
2025-10-15T10:54:28.415608Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 18 from offset 276
2025-10-15T10:54:28.415654Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 276 ReadOffset 276 ReadGuid 6ece8aa3-8772f57a-9cdbc803-33758c46 has messages 1
2025-10-15T10:54:28.415853Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.415910Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.415938Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.415967Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.416084Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 6ece8aa3-8772f57a-9cdbc803-33758c46, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 443318
2025-10-15T10:54:28.416118Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 6ece8aa3-8772f57a-9cdbc803-33758c46
2025-10-15T10:54:28.417064Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:28.417855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.417897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.417953Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 297 partNo : 0 messageNo: 596 size 32645 offset: -1
2025-10-15T10:54:28.418030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.418044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.418069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 298 partNo : 0 messageNo: 597 size 32755 offset: -1
2025-10-15T10:54:28.418129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.418142Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.418166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 299 partNo : 0 messageNo: 598 size 32865 offset: -1
2025-10-15T10:54:28.418229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.418244Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.418265Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 300 partNo : 0 messageNo: 599 size 32975 offset: -1
2025-10-15T10:54:28.418289Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.418336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.418348Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.418362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.418374Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.418387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.418397Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:28.418411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:54:28.420022Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 276 count 15 size 468486 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:28.420073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:28.420127Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 468330 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:28.420159Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420187Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 277, partNo: 0, Offset: 276 is stored on disk
2025-10-15T10:54:28.420205Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420224Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 278, partNo: 0, Offset: 277 is stored on disk
2025-10-15T10:54:28.420235Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 279, partNo: 0, Offset: 278 is stored on disk
2025-10-15T10:54:28.420264Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420280Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 280, partNo: 0, Offset: 279 is stored on disk
2025-10-15T10:54:28.420292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420309Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 281, partNo: 0, Offset: 280 is stored on disk
2025-10-15T10:54:28.420319Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420339Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 282, partNo: 0, Offset: 281 is stored on disk
2025-10-15T10:54:28.420351Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420370Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 283, partNo: 0, Offset: 282 is stored on disk
2025-10-15T10:54:28.420381Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420401Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 284, partNo: 0, Offset: 283 is stored on disk
2025-10-15T10:54:28.420413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420431Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 285, partNo: 0, Offset: 284 is stored on disk
2025-10-15T10:54:28.420440Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 286, partNo: 0, Offset: 285 is stored on disk
2025-10-15T10:54:28.420470Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 287, partNo: 0, Offset: 286 is stored on disk
2025-10-15T10:54:28.420500Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420518Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 288, partNo: 0, Offset: 287 is stored on disk
2025-10-15T10:54:28.420529Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420546Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 289, partNo: 0, Offset: 288 is stored on disk
2025-10-15T10:54:28.420556Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420576Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 290, partNo: 0, Offset: 289 is stored on disk
2025-10-15T10:54:28.420589Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.420605Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 291, partNo: 0, Offset: 290 is stored on disk
2025-10-15T10:54:28.421059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.421109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.421119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (9)
2025-10-15T10:54:28.421212Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 292 partNo 0
2025-10-15T10:54:28.422102Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 276 partno 0 count 15 parts 0 suffix '63' size 468486
2025-10-15T10:54:28.422347Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 276 EndOffset 276 newEndOffset 291 commitOffset 0 clientCommitOffset 0 cookie 18 readingFinished 0 firstRead 0
2025-10-15T10:54:28.422386Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 276 endOffset 291
2025-10-15T10:54:28.422459Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 276, endOffset# 291, WTime# 1760525668184, sizeLag# 468486
2025-10-15T10:54:28.422474Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:28.422516Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# 8eb1ff4a-d534eee7-acbff6e1-99079e9, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 80970, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:28.422561Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 80970 maxTimeLagMs 0 readTimestampMs 0 readOffset 276 EndOffset 291 ClientCommitOffset 0 committedOffset 0 Guid 8eb1ff4a-d534eee7-acbff6e1-99079e9
2025-10-15T10:54:28.424043Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 443318, now ReadSizeBudget = 0, ReadSizeServerDelta = 80970
2025-10-15T10:54:28.424205Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 80970
2025-10-15T10:54:28.424461Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (261-275)
2025-10-15T10:54:28.424499Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 443318 to budget
2025-10-15T10:54:28.424529Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 443318, ReadSizeServerDelta = 80970
2025-10-15T10:54:28.424733Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:28.424841Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (261-261)
2025-10-15T10:54:28.424958Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (262-262)
2025-10-15T10:54:28.425107Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (263-263)
2025-10-15T10:54:28.425208Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (264-264)
2025-10-15T10:54:28.425427Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (265-265)
2025-10-15T10:54:28.425499Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (266-266)
2025-10-15T10:54:28.425571Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (267-267)
2025-10-15T10:54:28.425670Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (268-268)
2025-10-15T10:54:28.426083Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (269-269)
2025-10-15T10:54:28.426157Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (270-270)
2025-10-15T10:54:28.426225Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (271-271)
2025-10-15T10:54:28.426299Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 3} (272-272)
2025-10-15T10:54:28.426373Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 4} (273-273)
2025-10-15T10:54:28.426447Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 5} (274-274)
2025-10-15T10:54:28.426517Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 6} (275-275)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..28721 bytes.. Information: { Offset: 261 ProducerId: "src_id" SeqNo: 262 CreateTime: 2025-10-15T10:54:26.016000Z WriteTime: 2025-10-15T10:54:28.091000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28831 bytes.. Information: { Offset: 262 ProducerId: "src_id" SeqNo: 263 CreateTime: 2025-10-15T10:54:26.016000Z WriteTime: 2025-10-15T10:54:28.183000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..28941 bytes.. Information: { Offset: 263 ProducerId: "src_id" SeqNo: 264 CreateTime: 2025-10-15T10:54:26.016000Z WriteTime: 2025-10-15T10:54:28.183000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29051 bytes.. Information: { Offset: 264 ProducerId: "src_id" SeqNo: 265 CreateTime: 2025-10-15T10:54:26.017000Z WriteTime: 2025-10-15T10:54:28.183000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29161 bytes.. Information: { Offset: 265 ProducerId: "src_id" SeqNo: 266 CreateTime: 2025-10-15T10:54:26.017000Z WriteTime: 2025-10-15T10:54:28.183000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29271 bytes.. Information: { Offset: 266 ProducerId: "src_id" SeqNo: 267 CreateTime: 2025-10-15T10:54:26.017000Z WriteTime: 2025-10-15T10:54:28.183000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29381 bytes.. Information: { Offset: 267 ProducerId: "src_id" SeqNo: 268 CreateTime: 2025-10-15T10:54:26.017000Z WriteTime: 2025-10-15T10:54:28.183000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29491 bytes.. Information: { Offset: 268 ProducerId: "src_id" SeqNo: 269 CreateTime: 2025-10-15T10:54:26.017000Z WriteTime: 2025-10-15T10:54:28.183000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29601 bytes.. Information: { Offset: 269 ProducerId: "src_id" SeqNo: 270 CreateTime: 2025-10-15T10:54:26.017000Z WriteTime: 2025-10-15T10:54:28.184000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29711 bytes.. Information: { Offset: 270 ProducerId: "src_id" SeqNo: 271 CreateTime: 2025-10-15T10:54:26.018000Z WriteTime: 2025-10-15T10:54:28.184000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29821 bytes.. Information: { Offset: 271 ProducerId: "src_id" SeqNo: 272 CreateTime: 2025-10-15T10:54:26.018000Z WriteTime: 2025-10-15T10:54:28.184000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..29931 bytes.. Information: { Offset: 272 ProducerId: "src_id" SeqNo: 273 CreateTime: 2025-10-15T10:54:26.018000Z WriteTime: 2025-10-15T10:54:28.184000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30041 bytes.. Information: { Offset: 273 ProducerId: "src_id" SeqNo: 274 CreateTime: 2025-10-15T10:54:26.018000Z WriteTime: 2025-10-15T10:54:28.184000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30151 bytes.. Information: { Offset: 274 ProducerId: "src_id" SeqNo: 275 CreateTime: 2025-10-15T10:54:26.018000Z WriteTime: 2025-10-15T10:54:28.184000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30261 bytes.. Information: { Offset: 275 ProducerId: "src_id" SeqNo: 276 CreateTime: 2025-10-15T10:54:26.018000Z WriteTime: 2025-10-15T10:54:28.184000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:28.429661Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 15, size 442365 bytes
2025-10-15T10:54:28.429701Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:28.423119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 292 partNo 0 FormedBlobsCount 0 NewHead: Offset 291 PartNo 0 PackedSize 32169 count 1 nextOffset 292 batches 1
2025-10-15T10:54:28.423200Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 293 partNo 0
2025-10-15T10:54:28.423238Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 293 partNo 0 FormedBlobsCount 0 NewHead: Offset 291 PartNo 0 PackedSize 64416 count 2 nextOffset 293 batches 1
2025-10-15T10:54:28.423259Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 294 partNo 0
2025-10-15T10:54:28.423285Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 294 partNo 0 FormedBlobsCount 0 NewHead: Offset 291 PartNo 0 PackedSize 96773 count 3 nextOffset 294 batches 1
2025-10-15T10:54:28.423307Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 295 partNo 0
2025-10-15T10:54:28.423327Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 295 partNo 0 FormedBlobsCount 0 NewHead: Offset 291 PartNo 0 PackedSize 129240 count 4 nextOffset 295 batches 1
2025-10-15T10:54:28.423365Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 296 partNo 0
2025-10-15T10:54:28.423388Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 296 partNo 0 FormedBlobsCount 0 NewHead: Offset 291 PartNo 0 PackedSize 161817 count 5 nextOffset 296 batches 1
2025-10-15T10:54:28.423411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 297 partNo 0
2025-10-15T10:54:28.423432Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 297 partNo 0 FormedBlobsCount 0 NewHead: Offset 291 PartNo 0 PackedSize 194504 count 6 nextOffset 297 batches 1
2025-10-15T10:54:28.423451Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 298 partNo 0
2025-10-15T10:54:28.423470Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 298 partNo 0 FormedBlobsCount 0 NewHead: Offset 291 PartNo 0 PackedSize 227301 count 7 nextOffset 298 batches 1
2025-10-15T10:54:28.423491Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 299 partNo 0
2025-10-15T10:54:28.423510Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 299 partNo 0 FormedBlobsCount 0 NewHead: Offset 291 PartNo 0 PackedSize 260208 count 8 nextOffset 299 batches 1
2025-10-15T10:54:28.423529Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 300 partNo 0
2025-10-15T10:54:28.423549Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 300 partNo 0 FormedBlobsCount 0 NewHead: Offset 291 PartNo 0 PackedSize 293225 count 9 nextOffset 300 batches 1
2025-10-15T10:54:28.423566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.435634Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 443318 } }
2025-10-15T10:54:28.435852Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 32b982f9-488a0d89-5e8e5bcf-f4f615e3
2025-10-15T10:54:28.436635Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 291,9 HeadOffset 291 endOffset 291 curOffset 300 d0000000000_00000000000000000291_00000_0000000009_00000? size 293010 WTime 1760525668436
2025-10-15T10:54:28.444495Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:28.444624Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 557  requestId: <none> cookie: 277
2025-10-15T10:54:28.444709Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 558  requestId: <none> cookie: 278
2025-10-15T10:54:28.444745Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 559  requestId: <none> cookie: 279
2025-10-15T10:54:28.444768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 560  requestId: <none> cookie: 280
2025-10-15T10:54:28.444793Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 561  requestId: <none> cookie: 281
2025-10-15T10:54:28.444821Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 567  requestId: <none> cookie: 282
2025-10-15T10:54:28.444847Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 568  requestId: <none> cookie: 283
2025-10-15T10:54:28.444876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 569  requestId: <none> cookie: 284
2025-10-15T10:54:28.444904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 570  requestId: <none> cookie: 285
2025-10-15T10:54:28.444930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 571  requestId: <none> cookie: 286
2025-10-15T10:54:28.444957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 577  requestId: <none> cookie: 287
2025-10-15T10:54:28.444980Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 578  requestId: <none> cookie: 288
2025-10-15T10:54:28.445005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 579  requestId: <none> cookie: 289
2025-10-15T10:54:28.445030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 580  requestId: <none> cookie: 290
2025-10-15T10:54:28.445055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 581  requestId: <none> cookie: 291
2025-10-15T10:54:28.445161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.445185Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.445227Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:28.445344Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 291 partNo 0 count 9 size 293010
2025-10-15T10:54:28.445573Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 28 Topic 'rt3.dc1--test-topic' partition 0 user user offset 276 count 18 size 80970 endOffset 291 max time lag 0ms effective offset 276
2025-10-15T10:54:28.445755Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 28 added 1 blobs, size 468486 count 15 last offset 276, current partition end offset: 291
2025-10-15T10:54:28.445769Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 28. Send blob request.
2025-10-15T10:54:28.445815Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 276 partno 0 count 15 parts_count 0 source 1 size 468486 accessed 0 times before, last time 2025-10-15T10:54:28.000000Z
2025-10-15T10:54:28.445836Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 28. All 1 blobs are from cache.
2025-10-15T10:54:28.445877Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:28.447520Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 276 partno 0 count 15 parts 0 suffix '63'
2025-10-15T10:54:28.447928Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448010Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448043Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448071Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448104Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448133Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448162Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448189Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448217Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448244Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448271Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448294Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448322Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.448373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.449829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 277 offsets: 276 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:28.449872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 277
2025-10-15T10:54:28.451510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 278 offsets: 277 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 37 }
2025-10-15T10:54:28.451550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 278
2025-10-15T10:54:28.451696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 279 offsets: 278 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 38 }
2025-10-15T10:54:28.451717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 279
2025-10-15T10:54:28.451832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 280 offsets: 279 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 38 }
2025-10-15T10:54:28.451854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 280
2025-10-15T10:54:28.451965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 281 offsets: 280 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 38 }
2025-10-15T10:54:28.451990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 281
2025-10-15T10:54:28.452078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 282 offsets: 281 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 24 }
2025-10-15T10:54:28.452099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 282
2025-10-15T10:54:28.452198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 283 offsets: 282 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:28.452219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 283
2025-10-15T10:54:28.452336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 284 offsets: 283 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:28.452357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 284
2025-10-15T10:54:28.452456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 285 offsets: 284 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:28.452476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 285
2025-10-15T10:54:28.452590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 286 offsets: 285 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 23 }
2025-10-15T10:54:28.452616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 286
2025-10-15T10:54:28.452772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 287 offsets: 286 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:28.452795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 287
2025-10-15T10:54:28.452927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 288 offsets: 287 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:28.452949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 288
2025-10-15T10:54:28.453092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 289 offsets: 288 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:28.453114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 289
2025-10-15T10:54:28.453256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 290 offsets: 289 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:28.453282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 290
2025-10-15T10:54:28.453397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 291 offsets: 290 already_written: false write_statistics { persist_duration_ms: 193 queued_in_partition_duration_ms: 11 }
2025-10-15T10:54:28.453423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 291
2025-10-15T10:54:28.453367Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 276 totakecount 15 count 15 size 468463 from pos 0 cbcount 15
2025-10-15T10:54:28.453831Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 276
2025-10-15T10:54:28.461418Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 291 Result { Offset: 276 Data: "... 30445 bytes ..." SourceId: "\000src_id" SeqNo: 277 WriteTimestampMS: 1760525668216 CreateTimestampMS: 1760525666019 UncompressedSize: 30371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 277 Data: "... 30555 bytes ..." SourceId: "\000src_id" SeqNo: 278 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666019 UncompressedSize: 30481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 278 Data: "... 30665 bytes ..." SourceId: "\000src_id" SeqNo: 279 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666032 UncompressedSize: 30591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 279 Data: "... 30775 bytes ..." SourceId: "\000src_id" SeqNo: 280 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666032 UncompressedSize: 30701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 280 Data: "... 30885 bytes ..." SourceId: "\000src_id" SeqNo: 281 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666032 UncompressedSize: 30811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 281 Data: "... 30995 bytes ..." SourceId: "\000src_id" SeqNo: 282 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666032 UncompressedSize: 30921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 282 Data: "... 31105 bytes ..." SourceId: "\000src_id" SeqNo: 283 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666032 UncompressedSize: 31031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 283 Data: "... 31215 bytes ..." SourceId: "\000src_id" SeqNo: 284 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666032 UncompressedSize: 31141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 284 Data: "... 31325 bytes ..." SourceId: "\000src_id" SeqNo: 285 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666033 UncompressedSize: 31251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 285 Data: "... 31435 bytes ..." SourceId: "\000src_id" SeqNo: 286 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666033 UncompressedSize: 31361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 286 Data: "... 31545 bytes ..." SourceId: "\000src_id" SeqNo: 287 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666033 UncompressedSize: 31471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 287 Data: "... 31655 bytes ..." SourceId: "\000src_id" SeqNo: 288 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666033 UncompressedSize: 31581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 288 Data: "... 31765 bytes ..." SourceId: "\000src_id" SeqNo: 289 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666033 UncompressedSize: 31691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 289 Data: "... 31875 bytes ..." SourceId: "\000src_id" SeqNo: 290 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666033 UncompressedSize: 31801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 290 Data: "... 31985 bytes ..." SourceId: "\000src_id" SeqNo: 291 WriteTimestampMS: 1760525668226 CreateTimestampMS: 1760525666034 UncompressedSize: 31911 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551247 RealReadOffset: 290 WaitQuotaTimeMs: 0 EndOffset: 291 StartOffset: 0 } Cookie: 276 }
2025-10-15T10:54:28.462652Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 19 from offset 291
2025-10-15T10:54:28.462700Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 291 ReadOffset 291 ReadGuid 8eb1ff4a-d534eee7-acbff6e1-99079e9 has messages 1
2025-10-15T10:54:28.462955Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# 8eb1ff4a-d534eee7-acbff6e1-99079e9, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 467950
2025-10-15T10:54:28.462986Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# 8eb1ff4a-d534eee7-acbff6e1-99079e9
2025-10-15T10:54:28.465783Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:28.477420Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 467950, now ReadSizeBudget = 0, ReadSizeServerDelta = 56338
2025-10-15T10:54:28.477569Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 56338
2025-10-15T10:54:28.477903Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (276-290)
2025-10-15T10:54:28.477938Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 467950 to budget
2025-10-15T10:54:28.477967Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 467950, ReadSizeServerDelta = 56338
2025-10-15T10:54:28.478181Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:28.478321Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (276-276)
2025-10-15T10:54:28.478429Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (277-277)
2025-10-15T10:54:28.478571Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (278-278)
2025-10-15T10:54:28.478635Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (279-279)
2025-10-15T10:54:28.478898Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (280-280)
2025-10-15T10:54:28.478975Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (281-281)
2025-10-15T10:54:28.479036Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (282-282)
2025-10-15T10:54:28.479108Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (283-283)
2025-10-15T10:54:28.479531Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (284-284)
2025-10-15T10:54:28.479646Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (285-285)
2025-10-15T10:54:28.479704Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (286-286)
2025-10-15T10:54:28.479774Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (287-287)
2025-10-15T10:54:28.479839Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (288-288)
2025-10-15T10:54:28.479895Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (289-289)
2025-10-15T10:54:28.479952Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (290-290)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..30371 bytes.. Information: { Offset: 276 ProducerId: "src_id" SeqNo: 277 CreateTime: 2025-10-15T10:54:26.019000Z WriteTime: 2025-10-15T10:54:28.216000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30481 bytes.. Information: { Offset: 277 ProducerId: "src_id" SeqNo: 278 CreateTime: 2025-10-15T10:54:26.019000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30591 bytes.. Information: { Offset: 278 ProducerId: "src_id" SeqNo: 279 CreateTime: 2025-10-15T10:54:26.032000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30701 bytes.. Information: { Offset: 279 ProducerId: "src_id" SeqNo: 280 CreateTime: 2025-10-15T10:54:26.032000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30811 bytes.. Information: { Offset: 280 ProducerId: "src_id" SeqNo: 281 CreateTime: 2025-10-15T10:54:26.032000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..30921 bytes.. Information: { Offset: 281 ProducerId: "src_id" SeqNo: 282 CreateTime: 2025-10-15T10:54:26.032000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31031 bytes.. Information: { Offset: 282 ProducerId: "src_id" SeqNo: 283 CreateTime: 2025-10-15T10:54:26.032000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31141 bytes.. Information: { Offset: 283 ProducerId: "src_id" SeqNo: 284 CreateTime: 2025-10-15T10:54:26.032000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31251 bytes.. Information: { Offset: 284 ProducerId: "src_id" SeqNo: 285 CreateTime: 2025-10-15T10:54:26.033000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31361 bytes.. Information: { Offset: 285 ProducerId: "src_id" SeqNo: 286 CreateTime: 2025-10-15T10:54:26.033000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31471 bytes.. Information: { Offset: 286 ProducerId: "src_id" SeqNo: 287 CreateTime: 2025-10-15T10:54:26.033000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31581 bytes.. Information: { Offset: 287 ProducerId: "src_id" SeqNo: 288 CreateTime: 2025-10-15T10:54:26.033000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31691 bytes.. Information: { Offset: 288 ProducerId: "src_id" SeqNo: 289 CreateTime: 2025-10-15T10:54:26.033000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31801 bytes.. Information: { Offset: 289 ProducerId: "src_id" SeqNo: 290 CreateTime: 2025-10-15T10:54:26.033000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..31911 bytes.. Information: { Offset: 290 ProducerId: "src_id" SeqNo: 291 CreateTime: 2025-10-15T10:54:26.034000Z WriteTime: 2025-10-15T10:54:28.226000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:42440", "server": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:28.486901Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 15, size 467115 bytes
2025-10-15T10:54:28.486957Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:28.487959Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 291 count 9 size 293010 actorID [4:7561400150473162765:2377]
2025-10-15T10:54:28.488029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:28.488078Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 292878 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:28.488108Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.488139Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 292, partNo: 0, Offset: 291 is stored on disk
2025-10-15T10:54:28.488156Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.488177Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 293, partNo: 0, Offset: 292 is stored on disk
2025-10-15T10:54:28.488187Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.488208Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 294, partNo: 0, Offset: 293 is stored on disk
2025-10-15T10:54:28.488218Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.488236Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 295, partNo: 0, Offset: 294 is stored on disk
2025-10-15T10:54:28.488245Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.488270Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 296, partNo: 0, Offset: 295 is stored on disk
2025-10-15T10:54:28.488283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.488302Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 297, partNo: 0, Offset: 296 is stored on disk
2025-10-15T10:54:28.488312Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.488332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 298, partNo: 0, Offset: 297 is stored on disk
2025-10-15T10:54:28.488344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.488360Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 299, partNo: 0, Offset: 298 is stored on disk
2025-10-15T10:54:28.488370Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:28.488388Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 300, partNo: 0, Offset: 299 is stored on disk
2025-10-15T10:54:28.488712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.488724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.488733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.488763Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:28.488812Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 4964600 CachedBlobs 30
2025-10-15T10:54:28.488841Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 587  requestId: <none> cookie: 292
2025-10-15T10:54:28.488877Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 588  requestId: <none> cookie: 293
2025-10-15T10:54:28.488902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 589  requestId: <none> cookie: 294
2025-10-15T10:54:28.488927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 590  requestId: <none> cookie: 295
2025-10-15T10:54:28.488952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 591  requestId: <none> cookie: 296
2025-10-15T10:54:28.488975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 596  requestId: <none> cookie: 297
2025-10-15T10:54:28.488996Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 597  requestId: <none> cookie: 298
2025-10-15T10:54:28.489018Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 598  requestId: <none> cookie: 299
2025-10-15T10:54:28.489043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 599  requestId: <none> cookie: 300
2025-10-15T10:54:28.489168Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 291 partno 0 count 9 parts 0 suffix '63' size 293010
2025-10-15T10:54:28.494951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.494980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.494994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.495496Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 291 EndOffset 291 newEndOffset 300 commitOffset 0 clientCommitOffset 0 cookie 19 readingFinished 0 firstRead 0
2025-10-15T10:54:28.495544Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 291 endOffset 300
2025-10-15T10:54:28.495614Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.495685Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.495721Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.495748Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.495775Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.495804Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.495828Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.495854Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.495880Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:28.497156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 292 offsets: 291 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 168 }
2025-10-15T10:54:28.497197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 292
2025-10-15T10:54:28.498321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 293 offsets: 292 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 168 }
2025-10-15T10:54:28.498357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 293
2025-10-15T10:54:28.498499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 294 offsets: 293 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 168 }
2025-10-15T10:54:28.498520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 294
2025-10-15T10:54:28.498632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 295 offsets: 294 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 168 }
2025-10-15T10:54:28.498656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 295
2025-10-15T10:54:28.498759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 296 offsets: 295 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 168 }
2025-10-15T10:54:28.498779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 296
2025-10-15T10:54:28.498884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 297 offsets: 296 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:28.498907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 297
2025-10-15T10:54:28.499010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 298 offsets: 297 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:28.499031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 298
2025-10-15T10:54:28.499143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 299 offsets: 298 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:28.499167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 299
2025-10-15T10:54:28.499280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session got write response: sequence_numbers: 300 offsets: 299 already_written: false write_statistics { persist_duration_ms: 64 queued_in_partition_duration_ms: 4 }
2025-10-15T10:54:28.499304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: acknoledged message 300
2025-10-15T10:54:28.515850Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 467950 } }
2025-10-15T10:54:28.515925Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 291, endOffset# 300, WTime# 1760525668226, sizeLag# 293010
2025-10-15T10:54:28.515938Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1TEvPartitionReady. Aval parts: 1
2025-10-15T10:54:28.515978Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 performing read request: guid# e52138a9-e83025ba-dfd321c0-8b81e874, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 56338, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T10:54:28.516097Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# 49001403-61c6eaa8-5fa16d57-4f8384e4
2025-10-15T10:54:28.516152Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 56338 maxTimeLagMs 0 readTimestampMs 0 readOffset 291 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid e52138a9-e83025ba-dfd321c0-8b81e874
2025-10-15T10:54:28.520331Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:28.520382Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:28.520520Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 29 Topic 'rt3.dc1--test-topic' partition 0 user user offset 291 count 10 size 56338 endOffset 300 max time lag 0ms effective offset 291
2025-10-15T10:54:28.520725Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 29 added 1 blobs, size 293010 count 9 last offset 291, current partition end offset: 300
2025-10-15T10:54:28.520742Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 29. Send blob request.
2025-10-15T10:54:28.520802Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 291 partno 0 count 9 parts_count 0 source 1 size 293010 accessed 0 times before, last time 2025-10-15T10:54:28.000000Z
2025-10-15T10:54:28.520836Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 29. All 1 blobs are from cache.
2025-10-15T10:54:28.520889Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:54:28.521767Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 291 partno 0 count 9 parts 0 suffix '63'
2025-10-15T10:54:28.521988Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 291 totakecount 9 count 9 size 292987 from pos 0 cbcount 9
2025-10-15T10:54:28.522344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 291
2025-10-15T10:54:28.532035Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 291 Data: "... 32095 bytes ..." SourceId: "\000src_id" SeqNo: 292 WriteTimestampMS: 1760525668421 CreateTimestampMS: 1760525666034 UncompressedSize: 32021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 292 Data: "... 32205 bytes ..." SourceId: "\000src_id" SeqNo: 293 WriteTimestampMS: 1760525668423 CreateTimestampMS: 1760525666034 UncompressedSize: 32131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 293 Data: "... 32315 bytes ..." SourceId: "\000src_id" SeqNo: 294 WriteTimestampMS: 1760525668423 CreateTimestampMS: 1760525666034 UncompressedSize: 32241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 294 Data: "... 32425 bytes ..." SourceId: "\000src_id" SeqNo: 295 WriteTimestampMS: 1760525668423 CreateTimestampMS: 1760525666034 UncompressedSize: 32351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 295 Data: "... 32535 bytes ..." SourceId: "\000src_id" SeqNo: 296 WriteTimestampMS: 1760525668423 CreateTimestampMS: 1760525666035 UncompressedSize: 32461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 296 Data: "... 32645 bytes ..." SourceId: "\000src_id" SeqNo: 297 WriteTimestampMS: 1760525668423 CreateTimestampMS: 1760525666035 UncompressedSize: 32571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 297 Data: "... 32755 bytes ..." SourceId: "\000src_id" SeqNo: 298 WriteTimestampMS: 1760525668423 CreateTimestampMS: 1760525666035 UncompressedSize: 32681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 298 Data: "... 32865 bytes ..." SourceId: "\000src_id" SeqNo: 299 WriteTimestampMS: 1760525668423 CreateTimestampMS: 1760525666035 UncompressedSize: 32791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 299 Data: "... 32975 bytes ..." SourceId: "\000src_id" SeqNo: 300 WriteTimestampMS: 1760525668423 CreateTimestampMS: 1760525666035 UncompressedSize: 32901 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551433 RealReadOffset: 299 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 291 }
2025-10-15T10:54:28.532541Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 20 from offset 300
2025-10-15T10:54:28.532581Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 300 ReadGuid e52138a9-e83025ba-dfd321c0-8b81e874 has messages 1
2025-10-15T10:54:28.532763Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 read done: guid# e52138a9-e83025ba-dfd321c0-8b81e874, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 292752
2025-10-15T10:54:28.532795Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 response to read: guid# e52138a9-e83025ba-dfd321c0-8b81e874
2025-10-15T10:54:28.533482Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 Process answer. Aval parts: 0
2025-10-15T10:54:28.534835Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Got ReadResponse, serverBytesSize = 292752, now ReadSizeBudget = 0, ReadSizeServerDelta = 231536
2025-10-15T10:54:28.534962Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 231536
2025-10-15T10:54:28.537337Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (291-299)
2025-10-15T10:54:28.537401Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 292752 to budget
2025-10-15T10:54:28.537433Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] In ContinueReadingDataImpl, ReadSizeBudget = 292752, ReadSizeServerDelta = 231536
2025-10-15T10:54:28.537699Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T10:54:28.537855Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (291-291)
2025-10-15T10:54:28.537975Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (292-292)
2025-10-15T10:54:28.538158Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (293-293)
2025-10-15T10:54:28.538233Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (294-294)
2025-10-15T10:54:28.538418Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (295-295)
2025-10-15T10:54:28.538461Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (296-296)
2025-10-15T10:54:28.538499Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (297-297)
2025-10-15T10:54:28.538536Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (298-298)
2025-10-15T10:54:28.538847Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (299-299)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..32021 bytes.. Information: { Offset: 291 ProducerId: "src_id" SeqNo: 292 CreateTime: 2025-10-15T10:54:26.034000Z WriteTime: 2025-10-15T10:54:28.421000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32131 bytes.. Information: { Offset: 292 ProducerId: "src_id" SeqNo: 293 CreateTime: 2025-10-15T10:54:26.034000Z WriteTime: 2025-10-15T10:54:28.423000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32241 bytes.. Information: { Offset: 293 ProducerId: "src_id" SeqNo: 294 CreateTime: 2025-10-15T10:54:26.034000Z WriteTime: 2025-10-15T10:54:28.423000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32351 bytes.. Information: { Offset: 294 ProducerId: "src_id" SeqNo: 295 CreateTime: 2025-10-15T10:54:26.034000Z WriteTime: 2025-10-15T10:54:28.423000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32461 bytes.. Information: { Offset: 295 ProducerId: "src_id" SeqNo: 296 CreateTime: 2025-10-15T10:54:26.035000Z WriteTime: 2025-10-15T10:54:28.423000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32571 bytes.. Information: { Offset: 296 ProducerId: "src_id" SeqNo: 297 CreateTime: 2025-10-15T10:54:26.035000Z WriteTime: 2025-10-15T10:54:28.423000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32681 bytes.. Information: { Offset: 297 ProducerId: "src_id" SeqNo: 298 CreateTime: 2025-10-15T10:54:26.035000Z WriteTime: 2025-10-15T10:54:28.423000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32791 bytes.. Information: { Offset: 298 ProducerId: "src_id" SeqNo: 299 CreateTime: 2025-10-15T10:54:26.035000Z WriteTime: 2025-10-15T10:54:28.423000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } Message { Data: ..32901 bytes.. Information: { Offset: 299 ProducerId: "src_id" SeqNo: 300 CreateTime: 2025-10-15T10:54:26.035000Z WriteTime: 2025-10-15T10:54:28.423000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:42440", "_ip": "ipv6:[::1]:42440" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T10:54:28.541219Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] The application data is transferred to the client. Number of messages 9, size 292149 bytes
2025-10-15T10:54:28.541258Z :DEBUG: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] [] Returning serverBytesSize = 0 to budget
2025-10-15T10:54:28.541554Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 1, data# { read_request { bytes_size: 292752 } }
2025-10-15T10:54:28.541699Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 got read request: guid# afdd512f-c9a79d3b-9487c4f4-6201954c
2025-10-15T10:54:28.542053Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Closing read session. Close timeout: 18446744073709.551615s
2025-10-15T10:54:28.542129Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-15T10:54:28.542200Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3126 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:28.542817Z :INFO: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Closing read session. Close timeout: 18446744073709.551615s
2025-10-15T10:54:28.542865Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:54:28.542900Z :INFO: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3091 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:28.543192Z :INFO: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Closing read session. Close timeout: 18446744073709.551615s
2025-10-15T10:54:28.543224Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:54:28.543250Z :INFO: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3068 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:28.543564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: close. Timeout = 0 ms
2025-10-15T10:54:28.543604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session will now close
2025-10-15T10:54:28.543644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: aborting
2025-10-15T10:54:28.543967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:54:28.544005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0] Write session: destroy
2025-10-15T10:54:28.545642Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Closing read session. Close timeout: 0.000000s
2025-10-15T10:54:28.545698Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-15T10:54:28.545757Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3129 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:28.545796Z :INFO: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Closing read session. Close timeout: 0.000000s
2025-10-15T10:54:28.545821Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:54:28.545845Z :INFO: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3094 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:28.545868Z :INFO: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Closing read session. Close timeout: 0.000000s
2025-10-15T10:54:28.545892Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:54:28.545915Z :INFO: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3071 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:28.545944Z :INFO: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Closing read session. Close timeout: 0.000000s
2025-10-15T10:54:28.545975Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:54:28.546052Z :INFO: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3071 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:28.546154Z :NOTICE: [/Root] [/Root] [e4039c78-66edd09c-ea01bc6f-280ea9fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:54:28.546283Z :INFO: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Closing read session. Close timeout: 0.000000s
2025-10-15T10:54:28.546307Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-15T10:54:28.546330Z :INFO: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3094 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:28.546374Z :NOTICE: [/Root] [/Root] [fa48df86-fcea3e3b-3e134112-fbadcd85] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:54:28.546431Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Closing read session. Close timeout: 0.000000s
2025-10-15T10:54:28.546456Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-15T10:54:28.546486Z :INFO: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3130 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:28.546530Z :NOTICE: [/Root] [/Root] [a3829b34-ed15c9bd-4043db0d-fe85c735] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T10:54:28.552317Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read done: success# 0, data# {  }
2025-10-15T10:54:28.552348Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc read failed
2025-10-15T10:54:28.552376Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 grpc closed
2025-10-15T10:54:28.552416Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_2543886588194940179_v1 is DEAD
2025-10-15T10:54:28.553177Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 grpc read done: success# 0, data# {  }
2025-10-15T10:54:28.553188Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 grpc read failed
2025-10-15T10:54:28.553206Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 grpc closed
2025-10-15T10:54:28.553220Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_5033013796418176116_v1 is DEAD
2025-10-15T10:54:28.553506Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 grpc read done: success# 0, data# {  }
2025-10-15T10:54:28.553514Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 grpc read failed
2025-10-15T10:54:28.553526Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 grpc closed
2025-10-15T10:54:28.553539Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_16701149177465999335_v1 is DEAD
2025-10-15T10:54:28.553754Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read done: success: 0 data: 
2025-10-15T10:54:28.553762Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc read failed
2025-10-15T10:54:28.553781Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 grpc closed
2025-10-15T10:54:28.553794Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|d4ce9d1f-7576412f-c5947a78-f7c0e1f8_0 is DEAD
2025-10-15T10:54:28.554188Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:54:28.554387Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576874:2500] disconnected; active server actors: 1
2025-10-15T10:54:28.554412Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576874:2500] client user disconnected session shared/user_3_1_2543886588194940179_v1
2025-10-15T10:54:28.554467Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T10:54:28.554505Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576876:2502] disconnected; active server actors: 1
2025-10-15T10:54:28.554517Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576876:2502] client user disconnected session shared/user_3_2_5033013796418176116_v1
2025-10-15T10:54:28.554540Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576879:2504] disconnected; active server actors: 1
2025-10-15T10:54:28.554552Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400158502576879:2504] client user disconnected session shared/user_3_3_16701149177465999335_v1
2025-10-15T10:54:28.554836Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561400158502576918:2512] destroyed
2025-10-15T10:54:28.554881Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_1_2543886588194940179_v1
2025-10-15T10:54:28.554911Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561400158502576883:2511] destroyed
2025-10-15T10:54:28.554940Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:54:28.554973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.554987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.554997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.555076Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_1_2543886588194940179_v1
2025-10-15T10:54:28.563814Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:28.595299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.595338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.595370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.696353Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.696382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.696393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.351017Z node 3 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [3:7561400175682446320:2538] TxId: 281474976710695. Ctx: { TraceId: 01k7kr3m8x8aktjrbyvhtw5fz0, Database: /Root, SessionId: ydb://session/3?node_id=3&id=NDNmYzA4NjctYzY4NmZiNjYtYjFkNzA5YmUtYjFiMzdjZTY=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 4
2025-10-15T10:54:29.351755Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [3:7561400175682446329:2545], TxId: 281474976710695, task: 2. Ctx: { TraceId : 01k7kr3m8x8aktjrbyvhtw5fz0.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=3&id=NDNmYzA4NjctYzY4NmZiNjYtYjFkNzA5YmUtYjFiMzdjZTY=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [3:7561400175682446320:2538], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-15T10:54:29.351804Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [3:7561400175682446331:2546], TxId: 281474976710695, task: 4. Ctx: { TraceId : 01k7kr3m8x8aktjrbyvhtw5fz0.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=3&id=NDNmYzA4NjctYzY4NmZiNjYtYjFkNzA5YmUtYjFiMzdjZTY=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [3:7561400175682446320:2538], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-15T10:53:30.848836Z :WriteSessionCloseWaitsForWrites INFO: Random seed for debugging is 1760525610848759
2025-10-15T10:53:31.697965Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561399926797624190:2086];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:31.698036Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:31.855738Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:31.990307Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/001073/r3tmp/tmpYD5bIc/pdisk_1.dat
2025-10-15T10:53:32.351502Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:32.355521Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:32.355603Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:32.668663Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:32.675700Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:32.719807Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:32.723683Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:32.840897Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:32.940410Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:32.951805Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:32.951910Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:32.972931Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:32.973032Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:32.979506Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T10:53:32.979953Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:32.981123Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 19858, node 1
2025-10-15T10:53:33.271833Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:33.278742Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:33.328084Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/001073/r3tmp/yandexSXrP8m.tmp
2025-10-15T10:53:33.328113Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/001073/r3tmp/yandexSXrP8m.tmp
2025-10-15T10:53:33.334890Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/001073/r3tmp/yandexSXrP8m.tmp
2025-10-15T10:53:33.335082Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:33.401206Z INFO: TTestServer started on Port 5720 GrpcPort 19858
TClient is connected to server localhost:5720
PQClient connected to localhost:19858
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:34.246654Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:36.699577Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561399926797624190:2086];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:36.699675Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:39.661715Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:39.721799Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7561399961157363567:2326], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:39.723722Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=NTRjYjQ2Y2UtNDFkMjNhODctZmUyNTNkODEtNmNjYmI3OWI=, ActorId: [1:7561399961157363565:2325], ActorState: ExecuteState, TraceId: 01k7kr23z9dy200daag8qbxg96, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:39.725821Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:39.737202Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7561399960656202670:2295], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:39.739195Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=NDQ4Mzk0ODYtNTdjNWJkY2UtYWI0M2JiNTctZTFkZTU5OGY=, ActorId: [2:7561399960656202668:2294], ActorState: ExecuteState, TraceId: 01k7kr24346c591x26gefxg2jd, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:39.740027Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:39.850439Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:40.078067Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:19858", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:41.063966Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k7kr253v56fxxs3jm54xff2q, Database: , SessionId: ydb://session/3?node_id=1&id=YTNhMzE2ZGMtOTZiMjg1MzAtNGMxMzkyMzMtMjU2Y2I5Nzg=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561399969747298573:2937] 
=== CheckClustersList. Ok
2025-10-15T10:53:46.679493Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:19858
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:46.948612Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:19858
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:47.026928Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561399991222135521:3215] connected; active server actors: 1
2025-10-15T10:53:47.027152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:47.029619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:47.029804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:47.062570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:47.070653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:47.070980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:47.071053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:47.071094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:47.072456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T10:53:47.072676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399991222135520:3214], now have 1 active actors on pipe
2025-10-15T10:53:47.072701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399995517102857:2448], now have 1 active actors on pipe
2025-10-15T10:53:47.073470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:47.083752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:47.090240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399995517102891:3269], now have 1 active actors on pipe
2025-10-15T10:53:47.097379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:47.108178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:47.109387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:47.109484Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:47.109779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:47.110099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561399995015941545:2372]
2025-10-15T10:53:47.115294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:47.115325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:47.115421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561399995015941545:2372]
2025-10-15T10:53:47.115477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:47.116858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:47.116917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.117043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.117055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:47.117071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:47.117082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.117093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.117101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:47.117176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:47.118430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:47.123718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:47.134722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:47.134905Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525627133, TxId 281474976710676
2025-10-15T10:53:47.134931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.134940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.135073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.135304Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:47.138916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:47.139224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:47.139261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.139270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.139279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.139307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:47.139657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:47.139747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:47.140011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:47.151231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:47.151341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:47.162018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:47.218964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.219031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.219060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.235218Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k7kr2bmv5wsw69svqd7rjj36, Database: , SessionId: ydb://session/3?node_id=1&id=NTc3ZDVjZGMtZDk1OTgwNWQtZWM3YzQ3NzAtN2MxZmYzMTU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525627133
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525627133
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:19858
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:47.295696Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:47.322248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.322283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.322293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.426745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.426773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.426782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.518628Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:47.518659Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:47.526067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.526098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.526108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.627177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.627212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.627222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.727424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.727452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.727462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:19858
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:47.809804Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:47.834448Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:47.835920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.835947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.835968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.847740Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:47.847796Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:19858
2025-10-15T10:53:47.897033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:47.897076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:47.913836Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:47.916299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:47.916504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:38496
2025-10-15T10:53:47.916531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38496 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:47.916542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:47.922137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:47.940995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.941022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.941031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.922310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:47.922324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:47.922334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:47.922351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399995517103042:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:47.931621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399995517103042:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:48.041290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.041323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.041333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.130653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399995517103042:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:48.135737Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399999812070380:2481] connected; active server actors: 1
2025-10-15T10:53:48.136063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399995517103042:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:48.136104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399995517103042:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:48.146013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.146037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.146046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.162382Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399999812070380:2481] disconnected; active server actors: 1
2025-10-15T10:53:48.162421Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399999812070380:2481] disconnected no session
2025-10-15T10:53:48.245518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.245548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.245558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.318322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399995517103042:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:48.318359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399995517103042:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:48.318376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399995517103042:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:48.318404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:48.320660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:48.321023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399999812070420:2481], now have 1 active actors on pipe
2025-10-15T10:53:48.327624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.327668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.327759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|ad991d82-f1b9a13-c6a7a711-69810b2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:48.327799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.327826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.327836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:48.327874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.327913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:48.327988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:48.331879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.331909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.332003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:48.336117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|ad991d82-f1b9a13-c6a7a711-69810b2e_0
2025-10-15T10:53:48.340446Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525628340 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:48.340575Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|ad991d82-f1b9a13-c6a7a711-69810b2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:48.340925Z :INFO: [] MessageGroupId [src] SessionId [src|ad991d82-f1b9a13-c6a7a711-69810b2e_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:48.340958Z :INFO: [] MessageGroupId [src] SessionId [src|ad991d82-f1b9a13-c6a7a711-69810b2e_0] Write session will now close
2025-10-15T10:53:48.341002Z :DEBUG: [] MessageGroupId [src] SessionId [src|ad991d82-f1b9a13-c6a7a711-69810b2e_0] Write session: aborting
2025-10-15T10:53:48.341402Z :INFO: [] MessageGroupId [src] SessionId [src|ad991d82-f1b9a13-c6a7a711-69810b2e_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:48.341438Z :DEBUG: [] MessageGroupId [src] SessionId [src|ad991d82-f1b9a13-c6a7a711-69810b2e_0] Write session: destroy
2025-10-15T10:53:48.347632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.347657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.347668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.363449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|ad991d82-f1b9a13-c6a7a711-69810b2e_0 grpc read done: success: 0 data: 
2025-10-15T10:53:48.363489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|ad991d82-f1b9a13-c6a7a711-69810b2e_0 grpc read failed
2025-10-15T10:53:48.363519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|ad991d82-f1b9a13-c6a7a711-69810b2e_0 grpc closed
2025-10-15T10:53:48.363537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|ad991d82-f1b9a13-c6a7a711-69810b2e_0 is DEAD
2025-10-15T10:53:48.380248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399999812070420:2481] destroyed
2025-10-15T10:53:48.380293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:48.380326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.380340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.380353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.377378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
Session was created
2025-10-15T10:53:48.451460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.451488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.451499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:53:48.478232Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:19858" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:19858" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:19858" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-15T10:53:48.520478Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:48.521005Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-15T10:53:48.556576Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-15T10:53:48.551771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.551797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.551806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.564245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:48.564275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-15T10:53:48.578252Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:53:48.578675Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-15T10:53:48.579338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:53:48.579532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:38508
2025-10-15T10:53:48.579547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:38508 proto=topic  topic=test-topic durationSec=0
2025-10-15T10:53:48.579558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:48.581429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-15T10:53:48.581537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:48.581546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:48.581553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:48.581569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399999812070443:2498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:48.600113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399999812070443:2498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:48.617456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399999812070443:2498] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:48.618238Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399999812070462:2498] connected; active server actors: 1
2025-10-15T10:53:48.618384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399999812070443:2498] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-15T10:53:48.618403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399999812070443:2498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:48.619212Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399999812070462:2498] disconnected; active server actors: 1
2025-10-15T10:53:48.619232Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399999812070462:2498] disconnected no session
2025-10-15T10:53:48.630365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399999812070443:2498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:48.630405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399999812070443:2498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:48.630421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399999812070443:2498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:48.630449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:48.635757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399999812070473:2498], now have 1 active actors on pipe
2025-10-15T10:53:48.639308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:48.643676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.643717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.643793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:53:48.643824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.643838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.643848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:48.643884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.643924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:48.643967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:48.644858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.644888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.644946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:48.645419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0
2025-10-15T10:53:48.648264Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:48.648334Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525628648 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:48.648478Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-15T10:53:48.648742Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-15T10:53:48.648850Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
2025-10-15T10:53:48.648891Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
2025-10-15T10:53:48.648934Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 4 to 4
2025-10-15T10:53:48.648978Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 5 to 5
2025-10-15T10:53:48.649011Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 6 to 6
2025-10-15T10:53:48.649056Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 7 to 7
2025-10-15T10:53:48.649096Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 8 to 8
2025-10-15T10:53:48.649137Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 9 to 9
2025-10-15T10:53:48.649181Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 10 to 10
2025-10-15T10:53:48.649210Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 11 to 11
2025-10-15T10:53:48.649244Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 12 to 12
2025-10-15T10:53:48.649278Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 13 to 13
2025-10-15T10:53:48.649321Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 14 to 14
2025-10-15T10:53:48.649352Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 15 to 15
2025-10-15T10:53:48.649389Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 16 to 16
2025-10-15T10:53:48.649425Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 17 to 17
2025-10-15T10:53:48.649461Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 18 to 18
2025-10-15T10:53:48.649489Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 19 to 19
2025-10-15T10:53:48.649523Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 20 to 20
2025-10-15T10:53:48.649591Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 21 to 21
2025-10-15T10:53:48.649631Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 22 to 22
2025-10-15T10:53:48.649668Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 23 to 23
2025-10-15T10:53:48.649700Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 24 to 24
2025-10-15T10:53:48.649738Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 25 to 25
2025-10-15T10:53:48.649766Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 26 to 26
2025-10-15T10:53:48.649808Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 27 to 27
2025-10-15T10:53:48.649845Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 28 to 28
2025-10-15T10:53:48.649875Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 29 to 29
2025-10-15T10:53:48.649942Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 30 to 30
2025-10-15T10:53:48.649977Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 31 to 31
2025-10-15T10:53:48.650012Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 32 to 32
2025-10-15T10:53:48.650066Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 33 to 33
2025-10-15T10:53:48.650100Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 34 to 34
2025-10-15T10:53:48.650134Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 35 to 35
2025-10-15T10:53:48.650176Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 36 to 36
2025-10-15T10:53:48.650213Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 37 to 37
2025-10-15T10:53:48.650245Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 38 to 38
2025-10-15T10:53:48.650286Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 39 to 39
2025-10-15T10:53:48.650321Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 40 to 40
2025-10-15T10:53:48.650355Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 41 to 41
2025-10-15T10:53:48.650389Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 42 to 42
2025-10-15T10:53:48.650419Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 43 to 43
2025-10-15T10:53:48.650451Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 44 to 44
2025-10-15T10:53:48.650479Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 45 to 45
2025-10-15T10:53:48.650520Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 46 to 46
2025-10-15T10:53:48.650547Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 47 to 47
2025-10-15T10:53:48.650580Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 48 to 48
2025-10-15T10:53:48.650621Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 49 to 49
2025-10-15T10:53:48.650656Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 50 to 50
2025-10-15T10:53:48.650682Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 51 to 51
2025-10-15T10:53:48.650727Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 52 to 52
2025-10-15T10:53:48.650761Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 53 to 53
2025-10-15T10:53:48.650800Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 54 to 54
2025-10-15T10:53:48.650831Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 55 to 55
2025-10-15T10:53:48.650860Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 56 to 56
2025-10-15T10:53:48.650897Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 57 to 57
2025-10-15T10:53:48.650929Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 58 to 58
2025-10-15T10:53:48.650958Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 59 to 59
2025-10-15T10:53:48.650995Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 60 to 60
2025-10-15T10:53:48.651065Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 61 to 61
2025-10-15T10:53:48.651103Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 62 to 62
2025-10-15T10:53:48.651137Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 63 to 63
2025-10-15T10:53:48.651182Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 64 to 64
2025-10-15T10:53:48.651240Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 65 to 65
2025-10-15T10:53:48.651281Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 66 to 66
2025-10-15T10:53:48.651310Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 67 to 67
2025-10-15T10:53:48.651363Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 68 to 68
2025-10-15T10:53:48.651432Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 69 to 69
2025-10-15T10:53:48.651502Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 70 to 70
2025-10-15T10:53:48.651537Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 71 to 71
2025-10-15T10:53:48.651576Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 72 to 72
2025-10-15T10:53:48.651614Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 73 to 73
2025-10-15T10:53:48.651646Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 74 to 74
2025-10-15T10:53:48.651676Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 75 to 75
2025-10-15T10:53:48.651717Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 76 to 76
2025-10-15T10:53:48.651794Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 77 to 77
2025-10-15T10:53:48.651847Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 78 to 78
2025-10-15T10:53:48.651879Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 79 to 79
2025-10-15T10:53:48.651913Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 80 to 80
2025-10-15T10:53:48.651948Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 81 to 81
2025-10-15T10:53:48.651980Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 82 to 82
2025-10-15T10:53:48.652032Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 83 to 83
2025-10-15T10:53:48.652095Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 84 to 84
2025-10-15T10:53:48.652135Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 85 to 85
2025-10-15T10:53:48.652169Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 86 to 86
2025-10-15T10:53:48.652210Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 87 to 87
2025-10-15T10:53:48.652291Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 88 to 88
2025-10-15T10:53:48.652364Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 89 to 89
2025-10-15T10:53:48.652399Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 90 to 90
2025-10-15T10:53:48.652432Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 91 to 91
2025-10-15T10:53:48.652462Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 92 to 92
2025-10-15T10:53:48.652496Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 93 to 93
2025-10-15T10:53:48.652529Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 94 to 94
2025-10-15T10:53:48.652575Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 95 to 95
2025-10-15T10:53:48.652611Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 96 to 96
2025-10-15T10:53:48.652679Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 97 to 97
2025-10-15T10:53:48.652713Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 98 to 98
2025-10-15T10:53:48.652743Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 99 to 99
2025-10-15T10:53:48.652778Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 100 to 100
2025-10-15T10:53:48.655725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.655750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.655760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.706701Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:48.706759Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Send 17 message(s) (83 left), first sequence number is 1
2025-10-15T10:53:48.711461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:53:48.711942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:53:48.713014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:48.712652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.712689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.712775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:53:48.713717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.713739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.714093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:48.714262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-15T10:53:48.714277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-15T10:53:48.714291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-15T10:53:48.714306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-15T10:53:48.714322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-15T10:53:48.714337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-15T10:53:48.714358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-15T10:53:48.714424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:53:48.714533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.714595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.714611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (17)
2025-10-15T10:53:48.714744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T10:53:48.715616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-15T10:53:48.715664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T10:53:48.715692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 312 count 2 nextOffset 2 batches 1
2025-10-15T10:53:48.715714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-15T10:53:48.715733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 452 count 3 nextOffset 3 batches 1
2025-10-15T10:53:48.715752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-15T10:53:48.715768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 592 count 4 nextOffset 4 batches 1
2025-10-15T10:53:48.715789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-15T10:53:48.715809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 732 count 5 nextOffset 5 batches 1
2025-10-15T10:53:48.715826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-15T10:53:48.715842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 872 count 6 nextOffset 6 batches 1
2025-10-15T10:53:48.715861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-15T10:53:48.715878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1012 count 7 nextOffset 7 batches 1
2025-10-15T10:53:48.715893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-15T10:53:48.715910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1152 count 8 nextOffset 8 batches 1
2025-10-15T10:53:48.715930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-15T10:53:48.715950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1292 count 9 nextOffset 9 batches 1
2025-10-15T10:53:48.715967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-15T10:53:48.715984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1432 count 10 nextOffset 10 batches 1
2025-10-15T10:53:48.716003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-15T10:53:48.716021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1573 count 11 nextOffset 11 batches 1
2025-10-15T10:53:48.716036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-15T10:53:48.716052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1714 count 12 nextOffset 12 batches 1
2025-10-15T10:53:48.716069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-15T10:53:48.716086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1855 count 13 nextOffset 13 batches 1
2025-10-15T10:53:48.716103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-15T10:53:48.716120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1996 count 14 nextOffset 14 batches 1
2025-10-15T10:53:48.716136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-15T10:53:48.716153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2137 count 15 nextOffset 15 batches 1
2025-10-15T10:53:48.716172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-15T10:53:48.716189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2278 count 16 nextOffset 16 batches 1
2025-10-15T10:53:48.716208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-15T10:53:48.716230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2419 count 17 nextOffset 17 batches 1
2025-10-15T10:53:48.716246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.716896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,17 HeadOffset 0 endOffset 0 curOffset 17 d0000000000_00000000000000000000_00000_0000000017_00000? size 1918 WTime 1760525628715
2025-10-15T10:53:48.717062Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:48.717188Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 17 size 1918
2025-10-15T10:53:48.740440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 17 size 1918 actorID [2:7561399995015941528:2372]
2025-10-15T10:53:48.740499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:48.740549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1792 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:48.740582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-15T10:53:48.740645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-15T10:53:48.740672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-15T10:53:48.740700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-15T10:53:48.740727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-15T10:53:48.740753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-15T10:53:48.740781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-15T10:53:48.740810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-15T10:53:48.740836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-15T10:53:48.740861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-15T10:53:48.740886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-15T10:53:48.740914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-15T10:53:48.740940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-15T10:53:48.740966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.740984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-15T10:53:48.740996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.741012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-15T10:53:48.741022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.741038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-15T10:53:48.741048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.741064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-15T10:53:48.741298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:48.741321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:53:48.741340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.741350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.741358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.741387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:48.741545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-15T10:53:48.741644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 17 max time lag 0ms effective offset 0
2025-10-15T10:53:48.741858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1918 count 17 last offset 0, current partition end offset: 17
2025-10-15T10:53:48.741875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:53:48.741926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 17 parts_count 0 source 1 size 1918 accessed 0 times before, last time 2025-10-15T10:53:48.000000Z
2025-10-15T10:53:48.741961Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-15T10:53:48.742018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:53:48.742523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 17 count 17 size 1898 from pos 0 cbcount 17
2025-10-15T10:53:48.742625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525628714 queuesize 0 startOffset 0
2025-10-15T10:53:48.742806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 17 parts 0 suffix '63' size 1918
2025-10-15T10:53:48.742865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 17 parts 0 suffix '63'
2025-10-15T10:53:48.743477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:48.744522Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:48.745223Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } acks { seq_no: 2 written { offset: 1 } } acks { seq_no: 3 written { offset: 2 } } acks { seq_no: 4 written { offset: 3 } } acks { seq_no: 5 written { offset: 4 } } acks { seq_no: 6 written { offset: 5 } } acks { seq_no: 7 written { offset: 6 } } acks { seq_no: 8 written { offset: 7 } } acks { seq_no: 9 written { offset: 8 } } acks { seq_no: 10 written { offset: 9 } } acks { seq_no: 11 written { offset: 10 } } acks { seq_no: 12 written { offset: 11 } } acks { seq_no: 13 written { offset: 12 } } acks { seq_no: 14 written { offset: 13 } } acks { seq_no: 15 written { offset: 14 } } acks { seq_no: 16 written { offset: 15 } } acks { seq_no: 17 written { offset: 16 } } write_statistics { persisting_time { nanos: 24000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 5000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-15T10:53:48.745265Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-15T10:53:48.745308Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-15T10:53:48.745344Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-15T10:53:48.745364Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 2
2025-10-15T10:53:48.745384Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=3, txId=?
2025-10-15T10:53:48.745406Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 3
2025-10-15T10:53:48.745428Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=4, txId=?
2025-10-15T10:53:48.745444Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 4
2025-10-15T10:53:48.745464Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=5, txId=?
2025-10-15T10:53:48.745481Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 5
2025-10-15T10:53:48.745505Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=6, txId=?
2025-10-15T10:53:48.745525Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 6
2025-10-15T10:53:48.745540Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=7, txId=?
2025-10-15T10:53:48.745554Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 7
2025-10-15T10:53:48.745575Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=8, txId=?
2025-10-15T10:53:48.745591Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 8
2025-10-15T10:53:48.745617Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=9, txId=?
2025-10-15T10:53:48.745641Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 9
2025-10-15T10:53:48.745666Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=10, txId=?
2025-10-15T10:53:48.745697Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 10
2025-10-15T10:53:48.745720Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=11, txId=?
2025-10-15T10:53:48.745753Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 11
2025-10-15T10:53:48.745773Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=12, txId=?
2025-10-15T10:53:48.745793Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 12
2025-10-15T10:53:48.745815Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=13, txId=?
2025-10-15T10:53:48.745829Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 13
2025-10-15T10:53:48.745853Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=14, txId=?
2025-10-15T10:53:48.745870Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 14
2025-10-15T10:53:48.745894Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=15, txId=?
2025-10-15T10:53:48.745909Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 15
2025-10-15T10:53:48.745934Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=16, txId=?
2025-10-15T10:53:48.745952Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 16
2025-10-15T10:53:48.745970Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=17, txId=?
2025-10-15T10:53:48.745994Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 17
2025-10-15T10:53:48.753954Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:48.754004Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Send 70 message(s) (13 left), first sequence number is 18
2025-10-15T10:53:48.754794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:53:48.755828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:53:48.759778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.759802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.759811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.759884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.759907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.759977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-15T10:53:48.763466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:48.768176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.768235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.768289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.768997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-15T10:53:48.769460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:53:48.769731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.769874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.769883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (70)
2025-10-15T10:53:48.769980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-15T10:53:48.770825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 173 count 1 nextOffset 18 batches 1
2025-10-15T10:53:48.770880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-15T10:53:48.770909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 314 count 2 nextOffset 19 batches 1
2025-10-15T10:53:48.770929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-15T10:53:48.770951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 455 count 3 nextOffset 20 batches 1
2025-10-15T10:53:48.771007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-15T10:53:48.771029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 596 count 4 nextOffset 21 batches 1
2025-10-15T10:53:48.771048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-15T10:53:48.771070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 737 count 5 nextOffset 22 batches 1
2025-10-15T10:53:48.771088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-15T10:53:48.771106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 878 count 6 nextOffset 23 batches 1
2025-10-15T10:53:48.771122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-15T10:53:48.771139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1019 count 7 nextOffset 24 batches 1
2025-10-15T10:53:48.771156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-15T10:53:48.771175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1160 count 8 nextOffset 25 batches 1
2025-10-15T10:53:48.771194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-15T10:53:48.771215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1301 count 9 nextOffset 26 batches 1
2025-10-15T10:53:48.771232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-15T10:53:48.771248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1442 count 10 nextOffset 27 batches 1
2025-10-15T10:53:48.771273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-15T10:53:48.771297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1583 count 11 nextOffset 28 batches 1
2025-10-15T10:53:48.771318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-15T10:53:48.771336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1724 count 12 nextOffset 29 batches 1
2025-10-15T10:53:48.773939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-15T10:53:48.773986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1865 count 13 nextOffset 30 batches 1
2025-10-15T10:53:48.774022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-15T10:53:48.774044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2006 count 14 nextOffset 31 batches 1
2025-10-15T10:53:48.774061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-15T10:53:48.774080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2147 count 15 nextOffset 32 batches 1
2025-10-15T10:53:48.774101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-15T10:53:48.774121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2288 count 16 nextOffset 33 batches 1
2025-10-15T10:53:48.774138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-15T10:53:48.774171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2429 count 17 nextOffset 34 batches 1
2025-10-15T10:53:48.774189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-15T10:53:48.774210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2570 count 18 nextOffset 35 batches 1
2025-10-15T10:53:48.774230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-15T10:53:48.774249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2711 count 19 nextOffset 36 batches 1
2025-10-15T10:53:48.774314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-15T10:53:48.774338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2852 count 20 nextOffset 37 batches 1
2025-10-15T10:53:48.774356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-15T10:53:48.774373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2993 count 21 nextOffset 38 batches 1
2025-10-15T10:53:48.774390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-15T10:53:48.774408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 3134 count 22 nextOffset 39 batches 1
2025-10-15T10:53:48.774425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-15T10:53:48.774443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 3275 count 23 nextOffset 40 batches 1
2025-10-15T10:53:48.774461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-15T10:53:48.774479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 3416 count 24 nextOffset 41 batches 1
2025-10-15T10:53:48.774494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-15T10:53:48.774513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 3557 count 25 nextOffset 42 batches 1
2025-10-15T10:53:48.774531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-15T10:53:48.774546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 3698 count 26 nextOffset 43 batches 1
2025-10-15T10:53:48.774561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-15T10:53:48.774578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 3839 count 27 nextOffset 44 batches 1
2025-10-15T10:53:48.774595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-15T10:53:48.774613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 3980 count 28 nextOffset 45 batches 1
2025-10-15T10:53:48.774629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-15T10:53:48.774646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4121 count 29 nextOffset 46 batches 1
2025-10-15T10:53:48.774663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-15T10:53:48.774678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4262 count 30 nextOffset 47 batches 1
2025-10-15T10:53:48.774695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-15T10:53:48.774713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4403 count 31 nextOffset 48 batches 1
2025-10-15T10:53:48.774735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-15T10:53:48.774754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4544 count 32 nextOffset 49 batches 1
2025-10-15T10:53:48.774771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-15T10:53:48.774795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4685 count 33 nextOffset 50 batches 1
2025-10-15T10:53:48.774813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-15T10:53:48.774831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4826 count 34 nextOffset 51 batches 1
2025-10-15T10:53:48.774848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-15T10:53:48.774865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4967 count 35 nextOffset 52 batches 1
2025-10-15T10:53:48.774916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-15T10:53:48.774938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 5108 count 36 nextOffset 53 batches 1
2025-10-15T10:53:48.774955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-15T10:53:48.774971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 5249 count 37 nextOffset 54 batches 1
2025-10-15T10:53:48.774989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-15T10:53:48.775008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 5390 count 38 nextOffset 55 batches 1
2025-10-15T10:53:48.775023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-15T10:53:48.775039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 5531 count 39 nextOffset 56 batches 1
2025-10-15T10:53:48.775057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-15T10:53:48.775073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 5672 count 40 nextOffset 57 batches 1
2025-10-15T10:53:48.775091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-15T10:53:48.775107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 5813 count 41 nextOffset 58 batches 1
2025-10-15T10:53:48.775123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-15T10:53:48.775138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 5954 count 42 nextOffset 59 batches 1
2025-10-15T10:53:48.775153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-15T10:53:48.775169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6095 count 43 nextOffset 60 batches 1
2025-10-15T10:53:48.775185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-15T10:53:48.775202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6236 count 44 nextOffset 61 batches 1
2025-10-15T10:53:48.775217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-10-15T10:53:48.775235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6377 count 45 nextOffset 62 batches 1
2025-10-15T10:53:48.775251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-15T10:53:48.775268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6518 count 46 nextOffset 63 batches 1
2025-10-15T10:53:48.775285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-15T10:53:48.775302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6659 count 47 nextOffset 64 batches 1
2025-10-15T10:53:48.775321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-15T10:53:48.775338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6800 count 48 nextOffset 65 batches 1
2025-10-15T10:53:48.775372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-15T10:53:48.775393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6941 count 49 nextOffset 66 batches 1
2025-10-15T10:53:48.775413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-15T10:53:48.775430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 7082 count 50 nextOffset 67 batches 1
2025-10-15T10:53:48.775446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-15T10:53:48.775463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 7223 count 51 nextOffset 68 batches 1
2025-10-15T10:53:48.775502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-15T10:53:48.775525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 7364 count 52 nextOffset 69 batches 1
2025-10-15T10:53:48.775541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-15T10:53:48.775560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 7505 count 53 nextOffset 70 batches 1
2025-10-15T10:53:48.775580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-15T10:53:48.775598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 7646 count 54 nextOffset 71 batches 1
2025-10-15T10:53:48.775615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-15T10:53:48.775635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 7787 count 55 nextOffset 72 batches 1
2025-10-15T10:53:48.775652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-10-15T10:53:48.775671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 7928 count 56 nextOffset 73 batches 1
2025-10-15T10:53:48.775689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-15T10:53:48.775706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 8069 count 57 nextOffset 74 batches 1
2025-10-15T10:53:48.775725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-15T10:53:48.775744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 8210 count 58 nextOffset 75 batches 1
2025-10-15T10:53:48.775760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-15T10:53:48.775778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 8351 count 59 nextOffset 76 batches 1
2025-10-15T10:53:48.775797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-15T10:53:48.775814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 8492 count 60 nextOffset 77 batches 1
2025-10-15T10:53:48.775850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-15T10:53:48.775877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 8633 count 61 nextOffset 78 batches 1
2025-10-15T10:53:48.775900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-15T10:53:48.775917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 8774 count 62 nextOffset 79 batches 1
2025-10-15T10:53:48.775934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-15T10:53:48.775951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 8915 count 63 nextOffset 80 batches 1
2025-10-15T10:53:48.775971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-15T10:53:48.775989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 9056 count 64 nextOffset 81 batches 1
2025-10-15T10:53:48.776005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-15T10:53:48.776032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 9197 count 65 nextOffset 82 batches 1
2025-10-15T10:53:48.776049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-15T10:53:48.776066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 9338 count 66 nextOffset 83 batches 1
2025-10-15T10:53:48.776081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-15T10:53:48.776098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 9479 count 67 nextOffset 84 batches 1
2025-10-15T10:53:48.776139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-15T10:53:48.776161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 9620 count 68 nextOffset 85 batches 1
2025-10-15T10:53:48.776177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-15T10:53:48.776194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 9761 count 69 nextOffset 86 batches 1
2025-10-15T10:53:48.776209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-15T10:53:48.776226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 9902 count 70 nextOffset 87 batches 1
2025-10-15T10:53:48.776240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.776875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 17,70 HeadOffset 17 endOffset 17 curOffset 87 d0000000000_00000000000000000017_00000_0000000070_00000? size 7652 WTime 1760525628775
2025-10-15T10:53:48.777013Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:48.777100Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 70 size 7652
2025-10-15T10:53:48.814390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 70 size 7652 actorID [2:7561399995015941528:2372]
2025-10-15T10:53:48.814444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:48.814487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 7420 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:48.814517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-15T10:53:48.814562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-15T10:53:48.814588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-15T10:53:48.814614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-15T10:53:48.814641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-15T10:53:48.814668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-15T10:53:48.814695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-15T10:53:48.814723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-15T10:53:48.814749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-15T10:53:48.814772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-15T10:53:48.814796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-15T10:53:48.814828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-15T10:53:48.814861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-15T10:53:48.814893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-15T10:53:48.814918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-15T10:53:48.814953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-15T10:53:48.814975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.814990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-15T10:53:48.815000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-15T10:53:48.815024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-15T10:53:48.815055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-15T10:53:48.815083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-15T10:53:48.815106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-15T10:53:48.815130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-15T10:53:48.815156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-15T10:53:48.815183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-15T10:53:48.815211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-15T10:53:48.815233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-15T10:53:48.815257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-15T10:53:48.815281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-15T10:53:48.815308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-15T10:53:48.815332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-15T10:53:48.815370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-15T10:53:48.815398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-15T10:53:48.815424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-15T10:53:48.815492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-15T10:53:48.815524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-15T10:53:48.815547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-15T10:53:48.815567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-15T10:53:48.815591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-15T10:53:48.815615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-15T10:53:48.815653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.815672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-15T10:53:48.815685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-15T10:53:48.816565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-15T10:53:48.816613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-15T10:53:48.816642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-15T10:53:48.816672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-15T10:53:48.816701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-15T10:53:48.816755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-15T10:53:48.816789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-15T10:53:48.816824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-15T10:53:48.816849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-15T10:53:48.816881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-15T10:53:48.816916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-15T10:53:48.816946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.816962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-15T10:53:48.817000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-15T10:53:48.817048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-15T10:53:48.817085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-15T10:53:48.817126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-15T10:53:48.817155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-15T10:53:48.817215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-15T10:53:48.817246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-15T10:53:48.817282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-15T10:53:48.817317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-15T10:53:48.817353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-15T10:53:48.817378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-15T10:53:48.817422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-15T10:53:48.817449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-15T10:53:48.817494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-15T10:53:48.817523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-15T10:53:48.817563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.817581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-15T10:53:48.817740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.817751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.817760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.817792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:48.818368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-15T10:53:48.818521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 70 parts 0 suffix '63' size 7652
2025-10-15T10:53:48.820011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:48.823933Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:48.825188Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 18 written { offset: 17 } } acks { seq_no: 19 written { offset: 18 } } acks { seq_no: 20 written { offset: 19 } } acks { seq_no: 21 written { offset: 20 } } acks { seq_no: 22 written { offset: 21 } } acks { seq_no: 23 written { offset: 22 } } acks { seq_no: 24 written { offset: 23 } } acks { seq_no: 25 written { offset: 24 } } acks { seq_no: 26 written { offset: 25 } } acks { seq_no: 27 written { offset: 26 } } acks { seq_no: 28 written { offset: 27 } } acks { seq_no: 29 written { offset: 28 } } acks { seq_no: 30 written { offset: 29 } } acks { seq_no: 31 written { offset: 30 } } acks { seq_no: 32 written { offset: 31 } } acks { seq_no: 33 written { offset: 32 } } acks { seq_no: 34 written { offset: 33 } } acks { seq_no: 35 written { offset: 34 } } acks { seq_no: 36 written { offset: 35 } } acks { seq_no: 37 written { offset: 36 } } acks { seq_no: 38 written { offset: 37 } } acks { seq_no: 39 written { offset: 38 } } acks { seq_no: 40 written { offset: 39 } } acks { seq_no: 41 written { offset: 40 } } acks { seq_no: 42 written { offset: 41 } } acks { seq_no: 43 written { offset: 42 } } acks { seq_no: 44 written { offset: 43 } } acks { seq_no: 45 written { offset: 44 } } acks { seq_no: 46 written { offset: 45 } } acks { seq_no: 47 written { offset: 46 } } acks { seq_no: 48 written { offset: 47 } } acks { seq_no: 49 written { offset: 48 } } acks { seq_no: 50 written { offset: 49 } } acks { seq_no: 51 written { offset: 50 } } acks { seq_no: 52 written { offset: 51 } } acks { seq_no: 53 written { offset: 52 } } acks { seq_no: 54 written { offset: 53 } } acks { seq_no: 55 written { offset: 54 } } acks { seq_no: 56 written { offset: 55 } } acks { seq_no: 57 written { offset: 56 } } acks { seq_no: 58 written { offset: 57 } } acks { seq_no: 59 written { offset: 58 } } acks { seq_no: 60 written { offset: 59 } } acks { seq_no: 61 written { offset: 60 } } acks { seq_no: 62 written { offset: 61 } } acks { seq_no: 63 written { offset: 62 } } acks { seq_no: 64 written { offset: 63 } } acks { seq_no: 65 written { offset: 64 } } acks { seq_no: 66 written { offset: 65 } } acks { seq_no: 67 written { offset: 66 } } acks { seq_no: 68 written { offset: 67 } } acks { seq_no: 69 written { offset: 68 } } acks { seq_no: 70 written { offset: 69 } } acks { seq_no: 71 written { offset: 70 } } acks { seq_no: 72 written { offset: 71 } } acks { seq_no: 73 written { offset: 72 } } acks { seq_no: 74 written { offset: 73 } } acks { seq_no: 75 written { offset: 74 } } acks { seq_no: 76 written { offset: 75 } } acks { seq_no: 77 written { offset: 76 } } acks { seq_no: 78 written { offset: 77 } } acks { seq_no: 79 written { offset: 78 } } acks { seq_no: 80 written { offset: 79 } } acks { seq_no: 81 written { offset: 80 } } acks { seq_no: 82 written { offset: 81 } } acks { seq_no: 83 written { offset: 82 } } acks { seq_no: 84 written { offset: 83 } } acks { seq_no: 85 written { offset: 84 } } acks { seq_no: 86 written { offset: 85 } } acks { seq_no: 87 written { offset: 86 } } write_statistics { persisting_time { nanos: 40000000 } min_queue_wait_time { nanos: 6000000 } max_queue_wait_time { nanos: 10000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-15T10:53:48.825234Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=18, txId=?
2025-10-15T10:53:48.825261Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 18
2025-10-15T10:53:48.825300Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=19, txId=?
2025-10-15T10:53:48.825327Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 19
2025-10-15T10:53:48.825344Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=20, txId=?
2025-10-15T10:53:48.825366Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 20
2025-10-15T10:53:48.825390Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=21, txId=?
2025-10-15T10:53:48.825407Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 21
2025-10-15T10:53:48.825432Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=22, txId=?
2025-10-15T10:53:48.825471Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 22
2025-10-15T10:53:48.825494Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=23, txId=?
2025-10-15T10:53:48.825512Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 23
2025-10-15T10:53:48.825537Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=24, txId=?
2025-10-15T10:53:48.825554Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 24
2025-10-15T10:53:48.825580Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=25, txId=?
2025-10-15T10:53:48.825602Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 25
2025-10-15T10:53:48.825617Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=26, txId=?
2025-10-15T10:53:48.825637Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 26
2025-10-15T10:53:48.825666Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=27, txId=?
2025-10-15T10:53:48.825683Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 27
2025-10-15T10:53:48.825701Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=28, txId=?
2025-10-15T10:53:48.825719Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 28
2025-10-15T10:53:48.825745Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=29, txId=?
2025-10-15T10:53:48.825759Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 29
2025-10-15T10:53:48.825782Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=30, txId=?
2025-10-15T10:53:48.825800Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 30
2025-10-15T10:53:48.825817Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=31, txId=?
2025-10-15T10:53:48.825836Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 31
2025-10-15T10:53:48.825854Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=32, txId=?
2025-10-15T10:53:48.825872Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 32
2025-10-15T10:53:48.825900Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=33, txId=?
2025-10-15T10:53:48.825935Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 33
2025-10-15T10:53:48.825956Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=34, txId=?
2025-10-15T10:53:48.825975Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 34
2025-10-15T10:53:48.826003Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=35, txId=?
2025-10-15T10:53:48.826025Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 35
2025-10-15T10:53:48.826042Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=36, txId=?
2025-10-15T10:53:48.826061Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 36
2025-10-15T10:53:48.826084Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=37, txId=?
2025-10-15T10:53:48.826102Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 37
2025-10-15T10:53:48.826121Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=38, txId=?
2025-10-15T10:53:48.826138Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 38
2025-10-15T10:53:48.826159Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=39, txId=?
2025-10-15T10:53:48.826174Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 39
2025-10-15T10:53:48.826195Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=40, txId=?
2025-10-15T10:53:48.826215Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 40
2025-10-15T10:53:48.826234Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=41, txId=?
2025-10-15T10:53:48.826254Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 41
2025-10-15T10:53:48.826269Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=42, txId=?
2025-10-15T10:53:48.826287Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 42
2025-10-15T10:53:48.826313Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=43, txId=?
2025-10-15T10:53:48.826328Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 43
2025-10-15T10:53:48.826345Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=44, txId=?
2025-10-15T10:53:48.826381Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 44
2025-10-15T10:53:48.826410Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=45, txId=?
2025-10-15T10:53:48.826424Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 45
2025-10-15T10:53:48.826445Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=46, txId=?
2025-10-15T10:53:48.826465Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 46
2025-10-15T10:53:48.826486Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=47, txId=?
2025-10-15T10:53:48.826505Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 47
2025-10-15T10:53:48.826529Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=48, txId=?
2025-10-15T10:53:48.826546Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 48
2025-10-15T10:53:48.826572Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=49, txId=?
2025-10-15T10:53:48.826588Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 49
2025-10-15T10:53:48.826605Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=50, txId=?
2025-10-15T10:53:48.826624Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 50
2025-10-15T10:53:48.826652Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=51, txId=?
2025-10-15T10:53:48.826673Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 51
2025-10-15T10:53:48.826688Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=52, txId=?
2025-10-15T10:53:48.826707Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 52
2025-10-15T10:53:48.826731Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=53, txId=?
2025-10-15T10:53:48.826747Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 53
2025-10-15T10:53:48.826771Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=54, txId=?
2025-10-15T10:53:48.826792Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 54
2025-10-15T10:53:48.826827Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=55, txId=?
2025-10-15T10:53:48.826846Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 55
2025-10-15T10:53:48.826865Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=56, txId=?
2025-10-15T10:53:48.826882Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 56
2025-10-15T10:53:48.826903Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=57, txId=?
2025-10-15T10:53:48.826922Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 57
2025-10-15T10:53:48.826938Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=58, txId=?
2025-10-15T10:53:48.826956Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 58
2025-10-15T10:53:48.826977Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=59, txId=?
2025-10-15T10:53:48.826994Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 59
2025-10-15T10:53:48.827013Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=60, txId=?
2025-10-15T10:53:48.827031Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 60
2025-10-15T10:53:48.827063Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=61, txId=?
2025-10-15T10:53:48.827077Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 61
2025-10-15T10:53:48.827098Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=62, txId=?
2025-10-15T10:53:48.827116Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 62
2025-10-15T10:53:48.827135Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=63, txId=?
2025-10-15T10:53:48.827155Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 63
2025-10-15T10:53:48.827176Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=64, txId=?
2025-10-15T10:53:48.827193Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 64
2025-10-15T10:53:48.827216Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=65, txId=?
2025-10-15T10:53:48.827231Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 65
2025-10-15T10:53:48.827249Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=66, txId=?
2025-10-15T10:53:48.827284Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 66
2025-10-15T10:53:48.827308Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=67, txId=?
2025-10-15T10:53:48.827327Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 67
2025-10-15T10:53:48.827342Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=68, txId=?
2025-10-15T10:53:48.835238Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 68
2025-10-15T10:53:48.835283Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=69, txId=?
2025-10-15T10:53:48.835303Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 69
2025-10-15T10:53:48.835334Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=70, txId=?
2025-10-15T10:53:48.835367Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 70
2025-10-15T10:53:48.835388Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=71, txId=?
2025-10-15T10:53:48.835406Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 71
2025-10-15T10:53:48.835428Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=72, txId=?
2025-10-15T10:53:48.835445Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 72
2025-10-15T10:53:48.835468Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=73, txId=?
2025-10-15T10:53:48.835488Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 73
2025-10-15T10:53:48.835506Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=74, txId=?
2025-10-15T10:53:48.835527Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 74
2025-10-15T10:53:48.835548Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=75, txId=?
2025-10-15T10:53:48.835567Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 75
2025-10-15T10:53:48.835588Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=76, txId=?
2025-10-15T10:53:48.835604Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 76
2025-10-15T10:53:48.835625Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=77, txId=?
2025-10-15T10:53:48.835637Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 77
2025-10-15T10:53:48.835670Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=78, txId=?
2025-10-15T10:53:48.835688Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 78
2025-10-15T10:53:48.835706Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=79, txId=?
2025-10-15T10:53:48.835723Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 79
2025-10-15T10:53:48.835739Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=80, txId=?
2025-10-15T10:53:48.835756Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 80
2025-10-15T10:53:48.835782Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=81, txId=?
2025-10-15T10:53:48.835796Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 81
2025-10-15T10:53:48.835813Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=82, txId=?
2025-10-15T10:53:48.835835Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 82
2025-10-15T10:53:48.835855Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=83, txId=?
2025-10-15T10:53:48.835875Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 83
2025-10-15T10:53:48.835890Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=84, txId=?
2025-10-15T10:53:48.835905Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 84
2025-10-15T10:53:48.835924Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=85, txId=?
2025-10-15T10:53:48.835939Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 85
2025-10-15T10:53:48.835961Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=86, txId=?
2025-10-15T10:53:48.835976Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 86
2025-10-15T10:53:48.835992Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=87, txId=?
2025-10-15T10:53:48.836005Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 87
2025-10-15T10:53:48.840823Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:48.840873Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Send 13 message(s) (0 left), first sequence number is 88
2025-10-15T10:53:48.841588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:53:48.842037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:53:48.842612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.842647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.842709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-15T10:53:48.843038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:48.843569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:48.843590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:48.843635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-15T10:53:48.843867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:53:48.843968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.844013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.844023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (13)
2025-10-15T10:53:48.844118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-15T10:53:48.915752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 173 count 1 nextOffset 88 batches 1
2025-10-15T10:53:48.915832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-15T10:53:48.915871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 314 count 2 nextOffset 89 batches 1
2025-10-15T10:53:48.915893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-15T10:53:48.915920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 455 count 3 nextOffset 90 batches 1
2025-10-15T10:53:48.915941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-15T10:53:48.915959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 596 count 4 nextOffset 91 batches 1
2025-10-15T10:53:48.915978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-15T10:53:48.916000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 737 count 5 nextOffset 92 batches 1
2025-10-15T10:53:48.916018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-15T10:53:48.916035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 878 count 6 nextOffset 93 batches 1
2025-10-15T10:53:48.916053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-15T10:53:48.916071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 1019 count 7 nextOffset 94 batches 1
2025-10-15T10:53:48.916090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-15T10:53:48.916107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 1160 count 8 nextOffset 95 batches 1
2025-10-15T10:53:48.916124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-15T10:53:48.916146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 1301 count 9 nextOffset 96 batches 1
2025-10-15T10:53:48.916165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-15T10:53:48.916182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 1442 count 10 nextOffset 97 batches 1
2025-10-15T10:53:48.916199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-15T10:53:48.916218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 1583 count 11 nextOffset 98 batches 1
2025-10-15T10:53:48.916237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-15T10:53:48.916253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 1724 count 12 nextOffset 99 batches 1
2025-10-15T10:53:48.916268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-15T10:53:48.916287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 87 PartNo 0 PackedSize 1865 count 13 nextOffset 100 batches 1
2025-10-15T10:53:48.916302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.916733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 87,13 HeadOffset 87 endOffset 87 curOffset 100 d0000000000_00000000000000000087_00000_0000000013_00000? size 1496 WTime 1760525628916
2025-10-15T10:53:48.916908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:53:48.916926Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:48.917012Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 87 partNo 0 count 13 size 1496
2025-10-15T10:53:48.930493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 87 count 13 size 1496 actorID [2:7561399995015941528:2372]
2025-10-15T10:53:48.930548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:48.930592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1378 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:48.930624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-15T10:53:48.930665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-15T10:53:48.930702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-15T10:53:48.930727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-10-15T10:53:48.930751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-15T10:53:48.930779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-15T10:53:48.930806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-15T10:53:48.930832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-15T10:53:48.930858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-15T10:53:48.930885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-15T10:53:48.930911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-15T10:53:48.930940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-15T10:53:48.930964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:48.930979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-15T10:53:48.931116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.931126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.931134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.931163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:48.931279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-15T10:53:48.932201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:48.931987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 87 partno 0 count 13 parts 0 suffix '63' size 1496
2025-10-15T10:53:48.937780Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:48.938093Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 88 written { offset: 87 } } acks { seq_no: 89 written { offset: 88 } } acks { seq_no: 90 written { offset: 89 } } acks { seq_no: 91 written { offset: 90 } } acks { seq_no: 92 written { offset: 91 } } acks { seq_no: 93 written { offset: 92 } } acks { seq_no: 94 written { offset: 93 } } acks { seq_no: 95 written { offset: 94 } } acks { seq_no: 96 written { offset: 95 } } acks { seq_no: 97 written { offset: 96 } } acks { seq_no: 98 written { offset: 97 } } acks { seq_no: 99 written { offset: 98 } } acks { seq_no: 100 written { offset: 99 } } write_statistics { persisting_time { nanos: 14000000 } min_queue_wait_time { nanos: 72000000 } max_queue_wait_time { nanos: 72000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-15T10:53:48.938126Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=88, txId=?
2025-10-15T10:53:48.938155Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 88
2025-10-15T10:53:48.938186Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=89, txId=?
2025-10-15T10:53:48.938202Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 89
2025-10-15T10:53:48.938226Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=90, txId=?
2025-10-15T10:53:48.938246Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 90
2025-10-15T10:53:48.938263Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=91, txId=?
2025-10-15T10:53:48.938282Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 91
2025-10-15T10:53:48.938303Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=92, txId=?
2025-10-15T10:53:48.938327Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 92
2025-10-15T10:53:48.938351Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=93, txId=?
2025-10-15T10:53:48.938366Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 93
2025-10-15T10:53:48.938391Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=94, txId=?
2025-10-15T10:53:48.938409Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 94
2025-10-15T10:53:48.938428Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=95, txId=?
2025-10-15T10:53:48.938447Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 95
2025-10-15T10:53:48.938466Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=96, txId=?
2025-10-15T10:53:48.938484Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 96
2025-10-15T10:53:48.938504Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=97, txId=?
2025-10-15T10:53:48.938521Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 97
2025-10-15T10:53:48.938543Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=98, txId=?
2025-10-15T10:53:48.938558Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 98
2025-10-15T10:53:48.938610Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=99, txId=?
2025-10-15T10:53:48.938627Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 99
2025-10-15T10:53:48.938653Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] OnAck: seqNo=100, txId=?
2025-10-15T10:53:48.938671Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 100
2025-10-15T10:53:48.943530Z :INFO: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-15T10:53:48.943576Z :INFO: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session will now close
2025-10-15T10:53:48.943639Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: aborting
2025-10-15T10:53:48.944034Z :INFO: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:48.944074Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0]  MessageGroupId [src_id] Write session: destroy
2025-10-15T10:53:48.953121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0 grpc read done: success: 0 data: 
2025-10-15T10:53:48.953146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0 grpc read failed
2025-10-15T10:53:48.953195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0 grpc closed
2025-10-15T10:53:48.953210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|ece63a04-f7a9118f-1861e9c3-3756bd64_0 is DEAD
2025-10-15T10:53:48.953942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:48.956284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399999812070473:2498] destroyed
2025-10-15T10:53:48.956328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:48.956354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.956365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.956373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.023452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.023481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.023492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.120487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.120513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.120523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.223520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.223548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.223558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.440487Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561400004107037820:2510]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-15T10:53:49.479451Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561400004107037820:2510]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:49.592972Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561400004107037820:2510]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:49.800143Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561400004107037820:2510]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:50.002341Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561400004107037820:2510]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:50.217799Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561400004107037820:2510]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:50.417800Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561400004107037820:2510]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:50.833591Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710688. Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:50.833712Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:248: ActorId: [1:7561400004107037848:2504] TxId: 281474976710688. Ctx: { TraceId: 01k7kr2dwp5bde9mgjr0j3081f, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NDBmOGVjOGUtZTY5ZjIyYzUtZmIyM2M4NmMtMWU1MGI4NTQ=, PoolId: }. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:50.833975Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2830: SessionId: ydb://session/3?node_id=1&id=NDBmOGVjOGUtZTY5ZjIyYzUtZmIyM2M4NmMtMWU1MGI4NTQ=, ActorId: [1:7561400004107037798:2504], ActorState: ExecuteState, TraceId: 01k7kr2dwp5bde9mgjr0j3081f, Create QueryResponse for error on request, msg: 
2025-10-15T10:53:50.835574Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k7kr2ed27x8m729jgfy1rpmn" } } YdbStatus: UNAVAILABLE ConsumedRu: 338 }
2025-10-15T10:53:52.289412Z :WriteSessionCloseIgnoresWrites INFO: Random seed for debugging is 1760525632289394
2025-10-15T10:53:52.896841Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7561400013475588626:2078];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:52.896886Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:53.039299Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:53.067560Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/001073/r3tmp/tmpAhHezp/pdisk_1.dat
2025-10-15T10:53:53.054162Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7561400019481668610:2215];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:53.054240Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:53.081180Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T10:53:53.081741Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:53.172210Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:53.303674Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:53.340915Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:53.426804Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:53.455020Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:53.455107Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:53.457535Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:53.457615Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:53.473059Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:53.478872Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-15T10:53:53.485585Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 29502, node 3
2025-10-15T10:53:53.744315Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:53.850817Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/001073/r3tmp/yandexIpiQFm.tmp
2025-10-15T10:53:53.850843Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/001073/r3tmp/yandexIpiQFm.tmp
2025-10-15T10:53:53.850975Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/001073/r3tmp/yandexIpiQFm.tmp
2025-10-15T10:53:53.851127Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:53.874467Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:53.929797Z INFO: TTestServer started on Port 15607 GrpcPort 29502
2025-10-15T10:53:54.020667Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:54.055851Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:15607
PQClient connected to localhost:29502
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:54.528988Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:54.704500Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976710660, at schemeshard: 72057594046644480
2025-10-15T10:53:57.902881Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7561400013475588626:2078];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:57.903012Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:57.953824Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7561400036661537935:2293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:57.959690Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=Mjk2OTMzZmUtYzFhZWRiZjAtMTcwNGQ1MmItYjlkYjMyZDQ=, ActorId: [4:7561400036661537933:2292], ActorState: ExecuteState, TraceId: 01k7kr2p7t6ztmmppwgxhdm9bg, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:57.960059Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:58.055676Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7561400019481668610:2215];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:58.055750Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:58.234581Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7561400039245393408:2323], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:58.237347Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=YmRmNzNjNjAtNDZlNDE2MDEtYWZiZWI0MWItNzIyMjVlNWQ=, ActorId: [3:7561400039245393405:2321], ActorState: ExecuteState, TraceId: 01k7kr2pfebtmd0cwhr7e8pdsq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:58.237704Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:58.259644Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:58.478320Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:58.695970Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:29502", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:59.316957Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k7kr2q91bpjgxkk7gp3sfw0r, Database: , SessionId: ydb://session/3?node_id=3&id=MzI0ZGQ3MDQtNjRiODMwYjQtNTcxOWRkMGEtNzFmMmE3NTA=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7561400043540361113:2938] 
=== CheckClustersList. Ok
2025-10-15T10:54:04.504582Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710673:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:29502
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
2025-10-15T10:54:04.586435Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:29502
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:54:04.630623Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7561400065015198079:3231] connected; active server actors: 1
2025-10-15T10:54:04.630815Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:54:04.632167Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:54:04.635764Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:54:04.657105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:54:04.661483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:54:04.661776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:54:04.661813Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:04.661852Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:54:04.662298Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400065015198078:3230], now have 1 active actors on pipe
2025-10-15T10:54:04.662351Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400065015198099:2431], now have 1 active actors on pipe
2025-10-15T10:54:04.663530Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:04.666438Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-15T10:54:04.669474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:04.676611Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400065015198126:3271], now have 1 active actors on pipe
2025-10-15T10:54:04.677157Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:04.682273Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:04.683096Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:54:04.683144Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:54:04.683420Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:54:04.683589Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7561400066726309535:2380]
2025-10-15T10:54:04.687140Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:54:04.687169Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:54:04.687188Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7561400066726309535:2380]
2025-10-15T10:54:04.687209Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:54:04.688433Z node 4 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:54:04.688472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.688539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.688550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:04.688564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:54:04.688572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.688583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.688590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:54:04.688619Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:54:04.688915Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:04.689037Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:04.695519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:04.695648Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525644717, TxId 281474976710676
2025-10-15T10:54:04.695667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.695675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.695782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.695958Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:04.699609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:04.699836Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:04.699858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.699869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.699877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.699904Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:04.700196Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:54:04.700271Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:54:04.700485Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:04.715608Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:04.715711Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:54:04.721531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:54:04.788546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.788578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.788589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.888489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.888516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.888524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.905093Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k7kr2wvt6ex6jjf0hk4k4rqb, Database: , SessionId: ydb://session/3?node_id=3&id=ZWQ5MmEwMDAtN2FjZjlmMDYtYjhjZDVhY2EtNTRkYzAxYzA=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525644717
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525644717
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:29502
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:54:04.949629Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:54:04.992349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.992377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.992396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.096045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.096072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.096084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.196738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.196769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.196781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.297888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.297914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.297923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.402422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.402456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.402472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:29502
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:54:05.459666Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:54:05.502865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.502906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.502917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.605807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.605834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.605843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.706842Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.706871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.706882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.809718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.809748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.809760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.911885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.911914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.911925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:29502
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:54:05.971929Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:54:05.998097Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:54:05.998538Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:54:05.998591Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:29502
2025-10-15T10:54:06.011983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.012006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.012017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.018482Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:54:06.019634Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:06.019664Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:54:06.022386Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:54:06.022499Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:50882
2025-10-15T10:54:06.022512Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:50882 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:54:06.022519Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:06.024073Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:54:06.024211Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:06.024220Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:06.024226Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:06.024248Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561400073605132903:2470] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:06.026675Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561400073605132903:2470] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:06.112747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.112776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.112786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.218485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.218513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.218522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.279759Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7561400073605132903:2470] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:54:06.280657Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400073605132943:2470] connected; active server actors: 1
2025-10-15T10:54:06.280967Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7561400073605132903:2470] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:54:06.280982Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400073605132903:2470] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:06.285108Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400073605132943:2470] disconnected; active server actors: 1
2025-10-15T10:54:06.285134Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561400073605132943:2470] disconnected no session
2025-10-15T10:54:06.319688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.319731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.319742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.423501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.423531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.423547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.523590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.523618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.523629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.537702Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400073605132903:2470] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:06.537751Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561400073605132903:2470] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:54:06.537768Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400073605132903:2470] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:06.537816Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:06.538880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400073605132965:2470], now have 1 active actors on pipe
2025-10-15T10:54:06.539203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:54:06.539581Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:06.539616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:06.539700Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|56db24e5-8564f05e-b870a88f-c62ad3dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:54:06.539743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.539763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.539772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:06.539808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.539843Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:06.539888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:06.540830Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:06.540859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:06.540929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:06.541391Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|56db24e5-8564f05e-b870a88f-c62ad3dc_0
2025-10-15T10:54:06.542331Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525646542 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:06.542438Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|56db24e5-8564f05e-b870a88f-c62ad3dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:54:06.542838Z :INFO: [] MessageGroupId [src] SessionId [src|56db24e5-8564f05e-b870a88f-c62ad3dc_0] Write session: close. Timeout = 0 ms
2025-10-15T10:54:06.542883Z :INFO: [] MessageGroupId [src] SessionId [src|56db24e5-8564f05e-b870a88f-c62ad3dc_0] Write session will now close
2025-10-15T10:54:06.542922Z :DEBUG: [] MessageGroupId [src] SessionId [src|56db24e5-8564f05e-b870a88f-c62ad3dc_0] Write session: aborting
2025-10-15T10:54:06.543309Z :INFO: [] MessageGroupId [src] SessionId [src|56db24e5-8564f05e-b870a88f-c62ad3dc_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:54:06.543364Z :DEBUG: [] MessageGroupId [src] SessionId [src|56db24e5-8564f05e-b870a88f-c62ad3dc_0] Write session: destroy
2025-10-15T10:54:06.551487Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|56db24e5-8564f05e-b870a88f-c62ad3dc_0 grpc read done: success: 0 data: 
2025-10-15T10:54:06.551514Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|56db24e5-8564f05e-b870a88f-c62ad3dc_0 grpc read failed
2025-10-15T10:54:06.551536Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|56db24e5-8564f05e-b870a88f-c62ad3dc_0 grpc closed
2025-10-15T10:54:06.551558Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|56db24e5-8564f05e-b870a88f-c62ad3dc_0 is DEAD
2025-10-15T10:54:06.552209Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:54:06.553592Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561400073605132965:2470] destroyed
2025-10-15T10:54:06.553631Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:54:06.553656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.553667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.553676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Ready to answer: ok
2025-10-15T10:54:06.627498Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: UNAVAILABLE. Description: 
2025-10-15T10:54:06.627518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.627547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.627557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.727471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.727553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.727570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.835473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.835510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.835522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.939701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.939734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.939746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.042858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.042888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.042899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.142905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.142938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.142951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.243537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.243565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.243577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.347641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.347678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.347696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.451638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.451675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.451687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.559915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.559947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.559961Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.660697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.660724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.660736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.764121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.764152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.764162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.864536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.864561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.864582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.967571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.967598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.967620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.071898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.071932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.071943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.175465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.175497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.175507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.278924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.278946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.278964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.352182Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:54:08.352214Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:54:08.379617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.379641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.379652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.480118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.480141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.480150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.580260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.580288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.580299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.681023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.681051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.681062Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.783152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.783176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.783185Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.887598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.887633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.887643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.987473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.987504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.987516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.094960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.094987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.094998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.195682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.195713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.195723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.299579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.299607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.299620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.401789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.401818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.401830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.503644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.503673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.503683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.603565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.603593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.603606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.695603Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:09.707461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.707490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.707501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.804757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.804788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.804801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.907551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.907613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.907636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:02.177779Z :WriteSessionNoAvailableDatabase INFO: Random seed for debugging is 1760525582177702
2025-10-15T10:53:03.029264Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561399804222067708:2151];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:03.030225Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/0010b8/r3tmp/tmpv3fCsz/pdisk_1.dat
2025-10-15T10:53:03.089569Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7561399803746234643:2150];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:03.089639Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:03.144327Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:03.199266Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:03.736118Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:03.770681Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:03.877498Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:03.906954Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:03.907531Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:03.921260Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:03.921319Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:03.952452Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:03.974869Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T10:53:04.031629Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:04.109001Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:04.114348Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:04.115556Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:04.119050Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 2299, node 1
2025-10-15T10:53:04.394497Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/0010b8/r3tmp/yandexrvXkng.tmp
2025-10-15T10:53:04.394527Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/0010b8/r3tmp/yandexrvXkng.tmp
2025-10-15T10:53:04.394691Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/0010b8/r3tmp/yandexrvXkng.tmp
2025-10-15T10:53:04.394818Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:04.443631Z INFO: TTestServer started on Port 27698 GrpcPort 2299
TClient is connected to server localhost:27698
PQClient connected to localhost:2299
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:05.134271Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:08.024830Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561399804222067708:2151];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:08.024961Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:08.091498Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7561399803746234643:2150];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:08.091566Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:10.718633Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:10.732670Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7561399833811005927:2298], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:10.735548Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7561399834286839719:2327], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:10.736469Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=ODk5MDYwOTMtNzllODViOTItY2M0MzA2YzUtNDAxMzU4ZWE=, ActorId: [1:7561399834286839716:2325], ActorState: ExecuteState, TraceId: 01k7kr17rr4nmsbbsd5yc9hzbj, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:10.738524Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:10.734718Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=Zjc5ODEzMWMtYWUxMDFkMGItNDIwMTdiZjEtMjA5ZTA3M2E=, ActorId: [2:7561399833811005925:2297], ActorState: ExecuteState, TraceId: 01k7kr17v9dz70ehgd7qqy2w7d, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:10.741219Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:10.931910Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:11.150442Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:2299", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:11.673169Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k7kr18s4bwe5vb0t6bwdjmry, Database: , SessionId: ydb://session/3?node_id=1&id=ODBhMWMwMTEtZDM4N2FhYmMtZmQ3NWI3MGYtMmFiZGI2ZDI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561399838581807420:2939] 
=== CheckClustersList. Ok
2025-10-15T10:53:17.326820Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715673:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:2299
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:17.585329Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:2299
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:17.667262Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561399864351611710:3244] connected; active server actors: 1
2025-10-15T10:53:17.667514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:17.669416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:17.671388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:17.699775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:17.703609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:17.703901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:17.703979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:17.704017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:17.705659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399864351611709:3243], now have 1 active actors on pipe
2025-10-15T10:53:17.705686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399864351611732:2446], now have 1 active actors on pipe
2025-10-15T10:53:17.706852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.707500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T10:53:17.713681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.721841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399864351611764:3288], now have 1 active actors on pipe
2025-10-15T10:53:17.724324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.728516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.729678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:17.729772Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:17.730065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:17.730381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561399863875777531:2386]
2025-10-15T10:53:17.735902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:17.735934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:17.735977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561399863875777531:2386]
2025-10-15T10:53:17.736020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:17.737396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:17.737453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.737576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.737587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:17.737607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:17.737622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.737633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.737641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:17.737702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:17.741151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.741317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.746937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.747088Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525597761, TxId 281474976715676
2025-10-15T10:53:17.747112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.747123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.747255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.747511Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:17.751549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:17.751833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:17.751867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.751882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.751895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.751924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.752283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:17.752377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:17.752663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.764642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.764786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.768831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.823399Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715677. Ctx: { TraceId: 01k7kr1eyn3xbfyahf4qdhe3f8, Database: , SessionId: ydb://session/3?node_id=1&id=Y2ZlODE3YTktYTA4YThlN2MtNzEwNmI4N2QtNmRiNmRhNQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-15T10:53:17.840827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.840859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.840872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525597761
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760525597761
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:2299
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:17.888659Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:17.943491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.943526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.943537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.048150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.048185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.048196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.148228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.148254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.148265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.251943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.251968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.251978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.354131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.354158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.354169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:2299
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:18.396865Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:18.460245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.460270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.460281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.559912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.559938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.559948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.660799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.660828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.660838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.734721Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:18.734757Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:18.767631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.767659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.767677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.871466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.871497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.871508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:2299
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:18.908689Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:18.973681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.973709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.973720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.986156Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:18.986607Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:18.986641Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:2299
2025-10-15T10:53:19.045864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:19.045904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:19.083467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.083501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.083512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.164385Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:19.170482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:19.170687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:40792
2025-10-15T10:53:19.170716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40792 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:19.170727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:19.173543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:19.173696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:19.173718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:19.173728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:19.173748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399872941546523:2479] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:19.178369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399872941546523:2479] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:19.182409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.182439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.182449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.287819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.287849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.287860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.390533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.390565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.390575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.491988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.492019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.492030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.595302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.595335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.595362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.601351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399872941546523:2479] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:19.603283Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399872941546585:2479] connected; active server actors: 1
2025-10-15T10:53:19.603576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399872941546523:2479] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:19.603600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399872941546523:2479] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:19.607950Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399872941546585:2479] disconnected; active server actors: 1
2025-10-15T10:53:19.607976Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399872941546585:2479] disconnected no session
2025-10-15T10:53:19.697990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.698018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.698028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.799589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.799615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.799623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.852967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399872941546523:2479] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:19.852999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399872941546523:2479] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:19.853015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399872941546523:2479] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:19.853041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:19.857465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399872941546620:2479], now have 1 active actors on pipe
2025-10-15T10:53:19.859027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:19.864317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.864366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.864476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|41bed32b-44de295-c97685cb-683caa84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:19.864523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.864549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.864564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:19.864610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.864659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:19.864738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:19.865969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.865996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.866087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:19.866571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|41bed32b-44de295-c97685cb-683caa84_0
2025-10-15T10:53:19.871785Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525599871 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:19.871973Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|41bed32b-44de295-c97685cb-683caa84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:19.875611Z :INFO: [] MessageGroupId [src] SessionId [src|41bed32b-44de295-c97685cb-683caa84_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:19.875669Z :INFO: [] MessageGroupId [src] SessionId [src|41bed32b-44de295-c97685cb-683caa84_0] Write session will now close
2025-10-15T10:53:19.875716Z :DEBUG: [] MessageGroupId [src] SessionId [src|41bed32b-44de295-c97685cb-683caa84_0] Write session: aborting
2025-10-15T10:53:19.876249Z :INFO: [] MessageGroupId [src] SessionId [src|41bed32b-44de295-c97685cb-683caa84_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:19.876289Z :DEBUG: [] MessageGroupId [src] SessionId [src|41bed32b-44de295-c97685cb-683caa84_0] Write session: destroy
2025-10-15T10:53:19.877459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|41bed32b-44de295-c97685cb-683caa84_0 grpc read done: success: 0 data: 
2025-10-15T10:53:19.877485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|41bed32b-44de295-c97685cb-683caa84_0 grpc read failed
2025-10-15T10:53:19.877532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|41bed32b-44de295-c97685cb-683caa84_0
2025-10-15T10:53:19.877550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|41bed32b-44de295-c97685cb-683caa84_0 is DEAD
2025-10-15T10:53:19.877821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:19.892110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399872941546620:2479] destroyed
2025-10-15T10:53:19.911889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:19.911948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.911962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.911975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.923573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.923592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.923602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-15T10:53:20.024492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.024524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.024534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-15T10:53:20.033099Z :ERROR: [/Root] [] [] Failed to select database: no available database. Status: NOT_FOUND
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to select database: no available database " }
2025-10-15T10:53:20.127482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.127513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.127524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.227885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.227922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.227943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.331601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:20.331628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:20.331638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.646740Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715685, task: 1, CA Id [1:7561399877236513963:2503]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-15T10:53:20.684445Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715685, task: 1, CA Id [1:7561399877236513963:2503]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:20.804643Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715685, task: 1, CA Id [1:7561399877236513963:2503]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:21.024293Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715685, task: 1, CA Id [1:7561399877236513963:2503]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:21.258300Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715685, task: 1, CA Id [1:7561399877236513963:2503]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:21.536297Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715685, task: 1, CA Id [1:7561399877236513963:2503]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:21.948939Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715685, task: 1, CA Id [1:7561399877236513963:2503]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:22.367601Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976715686. Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:22.367749Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:248: ActorId: [1:7561399881531481295:2497] TxId: 281474976715686. Ctx: { TraceId: 01k7kr1hhp0495cwmpqw5adq4a, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ODYzYzQ0OWYtYTk2NmU2ODItMjdkMDk3ZDgtNmI0ZWM1Y2Y=, PoolId: }. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:22.368050Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2830: SessionId: ydb://session/3?node_id=1&id=ODYzYzQ0OWYtYTk2NmU2ODItMjdkMDk3ZDgtNmI0ZWM1Y2Y=, ActorId: [1:7561399877236513934:2497], ActorState: ExecuteState, TraceId: 01k7kr1hhp0495cwmpqw5adq4a, Create QueryResponse for error on request, msg: 
2025-10-15T10:53:22.369620Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k7kr1jjtbnxc1e70n1nfkk31" } } YdbStatus: UNAVAILABLE ConsumedRu: 702 }
2025-10-15T10:53:22.688293Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715685, task: 1, CA Id [1:7561399877236513963:2503]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:23.763494Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715685, task: 1, CA Id [1:7561399877236513963:2503]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:25.099441Z :WriteSessionSwitchDatabases INFO: Random seed for debugging is 1760525605099420
2025-10-15T10:53:25.971648Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7561399899617682888:2068];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:26.000734Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/0010b8/r3tmp/tmpFXR2MC/pdisk_1.dat
2025-10-15T10:53:26.120882Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:26.121178Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T10:53:26.203667Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:26.209508Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:26.209576Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:26.210035Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:26.429850Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:26.531472Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:26.581385Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:26.647251Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:26.647325Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:26.650807Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:26.650887Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:26.655338Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-15T10:53:26.663705Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:26.664764Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 18252, node 3
2025-10-15T10:53:26.830230Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:26.884665Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/0010b8/r3tmp/yandexyM6HiU.tmp
2025-10-15T10:53:26.884694Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/0010b8/r3tmp/yandexyM6HiU.tmp
2025-10-15T10:53:26.885339Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/0010b8/r3tmp/yandexyM6HiU.tmp
2025-10-15T10:53:26.890332Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:26.910476Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:26.956055Z INFO: TTestServer started on Port 16035 GrpcPort 18252
2025-10-15T10:53:26.975565Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:27.092781Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:16035
PQClient connected to localhost:18252
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:27.321226Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:30.932205Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7561399899617682888:2068];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:30.932264Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:32.344796Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7561399929682454277:2296], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:32.346855Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=ODU0ZTc1MDYtYzI2MTg3NTUtZjZhYzUzMTctMWVkYzdjMmM=, ActorId: [4:7561399929682454275:2295], ActorState: ExecuteState, TraceId: 01k7kr1x622vctbp9stct56azj, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:32.347282Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:32.895147Z node 3 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k7kr1rhq1jsr9k9s55933fw6", Request deadline has expired for 0.417772s seconds
2025-10-15T10:53:32.975315Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7561399931209407968:2327], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:32.991010Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=YjBlYzljZS03ZTJkNDYzZi04YzNmOTllMC02MGNjYjVjZA==, ActorId: [3:7561399931209407965:2325], ActorState: ExecuteState, TraceId: 01k7kr1xvkdgvwj622qa5qet43, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:32.991394Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:32.995772Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:33.157433Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:33.409261Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7561399933977421665:2306], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:33.412029Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=Zjg5MWFkLWE0YTkwNGZkLWE4NmE3Mjk4LTVkYTU3N2My, ActorId: [4:7561399933977421663:2305], ActorState: ExecuteState, TraceId: 01k7kr1y9592179vzf5g60ecm4, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:33.412358Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:33.454718Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:18252", true, true, 1000);
2025-10-15T10:53:33.994760Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k7kr1ykf1kcjk46vq71st3wb, Database: , SessionId: ydb://session/3?node_id=3&id=MzNmYzI0ZWYtNmEwZTZlZjQtZGMxZDRkYjktZThjMDBkZjg=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7561399939799342970:2941] 
=== CheckClustersList. Ok
2025-10-15T10:53:39.562341Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:18252
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:39.697716Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:18252
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:39.789418Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7561399961274179896:3204] connected; active server actors: 1
2025-10-15T10:53:39.789615Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:39.791132Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:39.801207Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:39.804978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:39.812969Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:39.813264Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:39.813294Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:39.813331Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:39.814904Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-15T10:53:39.813958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399961274179895:3203], now have 1 active actors on pipe
2025-10-15T10:53:39.813991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399961274179931:2437], now have 1 active actors on pipe
2025-10-15T10:53:39.815520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:39.824830Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:39.836003Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399961274179959:3253], now have 1 active actors on pipe
2025-10-15T10:53:39.838342Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:39.852269Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:39.853194Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:39.853242Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:39.853512Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:39.853683Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7561399959747225853:2382]
2025-10-15T10:53:39.859763Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:39.859793Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:39.859815Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7561399959747225853:2382]
2025-10-15T10:53:39.859839Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:39.861212Z node 4 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:39.861239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.861310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.861322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:39.861338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:39.861347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.861357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.861365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:39.861392Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:39.861680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:39.861789Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:39.876461Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:39.876604Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525619874, TxId 281474976710676
2025-10-15T10:53:39.876627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.876639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.876786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.876991Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:39.885107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:39.885425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:39.885456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.885470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.885481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:39.885512Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:39.885885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:39.885975Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:39.886260Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:39.935579Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:39.935670Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:39.945547Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:39.961278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:39.961311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:39.961322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.061012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.061052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.061065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.112867Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k7kr24je12bxj254nywxbtpg, Database: , SessionId: ydb://session/3?node_id=3&id=OTI4MWU1YzktZmJiZGViZjItMWYzYzM4MTQtZjUzNWY0YTU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-15T10:53:40.164085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.164124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.164140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525619874
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525619874
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:18252
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:40.195850Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:40.221361Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:40.221775Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:40.221814Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:18252
2025-10-15T10:53:40.258029Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:40.259682Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:40.259718Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:40.260257Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:40.260378Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:56470
2025-10-15T10:53:40.260402Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56470 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:40.260411Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:40.262158Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:40.262277Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:40.262288Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:40.262299Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:40.262316Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561399965569147384:2461] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:40.265423Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561399965569147384:2461] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:40.267110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.267139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.267152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.367616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.367647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.367660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.471619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.471652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.471664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.575710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.575763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.575782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.677126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.677153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.677165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.748780Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7561399965569147384:2461] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:40.751112Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399965569147441:2461] connected; active server actors: 1
2025-10-15T10:53:40.751218Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7561399965569147384:2461] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:40.751234Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561399965569147384:2461] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:40.777629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.777659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.777671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.878003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.878037Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.878050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:40.878903Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399965569147441:2461] disconnected; active server actors: 1
2025-10-15T10:53:40.878941Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399965569147441:2461] disconnected no session
2025-10-15T10:53:40.989070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:40.989097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:40.989110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.091506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.091535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.091544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.189883Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561399965569147384:2461] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:41.189918Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561399965569147384:2461] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:41.189933Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561399965569147384:2461] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:41.189962Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:41.192086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.192125Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.192136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.224341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:53:41.225458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399969864114766:2461], now have 1 active actors on pipe
2025-10-15T10:53:41.237963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:41.238001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:41.238071Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|3b481bbe-69939453-6fd923fb-9aab433d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:41.238099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.238113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.238123Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:41.238152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.238185Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:41.244180Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:41.274297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:41.274336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:41.274402Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:41.275227Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|3b481bbe-69939453-6fd923fb-9aab433d_0
2025-10-15T10:53:41.290488Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525621290 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:41.290678Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|3b481bbe-69939453-6fd923fb-9aab433d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:41.292209Z :INFO: [] MessageGroupId [src] SessionId [src|3b481bbe-69939453-6fd923fb-9aab433d_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:41.294160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.294184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.294194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.295501Z :INFO: [] MessageGroupId [src] SessionId [src|3b481bbe-69939453-6fd923fb-9aab433d_0] Write session will now close
2025-10-15T10:53:41.295569Z :DEBUG: [] MessageGroupId [src] SessionId [src|3b481bbe-69939453-6fd923fb-9aab433d_0] Write session: aborting
2025-10-15T10:53:41.296183Z :INFO: [] MessageGroupId [src] SessionId [src|3b481bbe-69939453-6fd923fb-9aab433d_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:41.296232Z :DEBUG: [] MessageGroupId [src] SessionId [src|3b481bbe-69939453-6fd923fb-9aab433d_0] Write session: destroy
2025-10-15T10:53:41.298753Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|3b481bbe-69939453-6fd923fb-9aab433d_0 grpc read done: success: 0 data: 
2025-10-15T10:53:41.298779Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|3b481bbe-69939453-6fd923fb-9aab433d_0 grpc read failed
2025-10-15T10:53:41.315223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561399969864114766:2461] destroyed
2025-10-15T10:53:41.315262Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:41.315282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.315293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.315301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.298813Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|3b481bbe-69939453-6fd923fb-9aab433d_0 grpc closed
2025-10-15T10:53:41.298834Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|3b481bbe-69939453-6fd923fb-9aab433d_0 is DEAD
2025-10-15T10:53:41.312284Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:41.395801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.395827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.395837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-15T10:53:41.468071Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:18252" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:18252" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:18252" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-15T10:53:41.499480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.499513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.499524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.527774Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:41.546279Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-15T10:53:41.545603Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:41.545631Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:41.580614Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-15T10:53:41.584302Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:41.584332Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-15T10:53:41.593605Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:53:41.594075Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-15T10:53:41.594801Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:53:41.594992Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56484
2025-10-15T10:53:41.595010Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:56484 proto=topic  topic=test-topic durationSec=0
2025-10-15T10:53:41.595022Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:41.597029Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-15T10:53:41.597162Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:41.597176Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:41.597185Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:41.597202Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:41.599958Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:41.602060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.602086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.602102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.606990Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:41.608584Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399969864114829:2487] connected; active server actors: 1
2025-10-15T10:53:41.608791Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-15T10:53:41.608808Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:41.610337Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399969864114829:2487] disconnected; active server actors: 1
2025-10-15T10:53:41.610381Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7561399969864114829:2487] disconnected no session
2025-10-15T10:53:41.618166Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:41.618208Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:41.618222Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:41.618261Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:41.623755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561399969864114840:2487], now have 1 active actors on pipe
2025-10-15T10:53:41.624044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:53:41.624335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:41.624387Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:41.624461Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40d96975-f299e27a-641f2665-45d2dd9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:53:41.624490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.624506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.624515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:41.624595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.624635Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:41.624688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:41.628448Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:41.628485Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:41.628564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:41.633498Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|40d96975-f299e27a-641f2665-45d2dd9d_0
2025-10-15T10:53:41.634272Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:41.634362Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525621634 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:41.634492Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|40d96975-f299e27a-641f2665-45d2dd9d_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-15T10:53:41.635712Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-15T10:53:41.636531Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:41.636588Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-15T10:53:41.637345Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|40d96975-f299e27a-641f2665-45d2dd9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:53:41.640467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:41.640509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:41.637707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:53:41.640619Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:53:41.640974Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:41.641480Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:41.641507Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:41.641826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:53:41.641863Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:53:41.641907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.641929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.641942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:41.642060Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T10:53:41.643022Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-15T10:53:41.643059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.643659Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 160 WTime 1760525621643
2025-10-15T10:53:41.643829Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:41.643988Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 160
2025-10-15T10:53:41.650386Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:41.648609Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 160 actorID [4:7561399959747225836:2382]
2025-10-15T10:53:41.648667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:41.648715Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:41.648754Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:41.648792Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-15T10:53:41.649030Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:41.649059Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:53:41.649117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.649147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.649158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.649200Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:41.649236Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-15T10:53:41.649346Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T10:53:41.649585Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 160 count 1 last offset 0, current partition end offset: 1
2025-10-15T10:53:41.649601Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:53:41.649641Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 160 accessed 0 times before, last time 2025-10-15T10:53:41.000000Z
2025-10-15T10:53:41.649667Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-15T10:53:41.649710Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:53:41.649829Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-10-15T10:53:41.649896Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525621640 queuesize 0 startOffset 0
2025-10-15T10:53:41.650083Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-15T10:53:41.650145Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-15T10:53:41.652017Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:41.652769Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 5000000 } min_queue_wait_time { nanos: 2000000 } max_queue_wait_time { nanos: 2000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-15T10:53:41.652835Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-15T10:53:41.652876Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-15T10:53:41.703438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.703472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.703484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.803607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.803636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.803647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:41.904326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:41.904367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:41.904378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.004347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.004391Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.004403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.104669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.104708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.104721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.207488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.207520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.207531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.311569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.311603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.311616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.415612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.415649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.415661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.519063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.519100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.519113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.623475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.623506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.623518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.635594Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:42.727445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.727481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.727491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.827620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.827652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.827663Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:42.931451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:42.931481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:42.931492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.029355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.029381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.029392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.105319Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-15T10:53:43.105347Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561399969864114813:2487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:43.131738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.131772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.131783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.235677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.235705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.235717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.339585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.339618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.339632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.447495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.447530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.447543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.551217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.551252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.551263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.651928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.651965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.651977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.752241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.752275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.752286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.852655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.852689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.852703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:43.957940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:43.957973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:43.957986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.058368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.058416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.058426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.163460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.163489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.163499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.265720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.265754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.265766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.365649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.365676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.365688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.466399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.466430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.466441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.567966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.567997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.568010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.679486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.679522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.679535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.779938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.779972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.779983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.859485Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:44.880237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.880267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.880278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:44.983109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:44.983153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:44.983168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.091583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.091624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.091638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.192438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.192471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.192482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.295072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.295108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.295121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.399969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.400002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.400014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.503458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.503495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.503508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.607851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.607897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.607908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.715626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.715654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.715665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.824127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.824158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.824168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:45.924657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:45.924685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:45.924697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.027480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.027510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.027523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.131853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.131881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.131890Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.231769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.231797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.231807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.335990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.336017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.336029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.436385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.436415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.436425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.543471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.543504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.543517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.643848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.643876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.643887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.743687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.743715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.743726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.843692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.843721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.843733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:46.947724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:46.947752Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:46.947762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.049787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.049813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.049824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.151791Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.151819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.151830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.252480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.252510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.252521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.359492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.359539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.359554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.459120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.459148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.459159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.559816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.559847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.559859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.662384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.662416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.662439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.768966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.768993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.769005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.871477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.871505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.871516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:47.971471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:47.971501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:47.971513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.071528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.071557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.071568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.175746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.175771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.175783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.283458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.283486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.283496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.387920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.387956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.387969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.489936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.489973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.489987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.594033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.594067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.594080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.694120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.694166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.694180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.794752Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.794786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.794800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.895335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.895380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.895392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:48.998981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:48.999015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:48.999029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.101531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.101576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.101589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.203687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.203721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.203735Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.307905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.307933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.307944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.412580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.412611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.412622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.517046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.517075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.517087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.619940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.619967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.619977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.719684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.719711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.719720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.822731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.822763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.822775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:49.867051Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:49.924060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:49.924092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:49.924106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.027678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.027709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.027721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.131555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.131588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.131603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.237444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.237475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.237488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.338653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.338688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.338702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.439299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.439327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.439338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.543715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.543750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.543766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.647627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.647665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.647678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.748044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.748072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.748085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.850463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.850494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.850507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:50.951971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:50.952000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:50.952012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.051422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.051453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.051466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.151740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.151771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.151784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.255640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.255670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.255682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.359472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.359521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.359541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.457307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.457331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.457341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.558559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.558615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.558629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.659791Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.659823Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.659838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.762833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.762864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.762878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.862923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.862960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.862974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:51.964488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:51.964524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:51.964537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.065106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.065139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.065152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.167703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.167739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.167750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.267635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.267665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.267679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.371526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.371561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.371574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.476013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.476045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.476057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.579587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.579616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.579628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.683549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.683580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.683593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.787492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.787529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.787543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.887068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.887097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.887110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:52.987239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:52.987270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:52.987282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.089639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.089668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.089680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.199463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.199497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.199510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.301120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.301148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.301160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.402442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.402470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.402481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.510571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.510604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.510614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.611508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.611538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.611549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.715633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.715662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.715673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.816456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.816479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.816491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:53.920087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:53.920114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:53.920124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.022018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.022049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.022061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.120822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.120859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.120872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.221135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.221160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.221171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.327729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.327757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.327768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.428075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.428102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.428114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.528520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.528548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.528560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.628767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.628791Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.628803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.729075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.729104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.729115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.831577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.831609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.831619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:54.867560Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:54.931973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:54.932004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:54.932016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.032304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.032334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.032345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.135527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.135564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.135577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.236666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.236699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.236712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.336801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.336833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.336847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.442448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.442483Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.442496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.543588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.543621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.543635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.647077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.647113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.647127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.747708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.747754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.747769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.852361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.852395Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.852410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:55.955476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:55.955511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:55.955523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.058054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.058085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.058096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.158476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.158515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.158526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.258419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.258456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.258468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.358778Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.358808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.358819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.459108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.459132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.459140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.563547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.563588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.563602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.663794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.663838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.663853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.764566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.764606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.764619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.867524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.867575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.867590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:56.965683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:56.965716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:56.965727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.069623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.069654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.069666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.169877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.169907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.169918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.271098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.271128Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.271140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.370510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.370537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.370548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.474957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.474984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.474998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.576222Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.576250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.576261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.678604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.678631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.678643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.779671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.779695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.779706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.881906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.881932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.881944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:57.987462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:57.987491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:57.987501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.087600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.087625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.087636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.188827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.188856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.188868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.295565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.295600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.295612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.397759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.397790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.397800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.502214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.502244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.502255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.603325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.603371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.603383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.707590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.707618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.707631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.809544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.809574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.809594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:58.911858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:58.911887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:58.911898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.015043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.015072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.015082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.118211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.118242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.118255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.219583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.219615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.219627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.323567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.323593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.323605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.425641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.425679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.425694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.527554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.527581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.527592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.631646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.631672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.631683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.734696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.734733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.734747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.834924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.834972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.834987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:59.867943Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:59.935503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:59.935545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:59.935562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.035964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.036000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.036014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.137404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.137442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.137478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.238483Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.238516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.238529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.340407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.340441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.340455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.444993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.445033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.445047Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.543825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.543854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.543867Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.646963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.646999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.647010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.747576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.747609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.747621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.850968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.851000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.851013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:00.952950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:00.952982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:00.952995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.053954Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.053990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.054010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.155867Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.155900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.155912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.258534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.258563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.258574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.359107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.359140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.359153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.459314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.459365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.459378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.561381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.561409Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.561420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.661598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.661645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.661658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.764314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.764349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.764360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.866843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.866881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.866894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:01.969382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:01.969429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:01.969444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.070226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.070270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.070285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.172394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.172430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.172443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.272351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.272383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.272405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.374223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.374253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.374266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.475007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.475038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.475051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.578589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.578622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.578634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.679064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.679095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.679108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.783792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.783822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.783835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.884201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.884231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.884243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:02.984543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:02.984571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:02.984583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.085201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.085231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.085243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.187908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.187950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.187964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.288215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.288241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.288253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.389565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.389597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.389608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.489932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.489962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.489973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.599467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.599500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.599512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.702078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.702108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.702118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.813100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.813126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.813137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:03.912015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:03.912045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:03.912057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.014859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.014888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.014900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.119470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.119511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.119523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.219480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.219515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.219530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.327451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.327485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.327496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.427295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.427325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.427338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.531271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.531308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.531322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.632034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.632072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.632087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.732632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.732671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.732683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.835575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.835615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.835631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:04.871689Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:04.939516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:04.939554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:04.939566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.040208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.040243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.040255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.141129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.141156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.141169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.242680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.242707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.242721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.342826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.342853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.342877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.443723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.443751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.443762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.544044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.544072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.544085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.647478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.647514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.647526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.747456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.747488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.747502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.848147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.848170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.848179Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:05.948012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:05.948040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:05.948052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.051065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.051092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.051104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.151289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.151321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.151333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.258102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.258147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.258161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.362075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.362119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.362131Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.463056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.463098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.463112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.567314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.567361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.567374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.667901Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.667927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.667950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.772054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.772085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.772096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.875733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.875764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.875776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:06.979638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:06.979669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:06.979680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.079569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.079593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.079603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.293169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.293198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.293209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.398857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.398884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.398897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.499215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.499250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.499264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.598269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.598297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.598309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.699658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.699685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.699696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.801524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.801566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.801578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:07.901699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:07.901730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:07.901741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.003027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.003064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.003077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.103609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.103647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.103662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.205383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.205421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.205455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.307521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.307557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.307573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.409634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.409673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.409692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.511479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.511515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.511529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.612239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.612274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.612286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.712509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.712545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.712560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.815722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.815755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.815768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:08.919701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:08.919741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:08.919755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.023482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.023518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.023531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.123485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.123524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.123538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.223611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.223649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.223662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.323602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.323645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.323660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.427498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.427538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.427552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.528676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.528709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.528720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.629727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.629757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.629770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.731751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.731785Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.731799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.807474Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:54:09.807601Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-15T10:54:09.808698Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:54:09.809775Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-15T10:54:09.810441Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:54:09.811978Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-15T10:54:09.835497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.835533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.835547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:09.871780Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:09.935551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:09.935584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:09.935597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.035654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.035690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.035714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.139480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.139516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.139533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.241253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.241289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.241303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.346204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.346237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.346251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.447562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.447598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.447610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.547788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.547817Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.547830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.651470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.651503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.651516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.753519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.753561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.753589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.854475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.854510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.854522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:10.954857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:10.954886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:10.954899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.055398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.055424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.055435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.167044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.167086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.167100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.266151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.266179Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.266189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.366874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.366914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.366929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.467151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.467188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.467201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:54:11.571611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.571650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.571664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.583948Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was dc1) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:18252" location: "dc1" status: UNAVAILABLE weight: 500 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:18252" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:18252" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-15T10:54:11.584941Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:54:11.585052Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-15T10:54:11.587891Z :INFO: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-15T10:54:11.587940Z :INFO: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write session will now close
2025-10-15T10:54:11.588015Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write session: aborting
2025-10-15T10:54:11.588708Z :INFO: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-15T10:54:11.588758Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|40d96975-f299e27a-641f2665-45d2dd9d_0]  MessageGroupId [src_id] Write session: destroy
2025-10-15T10:54:11.590894Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|40d96975-f299e27a-641f2665-45d2dd9d_0 grpc read done: success: 0 data: 
2025-10-15T10:54:11.590931Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|40d96975-f299e27a-641f2665-45d2dd9d_0 grpc read failed
2025-10-15T10:54:11.590974Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|40d96975-f299e27a-641f2665-45d2dd9d_0 grpc closed
2025-10-15T10:54:11.590993Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|40d96975-f299e27a-641f2665-45d2dd9d_0 is DEAD
2025-10-15T10:54:11.591958Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-15T10:54:11.592058Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:11.592335Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-15T10:54:11.593904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561399969864114840:2487] destroyed
2025-10-15T10:54:11.593962Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:54:11.592053Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:54:11.592208Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:54:11.592223Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-15T10:54:11.593995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.594010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.594022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.594856Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:54:11.594994Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56484
2025-10-15T10:54:11.595008Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="topic server" ip=ipv6:[::1]:56484 proto=topic  topic=test-topic durationSec=0
2025-10-15T10:54:11.595020Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:54:11.596914Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-15T10:54:11.597051Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:54:11.597069Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:54:11.597081Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:54:11.597099Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561400098713135087:2721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:54:11.601455Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561400098713135087:2721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:54:11.635832Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400098713135087:2721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:11.661235Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400098713135087:2721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:54:11.661288Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561400098713135087:2721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:54:11.661310Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400098713135087:2721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:11.661349Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:54:11.664005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400098713135116:2721], now have 1 active actors on pipe
2025-10-15T10:54:11.664203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:54:11.667600Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.667650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.667737Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f9f074f-784c2e6-accee046-f21963bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:54:11.667766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.667783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.667796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:11.667847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.667894Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:54:11.667944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:11.669181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.669205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.669216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.669280Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:11.669302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:11.669373Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:54:11.670023Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 1 sessionId: src_id|9f9f074f-784c2e6-accee046-f21963bb_0
2025-10-15T10:54:11.673355Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:54:11.673429Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525651673 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:54:11.673600Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 1 session_id: "src_id|9f9f074f-784c2e6-accee046-f21963bb_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-15T10:54:11.769469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.769515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.769539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.871135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.871168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.871180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:11.974903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:11.974943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:11.974956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.075114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.075148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.075162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.178574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.178611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.178624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.279701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.279731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.279742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.383539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.383571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.383582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.483653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.483682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.483694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.587693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.587719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.587729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.669040Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400098713135087:2721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:54:12.689089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.689111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.689120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.703819Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400098713135087:2721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-15T10:54:12.703846Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400098713135087:2721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:54:12.789512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.789537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.789549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.895197Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.895224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.895236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:12.991652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:12.991682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:12.991695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.095649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.095675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.095688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.202762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.202789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.202800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.303694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.303722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.303734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.407563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.407592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.407605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.511567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.511594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.511606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.613190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.613219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.613233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.715539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.715566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.715579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.819587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.819614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.819626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:13.923568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:13.923602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:13.923614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.026466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.026499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.026512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.127082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.127130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.127141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.229528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.229557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.229566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.330003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.330039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.330052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.432677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.432707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.432719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.535609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.535641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.535654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.635653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.635689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.635703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.739628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.739669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.739683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.841482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.841516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.841545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:14.876203Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:14.941413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:14.941448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:14.941465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.044715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.044756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.044772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.146021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.146057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.146068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.250260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.250298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.250314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.355624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.355661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.355673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.453364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.453403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.453418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.554423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.554461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.554476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.654829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.654857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.654872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.755683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.755714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.755728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.859176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.859210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.859226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:15.960957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:15.960997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:15.961012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.063550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.063589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.063603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.165500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.165534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.165564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.267641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.267677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.267689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.367934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.367968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.367982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.471475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.471510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.471523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.575614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.575657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.575671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.679569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.679609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.679624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.780097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.780136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.780149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.881618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.881666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.881680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:16.981622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:16.981657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:16.981670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.082462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.082489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.082499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.185646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.185683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.185697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.288687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.288722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.288734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.391742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.391768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.391775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.492611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.492642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.492655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.595588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.595618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.595630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.699532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.699563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.699575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.800834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.800879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.800890Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:17.903871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:17.903911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:17.903924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.004101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.004136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.004149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.105208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.105243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.105269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.208721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.208763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.208776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.312186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.312220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.312233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.412209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.412254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.412268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.516236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.516271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.516285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.620015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.620057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.620073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.720523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.720560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.720578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.822463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.822497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.822510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:18.927124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:18.927158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:18.927172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.028821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.028857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.028871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.130676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.130709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.130722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.234196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.234231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.234246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.334690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.334723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.334736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.434739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.434768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.434781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.535098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.535131Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.535144Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.639466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.639505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.639519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.739836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.739879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.739894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.840283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.840318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.840331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:19.874061Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:19.947067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:19.947099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:19.947115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.050074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.050118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.050135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.150417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.150452Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.150466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.251671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.251703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.251716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.355288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.355325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.355342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.455944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.455977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.455992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.556023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.556054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.556067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.661019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.661050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.661064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.762984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.763014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.763027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.864010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.864040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.864051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:20.968671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:20.968700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:20.968714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.071795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.071824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.071838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.175628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.175663Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.175678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.274647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.274680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.274693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.379625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.379669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.379685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.480093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.480129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.480144Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.583573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.583610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.583625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.683422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.683464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.683480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.783760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.783807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.783822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.885865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.885905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.885920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:21.986085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:21.986121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:21.986134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.090210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.090241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.090253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.197404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.197435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.197447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.303787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.303819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.303830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.406153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.406193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.406205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.512119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.512153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.512164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.613394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.613426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.613436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.718190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.718214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.718225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.819480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.819515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.819528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:22.922488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:22.922524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:22.922539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.028135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.028172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.028185Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.128886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.128916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.128931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.230365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.230398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.230414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.332552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.332587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.332601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.432029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.432064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.432078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.532219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.532259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.532273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.635729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.635767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.635787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.739529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.739562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.739575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.846967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.846994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.847005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:23.951384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:23.951410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:23.951421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.051405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.051432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.051442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.151871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.151898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.151910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.255654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.255682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.255695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.359548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.359599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.359614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.464062Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.464092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.464103Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.571919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.571950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.571962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.674706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.674733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.674743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.775924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.775957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.775971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.874285Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:24.874338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.874354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.874365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:24.977094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:24.977125Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:24.977139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.079683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.079717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.079729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.183452Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.183485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.183497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.291587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.291620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.291630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.391866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.391893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.391905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.495748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.495774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.495784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.599667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.599691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.599701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.707461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.707494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.707505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.807497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.807523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.807533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:25.907835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:25.907863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:25.907875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.011236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.011277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.011289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.111569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.111600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.111613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.213565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.213596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.213604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.315005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.315038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.315051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.415241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.415285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.415298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.522605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.522651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.522665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.625608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.625646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.625661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.729271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.729309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.729325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.834732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.834772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.834786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:26.939495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:26.939535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:26.939548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.039517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.039552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.039564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.140218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.140253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.140265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.322724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.322752Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.322764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.423920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.423958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.423970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.524607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.524642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.524655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.628065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.628100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.628113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.734705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.734734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.734746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.835907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.835942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.835958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:27.937067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:27.937102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:27.937116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.043457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.043497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.043513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.143675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.143712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.143725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.244194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.244228Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.244243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.346001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.346043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.346058Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.446846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.446882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.446895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.551597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.551637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.551653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.653098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.653132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.653146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.755696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.755728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.755741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.856689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.856722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.856735Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:28.959117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:28.959148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:28.959160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.059600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.059635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.059646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.160715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.160748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.160769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.261911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.261955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.261972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.362567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.362604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.362619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.462688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.462725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.462738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.567466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.567500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.567511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.666557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.666592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.666608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.770951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.770987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.771001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.878179Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.878215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.878230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:29.878497Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:29.979020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:29.979053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:29.979066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.087685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.087718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.087730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.188517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.188547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.188560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.290585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.290623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.290640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.391826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.391875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.391889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.495722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.495768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.495782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.596016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.596065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.596079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.700330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.700372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.700387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.797955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.797995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.798008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.898247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.898274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.898284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:30.998716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:30.998748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:30.998759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.099430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.099466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.099478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.199833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.199865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.199877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.300288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.300331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.300342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.400641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.400670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.400684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.503310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.503356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.503368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.604245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.604273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.604285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.705409Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.705438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.705457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.808252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.808284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.808296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:31.907249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:31.907279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:31.907290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.043627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.043653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.043664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.150893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.150922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.150934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.255562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.255594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.255606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.359835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.359880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.359894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.459628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.459664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.459677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.559703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.559740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.559754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.663608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.663645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.663660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.762000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.762045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.762060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.864476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.864514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.864527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:32.964679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:32.964710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:32.964728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.067599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.067638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.067652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.166922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.166950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.166962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.267538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.267573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.267587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.367708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.367737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.367750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.469608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.469637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.469651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.573880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.573912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.573924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.673833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.673876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.673891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.776784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.776816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.776828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.877846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.877874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.877887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:33.983435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:33.983466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:33.983478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.087945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.087972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.087982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.195479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.195507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.195520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.299153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.299178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.299191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.399386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.399419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.399431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.501637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.501668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.501679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.604048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.604081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.604094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.707515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.707543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.707556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.811764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.811794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.811805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:34.883957Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:34.913532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:34.913561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:34.913572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.015707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.015734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.015748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.115587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.115613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.115624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.217313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.217351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.217364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.320960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.320992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.321004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.419939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.419964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.419976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.527284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.527313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.527326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.627533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.627565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.627579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.729426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.729454Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.729466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.833193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.833219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.833230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:35.935547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:35.935572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:35.935584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.039614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.039642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.039654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.142770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.142804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.142818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.247626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.247654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.247665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.351541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.351576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.351589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.459468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.459501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.459512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.563456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.563488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.563502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.667481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.667510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.667523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.768789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.768829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.768845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.871494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.871530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.871543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:36.972074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:36.972105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:36.972115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.074749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.074776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.074785Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.175044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.175078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.175092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.279460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.279496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.279510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.379715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.379750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.379767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.480942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.480973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.480985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.581502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.581544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.581556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.683561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.683594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.683608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.788339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.788368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.788381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.890451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.890490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.890503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:37.993489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:37.993522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:37.993535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.095597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.095630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.095644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.198047Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.198086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.198101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.300860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.300903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.300917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.402696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.402733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.402748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.503910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.503944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.503958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.606857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.606897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.606912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.709756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.709800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.709815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.811655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.811696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.811712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:38.911736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:38.911773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:38.911788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.015031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.015064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.015079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.119462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.119498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.119511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.219849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.219908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.219925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.327582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.327628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.327640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.430172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.430202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.430214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.533916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.533948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.533960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.635309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.635338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.635368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.735555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.735584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.735597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.807680Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:54:39.807750Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-15T10:54:39.814755Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-15T10:54:39.814961Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:54:39.811709Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:54:39.839456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.839489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.839503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:39.884086Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:39.936106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:39.936144Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:39.936156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.036461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.036493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.036506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.136967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.136996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.137008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.243515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.243558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.243573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.347482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.347522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.347538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.451506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.451546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.451560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.555480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.555519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.555533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.652957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.652994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.653006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.759681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.759708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.759720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.859994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.860024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.860045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:40.960838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:40.960871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:40.960883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.063518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.063552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.063563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.167458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.167491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.167502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.269188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.269215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.269225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.373949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.373992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.374004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.475831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.475872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.475885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.539920Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-10-15T10:54:41.540656Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:54:41.540701Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
>>> Ready to answer: ok
2025-10-15T10:54:41.551886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:41.551942Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:41.552020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:54:41.549857Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|9f9f074f-784c2e6-accee046-f21963bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:54:41.550210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:54:41.553342Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:41.555628Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:54:41.555675Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:54:41.555737Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:54:41.555778Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:54:41.555829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.555856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.555866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:54:41.555985Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T10:54:41.556803Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 172 count 1 nextOffset 2 batches 1
2025-10-15T10:54:41.556846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.557347Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 160 WTime 1760525681555
2025-10-15T10:54:41.557514Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:54:41.557665Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 160
2025-10-15T10:54:41.564295Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 160 actorID [4:7561399959747225836:2382]
2025-10-15T10:54:41.564370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:54:41.564421Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:54:41.564450Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:54:41.564483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-15T10:54:41.564648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.564661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.564672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.564700Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:41.564734Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 320 CachedBlobs 2
2025-10-15T10:54:41.564758Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-15T10:54:41.564933Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-15T10:54:41.565611Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:54:41.568104Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:54:41.568253Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 8000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-15T10:54:41.568281Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-15T10:54:41.568306Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-15T10:54:41.576118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.576151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.576165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.683502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.683539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.683553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.782360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.782397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.782411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.891978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.892018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.892032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:41.994842Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:41.994884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:41.994900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.095495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.095532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.095546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.198465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.198493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.198504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.299683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.299717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.299731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.399897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.399929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.399952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.503885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.503918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.503932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.604294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.604337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.604362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.708030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.708063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.708076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.807425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.807456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.807469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:42.908198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:42.908235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:42.908249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.008597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.008634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.008648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.111548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.111585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.111599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.216184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.216213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.216226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.314908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.314933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.314940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.419570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.419613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.419627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.519077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.519113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.519127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.623026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.623063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.623075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.725934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.725982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.725998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.827532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.827570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.827583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:43.935105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:43.935142Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:43.935157Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.039543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.039587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.039601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.139880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.139915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.139930Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.241477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.241509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.241527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.342967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.343003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.343014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.443259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.443293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.443307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.543617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.543645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.543657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.644426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.644456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.644468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.744815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.744843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.744855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.848029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.848061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.848073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:44.891714Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:44.948285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:44.948316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:44.948329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.048426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.048456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.048469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.155968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.156000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.156012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.258580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.258612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.258624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.359557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.359588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.359610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.461083Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.461113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.461125Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.561589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.561637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.561652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.662000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.662039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.662053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.762170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.762201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.762213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.862540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.862578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.862590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:45.963074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:45.963103Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:45.963115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.066565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.066603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.066617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.166143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.166177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.166189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.266548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.266583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.266596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.367950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.367987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.368001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.472322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.472355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.472371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.575491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.575534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.575548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.675620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.675658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.675672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.779481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.779521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.779534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.879558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.879595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.879610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:46.983545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:46.983586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:46.983600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.085386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.085423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.085438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.187338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.187389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.187402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.287516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.287546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.287569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.462873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.468244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.468278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.563546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.563582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.563596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.667507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.667544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.667559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.768588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.768641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.768657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.871487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.871528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.871544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:47.969389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:47.969430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:47.969444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.077948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.077981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.077995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.181288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.181322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.181336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.283905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.283934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.283946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.387533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.387571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.387584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.484890Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.484928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.484943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.588024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.588058Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.588072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.691167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.691203Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.691217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.791550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.791583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.791597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.895796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.895832Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.895844Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:48.995648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:48.995686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:48.995698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.098733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.098768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.098781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.199214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.199246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.199259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.300660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.300693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.300705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.400513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.400552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.400567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.504399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.504436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.504449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.607719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.607761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.607774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.710119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.710154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.710167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.810934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.810969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.810983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:49.891761Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:49.912131Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:49.912166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:49.912180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.012890Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.012921Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.012933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.113152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.113198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.113210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.214375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.214418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.214432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.316052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.316086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.316098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.421562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.421596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.421606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.524925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.524962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.524972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.627745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.627780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.627793Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.728069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.728105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.728117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.828636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.828673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.828686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:50.929318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:50.929360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:50.929373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.035452Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.035485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.035498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.131973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.132014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.132029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.235756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.235790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.235804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.335804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.335838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.335850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.436120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.436158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.436169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.536623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.536658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.536670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.641299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.641335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.641348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.743708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.743758Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.743771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.847542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.847578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.847591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:51.951444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:51.951480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:51.951493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.050621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.050668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.050683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.150875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.150912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.150926Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.252071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.252112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.252124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.355464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.355504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.355518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.455580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.455613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.455627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.559496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.559537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.559550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.660130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.660161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.660172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.763543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.763580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.763593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.863638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.863674Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.863687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:52.964129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:52.964162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:52.964174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.064292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.064330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.064343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.164631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.164679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.164693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.265016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.265048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.265057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.365448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.365498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.365513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.465723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.465766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.465780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.566095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.566137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.566166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.676358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.676390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.676404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.776528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.776564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.776579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.876990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.877021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.877034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:53.977206Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:53.977236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:53.977248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.079660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.079691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.079702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.183217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.183250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.183261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.288363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.288410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.288422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.391710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.391744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.391756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.489261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.489288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.489300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.589544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.589589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.589604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.694073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.694121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.694134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.794297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.794326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.794337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.891840Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:54.894699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.894737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.894748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:54.999569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:54.999604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:54.999616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.099548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.099578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.099590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.201364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.201394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.201404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.307454Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.307487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.307499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.409381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.409412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.409424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.512334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.512362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.512372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.612496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.612526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.612537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.715657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.715684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.715695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.815813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.815846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.815858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:55.917924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:55.917958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:55.917970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.019460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.019496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.019507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.119646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.119685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.119699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.219725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.219757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.219769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.320136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.320180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.320196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.423558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.423599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.423612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.523975Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.524008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.524020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.626676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.626714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.626728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.726626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.726662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.726677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.831948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.831984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.831996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:56.936162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:56.936194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:56.936206Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.036540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.036571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.036582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.137319Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.137370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.137384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.239370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.239399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.239407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.343516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.343543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.343554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.447502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.447536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.447546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.551828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.551855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.551866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.654963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.654994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.655004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.755538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.755566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.755577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.855657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.855693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.855705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:57.957076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:57.957107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:57.957119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.059716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.059749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.059770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.161449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.161480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.161494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.267467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.267501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.267513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.370112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.370143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.370171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.475560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.475596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.475608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.577816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.577847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.577857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.679211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.679241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.679253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.779580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.779607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.779619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.880112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.880142Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.880153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:58.980541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:58.980573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:58.980588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.080815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.080848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.080875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.181163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.181193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.181205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.281477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.281505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.281516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.387477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.387511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.387524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.488196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.488234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.488247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.588218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.588247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.588260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.692128Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.692160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.692173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.794327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.794359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.794371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.897414Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:54:59.897471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.897485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.897497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:54:59.995263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:54:59.995300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:54:59.995311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.097293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.097327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.097343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.197494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.197527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.197541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.297843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.297877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.297902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.399254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.399301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.399316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.499685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.499715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.499728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.599953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.600002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.600015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.700281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.700324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.700337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.800653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.800699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.800711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:00.900979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:00.901019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:00.901032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.001379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.001415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.001429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.101725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.101771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.101784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.203531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.203570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.203584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.309568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.309604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.309618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.411481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.411517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.411531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.511850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.511897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.511910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.612223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.612258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.612271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.715575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.715614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.715629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.816105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.816140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.816154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:01.916770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:01.916804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:01.916817Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.019642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.019687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.019704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.120068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.120105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.120119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.220409Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.220447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.220460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.324582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.324614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.324628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.424668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.424706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.424716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.525733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.525767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.525779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.625917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.625951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.625964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.729891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.729933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.729947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.829755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.829808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.829822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:02.929959Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:02.930001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:02.930011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.030331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.030354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.030362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.131071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.131107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.131119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.231078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.231106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.231117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.331646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.331674Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.331686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.432122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.432153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.432164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.533227Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.533262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.533275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.633984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.634010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.634021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.734967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.734999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.735011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.834746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.834781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.834792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:03.935107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:03.935139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:03.935162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.035526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.035556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.035568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.142020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.142060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.142074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.241821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.241850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.241863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.343746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.343781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.343792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.446165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.446202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.446217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.547472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.547512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.547527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.648106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.648148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.648164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.748651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.748683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.748697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.849023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.849057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.849071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:04.895329Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:04.949387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:04.949438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:04.949452Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.049659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.049692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.049700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.150208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.150242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.150267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.250394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.250435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.250451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.350772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.350810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.350834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.451129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.451200Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.451225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.555470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.555506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.555520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.655769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.655797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.655809Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.756378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.756412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.756424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.858141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.858177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.858189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:05.958105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:05.958133Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:05.958146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.058323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.058355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.058367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.159550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.159578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.159589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.263602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.263633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.263644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.363008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.363047Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.363061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.463387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.463418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.463430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.563740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.563775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.563789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.665132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.665167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.665182Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.764957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.764992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.765006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.865435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.865473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.865496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:06.969788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:06.969826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:06.969840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.071504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.071538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.071552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.171462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.171506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.171520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.271780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.271823Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.271837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.374243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.374281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.374306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.474546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.474582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.474596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.575895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.575930Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.575945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.679575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.679609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.679621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.779614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.779648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.779662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.880077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.880114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.880126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:07.983504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:07.983528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:07.983536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.087805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.087833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.087847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.187776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.187806Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.187829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.288592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.288619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.288632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.390988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.391024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.391038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.491979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.492005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.492016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.592538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.592566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.592578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.694900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.694932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.694943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.795275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.795303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.795313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.895482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.895518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.895530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:08.995790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:08.995824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:08.995839Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.096097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.096138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.096152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.197121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.197158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.197173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.298244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.298278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.298292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.401777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.401815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.401829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.502120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.502158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.502171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.603020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.603057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.603071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.704040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.704071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.704083Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.804829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.804863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.804876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:09.811593Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:55:09.811655Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-15T10:55:09.814643Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:55:09.815951Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 3 DataSize: 0 UsedReserveSize: 0
2025-10-15T10:55:09.816107Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:55:09.895366Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:09.905124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:09.905151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:09.905164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.005456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.005491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.005505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.105762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.105792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.105805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.207487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.207524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.207538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.310945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.310980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.310992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.411663Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.411699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.411712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.513905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.513939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.513954Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.614240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.614278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.614293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.714557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.714599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.714613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.814868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.814915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.814930Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:10.915456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:10.915494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:10.915506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.015850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.015887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.015902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.115931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.115958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.115969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.216525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.216560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.216572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.316597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.316636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.316647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.419943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.419971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.419982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.519920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.519946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.519957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-15T10:55:11.611876Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was dc2) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:18252" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:18252" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:18252" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-15T10:55:11.612154Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:55:11.612212Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-15T10:55:11.613917Z :INFO: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-15T10:55:11.613948Z :INFO: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write session will now close
2025-10-15T10:55:11.613998Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write session: aborting
2025-10-15T10:55:11.614340Z :INFO: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-15T10:55:11.614383Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|9f9f074f-784c2e6-accee046-f21963bb_0]  MessageGroupId [src_id] Write session: destroy
2025-10-15T10:55:11.614822Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-15T10:55:11.614901Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:11.615509Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-15T10:55:11.616343Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|9f9f074f-784c2e6-accee046-f21963bb_0 grpc read done: success: 0 data: 
2025-10-15T10:55:11.616378Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: src_id|9f9f074f-784c2e6-accee046-f21963bb_0 grpc read failed
2025-10-15T10:55:11.616745Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 3 sessionId: src_id|9f9f074f-784c2e6-accee046-f21963bb_0
2025-10-15T10:55:11.616777Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|9f9f074f-784c2e6-accee046-f21963bb_0 is DEAD
2025-10-15T10:55:11.617069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:55:11.617202Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:55:11.617224Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-15T10:55:11.619724Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561400098713135116:2721] destroyed
2025-10-15T10:55:11.619770Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:55:11.619799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.619809Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.619821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.623560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.623596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.623608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.626089Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:55:11.626229Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56484
2025-10-15T10:55:11.626244Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="topic server" ip=ipv6:[::1]:56484 proto=topic  topic=test-topic durationSec=0
2025-10-15T10:55:11.626254Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:55:11.627702Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-15T10:55:11.627797Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:55:11.627807Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:55:11.627816Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:55:11.627832Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7561400356411175555:3181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:55:11.630283Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7561400356411175555:3181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:55:11.649171Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400356411175555:3181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:11.672744Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400356411175555:3181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:55:11.672789Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7561400356411175555:3181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T10:55:11.672807Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400356411175555:3181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:11.672837Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:55:11.677819Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7561400356411175592:3181], now have 1 active actors on pipe
2025-10-15T10:55:11.679725Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-15T10:55:11.687171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:11.687212Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:11.687280Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e6f729d-70a9ef1b-99927433-6c302296_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:55:11.687304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.687318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.687329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:11.687381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.687421Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:55:11.687470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:11.689495Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:11.689529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:11.689593Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:55:11.690013Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 2 sessionId: src_id|1e6f729d-70a9ef1b-99927433-6c302296_0
2025-10-15T10:55:11.690779Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:55:11.690831Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525711690 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:55:11.690922Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 2 session_id: "src_id|1e6f729d-70a9ef1b-99927433-6c302296_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-15T10:55:11.721698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.721726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.721737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.821910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.821938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.821950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:11.923586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:11.923618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:11.923631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.023623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.023651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.023663Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.124014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.124048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.124060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.225431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.225459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.225471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.325981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.326009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.326021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.431665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.431709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.431723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.536506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.536562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.536585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.638684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.638720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.638731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.690771Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7561400356411175555:3181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:55:12.707144Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7561400356411175555:3181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-15T10:55:12.707173Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7561400356411175555:3181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:55:12.738465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.738502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.738514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.840336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.840372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.840386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:12.943576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:12.943610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:12.943623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.047586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.047622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.047634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.151498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.151532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.151544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.251462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.251500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.251513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.351991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.352026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.352038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.452104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.452132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.452141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.555181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.555221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.555236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.659985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.660022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.660031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.761014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.761193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.761207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.861303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.861339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.861363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:13.961628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:13.961666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:13.961681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.061965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.062015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.062031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.162737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.162784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.162798Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.262617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.262657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.262670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.363001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.363041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.363054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.467538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.467580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.467590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.565191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.565225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.565240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.667737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.667765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.667777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.768008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.768035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.768046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.872598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.872632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.872644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:14.895726Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:14.972798Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:14.972834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:14.972855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.073223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.073263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.073278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.173607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.173644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.173656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.273850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.273900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.273914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.374431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.374462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.374475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.475640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.475675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.475687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.576233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.576268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.576280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.676743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.676775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.676786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.779451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.779488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.779501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.887453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.887485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.887496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:15.988098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:15.988126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:15.988138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.088615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.088647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.088659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.191129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.191169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.191183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.291803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.292063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.292082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.392061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.392097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.392109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.495457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.495480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.495488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.595843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.595876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.595888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.696651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.696686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.696699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.797072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.797109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.797121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.899701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.899737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.899749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:16.999783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:16.999816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:16.999828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.100166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.100212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.100225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.200510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.200552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.200564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.300761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.300789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.300798Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.401250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.401289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.401300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.501523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.501551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.501565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.601872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.601903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.601914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.702540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.702587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.702600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.803143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.803189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.803202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:17.903551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:17.903576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:17.903587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.006001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.006029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.006040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.106147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.106183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.106195Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.206719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.206760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.206772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.306928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.306972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.306984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.407290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.407331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.407344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.508185Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.508218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.508232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.609135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.609163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.609174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.709347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.709379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.709393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.809788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.809829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.809840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:18.911745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:18.911777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:18.911788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.013003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.013034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.013045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.112840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.112871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.112893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.213767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.213805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.213837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.314941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.314986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.315001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.415492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.415526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.415541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.515999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.516032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.516057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.616134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.616170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.616184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.716512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.716556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.716571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.816847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.816880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.816894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:19.895999Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:19.917181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:19.917210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:19.917221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.017565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.017596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.017609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.123896Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.123926Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.123939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.231466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.231499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.231511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.335640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.335665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.335676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.439448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.439478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.439489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.543455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.543485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.543495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.646178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.646205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.646215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.747622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.747653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.747665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.851481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.851511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.851524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:20.952506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:20.952544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:20.952555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.052957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.052984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.052995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.153099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.153124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.153136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.254187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.254226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.254238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.354356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.354388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.354401Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.454697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.454739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.454751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.555080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.555126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.555143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.656154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.656182Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.656194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.756255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.756293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.756307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.857824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.857864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.857877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:21.957977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:21.958011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:21.958024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.059934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.059967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.059978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.160196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.160234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.160246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.260641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.260688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.260700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.360895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.360944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.360958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.461292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.461329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.461342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.563388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.563429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.563443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.664020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.664065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.664078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.764460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.764504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.764520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.864772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.864807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.864822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:22.967603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:22.967644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:22.967659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.069171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.069216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.069228Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.169359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.169403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.169417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.269748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.269784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.269797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.370075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.370113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.370130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.470835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.470894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.470911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.571329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.571378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.571392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.671638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.671676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.671691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.772111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.772143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.772155Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.872415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.872451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.872465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:23.975411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:23.975449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:23.975462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.079658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.079697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.079711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.179606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.179664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.179680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.280181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.280214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.280227Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.380889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.380927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.380941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.487627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.487669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.487685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.584087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.584120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.584134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.684362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.684392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.684414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.785889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.785922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.785936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.886268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.886311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.886327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:24.896027Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:24.986486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:24.986526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:24.986541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.087390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.087427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.087441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.187836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.187873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.187887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.290630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.290656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.290665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.390497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.390531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.390544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.490893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.490959Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.490974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.591151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.591184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.591196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.691611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.691647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.691658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.791863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.791895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.791908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.892221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.892280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.892295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:25.992571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:25.992604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:25.992619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.092939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.092977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.092992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.193316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.193366Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.193379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.295617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.295651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.295666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.399874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.399912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.399936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.501684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.501717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.501731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.601872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.601909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.601922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.702270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.702310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.702325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.802543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.802570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.802593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:26.902896Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:26.902924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:26.902935Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.006721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.006750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.006762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.104123Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.104161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.104182Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.204478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.204507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.204520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.304835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.304868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.304881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.405606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.405641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.405654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.506019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.506054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.506067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.606382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.606408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.606421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.706761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.706792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.706805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.807051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.807085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.807096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:27.907474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:27.907505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:27.907517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.007783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.007814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.007826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.108234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.108271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.108283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.211520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.211549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.211560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.312076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.312117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.312131Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.412291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.412333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.412348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.512623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.512659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.512671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.612981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.613021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.613035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.713866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.713909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.713923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.814230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.814268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.814283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:28.914556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:28.914593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:28.914616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.014916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.014960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.014974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.115379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.115423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.115436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.219451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.219488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.219500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.319127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.319182Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.319195Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.419423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.419468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.419480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.520022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.520055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.520069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.620575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.620612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.620626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.720954Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.720988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.721000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.823617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.823648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.823660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:29.896222Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:29.923691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:29.923729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:29.923740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.024056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.024085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.024111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.126768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.126800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.126812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.233471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.233505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.233518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.333251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.333278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.333291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.433675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.433713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.433729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.533964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.534001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.534024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.634371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.634406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.634419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.734704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.734740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.734754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.835066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.835099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.835112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:30.935406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:30.935445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:30.935461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.037045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.037099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.037113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.137129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.137173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.137187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.237532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.237599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.237621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.338336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.338381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.338394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.439234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.439267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.439279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.539536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.539570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.539582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.639864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.639896Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.639917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.740357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.740397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.740412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.840612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.840652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.840664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:31.940929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:31.940970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:31.940982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.041299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.041335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.041347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.143774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.143818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.143830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.244081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.244112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.244123Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.344408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.344439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.344450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.444791Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.444820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.444832Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.545116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.545153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.545164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.645491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.645523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.645546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.745813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.745846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.745866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.846199Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.846234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.846246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:32.946548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:32.946579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:32.946591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.047042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.047076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.047088Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.147263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.147297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.147310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.247617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.247652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.247664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.347971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.348006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.348020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.448364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.448396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.448408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.548637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.548673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.548686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.649017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.649046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.649057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.749351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.749385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.749396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.849670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.849704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.849715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:33.952205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:33.952232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:33.952243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.055513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.055552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.055564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.159598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.159628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.159639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.263660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.263700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.263713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.365410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.365442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.365453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.465676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.465721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.465734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.566055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.566098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.566118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.666385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.666435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.666450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.766730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.766779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.766795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.867110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.867149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.867173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:34.896417Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:34.967477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:34.967513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:34.967528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.067766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.067800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.067813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.168137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.168170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.168183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.268574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.268622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.268637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.376504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.376546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.376559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.476851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.476886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.476908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.577204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.577236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.577249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.677505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.677535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.677547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.782203Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.782233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.782245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.880835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.880871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.880884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:35.981204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:35.981246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:35.981261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.081553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.081605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.081620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.181854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.181893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.181908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.282244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.282272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.282283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.382557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.382598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.382611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.482946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.482991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.483007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.583540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.583578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.583590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.684167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.684211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.684224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.784516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.784569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.784591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.884866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.884904Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.884917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:36.985198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:36.985231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:36.985253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.085515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.085548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.085558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.185905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.185933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.185945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.286295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.286324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.286335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.386635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.386673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.386686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.487520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.487557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.487577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.587801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.587836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.587851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.688198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.688249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.688266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.790583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.790622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.790637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.891000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.891038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.891054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:37.991472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:37.991515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:37.991529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.091576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.091603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.091612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.191992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.192031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.192044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.292309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.292346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.292358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.392694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.392724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.392734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.495640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.495677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.495692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.595949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.595978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.595990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.696329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.696356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.696367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.796681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.796715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.796725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.897024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.897065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.897077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:38.998212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:38.998239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:38.998251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.098346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.098379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.098392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.200427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.200475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.200488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.300038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.300070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.300082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.400273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.400305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.400318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.503456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.503484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.503494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.604063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.604091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.604103Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.704441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.704472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.704485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.806893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.806922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.806934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:39.813859Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-15T10:55:39.813939Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-15T10:55:39.814551Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-15T10:55:39.815511Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 4 DataSize: 0 UsedReserveSize: 0
2025-10-15T10:55:39.815679Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-15T10:55:39.899645Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:39.907181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:39.907211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:39.907224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.007617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.007684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.007699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.108115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.108153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.108165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.208253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.208283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.208294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.308559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.308603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.308616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.408960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.408993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.409017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.509263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.509288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.509308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.609616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.609647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.609660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.709982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.710012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.710024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.810335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.810367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.810378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:40.910694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:40.910723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:40.910734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.011053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.011079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.011090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.111386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.111419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.111430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.211687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.211731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.211742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.312044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.312085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.312096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.412473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.412506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.412519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.512794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.512825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.512837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.613107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.613137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.613148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.627531Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-10-15T10:55:41.628045Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:55:41.628089Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 3
>>> Ready to answer: ok
2025-10-15T10:55:41.631426Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|1e6f729d-70a9ef1b-99927433-6c302296_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:55:41.631649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:55:41.632429Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:41.632466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:41.632536Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:55:41.633066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:41.633564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:55:41.633594Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:55:41.633649Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-15T10:55:41.633681Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:55:41.633719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.633741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.633750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:55:41.633833Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-15T10:55:41.635472Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 172 count 1 nextOffset 3 batches 1
2025-10-15T10:55:41.635514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.635894Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 160 WTime 1760525741631
2025-10-15T10:55:41.636008Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:55:41.636096Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 160
2025-10-15T10:55:41.639660Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 160 actorID [4:7561399959747225836:2382]
2025-10-15T10:55:41.639723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:55:41.639769Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:55:41.639782Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-15T10:55:41.639796Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:55:41.639823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-15T10:55:41.639958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.639975Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.639984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.640011Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:55:41.640041Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 480 CachedBlobs 3
2025-10-15T10:55:41.640064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-15T10:55:41.640281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:55:41.640821Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:55:41.640986Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 3 written { offset: 2 } } write_statistics { persisting_time { nanos: 5000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-15T10:55:41.641015Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-15T10:55:41.641038Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-15T10:55:41.642923Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: Cancelled on the server side, Details: , InternalError: 0
2025-10-15T10:55:41.643006Z :ERROR: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Got error. Status: CLIENT_CANCELLED, Description: <main>: Error: GRpc error: (1): Cancelled on the server side 
2025-10-15T10:55:41.643054Z :ERROR: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write session will not restart after a fatal error
2025-10-15T10:55:41.643086Z :INFO: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write session will now close
2025-10-15T10:55:41.643143Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write session: aborting
2025-10-15T10:55:41.647480Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|1e6f729d-70a9ef1b-99927433-6c302296_0 grpc read done: success: 0 data: 
2025-10-15T10:55:41.647509Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: src_id|1e6f729d-70a9ef1b-99927433-6c302296_0 grpc read failed
2025-10-15T10:55:41.647533Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: src_id|1e6f729d-70a9ef1b-99927433-6c302296_0 grpc closed
2025-10-15T10:55:41.647547Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|1e6f729d-70a9ef1b-99927433-6c302296_0 is DEAD
2025-10-15T10:55:41.647898Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:55:41.648198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7561400356411175592:3181] destroyed
2025-10-15T10:55:41.648246Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:55:41.648272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.648281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.648291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.679136Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|1e6f729d-70a9ef1b-99927433-6c302296_0]  MessageGroupId [src_id] Write session: destroy
2025-10-15T10:55:41.713517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.713545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.713555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.813875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.813934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.813948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.914246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:55:41.914285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:55:41.914300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:55:41.976226Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710890, task: 1, CA Id [3:7561400485260195917:3435]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-15T10:55:42.009853Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710890, task: 1, CA Id [3:7561400485260195917:3435]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:55:42.131433Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710890, task: 1, CA Id [3:7561400485260195917:3435]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:55:42.329849Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710890, task: 1, CA Id [3:7561400485260195917:3435]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:02.226035Z :WriteSessionWriteInHandlers INFO: Random seed for debugging is 1760525582225978
2025-10-15T10:53:03.056270Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561399804636216785:2243];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:03.056317Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T10:53:03.118759Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T10:53:03.171961Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:03.231894Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7561399805420812464:2204];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:03.231968Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/s8a1/00107c/r3tmp/tmpxsVIeI/pdisk_1.dat
2025-10-15T10:53:03.297983Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T10:53:03.298267Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T10:53:03.851419Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:03.919542Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:03.969930Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:03.970013Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:03.976381Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T10:53:03.976453Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T10:53:03.995407Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:04.063720Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:04.084299Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T10:53:04.084861Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T10:53:04.085007Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:04.087746Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T10:53:04.151748Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T10:53:04.226470Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 21604, node 1
2025-10-15T10:53:04.267681Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T10:53:04.487439Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T10:53:04.560027Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/s8a1/00107c/r3tmp/yandexZg3Csp.tmp
2025-10-15T10:53:04.560054Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/s8a1/00107c/r3tmp/yandexZg3Csp.tmp
2025-10-15T10:53:04.560192Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/s8a1/00107c/r3tmp/yandexZg3Csp.tmp
2025-10-15T10:53:04.560297Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T10:53:04.636751Z INFO: TTestServer started on Port 18804 GrpcPort 21604
TClient is connected to server localhost:18804
PQClient connected to localhost:21604
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T10:53:05.474111Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T10:53:08.061889Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561399804636216785:2243];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:08.061947Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:08.229105Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7561399805420812464:2204];send_to=[0:7307199536658146131:7762515];
2025-10-15T10:53:08.229152Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T10:53:10.719321Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7561399834700988704:2326], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:10.722351Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=NTQ5NDQ0ZTktMzBkNzg2MTctM2RmZjNkYTMtOTgwODNlNGU=, ActorId: [1:7561399834700988701:2324], ActorState: ExecuteState, TraceId: 01k7kr17jafrxndk44zsdk538y, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:10.724872Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:10.740305Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7561399831190616399:2296], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T10:53:10.742337Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=ODY3ODgzMDEtNzkwMzJiM2MtYTdiOTVmZWQtM2ZjMDZkNGQ=, ActorId: [2:7561399831190616397:2295], ActorState: ExecuteState, TraceId: 01k7kr17d05zdmnjknd0tvfeg2, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T10:53:10.752155Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T10:53:10.752011Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:11.195294Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T10:53:11.449319Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:21604", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T10:53:12.072727Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k7kr19219e1q0jhj0q52n13v, Database: , SessionId: ydb://session/3?node_id=1&id=OWQ0OTViN2EtYmNkZTI2ZDAtYWU4MjI4ZGUtZmZhNDllM2U=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561399843290923715:2944] 
=== CheckClustersList. Ok
2025-10-15T10:53:17.418133Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:21604
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:17.587584Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:21604
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T10:53:17.646452Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561399864765760661:3219] connected; active server actors: 1
2025-10-15T10:53:17.646636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T10:53:17.652509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T10:53:17.664160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T10:53:17.693007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T10:53:17.707496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T10:53:17.707762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T10:53:17.707812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:17.707847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T10:53:17.709151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399864765760660:3218], now have 1 active actors on pipe
2025-10-15T10:53:17.709180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399864765760706:2445], now have 1 active actors on pipe
2025-10-15T10:53:17.709584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.710428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T10:53:17.717169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.726204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399864765760742:3276], now have 1 active actors on pipe
2025-10-15T10:53:17.736185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.747577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.748682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T10:53:17.748774Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T10:53:17.749059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T10:53:17.749375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561399865550355281:2381]
2025-10-15T10:53:17.752638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T10:53:17.752669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T10:53:17.752705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561399865550355281:2381]
2025-10-15T10:53:17.752744Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T10:53:17.754102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4355: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T10:53:17.754144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.754239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.754247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:17.754265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:17.754275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.754284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.754296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T10:53:17.754335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:17.754602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.754730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.768800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.768934Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760525597768, TxId 281474976710676
2025-10-15T10:53:17.768958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.768968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.769083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.769291Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:17.778870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:17.779136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:17.779166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.779177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.779190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.779213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:17.779532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T10:53:17.779625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T10:53:17.779886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.793846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.793945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T10:53:17.799580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T10:53:17.858880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.858909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.858923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:17.882675Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k7kr1eyec7m7acsn49wbvj73, Database: , SessionId: ydb://session/3?node_id=1&id=NDVjNzQ1YTYtYWRjNTg0MTEtZGQxMWU0NjYtNTMyZmFlMg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: 2025-10-15T10:53:17.957447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:17.957470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:17.957479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525597768
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760525597768
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:21604
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:17.964913Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-15T10:53:18.059650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.059687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.059698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.160878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.160926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.160948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.263906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.263934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.263946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.368522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.368550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.368560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:21604
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T10:53:18.469621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.469655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.469666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.477013Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T10:53:18.488969Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T10:53:18.504947Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T10:53:18.505034Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:21604
2025-10-15T10:53:18.540166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:18.540210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T10:53:18.568334Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:18.569556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T10:53:18.569709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:37952
2025-10-15T10:53:18.569730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37952 proto=v1  topic=test-topic durationSec=0
2025-10-15T10:53:18.569738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:18.570026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.570052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.570062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.572081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T10:53:18.572269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:18.572281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:18.572288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:18.572309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399869060728191:2478] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:18.574748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399869060728191:2478] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:18.671936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.671973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.671984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.774475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.774512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.774523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.856414Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-15T10:53:18.856465Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T10:53:18.876357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.876388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.876397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:18.980040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:18.980068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:18.980078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.044611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399869060728191:2478] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:19.045799Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399873355695540:2478] connected; active server actors: 1
2025-10-15T10:53:19.046023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399869060728191:2478] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T10:53:19.046052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399869060728191:2478] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:19.090744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.090766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.090775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.097870Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399873355695540:2478] disconnected; active server actors: 1
2025-10-15T10:53:19.097909Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399873355695540:2478] disconnected no session
2025-10-15T10:53:19.199706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.199730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.199738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.299668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.299697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.299708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.405413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.405446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.405458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.416957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399869060728191:2478] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:19.416991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399869060728191:2478] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:19.417008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399869060728191:2478] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:19.417032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:19.418810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:19.418559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399873355695584:2478], now have 1 active actors on pipe
2025-10-15T10:53:19.419142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.419178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.419255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|c294a7a-8e41884a-3f026aab-d37f0bea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T10:53:19.419287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.419306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.419315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:19.419370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.419403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:19.419471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:19.420411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|c294a7a-8e41884a-3f026aab-d37f0bea_0
2025-10-15T10:53:19.421301Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525599421 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:19.421439Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|c294a7a-8e41884a-3f026aab-d37f0bea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T10:53:19.421648Z :INFO: [] MessageGroupId [src] SessionId [src|c294a7a-8e41884a-3f026aab-d37f0bea_0] Write session: close. Timeout = 0 ms
2025-10-15T10:53:19.421684Z :INFO: [] MessageGroupId [src] SessionId [src|c294a7a-8e41884a-3f026aab-d37f0bea_0] Write session will now close
2025-10-15T10:53:19.421711Z :DEBUG: [] MessageGroupId [src] SessionId [src|c294a7a-8e41884a-3f026aab-d37f0bea_0] Write session: aborting
2025-10-15T10:53:19.422046Z :INFO: [] MessageGroupId [src] SessionId [src|c294a7a-8e41884a-3f026aab-d37f0bea_0] Write session: gracefully shut down, all writes complete
2025-10-15T10:53:19.422074Z :DEBUG: [] MessageGroupId [src] SessionId [src|c294a7a-8e41884a-3f026aab-d37f0bea_0] Write session: destroy
2025-10-15T10:53:19.420050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.420081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.420145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:19.427613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|c294a7a-8e41884a-3f026aab-d37f0bea_0 grpc read done: success: 0 data: 
2025-10-15T10:53:19.427633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|c294a7a-8e41884a-3f026aab-d37f0bea_0 grpc read failed
2025-10-15T10:53:19.427660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|c294a7a-8e41884a-3f026aab-d37f0bea_0 grpc closed
2025-10-15T10:53:19.427675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|c294a7a-8e41884a-3f026aab-d37f0bea_0 is DEAD
2025-10-15T10:53:19.428421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:19.430233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399873355695584:2478] destroyed
2025-10-15T10:53:19.430275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:19.430300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.430312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.430322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
=== Before CreateWriteSession
=== Inside ReadyToAcceptHandler
=== Session created
=== Inside ReadyToAcceptHandler
2025-10-15T10:53:19.493858Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-15T10:53:19.494792Z :INFO: [/Root] [] [] Start federated write session to database '' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "" DbInfos: [ { path: "/Root" endpoint: "localhost:21604" status: AVAILABLE weight: 100 } ] ControlPlaneEndpoint: localhost:21604 }
2025-10-15T10:53:19.495188Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:19.495618Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-15T10:53:19.507512Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-15T10:53:19.511491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.511521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.511531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.530714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T10:53:19.530750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-15T10:53:19.605745Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:53:19.606325Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-15T10:53:19.606907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-15T10:53:19.607064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37972
2025-10-15T10:53:19.607082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:37972 proto=topic  topic=test-topic durationSec=0
2025-10-15T10:53:19.607091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T10:53:19.607842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.607865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.607875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.608666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-15T10:53:19.608785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T10:53:19.608793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T10:53:19.608801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T10:53:19.608813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561399873355695600:2497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T10:53:19.610913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561399873355695600:2497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T10:53:19.623716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561399873355695600:2497] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T10:53:19.626165Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399873355695619:2497] connected; active server actors: 1
2025-10-15T10:53:19.626374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561399873355695600:2497] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-15T10:53:19.626392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561399873355695600:2497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T10:53:19.627232Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399873355695619:2497] disconnected; active server actors: 1
2025-10-15T10:53:19.627252Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561399873355695619:2497] disconnected no session
2025-10-15T10:53:19.652627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561399873355695600:2497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T10:53:19.652664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561399873355695600:2497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T10:53:19.652679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561399873355695600:2497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T10:53:19.652714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T10:53:19.660119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561399873355695630:2497], now have 1 active actors on pipe
2025-10-15T10:53:19.660400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T10:53:19.660752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.660799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.660868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T10:53:19.660898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.660910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.660917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:19.660962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.660996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T10:53:19.661046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:19.661785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.661805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.661857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T10:53:19.662219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0
2025-10-15T10:53:19.666076Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:19.666155Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760525599666 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T10:53:19.666272Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-15T10:53:19.667556Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-15T10:53:19.670223Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:19.670273Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-15T10:53:19.670947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:53:19.671234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:53:19.671870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.671904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.671973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T10:53:19.672354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:19.672802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.672829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.673133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 115 offset: -1
2025-10-15T10:53:19.673174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:53:19.673216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.673251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.673267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:19.673382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T10:53:19.678775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 189 count 1 nextOffset 1 batches 1
2025-10-15T10:53:19.678824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.679391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 177 WTime 1760525599676
2025-10-15T10:53:19.679555Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:19.679668Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 177
2025-10-15T10:53:19.688588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 177 actorID [2:7561399865550355262:2381]
2025-10-15T10:53:19.688645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:19.688688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 122 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:19.688720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:19.688781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-15T10:53:19.688999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T10:53:19.689020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T10:53:19.689048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.689063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.689071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.689099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:19.689135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-15T10:53:19.689243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T10:53:19.689441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 177 count 1 last offset 0, current partition end offset: 1
2025-10-15T10:53:19.689456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T10:53:19.689494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 177 accessed 0 times before, last time 2025-10-15T10:53:19.000000Z
2025-10-15T10:53:19.689515Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-15T10:53:19.689562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-15T10:53:19.689687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 157 from pos 0 cbcount 1
2025-10-15T10:53:19.689750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760525599671 queuesize 0 startOffset 0
2025-10-15T10:53:19.690893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:19.690565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 177
2025-10-15T10:53:19.690630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-15T10:53:19.695496Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:19.696120Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 11000000 } min_queue_wait_time { nanos: 5000000 } max_queue_wait_time { nanos: 5000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-15T10:53:19.696178Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-15T10:53:19.696205Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: acknoledged message 1
=== Inside AcksHandler
2025-10-15T10:53:19.699513Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
=== Inside ReadyToAcceptHandler
2025-10-15T10:53:19.700312Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-15T10:53:19.700356Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-10-15T10:53:19.701229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T10:53:19.701474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T10:53:19.702470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.702500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.702559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
=== AcksHandler has written a message, closing the session
2025-10-15T10:53:19.703181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:19.703612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T10:53:19.703633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T10:53:19.703675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 107 offset: -1
2025-10-15T10:53:19.703699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T10:53:19.703732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.703750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.703757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T10:53:19.703840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T10:53:19.704666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 181 count 1 nextOffset 2 batches 1
2025-10-15T10:53:19.704698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.705042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 169 WTime 1760525599702
2025-10-15T10:53:19.705178Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T10:53:19.705254Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 169
2025-10-15T10:53:19.709225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T10:53:19.712835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 169 actorID [2:7561399865550355262:2381]
2025-10-15T10:53:19.712884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T10:53:19.712939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 114 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T10:53:19.712971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T10:53:19.712999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-15T10:53:19.713138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.713147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.713155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.713180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T10:53:19.713212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-15T10:53:19.713412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 169
2025-10-15T10:53:19.713908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T10:53:19.714445Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-15T10:53:19.714604Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 6000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-15T10:53:19.714649Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-15T10:53:19.714680Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: acknoledged message 2
=== Inside AcksHandler
=== Inside SessionClosedHandler
2025-10-15T10:53:19.715016Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
=== SessionClosedHandler has 'written' a message
2025-10-15T10:53:19.715118Z :INFO: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-15T10:53:19.715145Z :INFO: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session will now close
2025-10-15T10:53:19.715184Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: aborting
2025-10-15T10:53:19.715584Z :WARNING: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: could not confirm all writes in time or session aborted, perform hard shutdown
2025-10-15T10:53:19.715627Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0]  MessageGroupId [src_id] Write session: destroy
2025-10-15T10:53:19.733989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0 grpc read done: success: 0 data: 
2025-10-15T10:53:19.734014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0 grpc read failed
2025-10-15T10:53:19.734046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0 grpc closed
2025-10-15T10:53:19.734063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|455f5917-18d815e7-f9ad92da-50c85e0b_0 is DEAD
2025-10-15T10:53:19.734688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T10:53:19.735871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561399873355695630:2497] destroyed
2025-10-15T10:53:19.735907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T10:53:19.735932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.735941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.735948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.811669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.811704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.811714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:19.915879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T10:53:19.915931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T10:53:19.915959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T10:53:20.045990Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399877650662945:2502]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-15T10:53:20.088227Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399877650662945:2502]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:20.214916Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399877650662945:2502]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:20.430537Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399877650662945:2502]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:20.672539Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399877650662945:2502]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:20.984251Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399877650662945:2502]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:21.387546Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399877650662945:2502]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:22.016043Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399877650662945:2502]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-15T10:53:22.016123Z node 1 :KQP_EXECUTER WARN: kqp_shards_resolver.cpp:86: [ShardsResolver] TxId: 281474976710688. Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:22.016229Z node 1 :KQP_EXECUTER WARN: kqp_executer_impl.h:248: ActorId: [1:7561399877650663009:2504] TxId: 281474976710688. Ctx: { TraceId: 01k7kr1hee8j7rx10c9zkd7vds, Database: /Root, SessionId: ydb://session/3?node_id=1&id=ZGE5OGU4NzUtNjFkYzZjODAtYTQ2YjQwMTAtYjcwZDAwNQ==, PoolId: }. Shards nodes resolve failed, status: UNAVAILABLE, issues: <main>: Error: Failed to resolve tablet: 72075186224037890 after several retries.
2025-10-15T10:53:22.016528Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2830: SessionId: ydb://session/3?node_id=1&id=ZGE5OGU4NzUtNjFkYzZjODAtYTQ2YjQwMTAtYjcwZDAwNQ==, ActorId: [1:7561399877650662965:2504], ActorState: ExecuteState, TraceId: 01k7kr1hee8j7rx10c9zkd7vds, Create QueryResponse for error on request, msg: 
2025-10-15T10:53:22.017827Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Failed to resolve tablet: 72075186224037890 after several retries." severity: 1 } TxMeta { id: "01k7kr1j73dj0cwsa7tp0rm0kz" } } YdbStatus: UNAVAILABLE ConsumedRu: 519 }
2025-10-15T10:53:22.848348Z node 1 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710687, task: 1, CA Id [1:7561399877650662945:2502]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
